Package org.apache.beam.runners.spark.metrics

Class MetricsAccumulator.AccumulatorCheckpointingSparkListener

java.lang.Object
org.apache.spark.streaming.api.java.JavaStreamingListener
org.apache.beam.runners.spark.metrics.MetricsAccumulator.AccumulatorCheckpointingSparkListener
Enclosing class:
MetricsAccumulator
public static class MetricsAccumulator.AccumulatorCheckpointingSparkListener extends org.apache.spark.streaming.api.java.JavaStreamingListener
Spark Listener which checkpoints MetricsContainerStepMap values for fault-tolerance.

  • Constructor Summary

    Constructors
    Constructor
    Description
    AccumulatorCheckpointingSparkListener()
     

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    onBatchCompleted(org.apache.spark.streaming.api.java.JavaStreamingListenerBatchCompleted batchCompleted)
     

    Methods inherited from class org.apache.spark.streaming.api.java.JavaStreamingListener

    onBatchStarted, onBatchSubmitted, onOutputOperationCompleted, onOutputOperationStarted, onReceiverError, onReceiverStarted, onReceiverStopped, onStreamingStarted

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Constructor Details

    • AccumulatorCheckpointingSparkListener

      public AccumulatorCheckpointingSparkListener()

  • Method Details

    • onBatchCompleted

      public void onBatchCompleted(org.apache.spark.streaming.api.java.JavaStreamingListenerBatchCompleted batchCompleted)
      Overrides:
      onBatchCompleted in class org.apache.spark.streaming.api.java.JavaStreamingListener