org.apache.beam.runners.spark.aggregators

Class AggregatorsAccumulator.AccumulatorCheckpointingSparkListener

java.lang.Object

org.apache.spark.streaming.api.java.JavaStreamingListener

org.apache.beam.runners.spark.aggregators.AggregatorsAccumulator.AccumulatorCheckpointingSparkListener

Enclosing class:

AggregatorsAccumulator

public static class AggregatorsAccumulator.AccumulatorCheckpointingSparkListener
extends org.apache.spark.streaming.api.java.JavaStreamingListener

Spark Listener which checkpoints NamedAggregators values for fault-tolerance.

Constructor Summary

Constructors

Constructor and Description
AccumulatorCheckpointingSparkListener()

Method Summary

Modifier and Type	Method and Description
void	onBatchCompleted(org.apache.spark.streaming.api.java.JavaStreamingListenerBatchCompleted batchCompleted)

Methods inherited from class org.apache.spark.streaming.api.java.JavaStreamingListener

onBatchStarted, onBatchSubmitted, onOutputOperationCompleted, onOutputOperationStarted, onReceiverError, onReceiverStarted, onReceiverStopped, onStreamingStarted

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AccumulatorCheckpointingSparkListener

public AccumulatorCheckpointingSparkListener()

Method Detail

onBatchCompleted

public void onBatchCompleted(org.apache.spark.streaming.api.java.JavaStreamingListenerBatchCompleted batchCompleted)

Overrides:

onBatchCompleted in class org.apache.spark.streaming.api.java.JavaStreamingListener