org.apache.beam.runners.spark.metrics

Class MetricsAccumulator

java.lang.Object

org.apache.beam.runners.spark.metrics.MetricsAccumulator

public class MetricsAccumulator
extends java.lang.Object

For resilience, Accumulators are required to be wrapped in a Singleton.

See Also:

accumulators

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	MetricsAccumulator.AccumulatorCheckpointingSparkListener Spark Listener which checkpoints MetricsContainerStepMap values for fault-tolerance.

Constructor Summary

Constructors

Constructor and Description
MetricsAccumulator()

Method Summary

Modifier and Type	Method and Description
static void	clear()
static org.apache.spark.Accumulator<org.apache.beam.runners.core.metrics.MetricsContainerStepMap>	getInstance()
static void	init(SparkPipelineOptions opts, org.apache.spark.api.java.JavaSparkContext jsc) Init metrics accumulator if it has not been initiated.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MetricsAccumulator

public MetricsAccumulator()

Method Detail

init

public static void init(SparkPipelineOptions opts,
                        org.apache.spark.api.java.JavaSparkContext jsc)

Init metrics accumulator if it has not been initiated. This method is idempotent.

getInstance

public static org.apache.spark.Accumulator<org.apache.beam.runners.core.metrics.MetricsContainerStepMap> getInstance()

clear

public static void clear()