org.apache.beam.runners.spark.metrics

Class MetricsAccumulator

java.lang.Object

org.apache.beam.runners.spark.metrics.MetricsAccumulator

public class MetricsAccumulator
extends java.lang.Object

For resilience, Accumulators are required to be wrapped in a Singleton.

See Also:

accumulatorsV2

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	MetricsAccumulator.AccumulatorCheckpointingSparkListener Spark Listener which checkpoints MetricsContainerStepMap values for fault-tolerance.

Constructor Summary

Constructors

Constructor and Description
MetricsAccumulator()

Method Summary

Modifier and Type	Method and Description
static void	clear()
static MetricsContainerStepMapAccumulator	getInstance()
static void	init(SparkPipelineOptions opts, org.apache.spark.api.java.JavaSparkContext jsc) Init metrics accumulator if it has not been initiated.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MetricsAccumulator

public MetricsAccumulator()

Method Detail

init

public static void init(SparkPipelineOptions opts,
                        org.apache.spark.api.java.JavaSparkContext jsc)

Init metrics accumulator if it has not been initiated. This method is idempotent.

getInstance

public static MetricsContainerStepMapAccumulator getInstance()

clear

public static void clear()