Class MetricsAccumulator

java.lang.Object
org.apache.beam.runners.spark.metrics.MetricsAccumulator

public class MetricsAccumulator extends Object
For resilience, Accumulators are required to be wrapped in a Singleton.
See Also:
  • Constructor Details

    • MetricsAccumulator

      public MetricsAccumulator()
  • Method Details

    • init

      public static void init(SparkPipelineOptions opts, org.apache.spark.api.java.JavaSparkContext jsc)
      Init metrics accumulator if it has not been initiated. This method is idempotent.
    • init

      public static void init(SparkPipelineOptions opts, org.apache.spark.api.java.JavaSparkContext jsc, boolean useCheckpoint)
      Init metrics accumulator if it has not been initiated. This method is idempotent. With useCheckpoint set, the value is recovered from the metrics checkpoint under the checkpoint directory of opts, and MetricsAccumulator.AccumulatorCheckpointingSparkListener writes it back there. The DStream streaming path is the one using that checkpoint.
    • getInstance

      public static MetricsContainerStepMapAccumulator getInstance()
    • clear

      public static void clear()