Package org.apache.beam.runners.spark.metrics

package org.apache.beam.runners.spark.metrics

Provides internal utilities for implementing Beam metrics using Spark accumulators.

Related Packages

Package	Description
org.apache.beam.runners.spark	Internal implementation of the Beam runner for Apache Spark.
org.apache.beam.runners.spark.metrics.sink	Spark sinks that supports beam metrics and aggregators.

Classes

Class	Description
MetricsAccumulator	For resilience, Accumulators are required to be wrapped in a Singleton.
MetricsAccumulator.AccumulatorCheckpointingSparkListener	Spark Listener which checkpoints MetricsContainerStepMap values for fault-tolerance.
MetricsContainerStepMapAccumulator	AccumulatorV2 implementation for MetricsContainerStepMap.
SparkBeamMetricSource	A Spark Source that is tailored to expose a SparkBeamMetric, wrapping an underlying MetricResults instance.
WithMetricsSupport	A MetricRegistry decorator-like that supports invalid reference AggregatorMetric and SparkBeamMetric as Gauges.