Package org.apache.beam.runners.spark.structuredstreaming.metrics

package org.apache.beam.runners.spark.structuredstreaming.metrics

Provides internal utilities for implementing Beam metrics using Spark accumulators.

Related Packages

Package	Description
org.apache.beam.runners.spark.structuredstreaming	Internal implementation of the Beam runner for Apache Spark.
org.apache.beam.runners.spark.structuredstreaming.metrics.sink	Spark sinks that supports beam metrics and aggregators.
org.apache.beam.runners.spark.structuredstreaming.examples
org.apache.beam.runners.spark.structuredstreaming.io	Spark-specific transforms for I/O.
org.apache.beam.runners.spark.structuredstreaming.translation	Internal translators for running Beam pipelines on Spark.

Classes

Class	Description
MetricsAccumulator	AccumulatorV2 for Beam metrics captured in MetricsContainerStepMap.
SparkBeamMetricSource	A Spark Source that is tailored to expose a SparkBeamMetric, wrapping an underlying MetricResults instance.
WithMetricsSupport	A MetricRegistry decorator-like that supports BeamMetricSets as Gauges.