Package org.apache.beam.runners.spark.util

package org.apache.beam.runners.spark.util

Internal utilities to translate Beam pipelines to Spark.

Related Packages

Package	Description
org.apache.beam.runners.spark	Internal implementation of the Beam runner for Apache Spark.

Classes

Class	Description
ByteArray	Serializable byte array.
CachedSideInputReader	SideInputReader that caches materialized views.
GlobalWatermarkHolder	A store to hold the global watermarks for a micro-batch.
GlobalWatermarkHolder.SparkWatermarks	A GlobalWatermarkHolder.SparkWatermarks holds the watermarks and batch time relevant to a micro-batch input from a specific source.
GlobalWatermarkHolder.WatermarkAdvancingStreamingListener	Advance the WMs onBatchCompleted event.
SideInputBroadcast<T>	Broadcast helper for side inputs.
SideInputReaderFactory	Utility class for creating and managing side input readers in the Spark runner.
SparkSideInputReader	A SideInputReader for the SparkRunner.
TimerUtils	Utility class for handling timers in the Spark runner.
TimerUtils.TimerMarker	A marker class used to identify timer keys and values in Spark transformations.