Package org.apache.beam.runners.spark.structuredstreaming.translation.batch.functions

package org.apache.beam.runners.spark.structuredstreaming.translation.batch.functions

Internal implementation of the Beam runner for Apache Spark.

Related Packages

Package	Description
org.apache.beam.runners.spark.structuredstreaming.translation.batch	Internal utilities to translate Beam pipelines to Spark batching.

Class	Description
CachedSideInputReader	SideInputReader that caches results for costly Materializations.
GroupAlsoByWindowViaOutputBufferFn<K,InputT,W extends BoundedWindow>	A FlatMap function that groups by windows in batch mode using ReduceFnRunner.
NoOpStepContext	A StepContext for Spark Batch Runner execution.
SideInputValues<T>	SideInputValues serves as a Kryo serializable container that contains a materialized view of side inputs.
SideInputValues.BaseSideInputValues<BinaryT,ValuesT extends @NonNull Object,T>
SideInputValues.ByWindow<T>	General SideInputValues for BoundedWindows in two possible states.
SideInputValues.Global<T>	Specialized SideInputValues for use with the GlobalWindow in two possible states.
SideInputValues.Loader<T>	Factory function for load SideInputValues from a Dataset.
SparkSideInputReader	SideInputReader using broadcasted SideInputValues.