Package org.apache.beam.runners.spark.structuredstreaming.translation

Internal translators for running Beam pipelines on Spark.

See: Description

Interface Summary

Interface	Description
TransformTranslator<TransformT extends PTransform>	Supports translation between a Beam transform, and Spark's operations on Datasets.

Class Summary

Class	Description
PipelineTranslator	Pipeline.PipelineVisitor that translates the Beam operators to their Spark counterparts.
SchemaHelpers	A SchemaHelpers for the Spark Batch Runner.
TranslationContext	Base class that gives a context for PTransform translation: keeping track of the datasets, the SparkSession, the current transform being translated.

Package org.apache.beam.runners.spark.structuredstreaming.translation Description

Internal translators for running Beam pipelines on Spark.