See: Description
Class | Description |
---|---|
PipelineTranslator |
Pipeline.PipelineVisitor that translates the Beam operators to their Spark counterparts. |
SparkSessionFactory | |
TransformTranslator<InT extends PInput,OutT extends POutput,TransformT extends PTransform<? extends InT,OutT>> |
Supports translation between a Beam transform, and Spark's operations on Datasets.
|
TranslationContext |
Base class that gives a context for
PTransform translation: keeping track of the
datasets, the SparkSession , the current transform being translated. |