See: Description
| Class | Description |
|---|---|
| PipelineTranslator |
Pipeline.PipelineVisitor that translates the Beam operators to their Spark counterparts. |
| SparkSessionFactory | |
| TransformTranslator<InT extends PInput,OutT extends POutput,TransformT extends PTransform<? extends InT,OutT>> |
Supports translation between a Beam transform, and Spark's operations on Datasets.
|
| TranslationContext |
Base class that gives a context for
PTransform translation: keeping track of the
datasets, the SparkSession, the current transform being translated. |