See: Description
Interface | Description |
---|---|
TransformTranslator<TransformT extends PTransform> |
Supports translation between a Beam transform, and Spark's operations on Datasets.
|
Class | Description |
---|---|
AbstractTranslationContext |
Base class that gives a context for
PTransform translation: keeping track of the
datasets, the SparkSession , the current transform being translated. |
PipelineTranslator |
Pipeline.PipelineVisitor that translates the Beam operators to their Spark counterparts. |
TranslationContext |
Subclass of
AbstractTranslationContext that
address spark breaking changes. |