public class PipelineTranslatorBatch extends PipelineTranslator
PipelineTranslator
for executing a Pipeline
in Spark in batch mode. This contains
only the components specific to batch: registry of batch TransformTranslator
and registry
lookup code.Pipeline.PipelineVisitor.CompositeBehavior, Pipeline.PipelineVisitor.Defaults
translationContext
Constructor and Description |
---|
PipelineTranslatorBatch(SparkStructuredStreamingPipelineOptions options) |
Modifier and Type | Method and Description |
---|---|
protected TransformTranslator<?> |
getTransformTranslator(org.apache.beam.sdk.runners.TransformHierarchy.Node node)
Returns a translator for the given node, if it is possible, otherwise null.
|
detectTranslationMode, enterCompositeTransform, getTranslationContext, isLocalSparkMaster, leaveCompositeTransform, prepareFilesToStageForRemoteClusterExecution, replaceTransforms, translate, visitPrimitiveTransform
enterPipeline, getPipeline, leavePipeline, visitValue
public PipelineTranslatorBatch(SparkStructuredStreamingPipelineOptions options)
protected TransformTranslator<?> getTransformTranslator(org.apache.beam.sdk.runners.TransformHierarchy.Node node)
getTransformTranslator
in class PipelineTranslator