org.apache.beam.runners.spark.structuredstreaming.translation.batch

Class PipelineTranslatorBatch

java.lang.Object

org.apache.beam.runners.spark.structuredstreaming.translation.PipelineTranslator

org.apache.beam.runners.spark.structuredstreaming.translation.batch.PipelineTranslatorBatch

@Internal
public class PipelineTranslatorBatch
extends PipelineTranslator

PipelineTranslator for executing a Pipeline in Spark in batch mode. This contains only the components specific to batch: registry of batch TransformTranslator and registry lookup code.

Constructor Summary

Constructors

Constructor and Description
PipelineTranslatorBatch()

Method Summary

Modifier and Type	Method and Description
protected <InT extends PInput,OutT extends POutput,TransformT extends PTransform<InT,OutT>> @Nullable TransformTranslator<InT,OutT,TransformT>	getTransformTranslator(TransformT transform) Returns a TransformTranslator for the given PTransform if known.

Methods inherited from class org.apache.beam.runners.spark.structuredstreaming.translation.PipelineTranslator

detectStreamingMode, replaceTransforms, translate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PipelineTranslatorBatch

public PipelineTranslatorBatch()

Method Detail

getTransformTranslator

protected <InT extends PInput,OutT extends POutput,TransformT extends PTransform<InT,OutT>> @Nullable TransformTranslator<InT,OutT,TransformT> getTransformTranslator(TransformT transform)

Returns a TransformTranslator for the given PTransform if known.

Specified by:

getTransformTranslator in class PipelineTranslator