Package org.apache.beam.runners.flink

Class FlinkStreamingPortablePipelineTranslator

java.lang.Object

org.apache.beam.runners.flink.FlinkStreamingPortablePipelineTranslator

All Implemented Interfaces:

FlinkPortablePipelineTranslator<FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext>

public class FlinkStreamingPortablePipelineTranslator
extends Object
implements FlinkPortablePipelineTranslator<FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext>

Translate an unbounded portable pipeline representation into a Flink pipeline representation.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	FlinkStreamingPortablePipelineTranslator.IsFlinkNativeTransform	Predicate to determine whether a URN is a Flink native transform.
static interface	FlinkStreamingPortablePipelineTranslator.PTransformTranslator<T>
static class	FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext	Streaming translation context.

Nested classes/interfaces inherited from interface org.apache.beam.runners.flink.FlinkPortablePipelineTranslator

FlinkPortablePipelineTranslator.Executor, FlinkPortablePipelineTranslator.TranslationContext

Constructor Summary

Constructors

Constructor	Description
FlinkStreamingPortablePipelineTranslator()
FlinkStreamingPortablePipelineTranslator(Map<String,FlinkStreamingPortablePipelineTranslator.PTransformTranslator<FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext>> extraTranslations)

Method Summary

Modifier and Type	Method	Description
FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext	createTranslationContext(JobInfo jobInfo, FlinkPipelineOptions pipelineOptions, String confDir, List<String> filesToStage)	Creates a streaming translation context.
FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext	createTranslationContext(JobInfo jobInfo, FlinkPipelineOptions pipelineOptions, org.apache.flink.streaming.api.environment.StreamExecutionEnvironment executionEnvironment)	Creates a streaming translation context.
Set<String>	knownUrns()
FlinkPortablePipelineTranslator.Executor	translate(FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext context, org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline)	Translates the given pipeline.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.beam.runners.flink.FlinkPortablePipelineTranslator

prepareForTranslation

Constructor Details

FlinkStreamingPortablePipelineTranslator

public FlinkStreamingPortablePipelineTranslator()

FlinkStreamingPortablePipelineTranslator

public FlinkStreamingPortablePipelineTranslator(Map<String,FlinkStreamingPortablePipelineTranslator.PTransformTranslator<FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext>> extraTranslations)

Method Details

createTranslationContext

public FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext createTranslationContext(JobInfo jobInfo,
 FlinkPipelineOptions pipelineOptions,
 String confDir,
 List<String> filesToStage)

Creates a streaming translation context. The resulting Flink execution dag will live in a new StreamExecutionEnvironment.

Specified by:

createTranslationContext in interface FlinkPortablePipelineTranslator<FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext>

createTranslationContext

public FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext createTranslationContext(JobInfo jobInfo,
 FlinkPipelineOptions pipelineOptions,
 org.apache.flink.streaming.api.environment.StreamExecutionEnvironment executionEnvironment)

Creates a streaming translation context. The resulting Flink execution dag will live in the given StreamExecutionEnvironment.

knownUrns

public Set<String> knownUrns()

Specified by:

knownUrns in interface FlinkPortablePipelineTranslator<FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext>

translate

public FlinkPortablePipelineTranslator.Executor translate(FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext context,
 org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline)

Description copied from interface: FlinkPortablePipelineTranslator

Translates the given pipeline.

Specified by:

translate in interface FlinkPortablePipelineTranslator<FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext>