org.apache.beam.runners.flink

Class FlinkStreamingPortablePipelineTranslator

java.lang.Object

org.apache.beam.runners.flink.FlinkStreamingPortablePipelineTranslator

All Implemented Interfaces:

FlinkPortablePipelineTranslator<FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext>

public class FlinkStreamingPortablePipelineTranslator
extends java.lang.Object
implements FlinkPortablePipelineTranslator<FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext>

Translate an unbounded portable pipeline representation into a Flink pipeline representation.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	FlinkStreamingPortablePipelineTranslator.IsFlinkNativeTransform Predicate to determine whether a URN is a Flink native transform.
static class	FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext Streaming translation context.

Nested classes/interfaces inherited from interface org.apache.beam.runners.flink.FlinkPortablePipelineTranslator

FlinkPortablePipelineTranslator.TranslationContext

Method Summary

Modifier and Type	Method and Description
static FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext	createTranslationContext(JobInfo jobInfo, FlinkPipelineOptions pipelineOptions, java.util.List<java.lang.String> filesToStage) Creates a streaming translation context.
void	translate(FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext context, org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline) Translates the given pipeline.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

createTranslationContext

public static FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext createTranslationContext(JobInfo jobInfo,
                                                                                                            FlinkPipelineOptions pipelineOptions,
                                                                                                            java.util.List<java.lang.String> filesToStage)

Creates a streaming translation context. The resulting Flink execution dag will live in a new StreamExecutionEnvironment.

translate

public void translate(FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext context,
                      org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline)

Description copied from interface: FlinkPortablePipelineTranslator

Translates the given pipeline.

Specified by:

translate in interface FlinkPortablePipelineTranslator<FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext>