org.apache.beam.runners.flink

Class FlinkPipelineRunner

java.lang.Object

org.apache.beam.runners.flink.FlinkPipelineRunner

All Implemented Interfaces:

PortablePipelineRunner

public class FlinkPipelineRunner
extends java.lang.Object
implements PortablePipelineRunner

Runs a Pipeline on Flink via FlinkRunner.

Constructor Summary

Constructors

Constructor and Description
FlinkPipelineRunner(FlinkPipelineOptions pipelineOptions, @Nullable java.lang.String confDir, java.util.List<java.lang.String> filesToStage) Setup a flink pipeline runner.

Method Summary

Modifier and Type	Method and Description
static void	main(java.lang.String[] args) Main method to be called only as the entry point to an executable jar with structure as defined in PortablePipelineJarUtils.
PortablePipelineResult	run(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline, JobInfo jobInfo)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FlinkPipelineRunner

public FlinkPipelineRunner(FlinkPipelineOptions pipelineOptions,
                           @Nullable java.lang.String confDir,
                           java.util.List<java.lang.String> filesToStage)

Setup a flink pipeline runner.

Parameters:

pipelineOptions - pipeline options configuring the flink pipeline runner.

confDir - flink configuration directory. Note that pipeline option's flinkConfDir, If not null, takes precedence against this parameter.

filesToStage - a list of file names to stage.

Method Detail

run

public PortablePipelineResult run(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline,
                                  JobInfo jobInfo)
                           throws java.lang.Exception

Specified by:

run in interface PortablePipelineRunner

Throws:

java.lang.Exception

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Main method to be called only as the entry point to an executable jar with structure as defined in PortablePipelineJarUtils.

Throws:

java.lang.Exception