Package org.apache.beam.runners.flink

Class FlinkPipelineRunner

java.lang.Object

org.apache.beam.runners.flink.FlinkPipelineRunner

All Implemented Interfaces:

PortablePipelineRunner

public class FlinkPipelineRunner
extends Object
implements PortablePipelineRunner

Runs a Pipeline on Flink via FlinkRunner.

Constructor Summary

Constructors

Constructor	Description
FlinkPipelineRunner(FlinkPipelineOptions pipelineOptions, @Nullable String confDir, List<String> filesToStage)	Setup a flink pipeline runner.

Method Summary

Modifier and Type	Method	Description
static void	main(String[] args)	Main method to be called only as the entry point to an executable jar with structure as defined in PortablePipelineJarUtils.
PortablePipelineResult	run(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline, JobInfo jobInfo)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

FlinkPipelineRunner

public FlinkPipelineRunner(FlinkPipelineOptions pipelineOptions,
 @Nullable String confDir,
 List<String> filesToStage)

Setup a flink pipeline runner.

Parameters:

pipelineOptions - pipeline options configuring the flink pipeline runner.

confDir - flink configuration directory. Note that pipeline option's flinkConfDir, If not null, takes precedence against this parameter.

filesToStage - a list of file names to stage.

Method Details

run

public PortablePipelineResult run(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline,
 JobInfo jobInfo)
                           throws Exception

Specified by:

run in interface PortablePipelineRunner

Throws:

Exception

main

public static void main(String[] args)
                 throws Exception

Main method to be called only as the entry point to an executable jar with structure as defined in PortablePipelineJarUtils.

Throws:

Exception