org.apache.beam.runners.spark

Class SparkPipelineRunner

java.lang.Object

org.apache.beam.runners.spark.SparkPipelineRunner

All Implemented Interfaces:

PortablePipelineRunner

public class SparkPipelineRunner
extends java.lang.Object
implements PortablePipelineRunner

Runs a portable pipeline on Apache Spark.

Constructor Summary

Constructors

Constructor and Description
SparkPipelineRunner(SparkPipelineOptions pipelineOptions)

Method Summary

Modifier and Type	Method and Description
SparkPipelineResult	run(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline, JobInfo jobInfo)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkPipelineRunner

public SparkPipelineRunner(SparkPipelineOptions pipelineOptions)

Method Detail

run

public SparkPipelineResult run(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline,
                               JobInfo jobInfo)

Specified by:

run in interface PortablePipelineRunner