Package org.apache.beam.runners.spark

Class SparkPipelineRunner

java.lang.Object

org.apache.beam.runners.spark.SparkPipelineRunner

All Implemented Interfaces:

PortablePipelineRunner

public class SparkPipelineRunner
extends Object
implements PortablePipelineRunner

Runs a portable pipeline on Apache Spark.

Constructor Summary

Constructors

Constructor	Description
SparkPipelineRunner(SparkPipelineOptions pipelineOptions)

Method Summary

Modifier and Type	Method	Description
static void	main(String[] args)	Main method to be called only as the entry point to an executable jar with structure as defined in PortablePipelineJarUtils.
PortablePipelineResult	run(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline, JobInfo jobInfo)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

SparkPipelineRunner

public SparkPipelineRunner(SparkPipelineOptions pipelineOptions)

Method Details

run

public PortablePipelineResult run(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline,
 JobInfo jobInfo)

Specified by:

run in interface PortablePipelineRunner

main

public static void main(String[] args)
                 throws Exception

Main method to be called only as the entry point to an executable jar with structure as defined in PortablePipelineJarUtils.

Throws:

Exception