org.apache.beam.runners.spark

Class SparkPipelineRunner

java.lang.Object

org.apache.beam.runners.spark.SparkPipelineRunner

All Implemented Interfaces:

PortablePipelineRunner

public class SparkPipelineRunner
extends java.lang.Object
implements PortablePipelineRunner

Runs a portable pipeline on Apache Spark.

Constructor Summary

Constructors

Constructor and Description
SparkPipelineRunner(SparkPipelineOptions pipelineOptions)

Method Summary

Modifier and Type	Method and Description
static void	main(java.lang.String[] args) Main method to be called only as the entry point to an executable jar with structure as defined in PortablePipelineJarUtils.
PortablePipelineResult	run(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline, JobInfo jobInfo)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkPipelineRunner

public SparkPipelineRunner(SparkPipelineOptions pipelineOptions)

Method Detail

run

public PortablePipelineResult run(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline,
                                  JobInfo jobInfo)

Specified by:

run in interface PortablePipelineRunner

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Main method to be called only as the entry point to an executable jar with structure as defined in PortablePipelineJarUtils.

Throws:

java.lang.Exception