org.apache.beam.runners.spark

Class SparkJobInvoker

java.lang.Object

org.apache.beam.runners.jobsubmission.JobInvoker

org.apache.beam.runners.spark.SparkJobInvoker

public class SparkJobInvoker
extends JobInvoker

Creates a job invocation to manage the Spark runner's execution of a portable pipeline.

Method Summary

Modifier and Type	Method and Description
static SparkJobInvoker	create(SparkJobServerDriver.SparkServerConfiguration configuration)
protected JobInvocation	invokeWithExecutor(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline, org.apache.beam.vendor.grpc.v1p26p0.com.google.protobuf.Struct options, @Nullable java.lang.String retrievalToken, org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.ListeningExecutorService executorService) Start running a job, abstracting its state as a JobInvocation instance.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

create

public static SparkJobInvoker create(SparkJobServerDriver.SparkServerConfiguration configuration)

invokeWithExecutor

protected JobInvocation invokeWithExecutor(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline,
                                           org.apache.beam.vendor.grpc.v1p26p0.com.google.protobuf.Struct options,
                                           @Nullable java.lang.String retrievalToken,
                                           org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.ListeningExecutorService executorService)

Description copied from class: JobInvoker

Start running a job, abstracting its state as a JobInvocation instance.

Specified by:

invokeWithExecutor in class JobInvoker