Package org.apache.beam.runners.spark

Class SparkJobInvoker

java.lang.Object

org.apache.beam.runners.jobsubmission.JobInvoker

org.apache.beam.runners.spark.SparkJobInvoker

public class SparkJobInvoker
extends JobInvoker

Creates a job invocation to manage the Spark runner's execution of a portable pipeline.

Method Summary

Modifier and Type	Method	Description
static SparkJobInvoker	create(SparkJobServerDriver.SparkServerConfiguration configuration)
protected JobInvocation	invokeWithExecutor(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline, org.apache.beam.vendor.grpc.v1p69p0.com.google.protobuf.Struct options, @Nullable String retrievalToken, org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.util.concurrent.ListeningExecutorService executorService)	Start running a job, abstracting its state as a JobInvocation instance.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

create

public static SparkJobInvoker create(SparkJobServerDriver.SparkServerConfiguration configuration)

invokeWithExecutor

protected JobInvocation invokeWithExecutor(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline,
 org.apache.beam.vendor.grpc.v1p69p0.com.google.protobuf.Struct options,
 @Nullable String retrievalToken,
 org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.util.concurrent.ListeningExecutorService executorService)

Description copied from class: JobInvoker

Start running a job, abstracting its state as a JobInvocation instance.

Specified by:

invokeWithExecutor in class JobInvoker