org.apache.beam.runners.spark

Class SparkPipelineResult

java.lang.Object

org.apache.beam.runners.spark.SparkPipelineResult

All Implemented Interfaces:

PipelineResult

Direct Known Subclasses:

SparkRunnerDebugger.DebugSparkPipelineResult

public abstract class SparkPipelineResult
extends java.lang.Object
implements PipelineResult

Represents a Spark pipeline execution result.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.beam.sdk.PipelineResult

PipelineResult.State

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.spark.api.java.JavaSparkContext	javaSparkContext
protected java.util.concurrent.Future	pipelineExecution
protected PipelineResult.State	state

Method Summary

Modifier and Type	Method and Description
protected abstract PipelineResult.State	awaitTermination(Duration duration)
PipelineResult.State	cancel() Cancels the pipeline execution.
PipelineResult.State	getState() Retrieves the current state of the pipeline execution.
MetricResults	metrics() Returns the object to access metrics from the pipeline.
protected abstract void	stop()
PipelineResult.State	waitUntilFinish() Waits until the pipeline finishes and returns the final status.
PipelineResult.State	waitUntilFinish(Duration duration) Waits until the pipeline finishes and returns the final status.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

pipelineExecution

protected final java.util.concurrent.Future pipelineExecution

javaSparkContext

protected org.apache.spark.api.java.JavaSparkContext javaSparkContext

state

protected PipelineResult.State state

Method Detail

stop

protected abstract void stop()

awaitTermination

protected abstract PipelineResult.State awaitTermination(Duration duration)
                                                  throws java.util.concurrent.TimeoutException,
                                                         java.util.concurrent.ExecutionException,
                                                         java.lang.InterruptedException

Throws:

java.util.concurrent.TimeoutException

java.util.concurrent.ExecutionException

java.lang.InterruptedException

getState

public PipelineResult.State getState()

Description copied from interface: PipelineResult

Retrieves the current state of the pipeline execution.

Specified by:

getState in interface PipelineResult

Returns:

the PipelineResult.State representing the state of this pipeline.

waitUntilFinish

public PipelineResult.State waitUntilFinish()

Description copied from interface: PipelineResult

Waits until the pipeline finishes and returns the final status.

Specified by:

waitUntilFinish in interface PipelineResult

Returns:

The final state of the pipeline.

waitUntilFinish

public PipelineResult.State waitUntilFinish(Duration duration)

Description copied from interface: PipelineResult

Waits until the pipeline finishes and returns the final status. It times out after the given duration.

Specified by:

waitUntilFinish in interface PipelineResult

Parameters:

duration - The time to wait for the pipeline to finish. Provide a value less than 1 ms for an infinite wait.

Returns:

The final state of the pipeline or null on timeout.

metrics

public MetricResults metrics()

Description copied from interface: PipelineResult

Returns the object to access metrics from the pipeline.

Specified by:

metrics in interface PipelineResult

cancel

public PipelineResult.State cancel()
                            throws java.io.IOException

Description copied from interface: PipelineResult

Cancels the pipeline execution.

Specified by:

cancel in interface PipelineResult

Throws:

java.io.IOException - if there is a problem executing the cancel request.