org.apache.beam.runners.apex

Class ApexRunner

java.lang.Object

org.apache.beam.sdk.PipelineRunner<ApexRunnerResult>

org.apache.beam.runners.apex.ApexRunner

public class ApexRunner
extends PipelineRunner<ApexRunnerResult>

A PipelineRunner that translates the pipeline to an Apex DAG and executes it on an Apex cluster.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ApexRunner.CreateApexPCollectionView<ElemT,ViewT> Creates a primitive PCollectionView.

Field Summary

Fields

Modifier and Type	Field and Description
static java.util.concurrent.atomic.AtomicReference<java.lang.AssertionError>	ASSERTION_ERROR TODO: this isn't thread safe and may cause issues when tests run in parallel Holds any most resent assertion error that was raised while processing elements.
static java.lang.String	CLASSPATH_SCHEME
protected boolean	translateOnly

Constructor Summary

Constructors

Constructor and Description
ApexRunner(ApexPipelineOptions options)

Method Summary

Modifier and Type	Method and Description
static ApexRunner	fromOptions(PipelineOptions options)
protected java.util.List<org.apache.beam.sdk.runners.PTransformOverride>	getOverrides()
ApexRunnerResult	run(Pipeline pipeline) Processes the given Pipeline, potentially asynchronously, returning a runner-specific type of result.

Methods inherited from class org.apache.beam.sdk.PipelineRunner

create, run, run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CLASSPATH_SCHEME

public static final java.lang.String CLASSPATH_SCHEME

See Also:

Constant Field Values

translateOnly

protected boolean translateOnly

ASSERTION_ERROR

public static final java.util.concurrent.atomic.AtomicReference<java.lang.AssertionError> ASSERTION_ERROR

TODO: this isn't thread safe and may cause issues when tests run in parallel Holds any most resent assertion error that was raised while processing elements. Used in the unit test driver in embedded mode to propagate the exception.

Constructor Detail

ApexRunner

public ApexRunner(ApexPipelineOptions options)

Method Detail

fromOptions

public static ApexRunner fromOptions(PipelineOptions options)

getOverrides

protected java.util.List<org.apache.beam.sdk.runners.PTransformOverride> getOverrides()

run

public ApexRunnerResult run(Pipeline pipeline)

Description copied from class: PipelineRunner

Processes the given Pipeline, potentially asynchronously, returning a runner-specific type of result.

Specified by:

run in class PipelineRunner<ApexRunnerResult>