Package org.apache.beam.runners.dataflow
Interface TransformTranslator.TranslationContext
- Enclosing interface:
TransformTranslator<TransformT extends PTransform>
public static interface TransformTranslator.TranslationContext
The interface provided to registered callbacks for interacting with the
DataflowRunner
,
including reading and writing the values of PCollection
s and side inputs.-
Method Summary
Modifier and TypeMethodDescriptionaddStep
(PTransform<?, ?> transform, String type) Adds a step to the Dataflow workflow for the given transform, with the given Dataflow step type.asOutputReference
(PValue value, org.apache.beam.sdk.runners.AppliedPTransform<?, ?, ?> producer) Encode a PValue reference as an output reference.org.apache.beam.sdk.runners.AppliedPTransform
<?, ?, ?> Gets the parent composite transform to the current transform, if one exists.org.apache.beam.sdk.runners.AppliedPTransform
<?, ?, ?> getFullName
(PTransform<?, ?> transform) Returns the full name of the currently being translated transform.<InputT extends PValue>
InputTgetInput
(PTransform<InputT, ?> transform) <InputT extends PInput>
Map<TupleTag<?>, PCollection<?>> getInputs
(PTransform<InputT, ?> transform) Returns the input of the currently being translated transform.<OutputT extends PValue>
OutputTgetOutput
(PTransform<?, OutputT> transform) <OutputT extends POutput>
Map<TupleTag<?>, PCollection<?>> getOutputs
(PTransform<?, OutputT> transform) Returns the output of the currently being translated transform.Returns the configured pipeline options.org.apache.beam.sdk.runners.AppliedPTransform
<?, ?, ?> getProducer
(PValue value) Get theAppliedPTransform
that produced the providedPValue
.org.apache.beam.sdk.util.construction.SdkComponents
default boolean
-
Method Details
-
isStreamingEngine
default boolean isStreamingEngine() -
getPipelineOptions
DataflowPipelineOptions getPipelineOptions()Returns the configured pipeline options. -
getInputs
Returns the input of the currently being translated transform. -
getInput
-
getOutputs
<OutputT extends POutput> Map<TupleTag<?>,PCollection<?>> getOutputs(PTransform<?, OutputT> transform) Returns the output of the currently being translated transform. -
getOutput
-
getFullName
Returns the full name of the currently being translated transform. -
addStep
Adds a step to the Dataflow workflow for the given transform, with the given Dataflow step type. -
asOutputReference
OutputReference asOutputReference(PValue value, org.apache.beam.sdk.runners.AppliedPTransform<?, ?, ?> producer) Encode a PValue reference as an output reference. -
getSdkComponents
org.apache.beam.sdk.util.construction.SdkComponents getSdkComponents() -
getCurrentTransform
org.apache.beam.sdk.runners.AppliedPTransform<?,?, getCurrentTransform()?> -
getProducer
Get theAppliedPTransform
that produced the providedPValue
. -
getCurrentParent
org.apache.beam.sdk.runners.AppliedPTransform<?,?, getCurrentParent()?> Gets the parent composite transform to the current transform, if one exists. Otherwise returns one null.
-