Package org.apache.beam.runners.dataflow
Interface TransformTranslator.StepTranslationContext
- Enclosing interface:
TransformTranslator<TransformT extends PTransform>
public static interface TransformTranslator.StepTranslationContext
The interface for a
TransformTranslator
to build a Dataflow step.-
Method Summary
Modifier and TypeMethodDescriptionvoid
addCollectionToSingletonOutput
(PCollection<?> inputValue, String outputName, PCollectionView<?> outputValue) Adds an output to thisCollectionToSingleton
Dataflow step, consuming the specified inputPValue
and producing the specified outputPValue
.void
addEncodingInput
(Coder<?> value) Sets the encoding for this Dataflow step.void
Adds an input with the given name and value to this Dataflow step.void
Adds an input with the given name and value to this Dataflow step.void
Adds an input with the given name and value to this Dataflow step.void
Adds an input that is a list of objects.void
Adds an input that is a dictionary of strings to objects.void
Adds an input with the given name to this Dataflow step, coming from the specified input PValue.void
addOutput
(String name, PCollection<?> value) Adds a primitive output to this Dataflow step with the given name as the local output name, producing the specified outputPValue
, including itsCoder
if aTypedPValue
.
-
Method Details
-
addEncodingInput
Sets the encoding for this Dataflow step. -
addInput
Adds an input with the given name and value to this Dataflow step. -
addInput
Adds an input with the given name and value to this Dataflow step. -
addInput
Adds an input with the given name and value to this Dataflow step. -
addInput
Adds an input with the given name to this Dataflow step, coming from the specified input PValue.The input
PValue
must have already been produced by a step earlier in thisPipeline
. If the input value has not yet been produced yet (by a call to eitheraddOutput(java.lang.String, org.apache.beam.sdk.values.PCollection<?>)
oraddCollectionToSingletonOutput(org.apache.beam.sdk.values.PCollection<?>, java.lang.String, org.apache.beam.sdk.values.PCollectionView<?>)
) this method will throw an exception. -
addInput
Adds an input that is a dictionary of strings to objects. -
addInput
Adds an input that is a list of objects. -
addOutput
Adds a primitive output to this Dataflow step with the given name as the local output name, producing the specified outputPValue
, including itsCoder
if aTypedPValue
. If thePValue
is aPCollection
, wraps its coder inside aWindowedValueCoder
. -
addCollectionToSingletonOutput
void addCollectionToSingletonOutput(PCollection<?> inputValue, String outputName, PCollectionView<?> outputValue) Adds an output to thisCollectionToSingleton
Dataflow step, consuming the specified inputPValue
and producing the specified outputPValue
. This step requires special treatment for its output encoding. Returns a pipeline level unique id.
-