Package org.apache.beam.runners.dataflow
Interface TransformTranslator.StepTranslationContext
- Enclosing interface:
TransformTranslator<TransformT extends PTransform>
public static interface TransformTranslator.StepTranslationContext
The interface for a
TransformTranslator to build a Dataflow step.-
Method Summary
Modifier and TypeMethodDescriptionvoidaddCollectionToSingletonOutput(PCollection<?> inputValue, String outputName, PCollectionView<?> outputValue) Adds an output to thisCollectionToSingletonDataflow step, consuming the specified inputPValueand producing the specified outputPValue.voidaddEncodingInput(Coder<?> value) Sets the encoding for this Dataflow step.voidAdds an input with the given name and value to this Dataflow step.voidAdds an input with the given name and value to this Dataflow step.voidAdds an input with the given name and value to this Dataflow step.voidAdds an input that is a list of objects.voidAdds an input that is a dictionary of strings to objects.voidAdds an input with the given name to this Dataflow step, coming from the specified input PValue.voidaddOutput(String name, PCollection<?> value) Adds a primitive output to this Dataflow step with the given name as the local output name, producing the specified outputPValue, including itsCoderif aTypedPValue.
-
Method Details
-
addEncodingInput
Sets the encoding for this Dataflow step. -
addInput
Adds an input with the given name and value to this Dataflow step. -
addInput
Adds an input with the given name and value to this Dataflow step. -
addInput
Adds an input with the given name and value to this Dataflow step. -
addInput
Adds an input with the given name to this Dataflow step, coming from the specified input PValue.The input
PValuemust have already been produced by a step earlier in thisPipeline. If the input value has not yet been produced yet (by a call to eitheraddOutput(java.lang.String, org.apache.beam.sdk.values.PCollection<?>)oraddCollectionToSingletonOutput(org.apache.beam.sdk.values.PCollection<?>, java.lang.String, org.apache.beam.sdk.values.PCollectionView<?>)) this method will throw an exception. -
addInput
Adds an input that is a dictionary of strings to objects. -
addInput
Adds an input that is a list of objects. -
addOutput
Adds a primitive output to this Dataflow step with the given name as the local output name, producing the specified outputPValue, including itsCoderif aTypedPValue. If thePValueis aPCollection, wraps its coder inside aWindowedValueCoder. -
addCollectionToSingletonOutput
void addCollectionToSingletonOutput(PCollection<?> inputValue, String outputName, PCollectionView<?> outputValue) Adds an output to thisCollectionToSingletonDataflow step, consuming the specified inputPValueand producing the specified outputPValue. This step requires special treatment for its output encoding. Returns a pipeline level unique id.
-