org.apache.beam.runners.fnexecution.wire

Class WireCoders

java.lang.Object

org.apache.beam.runners.fnexecution.wire.WireCoders

public class WireCoders
extends java.lang.Object

Helpers to construct coders for gRPC port reads and writes.

Method Summary

Modifier and Type	Method and Description
static org.apache.beam.model.pipeline.v1.RunnerApi.MessageWithComponents	createRunnerWireCoder(org.apache.beam.runners.core.construction.graph.PipelineNode.PCollectionNode pCollectionNode, org.apache.beam.model.pipeline.v1.RunnerApi.Components components, java.util.function.Predicate<java.lang.String> idUsed) Creates a runner-side wire coder for a port read/write for the given PCollection.
static org.apache.beam.model.pipeline.v1.RunnerApi.MessageWithComponents	createSdkWireCoder(org.apache.beam.runners.core.construction.graph.PipelineNode.PCollectionNode pCollectionNode, org.apache.beam.model.pipeline.v1.RunnerApi.Components components, java.util.function.Predicate<java.lang.String> idUsed) Creates an SDK-side wire coder for a port read/write for the given PCollection.
static <T> Coder<org.apache.beam.sdk.util.WindowedValue<T>>	instantiateRunnerWireCoder(org.apache.beam.runners.core.construction.graph.PipelineNode.PCollectionNode pCollectionNode, org.apache.beam.model.pipeline.v1.RunnerApi.Components components) Instantiates a runner-side wire coder for the given PCollection.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

createSdkWireCoder

public static org.apache.beam.model.pipeline.v1.RunnerApi.MessageWithComponents createSdkWireCoder(org.apache.beam.runners.core.construction.graph.PipelineNode.PCollectionNode pCollectionNode,
                                                                                                   org.apache.beam.model.pipeline.v1.RunnerApi.Components components,
                                                                                                   java.util.function.Predicate<java.lang.String> idUsed)

Creates an SDK-side wire coder for a port read/write for the given PCollection. Coders that are unknown to the runner are wrapped with length-prefix coders. The inner element coders are kept intact so that SDK harnesses can reconstruct the original elements.

Returns:

a windowed value coder containing the PCollection's element coder

createRunnerWireCoder

public static org.apache.beam.model.pipeline.v1.RunnerApi.MessageWithComponents createRunnerWireCoder(org.apache.beam.runners.core.construction.graph.PipelineNode.PCollectionNode pCollectionNode,
                                                                                                      org.apache.beam.model.pipeline.v1.RunnerApi.Components components,
                                                                                                      java.util.function.Predicate<java.lang.String> idUsed)

Creates a runner-side wire coder for a port read/write for the given PCollection. Unknown coders are replaced with length-prefixed byte arrays.

Returns:

a windowed value coder containing the PCollection's element coder

instantiateRunnerWireCoder

public static <T> Coder<org.apache.beam.sdk.util.WindowedValue<T>> instantiateRunnerWireCoder(org.apache.beam.runners.core.construction.graph.PipelineNode.PCollectionNode pCollectionNode,
                                                                                              org.apache.beam.model.pipeline.v1.RunnerApi.Components components)
                                                                                       throws java.io.IOException

Instantiates a runner-side wire coder for the given PCollection. Any component coders that are unknown by the runner are replaced with length-prefixed byte arrays.

Returns:

a windowed value coder containing the PCollection's element coder

Throws:

java.io.IOException