org.apache.beam.runners.fnexecution.graph

Class LengthPrefixUnknownCoders

java.lang.Object

org.apache.beam.runners.fnexecution.graph.LengthPrefixUnknownCoders

public class LengthPrefixUnknownCoders
extends java.lang.Object

Utilities for replacing or wrapping unknown coders with LengthPrefixCoder.

TODO: Support a dynamic list of well known coders using either registration or manual listing, possibly from ModelCoderRegistrar.

Constructor Summary

Constructors

Constructor and Description
LengthPrefixUnknownCoders()

Method Summary

Modifier and Type	Method and Description
static org.apache.beam.model.pipeline.v1.RunnerApi.MessageWithComponents	forCoder(java.lang.String coderId, org.apache.beam.model.pipeline.v1.RunnerApi.Components components, boolean replaceWithByteArrayCoder) Recursively traverse the coder tree and wrap the first unknown coder in every branch with a LengthPrefixCoder unless an ancestor coder is itself a LengthPrefixCoder.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LengthPrefixUnknownCoders

public LengthPrefixUnknownCoders()

Method Detail

forCoder

public static org.apache.beam.model.pipeline.v1.RunnerApi.MessageWithComponents forCoder(java.lang.String coderId,
                                                                                         org.apache.beam.model.pipeline.v1.RunnerApi.Components components,
                                                                                         boolean replaceWithByteArrayCoder)

Recursively traverse the coder tree and wrap the first unknown coder in every branch with a LengthPrefixCoder unless an ancestor coder is itself a LengthPrefixCoder. If replaceWithByteArrayCoder is set, then replace that unknown coder with a ByteArrayCoder. Note that no ids that are generated will collide with the ids supplied within the coder map key space.

Parameters:

coderId - The root coder contained within coders to start the recursive descent from.

components - Contains the root coder and all component coders.

replaceWithByteArrayCoder - whether to replace an unknown coder with a ByteArrayCoder.

Returns:

A RunnerApi.MessageWithComponents with the root coder and its component coders. Note that no ids that are generated will collide with the ids supplied within the coder map key space.