org.apache.beam.runners.spark.structuredstreaming.translation.helpers

Class MultiOutputCoder<T>

java.lang.Object

org.apache.beam.sdk.coders.Coder<T>

org.apache.beam.sdk.coders.CustomCoder<scala.Tuple2<TupleTag<T>,org.apache.beam.sdk.util.WindowedValue<T>>>

org.apache.beam.runners.spark.structuredstreaming.translation.helpers.MultiOutputCoder<T>

Type Parameters:

T - type of the elements in the collection

All Implemented Interfaces:

java.io.Serializable

public class MultiOutputCoder<T>
extends CustomCoder<scala.Tuple2<TupleTag<T>,org.apache.beam.sdk.util.WindowedValue<T>>>

Coder to serialize and deserialize Tuple2, WindowedValue{/@code} to be used in spark encoders while applying DoFn.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.coders.Coder

Coder.Context, Coder.NonDeterministicException

Method Summary

Modifier and Type	Method and Description
scala.Tuple2<TupleTag<T>,org.apache.beam.sdk.util.WindowedValue<T>>	decode(java.io.InputStream inStream) Decodes a value of type T from the given input stream in the given context.
void	encode(scala.Tuple2<TupleTag<T>,org.apache.beam.sdk.util.WindowedValue<T>> tuple2, java.io.OutputStream outStream) Encodes the given value of type T onto the given output stream.
static MultiOutputCoder	of(Coder<TupleTag> tupleTagCoder, java.util.Map<TupleTag<?>,Coder<?>> coderMap, Coder<? extends BoundedWindow> windowCoder)

Methods inherited from class org.apache.beam.sdk.coders.CustomCoder

getCoderArguments, verifyDeterministic

Methods inherited from class org.apache.beam.sdk.coders.Coder

consistentWithEquals, decode, encode, getEncodedElementByteSize, getEncodedTypeDescriptor, isRegisterByteSizeObserverCheap, registerByteSizeObserver, structuralValue, verifyDeterministic, verifyDeterministic

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

of

public static MultiOutputCoder of(Coder<TupleTag> tupleTagCoder,
                                  java.util.Map<TupleTag<?>,Coder<?>> coderMap,
                                  Coder<? extends BoundedWindow> windowCoder)

encode

public void encode(scala.Tuple2<TupleTag<T>,org.apache.beam.sdk.util.WindowedValue<T>> tuple2,
                   java.io.OutputStream outStream)
            throws java.io.IOException

Description copied from class: Coder

Encodes the given value of type T onto the given output stream.

Specified by:

encode in class Coder<scala.Tuple2<TupleTag<T>,org.apache.beam.sdk.util.WindowedValue<T>>>

Throws:

java.io.IOException - if writing to the OutputStream fails for some reason

CoderException - if the value could not be encoded for some reason

decode

public scala.Tuple2<TupleTag<T>,org.apache.beam.sdk.util.WindowedValue<T>> decode(java.io.InputStream inStream)
                                                                           throws CoderException,
                                                                                  java.io.IOException

Description copied from class: Coder

Decodes a value of type T from the given input stream in the given context. Returns the decoded value.

Specified by:

decode in class Coder<scala.Tuple2<TupleTag<T>,org.apache.beam.sdk.util.WindowedValue<T>>>

Throws:

CoderException - if the value could not be decoded for some reason

java.io.IOException - if reading from the InputStream fails for some reason