Package org.apache.beam.sdk.coders

Class TimestampPrefixingWindowCoder<T extends BoundedWindow>

java.lang.Object
org.apache.beam.sdk.coders.Coder<T>
org.apache.beam.sdk.coders.StructuredCoder<T>
org.apache.beam.sdk.coders.TimestampPrefixingWindowCoder<T>
Type Parameters:
T - The custom window type.
All Implemented Interfaces:
Serializable
public class TimestampPrefixingWindowCoder<T extends BoundedWindow> extends StructuredCoder<T>
A TimestampPrefixingWindowCoder wraps arbitrary user custom window coder. While encoding the custom window type, it extracts the maxTimestamp(inclusive) of the window and prefix it to the encoded bytes of the window using the user custom window coder.
See Also:

  • Method Details

    • of

      public static <T extends BoundedWindow> TimestampPrefixingWindowCoder<T> of(Coder<T> windowCoder)

    • getWindowCoder

      public Coder<T> getWindowCoder()

    • encode

      public void encode(T value, OutputStream outStream) throws CoderException, IOException
      Description copied from class: Coder
      Encodes the given value of type T onto the given output stream. Multiple elements can be encoded next to each other on the output stream, each coder should encode information to know how many bytes to read when decoding. A common approach is to prefix the encoding with the element's encoded length.
      Specified by:
      encode in class Coder<T extends BoundedWindow>
      Throws:
      CoderException - if the value could not be encoded for some reason
      IOException - if writing to the OutputStream fails for some reason

    • decode

      public T decode(InputStream inStream) throws CoderException, IOException
      Description copied from class: Coder
      Decodes a value of type T from the given input stream in the given context. Returns the decoded value. Multiple elements can be encoded next to each other on the input stream, each coder should encode information to know how many bytes to read when decoding. A common approach is to prefix the encoding with the element's encoded length.
      Specified by:
      decode in class Coder<T extends BoundedWindow>
      Throws:
      CoderException - if the value could not be decoded for some reason
      IOException - if reading from the InputStream fails for some reason

    • getCoderArguments

      public List<? extends Coder<?>> getCoderArguments()
      Description copied from class: Coder
      If this is a Coder for a parameterized type, returns the list of Coders being used for each of the parameters in the same order they appear within the parameterized type's type signature. If this cannot be done, or this Coder does not encode/decode a parameterized type, returns the empty list.
      Specified by:
      getCoderArguments in class Coder<T extends BoundedWindow>

    • verifyDeterministic

      public void verifyDeterministic() throws Coder.NonDeterministicException
      Description copied from class: Coder
      Throw Coder.NonDeterministicException if the coding is not deterministic.

      In order for a Coder to be considered deterministic, the following must be true:

      • two values that compare as equal (via Object.equals() or Comparable.compareTo(), if supported) have the same encoding.
      • the Coder always produces a canonical encoding, which is the same for an instance of an object even if produced on different computers at different times.
      Specified by:
      verifyDeterministic in class Coder<T extends BoundedWindow>
      Throws:
      Coder.NonDeterministicException - if this coder is not deterministic.

    • consistentWithEquals

      public boolean consistentWithEquals()
      Description copied from class: Coder
      Returns true if this Coder is injective with respect to Object.equals(java.lang.Object).

      Whenever the encoded bytes of two values are equal, then the original values are equal according to Objects.equals(). Note that this is well-defined for null.

      This condition is most notably false for arrays. More generally, this condition is false whenever equals() compares object identity, rather than performing a semantic/structural comparison.

      By default, returns false.

      Overrides:
      consistentWithEquals in class Coder<T extends BoundedWindow>

    • isRegisterByteSizeObserverCheap

      public boolean isRegisterByteSizeObserverCheap(T value)
      Description copied from class: Coder
      Returns whether Coder.registerByteSizeObserver(T, org.apache.beam.sdk.util.common.ElementByteSizeObserver) cheap enough to call for every element, that is, if this Coder can calculate the byte size of the element to be coded in roughly constant time (or lazily).

      Not intended to be called by user code, but instead by PipelineRunner implementations.

      By default, returns false. The default Coder.registerByteSizeObserver(T, org.apache.beam.sdk.util.common.ElementByteSizeObserver) implementation invokes Coder.getEncodedElementByteSize(T) which requires re-encoding an element unless it is overridden. This is considered expensive.

      Overrides:
      isRegisterByteSizeObserverCheap in class Coder<T extends BoundedWindow>

    • registerByteSizeObserver

      public void registerByteSizeObserver(T value, org.apache.beam.sdk.util.common.ElementByteSizeObserver observer) throws Exception
      Description copied from class: Coder
      Notifies the ElementByteSizeObserver about the byte size of the encoded value using this Coder.

      Not intended to be called by user code, but instead by PipelineRunner implementations.

      By default, this notifies observer about the byte size of the encoded value using this coder as returned by Coder.getEncodedElementByteSize(T).

      Overrides:
      registerByteSizeObserver in class Coder<T extends BoundedWindow>
      Throws:
      Exception