Package org.apache.beam.sdk.io.sparkreceiver

Interface HasOffset

public interface HasOffset
Interface for any Spark Receiver that supports reading from and to some offset.

  • Method Summary

    Modifier and Type
    Method
    Description
    Long
    getEndOffset()
     
    default void
    setCheckpoint(Long recordsProcessed)
    Some Receiver support mechanism of checkpoint (e.g.
    void
    setStartOffset(Long offset)
     

  • Method Details

    • setStartOffset

      void setStartOffset(Long offset)
      Parameters:
      offset - inclusive start offset from which the reading should be started.

    • getEndOffset

      Long getEndOffset()
      Returns:
      exclusive end offset to which the reading from current page will occur.

    • setCheckpoint

      default void setCheckpoint(Long recordsProcessed)
      Some Receiver support mechanism of checkpoint (e.g. ack). This method should be called before stopping the receiver.