Package org.apache.beam.sdk.io.delta

Class DeltaIO.ReadChanges

java.lang.Object
org.apache.beam.sdk.transforms.PTransform<PBegin,PCollection<Row>>
org.apache.beam.sdk.io.delta.DeltaIO.ReadChanges
All Implemented Interfaces:
Serializable, HasDisplayData
Enclosing class:
DeltaIO
public abstract static class DeltaIO.ReadChanges extends PTransform<PBegin,PCollection<Row>>
See Also:

  • Constructor Details

    • ReadChanges

      public ReadChanges()

  • Method Details

    • getTablePath

      public abstract @Nullable String getTablePath()

    • getStartVersion

      public abstract @Nullable Long getStartVersion()

    • getStartTimestamp

      public abstract @Nullable String getStartTimestamp()

    • getEndVersion

      public abstract @Nullable Long getEndVersion()

    • getEndTimestamp

      public abstract @Nullable String getEndTimestamp()

    • getMetadataColumns

      public abstract @Nullable List<String> getMetadataColumns()

    • getHadoopConfig

      public abstract @Nullable Map<String,String> getHadoopConfig()

    • from

      public DeltaIO.ReadChanges from(String tablePath)

    • withStartVersion

      public DeltaIO.ReadChanges withStartVersion(long startVersion)

    • withStartTimestamp

      public DeltaIO.ReadChanges withStartTimestamp(String startTimestamp)

    • withEndVersion

      public DeltaIO.ReadChanges withEndVersion(long endVersion)

    • withEndTimestamp

      public DeltaIO.ReadChanges withEndTimestamp(String endTimestamp)

    • withMetadataColumns

      public DeltaIO.ReadChanges withMetadataColumns(String... metadataColumns)

    • withConfig

      public DeltaIO.ReadChanges withConfig(Map<String,String> config)

    • expand

      public PCollection<Row> expand(PBegin input)
      Description copied from class: PTransform
      Override this method to specify how this PTransform should be expanded on the given InputT.

      NOTE: This method should not be called directly. Instead apply the PTransform should be applied to the InputT using the apply method.

      Composite transforms, which are defined in terms of other transforms, should return the output of one of the composed transforms. Non-composite transforms, which do not apply any transforms internally, should return a new unbound output and register evaluators (via backend-specific registration methods).

      Specified by:
      expand in class PTransform<PBegin,PCollection<Row>>