Package org.apache.beam.sdk.io.delta

package org.apache.beam.sdk.io.delta

Transforms for reading from Delta Lake.

See Also:

• DeltaIO

Related Packages

Package	Description
org.apache.beam.sdk.io	Defines transforms for reading and writing common storage formats, including invalid reference org.apache.beam.sdk.io.AvroIO , and TextIO.

Classes

Class	Description
BeamEngine	A Beam specific Engine wrapper that provides a custom ParquetHandler.
BeamParquetHandler	A Beam specific ParquetHandler that delegates row group claiming to a DeltaReadTaskTracker.
DeltaIO	A connector that reads from Delta Lake tables.
DeltaIO.ReadRows
DeltaReadSchemaTransformProvider	SchemaTransform implementation for DeltaIO.readRows().
DeltaReadSchemaTransformProvider.Configuration
DeltaReadTask	A serializable task containing the necessary metadata to read a group of files in a Delta table.
DeltaReadTaskTracker	A RestrictionTracker for tracking progress across Parquet row groups represented by a DeltaReadTask.
SerializableRow	A serializable wrapper for Delta Row that implements the Row interface itself, allowing worker nodes to access serialized Row objects using standard Delta Kernel APIs.
SerializableStructType	A serializable wrapper for StructType using the Delta Kernel JSON serializer/deserializer.