Package org.apache.beam.sdk.io.delta

Class DeltaIO

java.lang.Object

org.apache.beam.sdk.io.delta.DeltaIO

@Internal
public class DeltaIO
extends Object

A connector that reads from Delta Lake tables.

Configuration Options

Please check the Managed IO configuration page for more details.

This is work in progress and is subject to change. For more details and to track progress, see Issue 21100.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	DeltaIO.ReadChanges
static class	DeltaIO.ReadRows

Field Summary

Fields

Modifier and Type	Field	Description
static final String	CHANGE_TYPE_COLUMN
static final String	COMMIT_TIMESTAMP_COLUMN
static final String	COMMIT_VERSION_COLUMN

Constructor Summary

Constructors

Constructor	Description
DeltaIO()

Method Summary

Modifier and Type	Method	Description
static DeltaIO.ReadChanges	readChanges()	Reads change data feed (CDC) from a Delta Lake table.
static DeltaIO.ReadRows	readRows()	Reads rows from a Delta Lake table.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

CHANGE_TYPE_COLUMN

public static final String CHANGE_TYPE_COLUMN

See Also:

• Constant Field Values

COMMIT_VERSION_COLUMN

public static final String COMMIT_VERSION_COLUMN

See Also:

• Constant Field Values

COMMIT_TIMESTAMP_COLUMN

public static final String COMMIT_TIMESTAMP_COLUMN

See Also:

• Constant Field Values

Constructor Details

DeltaIO

public DeltaIO()

Method Details

readRows

public static DeltaIO.ReadRows readRows()

Reads rows from a Delta Lake table.

Normally, it is recommended to use Managed.read(String) with Managed.DELTA_LAKE instead of directly using this transform.

readChanges

public static DeltaIO.ReadChanges readChanges()

Reads change data feed (CDC) from a Delta Lake table.