Package org.apache.beam.sdk.io.delta

Class DeltaReadSchemaTransformProvider

java.lang.Object

org.apache.beam.sdk.schemas.transforms.TypedSchemaTransformProvider<DeltaReadSchemaTransformProvider.Configuration>

org.apache.beam.sdk.io.delta.DeltaReadSchemaTransformProvider

All Implemented Interfaces:

SchemaTransformProvider

@AutoService(SchemaTransformProvider.class)
public class DeltaReadSchemaTransformProvider
extends TypedSchemaTransformProvider<DeltaReadSchemaTransformProvider.Configuration>

SchemaTransform implementation for DeltaIO.readRows(). Reads records from Delta Lake and outputs a PCollection of Beam Rows.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	DeltaReadSchemaTransformProvider.Configuration

Constructor Summary

Constructors

Constructor	Description
DeltaReadSchemaTransformProvider()

Method Summary

Modifier and Type	Method	Description
protected SchemaTransform	from(DeltaReadSchemaTransformProvider.Configuration configuration)	Produce a SchemaTransform from ConfigT.
String	identifier()	Returns an id that uniquely represents this transform.
List<String>	outputCollectionNames()	Returns the output collection names of this transform.

Methods inherited from class org.apache.beam.sdk.schemas.transforms.TypedSchemaTransformProvider

configurationClass, configurationSchema, dependencies, from

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.beam.sdk.schemas.transforms.SchemaTransformProvider

description, inputCollectionNames

Constructor Details

DeltaReadSchemaTransformProvider

public DeltaReadSchemaTransformProvider()

Method Details

from

protected SchemaTransform from(DeltaReadSchemaTransformProvider.Configuration configuration)

Description copied from class: TypedSchemaTransformProvider

Produce a SchemaTransform from ConfigT. Can throw a InvalidConfigurationException or a InvalidSchemaException.

Specified by:

from in class TypedSchemaTransformProvider<DeltaReadSchemaTransformProvider.Configuration>

outputCollectionNames

public List<String> outputCollectionNames()

Description copied from interface: SchemaTransformProvider

Returns the output collection names of this transform.

identifier

public String identifier()

Description copied from interface: SchemaTransformProvider

Returns an id that uniquely represents this transform.