org.apache.beam.sdk.io.iceberg

Class IcebergReadSchemaTransformProvider

java.lang.Object

org.apache.beam.sdk.schemas.transforms.TypedSchemaTransformProvider<IcebergReadSchemaTransformProvider.Config>

org.apache.beam.sdk.io.iceberg.IcebergReadSchemaTransformProvider

All Implemented Interfaces:

SchemaTransformProvider

@AutoService(value=SchemaTransformProvider.class)
public class IcebergReadSchemaTransformProvider
extends TypedSchemaTransformProvider<IcebergReadSchemaTransformProvider.Config>

SchemaTransform implementation for IcebergIO.readRows(org.apache.beam.sdk.io.iceberg.IcebergCatalogConfig). Reads records from Iceberg and outputs a PCollection of Beam Rows.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	IcebergReadSchemaTransformProvider.Config

Constructor Summary

Constructors

Constructor and Description
IcebergReadSchemaTransformProvider()

Method Summary

Modifier and Type	Method and Description
Schema	configurationSchema() Returns the expected schema of the configuration object.
protected SchemaTransform	from(IcebergReadSchemaTransformProvider.Config configuration) Produce a SchemaTransform from ConfigT.
SchemaTransform	from(Row rowConfig) Produces a SchemaTransform from a Row configuration.
java.lang.String	identifier() Returns an id that uniquely represents this transform.
java.util.List<java.lang.String>	outputCollectionNames() Returns the output collection names of this transform.

Methods inherited from class org.apache.beam.sdk.schemas.transforms.TypedSchemaTransformProvider

configurationClass, dependencies

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.beam.sdk.schemas.transforms.SchemaTransformProvider

description, inputCollectionNames

Constructor Detail

IcebergReadSchemaTransformProvider

public IcebergReadSchemaTransformProvider()

Method Detail

from

protected SchemaTransform from(IcebergReadSchemaTransformProvider.Config configuration)

Description copied from class: TypedSchemaTransformProvider

Produce a SchemaTransform from ConfigT. Can throw a InvalidConfigurationException or a InvalidSchemaException.

Specified by:

from in class TypedSchemaTransformProvider<IcebergReadSchemaTransformProvider.Config>

outputCollectionNames

public java.util.List<java.lang.String> outputCollectionNames()

Description copied from interface: SchemaTransformProvider

Returns the output collection names of this transform.

identifier

public java.lang.String identifier()

Description copied from interface: SchemaTransformProvider

Returns an id that uniquely represents this transform.

from

public SchemaTransform from(Row rowConfig)

Description copied from class: TypedSchemaTransformProvider

Produces a SchemaTransform from a Row configuration.

Specified by:

from in interface SchemaTransformProvider

Overrides:

from in class TypedSchemaTransformProvider<IcebergReadSchemaTransformProvider.Config>

configurationSchema

public Schema configurationSchema()

Description copied from interface: SchemaTransformProvider

Returns the expected schema of the configuration object. Note this is distinct from the schema of the transform itself.

Specified by:

configurationSchema in interface SchemaTransformProvider

Overrides:

configurationSchema in class TypedSchemaTransformProvider<IcebergReadSchemaTransformProvider.Config>