Package org.apache.beam.sdk.io.iceberg

Class IcebergWriteSchemaTransformProvider

java.lang.Object

org.apache.beam.sdk.schemas.transforms.TypedSchemaTransformProvider<IcebergWriteSchemaTransformProvider.Configuration>

org.apache.beam.sdk.io.iceberg.IcebergWriteSchemaTransformProvider

All Implemented Interfaces:

SchemaTransformProvider

@AutoService(SchemaTransformProvider.class)
public class IcebergWriteSchemaTransformProvider
extends TypedSchemaTransformProvider<IcebergWriteSchemaTransformProvider.Configuration>

SchemaTransform implementation for IcebergIO.writeRows(org.apache.beam.sdk.io.iceberg.IcebergCatalogConfig) and, in merge-on-read mode, IcebergIO.writeCdcRows(org.apache.beam.sdk.io.iceberg.IcebergCatalogConfig). Outputs a PCollection<Row> representing the snapshots created in the process; merge-on-read writes add a dead_letter output of late records.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	IcebergWriteSchemaTransformProvider.Configuration

Constructor Summary

Constructors

Constructor	Description
IcebergWriteSchemaTransformProvider()

Method Summary

Modifier and Type	Method	Description
String	description()	Returns a description regarding the SchemaTransform represented by the SchemaTransformProvider.
protected SchemaTransform	from(IcebergWriteSchemaTransformProvider.Configuration configuration)	Produce a SchemaTransform from ConfigT.
String	identifier()	Returns an id that uniquely represents this transform.
List<String>	inputCollectionNames()	Returns the input collection names of this transform.
List<String>	outputCollectionNames()	Returns the output collection names of this transform.

Methods inherited from class org.apache.beam.sdk.schemas.transforms.TypedSchemaTransformProvider

configurationClass, configurationSchema, dependencies, from

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

IcebergWriteSchemaTransformProvider

public IcebergWriteSchemaTransformProvider()

Method Details

description

public String description()

Description copied from interface: SchemaTransformProvider

Returns a description regarding the SchemaTransform represented by the SchemaTransformProvider. Please keep the language generic (i.e. not specific to any programming language). The description may be markdown formatted.

from

protected SchemaTransform from(IcebergWriteSchemaTransformProvider.Configuration configuration)

Description copied from class: TypedSchemaTransformProvider

Produce a SchemaTransform from ConfigT. Can throw a InvalidConfigurationException or a InvalidSchemaException.

Specified by:

from in class TypedSchemaTransformProvider<IcebergWriteSchemaTransformProvider.Configuration>

inputCollectionNames

public List<String> inputCollectionNames()

Description copied from interface: SchemaTransformProvider

Returns the input collection names of this transform.

outputCollectionNames

public List<String> outputCollectionNames()

Description copied from interface: SchemaTransformProvider

Returns the output collection names of this transform.

identifier

public String identifier()

Description copied from interface: SchemaTransformProvider

Returns an id that uniquely represents this transform.