org.apache.beam.io.debezium

Class DebeziumReadSchemaTransformProvider

java.lang.Object

org.apache.beam.sdk.schemas.transforms.TypedSchemaTransformProvider<DebeziumReadSchemaTransformProvider.DebeziumReadSchemaTransformConfiguration>

org.apache.beam.io.debezium.DebeziumReadSchemaTransformProvider

All Implemented Interfaces:

SchemaTransformProvider

@AutoService(value=SchemaTransformProvider.class)
public class DebeziumReadSchemaTransformProvider
extends TypedSchemaTransformProvider<DebeziumReadSchemaTransformProvider.DebeziumReadSchemaTransformConfiguration>

A schema-aware transform provider for DebeziumIO. This class provides a PTransform that returns a change stream for a relational database.

The transform needs to access the source database on expansion and at pipeline runtime. At expansion, the output PCollection schema is retrieved, while at runtime, the change stream is consumed.

This transform is tested against MySQL and Postgres, but it should work well for any data source supported by Debezium.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DebeziumReadSchemaTransformProvider.DebeziumReadSchemaTransformConfiguration

Constructor Summary

Constructors

Modifier	Constructor and Description
	DebeziumReadSchemaTransformProvider()
protected	DebeziumReadSchemaTransformProvider(java.lang.Boolean isTest, java.lang.Integer recordLimit, java.lang.Long timeLimitMs)

Method Summary

Modifier and Type	Method and Description
protected @NonNull @Initialized java.lang.Class<DebeziumReadSchemaTransformProvider.DebeziumReadSchemaTransformConfiguration>	configurationClass()
protected @NonNull @Initialized SchemaTransform	from(DebeziumReadSchemaTransformProvider.DebeziumReadSchemaTransformConfiguration configuration) Produce a SchemaTransform from ConfigT.
@NonNull @Initialized java.lang.String	identifier() Returns an id that uniquely represents this transform.
@NonNull @Initialized java.util.List<java.lang.String>	inputCollectionNames() Returns the input collection names of this transform.
@NonNull @Initialized java.util.List<java.lang.String>	outputCollectionNames() Returns the output collection names of this transform.

Methods inherited from class org.apache.beam.sdk.schemas.transforms.TypedSchemaTransformProvider

configurationSchema, dependencies, from

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.beam.sdk.schemas.transforms.SchemaTransformProvider

description

Constructor Detail

DebeziumReadSchemaTransformProvider

public DebeziumReadSchemaTransformProvider()

DebeziumReadSchemaTransformProvider

protected DebeziumReadSchemaTransformProvider(java.lang.Boolean isTest,
                                              java.lang.Integer recordLimit,
                                              java.lang.Long timeLimitMs)

Method Detail

configurationClass

protected @NonNull @Initialized java.lang.Class<DebeziumReadSchemaTransformProvider.DebeziumReadSchemaTransformConfiguration> configurationClass()

Specified by:

configurationClass in class TypedSchemaTransformProvider<DebeziumReadSchemaTransformProvider.DebeziumReadSchemaTransformConfiguration>

from

protected @NonNull @Initialized SchemaTransform from(DebeziumReadSchemaTransformProvider.DebeziumReadSchemaTransformConfiguration configuration)

Description copied from class: TypedSchemaTransformProvider

Produce a SchemaTransform from ConfigT. Can throw a InvalidConfigurationException or a InvalidSchemaException.

Specified by:

from in class TypedSchemaTransformProvider<DebeziumReadSchemaTransformProvider.DebeziumReadSchemaTransformConfiguration>

identifier

public @NonNull @Initialized java.lang.String identifier()

Description copied from interface: SchemaTransformProvider

Returns an id that uniquely represents this transform.

inputCollectionNames

public @NonNull @Initialized java.util.List<java.lang.String> inputCollectionNames()

Description copied from interface: SchemaTransformProvider

Returns the input collection names of this transform.

outputCollectionNames

public @NonNull @Initialized java.util.List<java.lang.String> outputCollectionNames()

Description copied from interface: SchemaTransformProvider

Returns the output collection names of this transform.