Package org.apache.beam.sdk.io.kafka

Class KafkaReadSchemaTransformProvider

java.lang.Object

org.apache.beam.sdk.schemas.transforms.TypedSchemaTransformProvider<KafkaReadSchemaTransformConfiguration>

org.apache.beam.sdk.io.kafka.KafkaReadSchemaTransformProvider

All Implemented Interfaces:

SchemaTransformProvider

@AutoService(SchemaTransformProvider.class)
public class KafkaReadSchemaTransformProvider
extends TypedSchemaTransformProvider<KafkaReadSchemaTransformConfiguration>

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	KafkaReadSchemaTransformProvider.ErrorFn

Field Summary

Fields

Modifier and Type	Field	Description
static final TupleTag<Row>	ERROR_TAG
static final TupleTag<Row>	OUTPUT_TAG

Constructor Summary

Constructors

Constructor	Description
KafkaReadSchemaTransformProvider()

Method Summary

Modifier and Type	Method	Description
protected Class<KafkaReadSchemaTransformConfiguration>	configurationClass()
protected SchemaTransform	from(KafkaReadSchemaTransformConfiguration configuration)	Produce a SchemaTransform from ConfigT.
static SerializableFunction<byte[],Row>	getRawBytesToRowFunction(Schema rawSchema)
static SerializableFunction<byte[],Row>	getRawStringToRowFunction(Schema stringSchema)
String	identifier()	Returns an id that uniquely represents this transform.
List<String>	inputCollectionNames()	Returns the input collection names of this transform.
List<String>	outputCollectionNames()	Returns the output collection names of this transform.

Methods inherited from class org.apache.beam.sdk.schemas.transforms.TypedSchemaTransformProvider

configurationSchema, dependencies, from

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.beam.sdk.schemas.transforms.SchemaTransformProvider

description

Field Details

OUTPUT_TAG

public static final TupleTag<Row> OUTPUT_TAG

ERROR_TAG

public static final TupleTag<Row> ERROR_TAG

Constructor Details

KafkaReadSchemaTransformProvider

public KafkaReadSchemaTransformProvider()

Method Details

configurationClass

protected Class<KafkaReadSchemaTransformConfiguration> configurationClass()

Overrides:

configurationClass in class TypedSchemaTransformProvider<KafkaReadSchemaTransformConfiguration>

from

protected SchemaTransform from(KafkaReadSchemaTransformConfiguration configuration)

Description copied from class: TypedSchemaTransformProvider

Produce a SchemaTransform from ConfigT. Can throw a InvalidConfigurationException or a InvalidSchemaException.

Specified by:

from in class TypedSchemaTransformProvider<KafkaReadSchemaTransformConfiguration>

getRawBytesToRowFunction

public static SerializableFunction<byte[],Row> getRawBytesToRowFunction(Schema rawSchema)

getRawStringToRowFunction

public static SerializableFunction<byte[],Row> getRawStringToRowFunction(Schema stringSchema)

identifier

public String identifier()

Description copied from interface: SchemaTransformProvider

Returns an id that uniquely represents this transform.

inputCollectionNames

public List<String> inputCollectionNames()

Description copied from interface: SchemaTransformProvider

Returns the input collection names of this transform.

outputCollectionNames

public List<String> outputCollectionNames()

Description copied from interface: SchemaTransformProvider

Returns the output collection names of this transform.