org.apache.beam.sdk.io.gcp.pubsublite

Class PubsubLiteWriteSchemaTransformProvider

java.lang.Object

org.apache.beam.sdk.schemas.transforms.TypedSchemaTransformProvider<PubsubLiteWriteSchemaTransformProvider.PubsubLiteWriteSchemaTransformConfiguration>

org.apache.beam.sdk.io.gcp.pubsublite.PubsubLiteWriteSchemaTransformProvider

All Implemented Interfaces:

SchemaTransformProvider

@AutoService(value=SchemaTransformProvider.class)
public class PubsubLiteWriteSchemaTransformProvider
extends TypedSchemaTransformProvider<PubsubLiteWriteSchemaTransformProvider.PubsubLiteWriteSchemaTransformConfiguration>

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	PubsubLiteWriteSchemaTransformProvider.ErrorCounterFn
static class	PubsubLiteWriteSchemaTransformProvider.PubsubLiteWriteSchemaTransformConfiguration
static class	PubsubLiteWriteSchemaTransformProvider.SetUuidFromPubSubMessage

Field Summary

Fields

Modifier and Type	Field and Description
static TupleTag<Row>	ERROR_TAG
static TupleTag<com.google.cloud.pubsublite.proto.PubSubMessage>	OUTPUT_TAG
static java.util.Set<java.lang.String>	SUPPORTED_FORMATS
static java.lang.String	SUPPORTED_FORMATS_STR

Constructor Summary

Constructors

Constructor and Description
PubsubLiteWriteSchemaTransformProvider()

Method Summary

Modifier and Type	Method and Description
protected java.lang.Class<PubsubLiteWriteSchemaTransformProvider.PubsubLiteWriteSchemaTransformConfiguration>	configurationClass()
java.lang.String	description() Returns a description regarding the SchemaTransform represented by the SchemaTransformProvider.
SchemaTransform	from(PubsubLiteWriteSchemaTransformProvider.PubsubLiteWriteSchemaTransformConfiguration configuration) Produce a SchemaTransform from ConfigT.
static SerializableFunction<Row,byte[]>	getRowToRawBytesFunction(java.lang.String rowFieldName)
static Schema	getSchemaWithoutAttributes(Schema inputSchema, java.util.List<java.lang.String> attributes)
java.lang.String	identifier() Returns an id that uniquely represents this transform.
java.util.List<java.lang.String>	inputCollectionNames() Returns the input collection names of this transform.
java.util.List<java.lang.String>	outputCollectionNames() Returns the output collection names of this transform.

Methods inherited from class org.apache.beam.sdk.schemas.transforms.TypedSchemaTransformProvider

configurationSchema, dependencies, from

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

SUPPORTED_FORMATS_STR

public static final java.lang.String SUPPORTED_FORMATS_STR

See Also:

Constant Field Values

SUPPORTED_FORMATS

public static final java.util.Set<java.lang.String> SUPPORTED_FORMATS

OUTPUT_TAG

public static final TupleTag<com.google.cloud.pubsublite.proto.PubSubMessage> OUTPUT_TAG

ERROR_TAG

public static final TupleTag<Row> ERROR_TAG

Constructor Detail

PubsubLiteWriteSchemaTransformProvider

public PubsubLiteWriteSchemaTransformProvider()

Method Detail

configurationClass

protected java.lang.Class<PubsubLiteWriteSchemaTransformProvider.PubsubLiteWriteSchemaTransformConfiguration> configurationClass()

Overrides:

configurationClass in class TypedSchemaTransformProvider<PubsubLiteWriteSchemaTransformProvider.PubsubLiteWriteSchemaTransformConfiguration>

description

public java.lang.String description()

Description copied from interface: SchemaTransformProvider

Returns a description regarding the SchemaTransform represented by the SchemaTransformProvider. Please keep the language generic (i.e. not specific to any programming language). The description may be markdown formatted.

from

public SchemaTransform from(PubsubLiteWriteSchemaTransformProvider.PubsubLiteWriteSchemaTransformConfiguration configuration)

Description copied from class: TypedSchemaTransformProvider

Produce a SchemaTransform from ConfigT. Can throw a InvalidConfigurationException or a InvalidSchemaException.

Specified by:

from in class TypedSchemaTransformProvider<PubsubLiteWriteSchemaTransformProvider.PubsubLiteWriteSchemaTransformConfiguration>

getSchemaWithoutAttributes

public static Schema getSchemaWithoutAttributes(Schema inputSchema,
                                                java.util.List<java.lang.String> attributes)

getRowToRawBytesFunction

public static SerializableFunction<Row,byte[]> getRowToRawBytesFunction(java.lang.String rowFieldName)

identifier

public java.lang.String identifier()

Description copied from interface: SchemaTransformProvider

Returns an id that uniquely represents this transform.

inputCollectionNames

public java.util.List<java.lang.String> inputCollectionNames()

Description copied from interface: SchemaTransformProvider

Returns the input collection names of this transform.

outputCollectionNames

public java.util.List<java.lang.String> outputCollectionNames()

Description copied from interface: SchemaTransformProvider

Returns the output collection names of this transform.