org.apache.beam.sdk.io.fileschematransform

Interface FileWriteSchemaTransformFormatProvider

All Superinterfaces:

Providers.Identifyable

All Known Implementing Classes:

AvroWriteSchemaTransformFormatProvider, CsvWriteSchemaTransformFormatProvider, JsonWriteSchemaTransformFormatProvider, ParquetWriteSchemaTransformFormatProvider, XmlWriteSchemaTransformFormatProvider

@Internal
public interface FileWriteSchemaTransformFormatProvider
extends Providers.Identifyable

Provides a PTransform that writes a PCollection of Rows and outputs a PCollection of the file names according to a registered AutoService FileWriteSchemaTransformFormatProvider implementation. See FileWriteSchemaTransformFormatProviders for a list of available formats.

Method Summary

Modifier and Type	Method and Description
PTransform<PCollection<Row>,PCollectionTuple>	buildTransform(FileWriteSchemaTransformConfiguration configuration, Schema schema) Builds a PTransform that writes a Row PCollection and outputs the resulting PCollectionTuple with two tags, one for the file names, and another errored-out rows.

Methods inherited from interface org.apache.beam.sdk.schemas.io.Providers.Identifyable

identifier

Method Detail

buildTransform

PTransform<PCollection<Row>,PCollectionTuple> buildTransform(FileWriteSchemaTransformConfiguration configuration,
                                                             Schema schema)

Builds a PTransform that writes a Row PCollection and outputs the resulting PCollectionTuple with two tags, one for the file names, and another errored-out rows.