org.apache.beam.sdk.io.fileschematransform

Class ParquetWriteSchemaTransformFormatProvider

java.lang.Object

org.apache.beam.sdk.io.fileschematransform.ParquetWriteSchemaTransformFormatProvider

All Implemented Interfaces:

FileWriteSchemaTransformFormatProvider, Providers.Identifyable

@AutoService(value=FileWriteSchemaTransformFormatProvider.class)
public class ParquetWriteSchemaTransformFormatProvider
extends java.lang.Object
implements FileWriteSchemaTransformFormatProvider

A FileWriteSchemaTransformFormatProvider for Parquet format.

Constructor Summary

Constructors

Constructor and Description
ParquetWriteSchemaTransformFormatProvider()

Method Summary

Modifier and Type	Method and Description
PTransform<PCollection<Row>,PCollectionTuple>	buildTransform(FileWriteSchemaTransformConfiguration configuration, Schema schema) Builds a PTransform that transforms a Row PCollection into result PCollectionTuple with two tags, one for file names written using ParquetIO.Sink and FileIO.Write, another for errored-out rows.
java.lang.String	identifier() Returns an id that uniquely represents this among others implementing its derived interface.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParquetWriteSchemaTransformFormatProvider

public ParquetWriteSchemaTransformFormatProvider()

Method Detail

identifier

public java.lang.String identifier()

Description copied from interface: Providers.Identifyable

Returns an id that uniquely represents this among others implementing its derived interface.

Specified by:

identifier in interface Providers.Identifyable

buildTransform

public PTransform<PCollection<Row>,PCollectionTuple> buildTransform(FileWriteSchemaTransformConfiguration configuration,
                                                                    Schema schema)

Builds a PTransform that transforms a Row PCollection into result PCollectionTuple with two tags, one for file names written using ParquetIO.Sink and FileIO.Write, another for errored-out rows.

Specified by:

buildTransform in interface FileWriteSchemaTransformFormatProvider