Package org.apache.beam.sdk.io.fileschematransform

Class ParquetWriteSchemaTransformFormatProvider

java.lang.Object

org.apache.beam.sdk.io.fileschematransform.ParquetWriteSchemaTransformFormatProvider

All Implemented Interfaces:

FileWriteSchemaTransformFormatProvider, Providers.Identifyable

@AutoService(FileWriteSchemaTransformFormatProvider.class)
public class ParquetWriteSchemaTransformFormatProvider
extends Object
implements FileWriteSchemaTransformFormatProvider

A FileWriteSchemaTransformFormatProvider for Parquet format.

Constructor Summary

Constructors

Constructor	Description
ParquetWriteSchemaTransformFormatProvider()

Method Summary

Modifier and Type	Method	Description
PTransform<PCollection<Row>,PCollectionTuple>	buildTransform(FileWriteSchemaTransformConfiguration configuration, Schema schema)	Builds a PTransform that transforms a Row PCollection into result PCollectionTuple with two tags, one for file names written using ParquetIO.Sink and FileIO.Write, another for errored-out rows.
String	identifier()	Returns an id that uniquely represents this among others implementing its derived interface.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

ParquetWriteSchemaTransformFormatProvider

public ParquetWriteSchemaTransformFormatProvider()

Method Details

identifier

public String identifier()

Description copied from interface: Providers.Identifyable

Returns an id that uniquely represents this among others implementing its derived interface.

Specified by:

identifier in interface Providers.Identifyable

buildTransform

public PTransform<PCollection<Row>,PCollectionTuple> buildTransform(FileWriteSchemaTransformConfiguration configuration,
 Schema schema)

Builds a PTransform that transforms a Row PCollection into result PCollectionTuple with two tags, one for file names written using ParquetIO.Sink and FileIO.Write, another for errored-out rows.

Specified by:

buildTransform in interface FileWriteSchemaTransformFormatProvider