org.apache.beam.sdk.io.parquet

Class ParquetSchemaIOProvider

java.lang.Object

org.apache.beam.sdk.io.parquet.ParquetSchemaIOProvider

All Implemented Interfaces:

SchemaIOProvider

@Internal
 @AutoService(value=SchemaIOProvider.class)
public class ParquetSchemaIOProvider
extends java.lang.Object
implements SchemaIOProvider

An implementation of SchemaIOProvider for reading and writing parquet files with ParquetIO.

Constructor Summary

Constructors

Constructor and Description
ParquetSchemaIOProvider()

Method Summary

Modifier and Type	Method and Description
Schema	configurationSchema() Returns the expected schema of the configuration object.
org.apache.beam.sdk.io.parquet.ParquetSchemaIOProvider.ParquetSchemaIO	from(java.lang.String location, Row configuration, Schema dataSchema) Produce a SchemaIO given a String representing the data's location, the schema of the data that resides there, and some IO-specific configuration object.
java.lang.String	identifier() Returns an id that uniquely represents this IO.
PCollection.IsBounded	isBounded()
boolean	requiresDataSchema() Indicates whether the dataSchema value is necessary.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParquetSchemaIOProvider

public ParquetSchemaIOProvider()

Method Detail

identifier

public java.lang.String identifier()

Returns an id that uniquely represents this IO.

Specified by:

identifier in interface SchemaIOProvider

configurationSchema

public Schema configurationSchema()

Returns the expected schema of the configuration object. Note this is distinct from the schema of the data source itself. No configuration expected for parquet.

Specified by:

configurationSchema in interface SchemaIOProvider

from

public org.apache.beam.sdk.io.parquet.ParquetSchemaIOProvider.ParquetSchemaIO from(java.lang.String location,
                                                                                   Row configuration,
                                                                                   Schema dataSchema)

Produce a SchemaIO given a String representing the data's location, the schema of the data that resides there, and some IO-specific configuration object.

Specified by:

from in interface SchemaIOProvider

requiresDataSchema

public boolean requiresDataSchema()

Description copied from interface: SchemaIOProvider

Indicates whether the dataSchema value is necessary.

Specified by:

requiresDataSchema in interface SchemaIOProvider

isBounded

public PCollection.IsBounded isBounded()

Specified by:

isBounded in interface SchemaIOProvider