org.apache.beam.sdk.extensions.sql.meta.provider.parquet

Class ParquetTable

java.lang.Object

org.apache.beam.sdk.extensions.sql.meta.BaseBeamTable

org.apache.beam.sdk.extensions.sql.meta.SchemaBaseBeamTable

org.apache.beam.sdk.extensions.sql.meta.provider.parquet.ParquetTable

All Implemented Interfaces:

java.io.Serializable, BeamSqlTable

public class ParquetTable
extends SchemaBaseBeamTable
implements java.io.Serializable

ParquetTable is a BeamSqlTable.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.extensions.sql.meta.SchemaBaseBeamTable

schema

Constructor Summary

Constructors

Constructor and Description
ParquetTable(Schema beamSchema, java.lang.String filePattern)

Method Summary

Modifier and Type	Method and Description
PCollection<Row>	buildIOReader(PBegin begin) create a PCollection<Row> from source.
PDone	buildIOWriter(PCollection<Row> input) create a IO.write() instance to write to target.
BeamTableStatistics	getTableStatistics(PipelineOptions options) Estimates the number of rows or the rate for unbounded Tables.
PCollection.IsBounded	isBounded() Whether this table is bounded (known to be finite) or unbounded (may or may not be finite).

Methods inherited from class org.apache.beam.sdk.extensions.sql.meta.SchemaBaseBeamTable

getSchema

Methods inherited from class org.apache.beam.sdk.extensions.sql.meta.BaseBeamTable

buildIOReader, constructFilter, supportsProjects

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParquetTable

public ParquetTable(Schema beamSchema,
                    java.lang.String filePattern)

Method Detail

buildIOReader

public PCollection<Row> buildIOReader(PBegin begin)

Description copied from interface: BeamSqlTable

create a PCollection<Row> from source.

Specified by:

buildIOReader in interface BeamSqlTable

buildIOWriter

public PDone buildIOWriter(PCollection<Row> input)

Description copied from interface: BeamSqlTable

create a IO.write() instance to write to target.

Specified by:

buildIOWriter in interface BeamSqlTable

isBounded

public PCollection.IsBounded isBounded()

Description copied from interface: BeamSqlTable

Whether this table is bounded (known to be finite) or unbounded (may or may not be finite).

Specified by:

isBounded in interface BeamSqlTable

getTableStatistics

public BeamTableStatistics getTableStatistics(PipelineOptions options)

Description copied from interface: BeamSqlTable

Estimates the number of rows or the rate for unbounded Tables. If it is not possible to estimate the row count or rate it will return BeamTableStatistics.BOUNDED_UNKNOWN.

Specified by:

getTableStatistics in interface BeamSqlTable