org.apache.beam.sdk.extensions.sql.impl.schema

Class BeamPCollectionTable<InputT>

java.lang.Object

org.apache.beam.sdk.extensions.sql.meta.BaseBeamTable

org.apache.beam.sdk.extensions.sql.meta.SchemaBaseBeamTable

org.apache.beam.sdk.extensions.sql.impl.schema.BeamPCollectionTable<InputT>

All Implemented Interfaces:

java.io.Serializable, BeamSqlTable

public class BeamPCollectionTable<InputT>
extends SchemaBaseBeamTable

BeamPCollectionTable converts a PCollection<Row> as a virtual table, then a downstream query can query directly.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.extensions.sql.meta.SchemaBaseBeamTable

schema

Constructor Summary

Constructors

Constructor and Description
BeamPCollectionTable(PCollection<InputT> upstream)

Method Summary

Modifier and Type	Method and Description
PCollection<Row>	buildIOReader(PBegin begin) create a PCollection<Row> from source.
POutput	buildIOWriter(PCollection<Row> input) create a IO.write() instance to write to target.
BeamTableStatistics	getTableStatistics(PipelineOptions options) Estimates the number of rows or the rate for unbounded Tables.
PCollection.IsBounded	isBounded() Whether this table is bounded (known to be finite) or unbounded (may or may not be finite).

Methods inherited from class org.apache.beam.sdk.extensions.sql.meta.SchemaBaseBeamTable

getSchema

Methods inherited from class org.apache.beam.sdk.extensions.sql.meta.BaseBeamTable

buildIOReader, constructFilter, supportsProjects

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BeamPCollectionTable

public BeamPCollectionTable(PCollection<InputT> upstream)

Method Detail

isBounded

public PCollection.IsBounded isBounded()

Description copied from interface: BeamSqlTable

Whether this table is bounded (known to be finite) or unbounded (may or may not be finite).

buildIOReader

public PCollection<Row> buildIOReader(PBegin begin)

Description copied from interface: BeamSqlTable

create a PCollection<Row> from source.

buildIOWriter

public POutput buildIOWriter(PCollection<Row> input)

Description copied from interface: BeamSqlTable

create a IO.write() instance to write to target.

getTableStatistics

public BeamTableStatistics getTableStatistics(PipelineOptions options)

Description copied from interface: BeamSqlTable

Estimates the number of rows or the rate for unbounded Tables. If it is not possible to estimate the row count or rate it will return BeamTableStatistics.BOUNDED_UNKNOWN.