org.apache.beam.sdk.extensions.sql.impl.schema

Class BeamPCollectionTable

java.lang.Object

org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

org.apache.beam.sdk.extensions.sql.impl.schema.BeamPCollectionTable

All Implemented Interfaces:

java.io.Serializable, BeamSqlTable

public class BeamPCollectionTable
extends BaseBeamTable

BeamPCollectionTable converts a PCollection<Row> as a virtual table, then a downstream query can query directly.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

schema

Constructor Summary

Constructors

Constructor and Description
BeamPCollectionTable(PCollection<Row> upstream)

Method Summary

Modifier and Type	Method and Description
PCollection<Row>	buildIOReader(Pipeline pipeline) create a PCollection<BeamSqlRow> from source.
PTransform<? super PCollection<Row>,POutput>	buildIOWriter() create a IO.write() instance to write to target.
BeamIOType	getSourceType() In Beam SQL, there's no difference between a batch query and a streaming query.

Methods inherited from class org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

getSchema

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BeamPCollectionTable

public BeamPCollectionTable(PCollection<Row> upstream)

Method Detail

getSourceType

public BeamIOType getSourceType()

Description copied from interface: BeamSqlTable

In Beam SQL, there's no difference between a batch query and a streaming query. BeamIOType is used to validate the sources.

buildIOReader

public PCollection<Row> buildIOReader(Pipeline pipeline)

Description copied from interface: BeamSqlTable

create a PCollection<BeamSqlRow> from source.

buildIOWriter

public PTransform<? super PCollection<Row>,POutput> buildIOWriter()

Description copied from interface: BeamSqlTable

create a IO.write() instance to write to target.