org.apache.beam.sdk.extensions.sql.impl.schema

Class BeamPCollectionTable

java.lang.Object

org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

org.apache.beam.sdk.extensions.sql.impl.schema.BeamPCollectionTable

All Implemented Interfaces:

java.io.Serializable, BeamSqlTable

public class BeamPCollectionTable
extends BaseBeamTable

BeamPCollectionTable converts a PCollection<BeamSqlRow> as a virtual table, then a downstream query can query directly.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

rowType

Constructor Summary

Constructors

Modifier	Constructor and Description
	BeamPCollectionTable(PCollection<Row> upstream, RowType beamRowType)
protected	BeamPCollectionTable(RowType beamRowType)

Method Summary

Modifier and Type	Method and Description
PCollection<Row>	buildIOReader(Pipeline pipeline) create a PCollection<BeamSqlRow> from source.
PTransform<? super PCollection<Row>,PDone>	buildIOWriter() create a IO.write() instance to write to target.
BeamIOType	getSourceType() In Beam SQL, there's no difference between a batch query and a streaming query.

Methods inherited from class org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

getRowType

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BeamPCollectionTable

protected BeamPCollectionTable(RowType beamRowType)

BeamPCollectionTable

public BeamPCollectionTable(PCollection<Row> upstream,
                            RowType beamRowType)

Method Detail

getSourceType

public BeamIOType getSourceType()

Description copied from interface: BeamSqlTable

In Beam SQL, there's no difference between a batch query and a streaming query. BeamIOType is used to validate the sources.

buildIOReader

public PCollection<Row> buildIOReader(Pipeline pipeline)

Description copied from interface: BeamSqlTable

create a PCollection<BeamSqlRow> from source.

buildIOWriter

public PTransform<? super PCollection<Row>,PDone> buildIOWriter()

Description copied from interface: BeamSqlTable

create a IO.write() instance to write to target.