org.apache.beam.sdk.extensions.sql.impl.schema

Class BeamPCollectionTable

java.lang.Object

org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

org.apache.beam.sdk.extensions.sql.impl.schema.BeamPCollectionTable

All Implemented Interfaces:

java.io.Serializable, BeamSqlTable

public class BeamPCollectionTable
extends BaseBeamTable

BeamPCollectionTable converts a PCollection<BeamSqlRow> as a virtual table, then a downstream query can query directly.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

beamSqlRowType

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	BeamPCollectionTable(BeamRecordSqlType beamSqlRowType)
	BeamPCollectionTable(PCollection<BeamRecord> upstream, BeamRecordSqlType beamSqlRowType)

Method Summary

Modifier and Type	Method and Description
PCollection<BeamRecord>	buildIOReader(Pipeline pipeline) create a PCollection<BeamSqlRow> from source.
PTransform<? super PCollection<BeamRecord>,PDone>	buildIOWriter() create a IO.write() instance to write to target.
BeamIOType	getSourceType() In Beam SQL, there's no difference between a batch query and a streaming query.

Methods inherited from class org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

getRowType

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BeamPCollectionTable

protected BeamPCollectionTable(BeamRecordSqlType beamSqlRowType)

BeamPCollectionTable

public BeamPCollectionTable(PCollection<BeamRecord> upstream,
                            BeamRecordSqlType beamSqlRowType)

Method Detail

getSourceType

public BeamIOType getSourceType()

Description copied from interface: BeamSqlTable

In Beam SQL, there's no difference between a batch query and a streaming query. BeamIOType is used to validate the sources.

buildIOReader

public PCollection<BeamRecord> buildIOReader(Pipeline pipeline)

Description copied from interface: BeamSqlTable

create a PCollection<BeamSqlRow> from source.

buildIOWriter

public PTransform<? super PCollection<BeamRecord>,PDone> buildIOWriter()

Description copied from interface: BeamSqlTable

create a IO.write() instance to write to target.