org.apache.beam.sdk.extensions.sql

Interface BeamSqlTable

All Known Implementing Classes:

BaseBeamTable, BeamBigQueryTable, BeamKafkaCSVTable, BeamKafkaTable, BeamPCollectionTable, BeamTextCSVTable, BeamTextTable

public interface BeamSqlTable

This interface defines a Beam Sql Table.

Method Summary

Modifier and Type	Method and Description
PCollection<Row>	buildIOReader(Pipeline pipeline) create a PCollection<BeamSqlRow> from source.
PTransform<? super PCollection<Row>,POutput>	buildIOWriter() create a IO.write() instance to write to target.
Schema	getSchema() Get the schema info of the table.
BeamIOType	getSourceType() In Beam SQL, there's no difference between a batch query and a streaming query.

Method Detail

getSourceType

BeamIOType getSourceType()

In Beam SQL, there's no difference between a batch query and a streaming query. BeamIOType is used to validate the sources.

buildIOReader

PCollection<Row> buildIOReader(Pipeline pipeline)

create a PCollection<BeamSqlRow> from source.

buildIOWriter

PTransform<? super PCollection<Row>,POutput> buildIOWriter()

create a IO.write() instance to write to target.

getSchema

Schema getSchema()

Get the schema info of the table.