org.apache.beam.sdk.extensions.sql

Interface BeamSqlTable

All Known Implementing Classes:

BaseBeamTable, BeamKafkaCSVTable, BeamKafkaTable, BeamPCollectionTable, HCatalogTable, ParquetTable, TestBoundedTable, TestTable, TestUnboundedTable, TextTable

public interface BeamSqlTable

This interface defines a Beam Sql Table.

Method Summary

Modifier and Type	Method and Description
PCollection<Row>	buildIOReader(PBegin begin) create a PCollection<Row> from source.
POutput	buildIOWriter(PCollection<Row> input) create a IO.write() instance to write to target.
default BeamTableStatistics	getRowCount(PipelineOptions options) Estimates the number of rows or the rate for unbounded Tables.
Schema	getSchema() Get the schema info of the table.
PCollection.IsBounded	isBounded() Whether this table is bounded (known to be finite) or unbounded (may or may not be finite).

Method Detail

buildIOReader

PCollection<Row> buildIOReader(PBegin begin)

create a PCollection<Row> from source.

buildIOWriter

POutput buildIOWriter(PCollection<Row> input)

create a IO.write() instance to write to target.

isBounded

PCollection.IsBounded isBounded()

Whether this table is bounded (known to be finite) or unbounded (may or may not be finite).

getSchema

Schema getSchema()

Get the schema info of the table.

getRowCount

default BeamTableStatistics getRowCount(PipelineOptions options)

Estimates the number of rows or the rate for unbounded Tables.