org.apache.beam.sdk.extensions.sql.meta

Class BaseBeamTable

java.lang.Object

org.apache.beam.sdk.extensions.sql.meta.BaseBeamTable

All Implemented Interfaces:

BeamSqlTable

Direct Known Subclasses:

HCatalogTable, SchemaBaseBeamTable

public abstract class BaseBeamTable
extends java.lang.Object
implements BeamSqlTable

Basic implementation of BeamSqlTable.

Constructor Summary

Constructors

Constructor and Description
BaseBeamTable()

Method Summary

Modifier and Type	Method and Description
PCollection<Row>	buildIOReader(PBegin begin, BeamSqlTableFilter filters, java.util.List<java.lang.String> fieldNames) create a PCollection<Row> from source with predicate and/or project pushed-down.
BeamSqlTableFilter	constructFilter(java.util.List<org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rex.RexNode> filter) Generate an IO implementation of BeamSqlTableFilter for predicate push-down.
BeamTableStatistics	getTableStatistics(PipelineOptions options) Estimates the number of rows or the rate for unbounded Tables.
ProjectSupport	supportsProjects() Whether project push-down is supported by the IO API.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.beam.sdk.extensions.sql.meta.BeamSqlTable

buildIOReader, buildIOWriter, getSchema, isBounded

Constructor Detail

BaseBeamTable

public BaseBeamTable()

Method Detail

getTableStatistics

public BeamTableStatistics getTableStatistics(PipelineOptions options)

Description copied from interface: BeamSqlTable

Estimates the number of rows or the rate for unbounded Tables. If it is not possible to estimate the row count or rate it will return BeamTableStatistics.BOUNDED_UNKNOWN.

Specified by:

getTableStatistics in interface BeamSqlTable

buildIOReader

public PCollection<Row> buildIOReader(PBegin begin,
                                      BeamSqlTableFilter filters,
                                      java.util.List<java.lang.String> fieldNames)

Description copied from interface: BeamSqlTable

create a PCollection<Row> from source with predicate and/or project pushed-down.

Specified by:

buildIOReader in interface BeamSqlTable

constructFilter

public BeamSqlTableFilter constructFilter(java.util.List<org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rex.RexNode> filter)

Description copied from interface: BeamSqlTable

Generate an IO implementation of BeamSqlTableFilter for predicate push-down.

Specified by:

constructFilter in interface BeamSqlTable

supportsProjects

public ProjectSupport supportsProjects()

Description copied from interface: BeamSqlTable

Whether project push-down is supported by the IO API.

Specified by:

supportsProjects in interface BeamSqlTable