org.apache.beam.sdk.extensions.sql.meta.provider.mongodb

Class MongoDbTable

java.lang.Object

org.apache.beam.sdk.extensions.sql.meta.BaseBeamTable

org.apache.beam.sdk.extensions.sql.meta.SchemaBaseBeamTable

org.apache.beam.sdk.extensions.sql.meta.provider.mongodb.MongoDbTable

All Implemented Interfaces:

java.io.Serializable, BeamSqlTable

@Experimental
public class MongoDbTable
extends SchemaBaseBeamTable
implements java.io.Serializable

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	MongoDbTable.DocumentToRow
static class	MongoDbTable.RowToDocument

Field Summary

Fields inherited from class org.apache.beam.sdk.extensions.sql.meta.SchemaBaseBeamTable

schema

Method Summary

Modifier and Type	Method and Description
PCollection<Row>	buildIOReader(PBegin begin) create a PCollection<Row> from source.
PCollection<Row>	buildIOReader(PBegin begin, BeamSqlTableFilter filters, java.util.List<java.lang.String> fieldNames) create a PCollection<Row> from source with predicate and/or project pushed-down.
POutput	buildIOWriter(PCollection<Row> input) create a IO.write() instance to write to target.
BeamSqlTableFilter	constructFilter(java.util.List<org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rex.RexNode> filter) Generate an IO implementation of BeamSqlTableFilter for predicate push-down.
BeamTableStatistics	getTableStatistics(PipelineOptions options) Estimates the number of rows or the rate for unbounded Tables.
PCollection.IsBounded	isBounded() Whether this table is bounded (known to be finite) or unbounded (may or may not be finite).
ProjectSupport	supportsProjects() Whether project push-down is supported by the IO API.

Methods inherited from class org.apache.beam.sdk.extensions.sql.meta.SchemaBaseBeamTable

getSchema

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

buildIOReader

public PCollection<Row> buildIOReader(PBegin begin)

Description copied from interface: BeamSqlTable

create a PCollection<Row> from source.

Specified by:

buildIOReader in interface BeamSqlTable

buildIOReader

public PCollection<Row> buildIOReader(PBegin begin,
                                      BeamSqlTableFilter filters,
                                      java.util.List<java.lang.String> fieldNames)

Description copied from interface: BeamSqlTable

create a PCollection<Row> from source with predicate and/or project pushed-down.

Specified by:

buildIOReader in interface BeamSqlTable

Overrides:

buildIOReader in class BaseBeamTable

buildIOWriter

public POutput buildIOWriter(PCollection<Row> input)

Description copied from interface: BeamSqlTable

create a IO.write() instance to write to target.

Specified by:

buildIOWriter in interface BeamSqlTable

supportsProjects

public ProjectSupport supportsProjects()

Description copied from interface: BeamSqlTable

Whether project push-down is supported by the IO API.

Specified by:

supportsProjects in interface BeamSqlTable

Overrides:

supportsProjects in class BaseBeamTable

constructFilter

public BeamSqlTableFilter constructFilter(java.util.List<org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rex.RexNode> filter)

Description copied from interface: BeamSqlTable

Generate an IO implementation of BeamSqlTableFilter for predicate push-down.

Specified by:

constructFilter in interface BeamSqlTable

Overrides:

constructFilter in class BaseBeamTable

isBounded

public PCollection.IsBounded isBounded()

Description copied from interface: BeamSqlTable

Whether this table is bounded (known to be finite) or unbounded (may or may not be finite).

Specified by:

isBounded in interface BeamSqlTable

getTableStatistics

public BeamTableStatistics getTableStatistics(PipelineOptions options)

Description copied from interface: BeamSqlTable

Estimates the number of rows or the rate for unbounded Tables. If it is not possible to estimate the row count or rate it will return BeamTableStatistics.BOUNDED_UNKNOWN.

Specified by:

getTableStatistics in interface BeamSqlTable