org.apache.beam.sdk.extensions.sql.meta.provider.hcatalog

Class HCatalogTable

java.lang.Object

org.apache.beam.sdk.extensions.sql.meta.BaseBeamTable

org.apache.beam.sdk.extensions.sql.meta.provider.hcatalog.HCatalogTable

All Implemented Interfaces:

BeamSqlTable

@Experimental
public abstract class HCatalogTable
extends BaseBeamTable

Beam SQL table that wraps HCatalogIO.

Reads HCatRecords and converts them to Rows.

Constructor Summary

Constructors

Constructor and Description
HCatalogTable()

Method Summary

Modifier and Type	Method and Description
PCollection<Row>	buildIOReader(PBegin begin) create a PCollection<Row> from source.
POutput	buildIOWriter(PCollection<Row> input) create a IO.write() instance to write to target.
abstract java.util.Map<java.lang.String,java.lang.String>	config()
abstract java.lang.String	database()
Schema	getSchema() Get the schema info of the table.
BeamTableStatistics	getTableStatistics(PipelineOptions options) Estimates the number of rows or the rate for unbounded Tables.
PCollection.IsBounded	isBounded() Whether this table is bounded (known to be finite) or unbounded (may or may not be finite).
abstract Schema	schema()
abstract java.lang.String	table()

Methods inherited from class org.apache.beam.sdk.extensions.sql.meta.BaseBeamTable

buildIOReader, constructFilter, supportsProjects

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HCatalogTable

public HCatalogTable()

Method Detail

schema

public abstract Schema schema()

config

public abstract java.util.Map<java.lang.String,java.lang.String> config()

database

public abstract java.lang.String database()

table

public abstract java.lang.String table()

buildIOReader

public PCollection<Row> buildIOReader(PBegin begin)

Description copied from interface: BeamSqlTable

create a PCollection<Row> from source.

buildIOWriter

public POutput buildIOWriter(PCollection<Row> input)

Description copied from interface: BeamSqlTable

create a IO.write() instance to write to target.

isBounded

public PCollection.IsBounded isBounded()

Description copied from interface: BeamSqlTable

Whether this table is bounded (known to be finite) or unbounded (may or may not be finite).

getTableStatistics

public BeamTableStatistics getTableStatistics(PipelineOptions options)

Description copied from interface: BeamSqlTable

Estimates the number of rows or the rate for unbounded Tables. If it is not possible to estimate the row count or rate it will return BeamTableStatistics.BOUNDED_UNKNOWN.

getSchema

public Schema getSchema()

Description copied from interface: BeamSqlTable

Get the schema info of the table.