org.apache.beam.sdk.extensions.sql.meta.provider.hcatalog

Class HCatalogTable

java.lang.Object

org.apache.beam.sdk.extensions.sql.meta.provider.hcatalog.HCatalogTable

All Implemented Interfaces:

BeamSqlTable

@Experimental
public abstract class HCatalogTable
extends java.lang.Object
implements BeamSqlTable

Beam SQL table that wraps HCatalogIO.

Reads HCatRecords and converts them to Rows.

Constructor Summary

Constructors

Constructor and Description
HCatalogTable()

Method Summary

Modifier and Type	Method and Description
PCollection<Row>	buildIOReader(PBegin begin) create a PCollection<Row> from source.
POutput	buildIOWriter(PCollection<Row> input) create a IO.write() instance to write to target.
abstract java.util.Map<java.lang.String,java.lang.String>	config()
abstract java.lang.String	database()
Schema	getSchema() Get the schema info of the table.
BeamTableStatistics	getTableStatistics(PipelineOptions options) Estimates the number of rows or the rate for unbounded Tables.
PCollection.IsBounded	isBounded() Whether this table is bounded (known to be finite) or unbounded (may or may not be finite).
abstract Schema	schema()
abstract java.lang.String	table()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HCatalogTable

public HCatalogTable()

Method Detail

schema

public abstract Schema schema()

config

public abstract java.util.Map<java.lang.String,java.lang.String> config()

database

public abstract java.lang.String database()

table

public abstract java.lang.String table()

buildIOReader

public PCollection<Row> buildIOReader(PBegin begin)

Description copied from interface: BeamSqlTable

create a PCollection<Row> from source.

Specified by:

buildIOReader in interface BeamSqlTable

buildIOWriter

public POutput buildIOWriter(PCollection<Row> input)

Description copied from interface: BeamSqlTable

create a IO.write() instance to write to target.

Specified by:

buildIOWriter in interface BeamSqlTable

isBounded

public PCollection.IsBounded isBounded()

Description copied from interface: BeamSqlTable

Whether this table is bounded (known to be finite) or unbounded (may or may not be finite).

Specified by:

isBounded in interface BeamSqlTable

getTableStatistics

public BeamTableStatistics getTableStatistics(PipelineOptions options)

Description copied from interface: BeamSqlTable

Estimates the number of rows or the rate for unbounded Tables. If it is not possible to estimate the row count or rate it will return BeamTableStatistics.BOUNDED_UNKNOWN.

Specified by:

getTableStatistics in interface BeamSqlTable

getSchema

public Schema getSchema()

Description copied from interface: BeamSqlTable

Get the schema info of the table.

Specified by:

getSchema in interface BeamSqlTable