org.apache.beam.sdk.io.hcatalog

Class HCatalogBeamSchema

java.lang.Object

org.apache.beam.sdk.io.hcatalog.HCatalogBeamSchema

@Experimental(value=SCHEMAS)
public class HCatalogBeamSchema
extends java.lang.Object

Adapter from HCatalog table schema to Beam Schema.

Loads a table schema from Hive Metastore specified in properties map, similar to HCatalogIO.

One of the use cases is to perform the schema conversion without leaking any HCatalog types.

Method Summary

Modifier and Type	Method and Description
static HCatalogBeamSchema	create(java.util.Map<java.lang.String,java.lang.String> config) Create the schema adapter.
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Optional<Schema>	getTableSchema(java.lang.String db, java.lang.String table) Gets the table schema, or absent optional if the table doesn't exist in the database.
boolean	hasDatabase(java.lang.String dbName) Checks if metastore client has the specified database.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

create

public static HCatalogBeamSchema create(java.util.Map<java.lang.String,java.lang.String> config)

Create the schema adapter.

Config map is used to construct the HiveMetaStoreClient.

hasDatabase

public boolean hasDatabase(java.lang.String dbName)

Checks if metastore client has the specified database.

getTableSchema

public org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Optional<Schema> getTableSchema(java.lang.String db,
                                                                                                     java.lang.String table)

Gets the table schema, or absent optional if the table doesn't exist in the database.