org.apache.beam.sdk.io.hcatalog

Class HCatToRow

java.lang.Object

org.apache.beam.sdk.io.hcatalog.HCatToRow

public class HCatToRow
extends java.lang.Object

Utilities to convert HCatRecords to Rows.

Constructor Summary

Constructors

Constructor and Description
HCatToRow()

Method Summary

Modifier and Type	Method and Description
static PTransform<PCollection<? extends org.apache.hive.hcatalog.data.HCatRecord>,PCollection<Row>>	forSchema(Schema schema) Creates a PTransform that converts incoming HCatRecords to Rows using specified schema.
static PTransform<PBegin,PCollection<Row>>	fromSpec(HCatalogIO.Read readSpec) Wraps the HCatalogIO.read() to convert HCatRecords to Rows.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HCatToRow

public HCatToRow()

Method Detail

forSchema

public static PTransform<PCollection<? extends org.apache.hive.hcatalog.data.HCatRecord>,PCollection<Row>> forSchema(Schema schema)

Creates a PTransform that converts incoming HCatRecords to Rows using specified schema.

If there is a mismatch between the schema specified here and actual record schema, or internal representation and schema, then runtime errors will happen.

fromSpec

public static PTransform<PBegin,PCollection<Row>> fromSpec(HCatalogIO.Read readSpec)

Wraps the HCatalogIO.read() to convert HCatRecords to Rows.

Eventually this should become part of the IO, e.g. HCatalogIO.readRows().