Package org.apache.beam.sdk.io.hcatalog

package org.apache.beam.sdk.io.hcatalog

Transforms for reading and writing using HCatalog.

WARNING:This package requires users to declare their own dependency on org.apache.hive:hive-exec and org.apache.hive.hcatalog. At the time of this Beam release every released version of those packages had a transitive dependency on a version of log4j vulnerable to CVE-2021-44228. We strongly encourage users to pin a non-vulnerable version of log4j when using this package. See Issue #21426.

Related Packages

Package	Description
org.apache.beam.sdk.io	Defines transforms for reading and writing common storage formats, including invalid reference org.apache.beam.sdk.io.AvroIO , and TextIO.

Classes

Class	Description
HCatalogBeamSchema	Adapter from HCatalog table schema to Beam Schema.
HCatalogIO	IO to read and write data using HCatalog.
HCatalogIO.Read	A PTransform to read data using HCatalog.
HCatalogIO.Write	A PTransform to write to a HCatalog managed source.
HCatalogUtils	Utility classes to enable meta store conf/client creation.
HCatToRow	Utilities to convert HCatRecords to Rows.