Package org.apache.beam.sdk.io.iceberg
package org.apache.beam.sdk.io.iceberg
Iceberg connectors.
-
ClassDescriptionA transform that takes in a stream of file paths, converts them to Iceberg
DataFiles with partition metadata and metrics, then commits them to an IcebergTable.BundleLifter<T>A PTransform that buffers elements and outputs them to one of two TupleTags based on the total size of the bundle in finish_bundle.Utilities that convert between a SQL filter expression and an IcebergExpression.SchemaTransform implementation forIcebergIO.readRows(org.apache.beam.sdk.io.iceberg.IcebergCatalogConfig).A connector that reads and writes to Apache Iceberg tables.SchemaTransform implementation forIcebergIO.readRows(org.apache.beam.sdk.io.iceberg.IcebergCatalogConfig).Utilities for converting between Beam and Iceberg types, made public for user's convenience.SchemaTransform implementation forIcebergIO.writeRows(org.apache.beam.sdk.io.iceberg.IcebergCatalogConfig).Helper class for source operations.This is an AutoValue representation of an IcebergSnapshot.