Package org.apache.beam.sdk.io.gcp.bigquery

Defines transforms for reading and writing from Google BigQuery.

See: Description

Interface Summary

Interface	Description
BigQueryOptions	Properties needed when using Google BigQuery with the Apache Beam SDK.
TestBigQueryOptions	TestPipelineOptions for TestBigQuery.

Class Summary

Class	Description
BigQueryCoderProviderRegistrar	A CoderProviderRegistrar for standard types used with BigQueryIO.
BigQueryHelpers	A set of helper functions and classes used by BigQueryIO.
BigQueryIO	PTransforms for reading and writing BigQuery tables.
BigQueryIO.Read	Implementation of BigQueryIO.read().
BigQueryIO.TypedRead<T>	Implementation of BigQueryIO.read(SerializableFunction).
BigQueryIO.Write<T>	Implementation of BigQueryIO.write().
BigQueryUtils	Utility methods for BigQuery related operations.
CreateTables<DestinationT>	Creates any tables needed before performing streaming writes to the tables.
DynamicDestinations<T,DestinationT>	This class provides the most general way of specifying dynamic BigQuery table destinations.
InsertRetryPolicy	A retry policy for streaming BigQuery inserts.
InsertRetryPolicy.Context	Contains information about a failed insert.
PrepareWrite<T,DestinationT>	Prepare an input PCollection for writing to BigQuery.
ReifyAsIterable<T>	This transforms turns a side input into a singleton PCollection that can be used as the main input for another transform.
SchemaAndRecord	A wrapper for a GenericRecord and the TableSchema representing the schema of the table (or query) it was generated from.
StreamingInserts<DestinationT>	PTransform that performs streaming BigQuery write.
StreamingWriteTables	This transform takes in key-value pairs of TableRow entries and the TableDestination it should be written to.
TableDestination	Encapsulates a BigQuery table destination.
TableDestinationCoder	A coder for TableDestination objects.
TableDestinationCoderV2	A Coder for TableDestination that includes time partitioning information.
TableRowJsonCoder	A Coder that encodes BigQuery TableRow objects in their native JSON format.
TestBigQuery	Test rule which creates a new table with specified schema, with randomized name and exposes few APIs to work with it.
WriteResult	The result of a BigQueryIO.Write transform.

Enum Summary

Enum	Description
BigQueryIO.TypedRead.QueryPriority	An enumeration type for the priority of a query.
BigQueryIO.Write.CreateDisposition	An enumeration type for the BigQuery create disposition strings.
BigQueryIO.Write.Method	Determines the method used to insert data in BigQuery.
BigQueryIO.Write.WriteDisposition	An enumeration type for the BigQuery write disposition strings.

Package org.apache.beam.sdk.io.gcp.bigquery Description

Defines transforms for reading and writing from Google BigQuery.

See Also:

BigQueryIO