org.apache.beam.sdk.io.gcp.bigquery

Class AvroGenericRecordToStorageApiProto

java.lang.Object

org.apache.beam.sdk.io.gcp.bigquery.AvroGenericRecordToStorageApiProto

public class AvroGenericRecordToStorageApiProto
extends java.lang.Object

Utility methods for converting Avro GenericRecord objects to dynamic protocol message, for use with the Storage write API.

Constructor Summary

Constructors

Constructor and Description
AvroGenericRecordToStorageApiProto()

Method Summary

Modifier and Type	Method and Description
static com.google.protobuf.DynamicMessage	messageFromGenericRecord(com.google.protobuf.Descriptors.Descriptor descriptor, GenericRecord record, java.lang.String changeType, long changeSequenceNum) Given an Avro GenericRecord object, returns a protocol-buffer message that can be used to write data using the BigQuery Storage streaming API.
static com.google.cloud.bigquery.storage.v1.TableSchema	protoTableSchemaFromAvroSchema(Schema schema) Given an Avro Schema, returns a protocol-buffer TableSchema that can be used to write data through BigQuery Storage API.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AvroGenericRecordToStorageApiProto

public AvroGenericRecordToStorageApiProto()

Method Detail

protoTableSchemaFromAvroSchema

public static com.google.cloud.bigquery.storage.v1.TableSchema protoTableSchemaFromAvroSchema(Schema schema)

Given an Avro Schema, returns a protocol-buffer TableSchema that can be used to write data through BigQuery Storage API.

Parameters:

schema - An Avro Schema

Returns:

Returns the TableSchema created from the provided Schema

messageFromGenericRecord

public static com.google.protobuf.DynamicMessage messageFromGenericRecord(com.google.protobuf.Descriptors.Descriptor descriptor,
                                                                          GenericRecord record,
                                                                          @Nullable
                                                                          java.lang.String changeType,
                                                                          long changeSequenceNum)

Given an Avro GenericRecord object, returns a protocol-buffer message that can be used to write data using the BigQuery Storage streaming API.

Parameters:

descriptor - The Descriptor for the DynamicMessage result

record - An Avro GenericRecord

Returns:

A dynamic message representation of a Proto payload to be used for StorageWrite API