Package org.apache.beam.sdk.io.gcp.bigquery

Class AvroGenericRecordToStorageApiProto

java.lang.Object

org.apache.beam.sdk.io.gcp.bigquery.AvroGenericRecordToStorageApiProto

public class AvroGenericRecordToStorageApiProto
extends Object

Utility methods for converting Avro GenericRecord objects to dynamic protocol message, for use with the Storage write API.

Constructor Summary

Constructors

Constructor	Description
AvroGenericRecordToStorageApiProto()

Method Summary

Modifier and Type	Method	Description
static DynamicMessage	messageFromGenericRecord(Descriptors.Descriptor descriptor, GenericRecord record, String changeType, long changeSequenceNum)	Forwards to messageFromGenericRecord(Descriptor, GenericRecord, String, String) via Long.toHexString(long).
static DynamicMessage	messageFromGenericRecord(Descriptors.Descriptor descriptor, GenericRecord record, String changeType, String changeSequenceNum)	Given an Avro GenericRecord object, returns a protocol-buffer message that can be used to write data using the BigQuery Storage streaming API.
static com.google.cloud.bigquery.storage.v1.TableSchema	protoTableSchemaFromAvroSchema(Schema schema)	Given an Avro Schema, returns a protocol-buffer TableSchema that can be used to write data through BigQuery Storage API.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

AvroGenericRecordToStorageApiProto

public AvroGenericRecordToStorageApiProto()

Method Details

protoTableSchemaFromAvroSchema

public static com.google.cloud.bigquery.storage.v1.TableSchema protoTableSchemaFromAvroSchema(Schema schema)

Given an Avro Schema, returns a protocol-buffer TableSchema that can be used to write data through BigQuery Storage API.

Parameters:

schema - An Avro Schema

Returns:

Returns the TableSchema created from the provided Schema

messageFromGenericRecord

public static DynamicMessage messageFromGenericRecord(Descriptors.Descriptor descriptor,
 GenericRecord record,
 @Nullable
 String changeType,
 long changeSequenceNum)

Forwards to messageFromGenericRecord(Descriptor, GenericRecord, String, String) via Long.toHexString(long).

messageFromGenericRecord

public static DynamicMessage messageFromGenericRecord(Descriptors.Descriptor descriptor,
 GenericRecord record,
 @Nullable
 String changeType,
 @Nullable
 String changeSequenceNum)

Given an Avro GenericRecord object, returns a protocol-buffer message that can be used to write data using the BigQuery Storage streaming API.

Parameters:

descriptor - The Descriptor for the DynamicMessage result

record - An Avro GenericRecord

Returns:

A dynamic message representation of a Proto payload to be used for StorageWrite API