org.apache.beam.sdk.io.gcp.bigquery

Class TableRowToStorageApiProto

java.lang.Object

org.apache.beam.sdk.io.gcp.bigquery.TableRowToStorageApiProto

public class TableRowToStorageApiProto
extends java.lang.Object

Utility methods for converting JSON TableRow objects to dynamic protocol message, for use with the Storage write API.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TableRowToStorageApiProto.SchemaConversionException
static class	TableRowToStorageApiProto.SchemaDoesntMatchException
static class	TableRowToStorageApiProto.SchemaTooNarrowException

Constructor Summary

Constructors

Constructor and Description
TableRowToStorageApiProto()

Method Summary

Modifier and Type	Method and Description
static Descriptors.Descriptor	getDescriptorFromTableSchema(TableSchema jsonSchema, boolean respectRequired)
static Descriptors.Descriptor	getDescriptorFromTableSchema(com.google.cloud.bigquery.storage.v1.TableSchema tableSchema, boolean respectRequired) Given a BigQuery TableSchema, returns a protocol-buffer Descriptor that can be used to write data using the BigQuery Storage API.
static java.lang.Object	jsonValueFromMessageValue(Descriptors.FieldDescriptor fieldDescriptor, java.lang.Object fieldValue, boolean expandRepeated)
static DynamicMessage	messageFromMap(org.apache.beam.sdk.io.gcp.bigquery.TableRowToStorageApiProto.SchemaInformation schemaInformation, Descriptors.Descriptor descriptor, java.util.AbstractMap<java.lang.String,java.lang.Object> map, boolean ignoreUnknownValues)
static DynamicMessage	messageFromTableRow(org.apache.beam.sdk.io.gcp.bigquery.TableRowToStorageApiProto.SchemaInformation schemaInformation, Descriptors.Descriptor descriptor, TableRow tableRow, boolean ignoreUnknownValues) Given a BigQuery TableRow, returns a protocol-buffer message that can be used to write data using the BigQuery Storage API.
static com.google.cloud.bigquery.storage.v1.TableFieldSchema.Mode	modeToProtoMode(java.lang.String mode)
static java.lang.String	protoModeToJsonMode(com.google.cloud.bigquery.storage.v1.TableFieldSchema.Mode protoMode)
static TableSchema	protoSchemaToTableSchema(com.google.cloud.bigquery.storage.v1.TableSchema protoTableSchema)
static TableFieldSchema	protoTableFieldToTableField(com.google.cloud.bigquery.storage.v1.TableFieldSchema protoTableField)
static java.lang.String	protoTypeToJsonType(com.google.cloud.bigquery.storage.v1.TableFieldSchema.Type protoType)
static com.google.cloud.bigquery.storage.v1.TableSchema	schemaToProtoTableSchema(TableSchema tableSchema)
static com.google.cloud.bigquery.storage.v1.TableFieldSchema	tableFieldToProtoTableField(TableFieldSchema field)
static TableRow	tableRowFromMessage(Message message)
static com.google.cloud.bigquery.storage.v1.TableFieldSchema.Type	typeToProtoType(java.lang.String type)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TableRowToStorageApiProto

public TableRowToStorageApiProto()

Method Detail

modeToProtoMode

public static com.google.cloud.bigquery.storage.v1.TableFieldSchema.Mode modeToProtoMode(java.lang.String mode)

protoModeToJsonMode

public static java.lang.String protoModeToJsonMode(com.google.cloud.bigquery.storage.v1.TableFieldSchema.Mode protoMode)

protoTypeToJsonType

public static java.lang.String protoTypeToJsonType(com.google.cloud.bigquery.storage.v1.TableFieldSchema.Type protoType)

typeToProtoType

public static com.google.cloud.bigquery.storage.v1.TableFieldSchema.Type typeToProtoType(java.lang.String type)

protoSchemaToTableSchema

public static TableSchema protoSchemaToTableSchema(com.google.cloud.bigquery.storage.v1.TableSchema protoTableSchema)

protoTableFieldToTableField

public static TableFieldSchema protoTableFieldToTableField(com.google.cloud.bigquery.storage.v1.TableFieldSchema protoTableField)

schemaToProtoTableSchema

public static com.google.cloud.bigquery.storage.v1.TableSchema schemaToProtoTableSchema(TableSchema tableSchema)

tableFieldToProtoTableField

public static com.google.cloud.bigquery.storage.v1.TableFieldSchema tableFieldToProtoTableField(TableFieldSchema field)

getDescriptorFromTableSchema

public static Descriptors.Descriptor getDescriptorFromTableSchema(TableSchema jsonSchema,
                                                                  boolean respectRequired)
                                                           throws Descriptors.DescriptorValidationException

Throws:

Descriptors.DescriptorValidationException

getDescriptorFromTableSchema

public static Descriptors.Descriptor getDescriptorFromTableSchema(com.google.cloud.bigquery.storage.v1.TableSchema tableSchema,
                                                                  boolean respectRequired)
                                                           throws Descriptors.DescriptorValidationException

Given a BigQuery TableSchema, returns a protocol-buffer Descriptor that can be used to write data using the BigQuery Storage API.

Throws:

Descriptors.DescriptorValidationException

messageFromMap

public static DynamicMessage messageFromMap(org.apache.beam.sdk.io.gcp.bigquery.TableRowToStorageApiProto.SchemaInformation schemaInformation,
                                            Descriptors.Descriptor descriptor,
                                            java.util.AbstractMap<java.lang.String,java.lang.Object> map,
                                            boolean ignoreUnknownValues)
                                     throws TableRowToStorageApiProto.SchemaConversionException

Throws:

TableRowToStorageApiProto.SchemaConversionException

messageFromTableRow

public static DynamicMessage messageFromTableRow(org.apache.beam.sdk.io.gcp.bigquery.TableRowToStorageApiProto.SchemaInformation schemaInformation,
                                                 Descriptors.Descriptor descriptor,
                                                 TableRow tableRow,
                                                 boolean ignoreUnknownValues)
                                          throws TableRowToStorageApiProto.SchemaConversionException

Given a BigQuery TableRow, returns a protocol-buffer message that can be used to write data using the BigQuery Storage API.

Throws:

TableRowToStorageApiProto.SchemaConversionException

tableRowFromMessage

public static TableRow tableRowFromMessage(Message message)

jsonValueFromMessageValue

public static java.lang.Object jsonValueFromMessageValue(Descriptors.FieldDescriptor fieldDescriptor,
                                                         java.lang.Object fieldValue,
                                                         boolean expandRepeated)