org.apache.beam.sdk.io.gcp.bigquery

Class BigQueryHelpers

java.lang.Object

org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers

public class BigQueryHelpers
extends java.lang.Object

A set of helper functions and classes used by BigQueryIO.

Constructor Summary

Constructors

Constructor and Description
BigQueryHelpers()

Method Summary

Modifier and Type	Method and Description
static java.util.List<java.lang.String>	dataCatalogSegments(TableReference ref, BigQueryOptions options)
static <T> T	fromJsonString(@PolyNull java.lang.String json, java.lang.Class<T> clazz)
static @Nullable java.math.BigInteger	getNumRows(BigQueryOptions options, TableReference tableRef) It returns the number of rows for a given table.
static @Nullable Table	getTable(BigQueryOptions options, TableReference tableRef)
static TableReference	parseTableSpec(java.lang.String tableSpec) Parse a table specification in the form "[project_id]:[dataset_id].[table_id]" or "[project_id].[dataset_id].[table_id]" or "[dataset_id].[table_id]".
static TableReference	parseTableUrn(java.lang.String tableUrn)
static java.lang.String	stripPartitionDecorator(java.lang.String tableSpec) Strip off any partition decorator information from a tablespec.
static @PolyNull java.lang.String	toJsonString(@PolyNull java.lang.Object item)
static java.lang.String	toTableSpec(TableReference ref) Returns a canonical string representation of the TableReference.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BigQueryHelpers

public BigQueryHelpers()

Method Detail

toTableSpec

public static java.lang.String toTableSpec(TableReference ref)

Returns a canonical string representation of the TableReference.

dataCatalogSegments

public static java.util.List<java.lang.String> dataCatalogSegments(TableReference ref,
                                                                   BigQueryOptions options)

parseTableSpec

public static TableReference parseTableSpec(java.lang.String tableSpec)

Parse a table specification in the form "[project_id]:[dataset_id].[table_id]" or "[project_id].[dataset_id].[table_id]" or "[dataset_id].[table_id]".

If the project id is omitted, the default project id is used.

parseTableUrn

public static TableReference parseTableUrn(java.lang.String tableUrn)

stripPartitionDecorator

public static java.lang.String stripPartitionDecorator(java.lang.String tableSpec)

Strip off any partition decorator information from a tablespec.

toJsonString

public static @PolyNull java.lang.String toJsonString(@PolyNull java.lang.Object item)

fromJsonString

public static <T> T fromJsonString(@PolyNull java.lang.String json,
                                   java.lang.Class<T> clazz)

getNumRows

public static @Nullable java.math.BigInteger getNumRows(BigQueryOptions options,
                                                        TableReference tableRef)
                                                 throws java.lang.InterruptedException,
                                                        java.io.IOException

It returns the number of rows for a given table.

Returns:

The number of rows in the table or null if it cannot get any estimate.

Throws:

java.lang.InterruptedException

java.io.IOException

getTable

public static @Nullable Table getTable(BigQueryOptions options,
                                       TableReference tableRef)
                                throws java.lang.InterruptedException,
                                       java.io.IOException

Throws:

java.lang.InterruptedException

java.io.IOException