Package org.apache.beam.sdk.io.gcp.bigquery

Class BigQueryHelpers

java.lang.Object

org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers

public class BigQueryHelpers
extends Object

A set of helper functions and classes used by BigQueryIO.

Constructor Summary

Constructors

Constructor	Description
BigQueryHelpers()

Method Summary

Modifier and Type	Method	Description
static List<String>	dataCatalogSegments(TableReference ref, BigQueryOptions options)
static <T> @PolyNull T	fromJsonString(@PolyNull String json, Class<T> clazz)
static @Nullable BigInteger	getNumRows(BigQueryOptions options, TableReference tableRef)	It returns the number of rows for a given table.
static @Nullable Table	getTable(BigQueryOptions options, TableReference tableRef)
static TableReference	parseTableSpec(String tableSpec)	Parse a table specification in the form "[project_id]:[dataset_id].[table_id]" or "[project_id].[dataset_id].[table_id]" or "[dataset_id].[table_id]".
static TableReference	parseTableUrn(String tableUrn)
static String	stripPartitionDecorator(String tableSpec)	Strip off any partition decorator information from a tablespec.
static @PolyNull String	toJsonString(@PolyNull Object item)
static String	toTableSpec(TableReference ref)	Returns a canonical string representation of the TableReference.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

BigQueryHelpers

public BigQueryHelpers()

Method Details

toTableSpec

public static String toTableSpec(TableReference ref)

Returns a canonical string representation of the TableReference.

dataCatalogSegments

public static List<String> dataCatalogSegments(TableReference ref,
 BigQueryOptions options)

parseTableSpec

public static TableReference parseTableSpec(String tableSpec)

Parse a table specification in the form "[project_id]:[dataset_id].[table_id]" or "[project_id].[dataset_id].[table_id]" or "[dataset_id].[table_id]".

If the project id is omitted, the default project id is used.

parseTableUrn

public static TableReference parseTableUrn(String tableUrn)

stripPartitionDecorator

public static String stripPartitionDecorator(String tableSpec)

Strip off any partition decorator information from a tablespec.

toJsonString

public static @PolyNull String toJsonString(@PolyNull Object item)

fromJsonString

public static <T> @PolyNull T fromJsonString(@PolyNull String json,
 Class<T> clazz)

getNumRows

public static @Nullable BigInteger getNumRows(BigQueryOptions options,
 TableReference tableRef)
                                       throws InterruptedException,
IOException

It returns the number of rows for a given table.

Returns:

The number of rows in the table or null if it cannot get any estimate.

Throws:

InterruptedException

IOException

getTable

public static @Nullable Table getTable(BigQueryOptions options,
 TableReference tableRef)
                                throws InterruptedException,
IOException

Throws:

InterruptedException

IOException