org.apache.beam.runners.dataflow

Class BigQueryFileToTable

java.lang.Object

org.apache.beam.runners.dataflow.BigQueryFileToTable

public class BigQueryFileToTable
extends java.lang.Object

An example that stresses the BigQuery sink at scale.

A 1TB file is read in a specified number of times, and each copy is written to the BigQuery sink. Output tables are assigned dynamically, and the number of output tables can be configured. This allows stress testing both the amount of data being written as well as the number of tables.

Constructor Summary

Constructors

Constructor and Description
BigQueryFileToTable()

Method Summary

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BigQueryFileToTable

public BigQueryFileToTable()