apache_beam.io.gcp.bigtableio module

BigTable connector

This module implements writing to BigTable tables. The default mode is to set row data to write to BigTable tables. The syntax supported is described here: https://cloud.google.com/bigtable/docs/quickstart-cbt

BigTable connector can be used as main outputs. A main output (common case) is expected to be massive and will be split into manageable chunks and processed in parallel. In the example below we created a list of rows then passed to the GeneratedDirectRows DoFn to set the Cells and then we call the BigTableWriteFn to insert those generated rows in the table.

main_table = (p

beam.Create(self._generate())

WriteToBigTable(project_id, instance_id, table_id))

class apache_beam.io.gcp.bigtableio.WriteToBigTable(project_id=None, instance_id=None, table_id=None)

Bases: apache_beam.transforms.ptransform.PTransform

A transform to write to the Bigtable Table.

A PTransform that write a list of DirectRow into the Bigtable Table

The PTransform to access the Bigtable Write connector :param project_id: GCP Project of to write the Rows :type project_id: str :param instance_id: GCP Instance to write the Rows :type instance_id: str :param table_id: GCP Table to write the DirectRows :type table_id: str

expand(pvalue)