This module implements writing to BigTable tables. The default mode is to set row data to write to BigTable tables. The syntax supported is described here: https://cloud.google.com/bigtable/docs/quickstart-cbt
BigTable connector can be used as main outputs. A main output (common case) is expected to be massive and will be split into manageable chunks and processed in parallel. In the example below we created a list of rows then passed to the GeneratedDirectRows DoFn to set the Cells and then we call the BigTableWriteFn to insert those generated rows in the table.
- main_table = (p
- beam.Create(self._generate())WriteToBigTable(project_id, instance_id, table_id))
WriteToBigTable(project_id=None, instance_id=None, table_id=None)¶
A transform to write to the Bigtable Table.
A PTransform that write a list of DirectRow into the Bigtable Table
The PTransform to access the Bigtable Write connector :param project_id: GCP Project of to write the Rows :type project_id: str :param instance_id: GCP Instance to write the Rows :type instance_id: str :param table_id: GCP Table to write the DirectRows :type table_id: str