apache_beam.testing.load_tests.load_test_metrics_utils module

Utility functions used for integrating Metrics API into load tests pipelines.

Metrics are send to BigQuery in following format: test_id | submit_timestamp | metric_type | value

The ‘test_id’ is common for all metrics for one run. Currently it is possible to have following metrics types: * runtime * total_bytes_count

apache_beam.testing.load_tests.load_test_metrics_utils.get_element_by_schema(schema_name, insert_list)[source]
class apache_beam.testing.load_tests.load_test_metrics_utils.BigQueryClient(project_name, table, dataset)[source]

Bases: object

match_and_save(rows)[source]
class apache_beam.testing.load_tests.load_test_metrics_utils.MetricsMonitor(project_name, table, dataset)[source]

Bases: object

send_metrics(result)[source]
class apache_beam.testing.load_tests.load_test_metrics_utils.MeasureTime(namespace)[source]

Bases: apache_beam.transforms.core.DoFn

start_bundle()[source]
finish_bundle()[source]
process(element)[source]
apache_beam.testing.load_tests.load_test_metrics_utils.count_bytes(f)[source]