apache_beam.testing.load_tests.streaming.group_by_key_streaming_pipeline module

Streaming pipeline which reads, GBK and ungroup data from PubSub. Pipeline is cancelled when matcher achieves expected elements amount or reaches timeout. To cancel pipeline by matcher it is required to use TestRunner (TestDataflowRunner or TestDirectRunner). Data from pubsub is parsed into pair of strings so it would be possible group it by key.

Values have to be reparsed again to bytes

apache_beam.testing.load_tests.streaming.group_by_key_streaming_pipeline.run(argv=None)