apache_beam.runners.pipeline_utils module

Pipeline manipulation utilities useful for many runners.

For internal use only; no backwards-compatibility guarantees.

apache_beam.runners.pipeline_utils.group_by_key_input_visitor(deterministic_key_coders=True)

apache_beam.runners.pipeline_utils.validate_pipeline_graph(pipeline_proto)

Ensures this is a correctly constructed Beam pipeline.

apache_beam.runners.pipeline_utils.merge_common_environments(pipeline_proto, inplace=False)

apache_beam.runners.pipeline_utils.merge_superset_dep_environments(pipeline_proto)

Merges all environemnts A and B where A and B are equivalent except that A has a superset of the dependencies of B.

apache_beam.runners.pipeline_utils.update_environments(pipeline_proto, environment_remappings, inplace=False)