apache_beam.runners.pipeline_context module

Utility class for serializing pipelines via the runner API.

For internal use only; no backwards-compatibility guarantees.

class apache_beam.runners.pipeline_context.PortableObject(*args, **kwargs)[source]

Bases: typing_extensions.Protocol

to_runner_api(_PortableObject__context)[source]
classmethod from_runner_api(_PortableObject__proto, _PortableObject__context)[source]
class apache_beam.runners.pipeline_context.PipelineContext(proto=None, component_id_map=None, default_environment=None, use_fake_coders=False, iterable_state_read=None, iterable_state_write=None, namespace='ref', requirements=())[source]

Bases: object

For internal use only; no backwards-compatibility guarantees.

Used for accessing and constructing the referenced objects of a Pipeline.

add_requirement(requirement)[source]
requirements()[source]
coder_id_from_element_type(element_type, requires_deterministic_key_coder=None)[source]
deterministic_coder(coder, msg)[source]
element_type_from_coder_id(coder_id)[source]
static from_runner_api(proto)[source]
to_runner_api()[source]
default_environment_id()[source]
get_environment_id_for_resource_hints(hints)[source]

Returns an environment id that has necessary resource hints.