apache_beam.runners.pipeline_context module

Utility class for serializing pipelines via the runner API.

For internal use only; no backwards-compatibility guarantees.

class apache_beam.runners.pipeline_context.PortableObject(*args, **kwargs)

Bases: typing_extensions.Protocol

to_runner_api(_PortableObject__context)

classmethod from_runner_api(_PortableObject__proto, _PortableObject__context)

class apache_beam.runners.pipeline_context.PipelineContext(proto=None, component_id_map=None, default_environment=None, use_fake_coders=False, iterable_state_read=None, iterable_state_write=None, namespace='ref', requirements=())

Bases: object

For internal use only; no backwards-compatibility guarantees.

Used for accessing and constructing the referenced objects of a Pipeline.

add_requirement(requirement)

requirements()

coder_id_from_element_type(element_type, requires_deterministic_key_coder=None)

deterministic_coder(coder, msg)

element_type_from_coder_id(coder_id)

static from_runner_api(proto)

to_runner_api()

default_environment_id()

get_environment_id_for_resource_hints(hints)

Returns an environment id that has necessary resource hints.