apache_beam.runners.interactive.caching.cacheable module

Module for dataclasses to hold metadata of cacheable PCollections in the user code scope.

For internal use only; no backwards-compatibility guarantees.

class apache_beam.runners.interactive.caching.cacheable.Cacheable(var: str, version: str, producer_version: str, pcoll: apache_beam.pvalue.PCollection)[source]

Bases: object

static from_pcoll(pcoll_name: str, pcoll: apache_beam.pvalue.PCollection) → apache_beam.runners.interactive.caching.cacheable.Cacheable[source]
to_key()[source]
class apache_beam.runners.interactive.caching.cacheable.CacheKey(var: str, version: str, producer_version: str, pipeline_id: str)[source]

Bases: object

The identifier of a cacheable PCollection in cache.

It contains 4 stringified components: var: The obfuscated variable name of the PCollection. version: The id() of the PCollection. producer_version: The id() of the producer of the PCollection. pipeline_id: The id() of the pipeline the PCollection belongs to.

static from_str(r: str) → apache_beam.runners.interactive.caching.cacheable.CacheKey[source]
static from_pcoll(pcoll_name: str, pcoll: apache_beam.pvalue.PCollection) → apache_beam.runners.interactive.caching.cacheable.CacheKey[source]
to_str()[source]