apache_beam.runners.interactive.caching.cacheable module

Module for dataclasses to hold metadata of cacheable PCollections in the user code scope.

For internal use only; no backwards-compatibility guarantees.

class apache_beam.runners.interactive.caching.cacheable.Cacheable(var: str, version: str, producer_version: str, pcoll: apache_beam.pvalue.PCollection)

Bases: object

static from_pcoll(pcoll_name: str, pcoll: apache_beam.pvalue.PCollection) → apache_beam.runners.interactive.caching.cacheable.Cacheable

to_key()

class apache_beam.runners.interactive.caching.cacheable.CacheKey(var: str, version: str, producer_version: str, pipeline_id: str)

Bases: object

The identifier of a cacheable PCollection in cache.

It contains 4 stringified components: var: The obfuscated variable name of the PCollection. version: The id() of the PCollection. producer_version: The id() of the producer of the PCollection. pipeline_id: The id() of the pipeline the PCollection belongs to.

static from_str(r: str) → apache_beam.runners.interactive.caching.cacheable.CacheKey

static from_pcoll(pcoll_name: str, pcoll: apache_beam.pvalue.PCollection) → apache_beam.runners.interactive.caching.cacheable.CacheKey

to_str()