apache_beam.runners.interactive.caching.cacheable module

Module for dataclasses to hold metadata of cacheable PCollections in the user code scope.

For internal use only; no backwards-compatibility guarantees.

class apache_beam.runners.interactive.caching.cacheable.Cacheable(var: str, version: str, producer_version: str, pcoll: apache_beam.pvalue.PCollection)[source]

Bases: object

var: str

version: str

producer_version: str

pcoll: PCollection

static from_pcoll(pcoll_name: str, pcoll: PCollection) → Cacheable[source]

to_key()[source]

class apache_beam.runners.interactive.caching.cacheable.CacheKey(var: str, version: str, producer_version: str, pipeline_id: str)[source]

Bases: object

The identifier of a cacheable PCollection in cache.

It contains 4 stringified components: var: The obfuscated variable name of the PCollection. version: The id() of the PCollection. producer_version: The id() of the producer of the PCollection. pipeline_id: The id() of the pipeline the PCollection belongs to.

var: str

version: str

producer_version: str

pipeline_id: str

static from_str(r: str) → CacheKey[source]

static from_pcoll(pcoll_name: str, pcoll: PCollection) → CacheKey[source]

to_str()[source]