apache_beam.runners.interactive.caching.cacheable module
Module for dataclasses to hold metadata of cacheable PCollections in the user code scope.
For internal use only; no backwards-compatibility guarantees.
- class apache_beam.runners.interactive.caching.cacheable.Cacheable(var: str, version: str, producer_version: str, pcoll: apache_beam.pvalue.PCollection)[source]
Bases:
object
- pcoll: PCollection
- static from_pcoll(pcoll_name: str, pcoll: PCollection) Cacheable [source]
- class apache_beam.runners.interactive.caching.cacheable.CacheKey(var: str, version: str, producer_version: str, pipeline_id: str)[source]
Bases:
object
The identifier of a cacheable PCollection in cache.
It contains 4 stringified components: var: The obfuscated variable name of the PCollection. version: The id() of the PCollection. producer_version: The id() of the producer of the PCollection. pipeline_id: The id() of the pipeline the PCollection belongs to.
- static from_pcoll(pcoll_name: str, pcoll: PCollection) CacheKey [source]