apache_beam.runners.interactive.options.capture_control module

Module to control how Interactive Beam captures data from sources for deterministic replayable PCollection evaluation and pipeline runs.

For internal use only; no backwards-compatibility guarantees.

class apache_beam.runners.interactive.options.capture_control.CaptureControl

Bases: object

Options and their utilities that controls how Interactive Beam captures deterministic replayable data from sources.

limiters() → List[Limiter]

set_limiters_for_test(limiters: List[Limiter]) → None

apache_beam.runners.interactive.options.capture_control.evict_captured_data(pipeline=None)

Evicts all deterministic replayable data that have been captured by Interactive Beam for the given pipeline. If no pipeline is specified, evicts for all user defined pipelines.

In future PCollection evaluation/visualization and pipeline runs, Interactive Beam will capture fresh data.