apache_beam.runners.interactive.interactive_runner module

A runner that allows running of Beam pipelines interactively.

This module is experimental. No backwards-compatibility guarantees.

class apache_beam.runners.interactive.interactive_runner.InteractiveRunner(underlying_runner=None, cache_dir=None)

Bases: apache_beam.runners.runner.PipelineRunner

An interactive runner for Beam Python pipelines.

Allows interactively building and running Beam Python pipelines.

start_session()

Start the session that keeps back-end managers and workers alive.

end_session()

End the session that keeps backend managers and workers alive.

cleanup()

apply(transform, pvalueish)

run_pipeline(pipeline)

class apache_beam.runners.interactive.interactive_runner.PipelineResult(underlying_result, runner, pipeline_info, cache_manager, pcolls_to_pcoll_id)

Bases: apache_beam.runners.runner.PipelineResult

Provides access to information about a pipeline.

wait_until_finish()

get(pcoll)

sample(pcoll)