apache_beam.runners.direct.direct_runner module

DirectRunner, executing on the local machine.

The DirectRunner is a runner implementation that executes the entire graph of transformations belonging to a pipeline on the local machine.

class apache_beam.runners.direct.direct_runner.SwitchingDirectRunner

Bases: apache_beam.runners.runner.PipelineRunner

Executes a single pipeline on the local machine.

This implementation switches between using the FnApiRunner (which has high throughput for batch jobs) and using the BundleBasedDirectRunner, which supports streaming execution and certain primitives not yet implemented in the FnApiRunner.

run_pipeline(pipeline, options)

class apache_beam.runners.direct.direct_runner.BundleBasedDirectRunner

Bases: apache_beam.runners.runner.PipelineRunner

Executes a single pipeline on the local machine.

run_pipeline(pipeline, options)

Execute the entire pipeline and returns an DirectPipelineResult.

apache_beam.runners.direct.direct_runner.DirectRunner

alias of SwitchingDirectRunner