Optional allOptional nextPrivate optionsPrivate underlyingRuns the transform.
Resolves to an instance of PipelineResult when the pipeline completes. Use runAsync() to execute the pipeline in the background.
A PipelineResult
runAsync() is the asynchronous version of run(), does not wait until pipeline finishes. Use the returned PipelineResult to query job status.
Optional options: ObjectGenerated using TypeDoc
A Runner implementation used to turn multiple pipeline
run()s into a a singlerun()of all the pipelines in parallel.This is primarily useful for testing runners (e.g. distributed runners) whose per-pipeline costs are substantially larger than the typical amount of computation done in a single unit test.
After invoking
run()on several pipelines, one must invokereallyRunPipelines()which will actually execute the pipelines on the underlying runner. Any individual pipeline failure will cause the entire pipeline to fail.Note that due to the (doubly) deferred nature of
run(), the test in question should use transforms liketesting.assert.assertDeepEqual(which fail if the input PCollection does not have the expected contents) rather than trying to validate any side effects of the (not-yet-executed) pipeline directly.