apache_beam.runners.direct.consumer_tracking_pipeline_visitor module¶
ConsumerTrackingPipelineVisitor, a PipelineVisitor object.
-
class
apache_beam.runners.direct.consumer_tracking_pipeline_visitor.
ConsumerTrackingPipelineVisitor
[source]¶ Bases:
apache_beam.pipeline.PipelineVisitor
For internal use only; no backwards-compatibility guarantees.
Visitor for extracting value-consumer relations from the graph.
Tracks the AppliedPTransforms that consume each PValue in the Pipeline. This is used to schedule consuming PTransforms to consume input after the upstream transform has produced and committed output.