apache_beam.runners.direct package

Inprocess runner executes pipelines locally in a single process.

Anything in this package not imported here is an internal implementation detail with no backwards-compatibility guarantees.

Submodules

• apache_beam.runners.direct.bundle_factory module
  • BundleFactory
    • BundleFactory.create_bundle()
    • BundleFactory.create_empty_committed_bundle()
• apache_beam.runners.direct.clock module
  • Clock
    • Clock.time()
    • Clock.advance_time()
  • RealClock
    • RealClock.time()
  • TestClock
    • TestClock.time()
    • TestClock.advance_time()
• apache_beam.runners.direct.consumer_tracking_pipeline_visitor module
  • ConsumerTrackingPipelineVisitor
    • ConsumerTrackingPipelineVisitor.views
    • ConsumerTrackingPipelineVisitor.visit_transform()
• apache_beam.runners.direct.direct_metrics module
  • DirectMetrics
    • DirectMetrics.commit_logical()
    • DirectMetrics.commit_physical()
    • DirectMetrics.update_physical()
    • DirectMetrics.query()
  • DirectMetric
    • DirectMetric.commit_logical()
    • DirectMetric.commit_physical()
    • DirectMetric.update_physical()
    • DirectMetric.extract_committed()
    • DirectMetric.extract_latest_attempted()
• apache_beam.runners.direct.direct_runner module
  • BundleBasedDirectRunner
    • BundleBasedDirectRunner.is_fnapi_compatible()
    • BundleBasedDirectRunner.run_pipeline()
  • DirectRunner
  • SwitchingDirectRunner
    • SwitchingDirectRunner.is_fnapi_compatible()
    • SwitchingDirectRunner.run_pipeline()
• apache_beam.runners.direct.direct_userstate module
  • DirectRuntimeState
    • DirectRuntimeState.for_spec()
  • ReadModifyWriteRuntimeState
    • ReadModifyWriteRuntimeState.read()
    • ReadModifyWriteRuntimeState.write()
    • ReadModifyWriteRuntimeState.clear()
    • ReadModifyWriteRuntimeState.is_cleared()
    • ReadModifyWriteRuntimeState.is_modified()
  • BagRuntimeState
    • BagRuntimeState.read()
    • BagRuntimeState.add()
    • BagRuntimeState.clear()
  • SetRuntimeState
    • SetRuntimeState.read()
    • SetRuntimeState.add()
    • SetRuntimeState.clear()
    • SetRuntimeState.is_modified()
  • CombiningValueRuntimeState
    • CombiningValueRuntimeState.read()
    • CombiningValueRuntimeState.add()
    • CombiningValueRuntimeState.clear()
    • CombiningValueRuntimeState.finalize()
  • DirectUserStateContext
    • DirectUserStateContext.get_timer()
    • DirectUserStateContext.get_state()
    • DirectUserStateContext.commit()
    • DirectUserStateContext.reset()
• apache_beam.runners.direct.evaluation_context module
  • EvaluationContext
    • EvaluationContext.metrics()
    • EvaluationContext.is_root_transform()
    • EvaluationContext.handle_result()
    • EvaluationContext.get_aggregator_values()
    • EvaluationContext.schedule_pending_unblocked_tasks()
    • EvaluationContext.get_execution_context()
    • EvaluationContext.create_bundle()
    • EvaluationContext.create_empty_committed_bundle()
    • EvaluationContext.extract_all_timers()
    • EvaluationContext.is_done()
    • EvaluationContext.get_value_or_block_until_ready()
    • EvaluationContext.shutdown()
  • DirectUnmergedState
  • DirectStepContext
    • DirectStepContext.get_keyed_state()
• apache_beam.runners.direct.executor module
  • TransformExecutor
    • TransformExecutor.call()
    • TransformExecutor.attempt_call()
  • Executor
    • Executor.start()
    • Executor.await_completion()
    • Executor.shutdown()
• apache_beam.runners.direct.helper_transforms module
  • LiftedCombinePerKey
    • LiftedCombinePerKey.expand()
  • PartialGroupByKeyCombiningValues
    • PartialGroupByKeyCombiningValues.setup()
    • PartialGroupByKeyCombiningValues.start_bundle()
    • PartialGroupByKeyCombiningValues.process()
    • PartialGroupByKeyCombiningValues.finish_bundle()
    • PartialGroupByKeyCombiningValues.teardown()
    • PartialGroupByKeyCombiningValues.default_type_hints()
  • FinishCombine
    • FinishCombine.setup()
    • FinishCombine.process()
    • FinishCombine.teardown()
    • FinishCombine.default_type_hints()
• apache_beam.runners.direct.sdf_direct_runner module
  • SplittableParDoOverride
    • SplittableParDoOverride.matches()
    • SplittableParDoOverride.get_replacement_transform_for_applied_ptransform()
  • SplittableParDo
    • SplittableParDo.expand()
  • ElementAndRestriction
  • PairWithRestrictionFn
    • PairWithRestrictionFn.start_bundle()
    • PairWithRestrictionFn.process()
  • SplitRestrictionFn
    • SplitRestrictionFn.start_bundle()
    • SplitRestrictionFn.process()
  • ExplodeWindowsFn
    • ExplodeWindowsFn.process()
  • RandomUniqueKeyFn
    • RandomUniqueKeyFn.process()
  • ProcessKeyedElements
    • ProcessKeyedElements.expand()
  • ProcessKeyedElementsViaKeyedWorkItemsOverride
    • ProcessKeyedElementsViaKeyedWorkItemsOverride.matches()
    • ProcessKeyedElementsViaKeyedWorkItemsOverride.get_replacement_transform_for_applied_ptransform()
  • ProcessKeyedElementsViaKeyedWorkItems
    • ProcessKeyedElementsViaKeyedWorkItems.expand()
  • ProcessElements
    • ProcessElements.expand()
    • ProcessElements.new_process_fn()
  • ProcessFn
    • ProcessFn.step_context
    • ProcessFn.set_process_element_invoker()
    • ProcessFn.process()
  • SDFProcessElementInvoker
    • SDFProcessElementInvoker.Result
    • SDFProcessElementInvoker.test_method()
    • SDFProcessElementInvoker.invoke_process_element()
• apache_beam.runners.direct.test_direct_runner module
  • TestDirectRunner
    • TestDirectRunner.run_pipeline()
• apache_beam.runners.direct.test_stream_impl module
• apache_beam.runners.direct.transform_evaluator module
  • TransformEvaluatorRegistry
    • TransformEvaluatorRegistry.get_evaluator()
    • TransformEvaluatorRegistry.get_root_bundle_provider()
    • TransformEvaluatorRegistry.should_execute_serially()
  • RootBundleProvider
    • RootBundleProvider.get_root_bundles()
  • DefaultRootBundleProvider
    • DefaultRootBundleProvider.get_root_bundles()
• apache_beam.runners.direct.util module
  • TransformResult
  • TimerFiring
  • KeyedWorkItem
• apache_beam.runners.direct.watermark_manager module
  • WatermarkManager
    • WatermarkManager.WATERMARK_POS_INF
    • WatermarkManager.WATERMARK_NEG_INF
    • WatermarkManager.get_watermarks()
    • WatermarkManager.update_watermarks()
    • WatermarkManager.extract_all_timers()