apache_beam.transforms package¶
PTransform and descendants.
Subpackages¶
- apache_beam.transforms.enrichment_handlers package
- Submodules
- apache_beam.transforms.enrichment_handlers.bigquery module
- apache_beam.transforms.enrichment_handlers.bigtable module
- apache_beam.transforms.enrichment_handlers.feast_feature_store module
- apache_beam.transforms.enrichment_handlers.utils module
- apache_beam.transforms.enrichment_handlers.vertex_ai_feature_store module
- Submodules
- apache_beam.transforms.xlang package
Submodules¶
- apache_beam.transforms.combinefn_lifecycle_pipeline module
CallSequenceEnforcingCombineFn
CallSequenceEnforcingCombineFn.instances
CallSequenceEnforcingCombineFn.setup()
CallSequenceEnforcingCombineFn.create_accumulator()
CallSequenceEnforcingCombineFn.add_input()
CallSequenceEnforcingCombineFn.add_inputs()
CallSequenceEnforcingCombineFn.merge_accumulators()
CallSequenceEnforcingCombineFn.extract_output()
CallSequenceEnforcingCombineFn.teardown()
IndexAssigningDoFn
run_combine()
run_pardo()
- apache_beam.transforms.combiners module
- apache_beam.transforms.core module
DoFn
DoFn.ElementParam
DoFn.SideInputParam
DoFn.TimestampParam
DoFn.WindowParam
DoFn.WindowedValueParam
DoFn.PaneInfoParam
DoFn.WatermarkEstimatorParam
DoFn.BundleFinalizerParam
DoFn.KeyParam
DoFn.BundleContextParam
DoFn.SetupContextParam
DoFn.StateParam
DoFn.TimerParam
DoFn.DynamicTimerTagParam
DoFn.DoFnProcessParams
DoFn.RestrictionParam
DoFn.from_callable()
DoFn.unbounded_per_element()
DoFn.yields_elements()
DoFn.yields_batches()
DoFn.default_label()
DoFn.process()
DoFn.process_batch()
DoFn.setup()
DoFn.start_bundle()
DoFn.finish_bundle()
DoFn.teardown()
DoFn.get_function_arguments()
DoFn.default_type_hints()
DoFn.infer_output_type()
DoFn.get_input_batch_type()
DoFn.get_output_batch_type()
DoFn.to_runner_api_parameter()
CombineFn
CombineFn.default_label()
CombineFn.setup()
CombineFn.create_accumulator()
CombineFn.add_input()
CombineFn.add_inputs()
CombineFn.merge_accumulators()
CombineFn.compact()
CombineFn.extract_output()
CombineFn.teardown()
CombineFn.apply()
CombineFn.for_input_type()
CombineFn.from_callable()
CombineFn.maybe_from_callable()
CombineFn.get_accumulator_coder()
CombineFn.to_runner_api_parameter()
PartitionFn
ParDo
ParDo.with_exception_handling()
ParDo.with_error_handler()
ParDo.default_type_hints()
ParDo.infer_output_type()
ParDo.infer_batch_converters()
ParDo.make_fn()
ParDo.display_data()
ParDo.expand()
ParDo.with_outputs()
ParDo.to_runner_api_parameter()
ParDo.from_runner_api_parameter()
ParDo.runner_api_requires_keyed_input()
ParDo.get_restriction_coder()
FlatMap()
FlatMapTuple()
Map()
MapTuple()
Filter()
CombineGlobally
CombineGlobally.has_defaults
CombineGlobally.as_view
CombineGlobally.fanout
CombineGlobally.display_data()
CombineGlobally.default_label()
CombineGlobally.with_fanout()
CombineGlobally.with_defaults()
CombineGlobally.without_defaults()
CombineGlobally.as_singleton_view()
CombineGlobally.expand()
CombineGlobally.from_runner_api_parameter()
CombinePerKey
CombinePerKey.with_hot_key_fanout()
CombinePerKey.display_data()
CombinePerKey.make_fn()
CombinePerKey.default_label()
CombinePerKey.expand()
CombinePerKey.default_type_hints()
CombinePerKey.to_runner_api_parameter()
CombinePerKey.from_runner_api_parameter()
CombinePerKey.runner_api_requires_keyed_input()
CombineValues
GroupBy
GroupByKey
Select
Partition
Windowing
WindowInto
Flatten
Create
Impulse
RestrictionProvider
WatermarkEstimatorProvider
- apache_beam.transforms.create_source module
- apache_beam.transforms.deduplicate module
- apache_beam.transforms.display module
- apache_beam.transforms.enrichment module
- apache_beam.transforms.environments module
- apache_beam.transforms.error_handling module
- apache_beam.transforms.external module
convert_to_typing_type()
iter_urns()
PayloadBuilder
SchemaBasedPayloadBuilder
ImplicitSchemaPayloadBuilder
NamedTupleBasedPayloadBuilder
SchemaTransformPayloadBuilder
ExplicitSchemaTransformPayloadBuilder
JavaClassLookupPayloadBuilder
SchemaTransformsConfig
SchemaAwareExternalTransform
JavaExternalTransform
AnnotationBasedPayloadBuilder
DataclassBasedPayloadBuilder
ExternalTransform
ExternalTransform.with_output_types()
ExternalTransform.replace_named_inputs()
ExternalTransform.replace_named_outputs()
ExternalTransform.default_label()
ExternalTransform.get_local_namespace()
ExternalTransform.outer_namespace()
ExternalTransform.expand()
ExternalTransform.service()
ExternalTransform.to_runner_api_transform()
ExpansionAndArtifactRetrievalStub
JavaJarExpansionService
BeamJarExpansionService
memoize()
- apache_beam.transforms.external_java module
- apache_beam.transforms.external_transform_provider module
- apache_beam.transforms.fully_qualified_named_transform module
- apache_beam.transforms.periodicsequence module
- apache_beam.transforms.ptransform module
PTransform
PTransform.side_inputs
PTransform.pipeline
PTransform.label
PTransform.default_label()
PTransform.annotations()
PTransform.default_type_hints()
PTransform.with_input_types()
PTransform.with_output_types()
PTransform.with_resource_hints()
PTransform.get_resource_hints()
PTransform.type_check_inputs()
PTransform.infer_output_type()
PTransform.type_check_outputs()
PTransform.type_check_inputs_or_outputs()
PTransform.expand()
PTransform.get_windowing()
PTransform.register_urn()
PTransform.to_runner_api()
PTransform.from_runner_api()
PTransform.to_runner_api_parameter()
PTransform.to_runner_api_pickled()
PTransform.runner_api_requires_keyed_input()
ptransform_fn()
label_from_callable()
annotate_yaml()
- apache_beam.transforms.resources module
- apache_beam.transforms.sideinputs module
- apache_beam.transforms.sql module
- apache_beam.transforms.stats module
- apache_beam.transforms.timeutil module
- apache_beam.transforms.trigger module
AccumulationMode
TriggerFn
DefaultTrigger
AfterWatermark
AfterWatermark.LATE_TAG
AfterWatermark.is_late()
AfterWatermark.on_element()
AfterWatermark.on_merge()
AfterWatermark.should_fire()
AfterWatermark.on_fire()
AfterWatermark.reset()
AfterWatermark.may_lose_data()
AfterWatermark.from_runner_api()
AfterWatermark.to_runner_api()
AfterWatermark.has_ontime_pane()
AfterProcessingTime
AfterProcessingTime.STATE_TAG
AfterProcessingTime.on_element()
AfterProcessingTime.on_merge()
AfterProcessingTime.should_fire()
AfterProcessingTime.on_fire()
AfterProcessingTime.reset()
AfterProcessingTime.may_lose_data()
AfterProcessingTime.from_runner_api()
AfterProcessingTime.to_runner_api()
AfterProcessingTime.has_ontime_pane()
AfterCount
Repeatedly
AfterAny
AfterAll
AfterEach
OrFinally
- apache_beam.transforms.userstate module
StateSpec
ReadModifyWriteStateSpec
BagStateSpec
SetStateSpec
CombiningValueStateSpec
Timer
TimerSpec
on_timer()
get_dofn_specs()
is_stateful_dofn()
validate_stateful_dofn()
BaseTimer
RuntimeTimer
RuntimeState
ReadModifyWriteRuntimeState
AccumulatingRuntimeState
BagRuntimeState
SetRuntimeState
CombiningValueRuntimeState
UserStateContext
- apache_beam.transforms.util module
BatchElements
CoGroupByKey
Distinct()
Keys()
KvSwap()
LogElements
Regex
Reify
RemoveDuplicates()
Reshuffle
ToString
Values()
WithKeys()
GroupIntoBatches
- apache_beam.transforms.window module