Package org.apache.beam.sdk.transforms.splittabledofn

package org.apache.beam.sdk.transforms.splittabledofn

Defines utilities related to splittable DoFn.

Related Packages

Package	Description
org.apache.beam.sdk.transforms	Defines PTransforms for transforming data in a pipeline.
org.apache.beam.sdk.transforms.display	Defines HasDisplayData for annotating components which provide display data used within UIs and diagnostic tools.
org.apache.beam.sdk.transforms.errorhandling	Provides utilities for handling errors in Pipelines.
org.apache.beam.sdk.transforms.join	Defines the CoGroupByKey transform for joining multiple PCollections.
org.apache.beam.sdk.transforms.resourcehints	Defines ResourceHints for configuring pipeline execution.
org.apache.beam.sdk.transforms.windowing	Defines the Window transform for dividing the elements in a PCollection into windows, and the Trigger for controlling when those elements are output.

Class	Description
ByteKeyRangeTracker	A RestrictionTracker for claiming ByteKeys in a ByteKeyRange in a monotonically increasing fashion.
GrowableOffsetRangeTracker	An OffsetRangeTracker for tracking a growable offset range.
GrowableOffsetRangeTracker.RangeEndEstimator	Provides the estimated end offset of the range.
HasDefaultTracker<RestrictionT extends HasDefaultTracker<RestrictionT,TrackerT>,TrackerT extends RestrictionTracker<RestrictionT,?>>	Interface for restrictions for which a default implementation of DoFn.NewTracker is available, depending only on the restriction itself.
HasDefaultWatermarkEstimator<WatermarkEstimatorStateT,WatermarkEstimatorT extends WatermarkEstimator<WatermarkEstimatorStateT>>	Interface for watermark estimator state for which a default implementation of DoFn.NewWatermarkEstimator is available, depending only on the watermark estimator state itself.
ManualWatermarkEstimator<WatermarkEstimatorStateT>	A WatermarkEstimator which is controlled manually from within a DoFn.
OffsetRangeTracker	A RestrictionTracker for claiming offsets in an OffsetRange in a monotonically increasing fashion.
RestrictionTracker<RestrictionT,PositionT>	Manages access to the restriction and keeps track of its claimed part for a splittable DoFn.
RestrictionTracker.HasProgress	All RestrictionTrackers SHOULD implement this interface to improve auto-scaling and splitting performance.
RestrictionTracker.IsBounded
RestrictionTracker.Progress	A representation for the amount of known completed and remaining work.
RestrictionTracker.TruncateResult<RestrictionT>	A representation of the truncate result.
SplitResult<RestrictionT>	A representation of a split result.
TimestampObservingWatermarkEstimator<WatermarkEstimatorStateT>	A WatermarkEstimator that observes the timestamps of all records output from a DoFn.
UnsplittableRestrictionTracker<RestrictionT,PositionT>	A RestrictionTracker for wrapping a RestrictionTracker with unsplittable restrictions.
WatermarkEstimator<WatermarkEstimatorStateT>	A WatermarkEstimator which is used for estimating output watermarks of a splittable DoFn.
WatermarkEstimators	A set of WatermarkEstimators that users can use to advance the output watermark for their associated splittable DoFns.
WatermarkEstimators.Manual	Concrete implementation of a ManualWatermarkEstimator.
WatermarkEstimators.MonotonicallyIncreasing	A watermark estimator that observes timestamps of records output from a DoFn reporting the timestamp of the last element seen as the current watermark.
WatermarkEstimators.WallTime	A watermark estimator that tracks wall time.