@DefaultAnnotation(value=org.checkerframework.checker.nullness.qual.NonNull.class) @Experimental(value=SPLITTABLE_DO_FN)

Package org.apache.beam.sdk.transforms.splittabledofn

Defines utilities related to splittable DoFn.

See: Description

Interface Summary

Interface	Description
GrowableOffsetRangeTracker.RangeEndEstimator	Provides the estimated end offset of the range.
HasDefaultTracker<RestrictionT extends HasDefaultTracker<RestrictionT,TrackerT>,TrackerT extends RestrictionTracker<RestrictionT,?>>	Interface for restrictions for which a default implementation of DoFn.NewTracker is available, depending only on the restriction itself.
HasDefaultWatermarkEstimator<WatermarkEstimatorStateT,WatermarkEstimatorT extends WatermarkEstimator<WatermarkEstimatorStateT>>	Interface for watermark estimator state for which a default implementation of DoFn.NewWatermarkEstimator is available, depending only on the watermark estimator state itself.
ManualWatermarkEstimator<WatermarkEstimatorStateT>	A WatermarkEstimator which is controlled manually from within a DoFn.
RestrictionTracker.HasProgress	All RestrictionTrackers SHOULD implement this interface to improve auto-scaling and splitting performance.
TimestampObservingWatermarkEstimator<WatermarkEstimatorStateT>	A WatermarkEstimator that observes the timestamps of all records output from a DoFn.
WatermarkEstimator<WatermarkEstimatorStateT>	A WatermarkEstimator which is used for estimating output watermarks of a splittable DoFn.

Class Summary

Class	Description
ByteKeyRangeTracker	A RestrictionTracker for claiming ByteKeys in a ByteKeyRange in a monotonically increasing fashion.
GrowableOffsetRangeTracker	An OffsetRangeTracker for tracking a growable offset range.
OffsetRangeTracker	A RestrictionTracker for claiming offsets in an OffsetRange in a monotonically increasing fashion.
RestrictionTracker<RestrictionT,PositionT>	Manages access to the restriction and keeps track of its claimed part for a splittable DoFn.
RestrictionTracker.Progress	A representation for the amount of known completed and remaining work.
RestrictionTracker.TruncateResult<RestrictionT>	A representation of the truncate result.
SplitResult<RestrictionT>	A representation of a split result.
WatermarkEstimators	A set of WatermarkEstimators that users can use to advance the output watermark for their associated splittable DoFns.
WatermarkEstimators.Manual	Concrete implementation of a ManualWatermarkEstimator.
WatermarkEstimators.MonotonicallyIncreasing	A watermark estimator that observes timestamps of records output from a DoFn reporting the timestamp of the last element seen as the current watermark.
WatermarkEstimators.WallTime	A watermark estimator that tracks wall time.

Enum Summary

Enum	Description
RestrictionTracker.IsBounded

Package org.apache.beam.sdk.transforms.splittabledofn Description

Defines utilities related to splittable DoFn.