@DefaultAnnotation(value=edu.umd.cs.findbugs.annotations.NonNull.class) @Experimental(value=SPLITTABLE_DO_FN)
DoFn.See: Description
| Interface | Description |
|---|---|
| GrowableOffsetRangeTracker.RangeEndEstimator |
Provides the estimated end offset of the range.
|
| HasDefaultTracker<RestrictionT extends HasDefaultTracker<RestrictionT,TrackerT>,TrackerT extends RestrictionTracker<RestrictionT,?>> |
Interface for restrictions for which a default implementation of
DoFn.NewTracker is available, depending only on the restriction
itself. |
| HasDefaultWatermarkEstimator<WatermarkEstimatorStateT,WatermarkEstimatorT extends WatermarkEstimator<WatermarkEstimatorStateT>> |
Interface for watermark estimator state for which a default implementation of
DoFn.NewWatermarkEstimator is available, depending only on the watermark estimator state itself. |
| ManualWatermarkEstimator<WatermarkEstimatorStateT> |
A
WatermarkEstimator which is controlled manually from within a DoFn. |
| RestrictionTracker.HasProgress |
All
RestrictionTrackers SHOULD implement this interface to improve auto-scaling and
splitting performance. |
| TimestampObservingWatermarkEstimator<WatermarkEstimatorStateT> |
A
WatermarkEstimator that observes the timestamps of all records output from a DoFn. |
| WatermarkEstimator<WatermarkEstimatorStateT> |
A
WatermarkEstimator which is used for estimating output watermarks of a splittable
DoFn. |
| Class | Description |
|---|---|
| ByteKeyRangeTracker | |
| GrowableOffsetRangeTracker |
An
OffsetRangeTracker for tracking a growable offset range. |
| OffsetRangeTracker |
A
RestrictionTracker for claiming offsets in an OffsetRange in a monotonically
increasing fashion. |
| RestrictionTracker<RestrictionT,PositionT> |
Manages access to the restriction and keeps track of its claimed part for a splittable
DoFn. |
| RestrictionTracker.Progress |
A representation for the amount of known completed and remaining work.
|
| SplitResult<RestrictionT> |
A representation of a split result.
|
| WatermarkEstimators |
A set of
WatermarkEstimators that users can use to advance the output watermark for their
associated splittable DoFns. |
| WatermarkEstimators.Manual |
Concrete implementation of a
ManualWatermarkEstimator. |
| WatermarkEstimators.MonotonicallyIncreasing |
A watermark estimator that observes timestamps of records output from a DoFn reporting the
timestamp of the last element seen as the current watermark.
|
| WatermarkEstimators.WallTime |
A watermark estimator that tracks wall time.
|
DoFn.