@DefaultAnnotation(value=edu.umd.cs.findbugs.annotations.NonNull.class) @Experimental(value=SPLITTABLE_DO_FN)
DoFn.See: Description
| Interface | Description |
|---|---|
| HasDefaultTracker<RestrictionT extends HasDefaultTracker<RestrictionT,TrackerT>,TrackerT extends RestrictionTracker<RestrictionT,?>> |
Interface for restrictions for which a default implementation of
DoFn.NewTracker is available, depending only on the restriction
itself. |
| HasDefaultWatermarkEstimator<WatermarkEstimatorStateT,WatermarkEstimatorT extends WatermarkEstimator<WatermarkEstimatorStateT>> |
Interface for watermark estimator state for which a default implementation of
DoFn.NewWatermarkEstimator is available, depending only on the watermark estimator state itself. |
| ManualWatermarkEstimator<WatermarkEstimatorStateT> |
A
WatermarkEstimator which is controlled manually from within a DoFn. |
| Sizes.HasSize |
RestrictionTrackers which can provide a size should implement this interface. |
| TimestampObservingWatermarkEstimator<WatermarkEstimatorStateT> |
A
WatermarkEstimator that observes the timestamps of all records output from a DoFn. |
| WatermarkEstimator<WatermarkEstimatorStateT> |
A
WatermarkEstimator which is used for estimating output watermarks of a splittable
DoFn. |
| Class | Description |
|---|---|
| ByteKeyRangeTracker | |
| OffsetRangeTracker |
A
RestrictionTracker for claiming offsets in an OffsetRange in a monotonically
increasing fashion. |
| RestrictionTracker<RestrictionT,PositionT> |
Manages access to the restriction and keeps track of its claimed part for a splittable
DoFn. |
| Sizes |
Definitions and convenience methods for reporting sizes for SplittableDoFns.
|
| SplitResult<RestrictionT> |
A representation of a split result.
|
| WatermarkEstimators |
A set of
WatermarkEstimators that users can use to advance the output watermark for their
associated splittable DoFns. |
| WatermarkEstimators.Manual |
Concrete implementation of a
ManualWatermarkEstimator. |
| WatermarkEstimators.MonotonicallyIncreasing |
A watermark estimator that observes timestamps of records output from a DoFn reporting the
timestamp of the last element seen as the current watermark.
|
| WatermarkEstimators.WallTime |
A watermark estimator that tracks wall time.
|
DoFn.