Package org.apache.beam.sdk.extensions.timeseries

Class FillGaps.FillGapsDoFn<ValueT>

java.lang.Object

org.apache.beam.sdk.transforms.DoFn<KV<Row,ValueT>,ValueT>

org.apache.beam.sdk.extensions.timeseries.FillGaps.FillGapsDoFn<ValueT>

All Implemented Interfaces:

Serializable, HasDisplayData

Enclosing class:

FillGaps<ValueT>

public static class FillGaps.FillGapsDoFn<ValueT>
extends DoFn<KV<Row,ValueT>,ValueT>

See Also:

• Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.transforms.DoFn

DoFn.AlwaysFetched, DoFn.BoundedPerElement, DoFn.BundleFinalizer, DoFn.Element, DoFn.FieldAccess, DoFn.FinishBundle, DoFn.FinishBundleContext, DoFn.GetInitialRestriction, DoFn.GetInitialWatermarkEstimatorState, DoFn.GetRestrictionCoder, DoFn.GetSize, DoFn.GetWatermarkEstimatorStateCoder, DoFn.Key, DoFn.MultiOutputReceiver, DoFn.NewTracker, DoFn.NewWatermarkEstimator, DoFn.OnTimer, DoFn.OnTimerContext, DoFn.OnTimerFamily, DoFn.OnWindowExpiration, DoFn.OnWindowExpirationContext, DoFn.OutputReceiver<T>, DoFn.ProcessContext, DoFn.ProcessContinuation, DoFn.ProcessElement, DoFn.RequiresStableInput, DoFn.RequiresTimeSortedInput, DoFn.Restriction, DoFn.Setup, DoFn.SideInput, DoFn.SplitRestriction, DoFn.StartBundle, DoFn.StartBundleContext, DoFn.StateId, DoFn.Teardown, DoFn.TimerFamily, DoFn.TimerId, DoFn.Timestamp, DoFn.TruncateRestriction, DoFn.UnboundedPerElement, DoFn.WatermarkEstimatorState, DoFn.WindowedContext

Method Summary

Modifier and Type	Method	Description
void	onGcTimer(Instant timerTs, ValueState<SortedMap<Instant,TimestampedValue<ValueT>>> seenBuckets, ValueState<SortedMap<Instant,Long>> gapDurations)
void	onTimer(String timerId, Instant timestamp, TimerMap gapTimers, TimerMap gcTimers, ValueState<SortedMap<Instant,TimestampedValue<ValueT>>> seenBuckets, ValueState<SortedMap<Instant,Long>> gapDurations, DoFn.OutputReceiver<ValueT> output)
void	process(KV<Row,ValueT> element, Instant ts, TimerMap gapTimers, TimerMap gcTimers, ValueState<SortedMap<Instant,TimestampedValue<ValueT>>> seenBuckets, DoFn.OutputReceiver<ValueT> output)

Methods inherited from class org.apache.beam.sdk.transforms.DoFn

getAllowedTimestampSkew, getInputTypeDescriptor, getOutputTypeDescriptor, populateDisplayData, prepareForProcessing

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

process

@ProcessElement
public void process(@Element
 KV<Row,ValueT> element,
 @Timestamp
 Instant ts,
 @TimerFamily("gapTimers")
 TimerMap gapTimers,
 @TimerFamily("gcTimers")
 TimerMap gcTimers,
 @AlwaysFetched @StateId("seenBuckets")
 ValueState<SortedMap<Instant,TimestampedValue<ValueT>>> seenBuckets,
 DoFn.OutputReceiver<ValueT> output)

onTimer

@OnTimerFamily("gapTimers")
public void onTimer(@TimerId
 String timerId,
 @Timestamp
 Instant timestamp,
 @TimerFamily("gapTimers")
 TimerMap gapTimers,
 @TimerFamily("gcTimers")
 TimerMap gcTimers,
 @AlwaysFetched @StateId("seenBuckets")
 ValueState<SortedMap<Instant,TimestampedValue<ValueT>>> seenBuckets,
 @AlwaysFetched @StateId("gapDurationMap")
 ValueState<SortedMap<Instant,Long>> gapDurations,
 DoFn.OutputReceiver<ValueT> output)

onGcTimer

@OnTimerFamily("gcTimers")
public void onGcTimer(@Timestamp
 Instant timerTs,
 @AlwaysFetched @StateId("seenBuckets")
 ValueState<SortedMap<Instant,TimestampedValue<ValueT>>> seenBuckets,
 @AlwaysFetched @StateId("gapDurationMap")
 ValueState<SortedMap<Instant,Long>> gapDurations)