Class DetectNewPartitionsDoFn
java.lang.Object
org.apache.beam.sdk.transforms.DoFn<InitialPipelineState,PartitionRecord>
org.apache.beam.sdk.io.gcp.bigtable.changestreams.dofn.DetectNewPartitionsDoFn
- All Implemented Interfaces:
Serializable
,HasDisplayData
@Internal
@UnboundedPerElement
public class DetectNewPartitionsDoFn
extends DoFn<InitialPipelineState,PartitionRecord>
- See Also:
-
Nested Class Summary
Nested classes/interfaces inherited from class org.apache.beam.sdk.transforms.DoFn
DoFn.AlwaysFetched, DoFn.BoundedPerElement, DoFn.BundleFinalizer, DoFn.Element, DoFn.FieldAccess, DoFn.FinishBundle, DoFn.FinishBundleContext, DoFn.GetInitialRestriction, DoFn.GetInitialWatermarkEstimatorState, DoFn.GetRestrictionCoder, DoFn.GetSize, DoFn.GetWatermarkEstimatorStateCoder, DoFn.Key, DoFn.MultiOutputReceiver, DoFn.NewTracker, DoFn.NewWatermarkEstimator, DoFn.OnTimer, DoFn.OnTimerContext, DoFn.OnTimerFamily, DoFn.OnWindowExpiration, DoFn.OnWindowExpirationContext, DoFn.OutputReceiver<T>, DoFn.ProcessContext, DoFn.ProcessContinuation, DoFn.ProcessElement, DoFn.RequiresStableInput, DoFn.RequiresTimeSortedInput, DoFn.Restriction, DoFn.Setup, DoFn.SideInput, DoFn.SplitRestriction, DoFn.StartBundle, DoFn.StartBundleContext, DoFn.StateId, DoFn.Teardown, DoFn.TimerFamily, DoFn.TimerId, DoFn.Timestamp, DoFn.TruncateRestriction, DoFn.UnboundedPerElement, DoFn.WatermarkEstimatorState, DoFn.WindowedContext
-
Constructor Summary
ConstructorsConstructorDescriptionDetectNewPartitionsDoFn
(Instant endTime, ActionFactory actionFactory, DaoFactory daoFactory, ChangeStreamMetrics metrics) -
Method Summary
Modifier and TypeMethodDescriptiongetInitialWatermarkEstimatorState
(InitialPipelineState initialPipelineState) double
getSize()
newWatermarkEstimator
(Instant watermarkEstimatorState) processElement
(InitialPipelineState initialPipelineState, RestrictionTracker<OffsetRange, Long> tracker, DoFn.OutputReceiver<PartitionRecord> receiver, ManualWatermarkEstimator<Instant> watermarkEstimator) restrictionTracker
(OffsetRange restriction) void
setup()
Methods inherited from class org.apache.beam.sdk.transforms.DoFn
getAllowedTimestampSkew, getInputTypeDescriptor, getOutputTypeDescriptor, populateDisplayData, prepareForProcessing
-
Constructor Details
-
DetectNewPartitionsDoFn
public DetectNewPartitionsDoFn(@Nullable Instant endTime, ActionFactory actionFactory, DaoFactory daoFactory, ChangeStreamMetrics metrics)
-
-
Method Details
-
getInitialWatermarkEstimatorState
@GetInitialWatermarkEstimatorState public Instant getInitialWatermarkEstimatorState(@Element InitialPipelineState initialPipelineState) -
newWatermarkEstimator
@NewWatermarkEstimator public ManualWatermarkEstimator<Instant> newWatermarkEstimator(@WatermarkEstimatorState Instant watermarkEstimatorState) -
initialRestriction
-
restrictionTracker
-
getSize
-
setup
- Throws:
IOException
-
processElement
@ProcessElement public DoFn.ProcessContinuation processElement(@Element InitialPipelineState initialPipelineState, RestrictionTracker<OffsetRange, Long> tracker, DoFn.OutputReceiver<PartitionRecord> receiver, ManualWatermarkEstimator<Instant> watermarkEstimator) throws Exception- Throws:
Exception
-