org.apache.beam.sdk.io.kinesis

Interface WatermarkPolicyFactory

All Superinterfaces:

java.io.Serializable

public interface WatermarkPolicyFactory
extends java.io.Serializable

Implement this interface to create a WatermarkPolicy. Used by the ShardRecordsIterator to create a watermark policy for every shard.

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy ArrivalTimeWatermarkPolicy uses WatermarkPolicyFactory.CustomWatermarkPolicy for watermark computation.
static class	WatermarkPolicyFactory.CustomWatermarkPolicy CustomWatermarkPolicy uses parameters defined in WatermarkParameters to compute watermarks.
static class	WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy Watermark policy where the processing time is used as the event time.

Method Summary

Modifier and Type	Method and Description
WatermarkPolicy	createWatermarkPolicy()
static WatermarkPolicyFactory	withArrivalTimePolicy() Returns an ArrivalTimeWatermarkPolicy.
static WatermarkPolicyFactory	withArrivalTimePolicy(Duration watermarkIdleDurationThreshold) Returns an ArrivalTimeWatermarkPolicy.
static WatermarkPolicyFactory	withCustomWatermarkPolicy(WatermarkParameters watermarkParameters) Returns an custom WatermarkPolicyFactory.
static WatermarkPolicyFactory	withProcessingTimePolicy() Returns an ProcessingTimeWatermarkPolicy.

Method Detail

createWatermarkPolicy

WatermarkPolicy createWatermarkPolicy()

withArrivalTimePolicy

static WatermarkPolicyFactory withArrivalTimePolicy()

Returns an ArrivalTimeWatermarkPolicy.

withArrivalTimePolicy

static WatermarkPolicyFactory withArrivalTimePolicy(Duration watermarkIdleDurationThreshold)

Returns an ArrivalTimeWatermarkPolicy.

Parameters:

watermarkIdleDurationThreshold - watermark idle duration threshold.

withProcessingTimePolicy

static WatermarkPolicyFactory withProcessingTimePolicy()

Returns an ProcessingTimeWatermarkPolicy.

withCustomWatermarkPolicy

static WatermarkPolicyFactory withCustomWatermarkPolicy(WatermarkParameters watermarkParameters)

Returns an custom WatermarkPolicyFactory.

Parameters:

watermarkParameters - Watermark parameters (timestamp extractor, watermark lag) for the policy.