org.apache.beam.sdk.io.kafka

Class TimestampPolicyFactory.ProcessingTimePolicy<K,V>

java.lang.Object

org.apache.beam.sdk.io.kafka.TimestampPolicy<K,V>

org.apache.beam.sdk.io.kafka.TimestampPolicyFactory.ProcessingTimePolicy<K,V>

Enclosing interface:

TimestampPolicyFactory<KeyT,ValueT>

public static class TimestampPolicyFactory.ProcessingTimePolicy<K,V>
extends TimestampPolicy<K,V>

A simple policy that uses current time for event time and watermark. This should be used when better timestamps like LogAppendTime are not available for a topic.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.io.kafka.TimestampPolicy

TimestampPolicy.PartitionContext

Constructor Summary

Constructors

Constructor and Description
ProcessingTimePolicy()

Method Summary

Modifier and Type	Method and Description
Instant	getTimestampForRecord(TimestampPolicy.PartitionContext context, KafkaRecord<K,V> record) Returns record timestamp (aka event time).
Instant	getWatermark(TimestampPolicy.PartitionContext context) Returns watermark for the partition.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ProcessingTimePolicy

public ProcessingTimePolicy()

Method Detail

getTimestampForRecord

public Instant getTimestampForRecord(TimestampPolicy.PartitionContext context,
                                     KafkaRecord<K,V> record)

Description copied from class: TimestampPolicy

Returns record timestamp (aka event time). This is often based on the timestamp of the Kafka record. This is invoked for each record when it is processed in the reader.

Specified by:

getTimestampForRecord in class TimestampPolicy<K,V>

getWatermark

public Instant getWatermark(TimestampPolicy.PartitionContext context)

Description copied from class: TimestampPolicy

Returns watermark for the partition. It is the timestamp before or at the timestamps of all future records consumed from the partition. See UnboundedSource.UnboundedReader#getWatermark() for more guidance on watermarks. E.g. if the record timestamp is 'LogAppendTime', watermark would be the timestamp of the last record since 'LogAppendTime' monotonically increases within a partition.

Specified by:

getWatermark in class TimestampPolicy<K,V>