Package org.apache.beam.sdk.io.aws2.kinesis
package org.apache.beam.sdk.io.aws2.kinesis
Transforms for reading from Amazon Kinesis.
-
ClassDescriptionThrown when the Kinesis client was throttled due to rate limits.IO to read from Kinesis streams.Implementation of
KinesisIO.read().Configuration of Kinesis record aggregation.Implementation ofKinesisIO.write().Result ofKinesisIO.write().PipelineOptions forKinesisIO.A registrar containing the defaultKinesisIOOptions.Kinesis interface for custom partitioner.An explicit partitioner that always returns aNonnullexplicit hash key.KinesisClientRecordenhanced with utility methods.ExposesKinesisIO.WriteandKinesisIO.Readas an external transform for cross-language usage.Implement this interface to create aRateLimitPolicy.Default rate limiter that throttles reading from a shard using an exponential backoff if the response is empty or if the consumer is throttled by AWS.Time conversion utilities.WatermarkParameterscontains the parameters used for watermark computation.Implement this interface to define a custom watermark calculation heuristic.Implement this interface to create aWatermarkPolicy.ArrivalTimeWatermarkPolicy usesWatermarkPolicyFactory.CustomWatermarkPolicyfor watermark computation.CustomWatermarkPolicy uses parameters defined inWatermarkParametersto compute watermarks.Watermark policy where the processing time is used as the event time.