Package org.apache.beam.sdk.io.aws2.kinesis

Transforms for reading from Amazon Kinesis.

See: Description

Interface Summary

Interface	Description
KinesisIOOptions	PipelineOptions for KinesisIO.
KinesisPartitioner<T>	Kinesis interface for custom partitioner.
KinesisPartitioner.ExplicitPartitioner<T>	An explicit partitioner that always returns a Nonnull explicit hash key.
RateLimitPolicy
RateLimitPolicyFactory	Implement this interface to create a RateLimitPolicy.
WatermarkPolicy	Implement this interface to define a custom watermark calculation heuristic.
WatermarkPolicyFactory	Implement this interface to create a WatermarkPolicy.

Class Summary

Class	Description
KinesisIO	IO to read from Kinesis streams.
KinesisIO.Read	Implementation of KinesisIO.read().
KinesisIO.RecordAggregation	Configuration of Kinesis record aggregation.
KinesisIO.RecordAggregation.Builder
KinesisIO.Write<T>	Implementation of KinesisIO.write().
KinesisIO.Write.Result	Result of KinesisIO.write().
KinesisIOOptions.KinesisIOOptionsRegistrar	A registrar containing the default KinesisIOOptions.
KinesisIOOptions.MapFactory
KinesisRecord	KinesisClientRecord enhanced with utility methods.
KinesisTransformRegistrar	Exposes KinesisIO.Write and KinesisIO.Read as an external transform for cross-language usage.
KinesisTransformRegistrar.KinesisReadToBytes
KinesisTransformRegistrar.ReadDataBuilder
KinesisTransformRegistrar.ReadDataBuilder.Configuration
KinesisTransformRegistrar.WriteBuilder
KinesisTransformRegistrar.WriteBuilder.Configuration
RateLimitPolicyFactory.DefaultRateLimiter	Default rate limiter that throttles reading from a shard using an exponential backoff if the response is empty or if the consumer is throttled by AWS.
RateLimitPolicyFactory.DelayIntervalRateLimiter
TimeUtil	Time conversion utilities.
WatermarkParameters	WatermarkParameters contains the parameters used for watermark computation.
WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy	ArrivalTimeWatermarkPolicy uses WatermarkPolicyFactory.CustomWatermarkPolicy for watermark computation.
WatermarkPolicyFactory.CustomWatermarkPolicy	CustomWatermarkPolicy uses parameters defined in WatermarkParameters to compute watermarks.
WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy	Watermark policy where the processing time is used as the event time.

Exception Summary

Exception	Description
KinesisClientThrottledException	Thrown when the Kinesis client was throttled due to rate limits.

Package org.apache.beam.sdk.io.aws2.kinesis Description

Transforms for reading from Amazon Kinesis.