org.apache.beam.sdk.io.kafka

Class KafkaSchemaTransformReadConfiguration.Builder

java.lang.Object

org.apache.beam.sdk.io.kafka.KafkaSchemaTransformReadConfiguration.Builder

Enclosing class:

KafkaSchemaTransformReadConfiguration

public abstract static class KafkaSchemaTransformReadConfiguration.Builder
extends java.lang.Object

Builder for the KafkaSchemaTransformReadConfiguration.

Constructor Summary

Constructors

Constructor and Description
Builder()

Method Summary

Modifier and Type	Method and Description
abstract KafkaSchemaTransformReadConfiguration	build() Builds a KafkaSchemaTransformReadConfiguration instance.
abstract KafkaSchemaTransformReadConfiguration.Builder	setBootstrapServers(java.lang.String value) Sets the bootstrap servers for the Kafka consumer.
abstract KafkaSchemaTransformReadConfiguration.Builder	setCommitOffsetsInFinalize(java.lang.Boolean value) Flags whether finalized offsets are committed to Kafka.
abstract KafkaSchemaTransformReadConfiguration.Builder	setConsumerConfigUpdates(java.util.Map<java.lang.String,java.lang.Object> value) Configuration updates for the backend main consumer.
abstract KafkaSchemaTransformReadConfiguration.Builder	setCreateTimeMillisecondsMaximumDelay(java.lang.Long value) Sets the timestamps policy based on KafkaTimestampType.CREATE_TIME timestamp of the records.
abstract KafkaSchemaTransformReadConfiguration.Builder	setDynamicReadMillisecondsDuration(java.lang.Long value) Configure the KafkaIO to use WatchKafkaTopicPartitionDoFn to detect and emit any new available TopicPartition for ReadFromKafkaDoFn to consume during pipeline execution time.
abstract KafkaSchemaTransformReadConfiguration.Builder	setOffsetConsumerConfiguration(java.util.Map<java.lang.String,java.lang.Object> value) Additional configuration for the backend offset consumer.
abstract KafkaSchemaTransformReadConfiguration.Builder	setReadCommitted(java.lang.Boolean value) Sets "isolation_level" to "read_committed" in Kafka consumer configuration.
abstract KafkaSchemaTransformReadConfiguration.Builder	setReadWithMetadata(java.lang.Boolean value) Specifies whether to include metadata when reading from Kafka topic.
abstract KafkaSchemaTransformReadConfiguration.Builder	setStartReadTimeMillisecondsEpoch(java.lang.Long value) Use timestamp to set up start offset.
abstract KafkaSchemaTransformReadConfiguration.Builder	setStopReadTimeMillisecondsEpoch(java.lang.Long value) Use timestamp to set up stop offset.
abstract KafkaSchemaTransformReadConfiguration.Builder	setTimestampPolicy(KafkaSchemaTransformReadConfiguration.TimestampPolicyConfiguration value) A timestamp policy to assign event time for messages in a Kafka partition and watermark for it.
abstract KafkaSchemaTransformReadConfiguration.Builder	setTopic(java.lang.String value) Sets the topic from which to read.
abstract KafkaSchemaTransformReadConfiguration.Builder	setTopicPartitions(java.util.List<KafkaSchemaTransformReadConfiguration.TopicPartitionConfiguration> value) Kafka partitions from which to read.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Builder

public Builder()

Method Detail

setBootstrapServers

public abstract KafkaSchemaTransformReadConfiguration.Builder setBootstrapServers(java.lang.String value)

Sets the bootstrap servers for the Kafka consumer.

setCommitOffsetsInFinalize

public abstract KafkaSchemaTransformReadConfiguration.Builder setCommitOffsetsInFinalize(java.lang.Boolean value)

Flags whether finalized offsets are committed to Kafka.

setConsumerConfigUpdates

public abstract KafkaSchemaTransformReadConfiguration.Builder setConsumerConfigUpdates(java.util.Map<java.lang.String,java.lang.Object> value)

Configuration updates for the backend main consumer.

setCreateTimeMillisecondsMaximumDelay

public abstract KafkaSchemaTransformReadConfiguration.Builder setCreateTimeMillisecondsMaximumDelay(java.lang.Long value)

Sets the timestamps policy based on KafkaTimestampType.CREATE_TIME timestamp of the records.

setDynamicReadMillisecondsDuration

public abstract KafkaSchemaTransformReadConfiguration.Builder setDynamicReadMillisecondsDuration(java.lang.Long value)

Configure the KafkaIO to use WatchKafkaTopicPartitionDoFn to detect and emit any new available TopicPartition for ReadFromKafkaDoFn to consume during pipeline execution time.

setOffsetConsumerConfiguration

public abstract KafkaSchemaTransformReadConfiguration.Builder setOffsetConsumerConfiguration(java.util.Map<java.lang.String,java.lang.Object> value)

Additional configuration for the backend offset consumer.

setReadWithMetadata

public abstract KafkaSchemaTransformReadConfiguration.Builder setReadWithMetadata(java.lang.Boolean value)

Specifies whether to include metadata when reading from Kafka topic.

setReadCommitted

public abstract KafkaSchemaTransformReadConfiguration.Builder setReadCommitted(java.lang.Boolean value)

Sets "isolation_level" to "read_committed" in Kafka consumer configuration.

setStartReadTimeMillisecondsEpoch

public abstract KafkaSchemaTransformReadConfiguration.Builder setStartReadTimeMillisecondsEpoch(java.lang.Long value)

Use timestamp to set up start offset.

setStopReadTimeMillisecondsEpoch

public abstract KafkaSchemaTransformReadConfiguration.Builder setStopReadTimeMillisecondsEpoch(java.lang.Long value)

Use timestamp to set up stop offset.

setTimestampPolicy

public abstract KafkaSchemaTransformReadConfiguration.Builder setTimestampPolicy(KafkaSchemaTransformReadConfiguration.TimestampPolicyConfiguration value)

A timestamp policy to assign event time for messages in a Kafka partition and watermark for it.

setTopic

public abstract KafkaSchemaTransformReadConfiguration.Builder setTopic(java.lang.String value)

Sets the topic from which to read.

setTopicPartitions

public abstract KafkaSchemaTransformReadConfiguration.Builder setTopicPartitions(java.util.List<KafkaSchemaTransformReadConfiguration.TopicPartitionConfiguration> value)

Kafka partitions from which to read.

build

public abstract KafkaSchemaTransformReadConfiguration build()

Builds a KafkaSchemaTransformReadConfiguration instance.