@Experimental @DefaultSchema(value=AutoValueSchema.class) public abstract class KafkaSchemaTransformReadConfiguration extends java.lang.Object
Internal only: This class is actively being worked on, and it will likely change. We provide no backwards compatibility guarantees, and it should not be implemented outside the Beam repository.
| Modifier and Type | Class and Description |
|---|---|
static class |
KafkaSchemaTransformReadConfiguration.Builder
Builder for the
KafkaSchemaTransformReadConfiguration. |
static class |
KafkaSchemaTransformReadConfiguration.TimestampPolicyConfiguration
A timestamp policy to assign event time for messages in a Kafka partition and watermark for it.
|
static class |
KafkaSchemaTransformReadConfiguration.TopicPartitionConfiguration
A configuration for a
TopicPartition. |
| Constructor and Description |
|---|
KafkaSchemaTransformReadConfiguration() |
| Modifier and Type | Method and Description |
|---|---|
static KafkaSchemaTransformReadConfiguration.Builder |
builder()
Instantiates a
KafkaSchemaTransformReadConfiguration.Builder instance. |
abstract java.lang.String |
getBootstrapServers()
Sets the bootstrap servers for the Kafka consumer.
|
abstract java.lang.Boolean |
getCommitOffsetsInFinalize()
Flags whether finalized offsets are committed to Kafka.
|
abstract java.util.Map<java.lang.String,java.lang.Object> |
getConsumerConfigUpdates()
Configuration updates for the backend main consumer.
|
abstract java.lang.Long |
getCreateTimeMillisecondsMaximumDelay()
Sets the timestamps policy based on KafkaTimestampType.CREATE_TIME timestamp of the records.
|
abstract java.lang.Long |
getDynamicReadMillisecondsDuration()
Configure the KafkaIO to use WatchKafkaTopicPartitionDoFn to detect and emit any new available
TopicPartition for ReadFromKafkaDoFn to consume during pipeline execution time. |
abstract java.util.Map<java.lang.String,java.lang.Object> |
getOffsetConsumerConfiguration()
Additional configuration for the backend offset consumer.
|
abstract java.lang.Boolean |
getReadCommitted()
Sets "isolation_level" to "read_committed" in Kafka consumer configuration.
|
abstract java.lang.Boolean |
getReadWithMetadata()
Specifies whether to include metadata when reading from Kafka topic.
|
abstract java.lang.Long |
getStartReadTimeMillisecondsEpoch()
Use timestamp to set up start offset.
|
abstract java.lang.Long |
getStopReadTimeMillisecondsEpoch()
Use timestamp to set up stop offset.
|
abstract KafkaSchemaTransformReadConfiguration.TimestampPolicyConfiguration |
getTimestampPolicy()
A timestamp policy to assign event time for messages in a Kafka partition and watermark for it.
|
abstract java.lang.String |
getTopic()
Sets the topic from which to read.
|
abstract java.util.List<KafkaSchemaTransformReadConfiguration.TopicPartitionConfiguration> |
getTopicPartitions()
Kafka partitions from which to read.
|
public KafkaSchemaTransformReadConfiguration()
public static KafkaSchemaTransformReadConfiguration.Builder builder()
KafkaSchemaTransformReadConfiguration.Builder instance.@Nullable public abstract java.lang.String getBootstrapServers()
@Nullable public abstract java.lang.Boolean getCommitOffsetsInFinalize()
@Nullable public abstract java.util.Map<java.lang.String,java.lang.Object> getConsumerConfigUpdates()
@Nullable public abstract java.lang.Long getCreateTimeMillisecondsMaximumDelay()
@Nullable public abstract java.lang.Long getDynamicReadMillisecondsDuration()
TopicPartition for ReadFromKafkaDoFn to consume during pipeline execution time.@Nullable public abstract java.util.Map<java.lang.String,java.lang.Object> getOffsetConsumerConfiguration()
@Nullable public abstract java.lang.Boolean getReadWithMetadata()
@Nullable public abstract java.lang.Boolean getReadCommitted()
@Nullable public abstract java.lang.Long getStartReadTimeMillisecondsEpoch()
@Nullable public abstract java.lang.Long getStopReadTimeMillisecondsEpoch()
@Nullable public abstract KafkaSchemaTransformReadConfiguration.TimestampPolicyConfiguration getTimestampPolicy()
@Nullable public abstract java.lang.String getTopic()
@Nullable public abstract java.util.List<KafkaSchemaTransformReadConfiguration.TopicPartitionConfiguration> getTopicPartitions()