Package org.apache.beam.sdk.extensions.sql.meta.provider.kafka

Class BeamKafkaCSVTable

java.lang.Object

org.apache.beam.sdk.extensions.sql.meta.BaseBeamTable

org.apache.beam.sdk.extensions.sql.meta.SchemaBaseBeamTable

org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaTable

org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaCSVTable

All Implemented Interfaces:

Serializable, BeamSqlTable

public class BeamKafkaCSVTable
extends BeamKafkaTable

A Kafka topic that saves records as CSV format.

See Also:

• Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaTable

numberOfRecordsForRate

Fields inherited from class org.apache.beam.sdk.extensions.sql.meta.SchemaBaseBeamTable

schema

Constructor Summary

Constructors

Constructor	Description
BeamKafkaCSVTable(Schema beamSchema, String bootstrapServers, List<String> topics)
BeamKafkaCSVTable(Schema beamSchema, String bootstrapServers, List<String> topics, TimestampPolicyFactory timestampPolicyFactory)
BeamKafkaCSVTable(Schema beamSchema, String bootstrapServers, List<String> topics, CSVFormat format, TimestampPolicyFactory timestampPolicyFactory)

Method Summary

Modifier and Type	Method	Description
protected PTransform<PCollection<KafkaRecord<byte[],byte[]>>,PCollection<Row>>	getPTransformForInput()
protected PTransform<PCollection<Row>,PCollection<ProducerRecord<byte[],byte[]>>>	getPTransformForOutput()

Methods inherited from class org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaTable

buildIOReader, buildIOWriter, createKafkaRead, getBootstrapServers, getConfigUpdates, getTableStatistics, getTimestampPolicyFactory, getTopics, isBounded, updateConsumerProperties

Methods inherited from class org.apache.beam.sdk.extensions.sql.meta.SchemaBaseBeamTable

getSchema

Methods inherited from class org.apache.beam.sdk.extensions.sql.meta.BaseBeamTable

buildIOReader, constructFilter, supportsProjects

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

BeamKafkaCSVTable

public BeamKafkaCSVTable(Schema beamSchema,
 String bootstrapServers,
 List<String> topics)

BeamKafkaCSVTable

public BeamKafkaCSVTable(Schema beamSchema,
 String bootstrapServers,
 List<String> topics,
 TimestampPolicyFactory timestampPolicyFactory)

BeamKafkaCSVTable

public BeamKafkaCSVTable(Schema beamSchema,
 String bootstrapServers,
 List<String> topics,
 CSVFormat format,
 TimestampPolicyFactory timestampPolicyFactory)

Method Details

getPTransformForInput

protected PTransform<PCollection<KafkaRecord<byte[],byte[]>>,PCollection<Row>> getPTransformForInput()

Specified by:

getPTransformForInput in class BeamKafkaTable

getPTransformForOutput

protected PTransform<PCollection<Row>,PCollection<ProducerRecord<byte[],byte[]>>> getPTransformForOutput()

Specified by:

getPTransformForOutput in class BeamKafkaTable