org.apache.beam.sdk.extensions.sql.meta.provider.kafka

Class BeamKafkaCSVTable

java.lang.Object

org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaTable

org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaCSVTable

All Implemented Interfaces:

java.io.Serializable, BeamSqlTable

public class BeamKafkaCSVTable
extends BeamKafkaTable

A Kafka topic that saves records as CSV format.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	BeamKafkaCSVTable.CsvRecorderDecoder A PTransform to convert KV<byte[], byte[]> to Row.
static class	BeamKafkaCSVTable.CsvRecorderEncoder A PTransform to convert Row to KV<byte[], byte[]>.

Field Summary

Fields inherited from class org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

schema

Constructor Summary

Constructors

Constructor and Description
BeamKafkaCSVTable(Schema beamSchema, java.lang.String bootstrapServers, java.util.List<java.lang.String> topics)
BeamKafkaCSVTable(Schema beamSchema, java.lang.String bootstrapServers, java.util.List<java.lang.String> topics, CSVFormat format)

Method Summary

Modifier and Type	Method and Description
PTransform<PCollection<KV<byte[],byte[]>>,PCollection<Row>>	getPTransformForInput()
PTransform<PCollection<Row>,PCollection<KV<byte[],byte[]>>>	getPTransformForOutput()

Methods inherited from class org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaTable

buildIOReader, buildIOWriter, getBootstrapServers, getTopics, isBounded, updateConsumerProperties

Methods inherited from class org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

getSchema

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.beam.sdk.extensions.sql.BeamSqlTable

getRowCount

Constructor Detail

BeamKafkaCSVTable

public BeamKafkaCSVTable(Schema beamSchema,
                         java.lang.String bootstrapServers,
                         java.util.List<java.lang.String> topics)

BeamKafkaCSVTable

public BeamKafkaCSVTable(Schema beamSchema,
                         java.lang.String bootstrapServers,
                         java.util.List<java.lang.String> topics,
                         CSVFormat format)

Method Detail

getPTransformForInput

public PTransform<PCollection<KV<byte[],byte[]>>,PCollection<Row>> getPTransformForInput()

Specified by:

getPTransformForInput in class BeamKafkaTable

getPTransformForOutput

public PTransform<PCollection<Row>,PCollection<KV<byte[],byte[]>>> getPTransformForOutput()

Specified by:

getPTransformForOutput in class BeamKafkaTable