org.apache.beam.sdk.extensions.sql.meta.provider.kafka

Class BeamKafkaThriftTable<FieldT extends org.apache.thrift.TFieldIdEnum,T extends org.apache.thrift.TBase<T,FieldT>>

java.lang.Object

org.apache.beam.sdk.extensions.sql.meta.BaseBeamTable

org.apache.beam.sdk.extensions.sql.meta.SchemaBaseBeamTable

org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaTable

org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaThriftTable<FieldT,T>

Type Parameters:

FieldT - thrift field type, i.e. ThriftGeneratedClass._Fields

T - thrift generated class

All Implemented Interfaces:

java.io.Serializable, BeamSqlTable

public class BeamKafkaThriftTable<FieldT extends org.apache.thrift.TFieldIdEnum,T extends org.apache.thrift.TBase<T,FieldT>>
extends BeamKafkaTable

Kafka table that handles thrift data.

Uses the default thrift schema provider , so it can't handle custom container typedefs.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaTable

numberOfRecordsForRate

Fields inherited from class org.apache.beam.sdk.extensions.sql.meta.SchemaBaseBeamTable

schema

Constructor Summary

Constructors

Constructor and Description
BeamKafkaThriftTable(Schema requiredSchema, java.lang.String bootstrapServers, java.util.List<java.lang.String> topics, java.lang.Class<T> thriftClass, org.apache.thrift.protocol.TProtocolFactory protocolFactory)

Method Summary

Modifier and Type	Method and Description
protected PTransform<PCollection<KV<byte[],byte[]>>,PCollection<Row>>	getPTransformForInput()
protected PTransform<PCollection<Row>,PCollection<KV<byte[],byte[]>>>	getPTransformForOutput()

Methods inherited from class org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaTable

buildIOReader, buildIOWriter, getBootstrapServers, getTableStatistics, getTopics, isBounded, updateConsumerProperties

Methods inherited from class org.apache.beam.sdk.extensions.sql.meta.SchemaBaseBeamTable

getSchema

Methods inherited from class org.apache.beam.sdk.extensions.sql.meta.BaseBeamTable

buildIOReader, constructFilter, supportsProjects

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BeamKafkaThriftTable

public BeamKafkaThriftTable(Schema requiredSchema,
                            java.lang.String bootstrapServers,
                            java.util.List<java.lang.String> topics,
                            java.lang.Class<T> thriftClass,
                            org.apache.thrift.protocol.TProtocolFactory protocolFactory)

Method Detail

getPTransformForInput

protected PTransform<PCollection<KV<byte[],byte[]>>,PCollection<Row>> getPTransformForInput()

Specified by:

getPTransformForInput in class BeamKafkaTable

getPTransformForOutput

protected PTransform<PCollection<Row>,PCollection<KV<byte[],byte[]>>> getPTransformForOutput()

Specified by:

getPTransformForOutput in class BeamKafkaTable