Package org.apache.beam.sdk.extensions.avro.io

package org.apache.beam.sdk.extensions.avro.io

Defines transforms for reading and writing Avro storage format.

Related Packages

Package	Description
org.apache.beam.sdk.extensions.avro	Defines Schema and other classes for representing schema'd data in a Pipeline using Apache Avro.
org.apache.beam.sdk.extensions.avro.coders	Defines Coders to specify how data is encoded to and decoded from byte strings using Apache Avro.
org.apache.beam.sdk.extensions.avro.schemas	Defines Schema and other classes for representing schema'd data in a Pipeline using Apache Avro.

Class	Description
AvroDatumFactory<T>	Create DatumReader and DatumWriter for given schemas.
AvroDatumFactory.GenericDatumFactory	Specialized AvroDatumFactory for GenericRecord.
AvroDatumFactory.ReflectDatumFactory<T>	Specialized AvroDatumFactory for java classes transforming to avro through reflection.
AvroDatumFactory.SpecificDatumFactory<T>	Specialized AvroDatumFactory for SpecificRecord.
AvroIO	PTransforms for reading and writing Avro files.
AvroIO.Parse<T>	Implementation of AvroIO.parseGenericRecords(org.apache.beam.sdk.transforms.SerializableFunction<org.apache.avro.generic.GenericRecord, T>).
AvroIO.ParseAll<T>	Deprecated. See AvroIO.parseAllGenericRecords(SerializableFunction) for details.
AvroIO.ParseFiles<T>	Implementation of AvroIO.parseFilesGenericRecords(org.apache.beam.sdk.transforms.SerializableFunction<org.apache.avro.generic.GenericRecord, T>).
AvroIO.Read<T>	Implementation of AvroIO.read(java.lang.Class<T>) and AvroIO.readGenericRecords(org.apache.avro.Schema).
AvroIO.ReadAll<T>	Deprecated. See AvroIO.readAll(Class) for details.
AvroIO.ReadFiles<T>	Implementation of AvroIO.readFiles(java.lang.Class<T>).
AvroIO.RecordFormatter<ElementT>	Deprecated. Users can achieve the same by providing this transform in a ParDo before using write in AvroIO AvroIO.write(Class).
AvroIO.Sink<ElementT>	Implementation of AvroIO.sink(java.lang.Class<ElementT>) and AvroIO.sinkViaGenericRecords(org.apache.avro.Schema, org.apache.beam.sdk.extensions.avro.io.AvroIO.RecordFormatter<ElementT>).
AvroIO.TypedWrite<UserT,DestinationT,OutputT>	Implementation of AvroIO.write(java.lang.Class<T>).
AvroIO.Write<T>	This class is used as the default return value of AvroIO.write(java.lang.Class<T>)
AvroSchemaIOProvider	An implementation of SchemaIOProvider for reading and writing Avro files with AvroIO.
AvroSink<UserT,DestinationT,OutputT>	A FileBasedSink for Avro files.
AvroSink.DatumWriterFactory<T>
AvroSource<T>	Do not use in pipelines directly: most users should use AvroIO.Read.
AvroSource.AvroReader<T>	A BlockBasedSource.BlockBasedReader for reading blocks from Avro files.
AvroSource.DatumReaderFactory<T>
DynamicAvroDestinations<UserT,DestinationT,OutputT>	A specialization of FileBasedSink.DynamicDestinations for AvroIO.