Package org.apache.beam.sdk.extensions.avro.io
@DefaultAnnotation(org.checkerframework.checker.nullness.qual.NonNull.class)
package org.apache.beam.sdk.extensions.avro.io
Defines transforms for reading and writing Avro storage format.
-
ClassDescriptionCreate
DatumReader
andDatumWriter
for given schemas.SpecializedAvroDatumFactory
forGenericRecord
.SpecializedAvroDatumFactory
for java classes transforming to avro through reflection.SpecializedAvroDatumFactory
forSpecificRecord
.PTransform
s for reading and writing Avro files.AvroIO.Parse<T>Deprecated.AvroIO.Read<T>Implementation ofAvroIO.read(java.lang.Class<T>)
andAvroIO.readGenericRecords(org.apache.avro.Schema)
.Deprecated.SeeAvroIO.readAll(Class)
for details.Implementation ofAvroIO.readFiles(java.lang.Class<T>)
.AvroIO.RecordFormatter<ElementT>Deprecated.Users can achieve the same by providing this transform in aParDo
before using write in AvroIOAvroIO.write(Class)
.AvroIO.Sink<ElementT>AvroIO.TypedWrite<UserT,DestinationT, OutputT> Implementation ofAvroIO.write(java.lang.Class<T>)
.AvroIO.Write<T>This class is used as the default return value ofAvroIO.write(java.lang.Class<T>)
An implementation ofSchemaIOProvider
for reading and writing Avro files withAvroIO
.AvroSink<UserT,DestinationT, OutputT> AFileBasedSink
for Avro files.AvroSource<T>Do not use in pipelines directly: most users should useAvroIO.Read
.ABlockBasedSource.BlockBasedReader
for reading blocks from Avro files.DynamicAvroDestinations<UserT,DestinationT, OutputT> A specialization ofFileBasedSink.DynamicDestinations
forAvroIO
.
AvroIO.parseAllGenericRecords(SerializableFunction)
for details.