Package org.apache.beam.sdk.io.fileschematransform
package org.apache.beam.sdk.io.fileschematransform
Defines transforms for File reading and writing support with Schema Transform.
-
ClassDescriptionA
FileWriteSchemaTransformFormatProviderfor avro format.AFileWriteSchemaTransformFormatProviderfor CSV format.Interface that provides aPTransformthat reads in aPCollectionofFileIO.ReadableFiles and outputs the data represented as aPCollectionofRows.The configuration for building file writing transforms usingSchemaTransformandSchemaTransformProvider.Configures extra details related to writing CSV formatted files.Configures extra details related to writing Parquet formatted files.Configures extra details related to writing XML formatted files.Provides aPTransformthat writes aPCollectionofRows and outputs aPCollectionof the file names according to a registeredAutoServiceFileWriteSchemaTransformFormatProviderimplementation.FileWriteSchemaTransformFormatProviderscontainsFileWriteSchemaTransformFormatProviderimplementations.ATypedSchemaTransformProviderimplementation for writing aRowPCollectionto file systems, driven by aFileWriteSchemaTransformConfiguration.AFileReadSchemaTransformFormatProviderthat reads newline-delimited JSONs.AFileWriteSchemaTransformFormatProviderfor JSON format.AFileReadSchemaTransformFormatProviderthat reads lines as Strings.AFileWriteSchemaTransformFormatProviderfor Parquet format.AFileWriteSchemaTransformFormatProviderfor XML format.