Package org.apache.beam.sdk.io.hadoop.format

package org.apache.beam.sdk.io.hadoop.format

Defines transforms for writing to Data sinks that implement HadoopFormatIO .

See Also:

• HadoopFormatIO

Related Packages

Package	Description
org.apache.beam.sdk.io.hadoop	Classes shared by Hadoop based IOs.

Class	Description
ExternalSynchronization	Provides mechanism for acquiring locks related to the job.
HadoopFormatIO	A HadoopFormatIO is a Transform for reading data from any source or writing data to any sink which implements Hadoop InputFormat or OutputFormat.
HadoopFormatIO.HadoopInputFormatBoundedSource<K,V>	Bounded source implementation for HadoopFormatIO.
HadoopFormatIO.Read<K,V>	A PTransform that reads from any data source which implements Hadoop InputFormat.
HadoopFormatIO.SerializableSplit	A wrapper to allow Hadoop InputSplit to be serialized using Java's standard serialization mechanisms.
HadoopFormatIO.Write<KeyT,ValueT>	A PTransform that writes to any data sink which implements Hadoop OutputFormat.
HadoopFormatIO.Write.ExternalSynchronizationBuilder<KeyT,ValueT>	Builder for External Synchronization defining.
HadoopFormatIO.Write.PartitionedWriterBuilder<KeyT,ValueT>	Builder for partitioning determining.
HadoopFormatIO.Write.WriteBuilder<KeyT,ValueT>	Main builder of Write transformation.
HDFSSynchronization	Implementation of ExternalSynchronization which registers locks in the HDFS.