@Experimental(value=SOURCE_SINK)

Package org.apache.beam.sdk.io.hadoop.format

Defines transforms for writing to Data sinks that implement HadoopFormatIO .

See: Description

Interface Summary

Interface	Description
ExternalSynchronization	Provides mechanism for acquiring locks related to the job.
HadoopFormatIO.Write.ExternalSynchronizationBuilder<KeyT,ValueT>	Builder for External Synchronization defining.
HadoopFormatIO.Write.PartitionedWriterBuilder<KeyT,ValueT>	Builder for partitioning determining.
HadoopFormatIO.Write.WriteBuilder<KeyT,ValueT>	Main builder of Write transformation.

Class Summary

Class	Description
HadoopFormatIO	A HadoopFormatIO is a Transform for reading data from any source or writing data to any sink which implements Hadoop InputFormat or OutputFormat.
HadoopFormatIO.HadoopInputFormatBoundedSource<K,V>	Bounded source implementation for HadoopFormatIO.
HadoopFormatIO.Read<K,V>	A PTransform that reads from any data source which implements Hadoop InputFormat.
HadoopFormatIO.SerializableSplit	A wrapper to allow Hadoop InputSplit to be serialized using Java's standard serialization mechanisms.
HadoopFormatIO.Write<KeyT,ValueT>	A PTransform that writes to any data sink which implements Hadoop OutputFormat.
HDFSSynchronization	Implementation of ExternalSynchronization which registers locks in the HDFS.

Package org.apache.beam.sdk.io.hadoop.format Description

Defines transforms for writing to Data sinks that implement HadoopFormatIO .

See Also:

HadoopFormatIO