HadoopFormatIO .See: Description
| Interface | Description |
|---|---|
| ExternalSynchronization |
Provides mechanism for acquiring locks related to the job.
|
| HadoopFormatIO.Write.ExternalSynchronizationBuilder<KeyT,ValueT> |
Builder for External Synchronization defining.
|
| HadoopFormatIO.Write.PartitionedWriterBuilder<KeyT,ValueT> |
Builder for partitioning determining.
|
| HadoopFormatIO.Write.WriteBuilder<KeyT,ValueT> |
Main builder of Write transformation.
|
| HDFSSynchronization.ThrowingFunction<T1,T2,X extends java.lang.Exception> |
Function which can throw exception.
|
| Class | Description |
|---|---|
| HadoopFormatIO |
A
HadoopFormatIO is a Transform for reading data from any source or writing data to any
sink which implements Hadoop InputFormat or OutputFormat. |
| HadoopFormatIO.HadoopInputFormatBoundedSource<K,V> |
Bounded source implementation for
HadoopFormatIO. |
| HadoopFormatIO.Read<K,V> |
A
PTransform that reads from any data source which implements Hadoop InputFormat. |
| HadoopFormatIO.SerializableSplit |
A wrapper to allow Hadoop
InputSplit to be serialized using
Java's standard serialization mechanisms. |
| HadoopFormatIO.Write<KeyT,ValueT> |
A
PTransform that writes to any data sink which implements Hadoop OutputFormat. |
| HDFSSynchronization |
Implementation of
ExternalSynchronization which registers locks in the HDFS. |
HadoopFormatIO .HadoopFormatIO