KeyT - Type of keys to be written.ValueT - Type of values to be written.public static class HadoopFormatIO.Write<KeyT,ValueT> extends PTransform<PCollection<KV<KeyT,ValueT>>,PDone>
PTransform that writes to any data sink which implements Hadoop OutputFormat. For
e.g. Cassandra, Elasticsearch, HBase, Redis, Postgres, etc. See the class-level Javadoc on
HadoopFormatIO for more information.HadoopFormatIO,
Serialized Form| Modifier and Type | Class and Description |
|---|---|
static interface |
HadoopFormatIO.Write.ExternalSynchronizationBuilder<KeyT,ValueT>
Builder for External Synchronization defining.
|
static interface |
HadoopFormatIO.Write.PartitionedWriterBuilder<KeyT,ValueT>
Builder for partitioning determining.
|
static interface |
HadoopFormatIO.Write.WriteBuilder<KeyT,ValueT>
Main builder of Write transformation.
|
annotations, displayData, name, resourceHints| Modifier and Type | Method and Description |
|---|---|
PDone |
expand(PCollection<KV<KeyT,ValueT>> input)
Override this method to specify how this
PTransform should be expanded on the given
InputT. |
void |
populateDisplayData(DisplayData.Builder builder)
Register display data for the given transform or component.
|
void |
validate(PipelineOptions pipelineOptions)
Called before running the Pipeline to verify this transform is fully and correctly specified.
|
addAnnotation, compose, compose, getAdditionalInputs, getAnnotations, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, setDisplayData, setResourceHints, toString, validatepublic void validate(PipelineOptions pipelineOptions)
PTransformBy default, does nothing.
validate in class PTransform<PCollection<KV<KeyT,ValueT>>,PDone>public void populateDisplayData(DisplayData.Builder builder)
PTransformpopulateDisplayData(DisplayData.Builder) is invoked by Pipeline runners to collect
display data via DisplayData.from(HasDisplayData). Implementations may call super.populateDisplayData(builder) in order to register display data in the current namespace,
but should otherwise use subcomponent.populateDisplayData(builder) to use the namespace
of the subcomponent.
By default, does not register any display data. Implementors may override this method to provide their own display data.
populateDisplayData in interface HasDisplayDatapopulateDisplayData in class PTransform<PCollection<KV<KeyT,ValueT>>,PDone>builder - The builder to populate with display data.HasDisplayDatapublic PDone expand(PCollection<KV<KeyT,ValueT>> input)
PTransformPTransform should be expanded on the given
InputT.
NOTE: This method should not be called directly. Instead apply the PTransform should
be applied to the InputT using the apply method.
Composite transforms, which are defined in terms of other transforms, should return the output of one of the composed transforms. Non-composite transforms, which do not apply any transforms internally, should return a new unbound output and register evaluators (via backend-specific registration methods).
expand in class PTransform<PCollection<KV<KeyT,ValueT>>,PDone>