public abstract static class HCatalogIO.Write extends PTransform<PCollection<org.apache.hive.hcatalog.data.HCatRecord>,PDone>
PTransform
to write to a HCatalog managed source.name
Constructor and Description |
---|
Write() |
Modifier and Type | Method and Description |
---|---|
PDone |
expand(PCollection<org.apache.hive.hcatalog.data.HCatRecord> input)
Override this method to specify how this
PTransform should be expanded on the given
InputT . |
HCatalogIO.Write |
withBatchSize(long batchSize)
Sets batch size for the write operation.
|
HCatalogIO.Write |
withConfigProperties(java.util.Map<java.lang.String,java.lang.String> configProperties)
Sets the configuration properties like metastore URI.
|
HCatalogIO.Write |
withDatabase(java.lang.String database)
Sets the database name.
|
HCatalogIO.Write |
withPartition(java.util.Map<java.lang.String,java.lang.String> partition)
Sets the partition details.
|
HCatalogIO.Write |
withTable(java.lang.String table)
Sets the table name to write to, the table should exist beforehand.
|
compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, populateDisplayData, toString, validate
public HCatalogIO.Write withConfigProperties(java.util.Map<java.lang.String,java.lang.String> configProperties)
public HCatalogIO.Write withDatabase(java.lang.String database)
public HCatalogIO.Write withTable(java.lang.String table)
public HCatalogIO.Write withPartition(java.util.Map<java.lang.String,java.lang.String> partition)
public HCatalogIO.Write withBatchSize(long batchSize)
public PDone expand(PCollection<org.apache.hive.hcatalog.data.HCatRecord> input)
PTransform
PTransform
should be expanded on the given
InputT
.
NOTE: This method should not be called directly. Instead apply the PTransform
should
be applied to the InputT
using the apply
method.
Composite transforms, which are defined in terms of other transforms, should return the output of one of the composed transforms. Non-composite transforms, which do not apply any transforms internally, should return a new unbound output and register evaluators (via backend-specific registration methods).
expand
in class PTransform<PCollection<org.apache.hive.hcatalog.data.HCatRecord>,PDone>