public abstract static class SolrIO.Write extends PTransform<PCollection<org.apache.solr.common.SolrInputDocument>,PDone>
PTransform
writing data to Solr.name
Constructor and Description |
---|
Write() |
Modifier and Type | Method and Description |
---|---|
PDone |
expand(PCollection<org.apache.solr.common.SolrInputDocument> input)
Override this method to specify how this
PTransform should be expanded on the given
InputT . |
SolrIO.Write |
to(java.lang.String collection)
Provide name of collection while reading from Solr.
|
SolrIO.Write |
withConnectionConfiguration(SolrIO.ConnectionConfiguration connectionConfiguration)
Provide the Solr connection configuration object.
|
SolrIO.Write |
withMaxBatchSize(int batchSize)
Provide a maximum size in number of documents for the batch.
|
SolrIO.Write |
withRetryConfiguration(SolrIO.RetryConfiguration retryConfiguration)
Provides configuration to retry a failed batch call to Solr.
|
compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, populateDisplayData, toString, validate
public SolrIO.Write withConnectionConfiguration(SolrIO.ConnectionConfiguration connectionConfiguration)
public SolrIO.Write to(java.lang.String collection)
collection
- the collection toward which the requests will be issuedpublic SolrIO.Write withMaxBatchSize(int batchSize)
batchSize
- maximum batch size in number of documentspublic SolrIO.Write withRetryConfiguration(SolrIO.RetryConfiguration retryConfiguration)
CloudSolrClient
surfaces HttpSolrClient.RemoteSolrException
, SolrServerException
or IOException
. Users should consider that retrying might
compound the underlying problem which caused the initial failure. Users should also be aware
that once retrying is exhausted the error is surfaced to the runner which may then
opt to retry the current partition in entirety or abort if the max number of retries of the
runner is completed. Retrying uses an exponential backoff algorithm, with minimum backoff of
5 seconds and then surfacing the error once the maximum number of retries or maximum
configuration duration is exceeded.
Example use:
SolrIO.write()
.withRetryConfiguration(SolrIO.RetryConfiguration.create(10, Duration.standardMinutes(3))
...
retryConfiguration
- the rules which govern the retry behaviorSolrIO.Write
with retrying configuredpublic PDone expand(PCollection<org.apache.solr.common.SolrInputDocument> input)
PTransform
PTransform
should be expanded on the given
InputT
.
NOTE: This method should not be called directly. Instead apply the PTransform
should
be applied to the InputT
using the apply
method.
Composite transforms, which are defined in terms of other transforms, should return the output of one of the composed transforms. Non-composite transforms, which do not apply any transforms internally, should return a new unbound output and register evaluators (via backend-specific registration methods).
expand
in class PTransform<PCollection<org.apache.solr.common.SolrInputDocument>,PDone>