public abstract static class CdapIO.Read<K,V> extends PTransform<PBegin,PCollection<KV<K,V>>>
PTransform
to read from CDAP source.annotations, displayData, name, resourceHints
Constructor and Description |
---|
Read() |
Modifier and Type | Method and Description |
---|---|
PCollection<KV<K,V>> |
expand(PBegin input)
Override this method to specify how this
PTransform should be expanded on the given
InputT . |
CdapIO.Read<K,V> |
withCdapPlugin(Plugin<K,V> plugin)
Sets a CDAP
Plugin . |
CdapIO.Read<K,V> |
withCdapPluginClass(java.lang.Class<?> cdapPluginClass)
Sets a CDAP Plugin class.
|
CdapIO.Read<K,V> |
withKeyClass(java.lang.Class<K> keyClass)
Sets a key class.
|
CdapIO.Read<K,V> |
withPluginConfig(PluginConfig pluginConfig)
Sets a
PluginConfig . |
CdapIO.Read<K,V> |
withPullFrequencySec(java.lang.Long pullFrequencySec)
Delay in seconds between polling for new records updates.
|
CdapIO.Read<K,V> |
withStartOffset(java.lang.Long startOffset)
Inclusive start offset from which the reading should be started.
|
CdapIO.Read<K,V> |
withStartPollTimeoutSec(java.lang.Long startPollTimeoutSec)
Delay in seconds before start polling.
|
CdapIO.Read<K,V> |
withValueClass(java.lang.Class<V> valueClass)
Sets a value class.
|
addAnnotation, compose, compose, getAdditionalInputs, getAnnotations, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setDisplayData, setResourceHints, toString, validate, validate
public CdapIO.Read<K,V> withCdapPluginClass(java.lang.Class<?> cdapPluginClass)
public CdapIO.Read<K,V> withPluginConfig(PluginConfig pluginConfig)
PluginConfig
.public CdapIO.Read<K,V> withKeyClass(java.lang.Class<K> keyClass)
public CdapIO.Read<K,V> withValueClass(java.lang.Class<V> valueClass)
public CdapIO.Read<K,V> withPullFrequencySec(java.lang.Long pullFrequencySec)
public CdapIO.Read<K,V> withStartPollTimeoutSec(java.lang.Long startPollTimeoutSec)
public CdapIO.Read<K,V> withStartOffset(java.lang.Long startOffset)
public PCollection<KV<K,V>> expand(PBegin input)
PTransform
PTransform
should be expanded on the given
InputT
.
NOTE: This method should not be called directly. Instead apply the PTransform
should
be applied to the InputT
using the apply
method.
Composite transforms, which are defined in terms of other transforms, should return the output of one of the composed transforms. Non-composite transforms, which do not apply any transforms internally, should return a new unbound output and register evaluators (via backend-specific registration methods).
expand
in class PTransform<PBegin,PCollection<KV<K,V>>>