org.apache.beam.sdk.io.cdap

Class CdapIO.Read<K,V>

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<PBegin,PCollection<KV<K,V>>>

org.apache.beam.sdk.io.cdap.CdapIO.Read<K,V>

All Implemented Interfaces:

java.io.Serializable, HasDisplayData

Enclosing class:

CdapIO

public abstract static class CdapIO.Read<K,V>
extends PTransform<PBegin,PCollection<KV<K,V>>>

A PTransform to read from CDAP source.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

name, resourceHints

Constructor Summary

Constructors

Constructor and Description
Read()

Method Summary

Modifier and Type	Method and Description
PCollection<KV<K,V>>	expand(PBegin input) Override this method to specify how this PTransform should be expanded on the given InputT.
CdapIO.Read<K,V>	withCdapPlugin(Plugin<K,V> plugin) Sets a CDAP Plugin.
CdapIO.Read<K,V>	withCdapPluginClass(java.lang.Class<?> cdapPluginClass) Sets a CDAP Plugin class.
CdapIO.Read<K,V>	withKeyClass(java.lang.Class<K> keyClass) Sets a key class.
CdapIO.Read<K,V>	withPluginConfig(PluginConfig pluginConfig) Sets a PluginConfig.
CdapIO.Read<K,V>	withPullFrequencySec(java.lang.Long pullFrequencySec) Delay in seconds between polling for new records updates.
CdapIO.Read<K,V>	withStartOffset(java.lang.Long startOffset) Inclusive start offset from which the reading should be started.
CdapIO.Read<K,V>	withStartPollTimeoutSec(java.lang.Long startPollTimeoutSec) Delay in seconds before start polling.
CdapIO.Read<K,V>	withValueClass(java.lang.Class<V> valueClass) Sets a value class.

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setResourceHints, toString, validate, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

Read

public Read()

Method Detail

withCdapPlugin

public CdapIO.Read<K,V> withCdapPlugin(Plugin<K,V> plugin)

Sets a CDAP Plugin.

withCdapPluginClass

public CdapIO.Read<K,V> withCdapPluginClass(java.lang.Class<?> cdapPluginClass)

Sets a CDAP Plugin class.

withPluginConfig

public CdapIO.Read<K,V> withPluginConfig(PluginConfig pluginConfig)

Sets a PluginConfig.

withKeyClass

public CdapIO.Read<K,V> withKeyClass(java.lang.Class<K> keyClass)

Sets a key class.

withValueClass

public CdapIO.Read<K,V> withValueClass(java.lang.Class<V> valueClass)

Sets a value class.

withPullFrequencySec

public CdapIO.Read<K,V> withPullFrequencySec(java.lang.Long pullFrequencySec)

Delay in seconds between polling for new records updates. Applicable only for streaming Cdap Plugins.

withStartPollTimeoutSec

public CdapIO.Read<K,V> withStartPollTimeoutSec(java.lang.Long startPollTimeoutSec)

Delay in seconds before start polling. Applicable only for streaming Cdap Plugins.

withStartOffset

public CdapIO.Read<K,V> withStartOffset(java.lang.Long startOffset)

Inclusive start offset from which the reading should be started. Applicable only for streaming Cdap Plugins.

expand

public PCollection<KV<K,V>> expand(PBegin input)

Description copied from class: PTransform

Override this method to specify how this PTransform should be expanded on the given InputT.

NOTE: This method should not be called directly. Instead apply the PTransform should be applied to the InputT using the apply method.

Composite transforms, which are defined in terms of other transforms, should return the output of one of the composed transforms. Non-composite transforms, which do not apply any transforms internally, should return a new unbound output and register evaluators (via backend-specific registration methods).

Specified by:

expand in class PTransform<PBegin,PCollection<KV<K,V>>>