Package org.apache.beam.sdk.io.azure.cosmos

Class CosmosIO.BoundedCosmosBDSource<T>

java.lang.Object

org.apache.beam.sdk.io.Source<T>

org.apache.beam.sdk.io.BoundedSource<T>

org.apache.beam.sdk.io.azure.cosmos.CosmosIO.BoundedCosmosBDSource<T>

All Implemented Interfaces:

Serializable, HasDisplayData

Enclosing class:

CosmosIO

public static class CosmosIO.BoundedCosmosBDSource<T>
extends BoundedSource<T>

A BoundedSource reading from Comos.

See Also:

• Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.io.BoundedSource

BoundedSource.BoundedReader<T>

Nested classes/interfaces inherited from class org.apache.beam.sdk.io.Source

Source.Reader<T>

Method Summary

Modifier and Type	Method	Description
BoundedSource.BoundedReader<T>	createReader(PipelineOptions options)	Returns a new BoundedSource.BoundedReader that reads from this source.
long	getEstimatedSizeBytes(PipelineOptions options)	An estimate of the total size (in bytes) of the data that would be read from this source.
Coder<T>	getOutputCoder()	Returns the Coder to use for the data read from this source.
List<? extends BoundedSource<T>>	split(long desiredBundleSizeBytes, PipelineOptions options)	Splits the source into bundles of approximately desiredBundleSizeBytes.

Methods inherited from class org.apache.beam.sdk.io.Source

getDefaultOutputCoder, populateDisplayData, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

split

public List<? extends BoundedSource<T>> split(long desiredBundleSizeBytes,
 PipelineOptions options)
                                       throws Exception

Description copied from class: BoundedSource

Splits the source into bundles of approximately desiredBundleSizeBytes.

Specified by:

split in class BoundedSource<T>

Throws:

Exception

getEstimatedSizeBytes

public long getEstimatedSizeBytes(PipelineOptions options)
                           throws Exception

Description copied from class: BoundedSource

An estimate of the total size (in bytes) of the data that would be read from this source. This estimate is in terms of external storage size, before any decompression or other processing done by the reader.

If there is no way to estimate the size of the source implementations MAY return 0L.

Specified by:

getEstimatedSizeBytes in class BoundedSource<T>

Throws:

Exception

getOutputCoder

public Coder<T> getOutputCoder()

Description copied from class: Source

Returns the Coder to use for the data read from this source.

Overrides:

getOutputCoder in class Source<T>

createReader

public BoundedSource.BoundedReader<T> createReader(PipelineOptions options)
                                            throws IOException

Description copied from class: BoundedSource

Returns a new BoundedSource.BoundedReader that reads from this source.

Specified by:

createReader in class BoundedSource<T>

Throws:

IOException