Class BeamImpulseSource
java.lang.Object
org.apache.beam.sdk.io.Source<byte[]>
org.apache.beam.sdk.io.BoundedSource<byte[]>
org.apache.beam.runners.flink.translation.wrappers.streaming.io.source.impulse.BeamImpulseSource
- All Implemented Interfaces:
Serializable
,HasDisplayData
A Beam
BoundedSource
for Impulse Source.- See Also:
-
Nested Class Summary
Nested classes/interfaces inherited from class org.apache.beam.sdk.io.BoundedSource
BoundedSource.BoundedReader<T>
Nested classes/interfaces inherited from class org.apache.beam.sdk.io.Source
Source.Reader<T>
-
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionBoundedSource.BoundedReader
<byte[]> createReader
(PipelineOptions options) Returns a newBoundedSource.BoundedReader
that reads from this source.long
getEstimatedSizeBytes
(PipelineOptions options) An estimate of the total size (in bytes) of the data that would be read from this source.Coder
<byte[]> Returns theCoder
to use for the data read from this source.List
<? extends BoundedSource<byte[]>> split
(long desiredBundleSizeBytes, PipelineOptions options) Splits the source into bundles of approximatelydesiredBundleSizeBytes
.Methods inherited from class org.apache.beam.sdk.io.Source
getDefaultOutputCoder, populateDisplayData, validate
-
Constructor Details
-
BeamImpulseSource
public BeamImpulseSource()
-
-
Method Details
-
split
public List<? extends BoundedSource<byte[]>> split(long desiredBundleSizeBytes, PipelineOptions options) throws Exception Description copied from class:BoundedSource
Splits the source into bundles of approximatelydesiredBundleSizeBytes
.- Specified by:
split
in classBoundedSource<byte[]>
- Throws:
Exception
-
getEstimatedSizeBytes
Description copied from class:BoundedSource
An estimate of the total size (in bytes) of the data that would be read from this source. This estimate is in terms of external storage size, before any decompression or other processing done by the reader.If there is no way to estimate the size of the source implementations MAY return 0L.
- Specified by:
getEstimatedSizeBytes
in classBoundedSource<byte[]>
- Throws:
Exception
-
createReader
Description copied from class:BoundedSource
Returns a newBoundedSource.BoundedReader
that reads from this source.- Specified by:
createReader
in classBoundedSource<byte[]>
- Throws:
IOException
-
getOutputCoder
Description copied from class:Source
Returns theCoder
to use for the data read from this source.- Overrides:
getOutputCoder
in classSource<byte[]>
-