Package org.apache.beam.runners.flink.translation.wrappers.streaming.io.source.bounded

Class FlinkBoundedSource<T>

java.lang.Object

org.apache.beam.runners.flink.translation.wrappers.streaming.io.source.FlinkSource<T,WindowedValue<T>>

org.apache.beam.runners.flink.translation.wrappers.streaming.io.source.bounded.FlinkBoundedSource<T>

Type Parameters:

T - The output type of the wrapped Beam BoundedSource.

All Implemented Interfaces:

Serializable, org.apache.flink.api.connector.source.Source<WindowedValue<T>,FlinkSourceSplit<T>,Map<Integer,List<FlinkSourceSplit<T>>>>, org.apache.flink.api.connector.source.SourceReaderFactory<WindowedValue<T>,FlinkSourceSplit<T>>

public class FlinkBoundedSource<T>
extends FlinkSource<T,WindowedValue<T>>

A Flink Source implementation that wraps a Beam BoundedSource.

A FlinkBoundedSource can run in either batch or streaming mode, depending on its Boundedness setting. For a BoundedSource running in streaming mode, it is acting like a "finite stream".

See Also:

• Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.runners.flink.translation.wrappers.streaming.io.source.FlinkSource

FlinkSource.TimestampExtractor<T>

Field Summary

Fields

Modifier and Type	Field	Description
protected final FlinkSource.TimestampExtractor<WindowedValue<T>>	timestampExtractor

Fields inherited from class org.apache.beam.runners.flink.translation.wrappers.streaming.io.source.FlinkSource

beamSource, boundedness, serializablePipelineOptions, stepName

Constructor Summary

Constructors

Constructor	Description
FlinkBoundedSource(String stepName, BoundedSource<T> beamSource, org.apache.beam.runners.core.construction.SerializablePipelineOptions serializablePipelineOptions, org.apache.flink.api.connector.source.Boundedness boundedness, int numSplits)
FlinkBoundedSource(String stepName, BoundedSource<T> beamSource, org.apache.beam.runners.core.construction.SerializablePipelineOptions serializablePipelineOptions, org.apache.flink.api.connector.source.Boundedness boundedness, int numSplits, FlinkSource.TimestampExtractor<WindowedValue<T>> timestampExtractor)

Method Summary

Modifier and Type	Method	Description
org.apache.flink.api.connector.source.SourceReader<WindowedValue<T>,FlinkSourceSplit<T>>	createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)

Methods inherited from class org.apache.beam.runners.flink.translation.wrappers.streaming.io.source.FlinkSource

bounded, boundedImpulse, createEnumerator, createEnumerator, getBoundedness, getEnumeratorCheckpointSerializer, getNumSplits, getSplitSerializer, restoreEnumerator, unbounded

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

timestampExtractor

@Nullable
protected final FlinkSource.TimestampExtractor<WindowedValue<T>> timestampExtractor

Constructor Details

FlinkBoundedSource

public FlinkBoundedSource(String stepName,
 BoundedSource<T> beamSource,
 org.apache.beam.runners.core.construction.SerializablePipelineOptions serializablePipelineOptions,
 org.apache.flink.api.connector.source.Boundedness boundedness,
 int numSplits)

FlinkBoundedSource

public FlinkBoundedSource(String stepName,
 BoundedSource<T> beamSource,
 org.apache.beam.runners.core.construction.SerializablePipelineOptions serializablePipelineOptions,
 org.apache.flink.api.connector.source.Boundedness boundedness,
 int numSplits,
 @Nullable
 FlinkSource.TimestampExtractor<WindowedValue<T>> timestampExtractor)

Method Details

createReader

public org.apache.flink.api.connector.source.SourceReader<WindowedValue<T>,FlinkSourceSplit<T>> createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)
                                                                                                      throws Exception

Throws:

Exception