Package org.apache.beam.runners.flink.translation.wrappers.streaming.io.source.unbounded

Class FlinkUnboundedSource<T>

java.lang.Object

org.apache.beam.runners.flink.translation.wrappers.streaming.io.source.FlinkSource<T,WindowedValue<ValueWithRecordId<T>>>

org.apache.beam.runners.flink.translation.wrappers.streaming.io.source.unbounded.FlinkUnboundedSource<T>

Type Parameters:

T - The output type of the wrapped Beam UnboundedSource.

All Implemented Interfaces:

Serializable, org.apache.flink.api.connector.source.Source<WindowedValue<ValueWithRecordId<T>>,FlinkSourceSplit<T>,Map<Integer,List<FlinkSourceSplit<T>>>>, org.apache.flink.api.connector.source.SourceReaderFactory<WindowedValue<ValueWithRecordId<T>>,FlinkSourceSplit<T>>

public class FlinkUnboundedSource<T>
extends FlinkSource<T,WindowedValue<ValueWithRecordId<T>>>

A Flink Source implementation that wraps a Beam UnboundedSource.

See Also:

• Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.runners.flink.translation.wrappers.streaming.io.source.FlinkSource

FlinkSource.TimestampExtractor<T>

Field Summary

Fields inherited from class org.apache.beam.runners.flink.translation.wrappers.streaming.io.source.FlinkSource

beamSource, boundedness, serializablePipelineOptions, stepName

Constructor Summary

Constructors

Constructor	Description
FlinkUnboundedSource(String stepName, UnboundedSource<T,?> beamSource, org.apache.beam.runners.core.construction.SerializablePipelineOptions serializablePipelineOptions, int numSplits)
FlinkUnboundedSource(String stepName, UnboundedSource<T,?> beamSource, org.apache.beam.runners.core.construction.SerializablePipelineOptions serializablePipelineOptions, int numSplits, FlinkSource.TimestampExtractor<WindowedValue<ValueWithRecordId<T>>> timestampExtractor)

Method Summary

Modifier and Type	Method	Description
org.apache.flink.api.connector.source.SourceReader<WindowedValue<ValueWithRecordId<T>>,FlinkSourceSplit<T>>	createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)

Methods inherited from class org.apache.beam.runners.flink.translation.wrappers.streaming.io.source.FlinkSource

bounded, boundedImpulse, createEnumerator, createEnumerator, getBoundedness, getEnumeratorCheckpointSerializer, getNumSplits, getSplitSerializer, restoreEnumerator, unbounded

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

FlinkUnboundedSource

public FlinkUnboundedSource(String stepName,
 UnboundedSource<T,?> beamSource,
 org.apache.beam.runners.core.construction.SerializablePipelineOptions serializablePipelineOptions,
 int numSplits)

FlinkUnboundedSource

public FlinkUnboundedSource(String stepName,
 UnboundedSource<T,?> beamSource,
 org.apache.beam.runners.core.construction.SerializablePipelineOptions serializablePipelineOptions,
 int numSplits,
 @Nullable
 FlinkSource.TimestampExtractor<WindowedValue<ValueWithRecordId<T>>> timestampExtractor)

Method Details

createReader

public org.apache.flink.api.connector.source.SourceReader<WindowedValue<ValueWithRecordId<T>>,FlinkSourceSplit<T>> createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)
                                                                                                                         throws Exception

Throws:

Exception