Package org.apache.beam.runners.flink.translation.wrappers.streaming.io.source

Class FlinkSourceSplitEnumerator<T>

java.lang.Object

org.apache.beam.runners.flink.translation.wrappers.streaming.io.source.FlinkSourceSplitEnumerator<T>

All Implemented Interfaces:

AutoCloseable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.api.connector.source.SplitEnumerator<FlinkSourceSplit<T>,FlinkSourceEnumeratorState<T>>

public class FlinkSourceSplitEnumerator<T>
extends Object
implements org.apache.flink.api.connector.source.SplitEnumerator<FlinkSourceSplit<T>,FlinkSourceEnumeratorState<T>>

Splits a Beam source and assigns its splits to Flink source readers round-robin.

Constructor Summary

Constructors

Constructor	Description
FlinkSourceSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FlinkSourceSplit<T>> context, Source<T> beamSource, PipelineOptions pipelineOptions, int numSplits)
FlinkSourceSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FlinkSourceSplit<T>> context, Source<T> beamSource, PipelineOptions pipelineOptions, int numSplits, FlinkSourceEnumeratorState<T> restoredState)

Method Summary

Modifier and Type	Method	Description
void	addReader(int subtaskId)
void	addSplitsBack(List<FlinkSourceSplit<T>> splits, int subtaskId)
void	close()
void	handleSplitRequest(int subtaskId, String requesterHostname)
FlinkSourceEnumeratorState<T>	snapshotState(long checkpointId)
void	start()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted

Methods inherited from interface org.apache.flink.api.connector.source.SplitEnumerator

handleSourceEvent, notifyCheckpointComplete

Constructor Details

FlinkSourceSplitEnumerator

public FlinkSourceSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FlinkSourceSplit<T>> context,
 Source<T> beamSource,
 PipelineOptions pipelineOptions,
 int numSplits)

FlinkSourceSplitEnumerator

public FlinkSourceSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FlinkSourceSplit<T>> context,
 Source<T> beamSource,
 PipelineOptions pipelineOptions,
 int numSplits,
 @Nullable
 FlinkSourceEnumeratorState<T> restoredState)

Method Details

start

public void start()

Specified by:

start in interface org.apache.flink.api.connector.source.SplitEnumerator<FlinkSourceSplit<T>,FlinkSourceEnumeratorState<T>>

handleSplitRequest

public void handleSplitRequest(int subtaskId,
 @Nullable
 String requesterHostname)

Specified by:

handleSplitRequest in interface org.apache.flink.api.connector.source.SplitEnumerator<FlinkSourceSplit<T>,FlinkSourceEnumeratorState<T>>

addSplitsBack

public void addSplitsBack(List<FlinkSourceSplit<T>> splits,
 int subtaskId)

Specified by:

addSplitsBack in interface org.apache.flink.api.connector.source.SplitEnumerator<FlinkSourceSplit<T>,FlinkSourceEnumeratorState<T>>

addReader

public void addReader(int subtaskId)

Specified by:

addReader in interface org.apache.flink.api.connector.source.SplitEnumerator<FlinkSourceSplit<T>,FlinkSourceEnumeratorState<T>>

snapshotState

public FlinkSourceEnumeratorState<T> snapshotState(long checkpointId)

Specified by:

snapshotState in interface org.apache.flink.api.connector.source.SplitEnumerator<FlinkSourceSplit<T>,FlinkSourceEnumeratorState<T>>

close

public void close()
           throws IOException

Specified by:

close in interface AutoCloseable

Specified by:

close in interface org.apache.flink.api.connector.source.SplitEnumerator<FlinkSourceSplit<T>,FlinkSourceEnumeratorState<T>>

Throws:

IOException