Package org.apache.beam.runners.flink.translation.functions

Class FlinkStatefulDoFnFunction<K,V,OutputT>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.api.common.functions.RichGroupReduceFunction<WindowedValue<KV<K,V>>,WindowedValue<RawUnionValue>>

org.apache.beam.runners.flink.translation.functions.FlinkStatefulDoFnFunction<K,V,OutputT>

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.GroupReduceFunction<WindowedValue<KV<K,V>>,WindowedValue<RawUnionValue>>, org.apache.flink.api.common.functions.RichFunction

public class FlinkStatefulDoFnFunction<K,V,OutputT>
extends org.apache.flink.api.common.functions.RichGroupReduceFunction<WindowedValue<KV<K,V>>,WindowedValue<RawUnionValue>>

A RichGroupReduceFunction for stateful ParDo in Flink Batch Runner.

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor

Description

FlinkStatefulDoFnFunction(DoFn<KV<K,V>,OutputT> dofn, String stepName, WindowingStrategy<?,?> windowingStrategy, Map<PCollectionView<?>,WindowingStrategy<?,?>> sideInputs, PipelineOptions pipelineOptions, Map<TupleTag<?>,Integer> outputMap, TupleTag<OutputT> mainOutputTag, Coder<KV<K,V>> inputCoder, Map<TupleTag<?>,Coder<?>> outputCoderMap, DoFnSchemaInformation doFnSchemaInformation, Map<String,PCollectionView<?>> sideInputMapping)

Method Summary

Modifier and Type	Method	Description
void	close()
void	open(org.apache.flink.configuration.Configuration parameters)
void	reduce(Iterable<WindowedValue<KV<K,V>>> values, org.apache.flink.util.Collector<WindowedValue<RawUnionValue>> out)

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

FlinkStatefulDoFnFunction

public FlinkStatefulDoFnFunction(DoFn<KV<K,V>,OutputT> dofn,
 String stepName,
 WindowingStrategy<?,?> windowingStrategy,
 Map<PCollectionView<?>,WindowingStrategy<?,?>> sideInputs,
 PipelineOptions pipelineOptions,
 Map<TupleTag<?>,Integer> outputMap,
 TupleTag<OutputT> mainOutputTag,
 Coder<KV<K,V>> inputCoder,
 Map<TupleTag<?>,Coder<?>> outputCoderMap,
 DoFnSchemaInformation doFnSchemaInformation,
 Map<String,PCollectionView<?>> sideInputMapping)

Method Details

reduce

public void reduce(Iterable<WindowedValue<KV<K,V>>> values,
 org.apache.flink.util.Collector<WindowedValue<RawUnionValue>> out)
            throws Exception

Specified by:

reduce in interface org.apache.flink.api.common.functions.GroupReduceFunction<K,V>

Specified by:

reduce in class org.apache.flink.api.common.functions.RichGroupReduceFunction<WindowedValue<KV<K,V>>,WindowedValue<RawUnionValue>>

Throws:

Exception

open

public void open(org.apache.flink.configuration.Configuration parameters)

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class org.apache.flink.api.common.functions.AbstractRichFunction

close

public void close()
           throws Exception

Specified by:

close in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

close in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception