Package org.apache.beam.runners.flink.translation.functions
package org.apache.beam.runners.flink.translation.functions
Internal implementation of the Beam runner for Apache Flink.
-
ClassDescriptionAbstractFlinkCombineRunner<K,
InputT, AccumT, OutputT, W extends BoundedWindow> Abstract base for runners that execute aCombine.PerKey.AbstractFlinkCombineRunner.CompleteFlinkCombiner<K,InputT, AccumT, OutputT> AbstractFlinkCombineRunner.FinalFlinkCombiner<K,AccumT, OutputT> A final combiner that takes inAccumTand producesOutputT.AbstractFlinkCombineRunner.FlinkCombiner<K,InputT, AccumT, OutputT> Adapter interface that allows using aCombineFnBase.GlobalCombineFnto either produce theAccumTas output or to combine several accumulators into anOutputT.AbstractFlinkCombineRunner.PartialFlinkCombiner<K,InputT, AccumT> A partial combiner that takes inInputTand producesAccumT.FlinkAssignWindows<T,W extends BoundedWindow> FlinkFlatMapFunctionfor implementingWindow.Assign.FlinkDoFnFunction<InputT,OutputT> Encapsulates aDoFninside a FlinkRichMapPartitionFunction.Singleton class that contains oneExecutableStageContext.Factoryper job.FlinkExecutableStageFunction<InputT>Flink operator that passes its input DataSet through an SDK-executedExecutableStage.A Flink function that demultiplexes output from aFlinkExecutableStageFunction.ExplodeWindowedValuethat belongs to multiple windows into multiple "single window"values, so we can safely group elements by (K, W) tuples.A map function that outputs the input element without any change.FlinkMergingNonShuffleReduceFunction<K,InputT, AccumT, OutputT, W extends BoundedWindow> Special version ofFlinkReduceFunctionthat supports merging windows.AFlatMapFunctionfunction that filters out those elements that don't belong in this output.FlinkNonMergingReduceFunction<K,InputT> Reduce function for non-merging GBK implementation.AStepContextfor Flink Batch Runner execution.FlinkPartialReduceFunction<K,InputT, AccumT, W extends BoundedWindow> This is the first step for executing aCombine.PerKeyon Flink.FlinkReduceFunction<K,AccumT, OutputT, W extends BoundedWindow> This is the second part for executing aCombine.PerKeyon Flink, the second part isFlinkReduceFunction.ASideInputReaderfor the Flink Batch Runner.FlinkStatefulDoFnFunction<K,V, OutputT> ARichGroupReduceFunctionfor statefulParDoin Flink Batch Runner.HashingFlinkCombineRunner<K,InputT, AccumT, OutputT, W extends BoundedWindow> A Flink combine runner that builds a map of merged windows and produces output after seeing all input.Source function which sends a single global impulse to a downstream operator.SideInputInitializer<ViewT>BroadcastVariableInitializerthat initializes the broadcast input as aMapfrom window to side input.SingleWindowFlinkCombineRunner<K,InputT, AccumT, OutputT, W extends BoundedWindow> A Flink combine runner takes elements pre-grouped by window and produces output after seeing all input.SortingFlinkCombineRunner<K,InputT, AccumT, OutputT, W extends BoundedWindow> A Flink combine runner that first sorts the elements by window and then does one pass that merges windows and outputs results.