org.apache.beam.runners.spark.structuredstreaming.translation.batch.functions

Class GroupAlsoByWindowViaOutputBufferFn<K,InputT,W extends BoundedWindow>

java.lang.Object

org.apache.beam.runners.spark.structuredstreaming.translation.batch.functions.GroupAlsoByWindowViaOutputBufferFn<K,InputT,W>

All Implemented Interfaces:

java.io.Serializable, org.apache.spark.api.java.function.FlatMapFunction<KV<K,java.lang.Iterable<org.apache.beam.sdk.util.WindowedValue<InputT>>>,org.apache.beam.sdk.util.WindowedValue<KV<K,java.lang.Iterable<InputT>>>>

public class GroupAlsoByWindowViaOutputBufferFn<K,InputT,W extends BoundedWindow>
extends java.lang.Object
implements org.apache.spark.api.java.function.FlatMapFunction<KV<K,java.lang.Iterable<org.apache.beam.sdk.util.WindowedValue<InputT>>>,org.apache.beam.sdk.util.WindowedValue<KV<K,java.lang.Iterable<InputT>>>>

A FlatMap function that groups by windows in batch mode using ReduceFnRunner.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
GroupAlsoByWindowViaOutputBufferFn(WindowingStrategy<?,W> windowingStrategy, org.apache.beam.runners.core.StateInternalsFactory<K> stateInternalsFactory, org.apache.beam.runners.core.SystemReduceFn<K,InputT,java.lang.Iterable<InputT>,java.lang.Iterable<InputT>,W> reduceFn, org.apache.beam.runners.core.construction.SerializablePipelineOptions options)

Method Summary

Modifier and Type	Method and Description
java.util.Iterator<org.apache.beam.sdk.util.WindowedValue<KV<K,java.lang.Iterable<InputT>>>>	call(KV<K,java.lang.Iterable<org.apache.beam.sdk.util.WindowedValue<InputT>>> kv)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GroupAlsoByWindowViaOutputBufferFn

public GroupAlsoByWindowViaOutputBufferFn(WindowingStrategy<?,W> windowingStrategy,
                                          org.apache.beam.runners.core.StateInternalsFactory<K> stateInternalsFactory,
                                          org.apache.beam.runners.core.SystemReduceFn<K,InputT,java.lang.Iterable<InputT>,java.lang.Iterable<InputT>,W> reduceFn,
                                          org.apache.beam.runners.core.construction.SerializablePipelineOptions options)

Method Detail

call

public java.util.Iterator<org.apache.beam.sdk.util.WindowedValue<KV<K,java.lang.Iterable<InputT>>>> call(KV<K,java.lang.Iterable<org.apache.beam.sdk.util.WindowedValue<InputT>>> kv)
                                                                                                  throws java.lang.Exception

Specified by:

call in interface org.apache.spark.api.java.function.FlatMapFunction<KV<K,java.lang.Iterable<org.apache.beam.sdk.util.WindowedValue<InputT>>>,org.apache.beam.sdk.util.WindowedValue<KV<K,java.lang.Iterable<InputT>>>>

Throws:

java.lang.Exception