org.apache.beam.runners.spark.structuredstreaming.translation.helpers

Class WindowingHelpers

java.lang.Object

org.apache.beam.runners.spark.structuredstreaming.translation.helpers.WindowingHelpers

public final class WindowingHelpers
extends java.lang.Object

Helper functions for working with windows.

Constructor Summary

Constructors

Constructor and Description
WindowingHelpers()

Method Summary

Modifier and Type	Method and Description
static <T,W extends BoundedWindow> org.apache.spark.api.java.function.MapFunction<org.apache.beam.sdk.util.WindowedValue<T>,org.apache.beam.sdk.util.WindowedValue<T>>	assignWindowsMapFunction(WindowFn<T,W> windowFn)
static <T,W extends BoundedWindow> boolean	skipAssignWindows(Window.Assign<T> transform, AbstractTranslationContext context) Checks if the window transformation should be applied or skipped.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WindowingHelpers

public WindowingHelpers()

Method Detail

skipAssignWindows

public static <T,W extends BoundedWindow> boolean skipAssignWindows(Window.Assign<T> transform,
                                                                    AbstractTranslationContext context)

Checks if the window transformation should be applied or skipped.

Avoid running assign windows if both source and destination are global window or if the user has not specified the WindowFn (meaning they are just messing with triggering or allowed lateness).

assignWindowsMapFunction

public static <T,W extends BoundedWindow> org.apache.spark.api.java.function.MapFunction<org.apache.beam.sdk.util.WindowedValue<T>,org.apache.beam.sdk.util.WindowedValue<T>> assignWindowsMapFunction(WindowFn<T,W> windowFn)