org.apache.beam.runners.spark.structuredstreaming.translation.helpers

Class RowHelpers

java.lang.Object

org.apache.beam.runners.spark.structuredstreaming.translation.helpers.RowHelpers

public final class RowHelpers
extends java.lang.Object

Helper functions for working with Row.

Constructor Summary

Constructors

Constructor and Description
RowHelpers()

Method Summary

Modifier and Type	Method and Description
static <T> org.apache.spark.api.java.function.MapFunction<org.apache.spark.sql.Row,org.apache.beam.sdk.util.WindowedValue<T>>	extractWindowedValueFromRowMapFunction(org.apache.beam.sdk.util.WindowedValue.WindowedValueCoder<T> windowedValueCoder) A Spark MapFunction for extracting a WindowedValue from a Row in which the WindowedValue was serialized to bytes using its WindowedValue.WindowedValueCoder.
static <T> org.apache.spark.sql.catalyst.InternalRow	storeWindowedValueInRow(org.apache.beam.sdk.util.WindowedValue<T> windowedValue, Coder<T> coder) Serialize a windowedValue to bytes using windowedValueCoder WindowedValue.FullWindowedValueCoder and stores it an InternalRow.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RowHelpers

public RowHelpers()

Method Detail

extractWindowedValueFromRowMapFunction

public static <T> org.apache.spark.api.java.function.MapFunction<org.apache.spark.sql.Row,org.apache.beam.sdk.util.WindowedValue<T>> extractWindowedValueFromRowMapFunction(org.apache.beam.sdk.util.WindowedValue.WindowedValueCoder<T> windowedValueCoder)

A Spark MapFunction for extracting a WindowedValue from a Row in which the WindowedValue was serialized to bytes using its WindowedValue.WindowedValueCoder.

Type Parameters:

T - The type of the object.

Returns:

A MapFunction that accepts a Row and returns its WindowedValue.

storeWindowedValueInRow

public static <T> org.apache.spark.sql.catalyst.InternalRow storeWindowedValueInRow(org.apache.beam.sdk.util.WindowedValue<T> windowedValue,
                                                                                    Coder<T> coder)

Serialize a windowedValue to bytes using windowedValueCoder WindowedValue.FullWindowedValueCoder and stores it an InternalRow.