org.apache.beam.runners.spark.util

Class SparkSideInputReader

java.lang.Object

org.apache.beam.runners.spark.util.SparkSideInputReader

All Implemented Interfaces:

org.apache.beam.runners.core.SideInputReader

public class SparkSideInputReader
extends java.lang.Object
implements org.apache.beam.runners.core.SideInputReader

A SideInputReader for the SparkRunner.

Constructor Summary

Constructors

Constructor and Description
SparkSideInputReader(java.util.Map<TupleTag<?>,KV<WindowingStrategy<?,?>,SideInputBroadcast<?>>> sideInputs)

Method Summary

Modifier and Type	Method and Description
<T> boolean	contains(PCollectionView<T> view) Returns true if the given PCollectionView is valid for this reader.
<T> T	get(PCollectionView<T> view, BoundedWindow window) Returns the value of the given PCollectionView for the given BoundedWindow.
boolean	isEmpty() Returns true if there are no side inputs in this reader.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkSideInputReader

public SparkSideInputReader(java.util.Map<TupleTag<?>,KV<WindowingStrategy<?,?>,SideInputBroadcast<?>>> sideInputs)

Method Detail

get

@Nullable
public <T> T get(PCollectionView<T> view,
                           BoundedWindow window)

Description copied from interface: org.apache.beam.runners.core.SideInputReader

Returns the value of the given PCollectionView for the given BoundedWindow.

It is valid for a side input to be null. It is not valid for this to return null for any other reason.

Specified by:

get in interface org.apache.beam.runners.core.SideInputReader

contains

public <T> boolean contains(PCollectionView<T> view)

Description copied from interface: org.apache.beam.runners.core.SideInputReader

Returns true if the given PCollectionView is valid for this reader.

Specified by:

contains in interface org.apache.beam.runners.core.SideInputReader

isEmpty

public boolean isEmpty()

Description copied from interface: org.apache.beam.runners.core.SideInputReader

Returns true if there are no side inputs in this reader.

Specified by:

isEmpty in interface org.apache.beam.runners.core.SideInputReader