org.apache.beam.runners.spark.structuredstreaming.translation.batch.functions

Class CachedSideInputReader

java.lang.Object

org.apache.beam.runners.spark.structuredstreaming.translation.batch.functions.CachedSideInputReader

All Implemented Interfaces:

org.apache.beam.runners.core.SideInputReader

@Internal
public class CachedSideInputReader
extends java.lang.Object
implements org.apache.beam.runners.core.SideInputReader

SideInputReader that caches results for costly Materializations. Concurrent access is not expected, but it won't impact correctness.

Method Summary

Modifier and Type	Method and Description
<T> boolean	contains(PCollectionView<T> view)
<T> T	get(PCollectionView<T> view, BoundedWindow window)
boolean	isEmpty()
static org.apache.beam.runners.core.SideInputReader	of(org.apache.beam.runners.core.SideInputReader reader, java.util.Collection<PCollectionView<?>> views) Creates a SideInputReader that caches results for costly Materializations if present, otherwise the SideInputReader is returned as is.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

of

public static org.apache.beam.runners.core.SideInputReader of(org.apache.beam.runners.core.SideInputReader reader,
                                                              java.util.Collection<PCollectionView<?>> views)

Creates a SideInputReader that caches results for costly Materializations if present, otherwise the SideInputReader is returned as is. Concurrent access is not expected, but it won't impact correctness.

get

public <T> T get(PCollectionView<T> view,
                 BoundedWindow window)

Specified by:

get in interface org.apache.beam.runners.core.SideInputReader

contains

public <T> boolean contains(PCollectionView<T> view)

Specified by:

contains in interface org.apache.beam.runners.core.SideInputReader

isEmpty

public boolean isEmpty()

Specified by:

isEmpty in interface org.apache.beam.runners.core.SideInputReader