java.lang.Object
org.apache.beam.runners.spark.structuredstreaming.translation.batch.functions.CachedSideInputReader
All Implemented Interfaces:
org.apache.beam.runners.core.SideInputReader

@Internal public class CachedSideInputReader extends Object implements org.apache.beam.runners.core.SideInputReader
SideInputReader that caches results for costly Materializations. Concurrent access is not expected, but it won't impact correctness.
  • Method Details

    • of

      public static org.apache.beam.runners.core.SideInputReader of(org.apache.beam.runners.core.SideInputReader reader, Collection<PCollectionView<?>> views)
      Creates a SideInputReader that caches results for costly Materializations if present, otherwise the SideInputReader is returned as is. Concurrent access is not expected, but it won't impact correctness.
    • get

      public <T> @Nullable T get(PCollectionView<T> view, BoundedWindow window)
      Specified by:
      get in interface org.apache.beam.runners.core.SideInputReader
    • contains

      public <T> boolean contains(PCollectionView<T> view)
      Specified by:
      contains in interface org.apache.beam.runners.core.SideInputReader
    • isEmpty

      public boolean isEmpty()
      Specified by:
      isEmpty in interface org.apache.beam.runners.core.SideInputReader