Package org.apache.beam.runners.spark.structuredstreaming.io.streaming

package org.apache.beam.runners.spark.structuredstreaming.io.streaming

Related Packages

Package	Description
org.apache.beam.runners.spark.structuredstreaming.io	Spark-specific transforms for I/O.

Classes

Class	Description
BeamReaderCache	Executor side cache of live Beam UnboundedSource.UnboundedReaders keyed by checkpoint location and split.
BeamReaderCache.CachedReader<T>	A live reader with the epoch it is positioned at and the coded mark taken there.
BeamSourceCheckpoint	Durable state of one Beam unbounded source under the per source checkpoint location Spark hands to toMicroBatchStream.
UnboundedSourceDataset	Translator facing entry point turning a Beam UnboundedSource into a streaming Spark Dataset of rows, with the DataSourceV2 micro-batch glue as nested classes.