Package org.apache.beam.runners.spark.structuredstreaming.translation.batch
package org.apache.beam.runners.spark.structuredstreaming.translation.batch
Internal utilities to translate Beam pipelines to Spark batching.
-
ClassDescriptionDoFnRunnerFactory<InT,
T> Factory to create aDoFnRunner.Translator for batch pipelines, the registry and the lookup live in the common base.Holds the translator registry shared by the batch and the streaming translator, and the registry lookup.StatefulTaskRunner<InT,T> Manages the task scoped lifecycle of a statefulDoFnRunnerand itsStepContext.A mutable step context that can rebind state and timers per key.