Package org.apache.beam.runners.spark.structuredstreaming.translation.batch

Internal utilities to translate Beam pipelines to Spark batching.

See: Description

Class Summary

Class	Description
DatasetSourceBatch	This is a spark structured streaming DataSourceV2 implementation that wraps an BoundedSource.As Continuous streaming is tagged experimental in spark (no aggregation support + no exactly once guaranty), this class does no implement ContinuousReadSupport.
DoFnFunction<InputT,OutputT>	Encapsulates a DoFn inside a Spark MapPartitionsFunction.
PipelineTranslatorBatch	PipelineTranslator for executing a Pipeline in Spark in batch mode.

Package org.apache.beam.runners.spark.structuredstreaming.translation.batch Description

Internal utilities to translate Beam pipelines to Spark batching.