See: Description
| Class | Description |
|---|---|
| DatasetSourceBatch |
This is a spark structured streaming
DataSourceV2 implementation that wraps an BoundedSource.As Continuous streaming is tagged experimental in spark (no aggregation support +
no exactly once guaranty), this class does no implement ContinuousReadSupport. |
| DoFnFunction<InputT,OutputT> |
Encapsulates a
DoFn inside a Spark MapPartitionsFunction. |
| ImpulseTranslatorBatch | |
| PipelineTranslatorBatch |
PipelineTranslator for executing a Pipeline in Spark in batch mode. |