Unbounded Splittable DoFn Support Status
| Google Cloud Dataflow | Prism Local Runner | Apache Flink | Apache Spark (RDD/DStream based) | Apache Spark Structured Streaming (Dataset based) | Hazelcast Jet | Kafka Streams (experimental, not released) | Twister2 | Python Direct FnRunner | |
|---|---|---|---|---|---|---|---|---|---|
| Base | Yes : | Yes : fully supported | Yes : | : | : | : | : | Yes : | No : not implemented |
| Side Inputs | Yes : fully supported | Yes : fully supported | Partially : Only portable Flink Runner supports this. | : | : | : | : | : | No : not implemented |
| Splittable DoFn Initiated Checkpointing | Yes : | Yes : fully supported | Yes : | : | : | : | : | Yes : | No : not implemented |
| Dynamic Splitting | No : | Yes : fully supported | No : | : | : | : | : | No : | No : not implemented |
| Bundle Finalization | Partially : Only Dataflow Runner V2 supports this. | Yes : fully supported | Partially : Only portable Flink Runner supports this with checkpointing enabled. | : | : | : | : | Yes : | No : not implemented |
Last updated on 2026/09/22
Have you found everything you were looking for?
Was it all useful and clear? Is there anything that you would like to change? Let us know!