Unbounded Splittable DoFn Support Status
Base |
---|
Side Inputs |
Splittable DoFn Initiated Checkpointing |
Dynamic Splitting |
Bundle Finalization |
Google Cloud Dataflow | Apache Flink | Apache Spark (RDD/DStream based) | Apache Spark Structured Streaming (Dataset based) | Apache Samza | Apache Nemo | Hazelcast Jet | Twister2 | Python Direct FnRunner | Go Direct Runner |
---|
Yes : | Partially : Support is either incomplete or broken on portable Flink Runner (#19637) | : | : | : | : | : | : | Yes : | No : |
Yes : fully supported | No : | : | : | : | : | : | : | : | Yes : |
Yes : | Partially : | : | : | : | : | : | : | Yes : | No : |
No : | No : | : | : | : | : | : | : | No : | No : |
Partially : Only Dataflow Runner V2 supports this. | No : | : | : | : | : | : | : | Yes : | No : |
Last updated on 2024/11/12
Have you found everything you were looking for?
Was it all useful and clear? Is there anything that you would like to change? Let us know!