back to collapsed details

Unbounded Splittable DoFn Support Status

Base
Side Inputs
Splittable DoFn Initiated Checkpointing
Dynamic Splitting
Bundle Finalization
Google Cloud DataflowApache FlinkApache Spark (RDD/DStream based)Apache Spark Structured Streaming (Dataset based)Apache SamzaApache NemoHazelcast JetTwister2Python Direct FnRunnerGo Direct Runner

Yes :


Partially :


Support is either incomplete or broken on portable Flink Runner (#19637)

:


:


:


:


:


:


Yes :


No :


Yes : fully supported


No :


:


:


:


:


:


:


:


Yes :


Yes :


Partially :


:


:


:


:


:


:


Yes :


No :


No :


No :


:


:


:


:


:


:


No :


No :


Partially : Only Dataflow Runner V2 supports this.


No :


:


:


:


:


:


:


Yes :


No :


Last updated on 2024/11/12

Have you found everything you were looking for?

Was it all useful and clear? Is there anything that you would like to change? Let us know!