How do refinements relate?
| Discarding |
|---|
| Accumulating |
| Google Cloud Dataflow | Prism Local Runner | Apache Flink | Apache Spark (RDD/DStream based) | Apache Spark Structured Streaming (Dataset based) | Apache Samza | Apache Nemo | Hazelcast Jet | Twister2 | Python Direct FnRunner | Go Direct Runner |
|---|
Yes : fully supported | Yes : fully supported | Yes : fully supported | Yes : fully supported Spark streaming natively discards elements after firing. | Partially : fully supported in batch mode | Yes : fully supported | Yes : fully supported | Yes : fully supported | Yes : fully supported |
Yes : fully supported Requires that the accumulated pane fits in memory, after being passed through the combiner (if relevant) | Yes : fully supported | Yes : fully supported | No | No | Yes : fully supported | Yes : fully supported | Yes : fully supported | Yes : fully supported |
Last updated on 2025/11/03
Have you found everything you were looking for?
Was it all useful and clear? Is there anything that you would like to change? Let us know!