Apache Beam Roadmap

Apache Beam is not governed or steered by any one commercial entity, but by its Project Management Committee (PMC), so we do not have a roadmap in the sense of a plan with a specific timeline. Instead, we share our vision for the future and major initiatives receiving and attention and contribution that users can look forward to.

The major components of Beam each have their own roadmap which you can find via the menu. Below are some highlights for the project as a whole.

Portability Framework

Portability is the primary Beam vision: running pipelines authors with any SDK on any runner. This is a cross-cutting effort across Java, Python, and Go, and every Beam runner.

See the details on the Portability Roadmap

A major highlight of the portability effort is the effort in running Python pipelines the Flink runner.

You can follow the instructions to try it out

Go SDK

The Go SDK is the newest SDK, and is the first SDK built entirely on the portability framework. See the Go SDK’s Roadmap if this piques your interest.

Python 3 support

The Python SDK is near to supporting Python 3. See details on the Python SDK’s Roadmap. This is also a great opportunity for lightweight contribution!

Java 11 support

The Java SDK is eager to add support for Java’s first new LTS (Long Term Support) version. See details on the Java SDK’s Roadmap.

SQL

Beam’s SQL module is rapidly maturing to allow users to author batch and streaming pipelines using only SQL, but also to allow Beam Java developers to use SQL in components of their pipeline for added efficiency. See the Beam SQL Roadmap

Euphoria

Euphoria is Beam’s newest API, offering a high-level, fluent style for Beam Java developers. See the Euphoria API Roadmap.