Apache Beam 2.42.0

We are happy to present the new 2.42.0 release of Beam. This release includes both improvements and new functionality. See the download page for this release.

For more information on changes in 2.42.0, check out the detailed release notes.

Highlights

  • Added support for stateful DoFns to the Go SDK.
  • Added support for Batched DoFns to the Python SDK.

New Features / Improvements

  • Added support for Zstd compression to the Python SDK.
  • Added support for Google Cloud Profiler to the Go SDK.
  • Added support for stateful DoFns to the Go SDK.

Breaking Changes

  • The Go SDK’s Row Coder now uses a different single-precision float encoding for float32 types to match Java’s behavior (#22629).

Bugfixes

  • Fixed Python cross-language JDBC IO Connector cannot read or write rows containing Timestamp type values 19817.

Known Issues

  • Go SDK doesn’t yet support Slowly Changing Side Input pattern (#23106)
  • See a full list of open issues that affect this version.

List of Contributors

According to git shortlog, the following people contributed to the 2.42.0 release. Thank you to all contributors!

Abirdcfly Ahmed Abualsaud Alexander Zhuravlev Alexey Inkin Alexey Romanenko Anand Inguva Andrej Galad Andrew Pilloud Andy Ye Balázs Németh Brian Hulette Bruno Volpato bulat safiullin bullet03 Chamikara Jayalath ChangyuLi28 Clément Guillaume Damon Danny McCormick Darkhan Nausharipov David Huntsperger dpcollins-google Evgeny Antyshev grufino Heejong Lee Ismaël Mejía Jack McCluskey johnjcasey Jonathan Shen Kenneth Knowles Ke Wu Kiley Sok Liam Miller-Cushon liferoad Lucas Nogueira Luke Cwik MakarkinSAkvelon Manit Gupta masahitojp Michael Hu Michel Davit Moritz Mack Naireen Hussain nancyxu123 Nikhil Nadig oborysevych Pablo Estrada Pranav Bhandari Rajat Bhatta Rebecca Szper Reuven Lax Ritesh Ghorse Robert Bradshaw Robert Burke Ryan Thompson Sam Whittle Sergey Pronin Shivam Shunsuke Otani Shunya Ueta Steven Niemitz Stuart Svetak Sundhar Valentyn Tymofieiev Vitaly Terentyev Vlad Vladislav Chunikhin Yichi Zhang Yi Hu Yixiao Shen