Beam SQL: Overview

Beam SQL allows a Beam user (currently only available in Beam Java) to query bounded and unbounded PCollections with SQL statements. Your SQL query is translated to a PTransform, an encapsulated segment of a Beam pipeline. You can freely mix SQL PTransforms and other PTransforms in your pipeline.

There are three main things you will need to know to use SQL in your pipeline:

The SQL pipeline walkthrough works through how you use these.