GroupIntoBatches

Pydoc

Batches the input into desired batch size.

Examples

In the following example, we create a pipeline with a PCollection of produce by season.

We use GroupIntoBatches to get fixed-sized batches for every key, which outputs a list of elements for every key.

Related transforms

For unkeyed data and dynamic batch sizes, one may want to use BatchElements.

Pydoc