Reshuffle

Pydoc

Adds a temporary random key to each element in a collection, reshuffles these keys, and removes the temporary key. This redistributes the elements between workers and returns a collection equivalent to its input collection. This is most useful for adjusting parallelism or preventing coupled failures.

Examples

See Issue 19498 for updates.

Related transforms

N/A