apache_beam.typehints.arrow_batching_microbenchmark module

A microbenchmark for pyarrow batch creation.

This microbenchmark exercises the PyarrowBatchConverter.produce_batch method for different batch sizes.

apache_beam.typehints.arrow_batching_microbenchmark.benchmark_produce_batch(size)[source]

apache_beam.typehints.arrow_batching_microbenchmark.run_benchmark(starting_point=1, num_runs=10, num_elements_step=300, verbose=True)[source]