apache_beam.utils.histogram module

class apache_beam.utils.histogram.Histogram(bucket_type)

Bases: object

A histogram that supports estimated percentile with linear interpolation.

This class is considered experimental and may break or receive backwards- incompatible changes in future versions of the Apache Beam SDK.

clear()

copy()

combine(other)

record(*args)

total_count()

p99()

p90()

p50()

get_percentile_info()

get_linear_interpolation(percentile)

Calculate percentile estimation based on linear interpolation.

It first finds the bucket which includes the target percentile and projects the estimated point in the bucket by assuming all the elements in the bucket are uniformly distributed.

Parameters:percentile – The target percentile of the value returning from this method. Should be a floating point number greater than 0 and less than 1.

class apache_beam.utils.histogram.BucketType

Bases: object

range_from()

Lower bound of a starting bucket.

range_to()

Upper bound of an ending bucket.

num_buckets()

The number of buckets.

bucket_index(value)

Get the bucket array index for the given value.

bucket_size(index)

Get the bucket size for the given bucket array index.

accumulated_bucket_size(end_index)

Get the accumulated bucket size from bucket index 0 until endIndex.

Generally, this can be calculated as sigma(0 <= i < endIndex) getBucketSize(i). However, a child class could provide better optimized calculation.

class apache_beam.utils.histogram.LinearBucket(start, width, num_buckets)

Bases: apache_beam.utils.histogram.BucketType

Create a histogram with linear buckets.

Parameters:

• start – Lower bound of a starting bucket.
• width – Bucket width. Smaller width implies a better resolution for percentile estimation.
• num_buckets – The number of buckets. Upper bound of an ending bucket is defined by start + width * numBuckets.

range_from()

range_to()

num_buckets()

bucket_index(value)

bucket_size(index)

accumulated_bucket_size(end_index)