apache_beam.runners.direct.direct_metrics module

DirectRunner implementation of MetricResults. It is in charge not only of responding to queries of current metrics, but also of keeping the common state consistent.

class apache_beam.runners.direct.direct_metrics.MetricAggregator

Bases: object

For internal use only; no backwards-compatibility guarantees.

Base interface for aggregating metric data during pipeline execution.

identity_element() → Any

Returns the identical element of an Aggregation.

For the identity element, it must hold that

Aggregator.combine(any_element, identity_element) == any_element.

combine(x: Any, y: Any) → Any

result(x: Any) → Any

class apache_beam.runners.direct.direct_metrics.CounterAggregator

Bases: MetricAggregator

For internal use only; no backwards-compatibility guarantees.

Aggregator for Counter metric data during pipeline execution.

Values aggregated should be int objects.

static identity_element() → int

combine(x: SupportsInt, y: SupportsInt) → int

result(x: SupportsInt) → int

class apache_beam.runners.direct.direct_metrics.GenericAggregator(data_class)

Bases: MetricAggregator

identity_element()

combine(x, y)

result(x)

class apache_beam.runners.direct.direct_metrics.DirectMetrics

Bases: MetricResults

commit_logical(bundle, updates)

commit_physical(bundle, updates)

update_physical(bundle, updates)

query(filter=None)

class apache_beam.runners.direct.direct_metrics.DirectMetric(aggregator)

Bases: object

Keeps a consistent state for a single metric.

It keeps track of the metric’s physical and logical updates. It’s thread safe.

commit_logical(bundle, update)

commit_physical(bundle, update)

update_physical(bundle, update)

extract_committed()

extract_latest_attempted()