org.apache.beam.it.gcp

Class IOLoadTestBase

java.lang.Object

org.apache.beam.it.gcp.LoadTestBase

org.apache.beam.it.gcp.IOLoadTestBase

Direct Known Subclasses:

IOStressTestBase

public class IOLoadTestBase
extends LoadTestBase

Base class for IO Load tests.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	IOLoadTestBase.CountingFn<T> A utility DoFn that counts elements passed through.
static class	IOLoadTestBase.PipelineMetricsType

Nested classes/interfaces inherited from class org.apache.beam.it.gcp.LoadTestBase

LoadTestBase.MetricsConfiguration

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	BEAM_METRICS_NAMESPACE Namespace for Beam provided pipeline metrics (set up by Metrics transform).
protected java.lang.String	tempBucketName

Fields inherited from class org.apache.beam.it.gcp.LoadTestBase

CREDENTIALS, CREDENTIALS_PROVIDER, monitoringClient, pipelineLauncher, pipelineOperator, project, region, testName, watcher

Constructor Summary

Constructors

Constructor and Description
IOLoadTestBase()

Method Summary

Modifier and Type	Method and Description
protected void	exportMetrics(org.apache.beam.it.common.PipelineLauncher.LaunchInfo launchInfo, LoadTestBase.MetricsConfiguration metricsConfig, boolean exportToInfluxDB, org.apache.beam.sdk.testutils.publishing.InfluxDBSettings influxDBSettings) Exports test metrics to InfluxDB or BigQuery depending on the configuration.
static java.lang.String	getBeamMetricsName(IOLoadTestBase.PipelineMetricsType metricstype, java.lang.String metricsName) Given a metrics name, return Beam metrics name.
org.apache.beam.it.common.PipelineLauncher	launcher()
void	setUpBase()
void	tearDownBase()

Methods inherited from class org.apache.beam.it.gcp.LoadTestBase

calculateAverage, createConfig, exportMetricsToBigQuery, getCpuUtilizationMetrics, getDataFreshnessMetrics, getMetrics, getMetrics, getMetrics, getMetrics, getSystemLatencyMetrics, getThroughputMetrics, getWorkerTimeInterval, setUp, setUpClass, tearDownLoadTestBase, waitForNumMessages

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

tempBucketName

protected java.lang.String tempBucketName

BEAM_METRICS_NAMESPACE

public static final java.lang.String BEAM_METRICS_NAMESPACE

Namespace for Beam provided pipeline metrics (set up by Metrics transform).

See Also:

Constant Field Values

Constructor Detail

IOLoadTestBase

public IOLoadTestBase()

Method Detail

setUpBase

public void setUpBase()

tearDownBase

public void tearDownBase()
                  throws java.io.IOException

Throws:

java.io.IOException

launcher

public org.apache.beam.it.common.PipelineLauncher launcher()

Specified by:

launcher in class LoadTestBase

getBeamMetricsName

public static java.lang.String getBeamMetricsName(IOLoadTestBase.PipelineMetricsType metricstype,
                                                  java.lang.String metricsName)

Given a metrics name, return Beam metrics name.

exportMetrics

protected void exportMetrics(org.apache.beam.it.common.PipelineLauncher.LaunchInfo launchInfo,
                             LoadTestBase.MetricsConfiguration metricsConfig,
                             boolean exportToInfluxDB,
                             org.apache.beam.sdk.testutils.publishing.InfluxDBSettings influxDBSettings)

Exports test metrics to InfluxDB or BigQuery depending on the configuration.