org.apache.beam.it.gcp.dataflow

Class DefaultPipelineLauncher

java.lang.Object

org.apache.beam.it.gcp.dataflow.AbstractPipelineLauncher

org.apache.beam.it.gcp.dataflow.DefaultPipelineLauncher

All Implemented Interfaces:

org.apache.beam.it.common.PipelineLauncher

public class DefaultPipelineLauncher
extends AbstractPipelineLauncher

Default class for implementation of PipelineLauncher interface.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DefaultPipelineLauncher.Builder Builder for DefaultPipelineLauncher.

Nested classes/interfaces inherited from interface org.apache.beam.it.common.PipelineLauncher

org.apache.beam.it.common.PipelineLauncher.JobState, org.apache.beam.it.common.PipelineLauncher.LaunchConfig, org.apache.beam.it.common.PipelineLauncher.LaunchInfo, org.apache.beam.it.common.PipelineLauncher.Sdk

Field Summary

Fields inherited from class org.apache.beam.it.gcp.dataflow.AbstractPipelineLauncher

client, launchedJobs, LEGACY_RUNNER, PARAM_JOB_ID, PARAM_JOB_TYPE, PARAM_RUNNER, RUNNER_V2

Method Summary

Modifier and Type	Method and Description
static DefaultPipelineLauncher.Builder	builder(com.google.auth.Credentials credentials)
Job	cancelJob(java.lang.String project, java.lang.String region, java.lang.String jobId)
Job	drainJob(java.lang.String project, java.lang.String region, java.lang.String jobId)
java.lang.Long	getBeamMetric(java.lang.String jobId, IOLoadTestBase.PipelineMetricsType metricType, java.lang.String metricName) Pull Beam pipeline defined metrics given the jobId.
Job	getJob(java.lang.String project, java.lang.String region, java.lang.String jobId)
protected org.apache.beam.it.common.PipelineLauncher.LaunchInfo.Builder	getJobInfoBuilder(org.apache.beam.it.common.PipelineLauncher.LaunchConfig options, org.apache.beam.it.common.PipelineLauncher.JobState state, Job job) Creates a JobInfo builder object from the provided parameters, enable derived class to add info incrementally.
org.apache.beam.it.common.PipelineLauncher.JobState	getJobStatus(java.lang.String project, java.lang.String region, java.lang.String jobId)
java.lang.Double	getMetric(java.lang.String project, java.lang.String region, java.lang.String jobId, java.lang.String metricName)
java.util.Map<java.lang.String,java.lang.Double>	getMetrics(java.lang.String project, java.lang.String region, java.lang.String jobId)
org.apache.beam.it.common.PipelineLauncher.LaunchInfo	launch(java.lang.String project, java.lang.String region, org.apache.beam.it.common.PipelineLauncher.LaunchConfig options)

Methods inherited from class org.apache.beam.it.gcp.dataflow.AbstractPipelineLauncher

cleanupAll, getJob, getJobInfo, handleJobState, listMessages, printJobResponse, waitUntilActive

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

builder

public static DefaultPipelineLauncher.Builder builder(com.google.auth.Credentials credentials)

getJobStatus

public org.apache.beam.it.common.PipelineLauncher.JobState getJobStatus(java.lang.String project,
                                                                        java.lang.String region,
                                                                        java.lang.String jobId)
                                                                 throws java.io.IOException

Specified by:

getJobStatus in interface org.apache.beam.it.common.PipelineLauncher

Overrides:

getJobStatus in class AbstractPipelineLauncher

Throws:

java.io.IOException

cancelJob

public Job cancelJob(java.lang.String project,
                     java.lang.String region,
                     java.lang.String jobId)

Specified by:

cancelJob in interface org.apache.beam.it.common.PipelineLauncher

Overrides:

cancelJob in class AbstractPipelineLauncher

getJob

public Job getJob(java.lang.String project,
                  java.lang.String region,
                  java.lang.String jobId)
           throws java.io.IOException

Specified by:

getJob in interface org.apache.beam.it.common.PipelineLauncher

Overrides:

getJob in class AbstractPipelineLauncher

Throws:

java.io.IOException

drainJob

public Job drainJob(java.lang.String project,
                    java.lang.String region,
                    java.lang.String jobId)

Specified by:

drainJob in interface org.apache.beam.it.common.PipelineLauncher

Overrides:

drainJob in class AbstractPipelineLauncher

getBeamMetric

public java.lang.Long getBeamMetric(java.lang.String jobId,
                                    IOLoadTestBase.PipelineMetricsType metricType,
                                    java.lang.String metricName)

Pull Beam pipeline defined metrics given the jobId.

getMetric

public java.lang.Double getMetric(java.lang.String project,
                                  java.lang.String region,
                                  java.lang.String jobId,
                                  java.lang.String metricName)
                           throws java.io.IOException

Specified by:

getMetric in interface org.apache.beam.it.common.PipelineLauncher

Overrides:

getMetric in class AbstractPipelineLauncher

Throws:

java.io.IOException

getMetrics

public java.util.Map<java.lang.String,java.lang.Double> getMetrics(java.lang.String project,
                                                                   java.lang.String region,
                                                                   java.lang.String jobId)
                                                            throws java.io.IOException

Specified by:

getMetrics in interface org.apache.beam.it.common.PipelineLauncher

Overrides:

getMetrics in class AbstractPipelineLauncher

Throws:

java.io.IOException

launch

public org.apache.beam.it.common.PipelineLauncher.LaunchInfo launch(java.lang.String project,
                                                                    java.lang.String region,
                                                                    org.apache.beam.it.common.PipelineLauncher.LaunchConfig options)
                                                             throws java.io.IOException

Throws:

java.io.IOException

getJobInfoBuilder

protected org.apache.beam.it.common.PipelineLauncher.LaunchInfo.Builder getJobInfoBuilder(org.apache.beam.it.common.PipelineLauncher.LaunchConfig options,
                                                                                          org.apache.beam.it.common.PipelineLauncher.JobState state,
                                                                                          Job job)

Description copied from class: AbstractPipelineLauncher

Creates a JobInfo builder object from the provided parameters, enable derived class to add info incrementally.

Overrides:

getJobInfoBuilder in class AbstractPipelineLauncher