Package org.apache.beam.sdk.io.gcp.testing

Class FakeJobService

java.lang.Object

org.apache.beam.sdk.io.gcp.testing.FakeJobService

All Implemented Interfaces:

Serializable, AutoCloseable, BigQueryServices.JobService

@Internal
public class FakeJobService
extends Object
implements BigQueryServices.JobService, Serializable

A fake implementation of BigQuery's job service.

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
FakeJobService()
FakeJobService(int numFailures)

Method Summary

Modifier and Type	Method	Description
void	close()
JobStatistics	dryRunQuery(String projectId, JobConfigurationQuery query, String location)	Dry runs the query in the given project.
void	expectDryRunQuery(String projectId, String query, JobStatistics result)
Collection<Job>	getAllJobs()
Job	getJob(JobReference jobRef)	Gets the specified Job by the given JobReference.
int	getNumExtractJobCalls()
Job	pollJob(JobReference jobRef, int maxAttempts)	Waits for the job is Done, and returns the job.
void	setNumFailuresExpected(int numFailuresExpected)
static void	setUp()
void	startCopyJob(JobReference jobRef, JobConfigurationTableCopy copyConfig)	Start a BigQuery copy job.
void	startExtractJob(JobReference jobRef, JobConfigurationExtract extractConfig)	Start a BigQuery extract job.
void	startLoadJob(JobReference jobRef, JobConfigurationLoad loadConfig)	Start a BigQuery load job.
void	startLoadJob(JobReference jobRef, JobConfigurationLoad loadConfig, com.google.api.client.http.AbstractInputStreamContent streamContent)	Start a BigQuery load job with stream content.
void	startQueryJob(JobReference jobRef, JobConfigurationQuery query)	Start a BigQuery query job.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

FakeJobService

public FakeJobService()

FakeJobService

public FakeJobService(int numFailures)

Method Details

close

public void close()
           throws Exception

Specified by:

close in interface AutoCloseable

Throws:

Exception

setNumFailuresExpected

public void setNumFailuresExpected(int numFailuresExpected)

setUp

public static void setUp()

startLoadJob

public void startLoadJob(JobReference jobRef,
 JobConfigurationLoad loadConfig)
                  throws IOException

Description copied from interface: BigQueryServices.JobService

Start a BigQuery load job.

Specified by:

startLoadJob in interface BigQueryServices.JobService

Throws:

IOException

startLoadJob

public void startLoadJob(JobReference jobRef,
 JobConfigurationLoad loadConfig,
 com.google.api.client.http.AbstractInputStreamContent streamContent)
                  throws InterruptedException,
IOException

Description copied from interface: BigQueryServices.JobService

Start a BigQuery load job with stream content.

Specified by:

startLoadJob in interface BigQueryServices.JobService

Throws:

InterruptedException

IOException

startExtractJob

public void startExtractJob(JobReference jobRef,
 JobConfigurationExtract extractConfig)
                     throws IOException

Description copied from interface: BigQueryServices.JobService

Start a BigQuery extract job.

Specified by:

startExtractJob in interface BigQueryServices.JobService

Throws:

IOException

getNumExtractJobCalls

public int getNumExtractJobCalls()

startQueryJob

public void startQueryJob(JobReference jobRef,
 JobConfigurationQuery query)

Description copied from interface: BigQueryServices.JobService

Start a BigQuery query job.

Specified by:

startQueryJob in interface BigQueryServices.JobService

startCopyJob

public void startCopyJob(JobReference jobRef,
 JobConfigurationTableCopy copyConfig)
                  throws IOException

Description copied from interface: BigQueryServices.JobService

Start a BigQuery copy job.

Specified by:

startCopyJob in interface BigQueryServices.JobService

Throws:

IOException

pollJob

public Job pollJob(JobReference jobRef,
 int maxAttempts)
            throws InterruptedException

Description copied from interface: BigQueryServices.JobService

Waits for the job is Done, and returns the job.

Returns null if the maxAttempts retries reached.

Specified by:

pollJob in interface BigQueryServices.JobService

Throws:

InterruptedException

expectDryRunQuery

public void expectDryRunQuery(String projectId,
 String query,
 JobStatistics result)

dryRunQuery

public JobStatistics dryRunQuery(String projectId,
 JobConfigurationQuery query,
 String location)

Description copied from interface: BigQueryServices.JobService

Dry runs the query in the given project.

Specified by:

dryRunQuery in interface BigQueryServices.JobService

getAllJobs

public Collection<Job> getAllJobs()

getJob

public Job getJob(JobReference jobRef)

Description copied from interface: BigQueryServices.JobService

Gets the specified Job by the given JobReference.

Returns null if the job is not found.

Specified by:

getJob in interface BigQueryServices.JobService