org.apache.beam.sdk.io.gcp.testing

Class FakeDatasetService

java.lang.Object

org.apache.beam.sdk.io.gcp.testing.FakeDatasetService

All Implemented Interfaces:

java.io.Serializable, BigQueryServices.DatasetService

@Internal
public class FakeDatasetService
extends java.lang.Object
implements BigQueryServices.DatasetService, java.io.Serializable

A fake dataset service that can be serialized, for use in testReadFromTable.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
FakeDatasetService()

Method Summary

Modifier and Type	Method and Description
void	createDataset(java.lang.String projectId, java.lang.String datasetId, java.lang.String location, java.lang.String description, java.lang.Long defaultTableExpirationMs) Create a Dataset with the given location, description and default expiration time for tables in the dataset (if null, tables don't expire).
void	createTable(Table table) Creates the specified table if it does not exist.
void	deleteDataset(java.lang.String projectId, java.lang.String datasetId) Deletes the dataset specified by the datasetId value.
void	deleteTable(TableReference tableRef) Deletes the table specified by tableId from the dataset.
void	failOnInsert(java.util.Map<TableRow,java.util.List<TableDataInsertAllResponse.InsertErrors>> insertErrors) Cause a given TableRow object to fail when it's inserted.
java.util.List<java.lang.String>	getAllIds(java.lang.String projectId, java.lang.String datasetId, java.lang.String tableId)
java.util.List<TableRow>	getAllRows(java.lang.String projectId, java.lang.String datasetId, java.lang.String tableId)
Dataset	getDataset(java.lang.String projectId, java.lang.String datasetId) Gets the specified Dataset resource by dataset ID.
Table	getTable(TableReference tableRef) Gets the specified Table resource by table ID.
Table	getTable(TableReference tableRef, @Nullable java.util.List<java.lang.String> selectedFields)
<T> long	insertAll(TableReference ref, java.util.List<FailsafeValueInSingleWindow<TableRow,TableRow>> rowList, @Nullable java.util.List<java.lang.String> insertIdList, InsertRetryPolicy retryPolicy, java.util.List<ValueInSingleWindow<T>> failedInserts, ErrorContainer<T> errorContainer, boolean skipInvalidRows, boolean ignoreUnknownValues, boolean ignoreInsertIds) Inserts TableRows with the specified insertIds if not null.
long	insertAll(TableReference ref, java.util.List<TableRow> rowList, @Nullable java.util.List<java.lang.String> insertIdList)
boolean	isTableEmpty(TableReference tableRef) Returns true if the table is empty.
Table	patchTableDescription(TableReference tableReference, @Nullable java.lang.String tableDescription) Patch BigQuery Table description.
static void	setUp()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FakeDatasetService

public FakeDatasetService()

Method Detail

setUp

public static void setUp()

getTable

public Table getTable(TableReference tableRef)
               throws java.lang.InterruptedException,
                      java.io.IOException

Description copied from interface: BigQueryServices.DatasetService

Gets the specified Table resource by table ID.

Returns null if the table is not found.

Specified by:

getTable in interface BigQueryServices.DatasetService

Throws:

java.lang.InterruptedException

java.io.IOException

getTable

public Table getTable(TableReference tableRef,
                      @Nullable java.util.List<java.lang.String> selectedFields)
               throws java.lang.InterruptedException,
                      java.io.IOException

Specified by:

getTable in interface BigQueryServices.DatasetService

Throws:

java.lang.InterruptedException

java.io.IOException

getAllRows

public java.util.List<TableRow> getAllRows(java.lang.String projectId,
                                           java.lang.String datasetId,
                                           java.lang.String tableId)
                                    throws java.lang.InterruptedException,
                                           java.io.IOException

Throws:

java.lang.InterruptedException

java.io.IOException

getAllIds

public java.util.List<java.lang.String> getAllIds(java.lang.String projectId,
                                                  java.lang.String datasetId,
                                                  java.lang.String tableId)
                                           throws java.lang.InterruptedException,
                                                  java.io.IOException

Throws:

java.lang.InterruptedException

java.io.IOException

deleteTable

public void deleteTable(TableReference tableRef)
                 throws java.io.IOException,
                        java.lang.InterruptedException

Description copied from interface: BigQueryServices.DatasetService

Deletes the table specified by tableId from the dataset. If the table contains data, all the data will be deleted.

Specified by:

deleteTable in interface BigQueryServices.DatasetService

Throws:

java.io.IOException

java.lang.InterruptedException

createTable

public void createTable(Table table)
                 throws java.io.IOException

Description copied from interface: BigQueryServices.DatasetService

Creates the specified table if it does not exist.

Specified by:

createTable in interface BigQueryServices.DatasetService

Throws:

java.io.IOException

isTableEmpty

public boolean isTableEmpty(TableReference tableRef)
                     throws java.io.IOException,
                            java.lang.InterruptedException

Description copied from interface: BigQueryServices.DatasetService

Returns true if the table is empty.

Specified by:

isTableEmpty in interface BigQueryServices.DatasetService

Throws:

java.io.IOException - if the table is not found.

java.lang.InterruptedException

getDataset

public Dataset getDataset(java.lang.String projectId,
                          java.lang.String datasetId)
                   throws java.io.IOException,
                          java.lang.InterruptedException

Description copied from interface: BigQueryServices.DatasetService

Gets the specified Dataset resource by dataset ID.

Specified by:

getDataset in interface BigQueryServices.DatasetService

Throws:

java.io.IOException

java.lang.InterruptedException

createDataset

public void createDataset(java.lang.String projectId,
                          java.lang.String datasetId,
                          java.lang.String location,
                          java.lang.String description,
                          java.lang.Long defaultTableExpirationMs)
                   throws java.io.IOException,
                          java.lang.InterruptedException

Description copied from interface: BigQueryServices.DatasetService

Create a Dataset with the given location, description and default expiration time for tables in the dataset (if null, tables don't expire).

Specified by:

createDataset in interface BigQueryServices.DatasetService

Throws:

java.io.IOException

java.lang.InterruptedException

deleteDataset

public void deleteDataset(java.lang.String projectId,
                          java.lang.String datasetId)
                   throws java.io.IOException,
                          java.lang.InterruptedException

Description copied from interface: BigQueryServices.DatasetService

Deletes the dataset specified by the datasetId value.

Before you can delete a dataset, you must delete all its tables.

Specified by:

deleteDataset in interface BigQueryServices.DatasetService

Throws:

java.io.IOException

java.lang.InterruptedException

insertAll

public long insertAll(TableReference ref,
                      java.util.List<TableRow> rowList,
                      @Nullable java.util.List<java.lang.String> insertIdList)
               throws java.io.IOException,
                      java.lang.InterruptedException

Throws:

java.io.IOException

java.lang.InterruptedException

insertAll

public <T> long insertAll(TableReference ref,
                          java.util.List<FailsafeValueInSingleWindow<TableRow,TableRow>> rowList,
                          @Nullable java.util.List<java.lang.String> insertIdList,
                          InsertRetryPolicy retryPolicy,
                          java.util.List<ValueInSingleWindow<T>> failedInserts,
                          ErrorContainer<T> errorContainer,
                          boolean skipInvalidRows,
                          boolean ignoreUnknownValues,
                          boolean ignoreInsertIds)
                   throws java.io.IOException,
                          java.lang.InterruptedException

Description copied from interface: BigQueryServices.DatasetService

Inserts TableRows with the specified insertIds if not null.

If any insert fail permanently according to the retry policy, those rows are added to failedInserts.

Returns the total bytes count of TableRows.

Specified by:

insertAll in interface BigQueryServices.DatasetService

Throws:

java.io.IOException

java.lang.InterruptedException

patchTableDescription

public Table patchTableDescription(TableReference tableReference,
                                   @Nullable java.lang.String tableDescription)
                            throws java.io.IOException,
                                   java.lang.InterruptedException

Description copied from interface: BigQueryServices.DatasetService

Patch BigQuery Table description.

Specified by:

patchTableDescription in interface BigQueryServices.DatasetService

Throws:

java.io.IOException

java.lang.InterruptedException

failOnInsert

public void failOnInsert(java.util.Map<TableRow,java.util.List<TableDataInsertAllResponse.InsertErrors>> insertErrors)

Cause a given TableRow object to fail when it's inserted. The errors link the list will be returned on subsequent retries, and the insert will succeed when the errors run out.