Package org.apache.beam.sdk.io.gcp.testing

Class FakeDatasetService

java.lang.Object
org.apache.beam.sdk.io.gcp.testing.FakeDatasetService
All Implemented Interfaces:
Serializable, AutoCloseable, BigQueryServices.DatasetService, BigQueryServices.WriteStreamService
@Internal public class FakeDatasetService extends Object implements BigQueryServices.DatasetService, BigQueryServices.WriteStreamService, Serializable
A fake dataset service that can be serialized, for use in testReadFromTable.
See Also:

  • Nested Class Summary

    Nested classes/interfaces inherited from interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.DatasetService

    BigQueryServices.DatasetService.TableMetadataView

  • Constructor Summary

    Constructors
    Constructor
    Description
    FakeDatasetService()
     

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    close()
     
    com.google.api.core.ApiFuture<com.google.cloud.bigquery.storage.v1.BatchCommitWriteStreamsResponse>
    commitWriteStreams(String tableUrn, Iterable<String> writeStreamNames)
    Commit write streams of type PENDING.
    void
    createDataset(String projectId, String datasetId, String location, String description, Long defaultTableExpirationMs)
    Create a Dataset with the given location, description and default expiration time for tables in the dataset (if null, tables don't expire).
    void
    createTable(com.google.api.services.bigquery.model.Table table)
    Creates the specified table if it does not exist.
    com.google.cloud.bigquery.storage.v1.WriteStream
    createWriteStream(String tableUrn, com.google.cloud.bigquery.storage.v1.WriteStream.Type type)
    Create a Write Stream for use with the Storage Write API.
    void
    deleteDataset(String projectId, String datasetId)
    Deletes the dataset specified by the datasetId value.
    void
    deleteTable(com.google.api.services.bigquery.model.TableReference tableRef)
    Deletes the table specified by tableId from the dataset.
    void
    failOnInsert(Map<com.google.api.services.bigquery.model.TableRow,List<com.google.api.services.bigquery.model.TableDataInsertAllResponse.InsertErrors>> insertErrors)
    Cause a given TableRow object to fail when it's inserted.
    com.google.api.core.ApiFuture<com.google.cloud.bigquery.storage.v1.FinalizeWriteStreamResponse>
    finalizeWriteStream(String streamName)
    Finalize a write stream.
    com.google.api.core.ApiFuture<com.google.cloud.bigquery.storage.v1.FlushRowsResponse>
    flush(String streamName, long offset)
    Flush a given stream up to the given offset.
    List<String>
    getAllIds(String projectId, String datasetId, String tableId)
     
    List<com.google.api.services.bigquery.model.TableRow>
    getAllRows(com.google.api.services.bigquery.model.TableReference tableReference)
     
    List<com.google.api.services.bigquery.model.TableRow>
    getAllRows(String projectId, String datasetId, String tableId)
     
    com.google.api.services.bigquery.model.Dataset
    getDataset(String projectId, String datasetId)
    Gets the specified Dataset resource by dataset ID.
    int
    getInsertCount()
     
    BigQueryServices.StreamAppendClient
    getStreamAppendClient(String streamName, DescriptorProtos.DescriptorProto descriptor, boolean useConnectionPool, com.google.cloud.bigquery.storage.v1.AppendRowsRequest.MissingValueInterpretation missingValueInterpretation)
    Create an append client for a given Storage API write stream.
    com.google.api.services.bigquery.model.Table
    getTable(com.google.api.services.bigquery.model.TableReference tableRef)
    Gets the specified Table resource by table ID.
    com.google.api.services.bigquery.model.Table
    getTable(com.google.api.services.bigquery.model.TableReference tableRef, List<String> selectedFields)
     
    com.google.api.services.bigquery.model.Table
    getTable(com.google.api.services.bigquery.model.TableReference tableRef, List<String> selectedFields, BigQueryServices.DatasetService.TableMetadataView view)
     
    com.google.api.services.bigquery.model.Table
    getTableImpl(com.google.api.services.bigquery.model.TableReference tableRef, List<String> selectedFields, BigQueryServices.DatasetService.TableMetadataView view)
     
    com.google.cloud.bigquery.storage.v1.TableSchema
    getWriteStreamSchema(String streamName)
     
    long
    insertAll(com.google.api.services.bigquery.model.TableReference ref, List<com.google.api.services.bigquery.model.TableRow> rowList, List<String> insertIdList)
     
    <T> long
    insertAll(com.google.api.services.bigquery.model.TableReference ref, List<FailsafeValueInSingleWindow<com.google.api.services.bigquery.model.TableRow,com.google.api.services.bigquery.model.TableRow>> rowList, List<String> insertIdList, InsertRetryPolicy retryPolicy, List<ValueInSingleWindow<T>> failedInserts, ErrorContainer<T> errorContainer, boolean skipInvalidRows, boolean ignoreUnknownValues, boolean ignoreInsertIds, List<ValueInSingleWindow<com.google.api.services.bigquery.model.TableRow>> successfulRows)
    Inserts TableRows with the specified insertIds if not null.
    boolean
    isTableEmpty(com.google.api.services.bigquery.model.TableReference tableRef)
    Returns true if the table is empty.
    com.google.api.services.bigquery.model.Table
    patchTableDescription(com.google.api.services.bigquery.model.TableReference tableReference, String tableDescription)
    Patch BigQuery Table description.
    com.google.api.services.bigquery.model.Table
    patchTableSchema(com.google.api.services.bigquery.model.TableReference tableReference, com.google.api.services.bigquery.model.TableSchema newSchema)
     
    void
    setAppendRowsError(Throwable t)
     
    void
    setPrimaryKey(com.google.api.services.bigquery.model.TableReference tableReference, List<String> columns)
     
    void
    setShouldFailRow(Function<com.google.api.services.bigquery.model.TableRow,Boolean> shouldFailRow)
     
    static void
    setUp()
     
    void
    updateTableSchema(com.google.api.services.bigquery.model.TableReference tableReference, com.google.api.services.bigquery.model.TableSchema tableSchema)
     

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait