org.apache.beam.sdk.io.snowflake.services

Class SnowflakeBatchServiceConfig

java.lang.Object

org.apache.beam.sdk.io.snowflake.services.SnowflakeBatchServiceConfig

public class SnowflakeBatchServiceConfig
extends java.lang.Object

Class for preparing configuration for batch write and read.

Constructor Summary

Constructors

Constructor and Description
SnowflakeBatchServiceConfig(SerializableFunction<java.lang.Void,javax.sql.DataSource> dataSourceProviderFn, java.util.List<java.lang.String> filesList, SnowflakeTableSchema tableSchema, java.lang.String database, java.lang.String schema, java.lang.String table, java.lang.String query, CreateDisposition createDisposition, WriteDisposition writeDisposition, java.lang.String storageIntegrationName, java.lang.String stagingBucketDir, java.lang.String quotationMark) Creating a batch configuration for writing.
SnowflakeBatchServiceConfig(SerializableFunction<java.lang.Void,javax.sql.DataSource> dataSourceProviderFn, java.lang.String database, java.lang.String schema, java.lang.String table, java.lang.String query, java.lang.String storageIntegrationName, java.lang.String stagingBucketDir, java.lang.String quotationMark) Creating a batch configuration for reading.

Method Summary

Modifier and Type	Method and Description
CreateDisposition	getCreateDisposition()
java.lang.String	getDatabase() Getting a Snowflake database.
SerializableFunction<java.lang.Void,javax.sql.DataSource>	getDataSourceProviderFn() Getting a DataSource provider function for connection credentials.
java.util.List<java.lang.String>	getFilesList() Getting list of names of staged files.
java.lang.String	getQuery() Getting a query which can be source for reading.
java.lang.String	getQuotationMark() Getting a character that will surround String in staged CSV files.
java.lang.String	getSchema() Getting a schema of a Snowflake table.
java.lang.String	getStagingBucketDir() Getting directory where files are staged.
java.lang.String	getStorageIntegrationName() Getting Snowflake integration which is used in COPY statement.
java.lang.String	getTable() Getting a table as a source of reading or destination to write.
SnowflakeTableSchema	getTableSchema()
WriteDisposition	getWriteDisposition() Getting disposition how write data to table, see: WriteDisposition.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SnowflakeBatchServiceConfig

public SnowflakeBatchServiceConfig(SerializableFunction<java.lang.Void,javax.sql.DataSource> dataSourceProviderFn,
                                   java.lang.String database,
                                   java.lang.String schema,
                                   java.lang.String table,
                                   java.lang.String query,
                                   java.lang.String storageIntegrationName,
                                   java.lang.String stagingBucketDir,
                                   java.lang.String quotationMark)

Creating a batch configuration for reading.

SnowflakeBatchServiceConfig

public SnowflakeBatchServiceConfig(SerializableFunction<java.lang.Void,javax.sql.DataSource> dataSourceProviderFn,
                                   java.util.List<java.lang.String> filesList,
                                   SnowflakeTableSchema tableSchema,
                                   java.lang.String database,
                                   java.lang.String schema,
                                   java.lang.String table,
                                   java.lang.String query,
                                   CreateDisposition createDisposition,
                                   WriteDisposition writeDisposition,
                                   java.lang.String storageIntegrationName,
                                   java.lang.String stagingBucketDir,
                                   java.lang.String quotationMark)

Creating a batch configuration for writing.

Method Detail

getDataSourceProviderFn

public SerializableFunction<java.lang.Void,javax.sql.DataSource> getDataSourceProviderFn()

Getting a DataSource provider function for connection credentials.

getTable

public java.lang.String getTable()

Getting a table as a source of reading or destination to write.

getQuery

public java.lang.String getQuery()

Getting a query which can be source for reading.

getStorageIntegrationName

public java.lang.String getStorageIntegrationName()

Getting Snowflake integration which is used in COPY statement.

getStagingBucketDir

public java.lang.String getStagingBucketDir()

Getting directory where files are staged.

getFilesList

public java.util.List<java.lang.String> getFilesList()

Getting list of names of staged files.

getWriteDisposition

public WriteDisposition getWriteDisposition()

Getting disposition how write data to table, see: WriteDisposition.

getQuotationMark

public java.lang.String getQuotationMark()

Getting a character that will surround String in staged CSV files.

getDatabase

public java.lang.String getDatabase()

Getting a Snowflake database.

getSchema

public java.lang.String getSchema()

Getting a schema of a Snowflake table.

getCreateDisposition

public CreateDisposition getCreateDisposition()

getTableSchema

public SnowflakeTableSchema getTableSchema()