Package org.apache.beam.sdk.io.snowflake.services

Class SnowflakeBatchServiceConfig

java.lang.Object

org.apache.beam.sdk.io.snowflake.services.SnowflakeBatchServiceConfig

public class SnowflakeBatchServiceConfig
extends Object

Class for preparing configuration for batch write and read.

Constructor Summary

Constructors

Constructor	Description
SnowflakeBatchServiceConfig(SerializableFunction<Void,DataSource> dataSourceProviderFn, String database, String schema, String table, String query, String storageIntegrationName, String stagingBucketDir, String quotationMark)	Creating a batch configuration for reading.
SnowflakeBatchServiceConfig(SerializableFunction<Void,DataSource> dataSourceProviderFn, List<String> filesList, SnowflakeTableSchema tableSchema, String database, String schema, String table, String query, CreateDisposition createDisposition, WriteDisposition writeDisposition, String storageIntegrationName, String stagingBucketDir, String quotationMark)	Creating a batch configuration for writing.

Method Summary

Modifier and Type	Method	Description
CreateDisposition	getCreateDisposition()
String	getDatabase()	Getting a Snowflake database.
SerializableFunction<Void,DataSource>	getDataSourceProviderFn()	Getting a DataSource provider function for connection credentials.
List<String>	getFilesList()	Getting list of names of staged files.
String	getQuery()	Getting a query which can be source for reading.
String	getQuotationMark()	Getting a character that will surround String in staged CSV files.
String	getSchema()	Getting a schema of a Snowflake table.
String	getStagingBucketDir()	Getting directory where files are staged.
String	getStorageIntegrationName()	Getting Snowflake integration which is used in COPY statement.
String	getTable()	Getting a table as a source of reading or destination to write.
SnowflakeTableSchema	getTableSchema()
WriteDisposition	getWriteDisposition()	Getting disposition how write data to table, see: WriteDisposition.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

SnowflakeBatchServiceConfig

public SnowflakeBatchServiceConfig(SerializableFunction<Void,DataSource> dataSourceProviderFn,
 String database,
 String schema,
 String table,
 String query,
 String storageIntegrationName,
 String stagingBucketDir,
 String quotationMark)

Creating a batch configuration for reading.

SnowflakeBatchServiceConfig

public SnowflakeBatchServiceConfig(SerializableFunction<Void,DataSource> dataSourceProviderFn,
 List<String> filesList,
 SnowflakeTableSchema tableSchema,
 String database,
 String schema,
 String table,
 String query,
 CreateDisposition createDisposition,
 WriteDisposition writeDisposition,
 String storageIntegrationName,
 String stagingBucketDir,
 String quotationMark)

Creating a batch configuration for writing.

Method Details

getDataSourceProviderFn

public SerializableFunction<Void,DataSource> getDataSourceProviderFn()

Getting a DataSource provider function for connection credentials.

getTable

public String getTable()

Getting a table as a source of reading or destination to write.

getQuery

public String getQuery()

Getting a query which can be source for reading.

getStorageIntegrationName

public String getStorageIntegrationName()

Getting Snowflake integration which is used in COPY statement.

getStagingBucketDir

public String getStagingBucketDir()

Getting directory where files are staged.

getFilesList

public List<String> getFilesList()

Getting list of names of staged files.

getWriteDisposition

public WriteDisposition getWriteDisposition()

Getting disposition how write data to table, see: WriteDisposition.

getQuotationMark

public String getQuotationMark()

Getting a character that will surround String in staged CSV files.

getDatabase

public String getDatabase()

Getting a Snowflake database.

getSchema

public String getSchema()

Getting a schema of a Snowflake table.

getCreateDisposition

public CreateDisposition getCreateDisposition()

getTableSchema

public SnowflakeTableSchema getTableSchema()