org.apache.beam.sdk.io.snowflake.services

Class SnowflakeStreamingServiceConfig

java.lang.Object

org.apache.beam.sdk.io.snowflake.services.ServiceConfig

org.apache.beam.sdk.io.snowflake.services.SnowflakeStreamingServiceConfig

public class SnowflakeStreamingServiceConfig
extends ServiceConfig

Class for preparing configuration for streaming write.

Constructor Summary

Constructors

Constructor and Description
SnowflakeStreamingServiceConfig(java.util.List<java.lang.String> filesList, java.lang.String stagingBucketDir, net.snowflake.ingest.SimpleIngestManager ingestManager) Constructor to create configuration for streaming write.

Method Summary

Modifier and Type	Method and Description
java.util.List<java.lang.String>	getFilesList() Getter for a list of staged files which are will be loaded to Snowflake.
net.snowflake.ingest.SimpleIngestManager	getIngestManager() Getter for ingest manager which serves API to load data in streaming mode and retrieve a report about loaded data.
java.lang.String	getStagingBucketDir() Getter for a bucket name with directory where files were staged and waiting for loading.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SnowflakeStreamingServiceConfig

public SnowflakeStreamingServiceConfig(java.util.List<java.lang.String> filesList,
                                       java.lang.String stagingBucketDir,
                                       net.snowflake.ingest.SimpleIngestManager ingestManager)

Constructor to create configuration for streaming write.

Parameters:

filesList - list of strings of staged files' names.

stagingBucketDir - name of a bucket and directory inside where files are staged and awaits for being loaded to Snowflake.

ingestManager - instance of SimpleIngestManager.

Method Detail

getIngestManager

public net.snowflake.ingest.SimpleIngestManager getIngestManager()

Getter for ingest manager which serves API to load data in streaming mode and retrieve a report about loaded data.

Returns:

instance of SimpleIngestManager.

getFilesList

public java.util.List<java.lang.String> getFilesList()

Getter for a list of staged files which are will be loaded to Snowflake.

Returns:

list of strings of staged files' names.

getStagingBucketDir

public java.lang.String getStagingBucketDir()

Getter for a bucket name with directory where files were staged and waiting for loading.

Returns:

name of a bucket and directory inside in form gs://mybucket/dir/