Package org.apache.beam.sdk.io.snowflake.services

Class SnowflakeStreamingServiceConfig

java.lang.Object

org.apache.beam.sdk.io.snowflake.services.SnowflakeStreamingServiceConfig

public class SnowflakeStreamingServiceConfig
extends Object

Class for preparing configuration for streaming write.

Constructor Summary

Constructors

Constructor	Description
SnowflakeStreamingServiceConfig(List<String> filesList, String stagingBucketDir, net.snowflake.ingest.SimpleIngestManager ingestManager)	Constructor to create configuration for streaming write.

Method Summary

Modifier and Type	Method	Description
List<String>	getFilesList()	Getter for a list of staged files which are will be loaded to Snowflake.
net.snowflake.ingest.SimpleIngestManager	getIngestManager()	Getter for ingest manager which serves API to load data in streaming mode and retrieve a report about loaded data.
String	getStagingBucketDir()	Getter for a bucket name with directory where files were staged and waiting for loading.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

SnowflakeStreamingServiceConfig

public SnowflakeStreamingServiceConfig(List<String> filesList,
 String stagingBucketDir,
 net.snowflake.ingest.SimpleIngestManager ingestManager)

Constructor to create configuration for streaming write.

Parameters:

filesList - list of strings of staged files' names.

stagingBucketDir - name of a bucket and directory inside where files are staged and awaits for being loaded to Snowflake.

ingestManager - instance of SimpleIngestManager.

Method Details

getIngestManager

public net.snowflake.ingest.SimpleIngestManager getIngestManager()

Getter for ingest manager which serves API to load data in streaming mode and retrieve a report about loaded data.

Returns:

instance of SimpleIngestManager.

getFilesList

public List<String> getFilesList()

Getter for a list of staged files which are will be loaded to Snowflake.

Returns:

list of strings of staged files' names.

getStagingBucketDir

public String getStagingBucketDir()

Getter for a bucket name with directory where files were staged and waiting for loading.

Returns:

name of a bucket and directory inside in form gs://mybucket/dir/