org.apache.beam.sdk.io.aws2.s3

Class S3FileSystemConfiguration

java.lang.Object

org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration

@Experimental(value=FILESYSTEM)
public abstract class S3FileSystemConfiguration
extends java.lang.Object

Object used to configure S3FileSystem.

See Also:

S3Options, S3FileSystemSchemeRegistrar

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	S3FileSystemConfiguration.Builder

Field Summary

Fields

Modifier and Type	Field and Description
static int	MINIMUM_UPLOAD_BUFFER_SIZE_BYTES

Constructor Summary

Constructors

Constructor and Description
S3FileSystemConfiguration()

Method Summary

Modifier and Type	Method and Description
static S3FileSystemConfiguration.Builder	builder() Creates a new uninitialized S3FileSystemConfiguration.Builder.
static S3FileSystemConfiguration.Builder	builderFrom(S3Options s3Options) Creates a new S3FileSystemConfiguration.Builder with values initialized by the properties of s3Options.
static S3FileSystemConfiguration	fromS3Options(S3Options s3Options)
abstract boolean	getBucketKeyEnabled() Whether to use an S3 Bucket Key for object encryption with server-side encryption using AWS KMS (SSE-KMS) or not.
abstract S3ClientBuilder	getS3ClientBuilder() Builder used to create the S3Client.
abstract java.lang.String	getS3StorageClass() The AWS S3 storage class used for creating S3 objects.
abstract int	getS3ThreadPoolSize() Thread pool size, limiting the max concurrent S3 operations.
abstract int	getS3UploadBufferSizeBytes() Size of S3 upload chnks.
abstract java.lang.String	getScheme() The uri scheme used by resources on this filesystem.
abstract @Nullable java.lang.String	getSSEAlgorithm() Algorithm for SSE-S3 encryption, e.g.
abstract SSECustomerKey	getSSECustomerKey() SSE key for SSE-C encryption, e.g.
abstract @Nullable java.lang.String	getSSEKMSKeyId() KMS key id for SSE-KMS encyrption, e.g.
abstract S3FileSystemConfiguration.Builder	toBuilder() Creates a new S3FileSystemConfiguration.Builder with values initialized by this instance's properties.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

MINIMUM_UPLOAD_BUFFER_SIZE_BYTES

public static final int MINIMUM_UPLOAD_BUFFER_SIZE_BYTES

See Also:

Constant Field Values

Constructor Detail

S3FileSystemConfiguration

public S3FileSystemConfiguration()

Method Detail

getScheme

public abstract java.lang.String getScheme()

The uri scheme used by resources on this filesystem.

getS3StorageClass

public abstract java.lang.String getS3StorageClass()

The AWS S3 storage class used for creating S3 objects.

getS3UploadBufferSizeBytes

public abstract int getS3UploadBufferSizeBytes()

Size of S3 upload chnks.

getS3ThreadPoolSize

public abstract int getS3ThreadPoolSize()

Thread pool size, limiting the max concurrent S3 operations.

getSSEAlgorithm

public abstract @Nullable java.lang.String getSSEAlgorithm()

Algorithm for SSE-S3 encryption, e.g. AES256.

getSSECustomerKey

public abstract SSECustomerKey getSSECustomerKey()

SSE key for SSE-C encryption, e.g. a base64 encoded key and the algorithm.

getSSEKMSKeyId

public abstract @Nullable java.lang.String getSSEKMSKeyId()

KMS key id for SSE-KMS encyrption, e.g. "arn:aws:kms:..."

getBucketKeyEnabled

public abstract boolean getBucketKeyEnabled()

Whether to use an S3 Bucket Key for object encryption with server-side encryption using AWS KMS (SSE-KMS) or not.

getS3ClientBuilder

public abstract S3ClientBuilder getS3ClientBuilder()

Builder used to create the S3Client.

builder

public static S3FileSystemConfiguration.Builder builder()

Creates a new uninitialized S3FileSystemConfiguration.Builder.

toBuilder

public abstract S3FileSystemConfiguration.Builder toBuilder()

Creates a new S3FileSystemConfiguration.Builder with values initialized by this instance's properties.

builderFrom

public static S3FileSystemConfiguration.Builder builderFrom(S3Options s3Options)

Creates a new S3FileSystemConfiguration.Builder with values initialized by the properties of s3Options.

fromS3Options

public static S3FileSystemConfiguration fromS3Options(S3Options s3Options)