Package org.apache.beam.sdk.io.aws2.s3

Class S3FileSystemConfiguration

java.lang.Object
org.apache.beam.sdk.io.aws2.s3.S3FileSystemConfiguration
public abstract class S3FileSystemConfiguration extends Object
Object used to configure S3FileSystem.
See Also:

  • Field Details

    • MINIMUM_UPLOAD_BUFFER_SIZE_BYTES

      public static final int MINIMUM_UPLOAD_BUFFER_SIZE_BYTES
      See Also:

  • Constructor Details

    • S3FileSystemConfiguration

      public S3FileSystemConfiguration()

  • Method Details

    • getScheme

      public abstract String getScheme()
      The uri scheme used by resources on this filesystem.

    • getS3StorageClass

      public abstract String getS3StorageClass()
      The AWS S3 storage class used for creating S3 objects.

    • getS3UploadBufferSizeBytes

      public abstract int getS3UploadBufferSizeBytes()
      Size of S3 upload chnks.

    • getS3ThreadPoolSize

      public abstract int getS3ThreadPoolSize()
      Thread pool size, limiting the max concurrent S3 operations.

    • getSSEAlgorithm

      public abstract @Nullable String getSSEAlgorithm()
      Algorithm for SSE-S3 encryption, e.g. AES256.

    • getSSECustomerKey

      public abstract SSECustomerKey getSSECustomerKey()
      SSE key for SSE-C encryption, e.g. a base64 encoded key and the algorithm.

    • getSSEKMSKeyId

      public abstract @Nullable String getSSEKMSKeyId()
      KMS key id for SSE-KMS encyrption, e.g. "arn:aws:kms:..."

    • getBucketKeyEnabled

      public abstract boolean getBucketKeyEnabled()
      Whether to use an S3 Bucket Key for object encryption with server-side encryption using AWS KMS (SSE-KMS) or not.

    • getS3ClientBuilder

      public abstract S3ClientBuilder getS3ClientBuilder()
      Builder used to create the S3Client.

    • builder

      public static S3FileSystemConfiguration.Builder builder()
      Creates a new uninitialized S3FileSystemConfiguration.Builder.

    • toBuilder

      public abstract S3FileSystemConfiguration.Builder toBuilder()
      Creates a new S3FileSystemConfiguration.Builder with values initialized by this instance's properties.

    • builderFrom

      public static S3FileSystemConfiguration.Builder builderFrom(S3Options s3Options)
      Creates a new S3FileSystemConfiguration.Builder with values initialized by the properties of s3Options.

    • fromS3Options

      public static S3FileSystemConfiguration fromS3Options(S3Options s3Options)