apache_beam.io.aws.clients.s3.boto3_client module

apache_beam.io.aws.clients.s3.boto3_client.get_http_error_code(exc)[source]
class apache_beam.io.aws.clients.s3.boto3_client.Client(options)[source]

Bases: object

Wrapper for boto3 library

get_object_metadata(request)[source]

Retrieves an object’s metadata.

Parameters:request – (GetRequest) input message
Returns:(Object) The response message.
get_stream(request, start)[source]

Opens a stream object starting at the given position.

Parameters:
  • request – (GetRequest) request
  • start – (int) start offset
Returns:

(Stream) Boto3 stream object.

get_range(request, start, end)[source]

Retrieves an object’s contents.

Parameters:
  • request – (GetRequest) request
  • start – (int) start offset
  • end – (int) end offset (exclusive)
Returns:

(bytes) The response message.

list(request)[source]

Retrieves a list of objects matching the criteria.

Parameters:request – (ListRequest) input message
Returns:(ListResponse) The response message.
create_multipart_upload(request)[source]

Initates a multipart upload to S3 for a given object

Parameters:request – (UploadRequest) input message
Returns:(UploadResponse) The response message.
upload_part(request)[source]

Uploads part of a file to S3 during a multipart upload

Parameters:request – (UploadPartRequest) input message
Returns:(UploadPartResponse) The response message.
complete_multipart_upload(request)[source]

Completes a multipart upload to S3

Parameters:request – (UploadPartRequest) input message
Returns:(Void) The response message.
delete(request)[source]

Deletes given object from bucket :param request: (DeleteRequest) input message

Returns:
(void) Void, otherwise will raise if an error occurs
delete_batch(request)[source]
copy(request)[source]