apache_beam.io.aws.clients.s3.boto3_client module

apache_beam.io.aws.clients.s3.boto3_client.get_http_error_code(exc)

class apache_beam.io.aws.clients.s3.boto3_client.Client(options)

Bases: object

Wrapper for boto3 library

get_object_metadata(request)

Retrieves an object’s metadata.

Parameters:request – (GetRequest) input message Returns:(Object) The response message.

get_stream(request, start)

Opens a stream object starting at the given position.

Parameters:

• request – (GetRequest) request
• start – (int) start offset

Returns:

(Stream) Boto3 stream object.

get_range(request, start, end)

Retrieves an object’s contents.

Parameters:

• request – (GetRequest) request
• start – (int) start offset
• end – (int) end offset (exclusive)

Returns:

(bytes) The response message.

list(request)

Retrieves a list of objects matching the criteria.

Parameters:request – (ListRequest) input message Returns:(ListResponse) The response message.

create_multipart_upload(request)

Initates a multipart upload to S3 for a given object

Parameters:request – (UploadRequest) input message Returns:(UploadResponse) The response message.

upload_part(request)

Uploads part of a file to S3 during a multipart upload

Parameters:request – (UploadPartRequest) input message Returns:(UploadPartResponse) The response message.

complete_multipart_upload(request)

Completes a multipart upload to S3

Parameters:request – (UploadPartRequest) input message Returns:(Void) The response message.

delete(request)

Deletes given object from bucket :param request: (DeleteRequest) input message

Returns:

(void) Void, otherwise will raise if an error occurs

delete_batch(request)

copy(request)