Advanced Amazon S3

Question 1

LifeCycle Rules - Transition Actions

Answer 1

move obj to Standard IA 60 days after creation

move to Glacier for Archiving after 6 months etc

Question 2

LifeCycle Rules - Expiration Actions

Answer 2

configure obj to expire (delete) after some time

Access log can be deleted after 365 days

Can be used to delete old version of files (if versioning enabled)

Can delete incomplete multi-part uploads

Question 3

Can you create LifeCycle rules for certain prefix? - s3://mybucket/mp3/*

Answer 3

Yes

Question 4

Can you create LifeCycle rules for certain object Tags? (e.g. Department: Finance)

Answer 4

yes

Question 5

What can Amazon S3 Analytics do with Storage classes?

Answer 5

Help decide when to transition objects to right storage class

Question 6

Which Storage classes does Amazon S3 Analytics work with?

Answer 6

Only Standard and Standard IA

Question 7

S3 - Requester Pays

Answer 7

Option to enable for the requester to pay instead of the owner of the bucket

Question 8

S3 general charging model?

Answer 8

Bucket owners pay for all S3 storage and data transfer costs associated with their bucket

Question 9

When would you use Requester Pays?

Answer 9

If you have an object that is too big and you don’t want to be charged

Question 10

Use cases for Requester Pays?

Answer 10

When you want to share large datasets with other accounts?

Question 11

What does the requester must be in order to download objects from a bucket?

Answer 11

Authenticated in AWS (cannot be anonymous)

Question 12

S3 Event Notification use cases

Answer 12

Generate thumbnails of images uploaded to S3

Question 13

What are the 3 main destinations for S3 events notifications?

Answer 13

SNS
SQS
Lambda Function

Question 14

S3 Event Notifications with Amazon EventBridge (architecture)

Answer 14

Events go into S3 bucket, then all of them are sent over to EventBridge.

EventBridge can then send events, depending on rules set, over to 18 AWS services as destinations

Question 15

When is Multi-Part upload recommended?

Answer 15

For anything greater than 100MB

Mandatory for anything over 5GB

Question 16

S3 Transfer Acceleration (upload/download)

Answer 16

Increase transfer speed by transferring file to AWS edge location which forwards the data to S3 bucket in the target region

Question 17

How does S3 Transfer Acceleration work?

Answer 17

If your file is in USA, you transfer it publicly (www) to an Edge Location in USA and then you send it to the S3 Bucket in AUS via private AWS.

Meaning you decrease the amount of public internet you go through

Question 18

S3 Byte-Range Fetches

Answer 18

Parallelise GETs by requesting specific byte ranges

Better resilience in case of failures

Question 19

S3 Byte-Range Fetches architecture

Answer 19

You have a file in S3, you break it down into parts and request these parts in parallel - speeds up download

Question 20

What are the 2 use cases for Byte-Range Fetches?

Answer 20

Speed up downloads
Retrieve only partial data (head of a file for example)

Question 21

S3 Select & Glacier Select

Answer 21

Retrieve less data using SQL - server side filtering

Filter rows and columns

Less network transfer, less CPU cost client-side

Question 22

How does S3 Select & Glacier Select work?

Answer 22

Instead of receiving the whole file and then filtering it on client-side, S3 Select does the filtering on the S3 and then sends you exactly what you need.

SQL is used

Question 23

S3 Select & Glacier Select architecture

Answer 23

You ask for a CSV with S3 Select. Amazon S3 does server-side filtering, then sends the filtered dataset to you

Question 24

S3 Batch Operations

Answer 24

Perform bulk operations on existing S3 objects with a single request

Question 25

S3 Batch Operations Examples

Answer 25

Modify object metadata & properties
Copy objects between S3 buckets
Encrypt un-encrypted objects
Modify ACLs, tags
Restore objects from S3 Glacier
Invoke Lambda Function to perform custom action on each object

Question 26

What do S3 Batch Operations manage?

Answer 26

Retries, track progress, sends completion notifications, generate reports

Question 27

How can you use S3 inventory?

Answer 27

To get object list and use S3 Select to filter your objects

Question 28

S3 Inventory use (architecture)

Answer 28

S3 inventory sends Objects list report to S3 select, then S3 select sends filtered list to S3 Batch Operations.

The user can also add operations & parameters, and then everything gets sent from S3 Batch Operations to Processed Objects