AWS Storage Extras Flashcards

1
Q

AWS Snow Family

A

Highly Secure portable devices.

They collect and process data at edge OR migrate data into and out of AWS

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Data Migration Snow devices

A

Snowcone
Snowball Edge
Snowmobile

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Edge computing

A

Snowcone
Snowball Edge

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Why would you want to use AWS Snow Family?

A

Because of the time to transfer huge amounts of data. Takes hours to days.
Perfect for data migration

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

How does AWS Snow Family work?

A

You order AWS Snowball online. It gets shipped to you. You add the data in, and then ship it to AWS. They import/export the data into your Amazon S3 bucket

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

SnowBall Edge (data transfers)

A

Move data in or out of AWS
Pay per data transfer job
Block storage and Amazon S3-compatible object storage

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are the 2 flavours of SnowBall Edge?

A

Storage Optimised - 80 TB of HDD

Compute Optimised - 42 TB of HDD or 28 TB of NVMe

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

SnowBall Edge use cases

A

Large data cloud migrations
Decommission Data Centre
Disaster Recovery

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

AWS Snowcone & Snowcone SSD

A

Small
Portable computing
rugged & secure
for harsh environments

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Snowcone use cases?

A

edge computing, storage, data transfer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Snowcone size

A

8 TB of HDD

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Snowcone SSD

A

14 TB of SSD

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What type of constrains do you need to have to use snowcone instead of snowball?

A

Space constrains, this is tiny

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What do you need to provide yourself for snowcone?

A

Battery / cables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

How do you transfer data from snowcone to AWS?

A

By sending it offline (shipping)

OR

Connect to internet and use AWS DataSync to send data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

AWS Snowmobile

A

For transferring exabytes
1 EB = 1000 PB = 1,000,000 TBs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is the capacity of AWS Snowmobile?

A

100 PB (can use multiple in parallel)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

How is a snowmobile protected?

A

Temp controlled tuck
GPS
24/7 video surveillance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

When would you choose Snowmobile over Snowball?

A

When you need to transfer more than 10 PB

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

How does data migration work with snowball devices?

A

Request snowball from AWS console

install snowball client or AWS OpsHub on your servers

connect to servers and copy using client

ship back device to AWS facility

data are loaded to S3 bucket

snowball is wiped completely

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

How does data migration work with snowball devices?

A

Request snowball from AWS console

install snowball client or AWS OpsHub on your servers

connect to servers and copy using client

ship back device to AWS facility

data are loaded to S3 bucket

snowball is wiped completely

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

How can you use snowball devices for Edge Computing?

A

Process data while created on edge location

Snowball edge / snowcone can do this

Perfect for limited / no internet access locations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Edge Computing use cases

A

Preprocess data

Machine learning at the edge

Transcoding media streams

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What can you do if you need to with edge computing after you are done?

A

Can also send it back to AWS to data transfer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
When would you use edge computing?
If you are at a location that has no / limited internet access limited / no computing power
26
What are some Edge Computing examples?
Truck on road, ship on sea, mining station underground
27
What are the deployment options of Edge computing?
1 or 3 year options discounted pricing
28
AWS OpsHub
Software to install on PC or laptop, to manage snow family devices. Graphical interface
29
How do you transfer data from Snowball into Glacier?
Order Snowball, add the data in, import it to amazon S3, create an S3 lifecycle policy that moves the data into glacier
30
What is Amazon FSx?
Allows to launch 3d party-high performance file systems on AWS As a fully managed service
31
What are the 4 FSx types?
For Lustre For Windows File Server For NetApp ONTAP For OpenZFS
32
FSx for Windows (File Server)
fully managed windows file system share drive supports SMB protocol & Windows NTFS Microsoft AD integration, ACL, user quotas Can be mounted on EC2 instances (Linux) Supports Microsofts Distributed File Systems (DFS) Name spaces (group files across multiple FS)
33
Benefits of FSx for Windows?
scale up to 10s of GB/s, millions of IOPS, 100s PB of data SSD & HDD Can be accessed from on-prem infra (VPN or Direct Connect) Can be multi-AZ (HA) Data backed to S3 d aily
34
Amazon FSx for Lustre
Linux & Cluster (derived) Type of parallel distributed file system for large-scale computing Used for ML, High Performance Computing (HPC) Video processing, financial modeling, electronic design automation SSD & HDD Seamless Integration with S3 can read S3 as a file system through FSx Can write output of the computations back to S3 (through FSx) Can be used on-prem servers (VPN or Direct Connect)
35
2 FSx File System Deployment options (Lustre)
Scratch File System Persistent FIle System
36
Scratch File System (Lustre)
Temporary storage Data not replicated (no persistence) High burst Usage: short term processing optimise costs
37
Persistent File System (Lustre)
Long-term storage Data is replicated within same AZ Replace failed files within minutes Usage: Long-term processing, sensitive data
38
FSx for NetApp ONTAP
Managed NetApp ONTAP on AWS FS compatible with NFS, SMB, iSCSI protocol Move workloads running on ONTAP or NAS to AWS Works with Linux Win MacOS VMware Cloud on AWS Amazon Workspaces & AppStream 2.0 Amazon EC2, ECS, and EKS Storage shrinks or grows auto (AS) Snapshots, replication, low-cost, compression and data de-duplication Point-in-time instantaneous cloning (helpful for testing new workloads
39
Amazon FSx for OpenZFS
Managed fiel system on AWS File system compatible with NFS (v3,v4,v4.1,v4.1) Move workloads running on ZFS to AWS Works with Linux Win MacOS VMware Cloud on AWS Workspaces & Appstream 2.0 Amazon EC2, ECS, EKS Up to 1,000,000 IOPS with <0.5ms latency Snapshot, compression and low -cost Point-in-time instantaneous cloning
40
Hybrid Cloud Storage
On-prem & Cloud infrastructure
41
How do you expose S3 to On-Prem?
AWS Storage Gateway
42
What are the 2 Block storage for AWS?
Amazon EBS EC2 Instance Store
43
2 File Storage in AWS
Amazon EFS Amazon FSx
44
2 Object Storage in AWS
Amazon S3 Amazon Glacier
45
What is AWS Storage Gateway?
Bridge between on-prem data and cloud data
46
Use cases for AWS Storage Gateway?
disaster recovery backup & restore tiered storage on-premise cache & low-latency file access
47
Different Kinds of Storage Gateways
S3 File Gateway FSx File Gateway Volume Gateway Tape Gateway
48
S3 File Gateway architecture
1 Corporate Data centre & AWS Cloud You have your app server on-prem and you add an S3 File Gateway. In the cloud you have your bucket (s3 standard, standard IA, One Zone IA, INtelligent-Tiering) and a Lifecycle policy for S3 Glacier . Then you transfer data through HTTPS from cloud and on-prem. Protocol used is NFS or SMB SMB protocol has integration with AD for user auth Frequently accessed data are cached
49
FSx File Gateway
Native access to Amazon FSx for Win File Server Local Cache for frequently accessed data Native compatibility with SMB, NTFS, AD useful for group file shares and home directories
50
FSx File Gateway Architecture
SMB client and FSx File Gateway on-prem. Amazon FSx for WIndows File Server in AWS Cloud.
51
Main reason to use FSx File Gateway?
Local Cache for frequently accessed data
52
Volume Gateway
Block storage using iSCSI protocol backed by S3
53
What does Volume Gateway do?
Backed by EBS snapshots which can restore on-prem volumes Cached Volumes - low latency access to most recent data Stored Volumes - entire dataset is on prem, scheduled for backup to S3
54
Volume Gateway architecture
App server in on prem data centre. You also have a Volume Gateway and connect both with iSCSI interface. The gateway contacts via HTTPS the S3 Bucket in the cloud which also contacts the Amazon EBS Snapshots (all in the cloud)
55
Why do you want to use Volume Gateway
To backup your on-prem volumes
56
Tape Gateway
Backup for physical tapes in the cloud
57
What is Tape Gateway using?
Virtual Tape Library (VTL) backed up by S3 and Glacier
58
Tape Gateway Architecture
On prem - Backup server, iSCSI interface chooses media changer or tape drive. Then the tape gateway connects via HTTPS to the cloud. Directly onto the S3 that stores Virtual TApes, and also the archived tapes stored in amazon glacier
59
What is Storage Gateway - Hardware appliance?
Essentially a mini server that can be installed on prem and act as a file, volume, tape gateway. Can be ordered if you do not own any physical gateways
60
When is a Storage Gateway - Hardware Appliance useful?
For daily NFS backups in small data centres
61
AWS Transfer Family
File transfers into and out of Amazon S3 or EFS using FTP (only)
62
AWS Transfer Family protocols
FTP SFTP FTPS
63
Benefits of Transfer Family
Managed infrastructure Scalable Reliable HA (multi az) Pay per endpoint per hour store and manage users credentials within the service
64
Transfer Family use cases
sharing files public datasets CRM ERP
65
AWS Transfer Family Architecture
User using FTP client goes through Route 53 (optional) to SFTP, FTPS, FTP (VPC only) and using an IAM role they can connect to S3 or EFS. users can also be auth using LDAP or MS AD.
66
AWS DataSync
Move large amounts of data to and from - on prem or other cloud to AWS - needs agent - AWS to AWS (no agent needed) Can synchronise - S3, EFS, FSx (win, lustre, NetApp, OpenZFS) Scheduled Replication (hourly, daily, weekly) File permissions and metadata are preserved (NFS POSIX, SMB) One agent can task 10Gbps, can have bandwidth limit
67
DataSync Architecture
NFS or SMB server on prem. connects to DataSync Agent which allows connection over TLS to AWS DataSync in the cloud. Then from there you can transfer/sync data to any AWS Storage Resources. Can also transfer and sync data from AWS to on prem.
68
DataSync - what happens if you want to use it but do not have the bandwidth?
You can use AWS Snowcone because it has the DataSync agent pre-installed. Upload the data, run the agent, ship it to AWS and the Sync will happen there.
69
Can you use AWS DataSync for transferring between AWS storage devices?
Yes - you can transfer directly between S3, EFS, FSx. And keeps the metadata
70
What can you use to preserve metadata and file permissions when you do a transfer between storage services?
AWS DataSync
71
What do you need to run to be able to connect and transfer data to NFS or SMB server?
DataSync Agent
72
S3
Object Storage
73
S3 Glacier
Object Archival
74
EBS Volume
Network Storage for one EC2 instance at a time
75
Instance Storage
Physical storage for EC2 instance (high IOPS)
76
EFS
Network File System for Linux instances, POSIX filesystem
77
FSx for Windows
Network File System for Windows Servers
78
FSx for Lustre
High performance Computing Linux file system
79
FSx for NetApp ONTAP
High OS compatibility
80
FSx for OpenZFS
Managed ZFS file system
81
Storage Gateway
S3 & FSx File Gateway, Volume Gateway (cache & stored), Tape Gateway
81
Storage Gateway
S3 & FSx File Gateway, Volume Gateway (cache & stored), Tape Gateway
82
Storage Gateway
S3 & FSx File Gateway, Volume Gateway (cache & stored), Tape Gateway
83
Transfer Family
FTP, FTPS, SFTP interface on top of Amazon S3 or Amazon EFS
84
DataSync
Schedule data sync from on-premises to AWS, or AWS to AWS
85
Snowcone/ / Snowball / Snowmobile
to move large amount of data to the cloud, physically
86
Database
for specific workloads, usually with indexing and querying