Storage and Databases Flashcards

1
Q

Types of block level storage

A
  • instance stores
  • Amazon Elastic Block Store (EBS)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is an instance store volume?

A

local storage physically attached to the host running the EC2 instance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is the downside of an instance store volume?

A

All data are deleted when the instance is stopped. Because an instance can be restarted on another physical host.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is instance store volume good for?

A

temporary storage

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is Amazon EBS?

A

Elastic Block Store - volumes (physical hard drives) attached to an EC2 instance.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is EBS good for?

A

Incremental backups - snapshots.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is Amazon S3?

A

Simple Storage Service, object store

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are S3 limits?

A
  • single object limit is 5TB
  • total volume - unlimited
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Storage tiers

A
  • S3 standard
  • S3 infrequent access (IA)
  • one-zone IA
  • Amazon S3 Glacier
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is stored in object store

A

data, metadata, key

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

S3 Standard storage tier - features

A
  • 99.999999999% probability of being intact after 1 year
  • data is stored in at least 3 facilities
  • good for static website hosting
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

S3 IA

A

Infrequent Access
- lower storage price, higher retrieval price
- rapid access when needed
- minimum 3 AZs, backups, disaster recovery

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is Amazon S3 Glacier good for?

A

audit data that need to be archived

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is WORM policy?

A

Write once, read many

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is Amazon S3 Glacier?

A

storage vaults for data that don’t need to be accessed rapidly (from minutes to hours)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is Amazon S3 Intelligent Tiering?

A

Service for automatically moving data between tiers according to lifecycle policies.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is Amazon S3 Intelligent Tiering good for?

A

Data with unknown or changing access patterns.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What do you pay for with S3 Intelligent Tiering?

A

a monthly monitoring and automation fee per object

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Types of Amazon Glacier

A
  • Instant Retrieval
  • Flexible Retrieval
  • Deep Archive
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Amazon Glacier Flexible Retrieval - retrieval policy

A

from minutes to hours

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Amazon Glacier Instant Retrieval - retrieval policy

22
Q

Amazon Glacier Deep Archive - retrieval policy

A

12 hours, 1-2 a year

23
Q

EBS vs. S3

A

EBS:
- up to 16TB
- block store - delta updates possible
- requires an instance
- use case: large vide file which is edited
- not web enabled

S3:
- unlimited
- object store - discrete objects, no delta updates possible (WORM)
- use case: photo analysis website
- serverless
- web enabled

24
Q

What is Amazon EFS?

A

Elastic File System - a managed filesystem that scales automatically

25
EFS vs. EBS
EFS - not a drive, but a linux filesystem - regional resource - scalable EBS - a drive (SSD or HDD) - must be in the same AZ as an EC2 instance it's connected to - not scalable
26
EFS use case
a filesystem shared among multiple servers that run analytics on data located on this filesystem
27
What is Amazon RDS?
Amazon Relational Database System
28
RDBMS supported by RDS
PostgreSQL, MySQL, Oracle, MSSQL, etc.
29
Ways to use RDBMS on AWS.
1. lift&shift an existing database to EC2 2. use a managed service - Amazon RDS 3. Amazon Aurora
30
Benefits of Amazon RDS
- automated patching - backups - redundancy - failover - disaster recovery - can be integrated with other services, e.g. lambda
31
Amazon Aurora - SQL engines
MySQL, PostgreSQL
32
Amazon Aurora - benefits
- cheaper - 1/10 cost of commercial dbs - 6 replicas across facilities - up to 15 read-replicas - continuous backups to S3 - point-in-time recovery - up to 5x faster than MySQL, 3x than PostgreSQL
33
What is Amazon DynamoDB?
non-relational database, serverless, key-value (no schema)
34
features of DynamoDB
- scalable - very performant (ms response time) - massive throughput - PB size potential - granular API access - redundant storage across AZs, mirrors data across drives
35
What is Amazon Redshift?
data warehousing as a service (big data)
36
What is data warehousing use case?
- historical analysis - looking backwards at data that don't change in real time - variety of different data
37
Amazon Redshift specs
- multiple PBs, massively scalable - 10x more performant than traditional dbs
38
What is AWS DMS?
AWS Data Migration Service. Secure and easy migration from on premise to cloud.
39
Benefits of AWS DMS
- source db is operational during migration - downtime is minimized - source and target can be of different types
40
Two DB migration types
- between homogenous DBs - between heterogenous DBs
41
Homogenous DB migration
Compatible schema, data types, db code, e.g. MySQL -> Amazon RDS for MySQL. Source can be: on premise, Amazon EC2, Amazon RDS, target: Amazon EC2, Amazon RDS. One step: user creates a migration task using AWS Database Migration Service.
42
Heterogenous DB migration
Two steps: 1) convert schema structures, db code using AWS schema conversion tool, 2) migrate using AWS DMS.
43
Database migration use cases
- dev and test db migration (copy prod to dev or test) - db consolidation - continuous db replication - for disaster recovery or due to geographical separation
44
Types of dbs supported by DMS
relational, non-relational, other data stores
45
Amazon Document DB
Document db service that supports MongoDB workloads. Good for content management system: catalogues, user profiles.
46
Amazon Neptune
A graph DB. Good for social networking and recommendation engines, fraud detection, knowledge graph.
47
Anazon Quantum Ledger Database (QLDB)
An immutable system of record - no entry can be changed or removed - complete history of changes. Good for supply chain, banking, financial records.
48
Amazon Managed Blockchain
distributed ledger
49
Amazon Elasticache
Service which adds a layer of optimization to a db. Offers optimization of read times for common requests from mili- to microseconds. Supports Redis or Memcached engines.
50
Amazon DAX
DynamoDB Accelerator - in-memory native caching layer to improve read times.