Merge 2 Flashcards
(101 cards)
1
Q
Where is data in DynamoDB stored?
A
SSD Storage
2
Q
Where is DynamoDB spread?
A
across 3 geographically distinct data centers (not AZs)
3
Q
Default consistency model for DynamoDB
A
Eventual Consistent Reads. Strongly consistent reads is the other
4
Q
Eventual Consistent Reads
A
Consistency across all copies of data is usually reached within 1 second. repeating a read after a short time should return the updated data (best read performance)
5
Q
Strongly Consistent Reads
A
returns the result that reflects all writes that received a successful response prior to the read
6
Q
If low latency is important
A
pick Eventual consistent reads. Otherwise, pick strongly consistent reads
7
Q
DynamoDB pricing
A
Provisioned throughput capacity, storage
8
Q
How expensive is DynamoDB?
A
Expensive for writes, cheap for reads
9
Q
Use case for DynamoDB
A
If DB is read-heavy, scalabilty and good performance are important, SQL is not necessary
10
Q
default read and write capacity units when creating a DynamoDB table
A
5, 5
11
Q
can you purchase reserved capacity?
A
Yes, 1 or 3-year terms
12
Q
Item
A
Row
13
Q
Important metrics to know
A
Read capacity Units, Write capacity units (both provisioned/consumed)
14
Q
Is RedShift fully managed?
A
Yes
15
Q
RedShift configuration
A
Single node (160 GB), multi-node
16
Q
Multi node consists of
A
Leader node, compute node
17
Q
Leader node
A
manages client connections and receives queries
18
Q
Compute node
A
store data and perform queries and computations. up to 128 compute nodes
19
Q
Does RedShift organize data by rows or columns?
A
Columns, so improved performance
20
Q
Redshift is fast because
A
Massively Parallel processing, advanced compression
21
Q
RedShift pricing
A
compute node hours,backup, data transfer w/in a VPC
22
Q
RedShift security
A
encrypted in transit (SSL), encrypted at rest (AES-256), redshift takes care of key management by default
23
Q
Redshift availability
A
1 AZ, can restore snapshots to new AZs in case of outage
24
Q
Elasticache can be used for
A
improving application performance/latency/throughput for many read-heavy apps by storing critical pieces of data in memory for low-latency access (social networking, gaming, media sharing, Q/A portals)
25
Memcached
memory object caching system
26
Redis
open source in-memory key-value store that support data structures such as sorted sets and lists.
27
Elasticache supports
Master/slave replication, multi-AZ
28
If a database is under a lot of stress, which service would you use?
Elasticache if read heavy and not prone to frequently changing
Redshift if reason for stress is OLAP
29
What is Aurora?
MySQL-compatible, relational database engine that combines the speed and availability of high-end commercial databases with the simplicity and cost-effectiveness of open-source databases
30
Performance, Price: Aurora vs MySQL
Aurora: 5x better, 1/10 cheaper
31
Aurora scaling
start with 10 GB, scales in 10 GB increments to 64 Tb
32
Compute resources scaling
up to 32 vCPUs and 244 Gb memory
33
How many copies of Aurora data?
2 per AZ, minimum of 3 AZs, so minimum of 6
34
How many copies can be lost w/o affecting availability?
2 - write, 3 - read
35
Aurora is self-healing, what is meant by that?
data blocks and disks are continuously scanned for errors and repaired automatically
36
2 Aurora replicas
Aurora replicas (15), MySQL Read replicas (5)
37
Aurora Replica vs MySQL read replica
which has failover?
Aurora read replica has failover, MySql read replica doesn't
38
Failover logic
tier 0 is highest
39
What is SQS?
web service that allows you to access a message queue that can be used to store messages while waiting for a computer to process them.distributed queue system that enables web services apps to quickly and reliably queue messages that one component in the app generates to be consumed by another component
40
What is a queue?
temporary repository for messages that are awaiting processing
41
Example of SQS:
Image is uploaded to web app, web app alerts SQS that image has been uploaded and a job needs to be executed on it. app servers may queue SQS system and notice new job that comes in and access that image and perform a task. app servers will update queue and remove message from the queue
42
What is meant by decoupling/loosely coupling in SQS?
If web server goes down, for example, message is still in SQS and app servers not affected
43
T/F: Using SQS, you can decouple the components of an app so they run independently, with SQS easing message management between components.
TRUE
44
Can any component of a distributed app store messages in a fail-safe queue?
Yes
45
How much text can be contained in a message?
256 KB, any format
46
How can a component retrieve messages?
with the SQS API
47
The queue acts as
a buffer between the component producing and saving data and the component receiving the data for processing.
48
The queue resolves...
...issues that arise if the producer is producing work faster than the consumer can process it, or if the producer or consumer are only intermittently connected to the network
49
How many times does SQS deliver each message?
at least once
50
How many readers and writers can interact with the same queue?
multiple
51
How many components can a single queue interact with?
Many, simultaneously.
52
Do components need to coordinate with each other to share the queue?
No
53
SQS is engineered to
always be available and deliver messages
54
Does SQS guarantee first in first out delivery?
No
55
Is order important?
No, but you can place sequencing information in each message.
56
Is SQS pull or push?
pull
57
sqs visibility timeout
how long message will be visible in the queue
58
when does visibility timeout start?
when app server picks up the message
59
when would a message be processed/deleted?
during visibility timeout period
60
what happens if visibility timeout expires?
message will stay in queue and won't be deleted and another app server will pull it
61
T/F: SQS can be integrated with Auto Scaling
True. Useful for when queue gets too large and more app servers can spin up
62
max visibility timeout period
12 hours
63
Best design practice
design system so that processing a message more than once does not create errors/inconsistencies
64
How is message billing based?
64 kb chunks. each chunk billed as one request
65
Cost for requests per month
First 1M free, after that it's 50 cents per million requests
66
How many messages can a request have?
Minimum 1 message, maximum 10 messages, up to maximum 256 kb
67
What is SWF?
web service that makes it easy to coordinate work across distributed app components
68
SWF enables apps to be designed as...
a coordination of tasks
69
Tasks represent
invocations of various processing steps in an app which can be performed by executable code, web service calls, human actions, and scripts
70
SQS vs SWF retention period
SQS - 14 days, SWF - 1 year
71
SQS vs SWF - APIs
SQS - message oriented, SWF - task oriented
72
SQS vs SWF - duplication
SWF - task assigned only once, never duplicated
SQS - need to handle duplicated messages, make sure message is processed only once
73
SQS vs SWF - tracking
SWF - keeps track of all the tasks and events in an app
SQS - need to implement your own app-level tracking, especially if your app uses multiple queues
74
SWF Actors
Workflow Starters, Deciders, Activity Workers
75
Workflow Starters
an app that can initiate (start) a workflow. example: e-commerce website when placing an order or a mobile app searching for bus times
76
Deciders
control the flow of activity tasks in a workflow execution. if something has finished in a workflow (or fails) a decider decides what to do next
77
Activity Workers
carry out the activity tasks
78
What is SNS?
web service that makes it easy to set up, operate, and send notifications from the cloud. provides developers w/ a highly scalable, flexible, and cost-effective capability to publish messages from an app and immediately deliver them to subscribers or other apps
79
Common use case for SNS
notifies you in case of auto scaling, CloudWatch event
80
push notifications to
Apple, Google, Fire OS, and Windows devices, as well as Android devices in China w/ Baidu Cloud Push
81
What can SNS do other than push cloud notifications to mobile devices?
deliver notifications by SMS or email, to SQS queues, or to any HTTP endpoint. can also trigger Lambda functions
82
When message published to an SNS topic that has Lambda function subscribed to it
Lambda function is invoked with the payload of the published message. the lambda function receives the message payload as an input parameter and can manipulate the info in the message, publish the message to other SNS topics, or send the message to other AWS services
83
SNS allows you to group multiple recipients using
topics
84
Topic
access point for allowing recipients to dynamically subscribe for identical copies of the same notification.
85
One topic can support deliveries to
multiple endpoint types (e.g. group together iOS, Android, SMS)
86
When you publish once to a topic
SNS delivers appropriately formatted copies of your messages to each subscriber
87
to prevent messages from being lost
all messages published to SNS are stored redundantly across multiple AZs
88
SNS benefits
Instantaneous, push-based delivery (EC2 instances do not need to pull) simple APIs and easy integration with apps flexible message deliver over multiple transport protocols pay as you go
89
SNS vs SQS
both messaging services, SNS - Push, SQS - Pull
90
SNS pricing
50 cents per million SNS requests, 6 cents per 100k notifications over HTTP, 75 cents per 100 notifications over SMS, $2 per 100k notifications over email
91
What is Elastic Transcoder?
Media transcoder in the cloud. Converts media files from original source format into different formats that will play on smartphones, PCs, tablets, etc. transcoding presets for popular output formats. pay based on the minutes you transcode, resolution at which you transcode
92
What is API Gateway?
Amazon API Gateway is a fully managed service that makes it easy for developers to publish, maintain, monitor, and secure APIs at any scale. With a few clicks in the AWS Management Console, you can create an API that acts as a “front door” for applications to access data, business logic, or functionality from your back-end services, such as applications running on Amazon Elastic Compute Cloud (Amazon EC2), code running on AWS Lambda, or any web application.
93
API gateway architecture
User makes a request through API gateway, which triggers a Lambda function or routes request to EC2 instances. That request is then cached at API gateway, so subsequent requests would return the cached endpoint
94
What is API caching?
Can enable API caching to cache your endpoint's response. with caching, you can reduce the number of calls made to your endpoint and also improve the latency of the requests to your API. when you enable caching for a stage, API gateway caches responses from your endpoint for a specified TTL period in seconds. API gateway then responds to the request by looking up the endpoint from the cache instead of making a request to your endpoint
95
What can API gateway do?
Low cost and efficient, scales effortlessly (w/o autoscaling groups or EC2 servers but can cause security concerns), you can throttle requests to prevent attacks, connect to CloudWatch to log requests
96
Same origin policy
In computing, the same-origin policy is an important concept in the web app security model. Under the policy, a web browser permits scripts contained in a first web page to access data in a second web page, but only if both web pages have the same origin/domain name
97
Cross-Origin Resource Sharing (CORS)
CORS is one way the server at the other end (not the client) can relax the same-origin policy.It is a mechanism that allows restricted resources (e.g. fonts) on a web page to be requested from another domain outside of the domain from which the first resource was served
98
Error: "Origin policy cannot be read at the remote resource"
You need to enable CORS on API gateway
99
T/F: API gateway has caching capabilities to increase performance
TRUE
100
T/F: API gateway is low cost and scales automatically.
TRUE
101
If you are using Javascript/AJAX that uses multiple domains with API gateway,
ensure you have enabled CORS on API Gateway
