Tutorial Dojo

Question 1

AWS Data exchange

Answer 1

-3rd party datasets in s3
-accessed via API GetDataSet

Question 2

Redshift concurrent scaling
and workload management

Answer 2

-handles concurrent users/unpredictability like BI workloads
-WLM can set query priority
-WLM up to 8 queues & eachqueue max concurrency of 50

Question 3

Athena workgroups

Answer 3

-organize and manage queries
-can use Apache spark for analytics
-security and access control

Question 4

AWS datasync

Answer 4

-on-prem to aws file storage like s3

Question 5

S3 event notification

Answer 5

-event type=ObjectCreated for example
-can trigger lambda based off for example suffix .csv

Question 6

AWS Glue for Ray

Answer 6

-job type for scale AI and Python and native library
-ray dataset based on Apache arrow

Question 7

Aws managed services for Apache flink

Answer 7

-for real time, time series analysis
-sliding window for intervals or overlapping

Question 8

Object lambda

Answer 8

-add code to get request enables real-time transformation as data retrieved
-on the fly

Question 9

Aws Graviton instance

Answer 9

-custom aws for best price performance for workloads

Question 10

Lambda provisioned concurrency

Answer 10

-setting scale without latency

Question 11

Redshift data sharing

Answer 11

-share read access across clusters, workgroups, accounts, regions
-live data

Question 12

-what to check state machine fails to start at a step?

Answer 12

• state machines iam role

Question 13

Glue’s sensitive data detection feature

Answer 13

-auto recognize PII AND redact

Question 14

S3 VPC gateway endpoint

Answer 14

-specify as target route in route table for traffic destined to s3

Question 15

Athena federated query

Answer 15

-connectors using lambda
-nosql, sql, timestream, etc

Question 16

Kenisis reporting with redshift real time

Answer 16

-create external schema for data stream
-materialized view referencing schema w auto refresh

Question 17

Stl_alert_event_log

Answer 17

-redshift view help identify performance issues and solution

Question 18

Glue resource policy

Answer 18

-think finance and hr running own etl and access own dbs

Question 19

S3 access point

Answer 19

-for multiple application access
-for cross-account access
-works with bucket policy

Question 20

MSCK Repair table

Answer 20

-Athena query when new data added to existing partition
-makes new partitions visible but does not necessarily speed up performance

Question 21

EFS and lambda

Answer 21

-mounts to efs seamlessly

Question 22

Improve kinesis Performance when processing

Answer 22

-add shards
-config parallel satin
-reg lambda func as consumer w enhanced fan-out
-exponential backoff and retry?

Question 23

Glue catalog partition predicates (frame)
&
Push down predicate

Answer 23

-server side filtering during frame creation (before data even loaded)
-faster than client side where data loaded in memory

-push down is similar but no mention of partition

Question 24

Transient EMR clusters

Answer 24

-think batch jobs
-cluster created then terminated after

Question 26

SQS settings

Answer 26

DelaySeconds -how long before visible in queue VisibilityTimeout -prevents multiple receive/processed MaxRecieveCount -amt of times a msg can be received before deleted

Question 27

Athena notebooks

Answer 27

-interactive python coding environment -execute spark code visually

Question 28

CloudWatch container insights

Answer 28

-for microservices and container apps

Question 29

OpenSearch storage

Answer 29

-hot = fastest access expensive -ultra warm = less accessed cheaper -cold = infrequent access can attach to ultra warm

Question 30

Stored proc and aurora

Answer 30

-can run proc in aurora to trigger lambda when loan is approved for example.

Question 31

MSK kafka ACLs

Answer 31

-microservices -which apps read/write diff topics

Question 32

Cloud trail data events vs management events

Answer 32

-data events = executions/s3 put example.. -management events = deleting resources

Question 33

Glue DataBrew masking techniques

Answer 33

-substitution = aron changed to donny -probablistic = different ciphertext each time -nulling deleting

Question 35

Athena Partition projection

Answer 35

-helps query performance focusing on subsets -good to run when already partitioned and data is growing.

Question 36

Redshift distribution style

Answer 36

-EVEN=rows even across node. Good when no joins/no clear dist key -KEY=rows w same key stored together. Good for query frequently filter or joined on spec column -ALL = full copy to each node. Best for small static table -AUTO = may change over time or not clear

Question 37

Sagemaker canvas

Answer 37

-no-code visual canvas. -simplifies whole process from cleaning to prediction

Question 38

Redshift vacuum commands

Answer 38

VACUUM FULL -same as vacuum VACUUM DELETE ONLY -doesn’t speed up performance just reclaims disc space VACUUM REINDEX -analyze interleaved sort key and performs vacuum. VACUUM SORT ONLY -sorts w out reclaiming disk. Used when rows unsourced but space not an issue

Question 39

Sagemaker workflows/lineage tracking

Answer 39

-save steps in workflow -visually think step function editor

Question 40

CloudWatch contributor insights & dynamodb

Answer 40

-view of dynamodb traffic trends

Question 41

Dynamodb cardinality key

Answer 41

-when throttling issues use high cardinality key, so more evenly distributed. -for hot partition issues

Question 42

RDS performance insights

Answer 42

-gathers performance metrics