Lecture 3/4: Big Data Fundamentals

Question 1

5 V’s of Big Data

Answer 1

• Volume
• Variety
• Velocity
• Veracity
• Value

Question 2

Distributed Storage Systems

Answer 2

• HDFS
• Cloud storage

Question 3

Data Processing Frameworks

Answer 3

• MapReduce
• Apache Spark

Question 4

Real-Time Streaming Technologies

Answer 4

• Kafka
• Storm
• Flink

Question 5

ETL Pipelines

Answer 5

• Extract, transform, load (ETL) processes used to integrate data from different sources into a centralized repository

Question 6

Challenges with Big Data (Lecture)

Answer 6

• Scalability
• Integration
• Quality and consistency
• Security and privacy
• Real-time processing