Big Data

Question 1

Big data

Answer 1

A termed coined to handle masses of data generated through the internet and derive business insight from it.

Question 2

Where does all this data come from

Answer 2

Web browsing patterns
RFID
Internet of things
Social media
Smartphones
Biomedical devices

Question 3

Scaling up v Scaling out

Answer 3

Scaling up: migrating to a larger system with better CPUs/storage space (increases costs)

Scaling out: spread across several servers

Question 4

Clustering

Answer 4

A cluster of low cost servers sharing the workload

Question 5

Velocity

Answer 5

Rate at which new data enters the system and the rate at which data must be processed

Question 6

Variety

Answer 6

Big data captures data in the form that it naturally exists in:
Structured, unstructured, semi-structured data

Question 7

Structured data

Answer 7

Organised to fit into a predefined data model

Question 8

Unstructured data

Answer 8

Not organised to fit into a predefined data model. Like videos, images, texts…

Question 9

Semi-structured

Answer 9

Has elements of both structured and unstructured data

Question 10

HDFS and it’s assumption’s

Answer 10

Hadoop Distributed File System
Assumes
• files will be really big. (divides them into blocks)
• write only, read many. (Simplifies concurrency issues and improves overall throughput)
• streaming access
• fault tolerance (replication means processing can continue even if one replicate fails)