Big Data Platform

Question 1

What is Cloud Dataproc?

Answer 1

• Google’s managed apache service
• Billed by the second
• Runs on clusters owned by the customer

Question 2

What is Cloud Dataflow?

Answer 2

• Managed etl pipelines

- Automated scaling and provisioning

Question 3

What is Big Query?

Answer 3

• Analytics data warehouse
• Allows SQL queries
• Free monthly quota
• Bounded to a region
• Billing for storage and process used

Question 4

What is Cloud Pub/Sub?

Answer 4

• Messaging bus

- Good for cases where data arrives in high and unpredictable rates (iot for example)

Question 5

What is Cloud Datalab?

Answer 5

• “jupyter playground” managed service

- pay for resources used, nmr of notebooks does not matter

Question 6

What is Cloud ML Platform?

Answer 6

• Ml platform with use case specific managed apis like:
  
  • Cloud Vision (image analysis)
  • Cloud Natural Language (audio to text, reveal structure and meaning of text, extract information)
  • Cloud Translation
  • Cloud Video Intelligence (annotate videos)