Cloud Dataflow

Question 1

Cloud Dataflow description

Answer 1

Fully managed service for creating data (batch and stream) processing pipelines where data is collected, transformed and then output

Question 2

What are the key features of Cloud Dataflow? (7)

Answer 2

1. Based on Apache Beam
2. Process data on multiple machines in parallel.
3. Handles streaming data like Cloud Pub/Sub
4. Handles batch or archived data like Cloud BigQuery
5. Serverless
6. Templates for ease of replication
7. Best choice if not using Apache Hadoop or Spark

Question 3

Where does Cloud Dataflow deliver its output?

Answer 3

BigQuery, Cloud Machine Learning, Cloud Bigtable

Question 4

3 examples of Cloud Dataflow

Answer 4

1. Analytical dashboards
2. Forecasting Sales Trends
3. ETL