Chapter 2

Question 1

Data pipeline stages

Answer 1

1. Ingestion
2. Transformation
3. Storage
4. Analysis

Note: Not all pipelines have all stages.

Question 2

What is Ingestion in terms of data pipeline

Answer 2

Ingestion (see Figure 3.3) is the process of bringing data into the GCP environment. This
can occur in either batch or streaming mode.

In batch mode, data sets made up of one or more files are copied to GCP. Often these
files will be copied to Cloud Storage first.

Streaming ingestion receives data in increments, typically a single record or small
batches of records, that continuously flow into an ingestion endpoint, typically a Cloud
Pub/Sub topic.

Question 3

What is Transformation in terms of data pipeline

Answer 3

Transformation is the process of mapping data from the structure used in the source system
to the structure used in the storage and analysis stages of the data pipeline.

Question 4

What are (4) Data Warehousing Pipelines

Answer 4

1. Extraction, transformation, and load (ETL)
2. Extraction, load, and transformation (ELT)
3. Extraction and load
4. Change data capture

Question 5

What is Dag

Answer 5

A DAG (Directed Acyclic Graph) is a graph of tasks where:

Directed: Each connection (edge) has a direction—task A → task B.
Acyclic: No cycles are allowed—you cannot loop back to a task already completed.

This ensures that tasks are executed in a defined, non-repeating sequence.

Question 6

What is ETL

Answer 6

Extract, transformation, and load

Question 7

What is ELT

Answer 7

Extract, load, and transformation.
Data is loaded into database before transforming the data.