Apache Kafka

Question 1

What is apache kafka?

Answer 1

Apache Kafka is an open-source distributed event streaming platform (Kafka is a distributed pub-sub messaging system that keeps track of streams of events)

Question 2

Why do we need Kafka?

Answer 2

Allows us to have a single source of events ( someones sends events, someone subscribes to these events). That’s allow not to build relations between each services directly.

Question 3

Where we can use Kafka? For what cases?

Answer 3

• messaging system ( communication between microservices )
• gather metrics
• Logs gathering
• De-coupling of system dependency

Question 4

What is kafka producer? What is acknowledgment?

Answer 4

Producer writes data to topic. There 3 types of acknowledgment
0 -> Don’t check if data was written to broker
1 -> Ensure that data was written to the leader broker
2 -> Ensure that data was written to the leader broker and all replicas

Question 5

What is kafka consumer? How to send a message?

Answer 5

Consumer reads data from the topic.

Question 6

What is Zookeper?

Answer 6

Zookeper maganages brokers and helps to find the leader.

Question 7

What is kafka topic? partition? offset?

Answer 7

A particular stream of data ( Similar to the table in DB)

Each topic contains partition ( similar to db row ), Each partition contains offset ( id )

Question 8

What is kafka broker?

Answer 8

Something like servers to handle kafka partitions.

Question 9

What is topic replication factor?

Answer 9

Is a number which describe how many copies of partition we need to send to different brokers. ( To avoid losing data )