Build your own Kafka
Create a log-based distributed messaging system.
advanced
Distributed Systems
Replication
Consistency
About this challenge
Internalize the principles behind Kafka by building a simplified but educational version focusing on logs, brokers, and clients.
What you will build
- Broker with segmented log
- Producer/consumer clients and basic replication
What you will learn
- Consensus basics and partitioning
- High-throughput storage design
Getting started
There is no backend work wired yet. When enabled, you will be able to enroll, track progress, and earn badges for completing stages.
For now, explore the curriculum and prepare your environment.
- Skim all stages to understand the scope
- Decide your implementation language
- Set up a project with tests and formatter