Building your own log-based message queue in Go
summary
Explains what a log data structure is and why it underpins systems like Apache Kafka, then demonstrates how to implement a log-based pub/sub message queue in Go. Covers concrete components such as segmented logs, data indexes, offset management and constant-time read/write behavior, and demos NetLog (netlog.io) and the BigLog library used to build it.
AI-written summary · about
chapters (5)
related talks
29mGo Big with Apache Kafka
41mKafka as a Platform: The Ecosystem from the Ground Up
41mKafka as a Platform: the Ecosystem from the Ground Up
16mAn introduction to Apache Kafka - this is Event Streaming, not just Messaging
15mGetting Started with Kafka
54mKafka as a Platform: the Ecosystem from the Ground Up
39mKafka as a Platform: The Ecosystem from the Ground Up
50mIntroduction to Apache Kafka