Kafka as a Platform: The Ecosystem from the Ground Up
summary
Explains Kafka as an immutable append-only log split into topics and partitions with per-partition ordering and configurable retention, running on multiple brokers (usually three+) with replication for fault tolerance. Shows producers, consumers, consumer groups that rebalance, and Kafka Connect for config-based integrations so teams avoid rewriting connectors. Demonstrates ksqlDB creating streams and a 15-minute windowed table, then using a JDBC sink to push live aggregates into Postgres — the demo updates in real time. Recommends Avro/Protobuf/JSON Schema with schema registry enforces compatibility for safe evolution.
AI-written summary · about
chapters (11)
- 0:00Intro
- 0:48Events
- 4:03The log
- 5:55Immutable event log
- 6:27Topics
- 8:18Partitions
- 9:10PUB/SUB
- 17:00Brokers and replication
- 19:01Streaming pipelines
- 28:50Demo
- 37:22Summary
related talks
41mKafka as a Platform: The Ecosystem from the Ground Up
41mKafka as a Platform: the Ecosystem from the Ground Up
54mKafka as a Platform: the Ecosystem from the Ground Up
01h 00mKafka as a Platform: the Ecosystem from the Ground Up
01h 00mKafka as a Platform: the Ecosystem from the Ground Up
01h 07mKafka Streams and KSQLDB
01h 00mIn Depth Kafka Streams
54mKafka: The Must Know Pub/Sub