Event Streaming with Kafka Streams

on YouTube ↗31m

" summary

Kafka Streams is a Java library that runs inside applications and implements scalable, stateful event processing by handling partition assignment when multiple instances with the same application.id join a consumer group. A concrete example shows grouping by key and doing counts (local state kept in a hashmap-like state store) and writing results to an output topic. The stack includes ZooKeeper (as of 12 Nov 2020) and optional schema registry for Avro/Protobuf; runnable tutorials ship via Docker.

AI-written summary · about

" chapters (10)

1. 0:00Introduction and welcome
2. 1:31What is Kafka Streams
3. 5:21Kafka as event streaming platform
4. 9:16Kafka Streams high-level API
5. 13:50Kafka application lifecycle
6. 17:40Scalability and elasticity in Kafka Streams
7. 21:33Where to run compute in stream processing
8. 24:41Kafka Streams vs lambda architecture
9. 26:50Learning resources and next steps
10. 29:00Q&A and closing

" related talks

• 37mEvent Streaming Applications with Kafka Streams, Spring Kafka and ActuatorKo Turk · Java Day Istanbul 2022
• 29mApache Kafka and the Next 700 Stream Processing SystemsJay Kreps · Strange Loop 2015
• 33mKafka streams at scaleDeepak Goyal · Rootconf 2019
• 01h 00mKafka as a Platform: the Ecosystem from the Ground UpRobin Moffatt · NDC Oslo 2020
• 02h 05mA Deep Dive into Apache Kafka This is Event StreamingKatherine Stanley, Andrew Dunnings · Devoxx Belgium 2019
• 08mPREVIEW: Kafka Stream Processing for Everyone with KSQLNick Dearden · Kafka Summit San Francisco 2017
• 51mStream Processing Smackdown: Kafka Streams vs. Apache FlinkViktor Gamov · Voxxed Days Ticino 2025
• 17mOvercome By Events - Apache Kafka And Event-oriented ArchitectureJay Kreps · Big Data LDN 2018