Applications in the Emerging World of Stream Processing
summary
A Java library built on Apache Kafka, Kafka Streams runs embedded in applications, uses Kafka group management to load‑balance processing, and offers local durable state (RocksDB or in‑memory) whose updates are written to changelog topics using log compaction. Reprocessing happens by resetting consumer offsets to zero; that enables a real‑time inventory table plus independent reorder and pricing services from the same changelog. Kafka Connect (≈30 connectors) and Kafka 0.10 ship these features.
AI-written summary · about
chapters (16)
- 0:00Start
- 2:29Request Response
- 10:14Stream Processing Approaches
- 10:57State Management
- 13:14Stream Processing for Application Development
- 14:51Processor Api
- 15:47High Level Dsl
- 16:53Ordering
- 17:39Partitioning and Scalability
- 18:26Data Parallelism
- 18:41Group Management
- 19:40Fault Tolerance
- 25:04The Compaction Policy
- 38:39Reorder Inventory Application
- 42:47Kafka Connect
- 43:13Kafka Connectors
related talks
50mApplication development and data in the emerging world ...
37mIntroducing Kafka Streams, new stream processing library ...
55mDemystifying Stream Processing with Apache Kafka
27mNavigating Streaming Infrastructure
03h 00mStream Processing, Going Beyond Pub/Sub with Kafka Streams and...
03mInterview
01h 00mIn Depth Kafka Streams
06mJay Kreps interview