Migrating applications to serverless Apache Kafka + KSQL
summary
Shows moving on-prem Kafka to Confluent Cloud by extracting MySQL movie rows with Debezium into a movies topic, replicating topics with Confluent Replicator, and replacing a stateful Java consumer (hashmap sum/count + JDBC join) with a persistent ksqlDB query that joins ratings to the movies table, computes averages, and exposes results over REST. Demo produces 4 ratings/sec, uses Avro and schema registry, has minor demo hiccups but the ksqlDB pipeline runs and returns live averages.
AI-written summary · about
chapters (7)
- 0:00Introduction and context
- 3:02The monolithic architecture
- 8:06Challenges of the old model
- 14:12Planning the cloud migration
- 20:10Cloud-native benefits
- 27:44Q&A session
- 36:40Demo and implementation
related talks
21mHow Apache Kafka® Generates Value In Retail With Confluent
52mStream Processing with the Spring Framework Like You’ve Never Seen It Before
45mStream Processing with KSQLDB and REST API Queries
14mPower real-time data streams from anywhere to Cosmos DB with Confluent
42mData Streaming for Microservices using Debezium
15mManaging Data Consistency among Microservices with Debezium
30mAccelerate Modernization with Confluent and YugabyteDB
44mKafka based Microservices with Akka Streams and Kafka Streams