CDC Without Pain: real-world resilient replication with Debezium and Kafka
summary
An explanation of using Change Data Capture (CDC) with Debezium and Kafka to build resilient replication between systems. Describes practical problems of data drift and inefficient database queries and shows a working approach for robust, fault-tolerant synchronization using Debezium + Kafka.
AI-written summary · about
chapters (13)
- 0:00Introduction
- 1:10CDC batching problems
- 2:35Debezium and Kafka Connect
- 3:57Data loss causes and heartbeat
- 7:05Monitoring and alerting with heartbeat
- 9:34Converters and data compression
- 12:07Snapshot issues and incremental
- 16:46Signals for snapshot control
- 18:52Retention and replica switching
- 20:17Debezium infrastructure
- 21:42DBA collaboration
- 22:26Resources and conclusion
- 23:08Q&A
related talks
01h 09mOpen-source Change Data Capture With Debezium
24mCDC: From Zero to Hero
23mChange Data Capture: A RabbitMQ and Debezium Approach
31mChange Data Capture for non relational databases
41mStreaming your database - Easier said than done?
19mChange data capture with Debezium…and without
41mChange Data Streaming Patterns in Distributed Systems
26mDebezium Server - New CDC runtime on the horizon!