Why PostgreSQL people should care about Kafka and Debezium?
summary
Demo spins a single-node Kafka broker, Kafka Connect and Debezium, creates a topic named "beer", creates a Postgres table and inserts rows, and Debezium immediately emits a CDC.public.beer topic with JSON records showing before/after row state. Configuration uses the PGoutput plugin and requires wal_level=logical on Postgres. Built artifacts (GitHub repo and Terraform script) reproduce the setup, SMTs handle lightweight transformations, and MirrorMaker2 is suggested for cross-cluster DR.
AI-written summary · about
chapters (10)
- 0:00Introduction and motivation
- 3:02Modern challenges for DBAs
- 6:03Introduction to Apache Kafka
- 9:33Kafka concepts and components
- 12:58Kafka quick start and demo
- 19:21Connecting databases with Debezium
- 23:48CDC implementation demo
- 29:42Advanced Kafka features
- 36:08Getting started with automation
- 39:03Conclusion and takeaways
related talks
51mGeo-Distributed Postgres Replication Using Debezium
26mDebezium Server - New CDC runtime on the horizon!
39mReliable Data Replication from Postgres on Kubernetes
48mStreaming Database Changes with Debezium
33mTransitioning from Debezium ElasticSearch to Postgres for Streamlined Resilience
31mKafka and Debezium at trivago
52mChange Data Streaming For Spring Boot With Apache Kafka and Debezium
42mData Streaming for Microservices using Debezium
