lesser known Superpower of Postgres Logical Replication
summary
Explains how Postgres logical replication evolved from V1 (only post-commit) to V2 (in‑progress streaming), V3 (prepared transactions) and V4 (parallel apply), with a Go program demoing a 100,000-row demo that shows V2 streaming ~6k-row batches mid‑transaction, and benchmarks where two 25M‑row transactions force ~8 GB slot growth but V2 lets the slot drop faster after commit; implementation uses PG output, ClickHouse/PB for ETL, and notes PB is actively implementing protocol V2 support.
AI-written summary · about
chapters (14)
- 0:00Introduction
- 1:06Postgres replication methods
- 3:55Logical replication overview
- 6:04Logical replication workflow
- 13:46Protocol version 1 explained
- 16:13Protocol version 1 demo
- 19:46Protocol version 2 introduction
- 22:12Protocol version 2 demo
- 25:21Challenges in version 2
- 32:05Two-phase commit explained
- 36:40Protocol version 3 features
- 38:22Protocol version 4 overview
- 40:06Conclusion and future
- 41:10Q&A
related talks
39mLogical Replication handling of large transactions
53mThe journey towards active replication in PostgreSQL
31mPast, Present, and Future: Logical Decoding and Replication in PostgreSQL
38mA journey into postgresql logical replication
59mLogical Replication...LIVE!
49mPostgreSQL Replication - The Most Exciting Technology on Earth
29mLogical replication theory and concepts
50mPGLogical the logical replication for Postgresql