Time travel with Neon
summary
Neon replaces local disks with a networked storage system that keeps every page version and reconstructs pages on demand from WAL-like reshuffled delta files and S3, enabling page-level recovery and instant branching. A demo shows a serverless Postgres instance starting in about one second to run queries at arbitrary LSNs (time travel works), backed by safekeepers for recent WAL and page servers for reads. Implementation notes: LSM-style compaction, local SSD cache, shared_buffers set to 128MB, current storage amplification ~2–3x, largest deployments ~1–5 TB.
AI-written summary · about
chapters (26)
- 0:00Introduction to Neon
- 1:09What is Neon and its storage system
- 3:14Traditional PostgreSQL setup vs Neon
- 6:45Neon storage architecture overview
- 9:59Time travel and page reconstruction
- 12:04Point-in-time recovery with time travel
- 16:17Live demo of Neon time travel
- 22:42Branching in Neon
- 24:29Q&A on hot pages and edge cases
- 26:17Managing branches at scale
- 28:22Scaling large databases
- 29:50Open source and on-premises options
- 31:16Caching and performance optimizations
- 32:39Optimizations and user data changes
- 33:21On-the-fly time travel limitations
- 34:04PostgreSQL version upgrades
- 35:29Storage size and pricing model
- 37:57Pricing model challenges
- 38:18Image compression and patches
- 39:23Retention policies and branching
- 39:45Streaming replication with Neon
- 40:48PostgreSQL backups with Neon
- 41:52Shared buffers and caching
- 42:36PostgreSQL extensions support
- 43:18PostgreSQL version releases
- 44:01Fast VM spin-up for branches
related talks
41mNeon tech - Separation of storage and compute for Postgres
26mNeon: How we made PostgreSQL serverless
45mPostgres: ServerLESS is more?
31mReimagining the Future: Where the Market is Evolving
46mEdge Performance with In memory NoSQL
39mTimescaleDB: Re-engineering PostgreSQL as a time-series database
32mLow Latency Serving of Offline Data: Efficient, Safe, and Reliable Data...
20mOpen Source Database Operations in the Age of AI
