Using Postgres XL

on YouTube ↗59m

" summary

Javelin moves large analytics workloads onto Postgres XL across 10 machines (8 cores, 16GB RAM, ~1TB each) and cuts queries from ~5 minutes to seconds. Migration uses a custom Postgres XL migrator shell script to pick distribution columns and avoid skew; operational tooling includes a simple PHP Postgres XL dashboard and PGXCtl for orchestration. Pain points: fragile GTM failover, PGAdmin incompatibilities with 9.5, HBA/grant tweaks to let non-superusers see databases, and copy-based bulk loads are far faster than INSERTs.

AI-written summary · about

" chapters (10)

1. 0:00Introduction to Postgres XL
2. 1:55Environment setup and goals
3. 6:00Architecture and components
4. 8:43Cluster management challenges
5. 14:02Tooling and administration
6. 20:02Configuration tuning
7. 24:31Security and user management
8. 28:37Data migration strategies
9. 40:02Optimizing query performance
10. 47:20Dashboarding and final Q&A

" related talks

• 50mSupersized Postgres: Postgres-XL for OLTP and Big Data AnalyticsMason Sharp · PostgresOpen 2014
• 39mPostgreSQL BI Performance & News from XL projectMark Wong · PostgresOpen Silicon Valley 2017
• 54mScaling out by distributing and replicating data in Postgres XCAshutosh Bapat · Postgres Open 2012
• 58mSuper Jumbo DeluxJosh Berkus · Postgres Open 2012
• 36mPostgres at any ScaleCraig Kerstiens · Birmingham on Rails 2020
• 26mMastering Large-Scale PostgreSQL MigrationJulien Acroute · PG Day France 2024
• 56mA Shared nothing Cluster System Postgres XCAmit Khandekar · Postgres Open 2012
• 49mPractical Guide to Migrating +100 Large PostgreSQL to the CloudNelson Calero · PostgreSQL Conference Europe 2025