A History of Fetching Specs

on YouTube ↗22m

" summary

Chronicle of how RubyGems moves from a full specs download to a tiny, CDN‑friendly index and whether that actually speeds installs and scales. It demonstrates a concrete new index format with names.list, versions.list and per‑gem depth files, explains operational pain points (uncacheable dependency API, heavy Postgres queries, single US origin), and reports real wins like cuts bundle install from ~18s to ~3s, depth folder ~200MB vs gemspecs ~1.1GB, and HTTP-cacheable static index served via CDN.

AI-written summary · about

" chapters (7)

1. 0:00Start
2. 4:52Problem #1: No Dependency Info
3. 7:04Dependency API
4. 8:14Modern Index Problems
5. 8:28MOAR RAM - Solved
6. 9:19Problem #1: Not cacheable
7. 12:25Problem #3: Operational Burdens

" related talks

• 36mHistory of RDoc and RubygemsEric Hodel · RubyConf 2010
• 45m`bundle install` Y U SO SLOW: Server EditionTerence Lee · Ruby on Ales 2013
• 01mExtreme Makeover - Rubygems EditionAndre Arko · RubyConf AU 2014
• 35mDemystifying the Ruby package ecosystemJenny Shen · RubyConf 2023
• 31mHow to Make a Gem of a GemJustin Searls · RubyConf 2021
• 39mPluck ItAdam Cuppy · Southeast Ruby 2017
• 37m`bundle install` Y U SO SLOW: Server EditionTerence Lee · Rubyfuza 2013
• 37mExtreme Makeover: Rubygems EditionAndre Arko · RubyFuza 2014