Lightning Demo: HTTP Archive, BigQuery, and you!
summary
HTTP Archive dumps ~0.5 TB of crawl data back to 2010 with bi-monthly runs over ~300,000 desktop and 10,000 mobile sites, and the dataset lives in BigQuery for ad-hoc analysis. Queries show TTFB quantiles: top 10% ~90 ms, median >500 ms, 80/90th >1 s; median requests per page ≈100 but outliers hit ~1,200 requests and some sites load resources from ~700 domains (one widget fetching 700 favicons). A Google Docs script queries HTTP Archive in BigQuery and graphs live results successfully.
AI-written summary · about
