Chrome Extension for Page Scraping & Analysis
summary
A working prototype implements a Chrome extension using a background page and content scripts that inject third party scripts, scrape Hacker News DOM nodes, filter titles and links, and send JSON results to a back end that can be either local MongoDB and Firebase. The demo shows per-component success but occasional integration hiccups; the extension stores results in Chrome storage, posts to an Express API, and testing options mentioned are PhantomJS Mocha Chai Sinon.
AI-written summary · about
chapters (13)
- 0:00Chrome extensions intro
- 6:36What extensions are
- 10:47First extension
- 15:43Chrome APIs
- 19:33Page scraping overview
- 23:08Demo: scraping extension
- 32:03Node.js scraping packages
- 36:39MongoDB storage
- 37:40Firebase backend
- 41:55Sample app build
- 51:14Live scraping demo
- 53:24Summary
- 54:05Q&A: DOM traversal
related talks
26mWeb Scraping with Puppeteer and NodeJS
25mDevTools and Headless Chrome–The Automation Power-Couple
41mCross browser extensions – lets make one
22mExtending the Web - explore new UI surfaces with WebExtensions
30mPowerful Automation with the Chrome DevTools Protocol
28mA hero's guide to developing with Chrome Dev Tools
34mAutomate building Chrome Extensions with Antigravity and DevTools MCP
32mDevTools and Headless Chrome - The Automation Power Couple