Balavijayan Ganesan interviewed at TOC 2011
summary
A Rapid Source automation center of excellence runs a web-extraction tool that pulls data from hundreds of thousands of sites, detects changes and delivers 1.5 million pages in under a month where manual work would have taken roughly 100 people. The system improves timeliness, completeness and accuracy, requires automated pacing rules to avoid overloading source sites, and shifts workflows from bulk human collection toward algorithmic monitoring with human editorial oversight.
AI-written summary · about
chapters (3)
related talks
14mHarnessing Common Crawl for AI and ML Applications
16mA Thrilling Journey into Data-Driven Security Automation
41mAddressing the Challenges of Public Web Data
16mFrom OT Data Challenges to AI-Driven Operations on
24mDataEngBytes 2023 - MEL-T2-02 - Vikas Rajput
32mModern Web Data Extraction: Tools, Techniques & Ethics
02h 03mBuilding on AI - Delhi meet-up
48mA Journey to Open Data