System for Preventing Parsing of the 2GIS API
summary
A presentation about preventing API scraping of a 2GIS database of 1.3M company contacts, describing how their anti-parsing system evolved. It covers implementation stages and technologies: an Nginx location-based rule, a PHP + Redis rate counter, moving logic to Nginx + Redis via configuration, and finally Nginx + Lua + Redis to implement more complex blocking logic without slowing responses.
AI-written summary · about
related talks
34mArchitecture of an Anti-Bot Protection
19mWhen data can't be open
44mDigital Cat-and-Mouse: Strategies to Outsmart Scrapers, Phishers, and Thieves
33mImproving API Security Posture.
41mDirty Tricks: Using nginx and Lua to thwart bots and skript kiddies
50mArchitecture of an Anti-Bot Protection
45mReliable High-Performance HTTP Infrastructure with nginx and Lua
24m"Good luck with that": Tag Teaming Civic Data