Avito Auto Upload: How to Download Millions of Photos per Day
summary
Avito AutoUpload handles tens of millions of listings per hour and downloads millions of photos per day from third‑party hosts of widely varying quality and stability. The talk describes the system and operational challenges of reliably fetching and processing that volume of images, including approaches to scaling, error handling, and working with unstable external storage providers.
AI-written summary · about
chapters (7)
- 0:00Introduction
- 10:45Scaling challenges
- 22:02First solution
- 26:40Second solution
- 30:12Third solution
- 33:47Summary
- 34:31Q&A
related talks
53mFrom Click to Publish: Architecture of Avito’s Classifieds Platform
47mWhere Your Ads Live
47mWhere Your Ads Live
51mEvolution of the PostgreSQL Storage for Listings at Avito
39mSearch Architecture at Avito
01h 50mLogical Replication and Avito
20mInput, Processing and Output (IPO) of Massive Metadata from Image Recognit...
23mManaging Small Datasets Without Losing Your Mind
