How Data Delivery Evolved for Yandex’s Ad Engine

on YouTube ↗39m

" summary

A Yandex team describes changing the data format and introducing a new index to avoid constant field reshuffling and to enable fast delivery of updates to their advertising engine. The talk covers the data-format evolution and the indexing approach used to speed update propagation to ad-serving components.

AI-written summary · about

" chapters (10)

1. 0:00Introduction
2. 3:41Ad engine operation
3. 7:12Old system problems
4. 10:21FL buffers format
5. 16:56Codegen and compatibility
6. 19:02PlaniUm and partial indexes
7. 24:12Data delivery acceleration
8. 27:16Caching and cold data
9. 29:24Final architecture
10. 34:47Q&A

" related talks

• 04mHighlights - Data and BusinessW.Vogels, J.Zavalishina, C.Moody, T.Haile, N.Carlson · DLD 2015
• 41mReliability of Data Delivery in Stream ProcessingEvgeniy Ravnushkin · Saint HighLoad++ 2023
• 21mPreparing Yandex search data — the library and processes we builtV.Agapitov, K.Khamitov · Saint HighLoad++ 2022
• 41mEfficiently Updating Database State from Stream Processing ServicesYuriy Pechatnov · Saint HighLoad++ 2023
• 29mSpeeding Up Image Preview Rendering in Yandex.DiskSergey Nechaev · HighLoad++ 2015
• 26mImplementing YDB CDC: The Yandex Monitoring CaseEgor Litvinenko · Saint HighLoad++ 2023
• 51mSuperspeed. Yandex unified express delivery platformSergey Khoroshenkikh · Saint HighLoad++ 2022
• 41mHow to Extract Anything from the Entire InternetIlya Kuchumov · HighLoad++ 2022