Next-gen Caching Infrastructure

on YouTube ↗27m

" summary

Criteo replaces memcache and Couchbase with Aerospike Real‑Time Data Platform, consolidating ~300 TB of cache and 300 TB / 1.2 trillion records across ~4,000 machines into far fewer nodes by combining workloads and eliminating duplicate layers. Migration uses the existing KVS SDK and double‑write synchronization to keep caches in sync, runs on Kubernetes with one pod per host with hostNetworking and local PVs, and reports reads slightly faster than memcache while p99 writes are slower than in‑memory memcached but much better than Couchbase; LDAP auth tuning was the main pain point.

AI-written summary · about

" chapters (5)

1. 0:00Intro
2. 1:19Criteo caching infrastructure
3. 7:22Why Aerospike?
4. 12:55Rollout strategy
5. 18:5218 months feedback

" related talks

• 05mHighlights From Aerospike APJ Summit 2023Aerospike APJ Summit 2023
• 31mUser Attribution at Scale: All-Flash, ½ Trillion ObjectsRobert Abraham · Aerospike Digital Summit 2021
• 46mEdge Performance with In memory NoSQLLiviu Costea · Voxxed Days Vienna 2017
• 03mInterviewGeir Magnusson · Velocity Conference Santa Clara 2014
• 09mBrian Bulkowski (Aerospike) Interview - OSCON 2014Brian Bulkowski · OSCON 2014
• 09mInnovating Together for Real-time Impact with Google CloudNRA meta · Aerospike Summit 2023
• 26mDNP-VYT - AWS re:Invent 2023 - (DAT206)Amit Shah, Lenley Hensarling, Shai Peretz, Ujjwal Wadhawan · AWS re:Invent 2023
• 15mAccelerate Application Response Times with True CacheShailesh Dwivedi · Oracle DatabaseWorld: AI Edition 2024