Jonathan Seckler, Dell Technologies & Ariel Pisetzky, Taboola | Dell Technologies World 2023
summary
Taboola describes running personalized recommendations for 4 billion webpages a day and 1.5 billion unique users a month on about 12,000 Dell servers (claiming a lower TCO than cloud). The deployment spans roughly half a million cores, uses GPUs for training, 25Gb server links with 100/400Gb uplinks, and software-driven fan and power controls to run racks a few degrees hotter. Validated designs, performance tuning and global support drive the production AI inferencing and cost gains.
AI-written summary · about
