~/talk

Performance & efficiency at Pinterest: Optimizing the latest instances

Talkat AWS re:Invent 2023 · 2023-11-27..12-01· [cloud-infrastructure]
links:none on file
linkedin:ambud
slides:none on file

Pinterest and Intel show concrete results: replacing gzip with zlib-ng and selective zstd use plus gen-over-gen instance upgrades yields up to 50% improvement in cost efficiency and 30–40% per-cluster gains, while a Rockstore fix cuts CPU by ~10%. Benchmarks use perf/PMU profiling, JDK 17 SSL improvements, and instance moves (c5d→c6id, i3→i4i, M7i) and hardware features like AMX and QAT to reach 3.5x encryption throughput and large reductions in CPU usage.

AI-written summary · about

  1. 0:00Introduction
  2. 0:49Cloud computing trends
  3. 4:36Microservices and performance
  4. 8:25Pinterest case study: Merced
  5. 17:06Pinterest case study: Kafka
  6. 21:43Pinterest case study: Rockstore
  7. 23:58Latest generation benchmarks
  8. 28:19Generative AI and LLMs
  9. 31:11Metal instances and accelerators
  10. 35:40Software collaboration and wrap-up
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.