~/talk

Getting the Most Out of Your Mesos

on YouTube 27m
Talkat LISA18 · on Monday, 2018-10-29· at 17:00· Legends Ballroom ABC· [data-engineering]

speaker

name:David Morrison
links:none on file

resources

video:https://youtu.be/HOINO6S5XuI
slides:none on file

summary

Yelp runs Apache Mesos in production since 2014, hosting about 400 services and ~600 batch jobs and running 100k unit/integration tests hundreds of times a day (one full run ≈15 minutes). Built tools include Pasta, Tron, Jolt and a benchmarking harness that archives experiments into Docker images with Jupyter notebooks. Load tests show Docker launching 10,000 containers averages ~60s (worst ~3m) versus UCR worst ~8s. Cluster Man provides a pluggable autoscaler plus a simulated AWS/Mesos environment for reproducible predictability and what’s called feedbackability.

AI-written summary · about

chapters (13)

  1. 0:00Intro
  2. 0:34Yelp's Mission Connecting people with great local businesses
  3. 2:30(A few) Examples of Mesos Applications
  4. 4:31Mesos Adoption at Yelp
  5. 7:31Metrics and Monitoring
  6. 8:04Tracing and Logging
  7. 8:55How many services can we support?
  8. 10:30How many frameworks can we run?
  9. 12:17Load Testing Apache Mesos
  10. 15:43Docker Containerizer vs UCR
  11. 21:38Clusterman Example: what happened
  12. 22:34Clusterman Example: What will happen
  13. 24:07Feedbackability

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.