~/talk

MicroMon: A Monitoring Framework for Tackling Distributed Heterogeneity

on YouTube 16m
Talkat 12th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage '20) · 2020-07-13..07-14· [observability]

speakers

name:Baber Khalid
links:none on file
name:Nolan Rudolph
links:none on file
name:Ramakrishnan Durairajan
links:none on file
name:Sudarsun Kannan
links:none on file

resources

video:https://youtu.be/aQypgGWfeNw
slides:none on file

summary

MicroMon is a fine‑grained monitoring framework that collects micrometrics (page cache, per‑host IO and network queue delays, SSD SMART counters), filters them into OS‑reported anomalies, and piggybacks those anomalies onto packets via in‑band network telemetry so a distributed inference engine can score replicas. A Cassandra prototype across three datacenters (NVMe vs HDD, YCSB workloads) yields about 10–50% higher throughput (up to ~49% observed) by choosing replicas based on combined storage and network signals.

AI-written summary · about

chapters (18)

  1. 0:00Intro
  2. 1:19Problem With Current Systems . Current monitoring frameworks for geo-distributed applications are unidimensional
  3. 2:09Our Solution - MicroMon • MicroMon is a fined grained monitoring, dissemination, and inference framework
  4. 3:15Case Study - Cassandra • Distributed NoSQL database system deployed geographically
  5. 3:44Cassandra - Replication
  6. 4:24Cassandra's Snitch Monitoring Cassandra uses Snitch to monitor network topology and route requests across replicas
  7. 5:12Analysis Goal and Methodology • Goal: Highlight the lack of heterogeneity awareness
  8. 5:52Impact of Storage Heterogeneity Awareness
  9. 6:44Our Design: Micro Mon • Monitoring and inference framework for geo-distributed applications
  10. 7:20MicroMon Challenges
  11. 7:44Design - Micrometrics Selection • Huge combinations of micrometrics across app, host OS, and network
  12. 8:30MicroMon High-level Design
  13. 8:59Reducing Dissemination - Anomaly Reports
  14. 10:20Reducing Dissemination - Network Telemetry
  15. 11:09Scalable Inference - Scoring-based Inference
  16. 12:31Evaluation Goals
  17. 13:39MicroMon's - Storage Heterogeneity
  18. 14:49Storage Heterogeneity + Network Latency

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.