How to Foster Cross-Community Collaboration – Lessons Learned
summary
Collaboration integrates Alluxio with Presto to deliver an SSD caching feature driven by a prototype (Raptor) that targets a 10x speedup; work starts end of 2019 with an aggressive six‑month milestone, two months of coding and about 60% of effort spent on staging and testing, and production rollout in June 2020. Engineering fixes include a two-phase commit for disk reliability, unique error counters surfaced to dashboards, and frequent lightweight Maven releases (2–3x/week) to push patches; adoption at Meta and replication at Uber confirm it works.
AI-written summary · about
chapters (10)
- 0:00Intro
- 4:05Challenge: Make it a Priority in Both Organizations
- 7:03Challenge: Tight Timeline and First-Time Collaborating
- 10:26Challenge: Release Cycle and Bug Escalation
- 13:13Challenge: Communication Channel
- 15:30Challenge: Responsibility Switch
- 18:42Bonus Challenge: Partner Engineering During Pandemic
- 21:55Core Challenge: Caching Data at Meta Scale
- 25:23Core Challenge: "Hi Bin, we have another incident"
- 28:17Quick Summary
related talks
26mBuilding a Community Growth Flywheel
38mBuilding Super-Contributors in Alluxio Open Source Community
17mComposable Data Management Systems
01h 36mLFX Mentorship Showcase
45mUnlocking High Performing Teams with Open Source
44mTechapalooza: Engineering Q&A Session
12mCNCF Projects Update
35mTen years of building open source standards.