Partial Object Modification in Yandex Object Storage: How We Improve Filesystem Behavior
summary
Yandex Object Storage supports partial object modification to improve filesystem-like operations. The talk explains the problem of updating portions of stored objects without rewriting whole files, and describes the implemented approach and system changes in Yandex Object Storage that enable more efficient partial updates and better filesystem performance.
AI-written summary · about
chapters (13)
- 0:00Introduction
- 1:08FS over S3 and use cases
- 3:20Filesystem implementation
- 6:32S3 interface drawbacks
- 7:55Multipart upload and modification
- 12:28Cloud solutions comparison
- 13:33Our patch solution
- 17:39Object storage layout
- 19:52Optimistic locking
- 23:45Testing and benchmarks
- 27:57Usage recommendations
- 29:42Future development
- 31:06Q&A
related talks
42mHow We Built a Shared Bus of Dynamic Resources at Yandex
31mThe Design of a Modern Distributed Object Storage
21mNew Techniques to Improve Small I/O Workloads in Distributed File Systems
47mMoving to Platform as a Service in Yandex Verticals
39mMailing Adventures with PostgreSQL: Taming 650+ Shards and Surviving
47mState machines for product data from YDB and queues
33mPredicting the Future of Distributed Systems
51mYandex Database: Distributed Queries in the Clouds