File IO - Past, Present and Future
summary
Covers forty years of file IO with concrete claims: buffered stdio/std::fstream copies cost ~4KB default buffers and get worse as NVMe latency drops; unbuffered memory‑map the file removes kernel→user copies, lets a background thread touch pages to hide loading screens, and saved one hacky experiment (read ~400KB from a 360KB floppy in 9s). Shows Windows SDK APIs (CreateFile/MapView), cites proposals Hash‑embed (P1040) and std mapped file handles (P883/P1031), and notes DirectStorage needs Win11 + RTX 3090.
AI-written summary · about
chapters (14)
- 0:00Introduction
- 4:14Why files exist
- 13:12Cassette to floppy disks
- 23:55Hard disks and file systems
- 29:36POSIX standards
- 33:56C++ file system standards
- 43:49Efficient RAM data movement
- 55:56Modern IO challenges
- 1:00:0864-bit address spaces
- 1:07:13Memory-mapped files
- 1:13:50Storage growth and C++
- 1:17:21Build pipelines
- 1:20:51Hash embed and compile-time resources
- 1:22:37Future of file IO
related talks
01h 01mWhat’s In A Bit – Designing, Using And Reverse-engineering Binary File Formats
01h 04mBetter mutual exclusion on the filesystem using Boost.AFIO
55mAbusing Your Memory Model for Fun and Profit
01h 23mElsewhere Memory (C++20 Abstract Machine) + Virtual Memory
05mMaximising Throughput & Minimising Latency in High-Performance C++ Code
20mMeasuring the Overhead of iostreams: What Is the Difference?
27mRebuilding a Faster OSD with Future
57mThis Videogame Programmer Used the STL and You Will Never Guess What Happened Next