CT Sun, AIC & Pompey Nagra, Solidigm | NVIDIA GTC 2026
summary
AIC lays out a tiered storage stack from GPU-local G3 to a new G3.5 content memory extension for overflowing KV caches, claiming each inference GPU can need 4 TB KV cache and projecting NVIDIA’s 100 million inference GPUs could drive roughly 10× current storage demand. BlueField‑4 (Vera 64 cores + CX9 + LPDDR5X) is positioned to enable low‑latency disaggregated architectures, while Solidigm’s E1.S/E3.S liquid‑cooled NVMe drives and PCIe Gen6/7 bandwidth are the practical building blocks; supply shortfalls may persist 2–3 years.
AI-written summary · about
