RISC-V: Changing the Way AI/ML Accelerators and Computing Infrastructure Are Built

on YouTube ↗19m

" summary

Stream Computing describes an AME matrix extension built as tile/block matrix instructions with an 8+8 register design, elemental-wise ops and RVV-decoupled semantics, plus an open-source repo moving from v0.2 to v0.5. A mass-production STCP920 NPU card (FP16/INT8) ships thousands of units since 2022 and runs a full LLVM/AI-compiler stack with operator ports and an RVV/Matrix-enabled runtime. That stack powers a deployed large-model service—a 1,000P computing center project using 1,000 NPU cards (now ~150P live) and a 5,000-category knowledge graph for smart-community NLP.

AI-written summary · about

" chapters (7)

1. 0:00Introduction to AI and RISC-V
2. 2:30Matrix extension development
3. 8:17Implementation and evaluation
4. 9:40Stream Computing products
5. 10:36Software stack and compiler
6. 14:48Smart community case study
7. 17:19Talent cultivation and closing

" related talks

• 13mKeynote: Taking RISC-V Intelligence EverywhereCharlie Su · RISC-V Summit North America 2023
• 22mAdvancing AI Computing With Optimized Matrix Multiplication Techniques With RISC-V CPUChun-Nan Ke, Heng-Kuan Lee · RISC-V Summit North America 2023
• 19mAccelerating Edge AI with the Help of RISC-VFlorian Zaruba · RISC-V Summit North America 2023
• 09mLightning Talk: RISC-V and AI: How an Open-Standards ISA Underpins Portability f...Philipp Tomsich · Open Source Summit Europe 2024: Open AI + Data Forum
• 30mRISC-V: Enabling Open Physical AILuca Benini · RISC-V Summit Europe 2026
• 09mA Tightly Coupled Light Weight Neural Network Processing Units With RISC V CoreLei Zhang · 7th RISC-V Workshop 2017
• 40mAdvancing AI Application Development on RISC-V PlatformsYuning Liang · Open Source Summit Europe 2025
• 17mRISC-V is Ready for Powering the Era of Intelligent General ComputingCharlie Su · RISC-V Summit North America 2025