Programming Abstractions for Orchestration of HPC Scientific Computing
summary
Claim: an orchestration layer built from unit-level metadata lets a legacy 1.5M‑line Fortran codebase be reconfigured and partially transpiled to target devices without rewriting core solvers. Implementation: Python setup script, config files as a DSL that encode unit dependencies, new task composer + transpiler prototype (collab with Tokyo Institute of Technology) that emits high‑level code and a lightweight runtime that spawns threads for data movement. Status: early prototype with decorated code snippets and open questions about ghost‑cell fusion, but feasible for many kernels.
AI-written summary · about
chapters (24)
- 0:00Start
- 3:24SETTING THE STAGE
- 5:19SCIENCE CODE DEVELOPMENT
- 8:19THERE IS MORE
- 10:08ARCHITECTING SCIENTIFIC CODES
- 15:03DESIGN APPROACH
- 16:56SEPARATION OF CONCERNS
- 17:43DESIGN PHILOSOPHY
- 19:59INTERACTION BETWEEN INFRASTRUCTURE AND PHYSICS
- 22:13Example Software: FLASH
- 23:37SCIENCE USING FLASH
- 24:53FLASH CODE BASICS
- 26:23DESIGN CONSIDERATIONS
- 26:47ENCAPSULATION
- 28:10EXTENSIBILITY ADD A UNIT
- 31:06COMPOSABILITY
- 31:46COMPOSITION
- 33:00CODE TRANSFORMATION
- 35:20ORCHESTRATION SYSTEM
- 35:55CONFIG FILES
- 37:43CONFIGURATION
- 42:15OUR VISION
- 43:38RUNTIME ORCHESTRATION
- 44:07BUILDING THE CODE
related talks
39mBuilding Scalable Orchestration
25mPipeline-level differentiable programming for the real world
01h 19mCo-Design for High-Performance Computing Software Systems
01h 21mAfter Reflection: The Runtime Story
20mPractical Runtime Instrumentation of Software Languages: the Case of SciHook
29mTaming the Circus: The Future of Power System Planning Model Interoperability
01h 02mProgram Manipulation of C Code
01h 11mProgramming for the planet