DimWit - Tensor programming with wit
summary
DimWit implements named tensor notation in Scala by encoding dimension names in types, letting the compiler verify axis-aligned operations; it wraps JAX via Scala Py and avoids reimplementing autodiff, JIT, or GPU code. Tracing overhead rises modestly (roughly 1s to 2s) but runtime uses JIT-compiled native code, so execution cost is unchanged. A full trained GPT-2 124M model is trained on 10 billion tokens in about three days on a DGX Spark GPU and runs on par with JAX.
AI-written summary · about
