Complex Numbers in PyTorch
summary
PyTorch adds native complex dtypes complex64 and complex128 and exposes spectral routines via torch.fft; linear algebra and elementwise kernels now support matmul and SVD on CPU and CUDA with vectorized CPU kernels. Automatic differentiation implements conjugate/Wirtinger rules so existing optimizers work for real-valued objectives and custom complex grads are supported. Ongoing work targets JIT and distributed support and broader operator coverage plus integration into torchaudio.
AI-written summary · about
chapters (4)
related talks
13mAccelerating Complex-Valued Tensors With Torch.compile
04mLinear Algebra in PyTorch
12mLightning Talk: Simulating Quantum Systems with PyTorch
26mFrom NumPy to PyTorch, A Story of API Compatibility
25mmxfp8, mxfp4, nvfp4 formats and applications in PyTorch
19mIncreasing the Impact of AI Through Better Software (Pytorch Updates)
24mHow To Write C++ Extensions in 2026
19mGet to know PyTorch - a cutting edge open source AI framework for Machine Learning
