The polar express: Optimal matrix sign methods and their application to the muon algorithm
New York University
Check the official event for registration, eligibility and attendance details.
Abstract
David Persson presents Polar Express, a method for polar decomposition and the matrix sign function motivated by the Muon neural-network optimizer. It uses matrix multiplications suited to GPUs and adapts each polynomial update through a minimax problem to reduce worst-case error. The talk covers convergence, finite-precision implementation in bfloat16 and validation-loss improvements when training GPT-2 on FineWeb data. This is an in-person PACM IDeAS seminar at Princeton.
Related Seminars
AI for the Sciences: towards understanding
More in Artificial Intelligence
CMSP News and Views Seminar Series: Exploring alternatives to digital artificial neural networks
More in Artificial Intelligence
Harnessing AI/ML for intelligent decision making in cell and gene therapy manufacturing
More in Artificial Intelligence