Skip to contentSkip to filters

We use cookies for analytics.

Seminar, Hosted by Princeton University

The polar express: Optimal matrix sign methods and their application to the muon algorithm

David Persson

New York University

Related content

Abstract

David Persson presents Polar Express, a method for polar decomposition and the matrix sign function motivated by the Muon neural-network optimizer. It uses matrix multiplications suited to GPUs and adapts each polynomial update through a minimax problem to reduce worst-case error. The talk covers convergence, finite-precision implementation in bfloat16 and validation-loss improvements when training GPT-2 on FineWeb data. This is an in-person PACM IDeAS seminar at Princeton.

Topics

Details

Location

Princeton, United States