Skip to content

The polar express: Optimal matrix sign methods and their application to the muon algorithm

Computational Mathematics seminar by David Persson, New York University

Hosted by Princeton University

Wednesday 12:00–13:00 New York (GMT-4)

Starts in 18 days

Princeton, NJ, USA

Abstract

David Persson presents Polar Express, a method for polar decomposition and the matrix sign function motivated by the Muon neural-network optimizer. It uses matrix multiplications suited to GPUs and adapts each polynomial update through a minimax problem to reduce worst-case error. The talk covers convergence, finite-precision implementation in bfloat16 and validation-loss improvements when training GPT-2 on FineWeb data. This is an in-person PACM IDeAS seminar at Princeton.

Topics

Show 1 more topic
FineWeb

We use cookies for analytics.