Acceleration and Adaptive Selection in Asynchronous Iterative Solvers
Linear Algebra seminar by Evan Coleman, University of Mary Washington
Hosted by Institute for Computational and Experimental Research in Mathematics (ICERM), Brown University
Tuesday 14:30 New York (GMT-4)
Recording available
Abstract
Evan Coleman studies how asynchronous solvers can recover convergence quality while tolerating stale data, stragglers, and variable delays. At the coordinator, Anderson acceleration connects asynchronous stationary iterations to Krylov methods with changing preconditioners and flexible GMRES. Controlled-delay experiments on high-performance computing infrastructure show that its effectiveness depends on the iteration's coupling density. At the worker, residual-weighted randomized coordinate descent includes Boltzmann weights that interpolate between uniform and greedy selection while preserving convergence guarantees. Both approaches seek better use of computation when information is inconsistent.
Topics
Related seminars
Asynchronous Iterative Methods: From Numerical Solvers to Reinforcement Learning
Related research
Asynchronous preconditioners and linear solvers
Related research
Provable Convergence rate for Asynchronous methods via Randomized Gauss-Seidel
Related research