Skip to contentSkip to filters

We use cookies for analytics.

Adam and friends via duality

Recording

1 h

Abstract

How do adaptive gradient methods such as Adam look in the dual formulation of an optimization problem? The talk derives and analyzes several methods through duality, showing relationships between them that are less apparent in the primal formulation. Examples emphasize linearly separable problems, with neural-network training as motivation.

Topics