Skip to contentSkip to filters

We use cookies for analytics.

Meta-learning of Optimizers and Update Rules

Recording

47 min

Abstract

Jascha Sohl-Dickstein examines when a learned parameter update rule or loss can better match the desired behavior than a hand-designed one. He presents update rules for unsupervised representations, semi-supervised learning, data augmentation and classification, explores constraints that make some learned rules biologically plausible, and discusses failure modes and remedies when optimizing the rules themselves.

Topics