Skip to contentSkip to filters

We use cookies for analytics.

Scaling, Robustness and Continual Learning in Foundation Models: Recent Advances from the Autonomous AI Lab

Irina Rish

Université de Montréal and Mila – Quebec AI Institute

Recording

1 h 5 min

Abstract

Irina Rish surveys how foundation models scale, respond to shifts in their inputs and adapt without being retrained from scratch. The talk covers contextual time-series forecasting, efficient model architectures, preservation of intermediate representations for reasoning, out-of-distribution evaluation and methods for continual pretraining and compression.

Topics