Cookies
We use essential cookies to run the site. Analytics cookies are optional and help us improve World Wide. Learn more.
Dr
DeepMind
Showing your local timezone
Schedule
Wednesday, March 13, 2024
1:00 PM Europe/London
Domain
NeuroscienceHost
NeuroAI UCL
Duration
70 minutes
Nonstationarity presents a variety of challenges for machine learning systems. One surprising pathology which can arise in nonstationary learning problems is plasticity loss, whereby making progress on new learning objectives becomes more difficult as training progresses. Networks which are unable to adapt in response to changes in their environment experience plateaus or even declines in performance in highly non-stationary domains such as reinforcement learning, where the learner must quickly adapt to new information even after hundreds of millions of optimization steps. The loss of plasticity manifests in a cluster of related empirical phenomena which have been identified by a number of recent works, including the primacy bias, implicit under-parameterization, rank collapse, and capacity loss. While this phenomenon is widely observed, it is still not fully understood. This talk will present exciting recent results which shed light on the mechanisms driving the loss of plasticity in a variety of learning problems and survey methods to maintain network plasticity in non-stationary tasks, with a particular focus on deep reinforcement learning.
Clare Lyle
Dr
DeepMind
neuro
Nervous system function relies on the polarized architecture of neurons, established by directional transport of pre- and postsynaptic cargoes. While delivery of postsynaptic components depends on the
neuro
A combinatorial neural code for long-term motor memory
neuro
The postdoctoral researcher will work on an interdisciplinary project at the intersection of deep learning and comparative politics. The candidate will work in the Human-Centered Machine Learning (HuM
We are looking for highly motivated researchers to join our group in interdisciplinary projects that focus on the development of computational models to understand how linguistic information is repres
The CSNG Lab at the Faculty of Mathematics and Physics at the Charles University is seeking a highly motivated Postdoctoral Researcher to join our team to work on a digital twin model of the visual sy
PROJECT SUMMARY / ABSTRACT Cluster headache (CH), which affects about 1 in 1,000 people, is a severe and debilitating primary headache disorder characterized by repeated attacks occurring in clusters