Richly structured reward predictions in dopaminergic learning circuits
National Institute of Mental Health at National Institutes of Health (NIH)
Abstract
Theories from reinforcement learning have been highly influential for interpreting neural activity in the biological circuits critical for animal and human learning. Central among these is the identification of phasic activity in dopamine neurons as a reward prediction error signal that drives learning in basal ganglia and prefrontal circuits. However, recent findings suggest that dopaminergic prediction error signals have access to complex, structured reward predictions and are sensitive to more properties of outcomes than learning theories with simple scalar value predictions might suggest. Here, I will present recent work in which we probed the identity-specific structure of reward prediction errors in an odor-guided choice task and found evidence for multiple predictive “threads” that segregate reward predictions, and reward prediction errors, according to the specific sensory features of anticipated outcomes. Our results point to an expanded class of neural reinforcement learning algorithms in which biological agents learn rich associative structure from their environment and leverage it to build reward predictions that include information about the specific, and perhaps idiosyncratic, features of available outcomes, using these to guide behavior in even quite simple reward learning tasks.
Topics
Related Seminars
Finding Meaning in Memories
Daphna Shohamy and Ashok Litwin-Kumar bridge experimental and computational neuroscience to explain how the brain assigns significance to memories, how dopamine shapes memory-guided decisions, and…
Deciphering the Dynamics of the Unconscious Brain under General Anesthesia
Stanford Neurosciences Seminar Series talk by Emery Brown (Massachusetts Institute of Technology, Neuroscience Statistics Research Lab) on deciphering the dynamics of the unconscious brain under…
The Connectome in Use: From anatomical wiring to functional organization in the behaving C. elegans brain
Rani Borbara presents brain-wide recordings from more than 150 freely moving C. elegans to examine how anatomical connectivity becomes functional organization during behavior. Cross-animal models…
Related Job Opportunities
Postdoctoral Scientist - Sarvestani Lab
The Sarvestani Lab at Cornell University is recruiting a postdoctoral scientist in systems neuroscience to study how visual and motor systems across the brain and body support perception and…
PhD Studentship: Mitochondrial Metabolism and Novel Therapeutic Strategies for Metabolic Dysfunction-Associated Steatotic Liver Disease (MASLD) (Fixed Term)
Supervisors: Professor Andrew Murray, Department of Physiology, Development and Neuroscience, University of Cambridge Dr Ross Lindsay, Novo Nordisk Funding: Fully funded PhD studentship (Home/UK…
Research Associate (Fixed Term)
We seek a highly motivated Postdoctoral Research Associate to join the laboratory of Professor Kathy Niakan. We are based in the Loke Centre for Trophoblast Research (LCTR), in the Department of…