Richly structured reward predictions in dopaminergic learning circuits
National Institute of Mental Health at National Institutes of Health (NIH)
Event Information
Host
van Vreeswijk TNS
Duration
70 minutes
Abstract
Theories from reinforcement learning have been highly influential for interpreting neural activity in the biological circuits critical for animal and human learning. Central among these is the identification of phasic activity in dopamine neurons as a reward prediction error signal that drives learning in basal ganglia and prefrontal circuits. However, recent findings suggest that dopaminergic prediction error signals have access to complex, structured reward predictions and are sensitive to more properties of outcomes than learning theories with simple scalar value predictions might suggest. Here, I will present recent work in which we probed the identity-specific structure of reward prediction errors in an odor-guided choice task and found evidence for multiple predictive “threads” that segregate reward predictions, and reward prediction errors, according to the specific sensory features of anticipated outcomes. Our results point to an expanded class of neural reinforcement learning algorithms in which biological agents learn rich associative structure from their environment and leverage it to build reward predictions that include information about the specific, and perhaps idiosyncratic, features of available outcomes, using these to guide behavior in even quite simple reward learning tasks.
Topics
Related Seminars
Deciphering the Dynamics of the Unconscious Brain under General Anesthesia
Stanford Neurosciences Seminar Series talk by Emery Brown (Massachusetts Institute of Technology, Neuroscience Statistics Research Lab) on deciphering the dynamics of the unconscious brain under…
Engineering human myelination in vitro: Mechanobiologically compatible platforms for CNS drug discovery
UCL Department of Neuroinflammation Seminar by Professor Emad Moeendarbary (Professor of Cell Mechanics and Mechanobiology, UCL Mechanical Engineering) on how biophysical factors such as substrate…
Colloquium on the Brain and Cognition with Christopher Harvey, PhD, Harvard University
Picower Institute Colloquium on the Brain and Cognition featuring Christopher Harvey, PhD, of Harvard University, held in Singleton Auditorium (46-3002) at MIT Building 46, 43 Vassar Street.
Related Job Opportunities
PhD Studentship: Mitochondrial Metabolism and Novel Therapeutic Strategies for Metabolic Dysfunction-Associated Steatotic Liver Disease (MASLD) (Fixed Term)
Supervisors: Professor Andrew Murray, Department of Physiology, Development and Neuroscience, University of Cambridge Dr Ross Lindsay, Novo Nordisk Funding: Fully funded PhD studentship (Home/UK…
Research Associate (Fixed Term)
We seek a highly motivated Postdoctoral Research Associate to join the laboratory of Professor Kathy Niakan. We are based in the Loke Centre for Trophoblast Research (LCTR), in the Department of…
Research Assistant/Associate (Fixed Term)
Applications are invited for a postdoctoral research associate position to study the neural mechanisms of visual learning in mice, in the laboratories of Professor Ole Paulsen and Dr Jasper Poort…