A role for dopamine in value-free learning
Dudman lab, HHMI Janelia
Recording
Abstract
Recent success in training artificial agents and robots derives from a combination of direct learning of behavioral policies and indirect learning via value functions. Policy learning and value learning employ distinct algorithms that depend upon evaluation of errors in performance and reward prediction errors, respectively. In mammals, behavioral learning and the role of mesolimbic dopamine signaling have been extensively evaluated with respect to reward prediction errors; but there has been little consideration of how direct policy learning might inform our understanding. I’ll discuss our recent work on classical conditioning in naïve mice (https://www.biorxiv.org/content/10.1101/2021.05.31.446464v1) that provides multiple lines of evidence that phasic dopamine signaling regulates policy learning from performance errors in addition to its well-known roles in value learning. This work points towards new opportunities for unraveling the mechanisms of basal ganglia control over behavior under both adaptive and maladaptive learning conditions.
Topics
Related Seminars
Finding Meaning in Memories
Daphna Shohamy and Ashok Litwin-Kumar bridge experimental and computational neuroscience to explain how the brain assigns significance to memories, how dopamine shapes memory-guided decisions, and…
Deciphering the Dynamics of the Unconscious Brain under General Anesthesia
Stanford Neurosciences Seminar Series talk by Emery Brown (Massachusetts Institute of Technology, Neuroscience Statistics Research Lab) on deciphering the dynamics of the unconscious brain under…
The Connectome in Use: From anatomical wiring to functional organization in the behaving C. elegans brain
Rani Borbara presents brain-wide recordings from more than 150 freely moving C. elegans to examine how anatomical connectivity becomes functional organization during behavior. Cross-animal models…
Related Job Opportunities
PhD Studentship: Mitochondrial Metabolism and Novel Therapeutic Strategies for Metabolic Dysfunction-Associated Steatotic Liver Disease (MASLD) (Fixed Term)
Supervisors: Professor Andrew Murray, Department of Physiology, Development and Neuroscience, University of Cambridge Dr Ross Lindsay, Novo Nordisk Funding: Fully funded PhD studentship (Home/UK…
Postdoctoral Scientist - Sarvestani Lab
The Sarvestani Lab at Cornell University is recruiting a postdoctoral scientist in systems neuroscience to study how visual and motor systems across the brain and body support perception and…
ARISE2 Postdoctoral Fellowship - 2026 Call for Applications
EMBL's ARISE2 programme offers more than 20 fully funded, three-year postdoctoral fellowships for scientists developing research-infrastructure technologies across the life sciences, including…