Action Outcome
action outcome
Dynamical population coding during defensive behaviours in prefrontal circuits
Coping with threatening situations requires both identifying stimuli predicting danger and selecting adaptive behavioral responses in order to survive. The dorso medial prefrontal cortex (dmPFC) is a critical structure involved in the regulation of threat-related behaviour, yet it is still largely unclear how threat-predicting stimuli and defensive behaviours are associated within prefrontal networks in order to successfully drive adaptive responses. To address these questions, we used a combination of extracellular recordings, neuronal decoding approaches, and optogenetic manipulations to show that threat representations and the initiation of avoidance behaviour are dynamically encoded in the overall population activity of dmPFC neurons. These data indicate that although dmPFC population activity at stimulus onset encodes sustained threat representations and discriminates threat- from non-threat cues, it does not predict action outcome. In contrast, transient dmPFC population activity prior to action initiation reliably predicts avoided from non-avoided trials. Accordingly, optogenetic inhibition of prefrontal activity critically constrained the selection of adaptive defensive responses in a time-dependent manner. These results reveal that the adaptive selection of active fear responses relies on a dynamic process of information linking threats with defensive actions unfolding within prefrontal networks.
Generalization guided exploration
How do people learn in real-world environments where the space of possible actions can be vast or even infinite? The study of human learning has made rapid progress in past decades, from discovering the neural substrate of reward prediction errors, to building AI capable of mastering the game of Go. Yet this line of research has primarily focused on learning through repeated interactions with the same stimuli. How are humans able to rapidly adapt to novel situations and learn from such sparse examples? I propose a theory of how generalization guides human learning, by making predictions about which unobserved options are most promising to explore. Inspired by Roger Shepard’s law of generalization, I show how a Bayesian function learning model provides a mechanism for generalizing limited experiences to a wide set of novel possibilities, based on the simple principle that similar actions produce similar outcomes. This model of generalization generates predictions about the expected reward and underlying uncertainty of unexplored options, where both are vital components in how people actively explore the world. This model allows us to explain developmental differences in the explorative behavior of children, and suggests a general principle of learning across spatial, conceptual, and structured domains.
Dynamical population coding during defensive behaviours in prefrontal circuits
Coping with threatening situations requires both identifying stimuli predicting danger and selecting adaptive behavioral responses in order to survive. The dorso medial prefrontal cortex (dmPFC) is a critical structure involved in the regulation of threat-related behaviour, yet it is still largely unclear how threat-predicting stimuli and defensive behaviours are associated within prefrontal networks in order to successfully drive adaptive responses. To address these questions, we used a combination of extracellular recordings, neuronal decoding approaches, and optogenetic manipulations to show that threat representations and the initiation of avoidance behaviour are dynamically encoded in the overall population activity of dmPFC neurons. These data indicate that although dmPFC population activity at stimulus onset encodes sustained threat representations and discriminates threat- from non-threat cues, it does not predict action outcome. In contrast, transient dmPFC population activity prior to action initiation reliably predicts avoided from non-avoided trials. Accordingly, optogenetic inhibition of prefrontal activity critically constrained the selection of adaptive defensive responses in a time-dependent manner. These results reveal that the adaptive selection of active fear responses relies on a dynamic process of information linking threats with defensive actions unfolding within prefrontal networks.
Sense of agency increases the neurophysiological impact of positive and negative action outcomes during goal-directed action
FENS Forum 2024