Domains featuring this topic
Explore the domains where this topic appears.
How do we sleep?
There is no consensus on if sleep is for the brain, body or both. But the difference in how we feel following disrupted sleep or having a good night of continuous sleep is striking. Understanding how and why we sleep will likely give insights into many aspects of health. In this talk I will outline our recent work on how the prefrontal cortex can signal to the hypothalamus to regulate sleep preparatory behaviours and sleep itself, and how other brain regions, including the ventral tegmental area, respond to psychosocial stress to induce beneficial sleep. I will also outline our work on examining the function of the glymphatic system, and whether clearance of molecules from the brain is enhanced during sleep or wakefulness.
Learning to Express Reward Prediction Error-like Dopaminergic Activity Requires Plastic Representations of Time
The dominant theoretical framework to account for reinforcement learning in the brain is temporal difference (TD) reinforcement learning. The TD framework predicts that some neuronal elements should represent the reward prediction error (RPE), which means they signal the difference between the expected future rewards and the actual rewards. The prominence of the TD theory arises from the observation that firing properties of dopaminergic neurons in the ventral tegmental area appear similar to those of RPE model-neurons in TD learning. Previous implementations of TD learning assume a fixed temporal basis for each stimulus that might eventually predict a reward. Here we show that such a fixed temporal basis is implausible and that certain predictions of TD learning are inconsistent with experiments. We propose instead an alternative theoretical framework, coined FLEX (Flexibly Learned Errors in Expected Reward). In FLEX, feature specific representations of time are learned, allowing for neural representations of stimuli to adjust their timing and relation to rewards in an online manner. In FLEX dopamine acts as an instructive signal which helps build temporal models of the environment. FLEX is a general theoretical framework that has many possible biophysical implementations. In order to show that FLEX is a feasible approach, we present a specific biophysically plausible model which implements the principles of FLEX. We show that this implementation can account for various reinforcement learning paradigms, and that its results and predictions are consistent with a preponderance of both existing and reanalyzed experimental data.