The dominant theoretical framework to account for reinforcement learning in the brain is temporal difference (TD) reinforcement learning. The TD framework predicts that some neuronal elements should represent the reward prediction error (RPE), which means they signal the difference between the expected future rewards and the actual rewards. The prominence of the TD theory arises from the observation that firing properties of dopaminergic neurons in the ventral tegmental area appear similar to those of RPE model-neurons in TD learning. Previous implementations of TD learning assume a fixed temporal basis for each stimulus that might eventually predict a reward. Here we show that such a fixed temporal basis is implausible and that certain predictions of TD learning are inconsistent with experiments. We propose instead an alternative theoretical framework, coined FLEX (Flexibly Learned Errors in Expected Reward). In FLEX, feature specific representations of time are learned, allowing for neural representations of stimuli to adjust their timing and relation to rewards in an online manner. In FLEX dopamine acts as an instructive signal which helps build temporal models of the environment. FLEX is a general theoretical framework that has many possible biophysical implementations. In order to show that FLEX is a feasible approach, we present a specific biophysically plausible model which implements the principles of FLEX. We show that this implementation can account for various reinforcement learning paradigms, and that its results and predictions are consistent with a preponderance of both existing and reanalyzed experimental data.

The arousal construct underlies a spectrum of behaviors that include sleep, exploration, feeding, sexual activity and adaptive stress. Pathological arousal conditions include stress, anxiety disorders, and addiction. The dynamics between arousal state transitions are modulated by norepinephrine neurons in the locus coeruleus, histaminergic neurons in the hypothalamus, dopaminergic neurons in the mesencephalon and cholinergic neurons in the basal forebrain. The hypocretin/orexin system in the lateral hypothalamus I will also present a new mechanism underlying sleep fragmentation during aging. Hcrt neurons are hyperexcitable in aged mice. We identify a potassium conductance known as the M-current, as a critical player in maintaining excitability of Hcrt neurons. Genetic disruption of KCNQ channels in Hcrt neurons of young animals results in sleep fragmentation. In contrast, treatment of aged animals with a KCNQ channel opener restores sleep/wake architecture. These data point to multiple circuits modulating sleep integrity across lifespan.

Conventionally, neurons are thought to be cellular units that process synaptic inputs into synaptic spikes. However, it is well known that neurons can also spike spontaneously and display a rich repertoire of firing properties with no apparent functional relevance e.g. in in vitro cortical slice preparations. In this talk, I will propose a hypothesis according to which intrinsic excitability in neurons may be a survival mechanism to minimize toxic byproducts of the cell’s energy metabolism. In neurons, this toxicity can arise when mitochondrial ATP production stalls due to limited ADP. Under these conditions, electrons deviate from the electron transport chain to produce reactive oxygen species, disrupting many cellular processes and challenging cell survival. To mitigate this, neurons may engage in ADP-producing metabolic spikes. I will explore the validity of this hypothesis using computational models that illustrate the implications of synaptic and metabolic spiking, especially in the context of substantia nigra pars compacta dopaminergic neurons and their degeneration in Parkinson's disease.

Can alterations in experience trigger different plastic modifications in neuronal structure and function, and if so, how do they integrate at the cellular level? To address this question, we interrogated circuitry in the mouse olfactory bulb responsible for the earliest steps in odor processing. We induced experience-dependent plasticity in mice of either sex by blocking one nostril for one day, a minimally invasive manipulation that leaves the sensory organ undamaged and is akin to the natural transient blockage suffered during common mild rhinal infections. We found that such brief sensory deprivation produced structural and functional plasticity in one highly specialized bulbar cell type: axon-bearing dopaminergic neurons in the glomerular layer. After 24 h naris occlusion, the axon initial segment (AIS) in bulbar dopaminergic neurons became significantly shorter, a structural modification that was also associated with a decrease in intrinsic excitability. These effects were specific to the AIS-positive dopaminergic subpopulation because no experience-dependent alterations in intrinsic excitability were observed in AIS-negative dopaminergic cells. Moreover, 24 h naris occlusion produced no structural changes at the AIS of bulbar excitatory neurons, mitral/tufted and external tufted cells, nor did it alter their intrinsic excitability. By targeting excitability in one specialized dopaminergic subpopulation, experience-dependent plasticity in early olfactory networks might act to fine-tune sensory processing in the face of continually fluctuating inputs. (https://www.jneurosci.org/content/41/10/2135)

Drosophila can learn to associate odours with reward or punishment and the resulting memories direct odour-specific approach or avoidance behaviours. Recent progress has revealed a straightforward model for learning in which reinforcing dopaminergic neurons assign valence to odour representations in the neural ensemble of the mushroom bodies. Dopamine directed synaptic depression alters the route of odour-driven activity through the mushroom body output network. This circuit configuration and influence of internal state guide the expression of appropriate behaviour. Importantly, learned behaviour is flexible and can be updated as the fly accumulates additional experience. Our latest studies demonstrate that well-informed behaviour is guided by combining parallel conflicting and complementary memories of opposite valence.

Parkinson's disease (PD) is the second most present neurodegenerative disease in the world after Alzheimer's. It is due to the progressive and irreversible loss of dopaminergic neurons of the substantia nigra Pars Compacta. Alpha synuclein deposits and the appearance of Lewi bodies are systematically associated with it. PD is characterized by four cardinal motor symptoms: bradykinesia / akinesia, rigidity, postural instability and tremors at rest. These symptoms appear when 80% of the dopaminergic endings disappear in the striatum. According to Braak's theory, non-motor symptoms appear much earlier and this is particularly the case with anxiety, depression, anhedonia, and sleep disturbances. In 90 to 95% of cases, the causes of the appearance of the disease remain unknown, but polluting toxic molecules are incriminated more and more. In Africa, neurodegenerative diseases of the Parkinson's type are increasingly present and a parallel seems to exist between the increase in cases and the presence of toxic and polluting products such as metals. My Web conference will focus on this aspect, i.e. present experimental arguments which reinforce the hypothesis of the incrimination of these pollutants in the incidence of Parkinson's disease and / or Parkinsonism. Among the lines of research that we have developed in my laboratory in Rabat, Morocco, I have chosen this one knowing that many of our PhD students and IBRO Alumni are working or trying to develop scientific research on neurotoxicity in correlation with pathologies of the brain.

Parkinson’s disease is affects millions of people around the world. The disease is characterized by typical movement defects that are caused by the loss of dopaminergic neurons, but several very debilitating non-motor symptoms occur more than 10 years before the motor symptoms. I will discuss how we study these non-motor symptoms including sleep disturbances and olfactory defects using large collections of knock in fruit flies that model the numerous familial forms of Parkinson’s disease as well as using human iPS cells from patients. A common emerging theme are defects in protein homeostasis that in specific neuronal cell types, cause cellular defects that explain the Parkinson-relevant phenotypes. Our work reveals the mechanisms that cause early defects in Parkinson’s disease and it opens therapeutic avenues to start tackling this disease.