We are interested in understanding how the basal ganglia and the cerebellum interact during a sensori-motor task. To this end we use both experimental data (multiunit activity and behavior) and computational models. On one hand we will record multiunit neuronal activity in the cerebellum and basal ganglia while animals perform a motor task. On the other hand we will use computational models to understand how activity in one brain region affects the representation of task related activity in the other area. More info: https://www.kth.se/profile/arvindku/page/postdoctoral-researcher-position

Post-doctoral position in cellular and systems neuroscience The Evans Lab at Georgetown University is looking for a post-doctoral fellow for cellular and systems neuroscience research in an NIH BRAIN Initiative-funded position. This post-doc will use electrophysiology and two-photon calcium imaging with simultaneous optogenetics to probe dendritic integration and circuitry of the extended basal ganglia including brainstem and dopaminergic neurons of the substantia nigra pars compacta in healthy and Parkinson’s Disease model mice. In addition, in vivo optogenetics and fiber photometry will be used to probe these circuits during behavior. Experience in electrophysiology and/or microscopy is a plus, but we can train a highly-motivated person on these techniques. Start date is flexible. Please see the Evans lab website: https://sites.google.com/view/evans-lab/home and contact Dr. Evans at re285@georgetown.edu with a letter of interest and CV.

The laboratories of Dr. Richard Mooney (https://www.neuro.duke.edu/mooney-lab) and Dr. John Pearson (http://pearsonlab.github.io) at Duke University are seeking two (2) postdoctoral scholars in conjunction with an NIH BRAIN Initiative-funded project investigating the contributions of basal ganglia to vocal motor exploration and reinforcement learning. Candidates will combine state of the art viral, electrophysiological, imaging, and computational methods and work as part of a multi-institution team that also includes Dr. Carlos Lois, in the Division of Biology and Biological Engineering at CalTech, and Dr. Tim Gardner, in the Phil and Penny Knight Campus for Accelerating Scientific Impact at the University of Oregon. The first postdoc, appointed in the Department of Neurobiology (https://careers.duke.edu/job/Durham-POSTDOCTORAL-ASSOCIATE-NC-27710/681792500/), will use behavioral, optogenetic, electrophysiological and optical imaging methods to explore how cortico-basal ganglia circuits contribute to vocal exploration and learning. Previous experience with imaging and electrophysiological methods is desirable, and experience using viral gene transfer methods to monitor and manipulate neural activity will be especially helpful. Candidates with strong quantitative skills and an interest in developing or improving computational skills are especially desired. This postdoc will work closely with a related postdoc hire in the Department of Biostatistics & Bioinformatics, as well as team members across all institutions. The second postdoc, appointed in the Department of Biostatistics & Bioinformatics (https://careers.duke.edu/job/Durham-POSTDOCTORAL-ASSOCIATE-NC-27710/681799400/), will perform computational modeling of reinforcement learning in the birdsong system, including development of new statistical machine learning methods for the analysis of song, electrophysiology, and calcium imaging data. The postdoc will work closely with experimentalists to design studies, analyze data, and refine hypotheses. Candidates should hold a PhD in a quantitative discipline such as computational neuroscience, physics, statistics, or computer science. Previous experience in neurobiology is a plus but not required. This postdoc will work closely with a related postdoc hire in the Department of Neurobiology, as well as team members across the other institutions.

The Brain Modulation Laboratory within the Department of Neurosurgery at Massachusetts General Hospital seeks to recruit a highly motivated and outstanding candidate to fill a postdoctoral associate position. This 3 to 5-year position is funded through a recently awarded NIH-NINDS U01 grant to Principal Investigator Mark Richardson, MD, PhD. The successful candidate will work in a highly interdisciplinary team, studying the role of cortical-basal ganglia networks during speech production, based on the analysis of intra operative local field potential and micro-electrode recording data acquired in the context of Deep Brain Stimulation implantation surgery. Co-investigators include Frank Guenther (BU), Nathan Crone (Johns Hopkins), Lori Holt (CMU), Julie Fiez (Pitt), and Rob Turner (Pitt).

Doctoral studies in computational neuroscience, focusing on the neural mechanisms of embodied decision-making and action planning in humans and non-human primates. The research involves computational models of the nervous system integrated with behavioral experiments, transcranial magnetic stimulation, and multi-electrode recording in multiple regions of the cerebral cortex and basal ganglia. New projects will use virtual reality to study naturalistic behavior and develop theoretical models of distributed cortical and subcortical circuits.

Multiple open research positions at the Neural Computation Unit at OIST, including: 1. Theory and experimental investigation of Bayesian inference and reinforcement learning by the cortex, basal ganglia, and neuromodulator systems. 2. Data-driven construction of neural network models and large-scale simulation. 3. Application of wearable devices for monitoring mind and body state to support healthy life. 4. Flexible and robust reinforcement learning and meta-learning algorithms. 5. Development of smartphone robots for multi-agent learning and embodied evolution.

Brain organization and function is a complex topic. We are good at establishing correlates of perception and behavior across forebrain circuits, as well as manipulating activity in these circuits to affect behavior. However, we still lack good models for the large-scale organization and function of the forebrain. What are the contributions of the cortex, basal ganglia, and thalamus to behavior? In addressing these questions, we often ascribe function to each area as if it were an independent processing unit. However, we know from the anatomy that the cortex, basal ganglia, and thalamus, are massively interconnected in a large network. One way to generate insight into these questions is to consider the evolution and development of forebrain systems. In this talk, I will discuss the developmental and evolutionary (comparative anatomy) data on the thalamus, and how it fits within forebrain networks. I will address questions including, when did the thalamus appear in evolution, how is the thalamus organized across the vertebrate lineage, and how can the change in the organization of forebrain networks affect behavioral repertoires.

This webinar addressed computational perspectives on how animals and humans make decisions, spanning normative, descriptive, and mechanistic models. Sam Gershman (Harvard) presented a capacity-limited reinforcement learning framework in which policies are compressed under an information bottleneck constraint. This approach predicts pervasive perseveration, stimulus‐independent “default” actions, and trade-offs between complexity and reward. Such policy compression reconciles observed action stochasticity and response time patterns with an optimal balance between learning capacity and performance. Jonathan Pillow (Princeton) discussed flexible descriptive models for tracking time-varying policies in animals. He introduced dynamic Generalized Linear Models (Sidetrack) and hidden Markov models (GLM-HMMs) that capture day-to-day and trial-to-trial fluctuations in choice behavior, including abrupt switches between “engaged” and “disengaged” states. These models provide new insights into how animals’ strategies evolve under learning. Finally, Kenji Doya (OIST) highlighted the importance of unifying reinforcement learning with Bayesian inference, exploring how cortical-basal ganglia networks might implement model-based and model-free strategies. He also described Japan’s Brain/MINDS 2.0 and Digital Brain initiatives, aiming to integrate multimodal data and computational principles into cohesive “digital brains.”

On Thursday, May 25th we will host Darcy Diesburg and Mark Richardson. Darcy Diesburg, PhD, is a post-doctoral research fellow at Brown University. She will tell us about “Deep brain stimulation and action-stopping: A cognitive neuroscience perspective on the contributions of fronto-basal ganglia circuits to inhibitory control”. Mark Richardson, MD, PhD, is the Director of Functional Neurosurgery at the Massachusetts General Hospital, Charles Pappas Associate Professor of Neurosciences at Harvard Medical School and Visiting Associate Professor of Brain and Cognitive Sciences at MIT. Beside his scientific presentation on “Auditory input to the basal ganglia”, he will give us a glimpse at the “Person behind the science”. The talks will be followed by a shared discussion. You can register via talks.stimulatingbrains.org to receive the (free) Zoom link!

Theories from reinforcement learning have been highly influential for interpreting neural activity in the biological circuits critical for animal and human learning. Central among these is the identification of phasic activity in dopamine neurons as a reward prediction error signal that drives learning in basal ganglia and prefrontal circuits. However, recent findings suggest that dopaminergic prediction error signals have access to complex, structured reward predictions and are sensitive to more properties of outcomes than learning theories with simple scalar value predictions might suggest. Here, I will present recent work in which we probed the identity-specific structure of reward prediction errors in an odor-guided choice task and found evidence for multiple predictive “threads” that segregate reward predictions, and reward prediction errors, according to the specific sensory features of anticipated outcomes. Our results point to an expanded class of neural reinforcement learning algorithms in which biological agents learn rich associative structure from their environment and leverage it to build reward predictions that include information about the specific, and perhaps idiosyncratic, features of available outcomes, using these to guide behavior in even quite simple reward learning tasks.

I will discuss work with Jack Lindsey modeling reinforcement learning for action selection in the basal ganglia. I will argue that the presence of multiple brain regions, in addition to the basal ganglia, that contribute to motor control motivates the need for an off-policy basal ganglia learning algorithm. I will then describe a biological implementation of such an algorithm that predicts tuning of dopamine neurons to a quantity we call "action surprise," in addition to reward prediction error. In the same model, an implementation of learning from a motor efference copy also predicts a novel solution to the problem of multiplexing feedforward and efference-related striatal activity. The solution exploits the difference between D1 and D2-expressing medium spiny neurons and leads to predictions about striatal dynamics.

On Thursday, April 27th, we will host Hayriye Cagnan and Philip A. Starr. Hayriye Cagnan, PhD, is an associate professor at the MRC Brain Network Dynamics Unit and University of Oxford. She will tell us about “Therapies orchestrated by patients’ own rhythms”. Philip A. Starr, MD, PhD, is a neurosurgeon and professor of Neurological Surgery at the University of California San Francisco. Besides his scientific presentation on “My evolution in invasive human neurophysiology: from basal ganglia single units to chronic electrocorticography”, he will give us a glimpse at the person behind the science. The talks will be followed by a shared discussion. You can register via talks.stimulatingbrains.org to receive the (free) Zoom link!

On Wednesday, January 25th, at noon ET / 6PM CET, we will host Roxanne Lofredi and Hagai Bergman. Roxanne Lofredi, MD, is a research fellow in the Movement Disorders and Neuromodulation Unit at Charité Universitätsmedizin Berlin. Hagai Bergman, MD, PhD, is a Professor of Physiology in the Edmond and Lily Safra Center for Brain Research and Faculty of Medicine at the Hebrew University of Jerusalem, and is Simone and Bernard Guttman Chair in Brain Research. Beside his scientific presentation on “Beta oscillations in the basal ganglia: Past, Present and Future”, he will also give us a glimpse at the “Person behind the science”. The talks will be followed by a shared discussion. You can register via talks.stimulatingbrains.org to receive the (free) Zoom link!

Since Darwin, comparative research has shown that most animals share basic timing capacities, such as the ability to process temporal regularities and produce rhythmic behaviors. What seems to be more exclusive, however, are the capacities to generate temporal predictions and to display anticipatory behavior at salient time points. These abilities are associated with subcortical structures like basal ganglia (BG) and cerebellum (CE), which are more developed in humans as compared to nonhuman animals. In the first research line, we investigated the basic capacities to extract temporal regularities from the acoustic environment and produce temporal predictions. We did so by adopting a comparative and translational approach, thus making use of a unique EEG dataset including 2 macaque monkeys, 20 healthy young, 11 healthy old participants and 22 stroke patients, 11 with focal lesions in the BG and 11 in the CE. In the second research line, we holistically explore the functional relevance of body-brain physiological interactions in human behavior. Thus, a series of planned studies investigate the functional mechanisms by which body signals (e.g., respiratory and cardiac rhythms) interact with and modulate neurocognitive functions from rest and sleep states to action and perception. This project supports the effort towards individual profiling: are individuals’ timing capacities (e.g., rhythm perception and production), and general behavior (e.g., individual walking and speaking rates) influenced / shaped by body-brain interactions?

The basal ganglia are a collection of brain areas that are connected by a variety of synaptic pathways and are a site of significant reward-related dopamine release. These properties suggest a possible role for the basal ganglia in action selection, guided by reinforcement learning. In this talk, I will discuss a framework for how this function might be performed and computational results using an upward mapping to identify putative low-dimensional control ensembles that may be involved in tuning decision policy. I will also present some recent experimental results and theory – related to effects of extracellular ion dynamics -- that run counter to the classical view of basal ganglia pathways and suggest a new interpretation of certain aspects of this framework. For those not so interested in the basal ganglia, I hope that the upward mapping approach and impact of extracellular ion dynamics will nonetheless be of interest!

We all have a sense of time. Yet it is a particularly intangible sensation. So how is our “sense” of time represented in the brain? Functional neuroimaging studies have consistently identified a network of regions, including Supplementary Motor Area and basal ganglia, that are activated when participants make judgements about the duration of currently unfolding events. In parallel, left parietal cortex and cerebellum are activated when participants predict when future events are likely to occur. These structures are activated by temporal processing even when task goals are purely perceptual. So why should the perception of time be represented in regions of the brain that have more traditionally been implicated in motor function? One possibility is that we learn about time through action. In other words, action could provide the functional scaffolding for learning about time in childhood, explaining why it has come to be represented in motor circuits of the adult brain.

We have been developing Brain-Computer Interface (BCI) using electrocorticography (ECoG) [1] , which is recorded by electrodes implanted on brain surface, and magnetoencephalography (MEG) [2] , which records the cortical activities non-invasively, for the clinical applications. The invasive BCI using ECoG has been applied for severely paralyzed patient to restore the communication and motor function. The non-invasive BCI using MEG has been applied as a neurofeedback tool to modulate some pathological neural activities to treat some neuropsychiatric disorders. Although these techniques have been developed for clinical application, BCI is also an important tool to investigate neural function. For example, motor BCI records some neural activities in a part of the motor cortex to generate some movements of external devices. Although our motor system consists of complex system including motor cortex, basal ganglia, cerebellum, spinal cord and muscles, the BCI affords us to simplify the motor system with exactly known inputs, outputs and the relation of them. We can investigate the motor system by manipulating the parameters in BCI system. Recently, we are developing some BCIs to visualize and manipulate our perception and mental imagery. Although these BCI has been developed for clinical application, the BCI will be useful to understand our neural system to generate the perception and imagery. In this talk, I will introduce our study of phantom limb pain [3] , that is controlled by MEG-BCI, and the development of a communication BCI using ECoG [4] , that enable the subject to visualize the contents of their mental imagery. And I would like to discuss how much we can control our cortical activities that represent our perception and mental imagery. These examples demonstrate that BCI is a promising tool to visualize and manipulate the perception and imagery and to understand our consciousness. References 1. Yanagisawa, T., Hirata, M., Saitoh, Y., Kishima, H., Matsushita, K., Goto, T., Fukuma, R., Yokoi, H., Kamitani, Y., and Yoshimine, T. (2012). Electrocorticographic control of a prosthetic arm in paralyzed patients. AnnNeurol 71, 353-361. 2. Yanagisawa, T., Fukuma, R., Seymour, B., Hosomi, K., Kishima, H., Shimizu, T., Yokoi, H., Hirata, M., Yoshimine, T., Kamitani, Y., et al. (2016). Induced sensorimotor brain plasticity controls pain in phantom limb patients. Nature communications 7, 13209. 3. Yanagisawa, T., Fukuma, R., Seymour, B., Tanaka, M., Hosomi, K., Yamashita, O., Kishima, H., Kamitani, Y., and Saitoh, Y. (2020). BCI training to move a virtual hand reduces phantom limb pain: A randomized crossover trial. Neurology 95, e417-e426. 4. Ryohei Fukuma, Takufumi Yanagisawa, Shinji Nishimoto, Hidenori Sugano, Kentaro Tamura, Shota Yamamoto, Yasushi Iimura, Yuya Fujita, Satoru Oshino, Naoki Tani, Naoko Koide-Majima, Yukiyasu Kamitani, Haruhiko Kishima (2022). Voluntary control of semantic neural representations by imagery with conflicting visual stimulation. arXiv arXiv:2112.01223.

To survive in a rapidly dynamic world, the brain predicts the future state of the world and proactively adjusts perception, attention and action. A key to efficient interaction is to predict and prepare to not only “where” and “what” things will happen, but also to “when”. I will present studies in healthy and neurological populations that investigated the cognitive architecture and neural basis of temporal anticipation. First, influential ‘entrainment’ models suggest that anticipation in rhythmic contexts, e.g. music or biological motion, uniquely relies on alignment of attentional oscillations to external rhythms. Using computational modeling and EEG, I will show that cortical neural patterns previously associated with entrainment in fact overlap with interval timing mechanisms that are used in aperiodic contexts. Second, temporal prediction and attention have commonly been associated with cortical circuits. Studying neurological populations with subcortical degeneration, I will present data that point to a double dissociation between rhythm- and interval-based prediction in the cerebellum and basal ganglia, respectively, and will demonstrate a role for the cerebellum in attentional control of perceptual sensitivity in time. Finally, using EEG in neurodegenerative patients, I will demonstrate that the cerebellum controls temporal adjustment of cortico-striatal neural dynamics, and use computational modeling to identify cerebellar-controlled neural parameters. Altogether, these findings reveal functionally and neural context-specificity and subcortical contributions to temporal anticipation, revising our understanding of dynamic cognition.

The basal ganglia are a collection of brain areas that are connected by a variety of synaptic pathways and are a site of significant reward-related dopamine release. These properties suggest a possible role for the basal ganglia in action selection, guided by reinforcement learning. In this talk, I will discuss a framework for how this function might be performed. I will also present some recent experimental results and theory that call for a re-evaluation of certain aspects of this framework. Next, I will turn to the changes in basal ganglia activity observed to occur with the dopamine depletion associated with Parkinson’s disease. I will discuss some of the potential functional implications of some of these changes and, if time permits, will conclude with some new results that focus on delta oscillations under dopamine depletion.

Recent success in training artificial agents and robots derives from a combination of direct learning of behavioral policies and indirect learning via value functions. Policy learning and value learning employ distinct algorithms that depend upon evaluation of errors in performance and reward prediction errors, respectively. In mammals, behavioral learning and the role of mesolimbic dopamine signaling have been extensively evaluated with respect to reward prediction errors; but there has been little consideration of how direct policy learning might inform our understanding. I’ll discuss our recent work on classical conditioning in naïve mice (https://www.biorxiv.org/content/10.1101/2021.05.31.446464v1) that provides multiple lines of evidence that phasic dopamine signaling regulates policy learning from performance errors in addition to its well-known roles in value learning. This work points towards new opportunities for unraveling the mechanisms of basal ganglia control over behavior under both adaptive and maladaptive learning conditions.

The main pillars of social behaviors involve (1) mating, where males copulate with female partners to reproduce, and (2) aggression, where males fight conspecific male competitors in territory guarding. Decades of study have identified two key regions in the hypothalamus, the medial preoptic nucleus (MPN) and the ventrolateral part of ventromedial hypothalamus (VMHvl) , that are essential for male sexual and aggressive behaviors, respectively. However, it remains ambiguous what area directs excitatory control of the hypothalamic activity and generates the initiation signal for social behaviors. Through neural tracing, in vivo optical recording and functional manipulations, we identified the estrogen receptor alpha (Esr1)-expressing cells in the posterior amygdala (PA) as a main source of excitatory inputs to the MPN and VMHvl, and key hubs in mating and fighting circuits in males. Importantly, two spatially-distinct populations in the PA regulate male sexual and aggressive behaviors, respectively. Moreover, these two subpopulations in the PA display differential molecular phenotypes, projection patterns and in vivo neural responses. Our work also observed the parallels between these social behavior circuits and basal ganglia circuits to control motivated behaviors, which Larry Swanson (2000) originally proposed based on extensive developmental and anatomical evidence.