Mathematical Modeling seminars

Cognitive maps confer animals with flexible intelligence by representing spatial, temporal, and abstract relationships that can be used to shape thought, planning, and behavior. Cognitive maps have been observed in the hippocampus, but their algorithmic form and the processes by which they are learned remain obscure. Here, we employed large-scale, longitudinal two-photon calcium imaging to record activity from thousands of neurons in the CA1 region of the hippocampus while mice learned to efficiently collect rewards from two subtly different versions of linear tracks in virtual reality. The results provide a detailed view of the formation of a cognitive map in the hippocampus. Throughout learning, both the animal behavior and hippocampal neural activity progressed through multiple intermediate stages, gradually revealing improved task representation that mirrored improved behavioral efficiency. The learning process led to progressive decorrelations in initially similar hippocampal neural activity within and across tracks, ultimately resulting in orthogonalized representations resembling a state machine capturing the inherent struture of the task. We show that a Hidden Markov Model (HMM) and a biologically plausible recurrent neural network trained using Hebbian learning can both capture core aspects of the learning dynamics and the orthogonalized representational structure in neural activity. In contrast, we show that gradient-based learning of sequence models such as Long Short-Term Memory networks (LSTMs) and Transformers do not naturally produce such orthogonalized representations. We further demonstrate that mice exhibited adaptive behavior in novel task settings, with neural activity reflecting flexible deployment of the state machine. These findings shed light on the mathematical form of cognitive maps, the learning rules that sculpt them, and the algorithms that promote adaptive behavior in animals. The work thus charts a course toward a deeper understanding of biological intelligence and offers insights toward developing more robust learning algorithms in artificial intelligence.

The neurobiological mechanisms of arousal and anesthesia remain poorly understood. Recent evidence highlights the key role of interactions between the cerebral cortex and the diffusely projecting matrix thalamic nuclei. Here, we interrogate these processes in a whole-brain corticothalamic neural mass model endowed with targeted and diffusely projecting thalamocortical nuclei inferred from empirical data. This model captures key features seen in propofol anesthesia, including diminished network integration, lowered state diversity, impaired susceptibility to perturbation, and decreased corticocortical coherence. Collectively, these signatures reflect a suppression of information transfer across the cerebral cortex. We recover these signatures of conscious arousal by selectively stimulating the matrix thalamus, recapitulating empirical results in macaque, as well as wake-like information processing states that reflect the thalamic modulation of largescale cortical attractor dynamics. Our results highlight the role of matrix thalamocortical projections in shaping many features of complex cortical dynamics to facilitate the unique communication states supporting conscious awareness.

Like all neural tissue, the retina has a high metabolic demand, and requires a constant supply of oxygen. Second and third order neurons are supplied by the retinal circulation, whose characteristics are similar to brain circulation. However, the photoreceptor region, which occupies half of the retinal thickness, is avascular, and relies on diffusion of oxygen from the choroidal circulation, whose properties are very different, as well as the retinal circulation. By fitting diffusion models to oxygen measurements made with oxygen microelectrodes, it is possible to understand the relative roles of the two circulations under normal conditions of light and darkness, and what happens if the retina is detached or the retinal circulation is occluded. Most of this work has been done in vivo in rat, cat, and monkey, but recent work in the isolated mouse retina will also be discussed.

Intelligent behavior depends on the brain’s ability to anticipate future events. However, the learning rules that enable neurons to predict and fire ahead of sensory inputs remain largely unknown. We propose a plasticity rule based on pre-dictive processing, where the neuron learns a low-rank model of the synaptic input dynamics in its membrane potential. Neurons thereby amplify those synapses that maximally predict other synaptic inputs based on their temporal relations, which provide a solution to an optimization problem that can be implemented at the single-neuron level using only local information. Consequently, neurons learn sequences over long timescales and shift their spikes towards the first inputs in a sequence. We show that this mechanism can explain the development of anticipatory motion signaling and recall in the visual system. Furthermore, we demonstrate that the learning rule gives rise to several experimentally observed STDP (spike-timing-dependent plasticity) mechanisms. These findings suggest prediction as a guiding principle to orchestrate learning and synaptic plasticity in single neurons.

Activity dependent synaptic plasticity is considered to be a primary mechanism underlying learning and memory. Yet it is unclear whether plasticity rules such as STDP measured in vitro apply in vivo. Network models with STDP predict that activity patterns (e.g., place-cell spatial selectivity) should change much faster than observed experimentally. We address this gap by investigating a nonlinear calcium-based plasticity rule fit to experiments done in physiological conditions. In this model, LTP and LTD result from intracellular calcium transients arising almost exclusively from synchronous coactivation of pre- and postsynaptic neurons. We analytically approximate the full distribution of nonlinear calcium transients as a function of pre- and postsynaptic firing rates, and temporal correlations. This analysis directly relates activity statistics that can be measured in vivo to the changes in synaptic efficacy they cause. Our results highlight that both high-firing rates and temporal correlations can lead to significant changes to synaptic efficacy. Using a mean-field theory, we show that the nonlinear plasticity rule, without any fine-tuning, gives a stable, unimodal synaptic weight distribution characterized by many strong synapses which remain stable over long periods of time, consistent with electrophysiological and behavioral studies. Moreover, our theory explains how memories encoded by strong synapses can be preferentially stabilized by the plasticity rule. We confirmed our analytical results in a spiking recurrent network. Interestingly, although most synapses are weak and undergo rapid turnover, the fraction of strong synapses are sufficient for supporting realistic spiking dynamics and serve to maintain the network’s cluster structure. Our results provide a mechanistic understanding of how stable memories may emerge on the behavioral level from an STDP rule measured in physiological conditions. Furthermore, the plasticity rule we investigate is mathematically equivalent to other learning rules which rely on the statistics of coincidences, so we expect that our formalism will be useful to study other learning processes beyond the calcium-based plasticity rule.

One of Tali's cherished goals was to transform biology into physics. In his view, biologists were far too enamored by the details of the specific models they studied, losing sight of the big principles that may govern the behavior of these models. One such big principle that he suggested was the 'information bottleneck (IB) principle'. The iIB principle is an information-theoretical approach for extracting the relevant information that one random variable carries about another. Tali applied the IB principle to numerous problems in biology, gaining important insights in the process. Here I will describe two applications of the IB principle to neurobiological data. The first is the formalization of the notion of surprise that allowed us to rigorously estimate the memory duration and content of neuronal responses in auditory cortex, and the second is an application to behavior, allowing us to estimate 'optimal policies under information constraints' that shed interesting light on rat behavior.

CA3-CA1 synapses in the hippocampus are the initial locus of episodic memory. The action of acetylcholine alters cellular excitability, modifies neuronal networks, and triggers secondary signaling that directly affects long-term plasticity (LTP) (the cellular underpinning of memory). It is therefore considered a critical regulator of learning and memory in the brain. Its action via M4 metabotropic receptors in the presynaptic terminal of the CA3 neurons and M1 metabotropic receptors in the postsynaptic spines of CA1 neurons produce rich dynamics across multiple timescales. We developed a model to describe the activation of postsynaptic M1 receptors that leads to IP3 production from membrane PIP2 molecules. The binding of IP3 to IP3 receptors in the endoplasmic reticulum (ER) ultimately causes calcium release. This calcium release from the ER activates potassium channels like the calcium-activated SK channels and alters different aspects of synaptic signaling. In an independent signaling cascade, M1 receptors also directly suppress SK channels and the voltage-activated KCNQ2/3 channels, enhancing post-synaptic excitability. In the CA3 presynaptic terminal, we model the reduction of the voltage sensitivity of voltage-gated calcium channels (VGCCs) and the resulting suppression of neurotransmitter release by the action of the M4 receptors. Our results show that the reduced initial release probability because of acetylcholine alters short-term plasticity (STP) dynamics. We characterize the dichotomy of suppressing neurotransmitter release from CA3 neurons and the enhanced excitability of the postsynaptic CA1 spine. Mechanisms underlying STP operate over a few seconds, while those responsible for LTP last for hours, and both forms of plasticity have been linked with very distinct functions in the brain. We show that the concurrent suppression of neurotransmitter release and increased sensitivity conserves neurotransmitter vesicles and enhances the reliability in plasticity. Our work establishes a relationship between STP and LTP coordinated by neuromodulation with acetylcholine.

In the past several years, I have been involved in building a biologically realistic model of the monkey visual cortex. Work on one of the input layers (4Ca) of the primary visual cortex (V1) is now nearly complete, and I would like to share some of what I have learned with the community. After a brief overview of the model and its capabilities, I would like to focus on three sets of results that represent three different aspects of the modeling. They are: (i) emergent E-I dynamics in local circuits; (ii) how visual cortical neurons acquire their ability to detect edges and directions of motion, and (iii) a view across the cortical surface: nonequilibrium steady states (in analogy with statistical mechanics) and beyond.

Neurodegenerative diseases such as Alzheimer’s or Parkinson’s are devastating conditions with poorly understood mechanisms and no cure. Yet, a striking feature of these conditions is the characteristic pattern of invasion throughout the brain, leading to well-codified disease stages associated with various cognitive deficits and pathologies. How can we use mathematical modelling to gain insight into this process and, doing so, gain understanding about how the brain works? In this talk, I will show that by linking new mathematical theories to recent progress in imaging, we can unravel some of the universal features associated with dementia and, more generally, brain functions.

Though the term has many definitions, computational neuroscience is mainly about applying mathematics to the study of the brain. The brain—a jumble of all different kinds of neurons interconnected in countless ways that somehow produce consciousness—has been described as “the most complex object in the known universe”. Physicists for centuries have turned to mathematics to properly explain some of the most seemingly simple processes in the universe—how objects fall, how water flows, how the planets move. Equations have proved crucial in these endeavors because they capture relationships and make precise predictions possible. How could we expect to understand the most complex object in the universe without turning to mathematics? — The answer is we can’t, and that is why I wrote this book. While I’ve been studying and working in the field for over a decade, most people I encounter have no idea what “computational neuroscience” is or that it even exists. Yet a desire to understand how the brain works is a common and very human interest. I wrote this book to let people in on the ways in which the brain will ultimately be understood: through mathematical and computational theories. — At the same time, I know that both mathematics and brain science are on their own intimidating topics to the average reader and may seem downright prohibitory when put together. That is why I’ve avoided (many) equations in the book and focused instead on the driving reasons why scientists have turned to mathematical modeling, what these models have taught us about the brain, and how some surprising interactions between biologists, physicists, mathematicians, and engineers over centuries have laid the groundwork for the future of neuroscience. — Each chapter of Models of the Mind covers a separate topic in neuroscience, starting from individual neurons themselves and building up to the different populations of neurons and brain regions that support memory, vision, movement and more. These chapters document the history of how mathematics has woven its way into biology and the exciting advances this collaboration has in store.

Colonies of ants and other eusocial insects are superorganisms, which perform sophisticated cognitive-like functions at the level of the group. In my talk I will review our efforts to establish the clonal raider ant Ooceraea biroi as a lab model system for the systematic study of the principles underlying collective information processing in ant colonies. I will use results from two separate projects to demonstrate the potential of this model system: In the first, we analyze the foraging behavior of the species, known as group raiding: a swift offensive response of a colony to the detection of a potential prey by a scout. By using automated behavioral tracking and detailed analysis we show that this behavior is closely related to the army ant mass raid, an iconic collective behavior in which hundreds of thousands of ants spontaneously leave the nest to go hunting, and that the evolutionary transition between the two can be explained by a change in colony size alone. In the second project, we study the emergence of a collective sensory response threshold in a colony. The sensory threshold is a fundamental computational primitive, observed across many biological systems. By carefully controlling the sensory environment and the social structure of the colonies we were able to show that it also appear in a collective context, and that it emerges out of a balance between excitatory and inhibitory interactions between ants. Furthermore, by using a mathematical model we predict that these two interactions can be mapped into known mechanisms of communication in ants. Finally, I will discuss the opportunities for understanding collective behavior that are opening up by the development of methods for neuroimaging and neurocontrol of our ants.

Rajanlab designs neural network models constrained by experimental data, and reverse engineers them to figure out how brain circuits function in health and disease. Recently, we have been developing a powerful new theory-based framework for “in-vivo tract tracing” from multi-regional neural activity collected experimentally. We call this framework CURrent-Based Decomposition (CURBD). CURBD employs recurrent neural networks (RNNs) directly constrained, from the outset, by time series measurements acquired experimentally, such as Ca2+ imaging or electrophysiological data. Once trained, these data-constrained RNNs let us infer matrices quantifying the interactions between all pairs of modeled units. Such model-derived “directed interaction matrices” can then be used to separately compute excitatory and inhibitory input currents that drive a given neuron from all other neurons. Therefore different current sources can be de-mixed – either within the same region or from other regions, potentially brain-wide – which collectively give rise to the population dynamics observed experimentally. Source de-mixed currents obtained through CURBD allow an unprecedented view into multi-region mechanisms inaccessible from measurements alone. We have applied this method successfully to several types of neural data from our experimental collaborators, e.g., zebrafish (Deisseroth lab, Stanford), mice (Harvey lab, Harvard), monkeys (Rudebeck lab, Sinai), and humans (Rutishauser lab, Cedars Sinai), where we have discovered both directed interactions brain wide and inter-area currents during different types of behaviors. With this powerful framework based on data-constrained multi-region RNNs and CURrent Based Decomposition (CURBD), we ask if there are conserved multi-region mechanisms across different species, as well as identify key divergences.

Birdsong emerges when a set of highly interconnected brain areas manage to generate a complex output. The similarities between birdsong production and human speech have positioned songbirds as unique animal models for studying learning and production of this complex motor skill. In this work, we developed a low dimensional model for a neural network in which the variables were the average activities of different neural populations within the nuclei of the song system. This neural network is active during production, perception and learning of birdsong. We performed electrophysiological experiments to record neural activity from one of these nuclei and found that the low dimensional model could reproduce the neural dynamics observed during the experiments. Also, this model could reproduce the respiratory motor patterns used to generate song. We showed that sparse activity in one of the neural nuclei could drive a more complex activity downstream in the neural network. This interdisciplinary work shows how low dimensional neural models can be a valuable tool for studying the emergence of complex motor tasks

This conference is a free event that includes a range of activities to stimulate the cross-fertilization of ideas, including invited speaker talks, workshops, micro talks, an undergraduate research competition, a contest to discover mathematical questions in biology, and plenty of networking opportunities. Today's speakers: Cassandra Extavour, William Bialek, Amy Shyer, Ankur Saxena, Jie Liang

This conference is a free event that includes a range of activities to stimulate the cross-fertilization of ideas, including invited speaker talks, workshops, micro talks, an undergraduate research competition, a contest to discover mathematical questions in biology, and plenty of networking opportunities. Today's speakers: Nathalie Dostatni, Christopher Obara, Hernan Garcia, Aaron Dinner, David Lubensky, Jianping Fu

Many networks in the nervous system possess an abundance of inhibition, which serves to shape and stabilize neural dynamics. The neurons in such networks exhibit intricate patterns of connectivity whose structure controls the allowed patterns of neural activity. In this work, we examine inhibitory threshold-linear networks whose dynamics are constrained by an underlying directed graph. We develop a set of parameter-independent graph rules that enable us to predict features of the dynamics, such as emergent sequences and dynamic attractors, from properties of the graph. These rules provide a direct link between the structure and function of these networks, and may provide new insights into how connectivity shapes dynamics in real neural circuits.

When was the last time you ran into a giant? Chances are never. Almost 100 years ago, JBS Haldane posed an outwardly simple yet complex question – what is the most optimal size (for a biological system)? The living world around us contains a huge diversity of organisms, each with its own characteristic size. Even the size of subcellular organelles is tightly controlled. In absence of physical rulers, how do cells and organisms truly “know” how large is large enough? What are the mechanisms in place to enforce size control? Many of these questions have motivated generations of scientists to look for physical principles underlying size control in biological systems. In the next edition of Emory's Theory and Modeling of Living Systems (TMLS) workshop series, our panel of speakers will take a close look at these questions, across the entire scale - from the molecular, all the way to the ecosystem.

Many of us came to biology from physics. There we have been trained on such classic examples as muon g-2, where experimental data and theoretical predictions agree to many significant digits. Now, working in biology, we routinely hear that it is messy, most details matter, and that the best hope for theory in biology is to be semi-qualitative, predict general trends, and to forgo the hope of ever making quantitative predictions with the precision that we are used to in physics. Colloquially, we should be satisfied even if data and models differ so much that plotting them on the same plot makes little sense. However, some of us won’t be satisfied by this. So can we take theory in biology seriously and predict experimental outcomes within (small) error bars? Certainly, we won’t be able to predict everything, but this is never required, even in traditional physics. But we should be able to choose some features of data that are nontrivial and interesting, and focus on them. We also should be able to find different classes of models --- maybe even null models --- that match biology better, and thus allow for a better agreement. It is even possible that large-dimensional datasets of modern high-throughput experiments, and the ensuing “more is different” statistical physics style models will make quantitative, precise theory easier. To explore the role of quantitative theory in biology, in this workshop, eight speakers will address some of the following general questions based on their specific work in different corners of biology: Which features of biological data are predictable? Which types of models are best suited to making quantitative predictions in different fields? Should theorists interested in quantitative predictions focus on different questions, not typically asked by biologists? Do large, multidimensional datasets make theories (and which theories?) more or less likely to succeed? This will be an unapologetically theoretical physics workshop — we won’t focus on a specific subfield of biology, but will explore these questions across the fields, hoping that the underlying theoretical frameworks will help us find the missing connections.

The Ca2+ modulated pulsatile secretions of glucagon and insulin by pancreatic α and β cells play a key role in glucose metabolism and homeostasis. However, how different types of cells in the islet couple and coordinate to give rise to various Ca2+ oscillation patterns and how these patterns are being tuned by paracrine regulation are still elusive. Here we developed a microfluidic device to facilitate long-term recording of islet Ca2+ activity at single cell level and found that islets show heterogeneous but intrinsic oscillation patterns. The α and β cells in an islet oscillate in antiphase and are globally phase locked to display a variety of oscillation modes. A mathematical model of islet oscillation maps out the dependence of the oscillation modes on the paracrine interactions between α and β cells. Our study reveals the origin of the islet oscillation patterns and highlights the role of paracrine regulation in tuning them.