Topic: Collective dynamics

NeuroAI from model to understanding: revealing the emergence of computations from the collective dynamics of interacting neurons

The role of sub-population structure in computations through neural dynamics

Neural computations are currently conceptualised using two separate approaches: sorting neurons into functional sub-populations or examining distributed collective dynamics. Whether and how these two aspects interact to shape computations is currently unclear. Using a novel approach to extract computational mechanisms from recurrent networks trained on neuroscience tasks, we show that the collective dynamics and sub-population structure play fundamentally complementary roles. Although various tasks can be implemented in networks with fully random population structure, we found that flexible input–output mappings instead require a non-random population structure that can be described in terms of multiple sub-populations. Our analyses revealed that such a sub-population organisation enables flexible computations through a mechanism based on gain-controlled modulations that flexibly shape the collective dynamics.

The role of population structure in computations through neural dynamics

Neural computations are currently investigated using two separate approaches: sorting neurons into functional subpopulations or examining the low-dimensional dynamics of collective activity. Whether and how these two aspects interact to shape computations is currently unclear. Using a novel approach to extract computational mechanisms from networks trained on neuroscience tasks, here we show that the dimensionality of the dynamics and subpopulation structure play fundamentally com- plementary roles. Although various tasks can be implemented by increasing the dimensionality in networks with fully random population structure, flexible input–output mappings instead require a non-random population structure that can be described in terms of multiple subpopulations. Our analyses revealed that such a subpopulation structure enables flexible computations through a mechanism based on gain-controlled modulations that flexibly shape the collective dynamics. Our results lead to task-specific predictions for the structure of neural selectivity, for inactivation experiments and for the implication of different neurons in multi-tasking.

When and (maybe) why do high-dimensional neural networks produce low-dimensional dynamics?

There is an avalanche of new data on activity in neural networks and the biological brain, revealing the collective dynamics of vast numbers of neurons. In principle, these collective dynamics can be of almost arbitrarily high dimension, with many independent degrees of freedom — and this may reflect powerful capacities for general computing or information. In practice, neural datasets reveal a range of outcomes, including collective dynamics of much lower dimension — and this may reflect other desiderata for neural codes. For what networks does each case occur? We begin by exploring bottom-up mechanistic ideas that link tractable statistical properties of network connectivity with the dimension of the activity that they produce. We then cover “top-down” ideas that describe how features of connectivity and dynamics that impact dimension arise as networks learn to perform fundamental computational tasks.

Making connections: how epithelial tissues guarantee folding

Tissue folding is a ubiquitous shape change event during development whereby a cell sheet bends into a curved 3D structure. This mechanical process is remarkably robust, and the correct final form is almost always achieved despite internal fluctuations and external perturbations inherent in living systems. While many genetic and molecular strategies that lead to robust development have been established, much less is known about how mechanical patterns and movements are ensured at the population level. I will describe how quantitative imaging, physical modeling and concepts from network science can uncover collective interactions that govern tissue patterning and shape change. Actin and myosin are two important cytoskeletal proteins involved in the force generation and movement of cells. Both parts of this talk will be about the spontaneous organization of actomyosin networks and their role in collective tissue dynamics. First, I will present how out-of-plane curvature can trigger the global alignment of actin fibers and a novel transition from collective to individual cell migration in culture. I will then describe how tissue-scale cytoskeletal patterns can guide tissue folding in the early fruit fly embryo. I will show that actin and myosin organize into a network that spans a domain of the embryo that will fold. Redundancy in this supracellular network encodes the tissue’s intrinsic robustness to mechanical and molecular perturbations during folding.

Tuning dumb neurons to task processing - via homeostasis

Homeostatic plasticity plays a key role in stabilizing neural network activity. But what is its role in neural information processing? We showed analytically how homeostasis changes collective dynamics and consequently information flow - depending on the input to the network. We then studied how input and homeostasis on a recurrent network of LIF neurons impacts information flow and task performance. We showed how we can tune the working point of the network, and found that, contrary to previous assumptions, there is not one optimal working point for a family of tasks, but each task may require its own working point.

Do leader cells drive collective behavior in Dictyostelium Discoideum amoeba colonies?

Dictyostelium Discoideum (DD) are a fascinating single-cellular organism. When nutrients are plentiful, the DD cells act as autonomous individuals foraging their local vicinity. At the onset of starvation, a few (<0.1%) cells begin communicating with others by emitting a spike in the chemoattractant protein cyclic-AMP. Nearby cells sense the chemical gradient and respond by moving toward it and emitting a cyclic-AMP spike of their own. Cyclic-AMP activity increases over time, and eventually a spiral wave emerges, attracting hundreds of thousands of cells to an aggregation center. How DD cells go from autonomous individuals to a collective entity remains an open question for more than 60 years--a question whose answer would shed light on the emergence of multi-cellular life. Recently, trans-scale imaging has allowed the ability to sense the cyclic-AMP activity at both cell and colony levels. Using both the images as well as toy simulation models, this research aims to clarify whether the activity at the colony level is in fact initiated by a few cells, which may be deemed "leader" or "pacemaker" cells. In this talk, I will demonstrate the use of information-theoretic techniques to classify leaders and followers based on trajectory data, as well as to infer the domain of interaction of leader cells. We validate the techniques on toy models where leaders and followers are known, and then try to answer the question in real data--do leader cells drive collective behavior in DD colonies?

Internal structure of honey bee swarms for mechanical stability and division of labor

The western honey bee (Apis mellifera) is a domesticated pollinator famous for living in highly social colonies. In the spring, thousands of worker bees and a queen fly from their hive in search of a new home. They self-assemble into a swarm that hangs from a tree branch for several days. We reconstruct the non-isotropic arrangement of worker bees inside swarms made up of 3000 - 8000 bees using x-ray computed tomography. Some bees are stationary and hang from the attachment board or link their bodies into hanging chains to support the swarm structure. The remaining bees use the chains as pathways to walk around the swarm, potentially to feed the queen or communicate with one another. The top layers of bees bear more weight per bee than the remainder of the swarm, suggesting that bees are optimizing for additional factors besides weight distribution. Despite not having a clear leader, honey bees are able to organize into a swarm that protects the queen and remains stable until scout bees locate a new hive.

Understanding neural dynamics in high dimensions across multiple timescales: from perception to motor control and learning

Remarkable advances in experimental neuroscience now enable us to simultaneously observe the activity of many neurons, thereby providing an opportunity to understand how the moment by moment collective dynamics of the brain instantiates learning and cognition. However, efficiently extracting such a conceptual understanding from large, high dimensional neural datasets requires concomitant advances in theoretically driven experimental design, data analysis, and neural circuit modeling. We will discuss how the modern frameworks of high dimensional statistics and deep learning can aid us in this process. In particular we will discuss: (1) how unsupervised tensor component analysis and time warping can extract unbiased and interpretable descriptions of how rapid single trial circuit dynamics change slowly over many trials to mediate learning; (2) how to tradeoff very different experimental resources, like numbers of recorded neurons and trials to accurately discover the structure of collective dynamics and information in the brain, even without spike sorting; (3) deep learning models that accurately capture the retina’s response to natural scenes as well as its internal structure and function; (4) algorithmic approaches for simplifying deep network models of perception; (5) optimality approaches to explain cell-type diversity in the first steps of vision in the retina.

Neural network-like collective dynamics of molecules

Collective dynamics in nuclear structure emerges from chromatin crosslinks and motors

Neural network-like collective dynamics in molecules

Neural networks can learn and recognize subtle correlations in high dimensional inputs. However, neural networks are simply many-body systems with strong non-linearities and disordered interactions. Hence, many-body physical systems with similar interactions should be able to show neural network-like behavior. Here we show neural network-like behavior in the nucleation dynamics of promiscuously interacting molecules with multiple stable crystalline phases. Using a combination of theory and experiments, we show how the physics of the system dictates relationships between the difficulty of the pattern recognition task solved, time taken and accuracy. This work shows that high dimensional pattern recognition and learning are not special to software algorithms but can be achieved by the collective dynamics of sufficiently disordered molecular systems.

Theoretical and computational approaches to neuroscience with complex models in high dimensions across multiple timescales: from perception to motor control and learning

Remarkable advances in experimental neuroscience now enable us to simultaneously observe the activity of many neurons, thereby providing an opportunity to understand how the moment by moment collective dynamics of the brain instantiates learning and cognition.  However, efficiently extracting such a conceptual understanding from large, high dimensional neural datasets requires concomitant advances in theoretically driven experimental design, data analysis, and neural circuit modeling.  We will discuss how the modern frameworks of high dimensional statistics and deep learning can aid us in this process.  In particular we will discuss: how unsupervised tensor component analysis and time warping can extract unbiased and interpretable descriptions of how rapid single trial circuit dynamics change slowly over many trials to mediate learning; how to tradeoff very different experimental resources, like numbers of recorded neurons and trials to accurately discover the structure of collective dynamics and information in the brain, even without spike sorting; deep learning models that accurately capture the retina’s response to natural scenes as well as its internal structure and function; algorithmic approaches for simplifying deep network models of perception; optimality approaches to explain cell-type diversity in the first steps of vision in the retina.