Neural mechanisms of optimal performance

When we attend a demanding task, our performance is poor at low arousal (when drowsy) or high arousal (when anxious), but we achieve optimal performance at intermediate arousal. This celebrated Yerkes-Dodson inverted-U law relating performance and arousal is colloquially referred to as being "in the zone." In this talk, I will elucidate the behavioral and neural mechanisms linking arousal and performance under the Yerkes-Dodson law in a mouse model. During decision-making tasks, mice express an array of discrete strategies, whereby the optimal strategy occurs at intermediate arousal, measured by pupil, consistent with the inverted-U law. Population recordings from the auditory cortex (A1) further revealed that sound encoding is optimal at intermediate arousal. To explain the computational principle underlying this inverted-U law, we modeled the A1 circuit as a spiking network with excitatory/inhibitory clusters, based on the observed functional clusters in A1. Arousal induced a transition from a multi-attractor (low arousal) to a single attractor phase (high arousal), and performance is optimized at the transition point. The model also predicts stimulus- and arousal-induced modulations of neural variability, which we confirmed in the data. Our theory suggests that a single unifying dynamical principle, phase transitions in metastable dynamics, underlies both the inverted-U law of optimal performance and state-dependent modulations of neural variability.

Learning and Memory

This webinar on learning and memory features three experts—Nicolas Brunel, Ashok Litwin-Kumar, and Julijana Gjorgieva—who present theoretical and computational approaches to understanding how neural circuits acquire and store information across different scales. Brunel discusses calcium-based plasticity and how standard “Hebbian-like” plasticity rules inferred from in vitro or in vivo datasets constrain synaptic dynamics, aligning with classical observations (e.g., STDP) and explaining how synaptic connectivity shapes memory. Litwin-Kumar explores insights from the fruit fly connectome, emphasizing how the mushroom body—a key site for associative learning—implements a high-dimensional, random representation of sensory features. Convergent dopaminergic inputs gate plasticity, reflecting a high-dimensional “critic” that refines behavior. Feedback loops within the mushroom body further reveal sophisticated interactions between learning signals and action selection. Gjorgieva examines how activity-dependent plasticity rules shape circuitry from the subcellular (e.g., synaptic clustering on dendrites) to the cortical network level. She demonstrates how spontaneous activity during development, Hebbian competition, and inhibitory-excitatory balance collectively establish connectivity motifs responsible for key computations such as response normalization.

The Role of Cognitive Appraisal in the Relationship between Personality and Emotional Reactivity

Emotion is defined as a rapid psychological process involving experiential, expressive and physiological responses. These emerge following an appraisal process that involves cognitive evaluations of the environment assessing its relevance, implication, coping potential, and normative significance. It has been suggested that changes in appraisal processes lead to changes in the resulting emotional nature. Simultaneously, it was demonstrated that personality can be seen as a predisposition to feel more frequently certain emotions, but the personality-appraisal-emotional response chain is rarely fully investigated. The present project thus sought to investigate the extent to which personality traits influence certain appraisals, which in turn influence the subsequent emotional reactions via a systematic analysis of the link between personality traits of different current models, specific appraisals, and emotional response patterns at the experiential, expressive, and physiological levels. Major results include the coherence of emotion components clustering, and the centrality of the pleasantness, coping potential and consequences appraisals, in context; and the differentiated mediating role of cognitive appraisal in the relation between personality and the intensity and duration of an emotional state, and autonomic arousal, such as Extraversion-pleasantness-experience, and Neuroticism-powerlessness-arousal. Elucidating these relationships deepens our understanding of individual differences in emotional reactivity and spot routes of action on appraisal processes to modify upcoming adverse emotional responses, with a broader societal impact on clinical and non-clinical populations.

Are integrative, multidisciplinary, and pragmatic models possible? The #PsychMapping experience

This presentation delves into the necessity for simplified models in the field of psychological sciences to cater to a diverse audience of practitioners. We introduce the #PsychMapping model, evaluate its merits and limitations, and discuss its place in contemporary scientific culture. The #PsychMapping model is the product of an extensive literature review, initially within the realm of sport and exercise psychology and subsequently encompassing a broader spectrum of psychological sciences. This model synthesizes the progress made in psychological sciences by categorizing variables into a framework that distinguishes between traits (e.g., body structure and personality) and states (e.g., heart rate and emotions). Furthermore, it delineates internal traits and states from the externalized self, which encompasses behaviour and performance. All three components—traits, states, and the externalized self—are in a continuous interplay with external physical, social, and circumstantial factors. Two core processes elucidate the interactions among these four primary clusters: external perception, encompassing the mechanism through which external stimuli transition into internal events, and self-regulation, which empowers individuals to become autonomous agents capable of exerting control over themselves and their actions. While the model inherently oversimplifies intricate processes, the central question remains: does its pragmatic utility outweigh its limitations, and can it serve as a valuable tool for comprehending human behaviour?

Are integrative, multidisciplinary, and pragmatic models possible? The #PsychMapping experience

This presentation delves into the necessity for simplified models in the field of psychological sciences to cater to a diverse audience of practitioners. We introduce the #PsychMapping model, evaluate its merits and limitations, and discuss its place in contemporary scientific culture. The #PsychMapping model is the product of an extensive literature review, initially within the realm of sport and exercise psychology and subsequently encompassing a broader spectrum of psychological sciences. This model synthesizes the progress made in psychological sciences by categorizing variables into a framework that distinguishes between traits (e.g., body structure and personality) and states (e.g., heart rate and emotions). Furthermore, it delineates internal traits and states from the externalized self, which encompasses behaviour and performance. All three components—traits, states, and the externalized self—are in a continuous interplay with external physical, social, and circumstantial factors. Two core processes elucidate the interactions among these four primary clusters: external perception, encompassing the mechanism through which external stimuli transition into internal events, and self-regulation, which empowers individuals to become autonomous agents capable of exerting control over themselves and their actions. While the model inherently oversimplifies intricate processes, the central question remains: does its pragmatic utility outweigh its limitations, and can it serve as a valuable tool for comprehending human behaviour?

Mathematical and computational modelling of ocular hemodynamics: from theory to applications

Changes in ocular hemodynamics may be indicative of pathological conditions in the eye (e.g. glaucoma, age-related macular degeneration), but also elsewhere in the body (e.g. systemic hypertension, diabetes, neurodegenerative disorders). Thanks to its transparent fluids and structures that allow the light to go through, the eye offers a unique window on the circulation from large to small vessels, and from arteries to veins. Deciphering the causes that lead to changes in ocular hemodynamics in a specific individual could help prevent vision loss as well as aid in the diagnosis and management of diseases beyond the eye. In this talk, we will discuss how mathematical and computational modelling can help in this regard. We will focus on two main factors, namely blood pressure (BP), which drives the blood flow through the vessels, and intraocular pressure (IOP), which compresses the vessels and may impede the flow. Mechanism-driven models translates fundamental principles of physics and physiology into computable equations that allow for identification of cause-to-effect relationships among interplaying factors (e.g. BP, IOP, blood flow). While invaluable for causality, mechanism-driven models are often based on simplifying assumptions to make them tractable for analysis and simulation; however, this often brings into question their relevance beyond theoretical explorations. Data-driven models offer a natural remedy to address these short-comings. Data-driven methods may be supervised (based on labelled training data) or unsupervised (clustering and other data analytics) and they include models based on statistics, machine learning, deep learning and neural networks. Data-driven models naturally thrive on large datasets, making them scalable to a plethora of applications. While invaluable for scalability, data-driven models are often perceived as black- boxes, as their outcomes are difficult to explain in terms of fundamental principles of physics and physiology and this limits the delivery of actionable insights. The combination of mechanism-driven and data-driven models allows us to harness the advantages of both, as mechanism-driven models excel at interpretability but suffer from a lack of scalability, while data-driven models are excellent at scale but suffer in terms of generalizability and insights for hypothesis generation. This combined, integrative approach represents the pillar of the interdisciplinary approach to data science that will be discussed in this talk, with application to ocular hemodynamics and specific examples in glaucoma research.

NII Methods (journal club): NeuroQuery, comprehensive meta-analysis of human brain mapping

We will discuss a recent paper by Taylor et al. (2023): https://www.sciencedirect.com/science/article/pii/S1053811923002896. They discuss the merits of highlighting results instead of hiding them; that is, clearly marking which voxels and clusters pass a given significance threshold, but still highlighting sub-threshold results, with opacity proportional to the strength of the effect. They use this to illustrate how there in fact may be more agreement between researchers than previously thought, using the NARPS dataset as an example. By adopting a continuous, "highlighted" approach, it becomes clear that the majority of effects are in the same location and that the effect size is in the same direction, compared to an approach that only permits rejecting or not rejecting the null hypothesis. We will also talk about the implications of this approach for creating figures, detecting artifacts, and aiding reproducibility.

Distinct contributions of different anterior frontal regions to rule-guided decision-making in primates: complementary evidence from lesions, electrophysiology, and neurostimulation

Different prefrontal areas contribute in distinctly different ways to rule-guided behaviour in the context of a Wisconsin Card Sorting Test (WCST) analog for macaques. For example, causal evidence from circumscribed lesions in NHPs reveals that dorsolateral prefrontal cortex (dlPFC) is necessary to maintain a reinforced abstract rule in working memory, orbitofrontal cortex (OFC) is needed to rapidly update representations of rule value, and the anterior cingulate cortex (ACC) plays a key role in cognitive control and integrating information for correct and incorrect trials over recent outcomes. Moreover, recent lesion studies of frontopolar cortex (FPC) suggest it contributes to representing the relative value of unchosen alternatives, including rules. Yet we do not understand how these functional specializations relate to intrinsic neuronal activities nor the extent to which these neuronal activities differ between different prefrontal regions. After reviewing the aforementioned causal evidence I will present our new data from studies using multi-area multi-electrode recording techniques in NHPs to simultaneously record from four different prefrontal regions implicated in rule-guided behaviour. Multi-electrode micro-arrays (‘Utah arrays’) were chronically implanted in dlPFC, vlPFC, OFC, and FPC of two macaques, allowing us to simultaneously record single and multiunit activity, and local field potential (LFP), from all regions while the monkey performs the WCST analog. Rule-related neuronal activity was widespread in all areas recorded but it differed in degree and in timing between different areas. I will also present preliminary results from decoding analyses applied to rule-related neuronal activities both from individual clusters and also from population measures. These results confirm and help quantify dynamic task-related activities that differ between prefrontal regions. We also found task-related modulation of LFPs within beta and gamma bands in FPC. By combining this correlational recording methods with trial-specific causal interventions (electrical microstimulation) to FPC we could significantly enhance and impair animals performance in distinct task epochs in functionally relevant ways, further consistent with an emerging picture of regional functional specialization within a distributed framework of interacting and interconnected cortical regions.

Learning through the eyes and ears of a child

Young children have sophisticated representations of their visual and linguistic environment. Where do these representations come from? How much knowledge arises through generic learning mechanisms applied to sensory data, and how much requires more substantive (possibly innate) inductive biases? We examine these questions by training neural networks solely on longitudinal data collected from a single child (Sullivan et al., 2020), consisting of egocentric video and audio streams. Our principal findings are as follows: 1) Based on visual only training, neural networks can acquire high-level visual features that are broadly useful across categorization and segmentation tasks. 2) Based on language only training, networks can acquire meaningful clusters of words and sentence-level syntactic sensitivity. 3) Based on paired visual and language training, networks can acquire word-referent mappings from tens of noisy examples and align their multi-modal conceptual systems. Taken together, our results show how sophisticated visual and linguistic representations can arise through data-driven learning applied to one child’s first-person experience.

Shallow networks run deep: How peripheral preprocessing facilitates odor classification

Drosophila olfactory sensory hairs ("sensilla") typically house two olfactory receptor neurons (ORNs) which can laterally inhibit each other via electrical ("ephaptic") coupling. ORN pairing is highly stereotyped and genetically determined. Thus, olfactory signals arriving in the Antennal Lobe (AL) have been pre-processed by a fixed and shallow network at the periphery. To uncover the functional significance of this organization, we developed a nonlinear phenomenological model of asymmetrically coupled ORNs responding to odor mixture stimuli. We derived an analytical solution to the ORNs’ dynamics, which shows that the peripheral network can extract the valence of specific odor mixtures via transient amplification. Our model predicts that for efficient read-out of the amplified valence signal there must exist specific patterns of downstream connectivity that reflect the organization at the periphery. Analysis of AL→Lateral Horn (LH) fly connectomic data reveals evidence directly supporting this prediction. We further studied the effect of ephaptic coupling on olfactory processing in the AL→Mushroom Body (MB) pathway. We show that stereotyped ephaptic interactions between ORNs lead to a clustered odor representation of glomerular responses. Such clustering in the AL is an essential assumption of theoretical studies on odor recognition in the MB. Together our work shows that preprocessing of olfactory stimuli by a fixed and shallow network increases sensitivity to specific odor mixtures, and aids in the learning of novel olfactory stimuli. Work led by Palka Puri, in collaboration with Chih-Ying Su and Shiuan-Tze Wu.

A multi-level account of hippocampal function in concept learning from behavior to neurons

A complete neuroscience requires multi-level theories that address phenomena ranging from higher-level cognitive behaviors to activities within a cell. Unfortunately, we don't have cognitive models of behavior whose components can be decomposed into the neural dynamics that give rise to behavior, leaving an explanatory gap. Here, we decompose SUSTAIN, a clustering model of concept learning, into neuron-like units (SUSTAIN-d; decomposed). Instead of abstract constructs (clusters), SUSTAIN-d has a pool of neuron-like units. With millions of units, a key challenge is how to bridge from abstract constructs such as clusters to neurons, whilst retaining high-level behavior. How does the brain coordinate neural activity during learning? Inspired by algorithms that capture flocking behavior in birds, we introduce a neural flocking learning rule to coordinate units that collectively form higher-level mental constructs ("virtual clusters"), neural representations (concept, place and grid cell-like assemblies), and parallels recurrent hippocampal activity. The decomposed model shows how brain-scale neural populations coordinate to form assemblies encoding concept and spatial representations, and why many neurons are required for robust performance. Our account provides a multi-level explanation for how cognition and symbol-like representations are supported by coordinated neural assemblies formed through learning.

Flexible multitask computation in recurrent networks utilizes shared dynamical motifs

Flexible computation is a hallmark of intelligent behavior. Yet, little is known about how neural networks contextually reconfigure for different computations. Humans are able to perform a new task without extensive training, presumably through the composition of elementary processes that were previously learned. Cognitive scientists have long hypothesized the possibility of a compositional neural code, where complex neural computations are made up of constituent components; however, the neural substrate underlying this structure remains elusive in biological and artificial neural networks. Here we identified an algorithmic neural substrate for compositional computation through the study of multitasking artificial recurrent neural networks. Dynamical systems analyses of networks revealed learned computational strategies that mirrored the modular subtask structure of the task-set used for training. Dynamical motifs such as attractors, decision boundaries and rotations were reused across different task computations. For example, tasks that required memory of a continuous circular variable repurposed the same ring attractor. We show that dynamical motifs are implemented by clusters of units and are reused across different contexts, allowing for flexibility and generalization of previously learned computation. Lesioning these clusters resulted in modular effects on network performance: a lesion that destroyed one dynamical motif only minimally perturbed the structure of other dynamical motifs. Finally, modular dynamical motifs could be reconfigured for fast transfer learning. After slow initial learning of dynamical motifs, a subsequent faster stage of learning reconfigured motifs to perform novel tasks. This work contributes to a more fundamental understanding of compositional computation underlying flexible general intelligence in neural systems. We present a conceptual framework that establishes dynamical motifs as a fundamental unit of computation, intermediate between the neuron and the network. As more whole brain imaging studies record neural activity from multiple specialized systems simultaneously, the framework of dynamical motifs will guide questions about specialization and generalization across brain regions.

How do protein-RNA condensates form and contribute to disease?

In recent years, it has become clear that intrinsically disordered regions (IDRs) of RBPs, and the structure of RNAs, often contribute to the condensation of RNPs. To understand the transcriptomic features of such RNP condensates, we’ve used an improved individual nucleotide resolution CLIP protocol (iiCLIP), which produces highly sensitive and specific data, and thus enables quantitative comparisons of interactions across conditions (Lee et al., 2021). This showed how the IDR-dependent condensation properties of TDP-43 specify its RNA binding and regulatory repertoire (Hallegger et al., 2021). Moreover, we developed software for discovery and visualisation of RNA binding motifs that uncovered common binding patterns of RBPs on long multivalent RNA regions that are composed of dispersed motif clusters (Kuret et al, 2021). Finally, we used hybrid iCLIP (hiCLIP) to characterise the RNA structures mediating the assembly of Staufen RNPs across mammalian brain development, which demonstrated the roles of long-range RNA duplexes in the compaction of long 3’UTRs. I will present how the combined analysis of the characteristics of IDRs in RBPs, multivalent RNA regions and RNA structures is required to understand the formation and functions of RNP condensates, and how they change in diseases.

A transcriptomic axis predicts state modulation of cortical interneurons

Transcriptomics has revealed that cortical inhibitory neurons exhibit a great diversity of fine molecular subtypes, but it is not known whether these subtypes have correspondingly diverse activity patterns in the living brain. We show that inhibitory subtypes in primary visual cortex (V1) have diverse correlates with brain state, but that this diversity is organized by a single factor: position along their main axis of transcriptomic variation. We combined in vivo 2-photon calcium imaging of mouse V1 with a novel transcriptomic method to identify mRNAs for 72 selected genes in ex vivo slices. We classified inhibitory neurons imaged in layers 1-3 into a three-level hierarchy of 5 Subclasses, 11 Types, and 35 Subtypes using previously-defined transcriptomic clusters. Responses to visual stimuli differed significantly only across Subclasses, suppressing cells in the Sncg Subclass while driving cells in the other Subclasses. Modulation by brain state differed at all hierarchical levels but could be largely predicted from the first transcriptomic principal component, which also predicted correlations with simultaneously recorded cells. Inhibitory Subtypes that fired more in resting, oscillatory brain states have less axon in layer 1, narrower spikes, lower input resistance and weaker adaptation as determined in vitro and express more inhibitory cholinergic receptors. Subtypes firing more during arousal had the opposite properties. Thus, a simple principle may largely explain how diverse inhibitory V1 Subtypes shape state-dependent cortical processing.

Learning binds novel inputs into functional synaptic clusters via spinogenesis

Learning is known to induce the formation of new dendritic spines, but despite decades of effort, the functional properties of new spines in vivo remain unknown. Here, using a combination of longitudinal in vivo 2-photon imaging of the glutamate reporter, iGluSnFR, and correlated electron microscopy (CLEM) of dendritic spines on the apical dendrites of L2/3 excitatory neurons in the motor cortex during motor learning, we describe a framework of new spines' formation, survival, and resulting function. Specifically, our data indicate that the potentiation of a subset of clustered, pre-existing spines showing task-related activity in early sessions of learning creates a micro-environment of plasticity within dendrites, wherein multiple filopodia sample the nearby neuropil, form connections with pre-existing boutons connected to allodendritic spines, and are then selected for survival based on co-activity with nearby task-related spines. Thus, the formation and survival of new spines is determined by the functional micro-environment of dendrites. After formation, new spines show preferential co-activation with nearby task-related spines. This synchronous activity is more specific to movements than activation of the individual spines in isolation, and further, is coincident with movements that are more similar to the learned pattern. Thus, new spines functionally engage with their parent clusters to signal the learned movement. Finally, by reconstructing the axons associated with new spines, we found that they synapse with axons previously unrepresented in these dendritic domains, suggesting that the strong local co-activity structure exhibited by new spines is likely not due to axon sharing. Thus, learning involves the binding of new information streams into functional synaptic clusters to subserve the learned behavior.

Towards a Theory of Microbial Ecosystems

A major unresolved question in microbiome research is whether the complex ecological patterns observed in surveys of natural communities can be explained and predicted by fundamental, quantitative principles. Bridging theory and experiment is hampered by the multiplicity of ecological processes that simultaneously affect community assembly and a lack of theoretical tools for modeling diverse ecosystems. Here, I will present a simple ecological model of microbial communities that reproduces large-scale ecological patterns observed across multiple natural and experimental settings including compositional gradients, clustering by environment, diversity/harshness correlations, and nestedness. Surprisingly, our model works despite having a “random metabolisms” and “random consumer preferences”. This raises the natural of question of why random ecosystems can describe real-world experimental data. In the second, more theoretical part of the talk, I will answer this question by showing that when a community becomes diverse enough, it will always self-organize into a stable state whose properties are well captured by a “typical random ecosystems”.

CaImAn: large-scale batch and online analysis of calcium imaging data

Advances in fluorescence microscopy enable monitoring larger brain areas in-vivo with finer time resolution. The resulting data rates require reproducible analysis pipelines that are reliable, fully automated, and scalable to datasets generated over the course of months. We present CaImAn, an open-source library for calcium imaging data analysis. CaImAn provides automatic and scalable methods to address problems common to pre-processing, including motion correction, neural activity identification, and registration across different sessions of data collection. It does this while requiring minimal user intervention, with good scalability on computers ranging from laptops to high-performance computing clusters. CaImAn is suitable for two-photon and one-photon imaging, and also enables real-time analysis on streaming data. To benchmark the performance of CaImAn we collected and combined a corpus of manual annotations from multiple labelers on nine mouse two-photon datasets. We demonstrate that CaImAn achieves near-human performance in detecting locations of active neurons.

NMC4 Short Talk: Untangling Contributions of Distinct Features of Images to Object Processing in Inferotemporal Cortex

How do humans perceive daily objects of various features and categorize these seemingly intuitive and effortless mental representations? Prior literature focusing on the role of the inferotemporal region (IT) has revealed object category clustering that is consistent with the semantic predefined structure (superordinate, ordinate, subordinate). It has however been debated whether the neural signals in the IT regions are a reflection of such categorical hierarchy [Wen et al.,2018; Bracci et al., 2017]. Visual attributes of images that correlated with semantic and category dimensions may have confounded these prior results. Our study aimed to address this debate by building and comparing models using the DNN AlexNet, to explain the variance in representational dissimilarity matrix (RDM) of neural signals in the IT region. We found that mid and high level perceptual attributes of the DNN model contribute the most to neural RDMs in the IT region. Semantic categories, as in predefined structure, were moderately correlated with mid to high DNN layers (r = [0.24 - 0.36]). Variance partitioning analysis also showed that the IT neural representations were mostly explained by DNN layers, while semantic categorical RDMs brought little additional information. In light of these results, we propose future works should focus more on the specific role IT plays in facilitating the extraction and coding of visual features that lead to the emergence of categorical conceptualizations.

Reflex Regulation of Innate Immunity

Reflex circuits in the nervous system integrate changes in the environment with physiology. Compact clusters of brain neuron cell bodies, termed nuclei, are essential for receiving sensory input and for transmitting motor outputs to the body. These nucelii are critical relay stations which process incoming information and convert these signals to outgoing action potentials which regulate immune system functions. Thus, reflex neural circuits maintain parameters of immunological physiology within a narrow range optimal for health. Advances in neuroscience and immunology using optogenetics, pharmacogenetics, and functional mapping offer a new understanding of the importance of neural circuitry underlying immunity, and offer direct paths to new therapies.

Imaging neuronal morphology and activity pattern in developing cerebral cortex layer 4

Establishment of precise neuronal connectivity in the neocortex relies on activity-dependent circuit reorganization during postnatal development. In the mouse somatosensory cortex layer 4, barrels are arranged in one-to-one correspondence to whiskers on the face. Thalamocortical axon termini are clustered in the center of each barrel. The layer 4 spiny stellate neurons are located around the barrel edge, extend their dendrites primarily toward the barrel center, and make synapses with thalamocortical axons corresponding to a single whisker. These organized circuits are established during the first postnatal week through activity-dependent refinement processes. However, activity pattern regulating the circuit formation is still elusive. Using two-photon calcium imaging in living neonatal mice, we found that layer 4 neurons within the same barrel fire synchronously in the absence of peripheral stimulation, creating a ''patchwork'' pattern of spontaneous activity corresponding to the barrel map. We also found that disruption of GluN1, an obligatory subunit of the N-methyl-D-aspartate (NMDA) receptor, in a sparse population of layer 4 neurons reduced activity correlation between GluN1 knockout neuron pairs within a barrel. Our results provide evidence for the involvement of layer 4 neuron NMDA receptors in spatial organization of the spontaneous firing activity of layer 4 neurons in the neonatal barrel cortex. In the talk I will introduce our strategy to analyze the role of NMDA receptor-dependent correlated activity in the layer 4 circuit formation.

On the implicit bias of SGD in deep learning

Tali's work emphasized the tradeoff between compression and information preservation. In this talk I will explore this theme in the context of deep learning. Artificial neural networks have recently revolutionized the field of machine learning. However, we still do not have sufficient theoretical understanding of how such models can be successfully learned. Two specific questions in this context are: how can neural nets be learned despite the non-convexity of the learning problem, and how can they generalize well despite often having more parameters than training data. I will describe our recent work showing that gradient-descent optimization indeed leads to 'simpler' models, where simplicity is captured by lower weight norm and in some cases clustering of weight vectors. We demonstrate this for several teacher and student architectures, including learning linear teachers with ReLU networks, learning boolean functions and learning convolutional pattern detection architectures.

Using Human Stem Cells to Uncover Genetic Epilepsy Mechanisms

Reprogramming somatic cells to a pluripotent state via the induced pluripotent stem cell (iPSC) method offers an increasingly utilized approach for neurological disease modeling with patient-derived cells. Several groups, including ours, have applied the iPSC approach to model severe genetic developmental and epileptic encephalopathies (DEEs) with patient-derived cells. Although most studies to date involve 2-D cultures of patient-derived neurons, brain organoids are increasingly being employed to explore genetic DEE mechanisms. We are applying this approach to understand PMSE (Polyhydramnios, Megalencephaly and Symptomatic Epilepsy) syndrome, Rett Syndrome (in collaboration with Ben Novitch at UCLA) and Protocadherin-19 Clustering Epilepsy (PCE). I will describe our findings of robust structural phenotypes in PMSE and PCE patient-derived brain organoid models, as well as functional abnormalities identified in fusion organoid models of Rett syndrome. In addition to showing epilepsy-relevant phenotypes, both 2D and brain organoid cultures offer platforms to identify novel therapies. We will also discuss challenges and recent advances in the brain organoid field, including a new single rosette brain organoid model that we have developed. The field is advancing rapidly and our findings suggest that brain organoid approaches offers great promise for modeling genetic neurodevelopmental epilepsies and identifying precision therapies.

Energy landscapes, order and disorder, and protein sequence coevolution: From proteins to chromosome structure

In vivo, the human genome folds into a characteristic ensemble of 3D structures. The mechanism driving the folding process remains unknown. A theoretical model for chromatin (the minimal chromatin model) explains the folding of interphase chromosomes and generates chromosome conformations consistent with experimental data is presented. The energy landscape of the model was derived by using the maximum entropy principle and relies on two experimentally derived inputs: a classification of loci into chromatin types and a catalog of the positions of chromatin loops. This model was generalized by utilizing a neural network to infer these chromatin types using epigenetic marks present at a locus, as assayed by ChIP-Seq. The ensemble of structures resulting from these simulations completely agree with HI-C data and exhibits unknotted chromosomes, phase separation of chromatin types, and a tendency for open chromatin to lie at the periphery of chromosome territories. Although this theoretical methodology was trained in one cell line, the human GM12878 lymphoblastoid cells, it has successfully predicted the structural ensembles of multiple human cell lines. Finally, going beyond Hi-C, our predicted structures are also consistent with microscopy measurements. Analysis of both structures from simulation and microscopy reveals that short segments of chromatin make two-state transitions between closed conformations and open dumbbell conformations. For gene active segments, the vast majority of genes appear clustered in the linker region of the chromatin segment, allowing us to speculate possible mechanisms by which chromatin structure and dynamics may be involved in controlling gene expression. * Supported by the NSF

From genetics to neurobiology through transcriptomic data analysis

Over the past years, genetic studies have uncovered hundreds of genetic variants to be associated with complex brain disorders. While this really represents a big step forward in understanding the genetic etiology of brain disorders, the functional interpretation of these variants remains challenging. We aim to help with the functional characterization of variants through transcriptomic data analysis. For instance, we rely on brain transcriptome atlases, such as Allen Brain Atlases, to infer functional relations between genes. One example of this is the identification of signaling mechanisms of steroid receptors. Further, by integrating brain transcriptome atlases with neuropathology and neuroimaging data, we identify key genes and pathways associated with brain disorders (e.g. Parkinson's disease). With technological advances, we can now profile gene expression in single-cells at large scale. These developments have presented significant computational developments. Our lab focuses on developing scalable methods to identify cells in single-cell data through interactive visualization, scalable clustering, classification, and interpretable trajectory modelling. We also work on methods to integrate single-cell data across studies and technologies.

Spatiotemporal patterns of neocortical activity around hippocampal sharp-wave ripples

Neocortical-hippocampal interactions during off-line periods such as slow-wave sleep are implicated in memory processing. In particular, recent memory traces are replayed in hippocampus during some sharp-wave ripple (SWR) events, and these replay events are positively correlated with neocortical memory trace reactivation. A prevalent model is that SWR arise ‘spontaneously’ in CA3 and propagate recent memory ‘indices’ outward to the neocortex to enable memory consolidation there; however, the spatiotemporal distribution of neocortical activation relative to SWR is incompletely understood. We used wide-field optical imaging to study voltage and glutamate release transients in dorsal neocortex in relation to CA1 multiunit activity (MUA) and SWR of sleeping and urethane anesthetized mice. Modulation of voltage and glutamate release signals in relation to SWRs varied across superficial neocortical regions, and it was largest in posteromedial regions surrounding retrosplenial cortex (RSC), which receives strong hippocampal output connections. Activity tended to spread sequentially from more medial towards more lateral regions. Contrary to the unidirectional hypothesis, activation exhibited a continuum of timing relative to SWRs, varying from neocortex leading to neocortex lagging the SWRs (± ~250 msec). The timing continuum was correlated with the skewness of peri-SWR hippocampal MUA and with a tendency for some SWR to occur in clusters. Thus, contrary to the model in which SWRs arise spontaneously in hippocampus, neocortical activation often precedes SWRs and may thus constitute a trigger event in which neocortical information seeds associative reactivation of hippocampal ‘indices’.

A metabolic function of the hippocampal sharp wave-ripple

The hippocampal formation has been implicated in both cognitive functions as well as the sensing and control of endocrine states. To identify a candidate activity pattern which may link such disparate functions, we simultaneously measured electrophysiological activity from the hippocampus and interstitial glucose concentrations in the body of freely behaving rats. We found that clusters of sharp wave-ripples (SPW-Rs) recorded from both dorsal and ventral hippocampus reliably predicted a decrease in peripheral glucose concentrations within ~10 minutes. This correlation was less dependent on circadian, ultradian, and meal-triggered fluctuations, it could be mimicked with optogenetically induced ripples, and was attenuated by pharmacogenetically suppressing activity of the lateral septum, the major conduit between the hippocampus and subcortical structures. Our findings demonstrate that a novel function of the SPW-R is to modulate peripheral glucose homeostasis and offer a mechanism for the link between sleep disruption and blood glucose dysregulation seen in type 2 diabetes and obesity.

Self-organization of chemically active colloids with non-reciprocal interactions

Cells and microorganisms produce and consume all sorts of chemicals, from nutrients to signalling molecules. The same happens at the nanoscale inside cells themselves, where enzymes catalyse the production and consumption of the chemicals needed for life. In this work, we have found a generic mechanism by which such chemically-active particles, be it cells or enzymes or engineered synthetic colloids, can "sense" each other and ultimately self- organize in a multitude of ways. A peculiarity of these chemical-mediated interactions is that they break action-reaction symmetry : for example, one particle may be repelled from a second particle, which is in turn attracted to the first one, so that it ends up "chasing" it. Such chasing interactions allow for the formation of large clusters of particles that "swim" autonomously. Regarding enzymes, we find that they can spontaneously aggregate into clusters with precisely the right composition, so that the product of one enzyme is passed on, without lack or excess, to the next enzyme in the metabolic cascade.

Exploring Memories of Scenes

State-of-the-art machine vision models can predict human recognition memory for complex scenes with astonishing accuracy. In this talk I present work that investigated how memorable scenes are actually remembered and experienced by human observers. We found that memorable scenes were recognized largely based on recollection of specific episodic details but also based on familiarity for an entire scene. I thus highlight current limitations in machine vision models emulating human recognition memory, with promising opportunities for future research. Moreover, we were interested in what observers specifically remember about complex scenes. We thus considered the functional role of eye-movements as a window into the content of memories, particularly when observers recollected specific information about a scene. We found that when observers formed a memory representation that they later recollected (compared to scenes that only felt familiar), the overall extent of exploration was broader, with a specific subset of fixations clustered around later to-be-recollected scene content, irrespective of the memorability of a scene. I discuss the critical role that our viewing behavior plays in visual memory formation and retrieval and point to potential implications for machine vision models predicting the content of human memories.

Finding the Fault Lines: Detecting Urban Social Boundaries using Social Data Science

In urban environments, social boundaries are the areas that emerge from processes of economic inequality and social segregation. These boundaries are important, as they serve both as areas of interaction and conflict. By applying geographical thinking to classic methods in data science, we can better understand where these boundaries emerge and how they delineate communities. In this talk, I’ll explain a bit about the basics of “boundary detection” in urban analytics. I’ll present a new method, the “geosilhouette,” that builds on previous methods of identifying the boundaries between clusters. And, finally, I’ll show how this can change our understanding of urban community.

A machine learning way to analyse white matter tractography streamlines / Application of artificial intelligence in correcting motion artifacts and reducing scan time in MRI

1. Embedding is all you need: A machine learning way to analyse white matter tractography streamlines - Dr Shenjun Zhong, Monash Biomedical Imaging Embedding white matter streamlines with various lengths into fixed-length latent vectors enables users to analyse them with general data mining techniques. However, finding a good embedding schema is still a challenging task as the existing methods based on spatial coordinates rely on manually engineered features, and/or labelled dataset. In this webinar, Dr Shenjun Zhong will discuss his novel deep learning model that identifies latent space and solves the problem of streamline clustering without needing labelled data. Dr Zhong is a Research Fellow and Informatics Officer at Monash Biomedical Imaging. His research interests are sequence modelling, reinforcement learning and federated learning in the general medical imaging domain. 2. Application of artificial intelligence in correcting motion artifacts and reducing scan time in MRI - Dr Kamlesh Pawar, Monash Biomedical imaging Magnetic Resonance Imaging (MRI) is a widely used imaging modality in clinics and research. Although MRI is useful it comes with an overhead of longer scan time compared to other medical imaging modalities. The longer scan times also make patients uncomfortable and even subtle movements during the scan may result in severe motion artifact in the images. In this seminar, Dr Kamlesh Pawar will discuss how artificial intelligence techniques can reduce scan time and correct motion artifacts. Dr Pawar is a Research Fellow at Monash Biomedical Imaging. His research interest includes deep learning, MR physics, MR image reconstruction and computer vision.

Acoustically Levitated Granular Matter

Granular matter can serve as a prototype for exploring the rich physics of many-body systems driven far from equilibrium. This talk will outline a new direction for granular physics with macroscopic particles, where acoustic levitation compensates the forces due to gravity and eliminates frictional interactions with supporting surfaces in order to focus on particle interactions. Levitating small particles by intense ultrasound fields in air makes it possible to manipulate and control their positions and assemble them into larger aggregates. The small air viscosity implies that the regime of underdamped dynamics can be explored, where inertial effects are important, in contrast to typical colloids in a liquid, where inertia can be neglected. Sound scattered off individual, levitated solid particles gives rise to controllable attractive forces with neighboring particles. I will discuss some of the key concepts underlying acoustic levitation, describe how detuning an acoustic cavity can introduce active fluctuations that control the assembly statistics of small levitated particles clusters, and give examples of how interactions between neighboring levitated objects can be controlled by their shape.

Organization of Midbrain Serotonin System

The serotonin system is the most frequently targeted neural system pharmacologically for treating psychiatric disorders, including depression and anxiety. Serotonin neurons of the dorsal and median raphe nuclei (DR, MR) collectively innervate the entire forebrain and midbrain, modulating diverse physiology and behaviour. By using viral-genetic methods, we found that DR serotonin system contains parallel sub-systems that differ in input and output connectivity, physiological response properties, and behavioural functions. To gain a fundamental understanding of the molecular heterogeneity of DR and MR, we used single-cell RNA - sequencing (scRNA-seq) to generate a comprehensive dataset comprising eleven transcriptomically distinct serotonin neuron clusters. We generated novel intersectional viral-genetic tools to access specific subpopulations. Whole-brain axonal projection mapping revealed that the molecular features of these distinct serotonin groups reflect their anatomical organization and provide tools for future exploration of the full projection map of molecularly defined serotonin groups. The molecular architecture of serotonin system lays the foundation for integrating anatomical, neurochemical, physiological, and behavioural functions.

Interacting synapses stabilise both learning and neuronal dynamics in biological networks

Distinct synapses influence one another when they undergo changes, with unclear consequences for neuronal dynamics and function. Here we show that synapses can interact such that excitatory currents are naturally normalised and balanced by inhibitory inputs. This happens when classical spike-timing dependent synaptic plasticity rules are extended by additional mechanisms that incorporate the influence of neighbouring synaptic currents and regulate the amplitude of efficacy changes accordingly. The resulting control of excitatory plasticity by inhibitory activation, and vice versa, gives rise to quick and long-lasting memories as seen experimentally in receptive field plasticity paradigms. In models with additional dendritic structure, we observe experimentally reported clustering of co-active synapses that depends on initial connectivity and morphology. Finally, in recurrent neural networks, rich and stable dynamics with high input sensitivity emerge, providing transient activity that resembles recordings from the motor cortex. Our model provides a general framework for codependent plasticity that frames individual synaptic modifications in the context of population-wide changes, allowing us to connect micro-level physiology with behavioural phenomena.

An Adaptive-Gravity Model for Insect Swarms: Miniature Star-Clusters Buzzing Above Your Heads in the Park

Global AND Scale-Free? Spontaneous cortical dynamics between functional networks and cortico-hippocampal communication

Recent advancements in anatomical and functional imaging emphasize the presence of whole-brain networks organized according to functional and connectivity gradients, but how such structure shapes activity propagation and memory processes still lacks asatisfactory model. We analyse the fine-grained spatiotemporal dynamics of spontaneous activity in the entire dorsal cortex. through simultaneous recordings of wide-field voltage sensitive dye transients (VS), cortical ECoG, and hippocampal LFP in anesthetized mice. Both VS and ECoG show cortical avalanches. When measuring avalanches from the VS signal, we find a major deviation of the size scaling from the power-law distribution predicted by the criticality hypothesis and well approximated by the results from the ECoG. Breaking from scale-invariance, avalanches can thus be grouped in two regimes. Small avalanches consists of a limited number of co-activation modes involving a sub-set of cortical networks (related to the Default Mode Network), while larger avalanches involve a substantial portion of the cortical surface and can be clustered into two families: one immediately preceded by Retrosplenial Cortex activation and mostly involving medial-posterior networks, the other initiated by Somatosensory Cortex and extending preferentially along the lateral-anterior region. Rather than only differing in terms of size, these two set of events appear to be associated with markedly different brain-wide dynamical states: they are accompaniedby a shift in the hippocampal LFP, from the ripple band (smaller) to the gamma band (larger avalanches), and correspond to opposite directionality in the cortex-to-hippocampus causal relationship. These results provide a concrete description of global cortical dynamics, and shows how cortex in its entirety is involved in bi-directional communication in the hippocampus even in sleep-like states.

Collective Ecophysiology and Physics of Social Insects

Collective behavior of organisms creates environmental micro-niches that buffer them from environmental fluctuations e.g., temperature, humidity, mechanical perturbations, etc., thus coupling organismal physiology, environmental physics, and population ecology. This talk will focus on a combination of biological experiments, theory, and computation to understand how a collective of bees can integrate physical and behavioral cues to attain a non-equilibrium steady state that allows them to resist and respond to environmental fluctuations of forces and flows. We analyze how bee clusters change their shape and connectivity and gain stability by spread-eagling themselves in response to mechanical perturbations. Similarly, we study how bees in a colony respond to environmental thermal perturbations by deploying a fanning strategy at the entrance that they use to create a forced ventilation stream that allows the bees to collectively maintain a constant hive temperature. When combined with quantitative analysis and computations in both systems, we integrate the sensing of the environmental cues (acceleration, temperature, flow) and convert them to behavioral outputs that allow the swarms to achieve a dynamic homeostasis.

Multitask performance humans and deep neural networks

Humans and other primates exhibit rich and versatile behaviour, switching nimbly between tasks as the environmental context requires. I will discuss the neural coding patterns that make this possible in humans and deep networks. First, using deep network simulations, I will characterise two distinct solutions to task acquisition (“lazy” and “rich” learning) which trade off learning speed for robustness, and depend on the initial weights scale and network sparsity. I will chart the predictions of these two schemes for a context-dependent decision-making task, showing that the rich solution is to project task representations onto orthogonal planes on a low-dimensional embedding space. Using behavioural testing and functional neuroimaging in humans, we observe BOLD signals in human prefrontal cortex whose dimensionality and neural geometry are consistent with the rich learning regime. Next, I will discuss the problem of continual learning, showing that behaviourally, humans (unlike vanilla neural networks) learn more effectively when conditions are blocked than interleaved. I will show how this counterintuitive pattern of behaviour can be recreated in neural networks by assuming that information is normalised and temporally clustered (via Hebbian learning) alongside supervised training. Together, this work offers a picture of how humans learn to partition knowledge in the service of structured behaviour, and offers a roadmap for building neural networks that adopt similar principles in the service of multitask learning. This is work with Andrew Saxe, Timo Flesch, David Nagy, and others.

“Cell Surface Topography: The Role of Protein Size at Cell-Cell Interfaces”

Membrane interfaces formed at junctions between cells are often associated with characteristic patterns of membrane protein organization, such as in epithelial tissues and between cells of the immune system. While this organization can be influenced by receptor clustering, lipid domain formation, and cytoskeletal dynamics, this talk will describe how cell surface molecular height can directly contribute to the spatial arrangement of membrane proteins and downstream signaling. Using a new optical method for characterizing molecular height, together with experiments using giant vesicles in vitro systems and live immune cells, we are investigating how cell surface molecular heights can be key contributors to cell-cell communication.

Local and global organization of synaptic inputs on cortical dendrites

Synaptic inputs on cortical dendrites are organized with remarkable subcellular precision at the micron level. This organization emerges during early postnatal development through patterned spontaneous activity and manifests both locally where synapses with similar functional properties are clustered, and globally along the axis from dendrite to soma. Recent experiments reveal species-specific differences in the local and global synaptic organization in mouse, ferret and macaque visual cortex. I will present a computational framework that implements functional and structural plasticity from spontaneous activity patterns to generate these different types of organization across species and scales. Within this framework, a single anatomical factor - the size of the visual cortex and the resulting magnification of visual space - can explain the observed differences. This allows us to make predictions about the organization of synapses also in other species and indicates that the proximal-distal axis of a dendrite might be central in endowing a neuron with powerful computational capabilities.

Physiological importance of phase separation: a case study in synapse formation

Synapse formation during neuronal development is critical to establish neural circuits and a nervous system1. Every presynapse builds a core active zone structure where ion channels are clustered and synaptic vesicles are released2. While the composition of active zones is well characterized2,3, how active zone proteins assemble together and recruit synaptic release machinery during development is not clear. Here, we find core active zone scaffold proteins SYD-2/Liprin-α and ELKS-1 phase separate during an early stage of synapse development, and later mature into a solid structure. We directly test the in vivo function of phase separation with mutants specifically lacking this activity. These mutant SYD-2 and ELKS-1 proteins remain enriched at synapses, but are defective in active zone assembly and synapse function. The defects are rescued with the introduction of a phase separation motif from an unrelated protein. In vitro, we reconstitute the SYD-2 and ELKS-1 liquid phase scaffold and find it is competent to bind and incorporate downstream active zone components. The fluidity of SYD-2 and ELKS-1 condensates is critical for efficient mixing and incorporation of active zone components. These data reveal that a developmental liquid phase of scaffold molecules is essential for synaptic active zone assembly before maturation into a stable final structure.

Genetic dissection of the Fgf5 enhancer cluster

Untangling the web of behaviours used to produce spider orb webs

Many innate behaviours are the result of multiple sensorimotor programs that are dynamically coordinated to produce higher-order behaviours such as courtship or architecture construction. Extendend phenotypes such as architecture are especially useful for ethological study because the structure itself is a physical record of behavioural intent. A particularly elegant and easily quantifiable structure is the spider orb-web. The geometric symmetry and regularity of these webs have long generated interest in their behavioural origin. However, quantitative analyses of this behaviour have been sparse due to the difficulty of recording web-making in real-time. To address this, we have developed a novel assay enabling real-time, high-resolution tracking of limb movements and web structure produced by the hackled orb-weaver Uloborus diversus. With its small brain size of approximately 100,000 neurons, the spider U. diversus offers a tractable model organism for the study of complex behaviours. Using deep learning frameworks for limb tracking, and unsupervised behavioural clustering methods, we have developed an atlas of stereotyped movement motifs and are investigating the behavioural state transitions of which the geometry of the web is an emergent property. In addition to tracking limb movements, we have developed algorithms to track the web’s dynamic graph structure. We aim to model the relationship between the spider’s sensory experience on the web and its motor decisions, thereby identifying the sensory and internal states contributing to this sensorimotor transformation. Parallel efforts in our group are establishing 2-photon in vivo calcium imaging protocols in this spider, eventually facilitating a search for neural correlates underlying the internal and sensory state variables identified by our behavioural models. In addition, we have assembled a genome, and are developing genetic perturbation methods to investigate the genetic underpinnings of orb-weaving behaviour. Together, we aim to understand how complex innate behaviours are coordinated by underlying neuronal and genetic mechanisms.

Dendritic nonlinearities and synapse type-specific input clustering enable the development of input selectivity in a wide range of settings.

Bernstein Conference 2024

The role of gap junctions and clustered connectivity in emergent synchronisation patterns of spiking inhibitory neuronal networks

Bernstein Conference 2024

Unsupervised clustering of burst shapes reveals the increasing complexity of developing networks in vitro

Bernstein Conference 2024

Clustered recurrent connectivity promotes the development of E/I co-tuning via synaptic plasticity

COSYNE 2022

Weighted clustering motifs and small-worldness in connectomes

COSYNE 2022

Weighted clustering motifs and small-worldness in connectomes

COSYNE 2022

Circuit-based framework for fine spatial scale clustering of orientation tuning in mouse V1

COSYNE 2023

Clustering Inductive Biases with Unrolled Networks

COSYNE 2023

Clustered representation of vocalizations in the auditory midbrain of the echolocating bat

COSYNE 2023

Place Cells are Clustered by Field Location in CA1 Hippocampus

COSYNE 2023

Synaptic-type-specific clustering optimizes the computational capabilities of balanced recurrent networks

COSYNE 2023

Dynamics of clustered spiking networks via the CTLN model

COSYNE 2025

Activity-dependent regulation of clustered gamma protocadherins (c-γPCDH) expression during circuit assembly in Purkinje cells

FENS Forum 2024

Automatized curation of spike sorting clusters

FENS Forum 2024

Characterization of dendritic spine morphology through a segmentation-clusterization approach

FENS Forum 2024

Clustering visual sensory neurons based on their invariances

FENS Forum 2024

Impact of barrel cortex lesions and sensory deprivation on perceptual decision-making: Insights from computer vision and time series clustering of freely moving behavioral strategies

FENS Forum 2024

Redox-dependent synaptic clustering of gephyrin

FENS Forum 2024

Synapsin 2a tetramerisation selectively controls the nanoscale clustering of reserve synaptic vesicles at the hippocampal presynapse

FENS Forum 2024

Targeting clusterin for therapeutic intervention in gliomas

FENS Forum 2024

Three-dimensional organization of connexin clusters along axonal cisternal organelle networks in human pyramidal neurons

FENS Forum 2024