Electroencephalography (EEG) has been thoroughly studied for decades in psychiatry research. Yet its integration into clinical practice as a diagnostic/prognostic tool remains unachieved. We hypothesize that a key reason is the underlying patient's heterogeneity, overlooked in psychiatric EEG research relying on a case-control approach. We combine HD-EEG with normative modeling to quantify this heterogeneity using two well-established and extensively investigated EEG characteristics -spectral power and functional connectivity- across a cohort of 1674 patients with attention-deficit/hyperactivity disorder, autism spectrum disorder, learning disorder, or anxiety, and 560 matched controls. Normative models showed that deviations from population norms among patients were highly heterogeneous and frequency-dependent. Deviation spatial overlap across patients did not exceed 40% and 24% for spectral and connectivity, respectively. Considering individual deviations in patients has significantly enhanced comparative analysis, and the identification of patient-specific markers has demonstrated a correlation with clinical assessments, representing a crucial step towards attaining precision psychiatry through EEG.

Neuroimaging has greatly extended our capacity to study the workings of the human brain. Despite the wealth of knowledge this tool has generated however, there are still critical gaps in our understanding. While tremendous progress has been made in mapping areas of the brain that are specialized for particular stimuli, or cognitive processes, we still know very little about how large-scale interactions between different cortical networks facilitate the integration of information and the execution of complex tasks. Yet even the simplest behavioral tasks are complex, requiring integration over multiple cognitive domains. Our knowledge falls short not only in understanding how this integration takes place, but also in what drives the profound variation in behavior that can be observed on almost every task, even within the typically developing (TD) population. The search for the neural underpinnings of individual differences is important not only philosophically, but also in the service of precision medicine. We approach these questions using a three-pronged approach. First, we create a battery of behavioral tasks from which we can calculate objective measures for different aspects of the behaviors of interest, with sufficient variance across the TD population. Second, using these individual differences in behavior, we identify the neural variance which explains the behavioral variance at the network level. Finally, using covert neurofeedback, we perturb the networks hypothesized to correspond to each of these components, thus directly testing their casual contribution. I will discuss our overall approach, as well as a few of the new directions we are currently pursuing.

Sound waves can be used to modify brain activity safely and transiently with unprecedented precision even deep in the brain - unlike traditional brain stimulation methods. In a series of studies in humans and non-human primates, I will show that Transcranial Ultrasound Stimulation (TUS) can have medium- to long-lasting effects. Multiple read-outs allow us to conclude that TUS can perturb neuronal tissues up to 2h after intervention, including changes in local and distributed brain network configurations, behavioural changes, task-related neuronal changes and chemical changes in the sonicated focal volume. Combined with multiple neuroimaging techniques (resting state functional Magnetic Resonance Imaging [rsfMRI], Spectroscopy [MRS] and task-related fMRI changes), this talk will focus on recent human TUS studies.

Advanced noninvasive neuroimaging methods provide valuable information on the brain function, but they have obvious pros and cons in terms of temporal and spatial resolution. Functional magnetic resonance imaging (fMRI) using blood-oxygenation-level-dependent (BOLD) effect provides good spatial resolution in the order of millimeters, but has a poor temporal resolution in the order of seconds due to slow hemodynamic responses to neuronal activation, providing indirect information on neuronal activity. In contrast, electroencephalography (EEG) and magnetoencephalography (MEG) provide excellent temporal resolution in the millisecond range, but spatial information is limited to centimeter scales. Therefore, there has been a longstanding demand for noninvasive brain imaging methods capable of detecting neuronal activity at both high temporal and spatial resolution. In this talk, I will introduce a novel approach that enables Direct Imaging of Neuronal Activity (DIANA) using MRI that can dynamically image neuronal spiking activity in milliseconds precision, achieved by data acquisition scheme of rapid 2D line scan synchronized with periodically applied functional stimuli. DIANA was demonstrated through in vivo mouse brain imaging on a 9.4T animal scanner during electrical whisker-pad stimulation. DIANA with milliseconds temporal resolution had high correlations with neuronal spike activities, which could also be applied in capturing the sequential propagation of neuronal activity along the thalamocortical pathway of brain networks. In terms of the contrast mechanism, DIANA was almost unaffected by hemodynamic responses, but was subject to changes in membrane potential-associated tissue relaxation times such as T2 relaxation time. DIANA is expected to break new ground in brain science by providing an in-depth understanding of the hierarchical functional organization of the brain, including the spatiotemporal dynamics of neural networks.

Mobile organisms must be capable of deciding both where and when to move in order to keep up with a changing environment; therefore, a strong sense of time is necessary, otherwise, we would fail in many of our movement goals. Despite this intrinsic link between movement and timing, only recently has research begun to investigate the interaction. Two primary effects that have been observed include: movements biasing time estimates (i.e., affecting accuracy) as well as making time estimates more precise. The goal of this presentation is to review this literature, discuss a Bayesian cue combination framework to explain these effects, and discuss the experiments I have conducted to test the framework. The experiments herein include: a motor timing task comparing the effects of movement vs non-movement with and without feedback (Exp. 1A & 1B), a transcranial magnetic stimulation (TMS) study on the role of the supplementary motor area (SMA) in transforming temporal information (Exp. 2), and a perceptual timing task investigating the effect of noisy movement on time perception with both visual and auditory modalities (Exp. 3A & 3B). Together, the results of these studies support the Bayesian cue combination framework, in that: movement improves the precision of time perception not only in perceptual timing tasks but also motor timing tasks (Exp. 1A & 1B), stimulating the SMA appears to disrupt the transformation of temporal information (Exp. 2), and when movement becomes unreliable or noisy there is no longer an improvement in precision of time perception (Exp. 3A & 3B). Although there is support for the proposed framework, more studies (i.e., fMRI, TMS, EEG, etc.) need to be conducted in order to better understand where and how this may be instantiated in the brain; however, this work provides a starting point to better understanding the intrinsic connection between time and movement

When listening to music, humans readily perceive and move along with a periodic beat. Critically, perception of a periodic beat is commonly elicited by rhythmic stimuli with physical features arranged in a way that is not strictly periodic. Hence, beat perception must capitalize on mechanisms that transform stimulus features into a temporally recurrent format with emphasized beat periodicity. Here, I will present a line of work that aims to clarify the nature and neural basis of this transformation. In these studies, electrophysiological activity was recorded as participants listened to rhythms known to induce perception of a consistent beat across healthy Western adults. The results show that the human brain selectively emphasizes beat representation when it is not acoustically prominent in the stimulus, and this transformation (i) can be captured non-invasively using surface EEG in adult participants, (ii) is already in place in 5- to 6-month-old infants, and (iii) cannot be fully explained by subcortical auditory nonlinearities. Moreover, as revealed by human intracerebral recordings, a prominent beat representation emerges already in the primary auditory cortex. Finally, electrophysiological recordings from the auditory cortex of a rhesus monkey show a significant enhancement of beat periodicities in this area, similar to humans. Taken together, these findings indicate an early, general auditory cortical stage of processing by which rhythmic inputs are rendered more temporally recurrent than they are in reality. Already present in non-human primates and human infants, this "periodized" default format could then be shaped by higher-level associative sensory-motor areas and guide movement in individuals with strongly coupled auditory and motor systems. Together, this highlights the multiplicity of neural processes supporting coordinated musical behaviors widely observed across human cultures.The experiments herein include: a motor timing task comparing the effects of movement vs non-movement with and without feedback (Exp. 1A & 1B), a transcranial magnetic stimulation (TMS) study on the role of the supplementary motor area (SMA) in transforming temporal information (Exp. 2), and a perceptual timing task investigating the effect of noisy movement on time perception with both visual and auditory modalities (Exp. 3A & 3B). Together, the results of these studies support the Bayesian cue combination framework, in that: movement improves the precision of time perception not only in perceptual timing tasks but also motor timing tasks (Exp. 1A & 1B), stimulating the SMA appears to disrupt the transformation of temporal information (Exp. 2), and when movement becomes unreliable or noisy there is no longer an improvement in precision of time perception (Exp. 3A & 3B). Although there is support for the proposed framework, more studies (i.e., fMRI, TMS, EEG, etc.) need to be conducted in order to better understand where and how this may be instantiated in the brain; however, this work provides a starting point to better understanding the intrinsic connection between time and movement

Focal Cortical Dysplasia (FCD) is the most common focal cortical malformation leading to intractable childhood focal epilepsy. In recent years, we and others have shown that FCD type II is caused by mosaic mutations in genes within the PI3K-AKT-mTOR-signaling pathway. Hyperactivation of the mTOR pathway accounts for neuropathological abnormalities and seizure occurrence in FCD. We further showed from human surgical FCDII tissue that epileptiform activity correlates with the density of mutated dysmorphic neurons, supporting their pro-epileptogenic role. The level of mosaicism, as defined by variant allele frequency (VAF) is thought to correlate with the size and regional brain distribution of the lesion such that when a somatic mutation occurs early during the cortical development, the dysplastic area is smaller than if it occurs later. Novel approaches based on the detection of cell-free DNA from the CSF and from trace tissue adherent to SEEG electrodes promise future opportunities for genetic testing during the presurgical evaluation of refractory epilepsy patients or in those that are not eligible for surgery. In utero-based electroporation mouse models allow to express somatic mutation during neurodevelopment and recapitulate most neuropathological and clinical features of FCDII, establishing relevant preclinical mouse models for developing precision medicine strategies.

Many engineered and biological systems must trade off performance and energy use, and the brain is no exception. While there are theories on how activity levels are controlled in biological networks through feedback control (homeostasis), it is not clear what the effects on population coding are, and therefore how performance and energy can be traded off. In this talk we will consider this tradeoff in auto-encoding networks, in which there is a clear definition of performance (the coding loss). We first show how SNNs follow a characteristic trade-off curve between activity levels and coding loss, but that standard networks need to be retrained to achieve different tradeoff points. We next formalize this tradeoff with a joint loss function incorporating coding loss (performance) and activity loss (energy use). From this loss we derive a class of spiking networks which coordinates its spiking to minimize both the activity and coding losses -- and as a result can dynamically adjust its coding precision and energy use. The network utilizes several known activity control mechanisms for this --- threshold adaptation and feedback inhibition --- and elucidates their potential function within neural circuits. Using geometric intuition, we demonstrate how these mechanisms regulate coding precision, and thereby performance. Lastly, we consider how these insights could be transferred to trained SNNs. Overall, this work addresses a key energy-coding trade-off which is often overlooked in network studies, expands on our understanding of homeostasis in biological SNNs, as well as provides a clear framework for considering performance and energy use in artificial SNNs.

Monash Biomedical Imaging is part of the new $71.2 million Australian Precision Medicine Enterprise (APME) facility, which will deliver large-scale development and manufacturing of precision medicines and theranostic radiopharmaceuticals for industry and research. A key feature of the APME project is a high-energy cyclotron with multiple production clean rooms, which will be located on the Monash Biomedical Imaging (MBI) site in Clayton. This strategic co-location will facilitate radiochemistry, PET and SPECT research and clinical use of theranostic (therapeutic and diagnostic) radioisotopes produced on-site. In this webinar, MBI’s Professor Gary Egan and Dr Maggie Aulsebrook will explain how the APME will secure Australia’s supply of critical radiopharmaceuticals, build a globally competitive Australian manufacturing hub, and train scientists and engineers for the Australian workforce. They will cover the APME’s state-of-the-art 30 MeV and 18-24 MeV cyclotrons and radiochemistry facilities, as well as the services that will be accessible to students, scientists, clinical researchers, and pharmaceutical companies in Australia and around the world. The APME is a collaboration between Monash University, Global Medical Solutions Australia, and Telix Pharmaceuticals. Professor Gary Egan is Director of Monash Biomedical Imaging, Director of the ARC Centre of Excellence for Integrative Brain Function and a Distinguished Professor at the Turner Institute for Brain and Mental Health, Monash University. He is also lead investigator of the Victorian Biomedical Imaging Capability, and Deputy Director of the Australian National Imaging Facility. Dr Maggie Aulsebrook obtained her PhD in Chemistry at Monash University and specialises in the development and clinical translation of radiopharmaceuticals. She has led the development of several investigational radiopharmaceuticals for first-in-human application. Maggie leads the Radiochemistry Platform at Monash Biomedical Imaging.

Cognitive and emotional processes are shaped by the dynamic integration of brain and body. A major channel of interoceptive information comes from the heart, where phasic signals are conveyed to the brain to indicate how fast and strong the heart is beating. This talk will discuss how interoceptive processes operate across conscious and unconscious levels to influence emotion and memory. The interoceptive channel is disrupted in distinct ways in individuals with autism and anxiety. Selective interoceptive disturbance is related to symptomatology including dissociation and the transdiagnostic expression of anxiety. Interoceptive training can reduce anxiety, with enhanced interoceptive precision associated with greater insula connectivity following targeted interoceptive feedback. The discrete cardiac effects on emotion and cognition have broad relevance to clinical neuroscience, with implications for peripheral treatment targets and behavioural interventions.

One elementary brain function that underlies many of our cognitive behaviors is the ability to maintain parametric information briefly in mind, in the time scale of seconds, to span delays between sensory information and actions. This component of working memory is fragile and quickly degrades with delay length. Under the assumption that behavioral delay-dependencies mark core functions of the working memory system, our goal is to find a neural circuit model that represents their neural mechanisms and apply it to research on working memory deficits in neuropsychiatric disorders. We have constrained computational models of spatial working memory with delay-dependent behavioral effects and with neural recordings in the prefrontal cortex during visuospatial working memory. I will show that a simple bump attractor model with weak inhomogeneities and short-term plasticity mechanisms can link neural data with fine-grained behavioral output in a trial-by-trial basis and account for the main delay-dependent limitations of working memory: precision, cardinal repulsion biases and serial dependence. I will finally present data from participants with neuropsychiatric disorders that suggest that serial dependence in working memory is specifically altered, and I will use the model to infer the possible neural mechanisms affected.

Information processing is energetically expensive. In the mammalian brain, it is unclear how information coding and energy usage are regulated during food scarcity. I addressed this in the visual cortex of awake mice using whole-cell recordings and two-photon imaging to monitor layer 2/3 neuronal activity and ATP usage. I found that food restriction reduced synaptic ATP usage by 29% through a decrease in AMPA receptor conductance. Neuronal excitability was nonetheless preserved by a compensatory increase in input resistance and a depolarized resting membrane potential. Consequently, neurons spiked at similar rates as controls, but spent less ATP on underlying excitatory currents. This energy-saving strategy had a cost since it amplified the variability of visually-evoked subthreshold responses, leading to a 32% broadening in orientation tuning and impaired fine visual discrimination. This reduction in coding precision was associated with reduced levels of the fat mass-regulated hormone leptin and was restored by exogenous leptin supplementation. These findings reveal novel mechanisms that dynamically regulate energy usage and coding precision in neocortex.

Precise synaptic connectivity is a prerequisite for the function of neural circuits, yet individual neurons, taken out of their developmental context, readily form unspecific synapses. How does genetically encoded brain wiring deal with this apparent contradiction? Brain wiring is a developmental growth process that is not only characterized by precision, but also flexibility and robustness. As in any other growth process, cellular interactions are restricted in space and time. Correspondingly, molecular and cellular interactions are restricted to those that 'get to see' each other during development. This seminar will explore the question how neurons decide when and where to make synapses using the Drosophila visual system as a model. New findings reveal that pattern formation during growth and the kinetics of live neuronal interactions restrict synapse formation and partner choice for neurons that are not otherwise prevented from making incorrect synapses in this system. For example, cell biological mechanisms like autophagy as well as developmental temperature restrict inappropriate partner choice through a process of kinetic exclusion that critically contributes to wiring specificity. The seminar will explore these and other neuronal strategies when and where to make synapses during developmental growth that contribute to precise, flexible and robust outcomes in brain wiring.

To survive in the wild small rodents evolved specialized retinas. To escape predators, looming shadows need to be detected with speed and precision. To evade starvation, small seeds, grass, nuts and insects need to also be detected quickly. Some of these succulent seeds and insects may be camouflaged offering only low contrast targets.Moreover, these challenging tasks need to be accomplished continuously at dusk, night, dawn and daytime. Crossover inhibition is thought to be involved in enhancing contrast detectionin the microcircuits of the inner plexiform layer of the mammalian retina. The AII amacrine cells are narrow field cells that play a key role in crossover inhibition. Our lab studies the synaptic physiology that regulates glycine release from AII amacrine cellsin mouse retina. These interneurons receive excitation from rod and conebipolar cells and transmit excitation to ON-type bipolar cell terminals via gap junctions. They also transmit inhibition via multiple glycinergic synapses onto OFF bipolar cell terminals.AII amacrine cells are thus a central hub of synaptic information processing that cross links the ON and the OFF pathways. What are the functions of crossover inhibition? How does it enhance contrast detection at different ambient light levels? How is the dynamicrange, frequency response and synaptic gain of glycine release modulated by luminance levels and circadian rhythms? How is synaptic gain changed by different extracellular neuromodulators, like dopamine, and by intracellular messengers like cAMP, phosphateand Ca2+ ions from Ca2+ channels and Ca2+ stores? My talk will try to answer some of these questions and will pose additional ones. It will end with further hypothesis and speculations on the multiple roles of crossover inhibition.

Despite the challenges COVID-19 has continued to present, Monash Biomedical Imaging (MBI) has had another outstanding year in terms of publications and scientific output. In this webinar, Professor Gary Egan, Director of MBI, will present an overview of MBI’s achievements during 2021 and outline the biomedical imaging research programs and partnerships in 2022. His presentation will cover: • MBI operational and research achievements during 2021 • Biomedical imaging technology developments and research outcomes during 2021 • Linked laboratories and research teams at MBI • Progress on the development of a cyclotron and precision radiopharmaceutical facility at Clayton • Emerging research opportunities at the Monash Heart Hospital in cardiology and cardiovascular disease. Professor Gary Egan is Director of Monash Biomedical Imaging, Director of the ARC Centre of Excellence for Integrative Brain Function and a Distinguished Professor at the Turner Institute for Brain and Mental Health, Monash University. He is also lead investigator of the Victorian Biomedical Imaging Capability, and Deputy Director of the Australian National Imaging Facility. His substantive body of published work has made a significant impact on the neuroimaging and neuroscience fields. He has sustained success in obtaining significant grants to support his own research and the development of facilities to advance biomedical imaging.

Recent advances in optogenetics allow for stimulation of neurons with sub-millisecond spike jitter and single neuron selectivity. Already this precision has revealed new levels of cortical sensitivity: stimulating tens of neurons can yield changes in the mean firing rate of thousands of similarly tuned neurons. This extreme sensitivity suggests that cortical dynamics are near criticality. Criticality is often studied in neural systems as a non-equilibrium thermodynamic process in which scale-free patterns of activity, called avalanches, emerge between distinct states of spontaneous activity. While criticality is well studied, it is still unclear what these distinct states of spontaneous activity are and what responses we expect from stimulation of this activity. By answering these questions, optogenetic stimulation will become a new avenue for approaching criticality and understanding cortical dynamics. Here, for the first time, we study the effects of optogenetic-like stimulation on a model near criticality. We study a model of Inhibitory/Excitatory (I/E) Leaky Integrate and Fire (LIF) spiking neurons which display a region of high sensitivity as seen in experiments. We find that this region of sensitivity is, indeed, near criticality. We derive the Dynamic Mean Field Theory of this model and find that the distinct states of activity are asynchrony and synchrony. We use our theory to characterize response to various types and strengths of optogenetic stimulation. Our model and theory predict that asynchronous, near-critical dynamics can have two qualitatively different responses to stimulation: one characterized by high sensitivity, discrete event responses, and high trial-to-trial variability, and another characterized by low sensitivity, continuous responses with characteristic frequencies, and low trial-to-trial variability. While both response types may be considered near-critical in model space, networks which are closest to criticality show a hybrid of these response effects.

Modeling neural responses to naturalistic stimuli has been instrumental in advancing our understanding of the visual system. Dominant computational modeling efforts in this direction have been deeply rooted in preconceived hypotheses. In contrast, hypothesis-neutral computational methodologies with minimal apriorism which bring neuroscience data directly to bear on the model development process are likely to be much more flexible and effective in modeling and understanding tuning properties throughout the visual system. In this study, we develop a hypothesis-neutral approach and characterize response selectivity in the human visual cortex exhaustively and systematically via response-optimized deep neural network models. First, we leverage the unprecedented scale and quality of the recently released Natural Scenes Dataset to constrain parametrized neural models of higher-order visual systems and achieve novel predictive precision, in some cases, significantly outperforming the predictive success of state-of-the-art task-optimized models. Next, we ask what kinds of functional properties emerge spontaneously in these response-optimized models? We examine trained networks through structural ( feature visualizations) as well as functional analysis (feature verbalizations) by running `virtual' fMRI experiments on large-scale probe datasets. Strikingly, despite no category-level supervision, since the models are solely optimized for brain response prediction from scratch, the units in the networks after optimization act as detectors for semantic concepts like `faces' or `words', thereby providing one of the strongest evidences for categorical selectivity in these visual areas. The observed selectivity in model neurons raises another question: are the category-selective units simply functioning as detectors for their preferred category or are they a by-product of a non-category-specific visual processing mechanism? To investigate this, we create selective deprivations in the visual diet of these response-optimized networks and study semantic selectivity in the resulting `deprived' networks, thereby also shedding light on the role of specific visual experiences in shaping neuronal tuning. Together with this new class of data-driven models and novel model interpretability techniques, our study illustrates that DNN models of visual cortex need not be conceived as obscure models with limited explanatory power, rather as powerful, unifying tools for probing the nature of representations and computations in the brain.

Large-scale recordings of neural activity are providing new opportunities to study network-level dynamics with unprecedented detail. However, the sheer volume of data and its dynamical complexity are major barriers to uncovering and interpreting these dynamics. I will present machine learning frameworks that enable inference of dynamics from neuronal population spiking activity on single trials and millisecond timescales, from diverse brain areas, and without regard to behavior. I will then demonstrate extensions that allow recovery of dynamics from two-photon calcium imaging data with surprising precision. Finally, I will discuss our efforts to facilitate comparisons within our field by curating datasets and standardizing model evaluation, including a currently active modeling challenge, the 2021 Neural Latents Benchmark [neurallatents.github.io].

Atherosclerosis is the underlying cause of major cardiovascular events, including heart attack and stroke. The build-up of plaque in coronary arteries can be a major risk for events, but risk is significantly higher in patients with vulnerable rather than stable plaque. Diagnostic imaging of vulnerable plaque is extremely useful for both stratifying patient risk and for determining effectiveness of experimental intervention in reducing cardiovascular risk. In the preclinical setting, being able to distinguish between stable and vulnerable plaque development and pair this with biochemical measures is critical for identification of new experimental candidates. In this webinar, Professor Stephen Nicholls and Dr Kristen Bubb from the Victorian Heart Institute will discuss the benefits of being able to visualise vulnerable plaque for both clinical and preclinical research. Professor Stephen Nicholls is a clinician-researcher and the Head of the Victorian Heart Institute. He is the lead investigator on multiple large, international, cardiovascular outcomes trials. He has attracted over $100 million in direct research funding and published more than 400 peer-reviewed manuscripts. He is focused on both therapeutic intervention to reduce vascular inflammation and lipid accumulation and precision medicine approaches to prevent cardiovascular mortality. Dr Kristen Bubb is a biomedical researcher and Group Leader within the Monash Biomedicine Discovery Institute Cardiovascular Program and Victorian Heart Institute. She focuses on preclinical/translational research into mechanisms underlying vascular pathologies including atherosclerosis and endothelium-driven hypertension within specific vascular systems, including pulmonary and pregnancy-induced. She has published >30 high impact papers in leading cardiovascular journals and attracted category 1&2 funding of >$750,000.

When we remember a stimulus we rarely maintain a full fidelity representation of the observed item. Our working memory instead maintains a mixture of the observed feature values and categorical/gist information. I will discuss evidence from computational models supporting a mix of categorical and fine-detail information in working memory. Having established the need for two memory formats in working memory, I will discuss whether categorical and fine-detailed information for a stimulus are represented separately or as a single unified representation. Computational models of these two potential cognitive structures make differing predictions about the pattern of responses in visual working memory recall tests. The present study required participants to remember the orientation of stimuli for later reproduction. The pattern of responses are used to test the competing representational structures and to quantify the relative amount of fine-detailed and categorical information maintained. The effects of set size, encoding time, serial order, and response order on memory precision, categorical information, and guessing rates are also explored. (This is a 60 min talk).

Deep learning has made tremendous progress in the last year but it's high computational and memory requirements impose challenges in using deep learning on edge devices. There has been some progress in lowering memory requirements of deep neural networks (for instance, use of half-precision) but there has been minimal effort in developing alternative efficient computational paradigms. Inspired by the brain, Spiking Neural Networks (SNN) provide an energy-efficient alternative to conventional rate-based neural networks. However, SNN architectures that employ the traditional feedforward and feedback pass do not fully exploit the asynchronous event-based processing paradigm of SNNs. In the first part of my talk, I will present my work on predictive coding which offers a fundamentally different approach to developing neural networks that are particularly suitable for event-based processing. In the second part of my talk, I will present our work on development of approaches for SNNs that target specific problems like low response latency and continual learning. References Dora, S., Bohte, S. M., & Pennartz, C. (2021). Deep Gated Hebbian Predictive Coding Accounts for Emergence of Complex Neural Response Properties Along the Visual Cortical Hierarchy. Frontiers in Computational Neuroscience, 65. Saranirad, V., McGinnity, T. M., Dora, S., & Coyle, D. (2021, July). DoB-SNN: A New Neuron Assembly-Inspired Spiking Neural Network for Pattern Classification. In 2021 International Joint Conference on Neural Networks (IJCNN) (pp. 1-6). IEEE. Machingal, P., Thousif, M., Dora, S., Sundaram, S., Meng, Q. (2021). A Cross Entropy Loss for Spiking Neural Networks. Expert Systems with Applications (under review).

To prevail in a dynamic and noisy environment, the brain must create reliable and meaningful representations from sensory inputs that are often ambiguous or corrupt. Since only information that permeates the cortical hierarchy can influence sensory perception and decision-making, it is critical that noisy external stimuli are encoded and propagated through different processing stages with minimal signal degradation. Here we hypothesize that stimulus-specific pathways akin to cortical topographic maps may provide the structural scaffold for such signal routing. We investigate whether the feature-specific pathways within such maps, characterized by the preservation of the relative organization of cells between distinct populations, can guide and route stimulus information throughout the system while retaining representational fidelity. We demonstrate that, in a large modular circuit of spiking neurons comprising multiple sub-networks, topographic projections are not only necessary for accurate propagation of stimulus representations, but can also help the system reduce sensory and intrinsic noise. Moreover, by regulating the effective connectivity and local E/I balance, modular topographic precision enables the system to gradually improve its internal representations and increase signal-to-noise ratio as the input signal passes through the network. Such a denoising function arises beyond a critical transition point in the sharpness of the feed-forward projections, and is characterized by the emergence of inhibition-dominated regimes where population responses along stimulated maps are amplified and others are weakened. Our results indicate that this is a generalizable and robust structural effect, largely independent of the underlying model specificities. Using mean-field approximations, we gain deeper insight into the mechanisms responsible for the qualitative changes in the system’s behavior and show that these depend only on the modular topographic connectivity and stimulus intensity. The general dynamical principle revealed by the theoretical predictions suggest that such a denoising property may be a universal, system-agnostic feature of topographic maps, and may lead to a wide range of behaviorally relevant regimes observed under various experimental conditions: maintaining stable representations of multiple stimuli across cortical circuits; amplifying certain features while suppressing others (winner-take-all circuits); and endow circuits with metastable dynamics (winnerless competition), assumed to be fundamental in a variety of tasks.

Information processing is energetically expensive. In the mammalian brain, it is unclear how information coding and energy usage are regulated during food scarcity. We addressed this in the visual cortex of awake mice using whole-cell patch clamp recordings and two-photon imaging to monitor layer 2/3 neuronal activity and ATP usage. We found that food restriction resulted in energy savings through a decrease in AMPA receptor conductance, reducing synaptic ATP usage by 29%. Neuronal excitability was nonetheless preserved by a compensatory increase in input resistance and a depolarized resting membrane potential. Consequently, neurons spiked at similar rates as controls, but spent less ATP on underlying excitatory currents. This energy-saving strategy had a cost since it amplified the variability of visually-evoked subthreshold responses, leading to a 32% broadening in orientation tuning and impaired fine visual discrimination. These findings reveal novel mechanisms that dynamically regulate energy usage and coding precision in neocortex.

Pathogenic variants in HCN1 are associated with severe developmental and epileptic encephalopathies (DEE). We have engineered the Hcn1 M294L heterozygous knock-in (Hcn1M294L) mouse which is a homolog of the de novo HCN1 M305L recurrent pathogenic variant. The mouse recapitulates the phenotypic features of patients including having spontaneous seizures and a learning deficit. In this talk I will present experimental work that probes the molecular and cellular mechanisms underlying hyper-excitability in the mouse model. This will include testing the efficacy of currently available antiepileptic drugs and a novel precision medicine approach. I will also briefly touch on how disease biology can give insights into the biophysical properties of HCN channels.

Not all individuals are equally competent at recognizing the faces they interact with. Revealing how the brains of different individuals support variations in this ability is a crucial step to develop an understanding of real-world human visual behaviour. In this talk, I will present findings from a large high-density EEG dataset (>100k trials of participants processing various stimulus categories) and computational approaches which aimed to characterise the brain representations behind real-world proficiency of “super-recognizers”—individuals at the top of face recognition ability spectrum. Using decoding analysis of time-resolved EEG patterns, we predicted with high precision the trial-by-trial activity of super-recognizers participants, and showed that evidence for face recognition ability variations is disseminated along early, intermediate and late brain processing steps. Computational modeling of the underlying brain activity uncovered two representational signatures supporting higher face recognition ability—i) mid-level visual & ii) semantic computations. Both components were dissociable in brain processing-time (the first around the N170, the last around the P600) and levels of computations (the first emerging from mid-level layers of visual Convolutional Neural Networks, the last from a semantic model characterising sentence descriptions of images). I will conclude by presenting ongoing analyses from a well-known case of acquired prosopagnosia (PS) using similar computational modeling of high-density EEG activity.

Reprogramming somatic cells to a pluripotent state via the induced pluripotent stem cell (iPSC) method offers an increasingly utilized approach for neurological disease modeling with patient-derived cells. Several groups, including ours, have applied the iPSC approach to model severe genetic developmental and epileptic encephalopathies (DEEs) with patient-derived cells. Although most studies to date involve 2-D cultures of patient-derived neurons, brain organoids are increasingly being employed to explore genetic DEE mechanisms. We are applying this approach to understand PMSE (Polyhydramnios, Megalencephaly and Symptomatic Epilepsy) syndrome, Rett Syndrome (in collaboration with Ben Novitch at UCLA) and Protocadherin-19 Clustering Epilepsy (PCE). I will describe our findings of robust structural phenotypes in PMSE and PCE patient-derived brain organoid models, as well as functional abnormalities identified in fusion organoid models of Rett syndrome. In addition to showing epilepsy-relevant phenotypes, both 2D and brain organoid cultures offer platforms to identify novel therapies. We will also discuss challenges and recent advances in the brain organoid field, including a new single rosette brain organoid model that we have developed. The field is advancing rapidly and our findings suggest that brain organoid approaches offers great promise for modeling genetic neurodevelopmental epilepsies and identifying precision therapies.

Our research investigates how processes of attention, visual working memory (VWM), and decision-making combine to translate perception into action. Within this framework, the role of VWM is to form stable representations of transient stimulus events that allow them to be identified by a decision process, which we model as a diffusion process. In psychophysical tasks, we find the capacity of VWM is well defined by a sample-size model, which attributes changes in VWM precision with set-size to differences in the number evidence samples recruited to represent stimuli. In the first part of the talk, I review evidence for the sample-size model and highlight the model's strengths: It provides a parameter-free characterization of the set-size effect; it has plausible neural and cognitive interpretations; an attention-weighted version of the model accounts for the power-law of VWM, and it accounts for the selective updating of VWM in multiple-look experiments. In the second part of the talk, I provide a characterization of the theoretical relationship between two-choice and continuous-outcome decision tasks using the circular diffusion model, highlighting their common features. I describe recent work characterizing the joint distributions of decision outcomes and response times in continuous-outcome tasks using the circular diffusion model and show that the model can clearly distinguish variable-precision and simple mixture models of the evidence entering the decision process. The ability to distinguish these kinds of processes is central to current VWM studies.

Human vision relies on rapid eye movements (saccades) 2-3 times every second to bring peripheral targets to central foveal vision for high resolution inspection. This rapid sampling of the world defines the perception-action cycle of natural vision and profoundly impacts our perception. Marmosets have similar visual processing and eye movements as humans, including a fovea that supports high-acuity central vision. Here, I present a novel approach developed in my laboratory for investigating the neural mechanisms of visual processing using naturalistic free viewing and simple target foraging paradigms. First, we establish that it is possible to map receptive fields in the marmoset with high precision in visual areas V1 and MT without constraints on fixation of the eyes. Instead, we use an off-line correction for eye position during foraging combined with high resolution eye tracking. This approach allows us to simultaneously map receptive fields, even at the precision of foveal V1 neurons, while also assessing the impact of eye movements on the visual information encoded. We find that the visual information encoded by neurons varies dramatically across the saccade to fixation cycle, with most information localized to brief post-saccadic transients. In a second study we examined if target selection prior to saccades can predictively influence how foveal visual information is subsequently processed in post-saccadic transients. Because every saccade brings a target to the fovea for detailed inspection, we hypothesized that predictive mechanisms might prime foveal populations to process the target. Using neural decoding from laminar arrays placed in foveal regions of area MT, we find that the direction of motion for a fixated target can be predictively read out from foveal activity even before its post-saccadic arrival. These findings highlight the dynamic and predictive nature of visual processing during eye movements and the utility of the marmoset as a model of active vision. Funding sources: NIH EY030998 to JM, Life Sciences Fellowship to JY

Rapidly changing inputs such as visual scenes and auditory landscapes are transmitted over several synaptic interfaces and perceived with little loss of detail, but individual neurons are typically “noisy” and cortico-cortical connections are typically “weak”. To understand how information embodied in spike train is transmitted in a lossless manner, we focus on a single synaptic interface: between pyramidal cells and putative interneurons. Using arbitrary white noise patterns injected intra-cortically as photocurrents to freely-moving mice, we find that directly-activated cells exhibit precision of several milliseconds, but post-synaptic, indirectly-activated cells exhibit higher precision. Considering multiple identical messages, the reliability of directly-activated cells peaks at a timescale of dozens of milliseconds, whereas indirectly-activated cells exhibit an order-of-magnitude faster timescale. Using data-driven modelling, we find that error correction is consistent with non-linear amplification of coincident spikes.

The songbird zebra finch is an exemplary model system in which to study trial-and-error learning, as the bird learns its single song gradually through the production of many noisy renditions. It is also a good system in which to study the maintenance of motor skills, as the adult bird actively maintains its song and retains some residual plasticity. Motor learning occurs through the association of timing within the song, represented by sparse firing in nucleus HVC, with motor output, driven by nucleus RA. Here we show through modeling that the small level of observed variability in HVC can result in a network which is more easily able to adapt to change, and is most robust to cell damage or death, than an unperturbed network. In collaboration with Carlos Lois’ lab, we also consider the effect of directly perturbing HVC through viral injection of toxins that affect the firing of projection neurons. Following these perturbations, the song is profoundly affected but is able to almost perfectly recover. We characterize the changes in song acoustics and syntax, and propose models for HVC architecture and plasticity that can account for some of the observed effects. Finally, we suggest a potential role for inputs from nucleus Uva in helping to control timing precision in HVC.

The cellular representations and computations that allow rodents to navigate in space have been described with beautiful precision. In this talk, I will show that some of these same computations can be found in humans doing tasks that appear very different from spatial navigation. I will describe some theory that allows us to think about spatial and non-spatial problems in the same framework, and I will try to use this theory to give a new perspective on the beautiful spatial computations that inspired it. The overall goal of this work is to find a framework where we can talk about complicated non-spatial inference problems with the same precision that is only currently available in space.

Physics offers countless examples for which theoretical predictions are astonishingly powerful. But it’s hard to imagine a similar precision in complex systems where the number and interdependencies between components simply prohibits a first-principles approach, look no further than the challenge of the billions of neurons and trillions of connections within our own brains. In such settings how do we even identify the important theoretical questions? We describe a systems-scale perspective in which we integrate information theory, dynamical systems and statistical physics to extract understanding directly from measurements. We demonstrate our approach with a reconstructed state space of the behavior of the nematode C. elegans, revealing a chaotic attractor with symmetric Lyapunov spectrum and a novel perspective of motor control. We then outline a maximally predictive coarse-graining in which nonlinear dynamics are subsumed into a linear, ensemble evolution to obtain a simple yet accurate model on multiple scales. With this coarse-graining we identify long timescales and collective states in the Langevin dynamics of a double-well potential, the Lorenz system and in worm behavior. We suggest that such an ``inverse’’ approach offers an emergent, quantitative framework in which to seek rather than impose effective organizing principles of complex systems.

Memory deficits are a debilitating symptom of epilepsy, but little is known about mechanisms underlying cognitive deficits. Here, we describe a Na+ channel-dependent mechanism underlying altered hippocampal dendritic integration, degraded place coding, and deficits in spatial memory. Two-photon glutamate uncaging experiments revealed that the mechanisms constraining the generation of Na+ spikes in hippocampal 1st order pyramidal cell dendrites are profoundly degraded in experimental epilepsy. This phenomenon was reversed by selectively blocking Nav1.3 sodium channels. In-vivo two-photon imaging revealed that hippocampal spatial representations were less precise in epileptic mice. Blocking Nav1.3 channels significantly improved the precision of spatial coding, and reversed hippocampal memory deficits. Thus, a dendritic channelopathy may underlie cognitive deficits in epilepsy and targeting it pharmacologically may constitute a new avenue to enhance cognition.

Genetic targeting of neuronal cells with activity reporters (calcium or voltage indicators) has initiated the paradigmatic transition whereby photons have replaced electrons for reading large-scale brain activities at cellular resolution. This has alleviated the limitations of single cell or extracellular electrophysiological probing, which only give access to the activity of at best a few neurons simultaneously and to population activity of unresolved cellular origin, respectively. In parallel, optogenetics has demonstrated that targeting neuronal cells with photosensitive microbial opsins, enables the transduction of photons into electrical currents of opposite polarities thus writing, through activation or inhibition, neuronal signals in a non-invasive way. These progresses have in turn stimulated the development of sophisticated optical methods to increase spatial and temporal resolution, light penetration depth and imaging volume. Today, nonlinear microscopy, combined with spatio-temporal wave front shaping, endoscopic probes engineering or multi scan heads design, enable in vivo in depth, simultaneous recording of thousands of cells in mm 3 volumes at single-spike precision and single-cell resolution. Joint progress in opsin engineering, wave front shaping and laser development have provided the methodology, that we named circuits optogenetics, to control single or multiple target activity independently in space and time with single- neuron and single-spike precision, at large depths. Here, we will review the most significant breakthroughs of the past years, which enable reading and writing neuronal activity at the relevant spatiotemporal scale for brain circuits manipulation, with particular emphasis on the most recent advances in circuit optogenetics.

Corticospinal neurons (CSN) are the cortical projection neurons that innervate the spinal cord and some brainstem targets with segmental precision to control voluntary movement of specific functional motor groups, limb sections, or individual digits, yet molecular regulation over CSN segmental target specificity is essentially unknown. CSN subpopulations exhibit striking axon targeting specificity from development into maturity: Evolutionarily newer rostrolateral CSN exclusively innervate bulbar-cervical targets (CSNBC-lat), while evolutionarily older caudomedial CSN (CSNmed) are more heterogeneous, with distinct subpopulations extending axons to either bulbar-cervical or thoraco-lumbar segments. The cervical cord, with its evolutionarily enhanced precision of forelimb movement, is innervated by multiple CSN subpopulations, suggesting inter-neuronal interactions in establishing corticospinal connectivity. I identify that Lumican, previously unrecognized in axon development, controls the specificity of cervical spinal cord innervation by CSN. Remarkably, Lumican, an extracellular matrix protein expressed by CSNBC-lat, non-cell-autonomously suppresses axon collateralization in the cervical cord by CSNmed. Intersectional viral labeling and mouse genetics further identify that Lumican controls axon collateralization by multiple subpopulations in caudomedial sensorimotor cortex. These results identify inter-axonal molecular crosstalk between CSN subpopulations as a novel mechanism controlling corticospinal connectivity and competitive specificity. Further, this mechanism has potential implications for evolutionary diversification of corticospinal circuitry with finer scale precision. "" Complementing this work, to comprehensively elucidate related axon projection mechanisms functioning at tips of growing CSN axons in vivo, I am currently applying experimental and analytic approaches recently developed in my postdoc lab (Poulopoulos*, Murphy*, Nature, 2019) to quantitatively and subcellularly “map” RNA and protein molecular machinery of subtype-specific growth cones, in parallel to their parent somata, isolated directly in vivo from developing subcerebral projection neurons (SCPN; the broader cortical output neuron population targeting both brainstem and spinal cord; includes CSN). I am investigating both normal development and GC-soma dysregulation with mutation of central CSN-SCPN transcriptional regulator Ctip2/Bcl11b.

Recent human gene discovery efforts show that gain-of-function (GOF) variants in the KCNT1gene, which encodes a Na+-activated K+ channel subunit, cause severe epilepsies and other neurodevelopmental disorders. Although the impact of these variants on the biophysical properties of the channels is well characterized, the mechanisms that link channel dysfunction to cellular and network hyperexcitability and human disease are unknown. Furthermore, precision therapies that correct channel biophysics in non-neuronal cells have had limited success in treating human disease, highlighting the need for a deeper understanding of how these variants affect neurons and networks. To address this gap, we developed a new mouse model with a pathogenic human variant knocked into the mouse Kcnt1gene. I will discuss our findings on the in vivo phenotypes of this mouse, focusing on our characterization of epileptiform neural activity using electrophysiology and widefield Ca++imaging. I will also talk about our investigations at the synaptic, cellular, and circuit levels, including the main finding that cortical inhibitory neurons in this model show a reduction in intrinsic excitability and action potential generation. Finally, I will discuss future directions to better understand the mechanisms underlying the cell-type specific effects, as well as the link between the cellular and network level effects of KCNT1 GOF.

My research at the interface of neurobiology, biomechanics, and behavior seeks to understand how the timing precision of sensory input structures locomotor output. My lab studies the flight behavior of the fruit fly, Drosophila melanogaster, combining powerful genetic tools available for labeling and manipulating neural circuits with cutting-edge imaging in awake, behaving animals. This work has the potential to fundamentally reshape understanding of the evolution of insect flight, as well as highlight the tremendous importance of timing in the context of locomotion. Timing is crucial to the nervous system. The ability to rapidly detect and process subtle disturbances in the environment determines whether an animal can attain its next meal or successfully navigate complex, unpredictable terrain. While previous work on various animals has made tremendous strides uncovering the specialized neural circuits used to resolve timing differences with sub-microsecond resolution, it has focused on the detection of timing differences in sensory systems. Understanding of how the timing of motor output is structured by precise sensory input remains poor. My research focuses on an organ unique to fruit flies, called the haltere, that serves as a bridge for detecting and acting on subtle timing differences, helping flies execute rapid maneuvers. Understanding how this relatively simple insect canperform such impressive aerial feats demands an integrative approach that combines physics, muscle mechanics, neuroscience, and behavior. This unique, powerful approach will reveal the general principles that govern sensorimotor processing.

To enable the understanding and repair of complex biological systems, such as the brain, we are creating novel optical tools that enable molecular-resolution maps of such systems, as well as technologies for observing and controlling high-speed physiological dynamics in such systems. First, we have developed a method for imaging specimens with nanoscale precision, by embedding them in a swellable polymer, homogenizing their mechanical properties, and exposing them to water – which causes them to expand manyfold isotropically. This method, which we call expansion microscopy (ExM), enables ordinary microscopes to do nanoscale imaging, in a multiplexed fashion – important, for example, for brain mapping. Second, we have developed a set of genetically-encoded reagents, known as optogenetic tools, that when expressed in specific neurons, enable their electrical activities to be precisely driven or silenced in response to millisecond timescale pulses of light. Finally, we are designing, and evolving, novel reagents, such as fluorescent voltage indicators and somatically targeted calcium indicators, to enable the imaging of fast physiological processes in 3-D with millisecond precision. In this way we aim to enable the systematic mapping, control, and dynamical observation of complex biological systems like the brain. The talk will be simultaneously interpreted English-Spanish) by the Interpreter, Mg. Lourdes Martino. Para permitir la comprensión y reparación de sistemas biológicos complejos, como el cerebro, estamos creando herramientas ópticas novedosas que permiten crear mapas de resolución molecular de dichos sistemas, así como tecnologías para observar y controlar la dinámica fisiológica de alta velocidad en dichos sistemas. Primero, hemos desarrollado un método para obtener imágenes de muestras con precisión a nanoescala, incrustándolas en un polímero hinchable, homogeneizando sus propiedades mecánicas y exponiéndolas al agua, lo que hace que se expandan muchas veces isotrópicamente. Este método, que llamamos microscopía de expansión (ExM), permite que los microscopios ordinarios obtengan imágenes a nanoescala, de forma multiplexada, lo que es importante, por ejemplo, para el mapeo cerebral. En segundo lugar, hemos desarrollado un conjunto de reactivos codificados genéticamente, conocidos como herramientas optogenéticas, que cuando se expresan en neuronas específicas, permiten que sus actividades eléctricas sean activadas o silenciadas con precisión en respuesta a pulsos de luz en una escala de tiempo de milisegundos. Finalmente, estamos diseñando y desarrollando reactivos novedosos, como indicadores de voltaje fluorescentes e indicadores de calcio dirigidos somáticamente, para permitir la obtención de imágenes de procesos fisiológicos rápidos en 3-D con precisión de milisegundos. De esta manera, nuestro objetivo es permitir el mapeo sistemático, el control y la observación dinámica de sistemas biológicos complejos como el cerebro. La conferencia será traducida simultáneamente al español por la intérprete Mg. Lourdes Martino.

Many of us came to biology from physics. There we have been trained on such classic examples as muon g-2, where experimental data and theoretical predictions agree to many significant digits. Now, working in biology, we routinely hear that it is messy, most details matter, and that the best hope for theory in biology is to be semi-qualitative, predict general trends, and to forgo the hope of ever making quantitative predictions with the precision that we are used to in physics. Colloquially, we should be satisfied even if data and models differ so much that plotting them on the same plot makes little sense. However, some of us won’t be satisfied by this. So can we take theory in biology seriously and predict experimental outcomes within (small) error bars? Certainly, we won’t be able to predict everything, but this is never required, even in traditional physics. But we should be able to choose some features of data that are nontrivial and interesting, and focus on them. We also should be able to find different classes of models --- maybe even null models --- that match biology better, and thus allow for a better agreement. It is even possible that large-dimensional datasets of modern high-throughput experiments, and the ensuing “more is different” statistical physics style models will make quantitative, precise theory easier. To explore the role of quantitative theory in biology, in this workshop, eight speakers will address some of the following general questions based on their specific work in different corners of biology: Which features of biological data are predictable? Which types of models are best suited to making quantitative predictions in different fields? Should theorists interested in quantitative predictions focus on different questions, not typically asked by biologists? Do large, multidimensional datasets make theories (and which theories?) more or less likely to succeed? This will be an unapologetically theoretical physics workshop — we won’t focus on a specific subfield of biology, but will explore these questions across the fields, hoping that the underlying theoretical frameworks will help us find the missing connections.

Synaptic inputs on cortical dendrites are organized with remarkable subcellular precision at the micron level. This organization emerges during early postnatal development through patterned spontaneous activity and manifests both locally where synapses with similar functional properties are clustered, and globally along the axis from dendrite to soma. Recent experiments reveal species-specific differences in the local and global synaptic organization in mouse, ferret and macaque visual cortex. I will present a computational framework that implements functional and structural plasticity from spontaneous activity patterns to generate these different types of organization across species and scales. Within this framework, a single anatomical factor - the size of the visual cortex and the resulting magnification of visual space - can explain the observed differences. This allows us to make predictions about the organization of synapses also in other species and indicates that the proximal-distal axis of a dendrite might be central in endowing a neuron with powerful computational capabilities.

The ability to read the DNA sequences of different organisms has transformed biology in much the same way that the telescope transformed astronomy. And yet, much of the sequence found in these genomes is as enigmatic as the Rosetta Stone was to early Egyptologists. With the aim of making steps to crack the genomic Rosetta Stone, I will describe unexpected ways of using the physics of information transfer first developed at Bell Labs for thinking about telephone communications to try to decipher the meaning of the regulatory features of genomes. Specifically, I will show how we have been able to explore genes for which we know nothing about how they are regulated by using a combination of mutagenesis, deep sequencing and the physics of information, with the result that we now have falsifiable hypotheses about how those genes work. With those results in hand, I will show how simple tools from statistical physics can be used to predict the level of expression of different genes, followed by a description of precision measurements used to test those predictions. Bringing the two threads of the talk together, I will think about next steps in reading and writing genomes at will.

Engineered pattern-recognition systems strive for short time-to-solution and low energy-to-solution characteristics. This represents one of the main driving forces behind the development of neuromorphic devices. For both them and their biological archetypes, this corresponds to using as few spikes as early as possible. The concept of few and early spikes is used as the founding principle in the time-to-first-spike coding scheme. Within this framework, we have developed a spike-timing-based learning algorithm, which we used to train neuronal networks on the mixed-signal neuromorphic platform BrainScaleS-2. We derive, from first principles, error-backpropagation-based learning in networks of leaky integrate-and-fire (LIF) neurons relying only on spike times, for specific configurations of neuronal and synaptic time constants. We explicitly examine applicability to neuromorphic substrates by studying the effects of reduced weight precision and range, as well as of parameter noise. We demonstrate the feasibility of our approach on continuous and discrete data spaces, both in software simulations and on BrainScaleS-2. This narrows the gap between previous models of first-spike-time learning and biological neuronal dynamics and paves the way for fast and energy-efficient neuromorphic applications.

Temporal lobe epilepsy is associated with memory deficits but the circuit mechanisms underlying these cognitive disabilities are not understood. We used electrophysiological recordings, open-source wire-free miniaturized microscopy and computational modeling to probe these deficits in a model of temporal lobe epilepsy. We find desynchronization of dentate gyrus interneurons with CA1 interneurons during theta oscillations and a loss of precision and stability of place fields. We also find that emergence of place cell dysfunction is delayed, providing a potential temporal window for treatments. Computation modeling shows that desynchronization rather than interneuron cell loss can drive place cell dysfunction. Future studies will uncover cell types driving these changes and transcriptional changes that may be driving dysfunction.

Densely mapping neuronal circuits at synaptic resolution is providing unprecedented insight into the formation and structure of the cerebral cortex. I’ll present recent advances and discuss what we can learn about precision, plasticity and possible patterns in mammalian neuronal circuits.

The last quarter century has provided extensive evidence that some regions of the human cortex are selectively engaged in processing a single specific domain of information, from faces, places, and bodies to language, music, and other people’s thoughts. This work dovetails with earlier theories in cognitive science highlighting domain specificity in human cognition, development, and evolution. But many questions remain unanswered about even the clearest cases of domain specificity in the brain, the selective engagement of the FFA, PPA, and EBA in the perception of faces, places, and bodies, respectively. First, these claims lack precision, saying little about what is computed and how, and relying on human judgements to decide what counts as a face, place, or body. Second, they provide no account of the reliably varying responses of these regions across different “preferred” images, or across different “nonpreferred” images for each category. Third, the category selectivity of each region is vulnerable to refutation if any of the vast set of as-yet-untested nonpreferred images turns out to produce a stronger response than preferred images for that region. Fourth, and most fundamentally, they provide no account of why, from a computational point of view, brains should exhibit this striking degree of functional specificity in the first place, and why we should have the particular visual specializations we do, for faces, places, and bodies, but not (apparently) for food or snakes. The advent of convolutional neural networks (CNNs) to model visual processing in the ventral pathway has opened up many opportunities to address these long-standing questions in new ways. I will describe ongoing efforts in our lab to harness CNNs to do just that.