Shape
shape
sensorimotor control, mouvement, touch, EEG
Traditionally, touch is associated with exteroception and is rarely considered a relevant sensory cue for controlling movements in space, unlike vision. We developed a technique to isolate and measure tactile involvement in controlling sliding finger movements over a surface. Young adults traced a 2D shape with their index finger under direct or mirror-reversed visual feedback to create a conflict between visual and somatosensory inputs. In this context, increased reliance on somatosensory input compromises movement accuracy. Based on the hypothesis that tactile cues contribute to guiding hand movements when in contact with a surface, we predicted poorer performance when the participants traced with their bare finger compared to when their tactile sensation was dampened by a smooth, rigid finger splint. The results supported this prediction. EEG source analyses revealed smaller current in the source-localized somatosensory cortex during sensory conflict when the finger directly touched the surface. This finding supports the hypothesis that, in response to mirror-reversed visual feedback, the central nervous system selectively gated task-irrelevant somatosensory inputs, thereby mitigating, though not entirely resolving, the visuo-somatosensory conflict. Together, our results emphasize touch’s involvement in movement control over a surface, challenging the notion that vision predominantly governs goal-directed hand or finger movements.
Computational Mechanisms of Predictive Processing in Brains and Machines
Predictive processing offers a unifying view of neural computation, proposing that brains continuously anticipate sensory input and update internal models based on prediction errors. In this talk, I will present converging evidence for the computational mechanisms underlying this framework across human neuroscience and deep neural networks. I will begin with recent work showing that large-scale distributed prediction-error encoding in the human brain directly predicts how sensory representations reorganize through predictive learning. I will then turn to PredNet, a popular predictive coding inspired deep network that has been widely used to model real-world biological vision systems. Using dynamic stimuli generated with our Spatiotemporal Style Transfer algorithm, we demonstrate that PredNet relies primarily on low-level spatiotemporal structure and remains insensitive to high-level content, revealing limits in its generalization capacity. Finally, I will discuss new recurrent vision models that integrate top-down feedback connections with intrinsic neural variability, uncovering a dual mechanism for robust sensory coding in which neural variability decorrelates unit responses, while top-down feedback stabilizes network dynamics. Together, these results outline how prediction error signaling and top-down feedback pathways shape adaptive sensory processing in biological and artificial systems.
Jorge Almeida
I am looking for a Post-Doctoral Researcher. The applicants should have obtained a PhD, and have an overall interest in object recognition, potentially focusing on object-related features like shape, texture material and surface properties. I am particularly interested in researchers with strong expertise in fMRI, and in particular decoding and multivariate approaches. Good programming skills, great communication and mentoring skills, and a great command of English are a plus. The selected applicant will work with me (Jorge Almeida) but will also benefit from the lively academic environment and research groups we are currently building in the Psychology Department of the University of Coimbra, Portugal (Jason Fischer, Joana Carvalho, Alfonso Caramazza, etc). The projects will relate to my work on object and mid-level processing. Below are some examples: Mahon, B. Z., & Almeida, J. (2024). Reciprocal interactions among parietal and occipito-temporal representations support everyday object-directed actions. Neuropsychologia, 198, 108841. https://doi.org/10.1016/j.neuropsychologia.2024.108841 Almeida, J., Fracasso, A., Kristensen, S., Valério, D., Bergström, F., Chakravarthi, R., Tal, Z., & Walbrin, J. (2023). Neural and behavioral signatures of the multidimensionality of manipulable object processing. Communications biology, 6(1), 940. https://doi.org/10.1038/s42003-023-05323-x Walbrin, J., & Almeida, J. (2021). High-Level Representations in Human Occipito-Temporal Cortex Are Indexed by Distal Connectivity. The Journal of neuroscience : the official journal of the Society for Neuroscience, 41(21), 4678–4685. https://doi.org/10.1523/JNEUROSCI.2857-20.2021 The position is for 2 to 3 years, and the salary is the standard Post-Doctoral pay-scale in Portugal (net value 1850 euros per month; this is a competitive salary for the cost of living in Portugal and especially in Coimbra). Start time should be as soon as possible. The Proaction Lab is currently well-funded as we have a set of on-going funded projects including a Starting Grant ERC to Jorge Almeida, a major European ERA Chair project to Jorge Almeida and Alfonso Caramazza, and other projects. We have access to a 3T MRI scanner with a 32-channel coil, to a 7T scanner (in collaboration with a site outside of Portugal), to tDCS, and to a fully set psychophysics lab. We have a 256 ch EEG, motion tracking and eyetracking on site. We also have a science communication office dedicated to the lab. Finally, the University of Coimbra is a 700-year-old University and has been selected as a UNESCO world Heritage site. Coimbra is one of the liveliest university cities in the world, and it is a beautiful city with easy access to the beach and mountain. You should apply as soon as you can. If interested send an email to jorgecbalmeida@gmail.com, with a CV, and motivation/scientific proposal letter.
Jorge Almeida
I am looking for a Post-Doctoral Researcher at the initial stages (defending very soon, and no more than 2 years and half after obtaining their PhD). The applicants should have obtained a PhD, and have an overall interest in object recognition, potentially focusing on object-related features like shape, texture material and surface properties. I am particularly interested in researchers with strong expertise in fMRI, and in particular decoding and multivariate approaches. Good programming skills, great communication and mentoring skills, and a great command of English are a plus. The selected applicant will work with me (Jorge Almeida) but will also benefit from the lively academic environment and research groups we are currently building in the Psychology Department of the University of Coimbra, Portugal (Jason Fischer, Joana Carvalho, Alfonso Caramazza, etc). The projects will relate to my work on object and mid-level processing. Below are some examples: Mahon, B. Z., & Almeida, J. (2024). Reciprocal interactions among parietal and occipito-temporal representations support everyday object-directed actions. Neuropsychologia, 198, 108841. https://doi.org/10.1016/j.neuropsychologia.2024.108841 Almeida, J., Fracasso, A., Kristensen, S., Valério, D., Bergström, F., Chakravarthi, R., Tal, Z., & Walbrin, J. (2023). Neural and behavioral signatures of the multidimensionality of manipulable object processing. Communications biology, 6(1), 940. https://doi.org/10.1038/s42003-023-05323-x Walbrin, J., & Almeida, J. (2021). High-Level Representations in Human Occipito-Temporal Cortex Are Indexed by Distal Connectivity. The Journal of neuroscience : the official journal of the Society for Neuroscience, 41(21), 4678–4685. https://doi.org/10.1523/JNEUROSCI.2857-20.2021 The position is for 2 to 3 years, and the salary is the standard Post-Doctoral pay-scale in Portugal (net value 1850 euros per month; this is a competitive salary for the cost of living in Portugal and especially in Coimbra). Start time should be as soon as possible. The Proaction Lab is currently well-funded as we have a set of on-going funded projects including a Starting Grant ERC to Jorge Almeida, a major European ERA Chair project to Jorge Almeida and Alfonso Caramazza, and other projects. We have access to a 3T MRI scanner with a 32-channel coil, to a 7T scanner (in collaboration with a site outside of Portugal), to tDCS, and to a fully set psychophysics lab. We have a 256 ch EEG, motion tracking and eyetracking on site. We also have a science communication office dedicated to the lab. Finally, the University of Coimbra is a 700-year-old University and has been selected as a UNESCO world Heritage site. Coimbra is one of the liveliest university cities in the world, and it is a beautiful city with easy access to the beach and mountain. You should apply as soon as you can. If interested send an email to jorgecbalmeida@gmail.com, with a CV, and motivation/scientific proposal letter.
Decoding ketamine: Neurobiological mechanisms underlying its rapid antidepressant efficacy
Unlike traditional monoamine-based antidepressants that require weeks to exert effects, ketamine alleviates depression within hours, though its clinical use is limited by side effects. While ketamine was initially thought to work primarily through NMDA receptor (NMDAR) inhibition, our research reveals a more complex mechanism. We demonstrate that NMDAR inhibition alone cannot explain ketamine's sustained antidepressant effects, as other NMDAR antagonists like MK-801 lack similar efficacy. Instead, the (2R,6R)-hydroxynorketamine (HNK) metabolite appears critical, exhibiting antidepressant effects without ketamine's side effects. Paradoxically, our findings suggest an inverted U-shaped dose-response relationship where excessive NMDAR inhibition may actually impede antidepressant efficacy, while some level of NMDAR activation is necessary. The antidepressant actions of ketamine and (2R,6R)-HNK require AMPA receptor activation, leading to synaptic potentiation and upregulation of AMPA receptor subunits GluA1 and GluA2. Furthermore, NMDAR subunit GluN2A appears necessary and possibly sufficient for these effects. This research establishes NMDAR-GluN2A activation as a common downstream effector for rapid-acting antidepressants, regardless of their initial targets, offering promising directions for developing next-generation antidepressants with improved efficacy and reduced side effects.
PhenoSign - Molecular Dynamic Insights
Do You Know Your Blood Glucose Level? You Probably Should! A single measurement is not enough to truly understand your metabolic health. Blood glucose levels fluctuate dynamically, and meaningful insights require continuous monitoring over time. But glucose is just one example. Many other molecular concentrations in the body are not static. Their variations are influenced by individual physiology and overall health. PhenoSign, a Swiss MedTech startup, is on a mission to become the leader in real-time molecular analysis of complex fluids, supporting clinical decision-making and life sciences applications. By providing real-time, in-situ molecular insights, we aim to advance medicine and transform life sciences research. This talk will provide an overview of PhenoSign’s journey since its inception in 2022—our achievements, challenges, and the strategic roadmap we are executing to shape the future of real-time molecular diagnostics.
Digital Minds: Brain Development in the Age of Technology
Digital Minds: Brain Development in the Age of Technology examines how our increasingly connected world shapes mental and cognitive health. From screen time and social media to virtual interactions, this seminar delves into the latest research on how technology influences brain development, relationships, and emotional well-being. Join us to explore strategies for harnessing technology's benefits while mitigating its potential challenges, empowering you to thrive in a digital age.
Learning and Memory
This webinar on learning and memory features three experts—Nicolas Brunel, Ashok Litwin-Kumar, and Julijana Gjorgieva—who present theoretical and computational approaches to understanding how neural circuits acquire and store information across different scales. Brunel discusses calcium-based plasticity and how standard “Hebbian-like” plasticity rules inferred from in vitro or in vivo datasets constrain synaptic dynamics, aligning with classical observations (e.g., STDP) and explaining how synaptic connectivity shapes memory. Litwin-Kumar explores insights from the fruit fly connectome, emphasizing how the mushroom body—a key site for associative learning—implements a high-dimensional, random representation of sensory features. Convergent dopaminergic inputs gate plasticity, reflecting a high-dimensional “critic” that refines behavior. Feedback loops within the mushroom body further reveal sophisticated interactions between learning signals and action selection. Gjorgieva examines how activity-dependent plasticity rules shape circuitry from the subcellular (e.g., synaptic clustering on dendrites) to the cortical network level. She demonstrates how spontaneous activity during development, Hebbian competition, and inhibitory-excitatory balance collectively establish connectivity motifs responsible for key computations such as response normalization.
Sensory cognition
This webinar features presentations from SueYeon Chung (New York University) and Srinivas Turaga (HHMI Janelia Research Campus) on theoretical and computational approaches to sensory cognition. Chung introduced a “neural manifold” framework to capture how high-dimensional neural activity is structured into meaningful manifolds reflecting object representations. She demonstrated that manifold geometry—shaped by radius, dimensionality, and correlations—directly governs a population’s capacity for classifying or separating stimuli under nuisance variations. Applying these ideas as a data analysis tool, she showed how measuring object-manifold geometry can explain transformations along the ventral visual stream and suggested that manifold principles also yield better self-supervised neural network models resembling mammalian visual cortex. Turaga described simulating the entire fruit fly visual pathway using its connectome, modeling 64 key cell types in the optic lobe. His team’s systematic approach—combining sparse connectivity from electron microscopy with simple dynamical parameters—recapitulated known motion-selective responses and produced novel testable predictions. Together, these studies underscore the power of combining connectomic detail, task objectives, and geometric theories to unravel neural computations bridging from stimuli to cognitive functions.
Unmotivated bias
In this talk, I will explore how social affective biases arise even in the absence of motivational factors as an emergent outcome of the basic structure of social learning. In several studies, we found that initial negative interactions with some members of a group can cause subsequent avoidance of the entire group, and that this avoidance perpetuates stereotypes. Additional cognitive modeling discovered that approach and avoidance behavior based on biased beliefs not only influences the evaluative (positive or negative) impressions of group members, but also shapes the depth of the cognitive representations available to learn about individuals. In other words, people have richer cognitive representations of members of groups that are not avoided, akin to individualized vs group level categories. I will end presenting a series of multi-agent reinforcement learning simulations that demonstrate the emergence of these social-structural feedback loops in the development and maintenance of affective biases.
Exploring Lifespan Memory Development and Intervention Strategies for Memory Decline through a Unified Model-Based Assessment
Understanding and potentially reversing memory decline necessitates a comprehensive examination of memory's evolution throughout life. Traditional memory assessments, however, suffer from a lack of comparability across different age groups due to the diverse nature of the tests employed. Addressing this gap, our study introduces a novel, ACT-R model-based memory assessment designed to provide a consistent metric for evaluating memory function across a lifespan, from 5 to 85-year-olds. This approach allows for direct comparison across various tasks and materials tailored to specific age groups. Our findings reveal a pronounced U-shaped trajectory of long-term memory function, with performance at age 5 mirroring those observed in elderly individuals with impairments, highlighting critical periods of memory development and decline. Leveraging this unified assessment method, we further investigate the therapeutic potential of rs-fMRI-guided TBS targeting area 8AV in individuals with early-onset Alzheimer’s Disease—a region implicated in memory deterioration and mood disturbances in this population. This research not only advances our understanding of memory's lifespan dynamics but also opens new avenues for targeted interventions in Alzheimer’s Disease, marking a significant step forward in the quest to mitigate memory decay.
There’s more to timing than time: P-centers, beat bins and groove in musical microrhythm
How does the dynamic shape of a sound affect its perceived microtiming? In the TIME project, we studied basic aspects of musical microrhythm, exploring both stimulus features and the participants’ enculturated expertise via perception experiments, observational studies of how musicians produce particular microrhythms, and ethnographic studies of musicians’ descriptions of microrhythm. Collectively, we show that altering the microstructure of a sound (“what” the sound is) changes its perceived temporal location (“when” it occurs). Specifically, there are systematic effects of core acoustic factors (duration, attack) on perceived timing. Microrhythmic features in longer and more complex sounds can also give rise to different perceptions of the same sound. Our results shed light on conflicting results regarding the effect of microtiming on the “grooviness” of a rhythm.
Cell-type-specific plasticity shapes neocortical dynamics for motor learning
How do cortical circuits acquire new dynamics that drive learned movements? This webinar will focus on mouse premotor cortex in relation to learned lick-timing and explore high-density electrophysiology using our silicon neural probes alongside region and cell-type-specific acute genetic manipulations of proteins required for synaptic plasticity.
Learning representations of specifics and generalities over time
There is a fundamental tension between storing discrete traces of individual experiences, which allows recall of particular moments in our past without interference, and extracting regularities across these experiences, which supports generalization and prediction in similar situations in the future. One influential proposal for how the brain resolves this tension is that it separates the processes anatomically into Complementary Learning Systems, with the hippocampus rapidly encoding individual episodes and the neocortex slowly extracting regularities over days, months, and years. But this does not explain our ability to learn and generalize from new regularities in our environment quickly, often within minutes. We have put forward a neural network model of the hippocampus that suggests that the hippocampus itself may contain complementary learning systems, with one pathway specializing in the rapid learning of regularities and a separate pathway handling the region’s classic episodic memory functions. This proposal has broad implications for how we learn and represent novel information of specific and generalized types, which we test across statistical learning, inference, and category learning paradigms. We also explore how this system interacts with slower-learning neocortical memory systems, with empirical and modeling investigations into how the hippocampus shapes neocortical representations during sleep. Together, the work helps us understand how structured information in our environment is initially encoded and how it then transforms over time.
Roles of inhibition in stabilizing and shaping the response of cortical networks
Inhibition has long been thought to stabilize the activity of cortical networks at low rates, and to shape significantly their response to sensory inputs. In this talk, I will describe three recent collaborative projects that shed light on these issues. (1) I will show how optogenetic excitation of inhibition neurons is consistent with cortex being inhibition stabilized even in the absence of sensory inputs, and how this data can constrain the coupling strengths of E-I cortical network models. (2) Recent analysis of the effects of optogenetic excitation of pyramidal cells in V1 of mice and monkeys shows that in some cases this optogenetic input reshuffles the firing rates of neurons of the network, leaving the distribution of rates unaffected. I will show how this surprising effect can be reproduced in sufficiently strongly coupled E-I networks. (3) Another puzzle has been to understand the respective roles of different inhibitory subtypes in network stabilization. Recent data reveal a novel, state dependent, paradoxical effect of weakening AMPAR mediated synaptic currents onto SST cells. Mathematical analysis of a network model with multiple inhibitory cell types shows that this effect tells us in which conditions SST cells are required for network stabilization.
Learning produces a hippocampal cognitive map in the form of an orthogonalized state machine
Cognitive maps confer animals with flexible intelligence by representing spatial, temporal, and abstract relationships that can be used to shape thought, planning, and behavior. Cognitive maps have been observed in the hippocampus, but their algorithmic form and the processes by which they are learned remain obscure. Here, we employed large-scale, longitudinal two-photon calcium imaging to record activity from thousands of neurons in the CA1 region of the hippocampus while mice learned to efficiently collect rewards from two subtly different versions of linear tracks in virtual reality. The results provide a detailed view of the formation of a cognitive map in the hippocampus. Throughout learning, both the animal behavior and hippocampal neural activity progressed through multiple intermediate stages, gradually revealing improved task representation that mirrored improved behavioral efficiency. The learning process led to progressive decorrelations in initially similar hippocampal neural activity within and across tracks, ultimately resulting in orthogonalized representations resembling a state machine capturing the inherent struture of the task. We show that a Hidden Markov Model (HMM) and a biologically plausible recurrent neural network trained using Hebbian learning can both capture core aspects of the learning dynamics and the orthogonalized representational structure in neural activity. In contrast, we show that gradient-based learning of sequence models such as Long Short-Term Memory networks (LSTMs) and Transformers do not naturally produce such orthogonalized representations. We further demonstrate that mice exhibited adaptive behavior in novel task settings, with neural activity reflecting flexible deployment of the state machine. These findings shed light on the mathematical form of cognitive maps, the learning rules that sculpt them, and the algorithms that promote adaptive behavior in animals. The work thus charts a course toward a deeper understanding of biological intelligence and offers insights toward developing more robust learning algorithms in artificial intelligence.
Neuromodulation of striatal D1 cells shapes BOLD fluctuations in anatomically connected thalamic and cortical regions
Understanding how macroscale brain dynamics are shaped by microscale mechanisms is crucial in neuroscience. We investigate this relationship in animal models by directly manipulating cellular properties and measuring whole-brain responses using resting-state fMRI. Specifically, we explore the impact of chemogenetically neuromodulating D1 medium spiny neurons in the dorsomedial caudate putamen (CPdm) on BOLD dynamics within a striato-thalamo-cortical circuit in mice. Our findings indicate that CPdm neuromodulation alters BOLD dynamics in thalamic subregions projecting to the dorsomedial striatum, influencing both local and inter-regional connectivity in cortical areas. This study contributes to understanding structure–function relationships in shaping inter-regional communication between subcortical and cortical levels.
Bayesian expectation in the perception of the timing of stimulus sequences
In the current virtual journal club Dr Di Luca will present findings from a series of psychophysical investigations where he measured sensitivity and bias in the perception of the timing of stimuli. He will present how improved detection with longer sequences and biases in reporting isochrony can be accounted for by optimal statistical predictions. Among his findings was also that the timing of stimuli that occasionally deviate from a regularly paced sequence is perceptually distorted to appear more regular. Such change depends on whether the context these sequences are presented is also regular. Dr Di Luca will present a Bayesian model for the combination of dynamically updated expectations, in the form of a priori probability, with incoming sensory information. These findings contribute to the understanding of how the brain processes temporal information to shape perceptual experiences.
Sensory Consequences of Visual Actions
We use rapid eye, head, and body movements to extract information from a new part of the visual scene upon each new gaze fixation. But the consequences of such visual actions go beyond their intended sensory outcomes. On the one hand, intrinsic consequences accompany movement preparation as covert internal processes (e.g., predictive changes in the deployment of visual attention). On the other hand, visual actions have incidental consequences, side effects of moving the sensory surface to its intended goal (e.g., global motion of the retinal image during saccades). In this talk, I will present studies in which we investigated intrinsic and incidental sensory consequences of visual actions and their sensorimotor functions. Our results provide insights into continuously interacting top-down and bottom-up sensory processes, and they reify the necessity to study perception in connection to motor behavior that shapes its fundamental processes.
Movements and engagement during decision-making
When experts are immersed in a task, a natural assumption is that their brains prioritize task-related activity. Accordingly, most efforts to understand neural activity during well-learned tasks focus on cognitive computations and task-related movements. Surprisingly, we observed that during decision-making, the cortex-wide activity of multiple cell types is dominated by movements, especially “uninstructed movements”, that are spontaneously expressed. These observations argue that animals execute expert decisions while performing richly varied, uninstructed movements that profoundly shape neural activity. To understand the relationship between these movements and decision-making, we examined the movements more closely. We tested whether the magnitude or the timing of the movements was correlated with decision-making performance. To do this, we partitioned movements into two groups: task-aligned movements that were well predicted by task events (such as the onset of the sensory stimulus or choice) and task independent movement (TIM) that occurred independently of task events. TIM had a reliable, inverse correlation with performance in head-restrained mice and freely moving rats. This hinted that the timing of spontaneous movements could indicate periods of disengagement. To confirm this, we compared TIM to the latent behavioral states recovered by a hidden Markov model with Bernoulli generalized linear model observations (GLM-HMM) and found these, again, to be inversely correlated. Finally, we examined the impact of these behavioral states on neural activity. Surprisingly, we found that the same movement impacts neural activity more strongly when animals are disengaged. An intriguing possibility is that these larger movement signals disrupt cognitive computations, leading to poor decision-making performance. Taken together, these observations argue that movements and cognitionare closely intertwined, even during expert decision-making.
Predictive processing in older adults: How does it shape perception and sensorimotor control?
From pecking order to ketamine - neural mechanism of social and emotional behavior
Emotions and social interactions color our lives and shape our behaviors. Using animal models and engineered manipulations, we aim to understand how social and emotional behaviors are encoded in the brain, focusing on the neural circuits underlying dominance hierarchy and depression. This lecture will highlight our recent discoveries on how downward social mobility leads to depression; how ketamine tames depression by blocking burst firing in the brain’s antireward center; and, how glia-neuron interaction plays a surprising role in this process. I will also present our recent work on the mechanism underlying the sustained antidepressant activity of ketamine and its brain region specificity. With these results, we hope to illuminate on a more unified theory on ketamine’s mode of action and inspire new treatment strategies for depression.
From pecking order to ketamine - neural mechanism of social and emotional behavior
Emotions and social interactions color our lives and shape our behaviors. Using animal models and engineered manipulations, we aim to understand how social and emotional behaviors are encoded in the brain, focusing on the neural circuits underlying dominance hierarchy and depression. This lecture will highlight our recent discoveries on how downward social mobility leads to depression; how ketamine tames depression by blocking burst firing in the brain’s antireward center; and, how glia-neuron interaction plays a surprising role in this process. I will also present our recent work on the mechanism underlying the sustained antidepressant activity of ketamine and its brain region specificity. With these results, we hope to illuminate on a more unified theory on ketamine’s mode of action and inspire new treatment strategies for depression.
Internal representation of musical rhythm: transformation from sound to periodic beat
When listening to music, humans readily perceive and move along with a periodic beat. Critically, perception of a periodic beat is commonly elicited by rhythmic stimuli with physical features arranged in a way that is not strictly periodic. Hence, beat perception must capitalize on mechanisms that transform stimulus features into a temporally recurrent format with emphasized beat periodicity. Here, I will present a line of work that aims to clarify the nature and neural basis of this transformation. In these studies, electrophysiological activity was recorded as participants listened to rhythms known to induce perception of a consistent beat across healthy Western adults. The results show that the human brain selectively emphasizes beat representation when it is not acoustically prominent in the stimulus, and this transformation (i) can be captured non-invasively using surface EEG in adult participants, (ii) is already in place in 5- to 6-month-old infants, and (iii) cannot be fully explained by subcortical auditory nonlinearities. Moreover, as revealed by human intracerebral recordings, a prominent beat representation emerges already in the primary auditory cortex. Finally, electrophysiological recordings from the auditory cortex of a rhesus monkey show a significant enhancement of beat periodicities in this area, similar to humans. Taken together, these findings indicate an early, general auditory cortical stage of processing by which rhythmic inputs are rendered more temporally recurrent than they are in reality. Already present in non-human primates and human infants, this "periodized" default format could then be shaped by higher-level associative sensory-motor areas and guide movement in individuals with strongly coupled auditory and motor systems. Together, this highlights the multiplicity of neural processes supporting coordinated musical behaviors widely observed across human cultures.The experiments herein include: a motor timing task comparing the effects of movement vs non-movement with and without feedback (Exp. 1A & 1B), a transcranial magnetic stimulation (TMS) study on the role of the supplementary motor area (SMA) in transforming temporal information (Exp. 2), and a perceptual timing task investigating the effect of noisy movement on time perception with both visual and auditory modalities (Exp. 3A & 3B). Together, the results of these studies support the Bayesian cue combination framework, in that: movement improves the precision of time perception not only in perceptual timing tasks but also motor timing tasks (Exp. 1A & 1B), stimulating the SMA appears to disrupt the transformation of temporal information (Exp. 2), and when movement becomes unreliable or noisy there is no longer an improvement in precision of time perception (Exp. 3A & 3B). Although there is support for the proposed framework, more studies (i.e., fMRI, TMS, EEG, etc.) need to be conducted in order to better understand where and how this may be instantiated in the brain; however, this work provides a starting point to better understanding the intrinsic connection between time and movement
How what you do shapes what you see
Prosody in the voice, face, and hands changes which words you hear
Speech may be characterized as conveying both segmental information (i.e., about vowels and consonants) as well as suprasegmental information - cued through pitch, intensity, and duration - also known as the prosody of speech. In this contribution, I will argue that prosody shapes low-level speech perception, changing which speech sounds we hear. Perhaps the most notable example of how prosody guides word recognition is the phenomenon of lexical stress, whereby suprasegmental F0, intensity, and duration cues can distinguish otherwise segmentally identical words, such as "PLAto" vs. "plaTEAU" in Dutch. Work from our group showcases the vast variability in how different talkers produce stressed vs. unstressed syllables, while also unveiling the remarkable flexibility with which listeners can learn to handle this between-talker variability. It also emphasizes that lexical stress is a multimodal linguistic phenomenon, with the voice, lips, and even hands conveying stress in concert. In turn, human listeners actively weigh these multisensory cues to stress depending on the listening conditions at hand. Finally, lexical stress is presented as having a robust and lasting impact on low-level speech perception, even down to changing vowel perception. Thus, prosody - in all its multisensory forms - is a potent factor in speech perception, determining what speech sounds we hear.
The role of sub-population structure in computations through neural dynamics
Neural computations are currently conceptualised using two separate approaches: sorting neurons into functional sub-populations or examining distributed collective dynamics. Whether and how these two aspects interact to shape computations is currently unclear. Using a novel approach to extract computational mechanisms from recurrent networks trained on neuroscience tasks, we show that the collective dynamics and sub-population structure play fundamentally complementary roles. Although various tasks can be implemented in networks with fully random population structure, we found that flexible input–output mappings instead require a non-random population structure that can be described in terms of multiple sub-populations. Our analyses revealed that such a sub-population organisation enables flexible computations through a mechanism based on gain-controlled modulations that flexibly shape the collective dynamics.
The embodied brain
Understanding the brain is not only intrinsically fascinating, but also highly relevant to increase our well-being since our brain exhibits a power over the body that makes it capable both of provoking illness or facilitating the healing process. Bearing in mind this dark force, brain sciences have undergone and will undergo an important revolution, redefining its boundaries beyond the cranial cavity. During this presentation, we will discuss about the communication between the brain and other systems that shapes how we feel the external word and how we think. We are starting to unravel how our organs talk to the brain and how the brain talks back. That two-way communication encompasses a complex, body-wide system of nerves, hormones and other signals that will be discussed. This presentation aims at challenging a long history of thinking of bodily regulation as separate from "higher" mental processes. Four centuries ago, René Descartes famously conceptualized the mind as being separate from the body, it is time now to embody our mind.
A sense without sensors: how non-temporal stimulus features influence the perception and the neural representation of time
Any sensory experience of the world, from the touch of a caress to the smile on our friend’s face, is embedded in time and it is often associated with the perception of the flow of it. The perception of time is therefore a peculiar sensory experience built without dedicated sensors. How the perception of time and the content of a sensory experience interact to give rise to this unique percept is unclear. A few empirical evidences show the existence of this interaction, for example the speed of a moving object or the number of items displayed on a computer screen can bias the perceived duration of those objects. However, to what extent the coding of time is embedded within the coding of the stimulus itself, is sustained by the activity of the same or distinct neural populations and subserved by similar or distinct neural mechanisms is far from clear. Addressing these puzzles represents a way to gain insight on the mechanism(s) through which the brain represents the passage of time. In my talk I will present behavioral and neuroimaging studies to show how concurrent changes of visual stimulus duration, speed, visual contrast and numerosity, shape and modulate brain’s and pupil’s responses and, in case of numerosity and time, influence the topographic organization of these features along the cortical visual hierarchy.
Dynamic endocrine modulation of the nervous system
Sex hormones are powerful neuromodulators of learning and memory. In rodents and nonhuman primates estrogen and progesterone influence the central nervous system across a range of spatiotemporal scales. Yet, their influence on the structural and functional architecture of the human brain is largely unknown. Here, I highlight findings from a series of dense-sampling neuroimaging studies from my laboratory designed to probe the dynamic interplay between the nervous and endocrine systems. Individuals underwent brain imaging and venipuncture every 12-24 hours for 30 consecutive days. These procedures were carried out under freely cycling conditions and again under a pharmacological regimen that chronically suppresses sex hormone production. First, resting state fMRI evidence suggests that transient increases in estrogen drive robust increases in functional connectivity across the brain. Time-lagged methods from dynamical systems analysis further reveals that these transient changes in estrogen enhance within-network integration (i.e. global efficiency) in several large-scale brain networks, particularly Default Mode and Dorsal Attention Networks. Next, using high-resolution hippocampal subfield imaging, we found that intrinsic hormone fluctuations and exogenous hormone manipulations can rapidly and dynamically shape medial temporal lobe morphology. Together, these findings suggest that neuroendocrine factors influence the brain over short and protracted timescales.
Explaining an asymmetry in similarity and difference judgments
Explicit similarity judgments tend to emphasize relational information more than do difference judgments. In this talk, I propose and test the hypothesis that this asymmetry arises because human reasoners represent the relation different as the negation of the relation same (i.e., as not-same). This proposal implies that processing difference is more cognitively demanding than processing similarity. Both for verbal comparisons between word pairs, and for visual comparisons between sets of geometric shapes, participants completed a triad task in which they selected which of two options was either more similar to or more different from a standard. On unambiguous trials, one option was unambiguously more similar to the standard, either by virtue of featural similarity or by virtue of relational similarity. On ambiguous trials, one option was more featurally similar (but less relationally similar) to the standard, whereas the other was more relationally similar (but less featurally similar). Given the higher cognitive complexity of assessing relational similarity, we predicted that detecting relational difference would be particularly demanding. We found that participants (1) had more difficulty accurately detecting relational difference than they did relational similarity on unambiguous trials, and (2) tended to emphasize relational information more when judging similarity than when judging difference on ambiguous trials. The latter finding was captured by a computational model of comparison that weights relational information more heavily for similarity than for difference judgments. These results provide convergent evidence for a representational asymmetry between the relations same and different.
Asymmetric signaling across the hierarchy of cytoarchitecture within the human connectome
Cortical variations in cytoarchitecture form a sensory-fugal axis that shapes regional profiles of extrinsic connectivity and is thought to guide signal propagation and integration across the cortical hierarchy. While neuroimaging work has shown that this axis constrains local properties of the human connectome, it remains unclear whether it also shapes the asymmetric signaling that arises from higher-order topology. Here, we used network control theory to examine the amount of energy required to propagate dynamics across the sensory-fugal axis. Our results revealed an asymmetry in this energy, indicating that bottom-up transitions were easier to complete compared to top-down. Supporting analyses demonstrated that asymmetries were underpinned by a connectome topology that is wired to support efficient bottom-up signaling. Lastly, we found that asymmetries correlated with differences in communicability and intrinsic neuronal time scales and lessened throughout youth. Our results show that cortical variation in cytoarchitecture may guide the formation of macroscopic connectome topology.
Off the rails - how pathological patterns of whole brain activity emerge in epileptic seizures
In most brains across the animal kingdom, brain dynamics can enter pathological states that are recognisable as epileptic seizures. Yet usually, brain operate within certain constraints given through neuronal function and synaptic coupling, that will prevent epileptic seizure dynamics from emerging. In this talk, I will bring together different approaches to identifying how networks in the broadest sense shape brain dynamics. Using illustrative examples from intracranial EEG recordings, disorders characterised by molecular disruption of a single neurotransmitter receptor type, to single-cell recordings of whole-brain activity in the larval zebrafish, I will address three key questions - (1) how does the regionally specific composition of synaptic receptors shape ongoing physiological brain activity; (2) how can disruption of this regionally specific balance result in abnormal brain dynamics; and (3) which cellular patterns underly the transition into an epileptic seizure.
Learning to see stuff
Humans are very good at visually recognizing materials and inferring their properties. Without touching surfaces, we can usually tell what they would feel like, and we enjoy vivid visual intuitions about how they typically behave. This is impressive because the retinal image that the visual system receives as input is the result of complex interactions between many physical processes. Somehow the brain has to disentangle these different factors. I will present some recent work in which we show that an unsupervised neural network trained on images of surfaces spontaneously learns to disentangle reflectance, lighting and shape. However, the disentanglement is not perfect, and we find that as a result the network not only predicts the broad successes of human gloss perception, but also the specific pattern of errors that humans exhibit on an image-by-image basis. I will argue this has important implications for thinking about appearance and vision more broadly.
Sampling the environment with body-brain rhythms
Since Darwin, comparative research has shown that most animals share basic timing capacities, such as the ability to process temporal regularities and produce rhythmic behaviors. What seems to be more exclusive, however, are the capacities to generate temporal predictions and to display anticipatory behavior at salient time points. These abilities are associated with subcortical structures like basal ganglia (BG) and cerebellum (CE), which are more developed in humans as compared to nonhuman animals. In the first research line, we investigated the basic capacities to extract temporal regularities from the acoustic environment and produce temporal predictions. We did so by adopting a comparative and translational approach, thus making use of a unique EEG dataset including 2 macaque monkeys, 20 healthy young, 11 healthy old participants and 22 stroke patients, 11 with focal lesions in the BG and 11 in the CE. In the second research line, we holistically explore the functional relevance of body-brain physiological interactions in human behavior. Thus, a series of planned studies investigate the functional mechanisms by which body signals (e.g., respiratory and cardiac rhythms) interact with and modulate neurocognitive functions from rest and sleep states to action and perception. This project supports the effort towards individual profiling: are individuals’ timing capacities (e.g., rhythm perception and production), and general behavior (e.g., individual walking and speaking rates) influenced / shaped by body-brain interactions?
The embodied brain
Understanding the brain is not only intrinsically fascinating, but also highly relevant to increase our well-being since our brain exhibits a power over the body that makes it capable both of provoking illness or facilitating the healing process. Bearing in mind this dark force, brain sciences have undergone and will undergo an important revolution, redefining its boundaries beyond the cranial cavity. During this presentation, we will discuss about the communication between the brain and other systems that shapes how we feel the external word and how we think. We are starting to unravel how our organs talk to the brain and how the brain talks back. That two-way communication encompasses a complex, body-wide system of nerves, hormones and other signals that will be discussed. This presentation aims at challenging a long history of thinking of bodily regulation as separate from "higher" mental processes. Four centuries ago, René Descartes famously conceptualized the mind as being separate from the body, it is time now to embody our mind.
Early life adversity, inflammation, and depression-onset: Results from the Teen Resilience Project
My research focuses broadly on the lifelong health disparities associated with experiences of adversity early in life. In this talk I will present the results of our recently completed Teen Resilience Project, a prospective and longitudinal study of first onset depression during adolescence. First, I will present the results on whether and how inflammatory processes may be shaped by early life adversity. Second, I will present data on the role of stress-induced inflammation in reward-related psychological processes. Finally, I will discuss the biobehavioral predictors of first-onset depression in this sample.
Behavioral Timescale Synaptic Plasticity (BTSP) for biologically plausible credit assignment across multiple layers via top-down gating of dendritic plasticity
A central problem in biological learning is how information about the outcome of a decision or behavior can be used to reliably guide learning across distributed neural circuits while obeying biological constraints. This “credit assignment” problem is commonly solved in artificial neural networks through supervised gradient descent and the backpropagation algorithm. In contrast, biological learning is typically modelled using unsupervised Hebbian learning rules. While these rules only use local information to update synaptic weights, and are sometimes combined with weight constraints to reflect a diversity of excitatory (only positive weights) and inhibitory (only negative weights) cell types, they do not prescribe a clear mechanism for how to coordinate learning across multiple layers and propagate error information accurately across the network. In recent years, several groups have drawn inspiration from the known dendritic non-linearities of pyramidal neurons to propose new learning rules and network architectures that enable biologically plausible multi-layer learning by processing error information in segregated dendrites. Meanwhile, recent experimental results from the hippocampus have revealed a new form of plasticity—Behavioral Timescale Synaptic Plasticity (BTSP)—in which large dendritic depolarizations rapidly reshape synaptic weights and stimulus selectivity with as little as a single stimulus presentation (“one-shot learning”). Here we explore the implications of this new learning rule through a biologically plausible implementation in a rate neuron network. We demonstrate that regulation of dendritic spiking and BTSP by top-down feedback signals can effectively coordinate plasticity across multiple network layers in a simple pattern recognition task. By analyzing hidden feature representations and weight trajectories during learning, we show the differences between networks trained with standard backpropagation, Hebbian learning rules, and BTSP.
Biological and experience-based trajectories in adolescent brain and cognitive development
Adolescent development is not only shaped by the mere passing of time and accumulating experience, but it also depends on pubertal timing and the cascade of maturational processes orchestrated by gonadal hormones. Although individual variability in puberty onset confounds adolescent studies, it has not been efficiently controlled for. Here we introduce ultrasonic bone age assessment to estimate biological maturity and disentangle the independent effects of chronological and biological age on adolescent cognitive abilities, emotional development, and brain maturation. Comparing cognitive performance of participants with different skeletal maturity we uncover the impact of biological age on both IQ and specific abilities. With respect to emotional development, we find narrow windows of highest vulnerability determined by biological age. In terms of neural development, we focus on the relevance of neural states unrelated to sensory stimulation, such as cortical activity during sleep and resting states, and we uncover a novel anterior-to-posterior pattern of human brain maturation. Based on our findings, bone age is a promising biomarker of adolescent maturity.
The role of population structure in computations through neural dynamics
Neural computations are currently investigated using two separate approaches: sorting neurons into functional subpopulations or examining the low-dimensional dynamics of collective activity. Whether and how these two aspects interact to shape computations is currently unclear. Using a novel approach to extract computational mechanisms from networks trained on neuroscience tasks, here we show that the dimensionality of the dynamics and subpopulation structure play fundamentally com- plementary roles. Although various tasks can be implemented by increasing the dimensionality in networks with fully random population structure, flexible input–output mappings instead require a non-random population structure that can be described in terms of multiple subpopulations. Our analyses revealed that such a subpopulation structure enables flexible computations through a mechanism based on gain-controlled modulations that flexibly shape the collective dynamics. Our results lead to task-specific predictions for the structure of neural selectivity, for inactivation experiments and for the implication of different neurons in multi-tasking.
Pitch and Time Interact in Auditory Perception
Research into pitch perception and time perception has typically treated the two as independent processes. However, previous studies of music and speech perception have suggested that pitch and timing information may be processed in an integrated manner, such that the pitch of an auditory stimulus can influence a person’s perception, expectation, and memory of its duration and tempo. Typically, higher-pitched sounds are perceived as faster and longer in duration than lower-pitched sounds with identical timing. We conducted a series of experiments to better understand the limits of this pitch-time integrality. Across several experiments, we tested whether the higher-equals-faster illusion generalizes across the broader frequency range of human hearing by asking participants to compare the tempo of a repeating tone played in one of six octaves to a metronomic standard. When participants heard tones from all six octaves, we consistently found an inverted U-shaped effect of the tone’s pitch height, such that perceived tempo peaked between A4 (440 Hz) and A5 (880 Hz) and decreased at lower and higher octaves. However, we found that the decrease in perceived tempo at extremely high octaves could be abolished by exposing participants to high-pitched tones only, suggesting that pitch-induced timing biases are context sensitive. We additionally tested how the timing of an auditory stimulus influences the perception of its pitch, using a pitch discrimination task in which probe tones occurred early, late, or on the beat within a rhythmic context. Probe timing strongly biased participants to rate later tones as lower in pitch than earlier tones. Together, these results suggest that pitch and time exert a bidirectional influence on one another, providing evidence for integrated processing of pitch and timing information in auditory perception. Identifying the mechanisms behind this pitch-time interaction will be critical for integrating current models of pitch and tempo processing.
Identifying central mechanisms of glucocorticoid circadian rhythm dysfunction in breast cancer
The circadian release of endogenous glucocorticoids is essential in preparing and synchronizing the body’s daily physiological needs. Disruption in the rhythmic activity of glucocorticoids has been observed in individuals with a variety of cancer types, and blunting of this rhythm has been shown to predict cancer mortality and declines in quality of life. This suggests that a disrupted glucocorticoid rhythm is potentially a shared phenotype across cancers. However, where this phenomenon is driven by the cancer itself, and the causal mechanisms that link glucocorticoid rhythm dysfunction and cancer outcomes remain preliminary at best. The regulation of daily glucocorticoid activity has been well-characterized and is maintained, in part, by the coordinated response of the hypothalamic-pituitary-adrenal (HPA) axis, consisting of the suprachiasmatic nucleus (SCN) and corticotropin-releasing hormone-expressing neurons of the paraventricular nucleus of the hypothalamus (PVNCRH). Consequently, we set out to examine if cancer-induced glucocorticoid dysfunction is regulated by disruptions within these hypothalamic nuclei. In comparison to their tumor-free baseline, mammary tumor-bearing mice exhibited a blunting of glucocorticoid rhythms across multiple timepoints throughout the day, as measured by the overall levels and the slope of fecal corticosterone rhythms, during tumor progression. We further examined how peripheral tumors shape hypothalamic activity within the brain. Serial two-photon tomography for whole-brain cFos imaging suggests a disrupted activation of the PVN in mice with tumors. Additionally, we found GFP labeled CRH+ neurons within the PVN after injection of pseudorabies virus expressing GFP into the tumor, pointing to the PVN as a primary target disrupted by mammary tumors. Preliminary in vivo fiber photometry data show that PVNCRH neurons exhibit enhanced calcium activity during tumor progression, as compared to baseline (no tumor) activity. Taken together, this suggests that there may be an overactive HPA response during tumor progression, which in turn, may result in a subsequent negative feedback on glucocorticoid rhythms. Current studies are examining whether tumor progression modulates SCN calcium activity, how the transcriptional profile of PVNCRH neurons is changed, and test if manipulation of the neurocircuitry surrounding glucocorticoid rhythmicity alters tumor characteristics.
What shapes the transcriptional identity of a neuron?
Within the vertebrate neocortex and other telencephalic structures, molecularly-defined neurons tend to segregate at first order into GABAergic types and glutamatergic types. Two fundamental questions arise: (1) do non-telencephalic neurons similarly segregate by neurotransmitter status, and (2) do GABAergic (or glutamatergic) types sampled in different structures share many molecular features in common, beyond the few genes directly responsible for neurotransmitter synthesis and release? To address these questions, we used single-nucleus RNA sequencing, analyzing over 2.4 million brain cells sampled from 16 locations in a primate (the common marmoset). Unexpectedly, we find the answer to both is “no”. I will discuss implications for generalizing associations between neurotransmitter utilization and other phenotypes, and share ongoing efforts to map the biodistributions of cell types in the primate brain.
Multi-level theory of neural representations in the era of large-scale neural recordings: Task-efficiency, representation geometry, and single neuron properties
A central goal in neuroscience is to understand how orchestrated computations in the brain arise from the properties of single neurons and networks of such neurons. Answering this question requires theoretical advances that shine light into the ‘black box’ of representations in neural circuits. In this talk, we will demonstrate theoretical approaches that help describe how cognitive and behavioral task implementations emerge from the structure in neural populations and from biologically plausible neural networks. First, we will introduce an analytic theory that connects geometric structures that arise from neural responses (i.e., neural manifolds) to the neural population’s efficiency in implementing a task. In particular, this theory describes a perceptron’s capacity for linearly classifying object categories based on the underlying neural manifolds’ structural properties. Next, we will describe how such methods can, in fact, open the ‘black box’ of distributed neuronal circuits in a range of experimental neural datasets. In particular, our method overcomes the limitations of traditional dimensionality reduction techniques, as it operates directly on the high-dimensional representations, rather than relying on low-dimensionality assumptions for visualization. Furthermore, this method allows for simultaneous multi-level analysis, by measuring geometric properties in neural population data, and estimating the amount of task information embedded in the same population. These geometric frameworks are general and can be used across different brain areas and task modalities, as demonstrated in the work of ours and others, ranging from the visual cortex to parietal cortex to hippocampus, and from calcium imaging to electrophysiology to fMRI datasets. Finally, we will discuss our recent efforts to fully extend this multi-level description of neural populations, by (1) investigating how single neuron properties shape the representation geometry in early sensory areas, and by (2) understanding how task-efficient neural manifolds emerge in biologically-constrained neural networks. By extending our mathematical toolkit for analyzing representations underlying complex neuronal networks, we hope to contribute to the long-term challenge of understanding the neuronal basis of tasks and behaviors.
The brain: A coincidence detector between sensory experiences and internal milieu
Understanding the brain is not only intrinsically fascinating, but also highly relevant to increase our well-being since our brain exhibits a power over the body that makes it capable both of provoking illness or facilitating the healing process. Bearing in mind this dark force, brain sciences have undergone and will undergo an important revolution, redefining its boundaries beyond the cranial cavity. During this presentation, we will discuss about the communication between the brain and other systems that shapes how we feel the external word and how we think. We are starting to unravel how our organs talk to the brain and how the brain talks back. That two-way communication encompasses a complex, bodywide system of nerves, hormones and other signals that we will discussed. This presentation aims at challenging a long history of thinking of bodily regulation as separate from "higher" mental processes. Four centuries ago, René Descartes famously conceptualized the mind as being separate from the body, it is time now to embody our mind.
Investigating activity-dependent processes in cerebral cortex development and disease
The cerebral cortex contains an extraordinary diversity of excitatory projection neuron (PN) and inhibitory interneurons (IN), wired together to form complex circuits. Spatiotemporally coordinated execution of intrinsic molecular programs by PNs and INs and activity-dependent processes, contribute to cortical development and cortical microcircuits formation. Alterations of these delicate processes have often been associated to neurological/neurodevelopmental disorders. However, despite the groundbreaking discovery that spontaneous activity in the embryonic brain can shape regional identities of distinct cortical territories, it is still unclear whether this early activity contributes to define subtype-specific neuronal fate as well as circuit assembly. In this study, we combined in utero genetic perturbations via CRISPR/Cas9 system and pharmacological inhibition of selected ion channels with RNA-sequencing and live imaging technologies to identify the activity-regulated processes controlling the development of different cortical PN classes, their wiring and the acquisition of subtype specific features. Moreover, we generated human induced pluripotent stem cells (iPSCs) form patients affected by a severe, rare and untreatable form of developmental epileptic encephalopathy. By differentiating cortical organoids form patient-derived iPSCs we create human models of early electrical alterations for studying molecular, structural and functional consequences of the genetic mutations during cortical development. Our ultimate goal is to define the activity-conditioned processes that physiologically occur during the development of cortical circuits, to identify novel therapeutical paths to address the pathological consequences of neonatal epilepsies.
Peripersonal space (PPS) as a primary interface for self-environment interactions
Peripersonal space (PPS) defines the portion of space where interactions between our body and the external environment more likely occur. There is no physical boundary defining the PPS with respect to the extrapersonal space, but PPS is continuously constructed by a dedicated neural system integrating external stimuli and tactile stimuli on the body, as a function of their potential interaction. This mechanism represents a primary interface between the individual and the environment. In this talk, I will present most recent evidence and highlight the current debate about the neural and computational mechanisms of PPS, its main functions and properties. I will discuss novel data showing how PPS dynamically shapes to optimize body-environment interactions. I will describe a novel electrophysiological paradigm to study and measure PPS, and show how this has been used to search for a basic marker of potentials of self-environment interaction in newborns and patients with disorders of consciousness. Finally, I will discuss how PPS is also involved in, and in turn shaped by, social interactions. Under these acceptances, I will discuss how PPS plays a key role in self-consciousness.
Membrane mechanics meet minimal manifolds
Changes in the geometry and topology of self-assembled membranes underlie diverse processes across cellular biology and engineering. Similar to lipid bilayers, monolayer colloidal membranes studied by the Sharma (IISc Bangalore) and Dogic (UCSB) Labs have in-plane fluid-like dynamics and out-of-plane bending elasticity, but their open edges and micron length scale provide a tractable system to study the equilibrium energetics and dynamic pathways of membrane assembly and reconfiguration. First, we discuss how doping colloidal membranes with short miscible rods transforms disk-shaped membranes into saddle-shaped minimal surfaces with complex edge structures. Theoretical modeling demonstrates that their formation is driven by increasing positive Gaussian modulus, which in turn is controlled by the fraction of short rods. Further coalescence of saddle-shaped surfaces leads to exotic topologically distinct structures, including shapes similar to catenoids, tri-noids, four-noids, and higher order structures. We then mathematically explore the mechanics of these catenoid-like structures subject to an external axial force and elucidate their intimate connection to two problems whose solutions date back to Euler: the shape of an area-minimizing soap film and the buckling of a slender rod under compression. A perturbation theory argument directly relates the tensions of membranes to the stability properties of minimal surfaces. We also investigate the effects of including a Gaussian curvature modulus, which, for small enough membranes, causes the axial force to diverge as the ring separation approaches its maximal value.
Reprogramming the nociceptive circuit topology reshapes sexual behavior in C. elegans
In sexually reproducing species, males and females respond to environmental sensory cues and transform the input into sexually dimorphic traits. Yet, how sexually dimorphic behavior is encoded in the nervous system is poorly understood. We characterize the sexually dimorphic nociceptive behavior in C. elegans – hermaphrodites present a lower pain threshold than males in response to aversive stimuli, and study the underlying neuronal circuits, which are composed of the same neurons that are wired differently. By imaging receptor expression, calcium responses and glutamate secretion, we show that sensory transduction is similar in the two sexes, and therefore explore how downstream network topology shapes dimorphic behavior. We generated a computational model that replicates the observed dimorphic behavior, and used this model to predict simple network rewirings that would switch the behavior between the sexes. We then showed experimentally, using genetic manipulations, artificial gap junctions, automated tracking and optogenetics, that these subtle changes to male connectivity result in hermaphrodite-like aversive behavior in-vivo, while hermaphrodite behavior was more robust to perturbations. Strikingly, when presented with aversive cues, rewired males were compromised in finding mating partners, suggesting that the network topology that enables efficient avoidance of noxious cues would have a reproductive "cost". To summarize, we present a deconstruction of a sex-shared neural circuit that affects sexual behavior, and how to reprogram it. More broadly, our results are an example of how common neuronal circuits changed their function during evolution by subtle topological rewirings to account for different environmental and sexual needs.
New prospects in shape morphing sheets: unexplored pathways, 4D printing, and autonomous actuation
Living organisms have mastered the dynamic control of stresses within sheets to induce shape transformation and locomotion. For instance, the spatiotemporal pattern of action potential in a heart yields a dynamical stress field leading to shape changes and biological function. Such structures inspired the development of theoretical tools and responsive materials alike. Yet, present attempts to mimic their rich dynamics and phenomenology in autonomous synthetic matter are still very limited. In this talk, I will present several complementing innovations toward this goal: novel shaping mechanisms that were overlooked by previous research, new fabrication techniques for programmable matter via 4D printing of gel structures, and most prominently, the first autonomous shape morphing membranes. The dynamical control over the geometry of the material is a prevalent theme in all of these achievements. In particular, the latter system demonstrates localized deformations, induced by a pattern-forming chemical reaction, that prescribe the patterns of curvature, leading to global shape evolution. Together, these developments present a route for modeling and producing fully autonomous soft membranes mimicking some of the locomotive capabilities of living organisms.
Clinical neuroscience and the heart-brain axis (BACN Mid-career Prize Lecture 2021)
Cognitive and emotional processes are shaped by the dynamic integration of brain and body. A major channel of interoceptive information comes from the heart, where phasic signals are conveyed to the brain to indicate how fast and strong the heart is beating. This talk will discuss how interoceptive processes operate across conscious and unconscious levels to influence emotion and memory. The interoceptive channel is disrupted in distinct ways in individuals with autism and anxiety. Selective interoceptive disturbance is related to symptomatology including dissociation and the transdiagnostic expression of anxiety. Interoceptive training can reduce anxiety, with enhanced interoceptive precision associated with greater insula connectivity following targeted interoceptive feedback. The discrete cardiac effects on emotion and cognition have broad relevance to clinical neuroscience, with implications for peripheral treatment targets and behavioural interventions.
A draft connectome for ganglion cell types of the mouse retina
The visual system of the brain is highly parallel in its architecture. This is clearly evident in the outputs of the retina, which arise from neurons called ganglion cells. Work in our lab has shown that mammalian retinas contain more than a dozen distinct types of ganglion cells. Each type appears to filter the retinal image in a unique way and to relay this processed signal to a specific set of targets in the brain. My students and I are working to understand the meaning of this parallel organization through electrophysiological and anatomical studies. We record from light-responsive ganglion cells in vitro using the whole-cell patch method. This allows us to correlate directly the visual response properties, intrinsic electrical behavior, synaptic pharmacology, dendritic morphology and axonal projections of single neurons. Other methods used in the lab include neuroanatomical tracing techniques, single-unit recording and immunohistochemistry. We seek to specify the total number of ganglion cell types, the distinguishing characteristics of each type, and the intraretinal mechanisms (structural, electrical, and synaptic) that shape their stimulus selectivities. Recent work in the lab has identified a bizarre new ganglion cell type that is also a photoreceptor, capable of responding to light even when it is synaptically uncoupled from conventional (rod and cone) photoreceptors. These ganglion cells appear to play a key role in resetting the biological clock. It is just this sort of link, between a specific cell type and a well-defined behavioral or perceptual function, that we seek to establish for the full range of ganglion cell types. My research concerns the structural and functional organization of retinal ganglion cells, the output cells of the retina whose axons make up the optic nerve. Ganglion cells exhibit great diversity both in their morphology and in their responses to light stimuli. On this basis, they are divisible into a large number of types (>15). Each ganglion-cell type appears to send its outputs to a specific set of central visual nuclei. This suggests that ganglion cell heterogeneity has evolved to provide each visual center in the brain with pre-processed representations of the visual scene tailored to its specific functional requirements. Though the outline of this story has been appreciated for some time, it has received little systematic exploration. My laboratory is addressing in parallel three sets of related questions: 1) How many types of ganglion cells are there in a typical mammalian retina and what are their structural and functional characteristics? 2) What combination of synaptic networks and intrinsic membrane properties are responsible for the characteristic light responses of individual types? 3) What do the functional specializations of individual classes contribute to perceptual function or to visually mediated behavior? To pursue these questions, we label retinal ganglion cells by retrograde transport from the brain; analyze in vitro their light responses, intrinsic membrane properties and synaptic pharmacology using the whole-cell patch clamp method; and reveal their morphology with intracellular dyes. Recently, we have discovered a novel ganglion cell in rat retina that is intrinsically photosensitive. These ganglion cells exhibit robust light responses even when all influences from classical photoreceptors (rods and cones) are blocked, either by applying pharmacological agents or by dissociating the ganglion cell from the retina. These photosensitive ganglion cells seem likely to serve as photoreceptors for the photic synchronization of circadian rhythms, the mechanism that allows us to overcome jet lag. They project to the circadian pacemaker of the brain, the suprachiasmatic nucleus of the hypothalamus. Their temporal kinetics, threshold, dynamic range, and spectral tuning all match known properties of the synchronization or "entrainment" mechanism. These photosensitive ganglion cells innervate various other brain targets, such as the midbrain pupillary control center, and apparently contribute to a host of behavioral responses to ambient lighting conditions. These findings help to explain why circadian and pupillary light responses persist in mammals, including humans, with profound disruption of rod and cone function. Ongoing experiments are designed to elucidate the phototransduction mechanism, including the identity of the photopigment and the nature of downstream signaling pathways. In other studies, we seek to provide a more detailed characterization of the photic responsiveness and both morphological and functional evidence concerning possible interactions with conventional rod- and cone-driven retinal circuits. These studies are of potential value in understanding and designing appropriate therapies for jet lag, the negative consequences of shift work, and seasonal affective disorder.
How are nervous systems remodeled in complex metazoans?
Early in development the nervous system is constructed with far too many neurons that make an excessive number of synaptic connections. Later, a wave of neuronal remodeling radically reshapes nervous system wiring and cell numbers through the selective elimination of excess synapses, axons and dendrites, and even whole neurons. This remodeling is widespread across the nervous system, extensive in terms of how much individual brain regions can change (e.g. in some cases 50% of neurons integrated into a brain circuit are eliminated), and thought to be essential for optimizing nervous system function. Perturbations of neuronal remodeling are thought to underlie devastating neurodevelopmental disorders including autism spectrum disorder, schizophrenia, and epilepsy. This seminar will discuss our efforts to use the relatively simple nervous system of Drosophila to understand the mechanistic basis by which cells, or parts of cells, are specified for removal and eliminated from the nervous system.
A transcriptomic axis predicts state modulation of cortical interneurons
Transcriptomics has revealed that cortical inhibitory neurons exhibit a great diversity of fine molecular subtypes, but it is not known whether these subtypes have correspondingly diverse activity patterns in the living brain. We show that inhibitory subtypes in primary visual cortex (V1) have diverse correlates with brain state, but that this diversity is organized by a single factor: position along their main axis of transcriptomic variation. We combined in vivo 2-photon calcium imaging of mouse V1 with a novel transcriptomic method to identify mRNAs for 72 selected genes in ex vivo slices. We classified inhibitory neurons imaged in layers 1-3 into a three-level hierarchy of 5 Subclasses, 11 Types, and 35 Subtypes using previously-defined transcriptomic clusters. Responses to visual stimuli differed significantly only across Subclasses, suppressing cells in the Sncg Subclass while driving cells in the other Subclasses. Modulation by brain state differed at all hierarchical levels but could be largely predicted from the first transcriptomic principal component, which also predicted correlations with simultaneously recorded cells. Inhibitory Subtypes that fired more in resting, oscillatory brain states have less axon in layer 1, narrower spikes, lower input resistance and weaker adaptation as determined in vitro and express more inhibitory cholinergic receptors. Subtypes firing more during arousal had the opposite properties. Thus, a simple principle may largely explain how diverse inhibitory V1 Subtypes shape state-dependent cortical processing.
How Attention Shapes Perception
Non-regular behavior during the coalescence of liquid-like cellular aggregates
The fusion of cell aggregates widely exists during biological processes such as development, tissue regeneration, and tumor invasion. Cellular spheroids (spherical cell aggregates) are commonly used to study this phenomenon. In previous studies, with approximated assumptions and measurements, researchers found that the fusion of two spheroids with some cell type is similar to the coalescence of two liquid droplets. However, with more accurate measurements focusing on the overall shape evolution in this process, we find that even in the previously-regarded liquid-like regime, the fusion process of spheroids can be very different from regular liquid coalescence. We conduct numerical simulations using both standard particulate models and vertex models with both Molecular Dynamics and Brownian Dynamics. The simulation results show that the difference between spheroids and regular liquid droplets is caused by the microscopic overdamped dynamics of each cell rather than the topological cell-cell interactions in the vertex model. Our research reveals the necessity of a new continuum theory for “liquid” with microscopically overdamped components, such as cellular and colloidal systems. Detailed analysis of our simulation results of different system sizes provides the basis for developing the new theory.
Lifestyle, cardiovascular health, and the brain
Lifestyle factors such as sleep, diet, stress, and exercise, profoundly influence cardiovascular health. Seeking to understand how lifestyle affects our biology is important for at least two reasons. First, it can expose a particular lifestyle’s biological impact, which can be leveraged for adopting specific public health policies. Second, such work may identify crucial molecular mechanisms central to how the body adapts to our environments. These insights can then be used to improve our lives. In this talk, I will focus on recent work in the lab exploring how lifestyle factors influence cardiovascular health. I will show how combining tools of neuroscience, hematology, immunology, and vascular biology helps us better understand how the brain shapes leukocytes in response to environmental perturbations. By “connecting the dots” from the brain to the vessel wall, we can begin to elucidate how lifestyle can both maintain and perturb salutogenesis.
The french roots of electrophysiology
This talk looks at the subject of my biography, the German physiologist Emil du Bois-Reymond (1818–1896). With respect to his philosophy of biological reduction, his methods of electrophysiological experiment, and his co-discovery of the action potential, du Bois-Reymond is generally considered one of the founders of neuroscience. Less well known are the origins of his innovation: French writers shaped his outlook on science, just as French scientists shaped his practice in the laboratory. I contend that du Bois-Reymond’s originality is the product of his synthesis of French traditions with German concerns.
Identity-Expression Ambiguity in 3D Morphable Face Models
3D Morphable Models are my favorite class of generative models and are commonly used to model faces. They are typically applied to ill-posed problems such as 3D reconstruction from 2D data. I'll start my presentation with an introduction into 3D Morphable Models and show what they are capable of doing. I'll then focus on our recent finding, the Identity-Expression Ambiguity: We demonstrate that non-orthogonality of the variation in identity and expression can cause identity-expression ambiguity in 3D Morphable Models, and that in practice expression and identity are far from orthogonal and can explain each other surprisingly well. Whilst previously reported ambiguities only arise in an inverse rendering setting, identity-expression ambiguity emerges in the 3D shape generation process itself. The goal of this presentation is to demonstrate the ambiguity and discuss its potential consequences in a computer vision setting as well as for understanding face perception mechanisms in the human brain.
Connecting structure and function in early visual circuits
How does the brain interpret signals from the outside world? Walking through a park, you might take for granted the ease with which you can understand what you see. Rather than seeing a series of still snapshots, you are able to see simple, fluid movement — of dogs running, squirrels foraging, or kids playing basketball. You can track their paths and know where they are headed without much thought. “How does this process take place?” asks Rudy Behnia, PhD, a principal investigator at Columbia’s Mortimer B. Zuckerman Mind Brain Behavior Institute. “For most of us, it’s hard to imagine a world where we can’t see motion, shapes, and color; where we can’t have a representation of the physical world in our head.” And yet this representation does not happen automatically — our brain has no direct connection with the outside world. Instead, it interprets information taken in by our senses. Dr. Behnia is studying how the brain builds these representations. As a starting point, she focuses on how we see motion
Flexible motor sequence generation by thalamic control of cortical dynamics through low-rank connectivity perturbations
One of the fundamental functions of the brain is to flexibly plan and control movement production at different timescales to efficiently shape structured behaviors. I will present a model that clarifies how these complex computations could be performed in the mammalian brain, with an emphasis on the learning of an extendable library of autonomous motor motifs and the flexible stringing of these motifs in motor sequences. To build this model, we took advantage of the fact that the anatomy of the circuits involved is well known. Our results show how these architectural constraints lead to a principled understanding of how strategically positioned plastic connections located within motif-specific thalamocortical loops can interact with cortical dynamics that are shared across motifs to create an efficient form of modularity. This occurs because the cortical dynamics can be controlled by the activation of as few as one thalamic unit, which induces a low-rank perturbation of the cortical connectivity, and significantly expands the range of outputs that the network can produce. Finally, our results show that transitions between any motifs can be facilitated by a specific thalamic population that participates in preparing cortex for the execution of the next motif. Taken together, our model sheds light on the neural network mechanisms that can generate flexible sequencing of varied motor motifs.
A Panoramic View on Vision
Statistics of natural scenes are not uniform - their structure varies dramatically from ground to sky. It remains unknown whether these non-uniformities are reflected in the large-scale organization of the early visual system and what benefits such adaptations would confer. By deploying an efficient coding argument, we predict that changes in the structure of receptive fields across visual space increase the efficiency of sensory coding. To test this experimentally, developed a simple, novel imaging system that is indispensable for studies at this scale. In agreement with our predictions, we could show that receptive fields of retinal ganglion cells change their shape along the dorsoventral axis, with a marked surround asymmetry at the visual horizon. Our work demonstrates that, according to principles of efficient coding, the panoramic structure of natural scenes is exploited by the retina across space and cell-types.
Chronic optogenetic stimulation has the potential to shape the collective activity of neuronal cell cultures
Bernstein Conference 2024
How connection probability shapes fluctuations of neural population dynamics
Bernstein Conference 2024
Cortical feedback shapes high order structure of population activity to improve sensory coding
Bernstein Conference 2024
How the presynapse shapes its molecular composition in an energetically optimal manner
Bernstein Conference 2024
Short-term adaptation reshapes retinal ganglion cell selectivity to natural scenes
Bernstein Conference 2024
Top-down modulation shapes timescales via synaptic plasticity in cortical circuits with multiple interneuron types
Bernstein Conference 2024
Unsupervised clustering of burst shapes reveals the increasing complexity of developing networks in vitro
Bernstein Conference 2024
Cellular mechanisms of dorsal horn neurons shape the functional states of nociceptive circuits
COSYNE 2022
How coding constraints affect the shape of neural manifolds
COSYNE 2022
Cortex-wide decision circuits are shaped by distinct classes of excitatory pyramidal neurons
COSYNE 2022
Divisive normalization shapes evidence accumulation during dynamic decision-making
COSYNE 2022
Heterogeneous prediction-error circuits formed and shaped by homeostatic inhibitory plasticity
COSYNE 2022
Heterogeneous prediction-error circuits formed and shaped by homeostatic inhibitory plasticity
COSYNE 2022
Long-term motor learning creates structure within neural space that shapes motor adaptation
COSYNE 2022
Long-term motor learning creates structure within neural space that shapes motor adaptation
COSYNE 2022
Natural scene expectation shapes the structure of trial to trial variability in mid-level visual cortex
COSYNE 2022
Natural scene expectation shapes the structure of trial to trial variability in mid-level visual cortex
COSYNE 2022
Sex-specific network topology of the nociceptive circuit shapes dimorphic behavior in C. elegans
COSYNE 2022
Sex-specific network topology of the nociceptive circuit shapes dimorphic behavior in C. elegans
COSYNE 2022
Context-Dependent Epoch Codes in Association Cortex Shape Neural Computations
COSYNE 2023
Dendritic low pass filtering shapes midbrain neural responses to behaviorally relevant stimuli
COSYNE 2023
Dynamic endocrine factors shape hippocampal spatial representations
COSYNE 2023
V4 neurons are tuned for local and non-local features of natural planar shape
COSYNE 2023
How Symmetry and Self-Coupling Shape Dynamics and Trainability of Recurrent Neural Networks
COSYNE 2023
Uncertainty differentially shapes premotor and primary motor activity during movement planning
COSYNE 2023
Beneficial effects of alternative stimulation pulse shapes for sensory prostheses: insights from vestibular prosthesis-evoked reflexes and population neural activity
COSYNE 2025
How connection probability shapes fluctuations of neural population dynamics
COSYNE 2025
A family of synaptic plasticity rules shapes triplet motifs in recurrent networks
COSYNE 2025
How internal states shape sensorimotor mapping in zebrafish larvae
COSYNE 2025
Sensory expectations shape neural population dynamics during reaching
COSYNE 2025
Task Structures Shape Underlying Dynamical Systems That Implement Computation
COSYNE 2025
Top-down modulation shapes the timescales of cortical circuits via synaptic plasticity
COSYNE 2025
Visual coding improves over development by refinement of noise amplitude rather than noise shape
COSYNE 2025
Astroglial control of prefrontal dopamine tone shapes behavior
FENS Forum 2024
Astroglial networks shape collicular visual maps
FENS Forum 2024
Cell-type specific auditory responses in the tail of the striatum shaped by feedforward inhibition
FENS Forum 2024
Development and application of L-shaped vertical micro-coils for in vivo neurostimulation in two-photon microscopy
FENS Forum 2024
Disynaptic inhibition shapes tuning of OFF-motion detectors in Drosophila
FENS Forum 2024
How does motor expertise shape the brain activity?
FENS Forum 2024
Hierarchy of prediction errors shapes context-dependent sensory representations
FENS Forum 2024