Sound
sound
Neural mechanisms of optimal performance
When we attend a demanding task, our performance is poor at low arousal (when drowsy) or high arousal (when anxious), but we achieve optimal performance at intermediate arousal. This celebrated Yerkes-Dodson inverted-U law relating performance and arousal is colloquially referred to as being "in the zone." In this talk, I will elucidate the behavioral and neural mechanisms linking arousal and performance under the Yerkes-Dodson law in a mouse model. During decision-making tasks, mice express an array of discrete strategies, whereby the optimal strategy occurs at intermediate arousal, measured by pupil, consistent with the inverted-U law. Population recordings from the auditory cortex (A1) further revealed that sound encoding is optimal at intermediate arousal. To explain the computational principle underlying this inverted-U law, we modeled the A1 circuit as a spiking network with excitatory/inhibitory clusters, based on the observed functional clusters in A1. Arousal induced a transition from a multi-attractor (low arousal) to a single attractor phase (high arousal), and performance is optimized at the transition point. The model also predicts stimulus- and arousal-induced modulations of neural variability, which we confirmed in the data. Our theory suggests that a single unifying dynamical principle, phase transitions in metastable dynamics, underlies both the inverted-U law of optimal performance and state-dependent modulations of neural variability.
Making Sense of Sounds: Cortical Mechanisms for Dynamic Auditory Perception
There’s more to timing than time: P-centers, beat bins and groove in musical microrhythm
How does the dynamic shape of a sound affect its perceived microtiming? In the TIME project, we studied basic aspects of musical microrhythm, exploring both stimulus features and the participants’ enculturated expertise via perception experiments, observational studies of how musicians produce particular microrhythms, and ethnographic studies of musicians’ descriptions of microrhythm. Collectively, we show that altering the microstructure of a sound (“what” the sound is) changes its perceived temporal location (“when” it occurs). Specifically, there are systematic effects of core acoustic factors (duration, attack) on perceived timing. Microrhythmic features in longer and more complex sounds can also give rise to different perceptions of the same sound. Our results shed light on conflicting results regarding the effect of microtiming on the “grooviness” of a rhythm.
Measures and models of multisensory integration in reaction times
First, a new measure of MI for reaction times is proposed that takes the entire RT distribution into account. Second, we present some recent developments in TWIN modeling, including a new proposal for the sound-induced flash illusion (SIFI).
Inducing short to medium neuroplastic effects with Transcranial Ultrasound Stimulation
Sound waves can be used to modify brain activity safely and transiently with unprecedented precision even deep in the brain - unlike traditional brain stimulation methods. In a series of studies in humans and non-human primates, I will show that Transcranial Ultrasound Stimulation (TUS) can have medium- to long-lasting effects. Multiple read-outs allow us to conclude that TUS can perturb neuronal tissues up to 2h after intervention, including changes in local and distributed brain network configurations, behavioural changes, task-related neuronal changes and chemical changes in the sonicated focal volume. Combined with multiple neuroimaging techniques (resting state functional Magnetic Resonance Imaging [rsfMRI], Spectroscopy [MRS] and task-related fMRI changes), this talk will focus on recent human TUS studies.
Vocal emotion perception at millisecond speed
The human voice is possibly the most important sound category in the social landscape. Compared to other non-verbal emotion signals, the voice is particularly effective in communicating emotions: it can carry information over large distances and independent of sight. However, the study of vocal emotion expression and perception is surprisingly far less developed than the study of emotion in faces. Thereby, its neural and functional correlates remain elusive. As the voice represents a dynamically changing auditory stimulus, temporally sensitive techniques such as the EEG are particularly informative. In this talk, the dynamic neurocognitive operations that take place when we listen to vocal emotions will be specified, with a focus on the effects of stimulus type, task demands, and speaker and listener characteristics (e.g., age). These studies suggest that emotional voice perception is not only a matter of how one speaks but also of who speaks and who listens. Implications of these findings for the understanding of psychiatric disorders such as schizophrenia will be discussed.
Internal representation of musical rhythm: transformation from sound to periodic beat
When listening to music, humans readily perceive and move along with a periodic beat. Critically, perception of a periodic beat is commonly elicited by rhythmic stimuli with physical features arranged in a way that is not strictly periodic. Hence, beat perception must capitalize on mechanisms that transform stimulus features into a temporally recurrent format with emphasized beat periodicity. Here, I will present a line of work that aims to clarify the nature and neural basis of this transformation. In these studies, electrophysiological activity was recorded as participants listened to rhythms known to induce perception of a consistent beat across healthy Western adults. The results show that the human brain selectively emphasizes beat representation when it is not acoustically prominent in the stimulus, and this transformation (i) can be captured non-invasively using surface EEG in adult participants, (ii) is already in place in 5- to 6-month-old infants, and (iii) cannot be fully explained by subcortical auditory nonlinearities. Moreover, as revealed by human intracerebral recordings, a prominent beat representation emerges already in the primary auditory cortex. Finally, electrophysiological recordings from the auditory cortex of a rhesus monkey show a significant enhancement of beat periodicities in this area, similar to humans. Taken together, these findings indicate an early, general auditory cortical stage of processing by which rhythmic inputs are rendered more temporally recurrent than they are in reality. Already present in non-human primates and human infants, this "periodized" default format could then be shaped by higher-level associative sensory-motor areas and guide movement in individuals with strongly coupled auditory and motor systems. Together, this highlights the multiplicity of neural processes supporting coordinated musical behaviors widely observed across human cultures.The experiments herein include: a motor timing task comparing the effects of movement vs non-movement with and without feedback (Exp. 1A & 1B), a transcranial magnetic stimulation (TMS) study on the role of the supplementary motor area (SMA) in transforming temporal information (Exp. 2), and a perceptual timing task investigating the effect of noisy movement on time perception with both visual and auditory modalities (Exp. 3A & 3B). Together, the results of these studies support the Bayesian cue combination framework, in that: movement improves the precision of time perception not only in perceptual timing tasks but also motor timing tasks (Exp. 1A & 1B), stimulating the SMA appears to disrupt the transformation of temporal information (Exp. 2), and when movement becomes unreliable or noisy there is no longer an improvement in precision of time perception (Exp. 3A & 3B). Although there is support for the proposed framework, more studies (i.e., fMRI, TMS, EEG, etc.) need to be conducted in order to better understand where and how this may be instantiated in the brain; however, this work provides a starting point to better understanding the intrinsic connection between time and movement
Prosody in the voice, face, and hands changes which words you hear
Speech may be characterized as conveying both segmental information (i.e., about vowels and consonants) as well as suprasegmental information - cued through pitch, intensity, and duration - also known as the prosody of speech. In this contribution, I will argue that prosody shapes low-level speech perception, changing which speech sounds we hear. Perhaps the most notable example of how prosody guides word recognition is the phenomenon of lexical stress, whereby suprasegmental F0, intensity, and duration cues can distinguish otherwise segmentally identical words, such as "PLAto" vs. "plaTEAU" in Dutch. Work from our group showcases the vast variability in how different talkers produce stressed vs. unstressed syllables, while also unveiling the remarkable flexibility with which listeners can learn to handle this between-talker variability. It also emphasizes that lexical stress is a multimodal linguistic phenomenon, with the voice, lips, and even hands conveying stress in concert. In turn, human listeners actively weigh these multisensory cues to stress depending on the listening conditions at hand. Finally, lexical stress is presented as having a robust and lasting impact on low-level speech perception, even down to changing vowel perception. Thus, prosody - in all its multisensory forms - is a potent factor in speech perception, determining what speech sounds we hear.
Multisensory influences on vision: Sounds enhance and alter visual-perceptual processing
Visual perception is traditionally studied in isolation from other sensory systems, and while this approach has been exceptionally successful, in the real world, visual objects are often accompanied by sounds, smells, tactile information, or taste. How is visual processing influenced by these other sensory inputs? In this talk, I will review studies from our lab showing that a sound can influence the perception of a visual object in multiple ways. In the first part, I will focus on spatial interactions between sound and sight, demonstrating that co-localized sounds enhance visual perception. Then, I will show that these cross-modal interactions also occur at a higher contextual and semantic level, where naturalistic sounds facilitate the processing of real-world objects that match these sounds. Throughout my talk I will explore to what extent sounds not only improve visual processing but also alter perceptual representations of the objects we see. Most broadly, I will argue for the importance of considering multisensory influences on visual perception for a more complete understanding of our visual experience.
Pitch and Time Interact in Auditory Perception
Research into pitch perception and time perception has typically treated the two as independent processes. However, previous studies of music and speech perception have suggested that pitch and timing information may be processed in an integrated manner, such that the pitch of an auditory stimulus can influence a person’s perception, expectation, and memory of its duration and tempo. Typically, higher-pitched sounds are perceived as faster and longer in duration than lower-pitched sounds with identical timing. We conducted a series of experiments to better understand the limits of this pitch-time integrality. Across several experiments, we tested whether the higher-equals-faster illusion generalizes across the broader frequency range of human hearing by asking participants to compare the tempo of a repeating tone played in one of six octaves to a metronomic standard. When participants heard tones from all six octaves, we consistently found an inverted U-shaped effect of the tone’s pitch height, such that perceived tempo peaked between A4 (440 Hz) and A5 (880 Hz) and decreased at lower and higher octaves. However, we found that the decrease in perceived tempo at extremely high octaves could be abolished by exposing participants to high-pitched tones only, suggesting that pitch-induced timing biases are context sensitive. We additionally tested how the timing of an auditory stimulus influences the perception of its pitch, using a pitch discrimination task in which probe tones occurred early, late, or on the beat within a rhythmic context. Probe timing strongly biased participants to rate later tones as lower in pitch than earlier tones. Together, these results suggest that pitch and time exert a bidirectional influence on one another, providing evidence for integrated processing of pitch and timing information in auditory perception. Identifying the mechanisms behind this pitch-time interaction will be critical for integrating current models of pitch and tempo processing.
Disentangling neural correlates of consciousness and task relevance using EEG and fMRI
How does our brain generate consciousness, that is, the subjective experience of what it is like to see face or hear a sound? Do we become aware of a stimulus during early sensory processing or only later when information is shared in a wide-spread fronto-parietal network? Neural correlates of consciousness are typically identified by comparing brain activity when a constant stimulus (e.g., a face) is perceived versus not perceived. However, in most previous experiments, conscious perception was systematically confounded with post-perceptual processes such as decision-making and report. In this talk, I will present recent EEG and fMRI studies dissociating neural correlates of consciousness and task-related processing in visual and auditory perception. Our results suggest that consciousness emerges during early sensory processing, while late, fronto-parietal activity is associated with post-perceptual processes rather than awareness. These findings challenge predominant theories of consciousness and highlight the importance of considering task relevance as a confound across different neuroscientific methods, experimental paradigms and sensory modalities.
Imperial Neurotechnology 2022 - Annual Research Symposium
A diverse mix of neurotechnology talks and posters from researchers at Imperial and beyond. Visit our event page to find out more. The event is in-person but talk sessions will be broadcast via Teams.
Why do some animals have more than two eyes?
The evolution of vision revolutionised animal biology, and eyes have evolved in a stunning array of diverse forms over the past half a billion years. Among these are curious duplicated visual systems, where eyes can be spread across the body and specialised for different tasks. Although it sounds radical, duplicated vision is found in most major groups across the animal kingdom, but remains poorly understood. We will explore how and why animals collect information about their environment in this unusual way, looking at examples from tropical forests to the sea floor, and from ancient arthropods to living jellyfish. Have we been short-changed with just two eyes? Dr Lauren Sumner-Rooney is a Research Fellow at the OUMNH studying the function and evolution of animal visual systems. Lauren completed her undergraduate degree at Oxford in 2012, and her PhD at Queen’s University Belfast in 2015. She worked as a research technician and science communicator at the Royal Veterinary College (2015-2016) and held a postdoctoral research fellowship at the Museum für Naturkunde, Berlin (2016-2017) before arriving at the Museum in 2017.
MBI Webinar on preclinical research into brain tumours and neurodegenerative disorders
WEBINAR 1 Breaking the barrier: Using focused ultrasound for the development of targeted therapies for brain tumours presented by Dr Ekaterina (Caty) Salimova, Monash Biomedical Imaging Glioblastoma multiforme (GBM) - brain cancer - is aggressive and difficult to treat as systemic therapies are hindered by the blood-brain barrier (BBB). Focused ultrasound (FUS) - a non-invasive technique that can induce targeted temporary disruption of the BBB – is a promising tool to improve GBM treatments. In this webinar, Dr Ekaterina Salimova will discuss the MRI-guided FUS modality at MBI and her research to develop novel targeted therapies for brain tumours. Dr Ekaterina (Caty) Salimova is a Research Fellow in the Preclinical Team at Monash Biomedical Imaging. Her research interests include imaging cardiovascular disease and MRI-guided focused ultrasound for investigating new therapeutic targets in neuro-oncology. - WEBINAR 2 Disposition of the Kv1.3 inhibitory peptide HsTX1[R14A], a novel attenuator of neuroinflammation presented by Sanjeevini Babu Reddiar, Monash Institute of Pharmaceutical Sciences The voltage-gated potassium channel (Kv1.3) in microglia regulates membrane potential and pro-inflammatory functions, and non-selective blockade of Kv1.3 has shown anti-inflammatory and disease improvement in animal models of Alzheimer’s and Parkinson’s diseases. Therefore, specific inhibitors of pro-inflammatory microglial processes with CNS bioavailability are urgently needed, as disease-modifying treatments for neurodegenerative disorders are lacking. In this webinar, PhD candidate Ms Sanju Reddiar will discuss the synthesis and biodistribution of a Kv1.3-inhibitory peptide using a [64Cu]Cu-DOTA labelled conjugate. Sanjeevini Babu Reddiar is a PhD student at the Monash Institute of Pharmaceutical Sciences. She is working on a project identifying the factors governing the brain disposition and blood-brain barrier permeability of a Kv1.3-blocking peptide.
Making a Mesh of Things: Using Network Models to Understand the Mechanics of Heterogeneous Tissues
Networks of stiff biopolymers are an omnipresent structural motif in cells and tissues. A prominent modeling framework for describing biopolymer network mechanics is rigidity percolation theory. This theory describes model networks as nodes joined by randomly placed, springlike bonds. Increasing the amount of bonds in a network results in an abrupt, dramatic increase in elastic moduli above a certain threshold – an example of a mechanical phase transition. While homogeneous networks are well studied, many tissues are made of disparate components and exhibit spatial fluctuations in the concentrations of their constituents. In this talk, I will first discuss recent work in which we explained the structural basis of the shear mechanics of healthy and chemically degraded cartilage by coupling a rigidity percolation framework with a background gel. Our model takes into account collagen concentration, as well as the concentration of peptidoglycans in the surrounding polyelectrolyte gel, to produce a structureproperty relationship that describes the shear mechanics of both sound and diseased cartilage. I will next discuss the introduction of structural correlation in constructing networks, such that sparse and dense patches emerge. I find moderate correlation allows a network to become rigid with fewer bonds, while this benefit is partly erased by excessive correlation. We explain this phenomenon through analysis of the spatial fluctuations in strained networks’ displacement fields. Finally, I will address our work’s implications for non-invasive diagnosis of pathology, as well as rational design of prostheses and novel soft materials.
Do we reason differently about affectively charged analogies? Insights from EEG research
Affectively charged analogies are commonly used in literature and art, but also in politics and argumentation. There are reasons to think we may process these analogies differently. Notably, analogical reasoning is a complex process that requires the use of cognitive resources, which are limited. In the presence of affectively charged content, some of these resources might be directed towards affective processing and away from analogical reasoning. To investigate this idea, I investigated effects of affective charge on differences in brain activity evoked by sound versus unsound analogies. The presentation will detail the methods and results for two such experiments, one in which participants saw analogies formed of neutral and negative words and one in which they were created by combining conditioned symbols. I will also briefly discuss future research aiming to investigate the effects of analogical reasoning on brain activity related to affective processing.
Rhythms in sounds and rhythms in brains: the temporal structure of auditory comprehension
Heartbeat-based auditory regularities induce prediction in human wakefulness and sleep
Exposure to sensory regularities in the environment induces the human brain to form expectations about incoming stimuli and remains partially preserved in the absence of consciousness (i.e. coma and sleep). While regularity often refers to stimuli presented at a fixed pace, we recently explored whether auditory prediction extends to pseudo-regular sequences where sensory prediction is induced by locking sound onsets to heartbeat signals and whether it can occur across vigilance states. In a series of experiments in healthy volunteers, we found neural and cardiac evidence of auditory prediction during heartbeat-based auditory regularities in wakefulness and N2 sleep. This process could represent an important mechanism for detecting unexpected stimuli in the environment even in states of limited conscious and attentional resources.
Neural circuits for novel choices and for choice speed and accuracy changes in macaques
While most experimental tasks aim at isolating simple cognitive processes to study their neural bases, naturalistic behaviour is often complex and multidimensional. I will present two studies revealing previously uncharacterised neural circuits for decision-making in macaques. This was possible thanks to innovative experimental tasks eliciting sophisticated behaviour, bridging the human and non-human primate research traditions. Firstly, I will describe a specialised medial frontal circuit for novel choice in macaques. Traditionally, monkeys receive extensive training before neural data can be acquired, while a hallmark of human cognition is the ability to act in novel situations. I will show how this medial frontal circuit can combine the values of multiple attributes for each available novel item on-the-fly to enable efficient novel choices. This integration process is associated with a hexagonal symmetry pattern in the BOLD response, consistent with a grid-like representation of the space of all available options. We prove the causal role played by this circuit by showing that focussed transcranial ultrasound neuromodulation impairs optimal choice based on attribute integration and forces the subjects to default to a simpler heuristic decision strategy. Secondly, I will present an ongoing project addressing the neural mechanisms driving behaviour shifts during an evidence accumulation task that requires subjects to trade speed for accuracy. While perceptual decision-making in general has been thoroughly studied, both cognitively and neurally, the reasons why speed and/or accuracy are adjusted, and the associated neural mechanisms, have received little attention. We describe two orthogonal dimensions in which behaviour can vary (traditional speed-accuracy trade-off and efficiency) and we uncover independent neural circuits concerned with changes in strategy and fluctuations in the engagement level. The former involves the frontopolar cortex, while the latter is associated with the insula and a network of subcortical structures including the habenula.
Interpersonal synchrony of body/brain, Solo & Team Flow
Flow is defined as an altered state of consciousness with excessive attention and enormous sense of pleasure, when engaged in a challenging task, first postulated by a psychologist, the late M. Csikszentmihayli. The main focus of this talk will be “Team Flow,” but there were two lines of previous studies in our laboratory as its background. First is inter-body and inter-brain coordination/synchrony between individuals. Considering various rhythmic echoing/synchronization phenomena in animal behavior, it could be regarded as the biological, sub-symbolic and implicit origin of social interactions. The second line of precursor research is on the state of Solo Flow in game playing. We employed attenuation of AEP (Auditory Evoked Potential) to task-irrelevant sound probes as an objective-neural indicator of such a Flow status, and found that; 1) Mutual link between the ACC & the TP is critical, and 2) overall, top-down influence is enhanced while bottom-up causality is attenuated. Having these as the background, I will present our latest study of Team Flow in game playing. We found that; 3) the neural correlates of Team Flow is distinctively different from those of Solo Flow nor of non-flow social, 4) the left medial temporal cortex seems to form an integrative node for Team Flow, receiving input related to Solo Flow state from the right PFC and input related to social state from the right IFC, and 5) Intra-brain (dis)similarity of brain activity well predicts (dis)similarity of skills/cognition as well as affinity for inter-brain coherence.
Hearing in an acoustically varied world
In order for animals to thrive in their complex environments, their sensory systems must form representations of objects that are invariant to changes in some dimensions of their physical cues. For example, we can recognize a friend’s speech in a forest, a small office, and a cathedral, even though the sound reaching our ears will be very different in these three environments. I will discuss our recent experiments into how neurons in auditory cortex can form stable representations of sounds in this acoustically varied world. We began by using a normative computational model of hearing to examine how the brain may recognize a sound source across rooms with different levels of reverberation. The model predicted that reverberations can be removed from the original sound by delaying the inhibitory component of spectrotemporal receptive fields in the presence of stronger reverberation. Our electrophysiological recordings then confirmed that neurons in ferret auditory cortex apply this algorithm to adapt to different room sizes. Our results demonstrate that this neural process is dynamic and adaptive. These studies provide new insights into how we can recognize auditory objects even in highly reverberant environments, and direct further research questions about how reverb adaptation is implemented in the cortical circuit.
What happens to our ability to perceive multisensory information as we age?
Our ability to perceive the world around us can be affected by a number of factors including the nature of the external information, prior experience of the environment, and the integrity of the underlying perceptual system. A particular challenge for the brain is to maintain a coherent perception from information encoded by the peripheral sensory organs whose function is affected by typical, developmental changes across the lifespan. Yet, how the brain adapts to the maturation of the senses, as well as experiential changes in the multisensory environment, is poorly understood. Over the past few years, we have used a range of multisensory tasks to investigate the role of ageing on the brain’s ability to merge sensory inputs. In particular, we have embedded an audio-visual task based on the sound-induced flash illusion (SIFI) into a large-scale, longitudinal study of ageing. Our findings support the idea that the temporal binding window (TBW) is modulated by age and reveal important individual differences in this TBW that may have clinical implications. However, our investigations also suggest the TWB is experience-dependent with evidence for both long and short term behavioural plasticity. An overview of these findings, including recent evidence on how multisensory integration may be associated with higher order functions, will be discussed.
Functional ultrasound imaging during behavior
The dream of a systems neuroscientist is to be able to unravel neural mechanisms that give rise to behavior. It is increasingly appreciated that behavior involves the concerted distributed activity of multiple brain regions so the focus on single or few brain areas might hinder our understanding. There have been quite a few technological advancements in this domain. Functional ultrasound imaging (fUSi) is an emerging technique that allows us to measure neural activity from medial frontal regions down to subcortical structures up to a depth of 20 mm. It is a method for imaging transient changes in cerebral blood volume (CBV), which are proportional to neural activity changes. It has excellent spatial resolution (~100 μm X 100 μm X 400 μm); its temporal resolution can go down to 100 milliseconds. In this talk, I will present its use in two model systems: marmoset monkeys and rats. In marmoset monkeys, we used it to delineate a social – vocal network involved in vocal communication while in rats, we used it to gain insights into brain wide networks involved in evidence accumulation based decision making. fUSi has the potential to provide an unprecedented access to brain wide dynamics in freely moving animals performing complex behavioral tasks.
Decoding sounds in early visual cortex of sighted and blind individuals
How does seeing help listening? Audiovisual integration in Auditory Cortex
Multisensory responses are ubiquitous in so-called unisensory cortex. However, despite their prevalence, we have very little understanding of what – if anything - they contribute to perception. In this talk I will focus on audio-visual integration in auditory cortex. Anatomical tracing studies highlight visual cortex as one source of visual input to auditory cortex. Using cortical cooling we test the hypothesis that these inputs support audiovisual integration in ferret auditory cortex. Behavioural studies in humans support the idea that visual stimuli can help listeners to parse an auditory scene. This effect is paralleled in single units in auditory cortex, where responses to a sound mixture can be determined by the timing of a visual stimulus such that sounds that are temporally coherent with a visual stimulus are preferentially represented. Our recent data therefore support the idea that one role for the early integration of auditory and visual signals in auditory cortex is to support auditory scene analysis, and that visual cortex plays a key role in this process.
The wonders and complexities of brain microstructure: Enabling biomedical engineering studies combining imaging and models
Brain microstructure plays a key role in driving the transport of drug molecules directly administered to the brain tissue as in Convection-Enhanced Delivery procedures. This study reports the first systematic attempt to characterize the cytoarchitecture of commissural, long association and projection fiber, namely: the corpus callosum, the fornix and the corona radiata. Ovine samples from three different subjects have been imaged using scanning electron microscope combined with focused ion beam milling. Particular focus has been given to the axons. For each tract, a 3D reconstruction of relatively large volumes (including a significant number of axons) has been performed. Namely, outer axonal ellipticity, outer axonal cross-sectional area and its relative perimeter have been measured. This study [1] provides useful insight into the fibrous organization of the tissue that can be described as composite material presenting elliptical tortuous tubular fibers, leading to a workflow to enable accurate simulations of drug delivery which include well-resolved microstructural features. As a demonstration of the use of these imaging and reconstruction techniques, our research analyses the hydraulic permeability of two white matter (WM) areas (corpus callosum and fornix) whose three-dimensional microstructure was reconstructed starting from the acquisition of the electron microscopy images. Considering that the white matter structure is mainly composed of elongated and parallel axons we computed the permeability along the parallel and perpendicular directions using computational fluid dynamics [2]. The results show a statistically significant difference between parallel and perpendicular permeability, with a ratio about 2 in both the white matter structures analysed, thus demonstrating their anisotropic behaviour. This is in line with the experimental results obtained using perfusion of brain matter [3]. Moreover, we find a significant difference between permeability in corpus callosum and fornix, which suggests that also the white matter heterogeneity should be considered when modelling drug transport in the brain. Our findings, that demonstrate and quantify the anisotropic and heterogeneous character of the white matter, represent a fundamental contribution not only for drug delivery modelling but also for shedding light on the interstitial transport mechanisms in the extracellular space. These and many other discoveries will be discussed during the talk." "1. https://www.researchsquare.com/article/rs-686577/v1, 2. https://www.pnas.org/content/118/36/e2105328118, 3. https://ieeexplore.ieee.org/abstract/document/9198110
Perceptual and neural basis of sound-symbolic crossmodal correspondences
Evidence for the role of glymphatic dysfunction in the development of Alzheimer’s disease
Glymphatic perivascular exchange is supported by the astroglial water channel aquaporin-4 (AQP4), which localizes to perivascular astrocytic endfeet surrounding the cerebral vasculature. In aging mice, impairment of glymphatic function is associated with reduced perivascular AQP4 localization, yet whether these changes contribute to the development of neurodegenerative disease, such as Alzheimer’s disease (AD), remains unknown. Using post mortem human tissue, we evaluated perivascular AQP4 localization in the frontal cortical gray matter, white matter, and hippocampus of cognitively normal subjects and those with AD. Loss of perivascular and increasing cellular localization of AQP4 in the frontal gray matter was specifically associated with AD status, amyloid β (Aβ) and tau pathology, and cognitive decline in the early stages of disease. Using AAV-PHP.B to drive expression on non-perivascular AQP4 in wild type and Tg2576 (APPSwe, mouse model of Aβ deposition) mice, increased cellular AQP4 localization did not slow glymphatic function or change Aβ deposition. Using the Snta1 knockout line (which lacks perivascular AQP4 localization), we observed that loss AQP4 from perivascular endfeet slowed glymphatic function in wild type mice and accelerated Aβ plaque deposition in Tg2576 mice. These findings demonstrate that loss of perivascular AQP4 localization, and not increased cellular AQP4 localization, slows glymphatic function and promotes the development of AD pathology. To evaluate whether naturally occurring variation in the human AQP4 gene, or the alpha syntrophin (SNTA1), dystrobrevin (DTNA) or dystroglycan (DAG1) genes (whose products maintain perivascular AQP4 localization) confer risk for or protection from AD pathology or clinical progression, we evaluated 56 tag single nucleotide polymorphisms (SNPs) across these genes for association with CSF AD biomarkers, MRI measures of cortical and hippocampal atrophy, and longitudinal cognitive decline in the Alzheimer’s Disease Neuroimaging Initiative I (ADNI I) cohort. We identify 25 different significant associations between AQP4, SNTA1, DTNA, and DAG1 tag SNPs and phenotypic measures of AD pathology and progression. These findings provide complimentary human genetic evidence for the contribution of perivascular glymphatic dysfunction to the development of AD in human populations.
Ultrasound imaging in neuroscience
Encoding and perceiving the texture of sounds: auditory midbrain codes for recognizing and categorizing auditory texture and for listening in noise
Natural soundscapes such as from a forest, a busy restaurant, or a busy intersection are generally composed of a cacophony of sounds that the brain needs to interpret either independently or collectively. In certain instances sounds - such as from moving cars, sirens, and people talking - are perceived in unison and are recognized collectively as single sound (e.g., city noise). In other instances, such as for the cocktail party problem, multiple sounds compete for attention so that the surrounding background noise (e.g., speech babble) interferes with the perception of a single sound source (e.g., a single talker). I will describe results from my lab on the perception and neural representation of auditory textures. Textures, such as a from a babbling brook, restaurant noise, or speech babble are stationary sounds consisting of multiple independent sound sources that can be quantitatively defined by summary statistics of an auditory model (McDermott & Simoncelli 2011). How and where in the auditory system are summary statistics represented and the neural codes that potentially contribute towards their perception, however, are largely unknown. Using high-density multi-channel recordings from the auditory midbrain of unanesthetized rabbits and complementary perceptual studies on human listeners, I will first describe neural and perceptual strategies for encoding and perceiving auditory textures. I will demonstrate how distinct statistics of sounds, including the sound spectrum and high-order statistics related to the temporal and spectral correlation structure of sounds, contribute to texture perception and are reflected in neural activity. Using decoding methods I will then demonstrate how various low and high-order neural response statistics can differentially contribute towards a variety of auditory tasks including texture recognition, discrimination, and categorization. Finally, I will show examples from our recent studies on how high-order sound statistics and accompanying neural activity underlie difficulties for recognizing speech in background noise.
Expectation of self-generated sounds drives predictive processing in mouse auditory cortex
Sensory stimuli are often predictable consequences of one’s actions, and behavior exerts a correspondingly strong influence over sensory responses in the brain. Closed-loop experiments with the ability to control the sensory outcomes of specific animal behaviors have revealed that neural responses to self-generated sounds are suppressed in the auditory cortex, suggesting a role for prediction in local sensory processing. However, it is unclear whether this phenomenon derives from a precise movement-based prediction or how it affects the neural representation of incoming stimuli. We address these questions by designing a behavioral paradigm where mice learn to expect the predictable acoustic consequences of a simple forelimb movement. Neuronal recordings from auditory cortex revealed suppression of neural responses that was strongest for the expected tone and specific to the time of the sound-associated movement. Predictive suppression in the auditory cortex was layer-specific, preceded by the arrival of movement information, and unaffected by behavioral relevance or reward association. These findings illustrate that expectation, learned through motor-sensory experience, drives layer-specific predictive processing in the mouse auditory cortex.
Imperial Neurotechnology 2021 - Annual Research Symposium
A diverse mix of neurotechnology talks from academic and industry colleagues plus presentations from our MRes Neurotechnology students. Visit our event page to find out more and register now!
The emergence of a ‘V1 like’ structure for soundscapes representing vision in the adult brain in the absence of visual experience
The neural mechanisms for song evaluation in fruit flies
How does the brain decode the meaning of sound signals, such as music and courtship songs? We believe that the fruit fly Drosophila melanogaster is an ideal model for answering this question, as it offers a comprehensive range of tools and assays which allow us to dissect the mechanisms underlying sound perception and evaluation in the brain. During the courtship behavior, male fruit flies emit “courtship songs” by vibrating their wings. Interestingly, the fly song has a species-specific rhythm, which indeed increases the female’s receptivity for copulation as well as male’s courtship behavior itself. How song signals, especially the species-specific sound rhythm, are evaluated in the fly brain? To tackle this question, we are exploring the features of the fly auditory system systematically. In this lecture, I will talk about our recent findings on the neural basis for song evaluation in fruit flies.
Direction selectivity in hearing: monaural phase sensitivity in octopus neurons
The processing of temporal sound features is fundamental to hearing, and the auditory system displays a plethora of specializations, at many levels, to enable such processing. Octopus neurons are the most extreme temporally-specialized cells in the auditory (and perhaps entire) brain, which make them intriguing but also difficult to study. Notwithstanding the scant physiological data, these neurons have been a favorite cell type of modeling studies which have proposed that octopus cells have critical roles in pitch and speech perception. We used a range of in vivo recording and labeling methods to examine the hypothesis that tonotopic ordering of cochlear afferents combines with dendritic delays to compensate for cochlear delay - which would explain the highly entrained responses of octopus cells to sound transients. Unexpectedly, the experiments revealed that these neurons have marked selectivity to the direction of fast frequency glides, which is tied in a surprising way to intrinsic membrane properties and subthreshold events. The data suggest that octopus cells have a role in temporal comparisons across frequency and may play a role in auditory scene analysis.
Dynamics of the mouse auditory cortex and the perception of sound
The recent history of the replication crisis in psychology & how Open Science can be part of the solution
In recent years, more and more evidence has accumulated showing that many studies in psychological research cannot be replicated, effects are often overestimated, and little is publicly known about unsuccessful studies. What are the mechanisms behind this crisis? In this talk, I will explain how we got there and why it is still difficult to break free from the current system. I will further explain which role Open Science plays within the replication crisis and how it can help to improve science. This might sound like a pessimistic, negative talk, but I will end it on a positive note, I promise!
Acoustically Levitated Granular Matter
Granular matter can serve as a prototype for exploring the rich physics of many-body systems driven far from equilibrium. This talk will outline a new direction for granular physics with macroscopic particles, where acoustic levitation compensates the forces due to gravity and eliminates frictional interactions with supporting surfaces in order to focus on particle interactions. Levitating small particles by intense ultrasound fields in air makes it possible to manipulate and control their positions and assemble them into larger aggregates. The small air viscosity implies that the regime of underdamped dynamics can be explored, where inertial effects are important, in contrast to typical colloids in a liquid, where inertia can be neglected. Sound scattered off individual, levitated solid particles gives rise to controllable attractive forces with neighboring particles. I will discuss some of the key concepts underlying acoustic levitation, describe how detuning an acoustic cavity can introduce active fluctuations that control the assembly statistics of small levitated particles clusters, and give examples of how interactions between neighboring levitated objects can be controlled by their shape.
Distinct forms of cortical plasticity underlie difficulties to reliably detect sounds in noisy environments"; "Acoustic context modulates natural sound discrimination in auditory cortex through frequency specific adaptation
Sounds Familiar? Statistical Learning of Acoustic Environments
Cortical filtering of self-generated sounds in health and disease
Neural Mechanisms of Coordination in Duetting Wrens
To communicate effectively, two individuals must take turns to prevent overlap in their signals. How does the nervous system coordinate vocalizations between two individuals? Female and male plain-tailed wrens sing a duet in which they alternate syllable production so rapidly and precisely it sounds as if a single bird is singing. I will talk about experiments that examine the interaction between sensory cues and motor activity, using behavioral manipulations and neurophysiological recordings from pairs of awake, duetting wrens. I will show evidence that auditory cues link the brains of the wrens by modulating motor circuits.
Contextual effects in the representation of complex sounds: from the inferior colliculus to higher-order cortical fields
Bridging scales – combining functional ultrasound imaging, optogenetics, and electrophysiology to study neuronal networks underlying behavior
Plasticity in hypothalamic circuits for oxytocin release
Mammalian babies are “sensory traps” for parents. Various sensory cues from the newborn are tremendously efficient in triggering parental responses in caregivers. We recently showed that core aspects of maternal behavior such as pup retrieval in response to infant vocalizations rely on active learning of auditory cues from pups facilitated by the neurohormone oxytocin (OT). Release of OT from the hypothalamus might thus help induce recognition of different infant cues but it is unknown what sensory stimuli can activate OT neurons. I performed unprecedented in vivo whole-cell and cell-attached recordings from optically-identified OT neurons in awake dams. I found that OT neurons, but not other hypothalamic cells, increased their firing rate after playback of pup distress vocalizations. Using anatomical tracing approaches and channelrhodopsin-assisted circuit mapping, I identified the projections and brain areas (including inferior colliculus, auditory cortex, and posterior intralaminar thalamus) relaying auditory information about social sounds to OT neurons. In hypothalamic brain slices, when optogenetically stimulating thalamic afferences to mimic high-frequency thalamic discharge, observed in vivo during pup calls playback, I found that thalamic activity led to long-term depression of synaptic inhibition in OT neurons. This was mediated by postsynaptic NMDARs-induced internalization of GABAARs. Therefore, persistent activation of OT neurons following pup calls in vivo is likely mediated by disinhibition. This gain modulation of OT neurons by infant cries, may be important for sustaining motivation. Using a genetically-encoded OT sensor, I demonstrated that pup calls were efficient in triggering OT release in downstream motivational areas. When thalamus projections to hypothalamus were inhibited with chemogenetics, dams exhibited longer latencies to retrieve crying pups, suggesting that the thalamus-hypothalamus noncanonical auditory pathway may be a specific circuit for the detection of social sounds, important for disinhibiting OT neurons, gating OT release in downstream brain areas, and speeding up maternal behavior.
Monkey Talk – what studies about nonhuman primate vocal communication reveal about the evolution of speech
The evolution of speech is considered to be one of the hardest problems in science. Studies of the communicative abilities of our closest living relatives, the nonhuman primates, aim to contribute to a better understanding of the emergence of this uniquely human capability. Following a brief introduction over the key building blocks that make up the human speech faculty, I will focus on the question of meaning in nonhuman primate vocalizations. While nonhuman primate calls may be highly context specific, thus giving rise to the notion of ‘referentiality’, comparisons across closely related species suggest that this specificity is evolved rather than learned. Yet, as in humans, the structure of calls varies with arousal and affective state, and there is some evidence for effects of sensory-motor integration in vocal production. Thus, the vocal production of nonhuman primates bears little resemblance to the symbolic and combinatorial features of human speech, while basic production mechanisms are shared. Listeners, in contrast, are able learning the meaning of new sounds. A recent study using artificial predator shows that this learning may be extremely rapid. Furthermore, listeners are able to integrate information from multiple sources to make adaptive decisions, which renders the vocal communication system as a whole relatively flexible and powerful. In conclusion, constraints at the side of vocal production, including limits in social cognition and motivation to share experiences, rather than constraints at the side of the recipient explain the differences in communicative abilities between humans and other animals.
Common developmental mechanisms underlie multiple brain disorders linked to corpus callosum dysgenesis. (Simultaneous translation to Spanish)
The corpus callosum is the largest fibre tract in the brain of placental mammals and connects the two cerebral hemispheres. Corpus callosum dysgenesis is a developmental brain disorder that is commonly genetic and occurs in approximately 1:4000 live births. It is easily diagnosed by MRI or prenatal ultrasound and is found in isolation or together with other brain anomalies, or with other organ system defects in a large number of different congenital syndromes. Callosal dysgenesis is a structural brain wiring disorder that can impact brain function and cognition in heterogeneous ways. We aim to understand how early developmental mechanisms lead to circuit alterations that ultimately impact behaviour and cognition. Translated to Spanish by MD and Medical interpreter Trinidad Ott. El cuerpo calloso es el tracto de fibras más grande del cerebro de los mamíferos placentarios y conecta los dos hemisferios cerebrales. La disgenesia del cuerpo calloso es un trastorno del desarrollo del cerebro que comunmente es genético y ocurre en aproximadamente 1: 4000 nacidos vivos. Se diagnostica fácilmente mediante resonancia magnética o ecografía prenatal y se encuentra aislado o junto con otras anomalías cerebrales, o con otros defectos del sistema de órganos en un gran número de síndromes congénitos diferentes. La disgenesia callosa es un trastorno estructural del cableado cerebral que puede afectar la función cerebral y la cognición de formas heterogéneas. Nuestro objetivo es comprender cómo los primeros mecanismos del desarrollo conducen a alteraciones en los circuitos que, en última instancia, afectan el comportamiento y la cognición. Traducción al español por la Doctora e Intérprete Médica Trinidad Ott.
Motor Cortical Control of Vocal Interactions in a Neotropical Singing Mouse
Using sounds for social interactions is common across many taxa. Humans engaged in conversation, for example, take rapid turns to go back and forth. This ability to act upon sensory information to generate a desired motor output is a fundamental feature of animal behavior. How the brain enables such flexible sensorimotor transformations, for example during vocal interactions, is a central question in neuroscience. Seeking a rodent model to fill this niche, we are investigating neural mechanisms of vocal interaction in Alston’s singing mouse (Scotinomys teguina) – a neotropical rodent native to the cloud forests of Central America. We discovered sub-second temporal coordination of advertisement songs (counter-singing) between males of this species – a behavior that requires the rapid modification of motor outputs in response to auditory cues. We leveraged this natural behavior to probe the neural mechanisms that generate and allow fast and flexible vocal communication. Using causal manipulations, we recently showed that an orofacial motor cortical area (OMC) in this rodent is required for vocal interactions (Okobi*, Banerjee* et. al, 2019). Subsequently, in electrophysiological recordings, I find neurons in OMC that track initiation, termination and relative timing of songs. Interestingly, persistent neural dynamics during song progression stretches or compresses on every trial to match the total song duration (Banerjee et al, in preparation). These results demonstrate robust cortical control of vocal timing in a rodent and upends the current dogma that motor cortical control of vocal output is evolutionarily restricted to the primate lineage.
The active modulation of sound and vibration perception
The dominant view of perception right now is that information travels from the environment to the sensory system, then to the nervous systems which processes it to generate a percept and behaviour. Ongoing behaviour is thought to occur largely through simple iterations of this process. However, this linear view, where information flows only in one direction and the properties of the environment and the sensory system remain static and unaffected by behaviour, is slowly fading. Many of us are beginning to appreciate that perception is largely active, i.e. that information flows back and forth between the three systems modulating their respective properties. In other words, in the real world, the environment and sensorimotor loop is pretty much always closed. I study the loop; in particular I study how the reverse arm of the loop affects sound and vibration perception. I will present two examples of motor modulation of perception at two very different temporal and spatial scales. First, in crickets, I will present data on how high-speed molecular motor activity enhances hearing via the well-studied phenomenon of active amplification. Second, in spiders I will present data on how body posture, a slow macroscopic feature, which can barely be called ‘active’, can nonetheless modulate vibration perception. I hope these results will motivate a conversation about whether ‘active’ perception is an optional feature observed in some sensory systems, or something that is ultimately necessitated by both evolution and physics.
Cortical adaptation to sound reverberation
COSYNE 2022
Mechanisms of plasticity for pup call sounds in the maternal auditory cortex
COSYNE 2022
Mechanisms of plasticity for pup call sounds in the maternal auditory cortex
COSYNE 2022
Natural sound characteristics explain perceptual categorization
COSYNE 2022
Natural sound characteristics explain perceptual categorization
COSYNE 2022
Transformation of population representations of sounds throughout the auditory system
COSYNE 2022
Transformation of population representations of sounds throughout the auditory system
COSYNE 2022
Function of cortical NDNF interneurons in sound frequency discrimination
COSYNE 2023
Normative modeling of auditory memory for natural sounds
COSYNE 2023
Targeted single-cell ablation uncovers network homeostasis of sound representations in mouse cortex
COSYNE 2023
Auditory cortical manifold for natural soundscapes enables neurally aligned category decoding
COSYNE 2025
Instinct vs Insight: Neural Competition Between Prefrontal and Auditory Cortex Constrains Sound Strategy Learning
COSYNE 2025
Studying sensory statistics and priors during sound categorisation in head-fixed mice
COSYNE 2025
Advancing in-vivo brain vasculature imaging: Super-resolution 3D ultrasound localization microscopy of the mouse brain and in non-human primate using RCA probes
FENS Forum 2024
Ambient sound stimulation regulates radial growth of myelin and tunes axonal conduction velocity in the auditory pathway
FENS Forum 2024
Auditory cortex activity during sound memory retention in an auditory working memory task
FENS Forum 2024
Brain-wide effects of cannabinoids, measured by functional ultrasound imaging, show strong correlation with CB1R activation and behavior in awake mice
FENS Forum 2024
Carbon-based neural interfaces to probe retinal and cortical circuits with functional ultrasound imaging in vivo
FENS Forum 2024
Characterization of transcranial focused ultrasound stimulation using calcium imaging with fiber photometry in mice
FENS Forum 2024
Characterizing sound-localization deficits in a mouse model of spinocerebellar ataxia type 13 (SCA13)
FENS Forum 2024
A computational model of the mammalian brainstem to solve sound localization
FENS Forum 2024
Are cortical columns ubiquitous? High-resolution identification of functional domains in cat cortex using 3D functional ultrasound imaging
FENS Forum 2024
Designing a transmodal technology to feel sound through touch: The multichannel vibrotactile gloves
FENS Forum 2024
Developmental fine-tuning of medial superior olive neurons mitigates their predisposition to contralateral sound sources
FENS Forum 2024
The effects of 40Hz ultrasound stimulation on neuronal function
FENS Forum 2024
Enhancement of cerebrospinal fluid movement by transcranial focused ultrasound stimulation
FENS Forum 2024
fMRI mapping of brain circuits during simple sound perception by awake rats
FENS Forum 2024
Frequency tagging in the sensorimotor cortex is enhanced by footstep sounds compared to visual information movement in a walking movement integration task
FENS Forum 2024
Functional ultrasound mapping of large-scale connectivity networks in the mouse brain
FENS Forum 2024
Functional ultrasound is able to detect music therapy-induced functional connectivity changes in neonates
FENS Forum 2024
High precision ultrasound stimulation of the retina with photoacoustic membrane
FENS Forum 2024
High-resolution 3D mapping of cat visual cortex using functional ultrasound imaging
FENS Forum 2024
Hippocampus-cortex communication and global brain hemodynamics during hippocampal ripples observed with functional ultrasound imaging
FENS Forum 2024
Lateralization of motor responses following focused ultrasound neuromodulation of the motor cortex and thalamus in awake mice
FENS Forum 2024
Longitudinal study of delayed cerebral ischemia in mice using daily functional ultrasound (fUS) imaging and gait analysis
FENS Forum 2024
Low-intensity repetitive pulsed ultrasound stimulation suppresses neural activity via effects on astrocytes
FENS Forum 2024
Massive impact of anesthesia on sound representations in the auditory brainstem
FENS Forum 2024
Modeling and inference of brain functional connectivity networks in the Shank2 mouse model of autism using functional ultrasound
FENS Forum 2024
Neural correlates of sound-localization deficits associated with spinocerebellar ataxia type 13 (SCA13)
FENS Forum 2024
Neural signatures of learning and exploiting sensory statistics in a sound categorisation task in rats
FENS Forum 2024