sensorimotor control, mouvement, touch, EEG

Traditionally, touch is associated with exteroception and is rarely considered a relevant sensory cue for controlling movements in space, unlike vision. We developed a technique to isolate and measure tactile involvement in controlling sliding finger movements over a surface. Young adults traced a 2D shape with their index finger under direct or mirror-reversed visual feedback to create a conflict between visual and somatosensory inputs. In this context, increased reliance on somatosensory input compromises movement accuracy. Based on the hypothesis that tactile cues contribute to guiding hand movements when in contact with a surface, we predicted poorer performance when the participants traced with their bare finger compared to when their tactile sensation was dampened by a smooth, rigid finger splint. The results supported this prediction. EEG source analyses revealed smaller current in the source-localized somatosensory cortex during sensory conflict when the finger directly touched the surface. This finding supports the hypothesis that, in response to mirror-reversed visual feedback, the central nervous system selectively gated task-irrelevant somatosensory inputs, thereby mitigating, though not entirely resolving, the visuo-somatosensory conflict. Together, our results emphasize touch’s involvement in movement control over a surface, challenging the notion that vision predominantly governs goal-directed hand or finger movements.

Prof. Alessandro D'Ausilio

Human communication is a complex and multifaceted phenomenon in which language represents the most evolved and versatile interactive behavior. Language is multipurpose, allows for the expression of desires and internal states, is based on a shared, specific, and ultra-compressed code, and enables creative communication of higher forms of representation. At the same time, a significant part of the information exchange that takes place between people, is conveyed by body movements. Indeed, we have shown that body movements convey implicit sub-symbolic coordinative signals on multiple scales, which are nevertheless essential for interaction. In this framework, the motor system acts as a filter/classifier of other peoples' actions, as human movements are characterized by invariants, arising from neural and biomechanical constraints. The observer is not naive about these regularities. In fact, each of us implicitly learns these regularities in the course of development and exploits this knowledge to support smooth interpersonal coordination. This means that natural communication is inherently multimodal and sensorimotor. The action-perception circuit mediates sensorimotor communication and causes automatic and implicit reciprocal behavioral coadaptation during interaction. Importantly, in addition to movement regularities, we recently demonstrated that a small but systematic degree of variability characterizes individual motor actions (Individual Motor Signatures – IMS). The study of IMS opens up important new lines of research, both theoretical and applied. On the one hand, this framework allows us to study the computational mechanism that enables decoding of others' action and making sensorimotor coordination smooth; on the other hand, it helps us progress toward an individual-level quantitative neuroscience.

Neural mechanisms of rhythmic motor control in Drosophila

All animal locomotion is rhythmic,whether it is achieved through undulatory movement of the whole body or the coordination of articulated limbs. Neurobiologists have long studied locomotor circuits that produce rhythmic activity with non-rhythmic input, also called central pattern generators (CPGs). However, the cellular and microcircuit implementation of a walking CPG has not been described for any limbed animal. New comprehensive connectomes of the fruit fly ventral nerve cord (VNC) provide an opportunity to study rhythmogenic walking circuits at a synaptic scale.We use a data-driven network modeling approach to identify and characterize a putative walking CPG in the Drosophila leg motor system.

Examining dexterous motor control in children born with a below elbow deficiency

Vision for perception versus vision for action: dissociable contributions of visual sensory drives from primary visual cortex and superior colliculus neurons to orienting behaviors

The primary visual cortex (V1) directly projects to the superior colliculus (SC) and is believed to provide sensory drive for eye movements. Consistent with this, a majority of saccade-related SC neurons also exhibit short-latency, stimulus-driven visual responses, which are additionally feature-tuned. However, direct neurophysiological comparisons of the visual response properties of the two anatomically-connected brain areas are surprisingly lacking, especially with respect to active looking behaviors. I will describe a series of experiments characterizing visual response properties in primate V1 and SC neurons, exploring feature dimensions like visual field location, spatial frequency, orientation, contrast, and luminance polarity. The results suggest a substantial, qualitative reformatting of SC visual responses when compared to V1. For example, SC visual response latencies are actively delayed, independent of individual neuron tuning preferences, as a function of increasing spatial frequency, and this phenomenon is directly correlated with saccadic reaction times. Such “coarse-to-fine” rank ordering of SC visual response latencies as a function of spatial frequency is much weaker in V1, suggesting a dissociation of V1 responses from saccade timing. Consistent with this, when we next explored trial-by-trial correlations of individual neurons’ visual response strengths and visual response latencies with saccadic reaction times, we found that most SC neurons exhibited, on a trial-by-trial basis, stronger and earlier visual responses for faster saccadic reaction times. Moreover, these correlations were substantially higher for visual-motor neurons in the intermediate and deep layers than for more superficial visual-only neurons. No such correlations existed systematically in V1. Thus, visual responses in SC and V1 serve fundamentally different roles in active vision: V1 jumpstarts sensing and image analysis, but SC jumpstarts moving. I will finish by demonstrating, using V1 reversible inactivation, that, despite reformatting of signals from V1 to the brainstem, V1 is still a necessary gateway for visually-driven oculomotor responses to occur, even for the most reflexive of eye movement phenomena. This is a fundamental difference from rodent studies demonstrating clear V1-independent processing in afferent visual pathways bypassing the geniculostriate one, and it demonstrates the importance of multi-species comparisons in the study of oculomotor control.

Cell-type-specific plasticity shapes neocortical dynamics for motor learning

How do cortical circuits acquire new dynamics that drive learned movements? This webinar will focus on mouse premotor cortex in relation to learned lick-timing and explore high-density electrophysiology using our silicon neural probes alongside region and cell-type-specific acute genetic manipulations of proteins required for synaptic plasticity.

Predictive processing in older adults: How does it shape perception and sensorimotor control?

Movement planning as a window into hierarchical motor control

The ability to organise one's body for action without having to think about it is taken for granted, whether it is handwriting, typing on a smartphone or computer keyboard, tying a shoelace or playing the piano. When compromised, e.g. in stroke, neurodegenerative and developmental disorders, the individuals’ study, work and day-to-day living are impacted with high societal costs. Until recently, indirect methods such as invasive recordings in animal models, computer simulations, and behavioural markers during sequence execution have been used to study covert motor sequence planning in humans. In this talk, I will demonstrate how multivariate pattern analyses of non-invasive neurophysiological recordings (MEG/EEG), fMRI, and muscular recordings, combined with a new behavioural paradigm, can help us investigate the structure and dynamics of motor sequence control before and after movement execution. Across paradigms, participants learned to retrieve and produce sequences of finger presses from long-term memory. Our findings suggest that sequence planning involves parallel pre-ordering of serial elements of the upcoming sequence, rather than a preparation of a serial trajectory of activation states. Additionally, we observed that the human neocortex automatically reorganizes the order and timing of well-trained movement sequences retrieved from memory into lower and higher-level representations on a trial-by-trial basis. This echoes behavioural transfer across task contexts and flexibility in the final hundreds of milliseconds before movement execution. These findings strongly support a hierarchical and dynamic model of skilled sequence control across the peri-movement phase, which may have implications for clinical interventions.

Controlling the present while planning the future: How the brain learns and produces fast motor sequences

Motor sequencing is one of the fundamental components of human motor skill. In this talk I will show evidence that the fast and smooth production of motor sequences relies on the ability to plan upcoming movements while simultaneously controlling the ongoing movement. I will argue that this ability relies heavily on planning-related areas in premotor and parietal cortex.

Dyskinesia: the failure of dopamine-dependent motor control

Cortex-dependent corrections as the mouse tongue reaches for and misses targets

Brendan Ito (Cornell University, USA) and Teja Bollu (Salk Institute, USA) share unique insights into rapid online motor corrections during mouse licking, analogous to primate goal-oriented reaching. Techniques covered include large-scale single unit recording during behaviour with optogenetics, and a deep-learning-based neural network to resolve 3D tongue kinematics during licking.

Sensing in Insect Wings

Ali Weber (University of Washington, USA) uses the the hawkmoth as a model system, to investigate how information from a small number of mechanoreceptors on the wings are used in flight control. She employs a combination of experimental and computational techniques to study how these sensors respond during flight and how one might optimally array a set of these sensors to best provide feedback during flight.

Machine learning for measuring and modeling the motor system

Measuring and modeling behavior to decode sensorimotor control

Neural Population Dynamics for Skilled Motor Control

The ability to reach, grasp, and manipulate objects is a remarkable expression of motor skill, and the loss of this ability in injury, stroke, or disease can be devastating. These behaviors are controlled by the coordinated activity of tens of millions of neurons distributed across many CNS regions, including the primary motor cortex. While many studies have characterized the activity of single cortical neurons during reaching, the principles governing the dynamics of large, distributed neural populations remain largely unknown. Recent work in primates has suggested that during the execution of reaching, motor cortex may autonomously generate the neural pattern controlling the movement, much like the spinal central pattern generator for locomotion. In this seminar, I will describe recent work that tests this hypothesis using large-scale neural recording, high-resolution behavioral measurements, dynamical systems approaches to data analysis, and optogenetic perturbations in mice. We find, by contrast, that motor cortex requires strong, continuous, and time-varying thalamic input to generate the neural pattern driving reaching. In a second line of work, we demonstrate that the cortico-cerebellar loop is not critical for driving the arm towards the target, but instead fine-tunes movement parameters to enable precise and accurate behavior. Finally, I will describe my future plans to apply these experimental and analytical approaches to the adaptive control of locomotion in complex environments.

Understanding neural dynamics in high dimensions across multiple timescales: from perception to motor control and learning

Remarkable advances in experimental neuroscience now enable us to simultaneously observe the activity of many neurons, thereby providing an opportunity to understand how the moment by moment collective dynamics of the brain instantiates learning and cognition. However, efficiently extracting such a conceptual understanding from large, high dimensional neural datasets requires concomitant advances in theoretically driven experimental design, data analysis, and neural circuit modeling. We will discuss how the modern frameworks of high dimensional statistics and deep learning can aid us in this process. In particular we will discuss: (1) how unsupervised tensor component analysis and time warping can extract unbiased and interpretable descriptions of how rapid single trial circuit dynamics change slowly over many trials to mediate learning; (2) how to tradeoff very different experimental resources, like numbers of recorded neurons and trials to accurately discover the structure of collective dynamics and information in the brain, even without spike sorting; (3) deep learning models that accurately capture the retina’s response to natural scenes as well as its internal structure and function; (4) algorithmic approaches for simplifying deep network models of perception; (5) optimality approaches to explain cell-type diversity in the first steps of vision in the retina.

Prof. Humphries reads from "The Spike" 📖

We see the last cookie in the box and think, can I take that? We reach a hand out. In the 2.1 seconds that this impulse travels through our brain, billions of neurons communicate with one another, sending blips of voltage through our sensory and motor regions. Neuroscientists call these blips “spikes.” Spikes enable us to do everything: talk, eat, run, see, plan, and decide. In The Spike, Mark Humphries takes readers on the epic journey of a spike through a single, brief reaction. In vivid language, Humphries tells the story of what happens in our brain, what we know about spikes, and what we still have left to understand about them. Drawing on decades of research in neuroscience, Humphries explores how spikes are born, how they are transmitted, and how they lead us to action. He dives into previously unanswered mysteries: Why are most neurons silent? What causes neurons to fire spikes spontaneously, without input from other neurons or the outside world? Why do most spikes fail to reach any destination? Humphries presents a new vision of the brain, one where fundamental computations are carried out by spontaneous spikes that predict what will happen in the world, helping us to perceive, decide, and react quickly enough for our survival. Traversing neuroscience’s expansive terrain, The Spike follows a single electrical response to illuminate how our extraordinary brains work.

Reverse-engineering Drosophila motor control

Sensory-motor control, cognition and brain evolution: exploring the links

Drawing on recent findings from evolutionary anthropology and neuroscience, professor Barton will lead us through the amazing story of the evolution of human cognition. Usingstatistical, phylogenetic analyses that tease apart the variation associated with different neural systems and due to different selection pressures, he will be addressing intriguing questions like ‘Why are there so many neurons in the cerebellum?’, ‘Is the neocortex the ‘intelligent’ bit of the brain?’, and ‘What explains that the recognition by humans of emotional expressions is disrupted by trancranial magnetic stimulation of the somatosensory cortex?’ Could, as professor Barton suggests, the cerebellum -modestly concealed beneath the volumetrically dominating neocortex and largely ignored- turn out to be the Cinderella of the study of brain evolution?

Understanding sensorimotor control at global and local scales

The brain is remarkably flexible, and appears to instantly reconfigure its processing depending on what’s needed to solve a task at hand: fMRI studies indicate that distal brain areas appear to fluidly couple and decouple with one another depending on behavioral context. But the structural architecture of the brain is comprised of long-range axonal projections that are relatively fixed by adulthood. How does the global dynamism evident in fMRI recordings manifest at a cellular level? To bridge the gap between the activity of single neurons and cortex-wide networks, we correlated electrophysiological recordings of individual neurons in primary visual (V1) and retrosplenial (RSP) associational cortex with activity across dorsal cortex, recorded simultaneously using widefield calcium imaging. We found that individual neurons in both cortical areas independently engaged in different distributed cortical networks depending on the animal’s behavioral state, suggesting that locomotion puts cortex into a more sensory driven mode relevant for navigation.

Recurrent problems in spinal-cord and cerebellar circuits

One of the best established recurrent inhibitory pathways is the recurrent inhibition of mammalian motoneurons through Renshaw cells. Golgi cells form an inhibitory feedback circuit in the granular layer of cerebellum. Feedback inhibitory pathways are long established “textbook” elements of neural circuitry, but in both cases their functional role has not been well established. Here I will present some new observations on the function of recurrent inhibition in the spinal-cord, supporting the idea that this connection frequency tunes transmission of inputs through motoneurons. Secondly, I will discuss evidence that the function of Golgi cells is much more complex than classical studies based on circuit connectivity suggest.

Simons-Emory Workshop on Neural Dynamics: What could neural dynamics have to say about neural computation, and do we know how to listen?

Speakers will deliver focused 10-minute talks, with periods reserved for broader discussion on topics at the intersection of neural dynamics and computation. Organizer & Moderator: Chethan Pandarinath - Emory University and Georgia Tech Speakers & Discussants: Adrienne Fairhall - U Washington Mehrdad Jazayeri - MIT John Krakauer - John Hopkins Francesca Mastrogiuseppe - Gatsby / UCL Abigail Person - U Colorado Abigail Russo - Princeton Krishna Shenoy - Stanford Saurabh Vyas - Columbia

Theoretical and computational approaches to neuroscience with complex models in high dimensions across multiple timescales: from perception to motor control and learning

Remarkable advances in experimental neuroscience now enable us to simultaneously observe the activity of many neurons, thereby providing an opportunity to understand how the moment by moment collective dynamics of the brain instantiates learning and cognition.  However, efficiently extracting such a conceptual understanding from large, high dimensional neural datasets requires concomitant advances in theoretically driven experimental design, data analysis, and neural circuit modeling.  We will discuss how the modern frameworks of high dimensional statistics and deep learning can aid us in this process.  In particular we will discuss: how unsupervised tensor component analysis and time warping can extract unbiased and interpretable descriptions of how rapid single trial circuit dynamics change slowly over many trials to mediate learning; how to tradeoff very different experimental resources, like numbers of recorded neurons and trials to accurately discover the structure of collective dynamics and information in the brain, even without spike sorting; deep learning models that accurately capture the retina’s response to natural scenes as well as its internal structure and function; algorithmic approaches for simplifying deep network models of perception; optimality approaches to explain cell-type diversity in the first steps of vision in the retina.

Towards a speech neuroprosthesis

I will review advances in understanding the cortical encoding of speech-related oral movements. These discoveries are being translated to develop algorithms to decode speech from population neural activity.

Neural Population Perspectives on Learning and Motor Control

Learning is a population phenomenon. Since it is the organized activity of populations of neurons that cause movement, learning a new skill must involve reshaping those population activity patterns. Seeing how the brain does this has been elusive, but a brain-computer interface approach can yield new insight. We presented monkeys with novel BCI mappings that we knew would be difficult for them to learn how to control. Over several days, we observed the emergence of new patterns of neural activity that endowed the animals with the ability to perform better at the BCI task. We speculate that there also exists a direct relationship between new patterns of neural activity and new abilities during natural movements, but it is much harder to see in that setting.

Understanding sensorimotor control at global and local scales

The brain is remarkably flexible, and appears to instantly reconfigure its processing depending on what’s needed to solve a task at hand: fMRI studies indicate that distal brain areas appear to fluidly couple and decouple with one another depending on behavioral context. We investigated how the brain coordinates its activity across areas to inform complex, top-down control behaviors. Animals were trained to perform a novel brain machine interface task to guide a visual cursor to a reward zone, using activity recorded with widefield calcium imaging. This allowed us to screen for cortical areas implicated in causal neural control of the visual object. Animals could decorrelate normally highly-correlated areas to perform the task, and used an explore-exploit search in neural activity space to discover successful strategies. Higher visual and parietal areas were more active during the task in expert animals. Single unit recordings targeted to these areas indicated that the sensory representation of an object was sensitive to an animal’s subjective sense of controlling it.

An interdisciplinary perspective on motor augmentation from neuroscience and design

By studying the neural correlates of hand augmentation, we are exploring the boundaries of neuroplasticity seeing how it can be harnessed to improve the usability and control of prosthetic devices. Tamar Makin and Dani Clode each discuss their research and perspectives within the field of prosthetics that has led to this unique collaboration and exploration of motor augmentation and the brain.

Leveraging neural manifolds to advance brain-computer interfaces

Brain-computer interfaces (BCIs) have afforded paralysed users “mental control” of computer cursors and robots, and even of electrical stimulators that reanimate their own limbs. Most existing BCIs map the activity of hundreds of motor cortical neurons recorded with implanted electrodes into control signals to drive these devices. Despite these impressive advances, the field is facing a number of challenges that need to be overcome in order for BCIs to become widely used during daily living. In this talk, I will focus on two such challenges: 1) having BCIs that allow performing a broad range of actions; and 2) having BCIs whose performance is robust over long time periods. I will present recent studies from our group in which we apply neuroscientific findings to address both issues. This research is based on an emerging view about how the brain works. Our proposal is that brain function is not based on the independent modulation of the activity of single neurons, but rather on specific population-wide activity patters —which mathematically define a “neural manifold”. I will provide evidence in favour of such a neural manifold view of brain function, and illustrate how advances in systems neuroscience may be critical for the clinical success of BCIs.

Motor Cortical Control of Vocal Interactions in a Neotropical Singing Mouse

Using sounds for social interactions is common across many taxa. Humans engaged in conversation, for example, take rapid turns to go back and forth. This ability to act upon sensory information to generate a desired motor output is a fundamental feature of animal behavior. How the brain enables such flexible sensorimotor transformations, for example during vocal interactions, is a central question in neuroscience. Seeking a rodent model to fill this niche, we are investigating neural mechanisms of vocal interaction in Alston’s singing mouse (Scotinomys teguina) – a neotropical rodent native to the cloud forests of Central America. We discovered sub-second temporal coordination of advertisement songs (counter-singing) between males of this species – a behavior that requires the rapid modification of motor outputs in response to auditory cues. We leveraged this natural behavior to probe the neural mechanisms that generate and allow fast and flexible vocal communication. Using causal manipulations, we recently showed that an orofacial motor cortical area (OMC) in this rodent is required for vocal interactions (Okobi*, Banerjee* et. al, 2019). Subsequently, in electrophysiological recordings, I find neurons in OMC that track initiation, termination and relative timing of songs. Interestingly, persistent neural dynamics during song progression stretches or compresses on every trial to match the total song duration (Banerjee et al, in preparation). These results demonstrate robust cortical control of vocal timing in a rodent and upends the current dogma that motor cortical control of vocal output is evolutionarily restricted to the primate lineage.

Neural and computational principles of the processing of dynamic faces and bodies

Body motion is a fundamental signal of social communication. This includes facial as well as full-body movements. Combining advanced methods from computer animation with motion capture in humans and monkeys, we synthesized highly-realistic monkey avatar models. Our face avatar is perceived by monkeys as almost equivalent to a real animal, and does not induce an ‘uncanny valley effect’, unlike all other previously used avatar models in studies with monkeys. Applying machine-learning methods for the control of motion style, we were able to investigate how species-specific shape and dynamic cues influence the perception of human and monkey facial expressions. Human observers showed very fast learning of monkey expressions, and a perceptual encoding of expression dynamics that was largely independent of facial shape. This result is in line with the fact that facial shape evolved faster than the neuromuscular control in primate phylogenesis. At the same time, it challenges popular neural network models of the recognition of dynamic faces that assume a joint encoding of facial shape and dynamics. We propose an alternative physiologically-inspired neural model that realizes such an orthogonal encoding of facial shape and expression from video sequences. As second example, we investigated the perception of social interactions from abstract stimuli, similar to the ones by Heider & Simmel (1944), and also from more realistic stimuli. We developed and validated a new generative model for the synthesis of such social interaction, which is based on a modification of human navigation model. We demonstrate that the recognition of such stimuli, including the perception of agency, can be accounted for by a relatively elementary physiologically-inspired hierarchical neural recognition model, that does not require the assumption of sophisticated inference mechanisms, as postulated by some cognitive theories of social recognition. Summarizing, this suggests that essential phenomena in social cognition might be accounted for by a small set of simple neural principles that can be easily implemented by cortical circuits. The developed technologies for stimulus control form the basis of electrophysiological studies that can verify specific neural circuits, as the ones proposed by our theoretical models.

Neural mechanisms of proprioception and motor control in Drosophila

Animals rely on an internal sense of body position and movement to effectively control motor behaviour. This sense of proprioception is mediated by diverse populations of internal mechanosensory neurons distributed throughout the body. My lab is trying to understand how proprioceptive stimuli are detected by sensory neurons, integrated and transformed in central circuits, and used to guide motor output. We approach these questions using genetic tools, in vivo two-photon imaging, and patch-clamp electrophysiology in Drosophila. We recently found that the axons of fly leg proprioceptors are organized into distinct functional projections that contain topographic representations of specific kinematic features: one group of axons encodes tibia position, another encodes movement direction, and a third encodes bidirectional movement and vibration frequency. Whole-cell recordings from downstream neurons reveal that position, movement, and directional information remain segregated in central circuits. These feedback signals then converge upon motor neurons that control leg muscles during walking. Overall, our findings reveal how a low-dimensional stimulus – the angle of a single leg joint – is encoded by a diverse population of mechanosensory neurons. Specific proprioceptive parameters are initially processed by parallel pathways, but are ultimately integrated to influence motor output. This architecture may help to maximize information transmission, processing speed, and robustness, which are critical for feedback control of the limbs during adaptive locomotion.

Neural Circuit Architectural Priors for Motor Control

COSYNE 2022

Neural Circuit Architectural Priors for Motor Control

COSYNE 2022

Dynamical Neural Computation in Predictive Sensorimotor Control

COSYNE 2023

Predicting sensory modulation of precise spike timing for motor control

COSYNE 2023

A model linking neural population activity to flexibility in sensorimotor control

COSYNE 2025

A multi-area RNN model of adaptive motor control explains adaptation-induced reorganization of neural activity

COSYNE 2025

Contribution of glutamatergic PPN neurons to motor control

FENS Forum 2024

Mapping cortical input into the brainstem: The function of cortico-brainstem neurons in skilled motor control

FENS Forum 2024

Myelinating Schwann cell alterations in the sciatic nerve of dystrophic mdx mice suggest a potential impact on the sensory-motor control of dystrophic muscles

FENS Forum 2024

Unexpected contribution of striatal projection neurons co-expressing dopamine D1 and D2 receptors in balancing motor control

FENS Forum 2024

Visuomotor control in virtually swimming Danionella larvae

FENS Forum 2024

What role for the striatum in motor control? Insights from unilateral perturbation during foraging

FENS Forum 2024