A sense without sensors: how non-temporal stimulus features influence the perception and the neural representation of time
Any sensory experience of the world, from the touch of a caress to the smile on our friend’s face, is embedded in time and it is often associated with the perception of the flow of it. The perception of time is therefore a peculiar sensory experience built without dedicated sensors. How the perception of time and the content of a sensory experience interact to give rise to this unique percept is unclear. A few empirical evidences show the existence of this interaction, for example the speed of a moving object or the number of items displayed on a computer screen can bias the perceived duration of those objects. However, to what extent the coding of time is embedded within the coding of the stimulus itself, is sustained by the activity of the same or distinct neural populations and subserved by similar or distinct neural mechanisms is far from clear. Addressing these puzzles represents a way to gain insight on the mechanism(s) through which the brain represents the passage of time. In my talk I will present behavioral and neuroimaging studies to show how concurrent changes of visual stimulus duration, speed, visual contrast and numerosity, shape and modulate brain’s and pupil’s responses and, in case of numerosity and time, influence the topographic organization of these features along the cortical visual hierarchy.
Behavioural Basis of Subjective Time Distortions
Precisely estimating event timing is essential for survival, yet temporal distortions are ubiquitous in our daily sensory experience. Here, we tested whether the relative position, duration, and distance in time of two sequentially-organized events—standard S, with constant duration, and comparison C, with duration varying trial-by-trial—are causal factors in generating temporal distortions. We found that temporal distortions emerge when the first event is shorter than the second event. Importantly, a significant interaction suggests that a longer inter-stimulus interval (ISI) helps to counteract such serial distortion effect only when the constant S is in the first position, but not if the unpredictable C is in the first position. These results imply the existence of a perceptual bias in perceiving ordered event durations, mechanistically contributing to distortion in time perception. Our results clarify the mechanisms generating time distortions by identifying a hitherto unknown duration-dependent encoding inefficiency in human serial temporal perception, something akin to a strong prior that can be overridden for highly predictable sensory events but unfolds for unpredictable ones.
How neural circuits organize and learn during development
To generate brain circuits that are both flexible and stable requires the coordination of powerful developmental mechanisms acting at different scales, including activity-dependent synaptic plasticity and changes in single neuron properties. The brain prepares to efficiently compute information and reliably generate behavior during early development without any prior sensory experience but through patterned spontaneous activity. After the onset of sensory experience, ongoing activity continues to modify sensory circuits, and plays an important functional role in the mature brain. Using quantitative data analysis, experiment-driven theory and computational modeling, I will present a framework for how neural circuits are built and organized during early postnatal development into functional units, and how they are modified by intact and perturbed sensory-evoked activity. Inspired by experimental data from sensory cortex, I will then show how neural circuits use the resulting non-random connectivity to flexibly gate a network’s response, providing a mechanism for routing information.
NMC4 Short Talk: Sensory intermixing of mental imagery and perception
Several lines of research have demonstrated that internally generated sensory experience - such as during memory, dreaming and mental imagery - activates similar neural representations as externally triggered perception. This overlap raises a fundamental challenge: how is the brain able to keep apart signals reflecting imagination and reality? In a series of online psychophysics experiments combined with computational modelling, we investigated to what extent imagination and perception are confused when the same content is simultaneously imagined and perceived. We found that simultaneous congruent mental imagery consistently led to an increase in perceptual presence responses, and that congruent perceptual presence responses were in turn associated with a more vivid imagery experience. Our findings can be best explained by a simple signal detection model in which imagined and perceived signals are added together. Perceptual reality monitoring can then easily be implemented by evaluating whether this intermixed signal is strong or vivid enough to pass a ‘reality threshold’. Our model suggests that, in contrast to self-generated sensory changes during movement, our brain does not discount self-generated sensory signals during mental imagery. This has profound implications for our understanding of reality monitoring and perception in general.
Feature selectivity can explain mismatch signals in mouse visual cortex
Sensory experience often depends on one’s own actions, including self-motion. Theories of predictive coding postulate that actions are regulated by calculating prediction error, which is the difference between sensory experience and expectation based on self-generated actions. Signals consistent with prediction error have been reported in mouse visual cortex (V1) when visual flow coupled to running was unexpectedly stopped. Here, we show such signals can be elicited by visual stimuli uncoupled to animal’s running. We recorded V1 neurons while presenting drifting gratings that unexpectedly stopped. We found strong responses to visual perturbations, which were enhanced during running. Perturbation responses were strongest in the preferred orientation of individual neurons and perturbation responsive neurons were more likely to prefer slow visual speeds. Our results indicate that prediction error signals can be explained by the convergence of known motor and sensory signals, providing a purely sensory and motor explanation for purported mismatch signals.
What is the function of auditory cortex when it develops in the absence of acoustic input?
Cortical plasticity is the neural mechanism by which the cerebrum adapts itself to its environment, while at the same time making it vulnerable to impoverished sensory or developmental experiences. Like the visual system, auditory development passes through a series of sensitive periods in which circuits and connections are established and then refined by experience. Current research is expanding our understanding of cerebral processing and organization in the deaf. In the congenitally deaf, higher-order areas of "deaf" auditory cortex demonstrate significant crossmodal plasticity with neurons responding to visual and somatosensory stimuli. This crucial cerebral function results in compensatory plasticity. Not only can the remaining inputs reorganize to substitute for those lost, but this additional circuitry also confers enhanced abilities to the remaining systems. In this presentation we will review our present understanding of the structure and function of “deaf” auditory cortex using psychophysical, electrophysiological, and connectional anatomy approaches and consider how this knowledge informs our expectations of the capabilities of cochlear implants in the developing brain.
Imaging the influences of sensory experience on visual system circuit development
Using a combination of in vivo imaging of neuronal circuit functional and structural dynamics, we have investigated the mechanisms by which patterned neural activity and sensory experience alter connectivity in the developing brain. We have identified, in addition to the long-hypothesized Hebbian structural plasticity mechanisms, a kind of plasticity induced by the absence of correlated firing that we dubbed “Stentian plasticity”. In the talk I will discuss the phenomenology and some mechanistic insights regarding Stentian mechanisms in brain development. Further, I will show how glia may have a key role in circuit remodeling during development. These studies have led us to an appreciation of the importance of neuron-glia interactions in early development and the ability of patterned activity to guide circuit wiring.
All optical interrogation of developing GABAergic circuits in vivo
The developmental journey of cortical interneurons encounters several activity-dependent milestones. During the early postnatal period in developing mice, GABAergic neurons are transient preferential recipients of thalamic inputs and undergo activity-dependent migration arrest, wiring and programmed cell-death. But cortical GABAergic neurons are also specified by very early developmental programs. For example, the earliest born GABAergic neurons develop into hub cells coordinating spontaneous activity in hippocampal slices. Despite their importance for the emergence of sensory experience, their role in coordinating network dynamics, and the role of activity in their integration into cortical networks, the collective in vivo dynamics of GABAergic neurons during the neonatal postnatal period remain unknown. Here, I will present data related to the coordinated activity between GABAergic cells of the mouse barrel cortex and hippocampus in non-anesthetized pups using the recent development of all optical methods to record and manipulate neuronal activity in vivo. I will show that the functional structure of developing GABAergic circuits is remarkably patterned, with segregated assemblies of prospective parvalbumin neurons and highly connected hub cells, both shaped by sensory-dependent processes.
Autism-Associated Shank3 Is Essential for Homeostatic Compensation in Rodent Visual Cortex
Neocortical networks must generate and maintain stable activity patterns despite perturbations induced by learning and experience- dependent plasticity. There is abundant theoretical and experimental evidence that network stability is achieved through homeostatic plasticity mechanisms that adjust synaptic and neuronal properties to stabilize some measure of average activity, and this process has been extensively studied in primary visual cortex (V1), where chronic visual deprivation induces an initial drop in activity and ensemble average firing rates (FRs), but over time activity is restored to baseline despite continued deprivation. Here I discuss recent work from the lab in which we followed this FR homeostasis in individual V1 neurons in freely behaving animals during a prolonged visual deprivation/eye-reopening paradigm. We find that - when FRs are perturbed by manipulating sensory experience - over time they return precisely to a cell-autonomous set-point. Finally, we find that homeostatic plasticity is perturbed in a mouse model of Autism spectrum disorder, and this results in a breakdown of FRH within V1. These data suggest that loss of homeostatic plasticity is one primary cause of excitation/inhibition imbalances in ASD models. Together these studies illuminate the role of stabilizing plasticity mechanisms in the ability of neocortical circuits to recover robust function following challenges to their excitability.
Wiring up direction selective circuits in the retina
The development of neural circuits is profoundly impacted by both spontaneous and sensory experience. This is perhaps most well studied in the visual system, where disruption of early spontaneous activity called retinal waves prior to eye opening and visual deprivation after eye opening leads to alterations in the response properties and connectivity in several visual centers in the brain. We address this question in the retina, which comprises multiple circuits that encode different features of the visual scene, culminating in over 40 different types of retinal ganglion cells. Direction-selective ganglion cells respond strongly to an image moving in the preferred direction and weakly to an image moving in the opposite, or null, direction. Moreover, as recently described (Sabbah et al, 2017) the preferred directions of direction selective ganglion cells cluster along four directions that align along two optic flow axes, causing variation of the relative orientation of preferred directions along the retinal surface. I will provide recent progress in the lab that addresses the role of visual experience and spontaneous retinal waves in the establishment of direction selective tuning and direction selectivity maps in the retina.