Drift
drift
Representational drift in human visual cortex
Dimensionality reduction beyond neural subspaces
Over the past decade, neural representations have been studied from the lens of low-dimensional subspaces defined by the co-activation of neurons. However, this view has overlooked other forms of covarying structure in neural activity, including i) condition-specific high-dimensional neural sequences, and ii) representations that change over time due to learning or drift. In this talk, I will present a new framework that extends the classic view towards additional types of covariability that are not constrained to a fixed, low-dimensional subspace. In addition, I will present sliceTCA, a new tensor decomposition that captures and demixes these different types of covariability to reveal task-relevant structure in neural activity. Finally, I will close with some thoughts regarding the circuit mechanisms that could generate mixed covariability. Together this work points to a need to consider new possibilities for how neural populations encode sensory, cognitive, and behavioral variables beyond neural subspaces.
Stability of visual processing in passive and active vision
The visual system faces a dual challenge. On the one hand, features of the natural visual environment should be stably processed - irrespective of ongoing wiring changes, representational drift, and behavior. On the other hand, eye, head, and body motion require a robust integration of pose and gaze shifts in visual computations for a stable perception of the world. We address these dimensions of stable visual processing by studying the circuit mechanism of long-term representational stability, focusing on the role of plasticity, network structure, experience, and behavioral state while recording large-scale neuronal activity with miniature two-photon microscopy.
State-of-the-Art Spike Sorting with SpikeInterface
This webinar will focus on spike sorting analysis with SpikeInterface, an open-source framework for the analysis of extracellular electrophysiology data. After a brief introduction of the project (~30 mins) highlighting the basics of the SpikeInterface software and advanced features (e.g., data compression, quality metrics, drift correction, cloud visualization), we will have an extensive hands-on tutorial (~90 mins) showing how to use SpikeInterface in a real-world scenario. After attending the webinar, you will: (1) have a global overview of the different steps involved in a processing pipeline; (2) know how to write a complete analysis pipeline with SpikeInterface.
Dissociation between superior colliculus visual response properties and short- latency ocular position drift responses
Does subjective time interact with the heart rate?
Decades of research have investigated the relationship between perception of time and heart rate with often mixed results. In search of such a relationship, I will present my far journey between two projects: from time perception in the realistic VR experience of crowded subway trips in the order of minutes (project 1); to the perceived duration of sub-second white noise tones (project 2). Heart rate had multiple concurrent relationships with subjective temporal distortions for the sub-second tones, while the effects were lacking or weak for the supra-minute subway trips. What does the heart have to do with sub-second time perception? We addressed this question with a cardiac drift-diffusion model, demonstrating the sensory accumulation of temporal evidence as a function of heart rate.
Drifting assemblies for persistent memory: Neuron transitions and unsupervised compensation
Change is ubiquitous in living beings. In particular, the connectome and neural representations can change. Nevertheless behaviors and memories often persist over long times. In a standard model, associative memories are represented by assemblies of strongly interconnected neurons. For faithful storage these assemblies are assumed to consist of the same neurons over time. We propose a contrasting memory model with complete temporal remodeling of assemblies, based on experimentally observed changes of synapses and neural representations. The assemblies drift freely as noisy autonomous network activity or spontaneous synaptic turnover induce neuron exchange. The exchange can be described analytically by reduced, random walk models derived from spiking neural network dynamics or from first principles. The gradual exchange allows activity-dependent and homeostatic plasticity to conserve the representational structure and keep inputs, outputs and assemblies consistent. This leads to persistent memory. Our findings explain recent experimental results on temporal evolution of fear memory representations and suggest that memory systems need to be understood in their completeness as individual parts may constantly change.
Network mechanisms underlying representational drift in area CA1 of hippocampus
Recent chronic imaging experiments in mice have revealed that the hippocampal code exhibits non-trivial turnover dynamics over long time scales. Specifically, the subset of cells which are active on any given session in a familiar environment changes over the course of days and weeks. While some cells transition into or out of the code after a few sessions, others are stable over the entire experiment. The mechanisms underlying this turnover are unknown. Here we show that the statistics of turnover are consistent with a model in which non-spatial inputs to CA1 pyramidal cells readily undergo plasticity, while spatially tuned inputs are largely stable over time. The heterogeneity in stability across the cell assembly, as well as the decrease in correlation of the population vector of activity over time, are both quantitatively fit by a simple model with Gaussian input statistics. In fact, such input statistics emerge naturally in a network of spiking neurons operating in the fluctuation-driven regime. This correspondence allows one to map the parameters of a large-scale spiking network model of CA1 onto the simple statistical model, and thereby fit the experimental data quantitatively. Importantly, we show that the observed drift is entirely consistent with random, ongoing synaptic turnover. This synaptic turnover is, in turn, consistent with Hebbian plasticity related to continuous learning in a fast memory system.
Neural signature for accumulated evidence underlying temporal decisions
Cognitive models of timing often include a pacemaker analogue whose ticks are accumulated to form an internal representation of time, and a threshold that determines when a target duration has elapsed. However, clear EEG manifestations of these abstract components have not yet been identified. We measured the EEG of subjects while they performed a temporal bisection task in which they were requested to categorize visual stimuli as short or long in duration. We report an ERP component whose amplitude depends monotonically on the stimulus duration. The relation of the ERP amplitude and stimulus duration can be captured by a simple model, adapted from a known drift-diffusion model for time perception. It includes a noisy accumulator that starts with the stimulus onset and a threshold. If the threshold is reached during stimulus presentation, the stimulus is categorized as "long", otherwise the stimulus is categorized as "short". At the stimulus offset, a response proportional to the distance to the threshold is emitted. This simple model has two parameters that fit both the behavior and ERP amplitudes recorded in the task. Two subsequent experiments replicate and extend this finding to another modality (touch) as well as to different time ranges (subsecond and suprasecond), establishing the described ERP component as a useful handle on the cognitive processes involved in temporal decisions.
NMC4 Short Talk: Neurocomputational mechanisms of causal inference during multisensory processing in the macaque brain
Natural perception relies inherently on inferring causal structure in the environment. However, the neural mechanisms and functional circuits that are essential for representing and updating the hidden causal structure during multisensory processing are unknown. To address this, monkeys were trained to infer the probability of a potential common source from visual and proprioceptive signals on the basis of their spatial disparity in a virtual reality system. The proprioceptive drift reported by monkeys demonstrated that they combined historical information and current multisensory signals to estimate the hidden common source and subsequently updated both the causal structure and sensory representation. Single-unit recordings in premotor and parietal cortices revealed that neural activity in premotor cortex represents the core computation of causal inference, characterizing the estimation and update of the likelihood of integrating multiple sensory inputs at a trial-by-trial level. In response to signals from premotor cortex, neural activity in parietal cortex also represents the causal structure and further dynamically updates the sensory representation to maintain consistency with the causal inference structure. Thus, our results indicate how premotor cortex integrates historical information and sensory inputs to infer hidden variables and selectively updates sensory representations in parietal cortex to support behavior. This dynamic loop of frontal-parietal interactions in the causal inference framework may provide the neural mechanism to answer long-standing questions regarding how neural circuits represent hidden structures for body-awareness and agency.
NMC4 Short Talk: Transient neuronal suppression for exploitation of new sensory evidence
Decision-making in noisy environments with constant sensory evidence involves integrating sequentially-sampled evidence, a strategy formalized by diffusion models which is supported by decades behavioral and neural findings. By contrast, it is unknown whether this strategy is also used during decision-making when the underlying sensory evidence is expected to change. Here, we trained monkeys to identify the dominant color of a dynamically refreshed checkerboard pattern that doesn't become informative until after a variable delay. Animals' behavioral responses were briefly suppressed after an abrupt change in evidence, and many neurons in the frontal eye field displayed a corresponding dip in activity at this time, similar to the dip frequently observed after stimulus onset. Generalized drift-diffusion models revealed that behavior and neural activity were consistent with a brief suppression of motor output without a change in evidence accumulation itself, in contrast to the popular belief that evidence accumulation is paused or reset. These results suggest that a brief interruption in motor preparation is an important strategy for dealing with changing evidence during perceptual decision making.
Representational drift in hippocampus and cortex
Feature selectivity can explain mismatch signals in mouse visual cortex
Sensory experience often depends on one’s own actions, including self-motion. Theories of predictive coding postulate that actions are regulated by calculating prediction error, which is the difference between sensory experience and expectation based on self-generated actions. Signals consistent with prediction error have been reported in mouse visual cortex (V1) when visual flow coupled to running was unexpectedly stopped. Here, we show such signals can be elicited by visual stimuli uncoupled to animal’s running. We recorded V1 neurons while presenting drifting gratings that unexpectedly stopped. We found strong responses to visual perturbations, which were enhanced during running. Perturbation responses were strongest in the preferred orientation of individual neurons and perturbation responsive neurons were more likely to prefer slow visual speeds. Our results indicate that prediction error signals can be explained by the convergence of known motor and sensory signals, providing a purely sensory and motor explanation for purported mismatch signals.
Population dynamics of the thalamic head direction system during drift and reorientation
The head direction (HD) system is classically modeled as a ring attractor network which ensures a stable representation of the animal’s head direction. This unidimensional description popularized the view of the HD system as the brain’s internal compass. However, unlike a globally consistent magnetic compass, the orientation of the HD system is dynamic, depends on local cues and exhibits remapping across familiar environments5. Such a system requires mechanisms to remember and align to familiar landmarks, which may not be well described within the classic 1-dimensional framework. To search for these mechanisms, we performed large population recordings of mouse thalamic HD cells using calcium imaging, during controlled manipulations of a visual landmark in a familiar environment. First, we find that realignment of the system was associated with a continuous rotation of the HD network representation. The speed and angular distance of this rotation was predicted by a 2nd dimension to the ring attractor which we refer to as network gain, i.e. the instantaneous population firing rate. Moreover, the 360-degree azimuthal profile of network gain, during darkness, maintained a ‘memory trace’ of a previously displayed visual landmark. In a 2nd experiment, brief presentations of a rotated landmark revealed an attraction of the network back to its initial orientation, suggesting a time-dependent mechanism underlying the formation of these network gain memory traces. Finally, in a 3rd experiment, continuous rotation of a visual landmark induced a similar rotation of the HD representation which persisted following removal of the landmark, demonstrating that HD network orientation is subject to experience-dependent recalibration. Together, these results provide new mechanistic insights into how the neural compass flexibly adapts to environmental cues to maintain a reliable representation of the head direction.
The role of motion in localizing objects
Everything we see has a location. We know where things are before we know what they are. But how do we know where things are? Receptive fields in the visual system specify location but neural delays lead to serious errors whenever targets or eyes are moving. Motion may be the problem here but motion can also be the solution, correcting for the effects of delays and eye movements. To demonstrate this, I will present results from three motion illusions where perceived location differs radically from physical location. These help understand how and where position is coded. We first look at the effects of a target’s simple forward motion on its perceived location. Second, we look at perceived location of a target that has internal motion as well as forward motion. The two directions combine to produce an illusory path. This “double-drift” illusion strongly affects perceived position but, surprisingly, not eye movements or attention. Even more surprising, fMRI shows that the shifted percept does not emerge in the visual cortex but is seen instead in the frontal lobes. Finally, we report that a moving frame also shifts the perceived positions of dots flashed within it. Participants report the dot positions relative to the frame, as if the frame were not moving. These frame-induced position effects suggest a link to visual stability where we see a steady world despite massive displacements during saccades. These motion-based effects on perceived location lead to new insights concerning how and where position is coded in the brain.
OpenFlexure
OpenFlexure is a 3D printed flexure translation stage, developed by a group at the Bath University. The stage is capable of sub-micron-scale motion, with very small drift over time. Which makes it quite good, among other things, for time-lapse protocols that need to be done over days/weeks time, and under space restricted areas, such as fume hoods.
Bacterial rheotaxis in bulk and at surfaces
Individual bacteria transported in viscous flows, show complex interactions with flows and bounding surfaces resulting from their complex shape as well as their activity. Understanding these transport dynamics is crucial, as they impact soil contamination, transport in biological conducts or catheters, and constitute thus a serious health threat. Here we investigate the trajectories of individual E-coli bacteria in confined geometries under flow, using microfluidic model systems in bulk flows as well as close to surfaces using a novel Langrangian 3D tracking method. Combining experimental observations and modelling we elucidate the origin of upstream swimming, lateral drift or persistent transport along corners. [1] Junot et al, EPL, 126 (2019) 44003 [2] Mathijssen et al. 10:3 (2019) Nature Comm. [3] Figueroa-Morales et al., Soft Matter, 2015,11, 6284-6293 [4] Darnige et al. Review of Scientific Instruments 88, 055106 (2017) [5] Jing et al, Science Advances, 2020; 6 : eabb2012 [6] Figueroa-Morales et al, Sci. Adv. 2020; 6 : eaay0155, 2020, 10.1126/sciadv.aay0155
Bayesian distributional regression models for cognitive science
The assumed data generating models (response distributions) of experimental or observational data in cognitive science have become increasingly complex over the past decades. This trend follows a revolution in model estimation methods and a drastic increase in computing power available to researchers. Today, higher-level cognitive functions can well be captured by and understood through computational cognitive models, a common example being drift diffusion models for decision processes. Such models are often expressed as the combination of two modeling layers. The first layer is the response distribution with corresponding distributional parameters tailored to the cognitive process under investigation. The second layer are latent models of the distributional parameters that capture how those parameters vary as a function of design, stimulus, or person characteristics, often in an additive manner. Such cognitive models can thus be understood as special cases of distributional regression models where multiple distributional parameters, rather than just a single centrality parameter, are predicted by additive models. Because of their complexity, distributional models are quite complicated to estimate, but recent advances in Bayesian estimation methods and corresponding software make them increasingly more feasible. In this talk, I will speak about the specification, estimation, and post-processing of Bayesian distributional regression models and how they can help to better understand cognitive processes.
How to simulate and analyze drift-diffusion models of timing and decision making
My talk will discuss the use of some of these four, simple Matlab functions to simulate models of timing, and to fit models to empirical data. Feel free to examine the code and the relatively brief book chapter that explains the code before the talk if you would like to learn more about computational/mathematical modeling.
Slowing down the body slows down time (perception)
Interval timing is a fundamental component action, and is susceptible to motor-related temporal distortions. Previous studies have shown that movement biases temporal estimates, but have primarily considered self-modulated movement only. However, real-world encounters often include situations in which movement is restricted or perturbed by environmental factors. In the following experiments, we introduced viscous movement environments to externally modulate movement and investigated the resulting effects on temporal perception. In two separate tasks, participants timed auditory intervals while moving a robotic arm that randomly applied four levels of viscosity. Results demonstrated that higher viscosity led to shorter perceived durations. Using a drift-diffusion model and a Bayesian observer model, we confirmed these biasing effects arose from perceptual mechanisms, instead of biases in decision making. These findings suggest that environmental perturbations are an important factor in movement-related temporal distortions, and enhance the current understanding of the interactions of motor activity and cognitive processes. https://www.biorxiv.org/content/10.1101/2020.10.26.355396v1
How does the cortex integrate conflicting time-information? A model of temporal averaging
In daily life, we consistently make decisions in pursuit of some goal. Many decisions are informed by multiple sources of information. Unfortunately, these sources often provide ambiguous information about what course of action to take. Therefore, determining how the brain integrates information to resolve this ambiguity is key to understanding the neural mechanisms of decision-making. In the domain of time, this topic can be studied by training subjects to predict when a future event will occur based on distinct cues (e.g., tone, light, etc.). If multiple cues are presented simultaneously and their cue-to-event intervals differ (e.g., tone-10s + light-30s), subjects will often expect the event to occur at the average of their intervals. This ‘temporal averaging’ effect is presumably how the timing system resolves ambiguous time-information. The neural mechanisms of temporal averaging are currently unclear. Here, we will propose how temporal averaging could emerge in cortical circuits using a simple modification of a ‘drift-diffusion’ model of timing.
Attentional Foundations of Framing Effects
Framing effects in individual decision-making have puzzled economists for decades because they are hard, if at all, to explain with rational choice theories. Why should mere changes in the description of a choice problem affect decision-making? Here, we examine the hypothesis that changes in framing cause changes in the allocation of attention to the different options – measured via eye-tracking – and give rise to changes in decision-making. We document that the framing of a sure alternative as a gain – as opposed to a loss – in a risk-taking task increases the attentional advantage of the sure option and induces a higher choice frequency of that option – a finding that is predicted by the attentional drift-diffusion model (aDDM). The model also correctly predicts other key findings such as that the increased attentional advantage of the sure option in the gain frame should also lead quicker decisions in this frame. In addition, the data reveal that increasing risk aversion at higher stake sizes may also be driven by attentional processes because the sure option receives significantly more attention – regardless of frame – at higher stakes. We also corroborate the causal impact of framing-induced changes of attention on choice with an additional experiment that manipulates attention exogenously. Finally, to study the precise mechanisms underlying the framing effect we structurally estimate an aDDM that allows for frame and option-dependent parameters. The estimation results indicate that – in addition to the direct effects of framing-induced changes in attention on choice – the gain frame also causes (i) an increase in the attentional discount of the gamble and (ii) an increased concavity of utility. Our findings suggest that the traditional explanation of framing effects in risky choice in terms of a more concave value function in the gain domain is seriously incomplete and that attentional mechanisms as hypothesized in the aDDM play a key role.
Continuum modelling of active fluids beyond the generalised Taylor dispersion
The Smoluchowski equation has often been used as the starting point of many continuum models of active suspensions. However, its six-dimensional nature depending on time, space and orientation requires a huge computational cost, fundamentally limiting its use for large-scale problems, such as mixing and transport of active fluids in turbulent flows. Despite the singular nature in strain-dominant flows, the generalised Taylor dispersion (GTD) theory (Frankel & Brenner 1991, J. Fluid Mech. 230:147-181) has been understood to be one of the most promising ways to reduce the Smoluchowski equation into an advection-diffusion equation, the mean drift and diffusion tensor of which rely on ‘local’ flow information only. In this talk, we will introduce an exact transformation of the Smoluchowski equation into such an advection-diffusion equation requiring only local flow information. Based on this transformation, a new advection-diffusion equation will subsequently be proposed by taking an asymptotic analysis in the limit of small particle velocity. With several examples, it will be demonstrated that the new advection-diffusion model, non-singular in strain-dominant flows, outperforms the GTD theory.
Visual perception and fixational eye movements: microsaccades, drift and tremor
Computational mechanisms of odor perception and representational drift in rodent olfactory systems
Bernstein Conference 2024
Hippocampal representational drift and the impact of Alzheimer’s disease
Bernstein Conference 2024
A homeostatic mechanism or statistics can maintain input-output relations of multilayer drifting assemblies
Bernstein Conference 2024
Quantifying the signal and noise of decision processes during dual tasks with an efficient two-dimensional drift-diffusion model
Bernstein Conference 2024
Sudden tuning curve jumps in cortical representational drift facilitate stable downstream population readouts
Bernstein Conference 2024
Synaptic fluctuation induces representational drift while preserving discriminability
Bernstein Conference 2024
Differential effects of time and experience on hippocampal representational drift
COSYNE 2022
A discrete model of visual input shows how ocular drift removes ambiguity
COSYNE 2022
Disentangling Fast Representational Drift in Mouse Visual Cortex
COSYNE 2022
A Model for Representational Drift: Implications for the Olfactory System
COSYNE 2022
A Model for Representational Drift: Implications for the Olfactory System
COSYNE 2022
Neural network size balances representational drift and flexibility during Bayesian sampling
COSYNE 2022
Neural network size balances representational drift and flexibility during Bayesian sampling
COSYNE 2022
Reduced stochastic models reveal the mechanisms underlying drifting cell assemblies
COSYNE 2022
Reduced stochastic models reveal the mechanisms underlying drifting cell assemblies
COSYNE 2022
Experience, Not Time, Determines Representational Drift in the Hippocampus
COSYNE 2023
Drift dynamics interact with a confirmation bias in visual working memory
COSYNE 2023
Representational Drift Across Short Timescales in the Mouse Visual Cortex
COSYNE 2023
Representational drift from a population view of memory consolidation
COSYNE 2023
Representational drift leads to sparse activity solutions that are robust to noise and learning
COSYNE 2023
Representational Drift as a Result of Implicit Regularization
COSYNE 2023
Robust multiband drift estimation in electrophysiology data
COSYNE 2023
Stable geometry is inevitable in drifting neural representations
COSYNE 2023
Contribution of task-irrelevant stimuli to drift of neural representations
COSYNE 2025
Correlated Excitatory \& Inhibitory Noise Mitigates Hebbian Synaptic Drift
COSYNE 2025
Modeling neural switching via drift-diffusion models
COSYNE 2025
The recurrency level is a key determinant of representational drift
COSYNE 2025
Representational drift in primary vibrissal somatosensory cortex is receptive field dependent
COSYNE 2025
Representational Drift: Transitioning from a Learning-Conducive to Robust Regime
COSYNE 2025
Representations of naturalistic behavior drift over hours at the level of single neurons and population dynamics
COSYNE 2025
Stiefel manifold dynamical system for tracking neural drift across sessions
COSYNE 2025
Abrupt transitions interrupt slow, ongoing representational drift in experiment and model
FENS Forum 2024
Drifting memories: Sleep stages play opposite roles in reshaping memory representations
FENS Forum 2024
Exercise accelerates place cell representational drift
FENS Forum 2024
Increased drift of population activity in the hippocampus under sensory-minimized conditions
FENS Forum 2024
Lateral entorhinal dynamics drift and shift at behaviorally relevant timescales
FENS Forum 2024
Mechanisms controlling representational drift in mouse visual cortex
FENS Forum 2024
Neural dynamics and representational drift of inhibitory neurons in mouse auditory cortex
FENS Forum 2024
Rate of representational drift correlates with information theoretic measures of neural and behavioural coupling
FENS Forum 2024
Representational drift from a population view of memory consolidation
FENS Forum 2024