Cognition seminars

Traditional work in the study of human reward-based learning involves designing an experimental task---often inspired by Reinforcement Learning (RL) theory---and fits a small set of computational models---often inspired by RL algorithms---to that dataset. For example, researchers often model human behavior on bandit tasks using variants of Q-learning. While this approach has been highly productive, leading to landmark discoveries such as the dopamine reward prediction error hypothesis, it also has limitations. This talk focuses on the lack of generalizability of such models: Even if they closely fit behavior on the original task, models derived from the one-task-one-model paradigm usually predict behavior on other tasks quite poorly. I argue that this lack of generalizability is a fundamental problem for the cognitive sciences: we intuitively expect our models to be robust to superficial task differences, such as variations in the number of choice options, reward probabilities, or the exact kind of non-stationarity. I will propose potential solutions to this problem along two dimensions: the behavioral dataset and the computational model. Regarding computational models, I will introduce work in which we moved beyond the limitations of hand-crafted one-off models by employing flexible, data-driven methods. These methods allowed us to compare classes of models instead of individual model instances, allowing us to cover the space of possible models more exhaustively, and innovate cognitive mechanisms very efficiently. For the behavioral dataset, we move from using single learning tasks to a comprehensive task space that encompasses most existing paradigms in the literature, while closing the gaps between them in a near-continuous fashion. Our results suggest that more general models in conjunction with broader datasets can pave the road toward increasingly general models of human reward-based learning and decision making, and a persistent departure from many aspects of RL theory. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2026-05-20. Recording duration: 00:51:19.

Reward expectations – one’s prediction about the likelihood of future outcomes - play a central role in shaping the satisfaction derived from those outcomes. Most existing research treats expectations as static, assuming they remain fixed in time. However, real-life expectations are often dynamic, fluctuating as new information becomes available. For example, during a soccer game, your expectations of seeing your team winning will likely rise and fall as the game unfolds. In the main part of this talk, I will present a series of studies demonstrating that human expectations can be tracked at sub-second timescales. Using slot machines as a case study, we leverage the continuous deceleration of the reels to elicit moment-by-moment fluctuations in rewardexpectations. To capture these dynamics, we take complementary approaches: we use the high temporal resolution of electroencephalography (EEG) to track neural signatures of evolving expectations, and we develop a novel behavioral paradigm (“Slot or Not”) designed to measure changes in expectations via betting behavior. Across four studies, we show that expectations fluctuate continuously and can be tracked both behaviorally and neurally. Extending these findings, a subsequent intracranial study shows that the human orbitofrontal cortex (OFC) encodes the moment-by-moment changes of reward expectations. In the second part of this talk, I will return to the relationship between expectations andsatisfaction. If expectations shape satisfaction, and if they are best conceptualized as dynamic trajectories rather than static quantities, a key question arises: does the trajectory leading up to an outcome influence how that outcome is evaluated? I will outline a new research direction aimed at formalizing this relationship using computational modeling. This is ongoing work, and I welcome feedback on how best to formalize these ideas. Finally, I will discuss potential extensions of this framework to psychopathology, asking whether alterations in dynamic expectations may characterize conditions such as Major Depressive Disorder and Gambling disorder. Together, this work introduces a new framework for studying expectations as dynamic processes, offering a richer understanding Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2026-04-29. Recording duration: 00:42:25.

Much is known about the neural representations of current environmental location and direction within the hippocampal formation, but use of such a “cognitive map” requires the online representation of desired locations and how to get there, and the neural basis for this function has been more elusive. I will discuss how “theta sweeps” of place and grid cell firing encode the current location (at early phases of each theta cycle) while, at later phases, sampling around the forward direction during exploration and indicating the direction to desired locations during goal-directed navigation. I will show how a relatively simple attractor model captures these results, but requires inputs signalling movement-direction and goal-direction.I will discuss why it is useful to consider the hippocampus as a generative model (in which head-direction, rather than movement-direction, is required, to translate egocentric sensory inputs to allocentric latent representations and back again) in explaining its roles in both spatial cognition and memory consolidation. “Replay sequences” are thought to support offline consolidation, and likely resemble theta sweeps more than behavioural experience. I will finish (given time) by considering how human memory consolidation can be seen as extraction of latent variables from replay via self-supervised learning, and how this perspective explains aspects of human memory such as gist-based distortions, imagination and planning. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2026-02-25. Recording duration: 00:46:52.

The hippocampus is thought to build a cognitive map that supports navigation, memory, and planning, but what defines such a map and how it is used remain debated. In this talk, I will present computational models in which hippocampal-like representations emerge in recurrent neural networks trained to predict sequences of sensory observations. While spatially tuned units reliably arise, they are not sufficient to form a cognitive map. Instead, map-like representations emerge when recurrent dynamics support multi-step prediction, yielding a population-level encoding of environmental geometry. Once learned, these representations can autonomously generate offline trajectories biased by recent experience, capturing key features of hippocampal replay. I will then show how these representations guide behavior in navigation tasks. In a hippocampal–striatal model facing visual ambiguity, access to hippocampal activity enables rapid learning and flexible adaptation. Place-like coding supports self-localization, while population-level hippocampal states can be used to derive intrinsic learning signals that estimate progress toward a remembered goal, improving performance beyond full sensory observability. Together, these results suggest that cognitive maps arise from predictive recurrent dynamics and support behavior through both localization and internally generated learning signals. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2026-01-21. Recording duration: 00:46:20.

Neural activity is often analyzed with respect to external referents, such as the onset of a sensory stimulus or an overt motor action. Simultaneous recordings allow referencing neurons’ activity to each other and thus detecting signals that are internal to the organism. Further, multi-region simultaneous recordings allow observing how these internal signals are coordinated across the brain. Following this logic in rats performing a perceptual decision-making task, we recorded simultaneously from thousands of neurons across up to 20 brain regions at once. Here we report two internal signals which we found to profoundly shape decision-related neural dynamics and brain states. First, we decoded the continuously evolving decision state separately from each region, and found surprisingly large magnitude co-fluctuations in these measures. Dimensionality analysis showed these to be dominated by a single state variable, suggesting that only a single decision-making computation, not multiple parallel computations, are being carried out during the analyzed period. Second, we found that the precise time the subject commits to a decision – a covert event that we decoded from large-scale neural activity in primary motor cortex – was accompanied by a coordinated change, across the brain, from a decision formation to a post-commitment state. The two states differ substantially in their choice-predictive neural dynamics and in their inter-region correlations. Therefore, knowing the time of this state change on single trials is needed to correctly parse fundamentally different phases of decision-making. Overall, our data suggest that internally-referenced signals and state changes, not timelocked to external events but detectable through simultaneous recordings, are major features of neural activity during cognition. VVTNS 2026 Opening Lecture. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2026-01-07. Recording duration: 00:42:45.

There is a fundamental tension between storing discrete traces of individual experiences, which allows recall of particular moments in our past without interference, and extracting regularities across these experiences, which supports generalization and prediction in similar situations in the future. One influential proposal for how the brain resolves this tension is that it separates the processes anatomically into Complementary Learning Systems, with the hippocampus rapidly encoding individual episodes and the neocortex slowly extracting regularities over days, months, and years. But this does not explain our ability to learn and generalize from new regularities in our environment quickly, often within minutes. We have put forward a neural network model of the hippocampus that suggests that the hippocampus itself may contain complementary learning systems, with one pathway specializing in the rapid learning of regularities and a separate pathway handling the region’s classic episodic memory functions. This proposal has broad implications for how we rapidly learn novel information of specific and generalized types, which we test across statistical learning, inference, and category learning paradigms. We also explore how this system interacts with slower-learning neocortical memory systems, with empirical and modeling investigations into how hippocampal replay shapes neocortical representations during sleep. Together, the work helps us understand how structured information in our environment is initially encoded and how it then transforms over time. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2025-12-03. Recording duration: 00:53:05.

Connectomic traces of Hebbian plasticity in the entorhinalhippocampal system

Distinct synaptic plasticity rules operate across dendritic compartments in vivo during learning

A combinatorial neural code for long-term motor memory

Binary and analog variation of synapses between cortical pyramidal neurons

Systems consolidation reorganizes hippocampal engram circuitry

Neocortical synaptic engrams for remote contextual memories

Structure and function of the hippocampal CA3 module

Synaptic architecture of a memory engram in the mouse hippocampus

My talk will consist of three subtopics. The brain remembers episodes not in isolation but with their contextual relationships, such as spatial or temporal proximity. This is an essential feature of the brain’s memory, but the underlying mechanism is yet to be explored. Cell assemblies, or engrams, may provide neural representations for such relationships. First, I will show a class of associative memory models that encode and retrieve multiple memory contents linked by an arbitrary graph structure through experience and demonstrate the crucial role of the balance between two inhibitory subnetwork types in the flexible retrieval of relational memories. Secondly, I propose a theoretical framework to generate a cognitive map, i.e., neural representations of relationships between memory items. This framework aims at the predictive function of the hippocampus and is based on successor representations proposed for reinforcement learning. Intriguingly, the model provides a unified account for grid cells in spatial navigation and concept cells in natural language processing. Finally, I will discuss another crucial role of the hippocampal memory system, memory replay, in a spiking neural network model. Unlike the conventional associative memory models that maintain attractor memory states, this model attempts to maximize the capacity of replayed activity patterns. Our model suggests the crucial role of inhibitory plasticity in optimizing spontaneous memory replay. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2025-05-14. Recording duration: 00:46:49.

Join Us for the Memory Decoding Journal Club! A collaboration of the Carboncopies Foundation and BPF Aspirational Neuroscience. This time, we’re diving into a groundbreaking paper: "Motor learning selectively strengthens cortical and striatal synapses of motor engram neurons