Seminars

Mark Harnett presents work on how synaptic organization, nonlinear dendritic processing, and neuronal activity patterns interact to support computation, flexibility, and learning in the adult mammalian neocortex. The Brain and Cognitive Sciences colloquium is followed by a reception.

Daphna Shohamy and Ashok Litwin-Kumar bridge experimental and computational neuroscience to explain how the brain assigns significance to memories, how dopamine shapes memory-guided decisions, and how bodily signals influence learning. Isabel Low moderates a public discussion and question session.

Traditional work in the study of human reward-based learning involves designing an experimental task---often inspired by Reinforcement Learning (RL) theory---and fits a small set of computational models---often inspired by RL algorithms---to that dataset. For example, researchers often model human behavior on bandit tasks using variants of Q-learning. While this approach has been highly productive, leading to landmark discoveries such as the dopamine reward prediction error hypothesis, it also has limitations. This talk focuses on the lack of generalizability of such models: Even if they closely fit behavior on the original task, models derived from the one-task-one-model paradigm usually predict behavior on other tasks quite poorly. I argue that this lack of generalizability is a fundamental problem for the cognitive sciences: we intuitively expect our models to be robust to superficial task differences, such as variations in the number of choice options, reward probabilities, or the exact kind of non-stationarity. I will propose potential solutions to this problem along two dimensions: the behavioral dataset and the computational model. Regarding computational models, I will introduce work in which we moved beyond the limitations of hand-crafted one-off models by employing flexible, data-driven methods. These methods allowed us to compare classes of models instead of individual model instances, allowing us to cover the space of possible models more exhaustively, and innovate cognitive mechanisms very efficiently. For the behavioral dataset, we move from using single learning tasks to a comprehensive task space that encompasses most existing paradigms in the literature, while closing the gaps between them in a near-continuous fashion. Our results suggest that more general models in conjunction with broader datasets can pave the road toward increasingly general models of human reward-based learning and decision making, and a persistent departure from many aspects of RL theory. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2026-05-20. Recording duration: 00:51:19.

Reward expectations – one’s prediction about the likelihood of future outcomes - play a central role in shaping the satisfaction derived from those outcomes. Most existing research treats expectations as static, assuming they remain fixed in time. However, real-life expectations are often dynamic, fluctuating as new information becomes available. For example, during a soccer game, your expectations of seeing your team winning will likely rise and fall as the game unfolds. In the main part of this talk, I will present a series of studies demonstrating that human expectations can be tracked at sub-second timescales. Using slot machines as a case study, we leverage the continuous deceleration of the reels to elicit moment-by-moment fluctuations in rewardexpectations. To capture these dynamics, we take complementary approaches: we use the high temporal resolution of electroencephalography (EEG) to track neural signatures of evolving expectations, and we develop a novel behavioral paradigm (“Slot or Not”) designed to measure changes in expectations via betting behavior. Across four studies, we show that expectations fluctuate continuously and can be tracked both behaviorally and neurally. Extending these findings, a subsequent intracranial study shows that the human orbitofrontal cortex (OFC) encodes the moment-by-moment changes of reward expectations. In the second part of this talk, I will return to the relationship between expectations andsatisfaction. If expectations shape satisfaction, and if they are best conceptualized as dynamic trajectories rather than static quantities, a key question arises: does the trajectory leading up to an outcome influence how that outcome is evaluated? I will outline a new research direction aimed at formalizing this relationship using computational modeling. This is ongoing work, and I welcome feedback on how best to formalize these ideas. Finally, I will discuss potential extensions of this framework to psychopathology, asking whether alterations in dynamic expectations may characterize conditions such as Major Depressive Disorder and Gambling disorder. Together, this work introduces a new framework for studying expectations as dynamic processes, offering a richer understanding Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2026-04-29. Recording duration: 00:42:25.

Much is known about the neural representations of current environmental location and direction within the hippocampal formation, but use of such a “cognitive map” requires the online representation of desired locations and how to get there, and the neural basis for this function has been more elusive. I will discuss how “theta sweeps” of place and grid cell firing encode the current location (at early phases of each theta cycle) while, at later phases, sampling around the forward direction during exploration and indicating the direction to desired locations during goal-directed navigation. I will show how a relatively simple attractor model captures these results, but requires inputs signalling movement-direction and goal-direction.I will discuss why it is useful to consider the hippocampus as a generative model (in which head-direction, rather than movement-direction, is required, to translate egocentric sensory inputs to allocentric latent representations and back again) in explaining its roles in both spatial cognition and memory consolidation. “Replay sequences” are thought to support offline consolidation, and likely resemble theta sweeps more than behavioural experience. I will finish (given time) by considering how human memory consolidation can be seen as extraction of latent variables from replay via self-supervised learning, and how this perspective explains aspects of human memory such as gist-based distortions, imagination and planning. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2026-02-25. Recording duration: 00:46:52.

The hippocampus is thought to build a cognitive map that supports navigation, memory, and planning, but what defines such a map and how it is used remain debated. In this talk, I will present computational models in which hippocampal-like representations emerge in recurrent neural networks trained to predict sequences of sensory observations. While spatially tuned units reliably arise, they are not sufficient to form a cognitive map. Instead, map-like representations emerge when recurrent dynamics support multi-step prediction, yielding a population-level encoding of environmental geometry. Once learned, these representations can autonomously generate offline trajectories biased by recent experience, capturing key features of hippocampal replay. I will then show how these representations guide behavior in navigation tasks. In a hippocampal–striatal model facing visual ambiguity, access to hippocampal activity enables rapid learning and flexible adaptation. Place-like coding supports self-localization, while population-level hippocampal states can be used to derive intrinsic learning signals that estimate progress toward a remembered goal, improving performance beyond full sensory observability. Together, these results suggest that cognitive maps arise from predictive recurrent dynamics and support behavior through both localization and internally generated learning signals. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2026-01-21. Recording duration: 00:46:20.

Neural activity is often analyzed with respect to external referents, such as the onset of a sensory stimulus or an overt motor action. Simultaneous recordings allow referencing neurons’ activity to each other and thus detecting signals that are internal to the organism. Further, multi-region simultaneous recordings allow observing how these internal signals are coordinated across the brain. Following this logic in rats performing a perceptual decision-making task, we recorded simultaneously from thousands of neurons across up to 20 brain regions at once. Here we report two internal signals which we found to profoundly shape decision-related neural dynamics and brain states. First, we decoded the continuously evolving decision state separately from each region, and found surprisingly large magnitude co-fluctuations in these measures. Dimensionality analysis showed these to be dominated by a single state variable, suggesting that only a single decision-making computation, not multiple parallel computations, are being carried out during the analyzed period. Second, we found that the precise time the subject commits to a decision – a covert event that we decoded from large-scale neural activity in primary motor cortex – was accompanied by a coordinated change, across the brain, from a decision formation to a post-commitment state. The two states differ substantially in their choice-predictive neural dynamics and in their inter-region correlations. Therefore, knowing the time of this state change on single trials is needed to correctly parse fundamentally different phases of decision-making. Overall, our data suggest that internally-referenced signals and state changes, not timelocked to external events but detectable through simultaneous recordings, are major features of neural activity during cognition. VVTNS 2026 Opening Lecture. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2026-01-07. Recording duration: 00:42:45.

There is a fundamental tension between storing discrete traces of individual experiences, which allows recall of particular moments in our past without interference, and extracting regularities across these experiences, which supports generalization and prediction in similar situations in the future. One influential proposal for how the brain resolves this tension is that it separates the processes anatomically into Complementary Learning Systems, with the hippocampus rapidly encoding individual episodes and the neocortex slowly extracting regularities over days, months, and years. But this does not explain our ability to learn and generalize from new regularities in our environment quickly, often within minutes. We have put forward a neural network model of the hippocampus that suggests that the hippocampus itself may contain complementary learning systems, with one pathway specializing in the rapid learning of regularities and a separate pathway handling the region’s classic episodic memory functions. This proposal has broad implications for how we rapidly learn novel information of specific and generalized types, which we test across statistical learning, inference, and category learning paradigms. We also explore how this system interacts with slower-learning neocortical memory systems, with empirical and modeling investigations into how hippocampal replay shapes neocortical representations during sleep. Together, the work helps us understand how structured information in our environment is initially encoded and how it then transforms over time. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2025-12-03. Recording duration: 00:53:05.

A combinatorial neural code for long-term motor memory

In a first part of the talk, I will present Predictive Coding Light (PCL), a novel unsupervised learning architecture for spiking neural networks. In contrast to conventional predictive coding approaches, which only transmit prediction errors to higher processing stages, PCL learns inhibitory lateral and top-down connectivity to suppress the most predictable spikes and passes a compressed representation of the input to higher processing stages. We show that PCL reproduces a range of biological findings and exhibits a favorable tradeoff between energy consumption and downstream classification performance on challenging benchmarks. A second part of the talk will feature our lab’s efforts to explain how infants and toddlers might learn abstract object representations without supervision. I will present deep learning models that exploit the temporal and multimodal structure of their sensory inputs to learn representations of individual objects, object categories, or abstract super-categories such as „kitchen object“ in a fully unsupervised fashion. These models offer a parsimonious account of how abstract semantic knowledge may be rooted in children's embodied first-person experiences.

My talk will consist of three subtopics. The brain remembers episodes not in isolation but with their contextual relationships, such as spatial or temporal proximity. This is an essential feature of the brain’s memory, but the underlying mechanism is yet to be explored. Cell assemblies, or engrams, may provide neural representations for such relationships. First, I will show a class of associative memory models that encode and retrieve multiple memory contents linked by an arbitrary graph structure through experience and demonstrate the crucial role of the balance between two inhibitory subnetwork types in the flexible retrieval of relational memories. Secondly, I propose a theoretical framework to generate a cognitive map, i.e., neural representations of relationships between memory items. This framework aims at the predictive function of the hippocampus and is based on successor representations proposed for reinforcement learning. Intriguingly, the model provides a unified account for grid cells in spatial navigation and concept cells in natural language processing. Finally, I will discuss another crucial role of the hippocampal memory system, memory replay, in a spiking neural network model. Unlike the conventional associative memory models that maintain attractor memory states, this model attempts to maximize the capacity of replayed activity patterns. Our model suggests the crucial role of inhibitory plasticity in optimizing spontaneous memory replay. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2025-05-14. Recording duration: 00:46:49.

How can the hippocampal system transition from episodic one-shot learning to a multi-shot learning regime and what is the utility of the resultant neural representations? This talk will explore the role of the dentate gyrus (DG) anatomy in this context. The canonical DG model suggests it performs pattern separation. More recent experimental results challenge this standard model, suggesting DG function is more complex and also supports the precise binding of objects and events to space and the integration of information across episodes. Very recent studies attribute pattern separation and pattern integration to anatomically distinct parts of the DG (the suprapyramidal blade vs the infrapyramidal blade). We propose a computational model that investigates this distinction. In the model the two processing streams (potentially localized in separate blades) contribute to the storage of distinct episodic memories, and the integration of information across episodes, respectively. The latter forms generalized expectations across episodes, eventually forming a cognitive map. We train the model with two data sets, MNIST and plausible entorhinal cortex inputs. The comparison between the two streams allows for the calculation of a prediction error, which can drive the storage of poorly predicted memories and the forgetting of well-predicted memories. We suggest that differential processing across the DG aids in the iterative construction of spatial cognitive maps to serve the generation of location-dependent expectations, while at the same time preserving episodic memory traces of idiosyncratic events.

Why do individuals, both humans and animals, exhibit personal biases in two-alternative decision-making tasks, even when no clear reason exists to favor one alternative over another? In this talk, I will explore two competing hypotheses to explain these idiosyncratic biases. The first suggests that such tendencies arise from unique personal experiences, where past associations between actions and feedback influence future choices. The second hypothesis proposes that the bias reflects irreducible microscopic heterogeneities in the dynamics of decision-making networks. I will present experimental data and theoretical findings that support the latter hypothesis, shedding new light on the neural mechanisms behind seemingly irrational preferences. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2025-03-05. Recording duration: 00:50:36.

The brain has a highly complex structure in terms of cell types and wiring between different regions. What is it for, if anything? I'll start this talk by asking what might an answer to this question even look like given that we can't run an alternative universe where our brains are structured differently. (Preview: we can do this with models!) I'll then talk about some of our work in two areas: (1) does the modular structure of the brain contribute to specialisation of function? (2) how do different cell types and architectures contribute to multimodal sensory processing?

The centre of memory is the medial temporal lobe (MTL) and especially the hippocampus. In our research, a more flexible brain-inspired computational microcircuit of the CA1 region of the mammalian hippocampus was upgraded and used to examine how information retrieval could be affected under different conditions. Six models (1-6) were created by modulating different excitatory and inhibitory pathways. The results showed that the increase in the strength of the feedforward excitation was the most effective way to recall memories. In other words, that allows the system to access stored memories more accurately.

This webinar brings together three leaders in theoretical and computational neuroscience—Larry Abbott, Haim Sompolinsky, and Terry Sejnowski—to discuss how neural circuits generate fundamental aspects of the mind. Abbott illustrates mechanisms in electric fish that differentiate self-generated electric signals from external sensory cues, showing how predictive plasticity and two-stage signal cancellation mediate a sense of self. Sompolinsky explores attractor networks, revealing how discrete and continuous attractors can stabilize activity patterns, enable working memory, and incorporate chaotic dynamics underlying spontaneous behaviors. He further highlights the concept of object manifolds in high-level sensory representations and raises open questions on integrating connectomics with theoretical frameworks. Sejnowski bridges these motifs with modern artificial intelligence, demonstrating how large-scale neural networks capture language structures through distributed representations that parallel biological coding. Together, their presentations emphasize the synergy between empirical data, computational modeling, and connectomics in explaining the neural basis of cognition—offering insights into perception, memory, language, and the emergence of mind-like processes.

This webinar addressed computational perspectives on how animals and humans make decisions, spanning normative, descriptive, and mechanistic models. Sam Gershman (Harvard) presented a capacity-limited reinforcement learning framework in which policies are compressed under an information bottleneck constraint. This approach predicts pervasive perseveration, stimulus‐independent “default” actions, and trade-offs between complexity and reward. Such policy compression reconciles observed action stochasticity and response time patterns with an optimal balance between learning capacity and performance. Jonathan Pillow (Princeton) discussed flexible descriptive models for tracking time-varying policies in animals. He introduced dynamic Generalized Linear Models (Sidetrack) and hidden Markov models (GLM-HMMs) that capture day-to-day and trial-to-trial fluctuations in choice behavior, including abrupt switches between “engaged” and “disengaged” states. These models provide new insights into how animals’ strategies evolve under learning. Finally, Kenji Doya (OIST) highlighted the importance of unifying reinforcement learning with Bayesian inference, exploring how cortical-basal ganglia networks might implement model-based and model-free strategies. He also described Japan’s Brain/MINDS 2.0 and Digital Brain initiatives, aiming to integrate multimodal data and computational principles into cohesive “digital brains.”

This webinar on learning and memory features three experts—Nicolas Brunel, Ashok Litwin-Kumar, and Julijana Gjorgieva—who present theoretical and computational approaches to understanding how neural circuits acquire and store information across different scales. Brunel discusses calcium-based plasticity and how standard “Hebbian-like” plasticity rules inferred from in vitro or in vivo datasets constrain synaptic dynamics, aligning with classical observations (e.g., STDP) and explaining how synaptic connectivity shapes memory. Litwin-Kumar explores insights from the fruit fly connectome, emphasizing how the mushroom body—a key site for associative learning—implements a high-dimensional, random representation of sensory features. Convergent dopaminergic inputs gate plasticity, reflecting a high-dimensional “critic” that refines behavior. Feedback loops within the mushroom body further reveal sophisticated interactions between learning signals and action selection. Gjorgieva examines how activity-dependent plasticity rules shape circuitry from the subcellular (e.g., synaptic clustering on dendrites) to the cortical network level. She demonstrates how spontaneous activity during development, Hebbian competition, and inhibitory-excitatory balance collectively establish connectivity motifs responsible for key computations such as response normalization.