Building and Using a Cognitive Map
The hippocampus is thought to build a cognitive map that supports navigation, memory, and planning, but what defines such a map and how it is used remain debated. In this talk, I will present computational models in which hippocampal-like representations emerge in recurrent neural networks trained to predict sequences of sensory observations. While spatially tuned units reliably arise, they are not sufficient to form a cognitive map. Instead, map-like representations emerge when recurrent dynamics support multi-step prediction, yielding a population-level encoding of environmental geometry. Once learned, these representations can autonomously generate offline trajectories biased by recent experience, capturing key features of hippocampal replay. I will then show how these representations guide behavior in navigation tasks. In a hippocampal–striatal model facing visual ambiguity, access to hippocampal activity enables rapid learning and flexible adaptation. Place-like coding supports self-localization, while population-level hippocampal states can be used to derive intrinsic learning signals that estimate progress toward a remembered goal, improving performance beyond full sensory observability. Together, these results suggest that cognitive maps arise from predictive recurrent dynamics and support behavior through both localization and internally generated learning signals. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2026-01-21. Recording duration: 00:46:20.
Learning representations of specifics and generalities over time
There is a fundamental tension between storing discrete traces of individual experiences, which allows recall of particular moments in our past without interference, and extracting regularities across these experiences, which supports generalization and prediction in similar situations in the future. One influential proposal for how the brain resolves this tension is that it separates the processes anatomically into Complementary Learning Systems, with the hippocampus rapidly encoding individual episodes and the neocortex slowly extracting regularities over days, months, and years. But this does not explain our ability to learn and generalize from new regularities in our environment quickly, often within minutes. We have put forward a neural network model of the hippocampus that suggests that the hippocampus itself may contain complementary learning systems, with one pathway specializing in the rapid learning of regularities and a separate pathway handling the region’s classic episodic memory functions. This proposal has broad implications for how we rapidly learn novel information of specific and generalized types, which we test across statistical learning, inference, and category learning paradigms. We also explore how this system interacts with slower-learning neocortical memory systems, with empirical and modeling investigations into how hippocampal replay shapes neocortical representations during sleep. Together, the work helps us understand how structured information in our environment is initially encoded and how it then transforms over time. Presented in the van Vreeswijk Theoretical Neuroscience Seminar series (formerly WWTNS) on 2025-12-03. Recording duration: 00:53:05.
A recurrent network model of planning predicts hippocampal replay and human behavior
When interacting with complex environments, humans can rapidly adapt their behavior to changes in task or context. To facilitate this adaptation, we often spend substantial periods of time contemplating possible futures before acting. For such planning to be rational, the benefits of planning to future behavior must at least compensate for the time spent thinking. Here we capture these features of human behavior by developing a neural network model where not only actions, but also planning, are controlled by prefrontal cortex. This model consists of a meta-reinforcement learning agent augmented with the ability to plan by sampling imagined action sequences drawn from its own policy, which we refer to as `rollouts'. Our results demonstrate that this agent learns to plan when planning is beneficial, explaining the empirical variability in human thinking times. Additionally, the patterns of policy rollouts employed by the artificial agent closely resemble patterns of rodent hippocampal replays recently recorded in a spatial navigation task, in terms of both their spatial statistics and their relationship to subsequent behavior. Our work provides a new theory of how the brain could implement planning through prefrontal-hippocampal interactions, where hippocampal replays are triggered by -- and in turn adaptively affect -- prefrontal dynamics.
A recurrent network model of planning explains hippocampal replay and human behavior
When interacting with complex environments, humans can rapidly adapt their behavior to changes in task or context. To facilitate this adaptation, we often spend substantial periods of time contemplating possible futures before acting. For such planning to be rational, the benefits of planning to future behavior must at least compensate for the time spent thinking. Here we capture these features of human behavior by developing a neural network model where not only actions, but also planning, are controlled by prefrontal cortex. This model consists of a meta-reinforcement learning agent augmented with the ability to plan by sampling imagined action sequences drawn from its own policy, which we refer to as 'rollouts'. Our results demonstrate that this agent learns to plan when planning is beneficial, explaining the empirical variability in human thinking times. Additionally, the patterns of policy rollouts employed by the artificial agent closely resemble patterns of rodent hippocampal replays recently recorded in a spatial navigation task, in terms of both their spatial statistics and their relationship to subsequent behavior. Our work provides a new theory of how the brain could implement planning through prefrontal-hippocampal interactions, where hippocampal replays are triggered by - and in turn adaptively affect - prefrontal dynamics.
Hippocampal replay reflects specific past experiences rather than a plan for subsequent choice
Executing memory-guided behavior requires storage of information about experience and later recall of that information to inform choices. Awake hippocampal replay, when hippocampal neural ensembles briefly reactivate a representation related to prior experience, has been proposed to critically contribute to these memory-related processes. However, it remains unclear whether awake replay contributes to memory function by promoting the storage of past experiences, facilitating planning based on evaluation of those experiences, or both. We designed a dynamic spatial task that promotes replay before a memory-based choice and assessed how the content of replay related to past and future behavior. We found that replay content was decoupled from subsequent choice and instead was enriched for representations of previously rewarded locations and places that had not been visited recently, indicating a role in memory storage rather than in directly guiding subsequent behavior.
The Role of Hippocampal Replay in Memory Consolidation
The hippocampus lies at the centre of a network of brain regions thought to support spatial and episodic memory. Place cells - the principal cell of the hippocampus, represent information about an animal’s spatial location. Yet, during rest and awake quiescence place cells spontaneously recapitulate past trajectories (‘replay’). Replay has been hypothesised to support systems consolidation – the stabilisation of new memories via maturation of complementary cortical memory traces. Indeed, in recent work we found place and grid cells, from the deep medial entorhinal cortex (dMEC, the principal cortical output region of the hippocampus), replayed coherently during rest periods. Importantly, dMEC grid cells lagged place cells by ~11ms; suggesting the coordination may reflect consolidation. Moreover, preliminary data shows that the dMEC-hippocampal coordination strengthens as an animal becomes familiar with a task and that it may be led by directionally modulated cells. Finally, on-going work, in my recently established lab, shows replay may represent the mechanism underlying the maturation of episodic/spatial memory in pre-weanling pups. Together, these results indicate replay may play a central role in ensuring the permanency of memories.