Prioritizing experience replay when future goals are unknown
Yotam Sagiv, Thomas Akam, Ilana Witten, Nathaniel Daw · COSYNE 2023
Although hippocampal place cells prominently "replay" nonlocal trajectories, the computational function of these events remains elusive. One hypothesis holds that replay plans routes to current goals by propagating information about rewards over space. An alternative view contends that replay learns and maintains routes more generally, separate from current goals or plans, to update a "cognitive map". The former view has been formalized in a reinforcement learning framework (Mattar and Daw, 2018), which predicts which trajectories should be replayed preferentially ("prioritized") to support pl
Sun, Mar 12, 2023