Cookies
We use essential cookies to run the site. Analytics cookies are optional and help us improve World Wide. Learn more.
Prof.
NYU
Showing your local timezone
Schedule
Friday, October 20, 2023
2:30 AM America/New_York
Domain
NeuroscienceHost
NYU Swartz
Duration
70 minutes
When interacting with complex environments, humans can rapidly adapt their behavior to changes in task or context. To facilitate this adaptation, we often spend substantial periods of time contemplating possible futures before acting. For such planning to be rational, the benefits of planning to future behavior must at least compensate for the time spent thinking. Here we capture these features of human behavior by developing a neural network model where not only actions, but also planning, are controlled by prefrontal cortex. This model consists of a meta-reinforcement learning agent augmented with the ability to plan by sampling imagined action sequences drawn from its own policy, which we refer to as `rollouts'. Our results demonstrate that this agent learns to plan when planning is beneficial, explaining the empirical variability in human thinking times. Additionally, the patterns of policy rollouts employed by the artificial agent closely resemble patterns of rodent hippocampal replays recently recorded in a spatial navigation task, in terms of both their spatial statistics and their relationship to subsequent behavior. Our work provides a new theory of how the brain could implement planning through prefrontal-hippocampal interactions, where hippocampal replays are triggered by -- and in turn adaptively affect -- prefrontal dynamics.
Marcelo Mattar
Prof.
NYU
neuro
Nervous system function relies on the polarized architecture of neurons, established by directional transport of pre- and postsynaptic cargoes. While delivery of postsynaptic components depends on the
neuro
A combinatorial neural code for long-term motor memory
neuro
The postdoctoral researcher will work on an interdisciplinary project at the intersection of deep learning and comparative politics. The candidate will work in the Human-Centered Machine Learning (HuM
We are looking for highly motivated researchers to join our group in interdisciplinary projects that focus on the development of computational models to understand how linguistic information is repres
The CSNG Lab at the Faculty of Mathematics and Physics at the Charles University is seeking a highly motivated Postdoctoral Researcher to join our team to work on a digital twin model of the visual sy
PROJECT SUMMARY / ABSTRACT Cluster headache (CH), which affects about 1 in 1,000 people, is a severe and debilitating primary headache disorder characterized by repeated attacks occurring in clusters