Behavioural Variability
behavioural variability
A recurrent network model of planning predicts hippocampal replay and human behavior
When interacting with complex environments, humans can rapidly adapt their behavior to changes in task or context. To facilitate this adaptation, we often spend substantial periods of time contemplating possible futures before acting. For such planning to be rational, the benefits of planning to future behavior must at least compensate for the time spent thinking. Here we capture these features of human behavior by developing a neural network model where not only actions, but also planning, are controlled by prefrontal cortex. This model consists of a meta-reinforcement learning agent augmented with the ability to plan by sampling imagined action sequences drawn from its own policy, which we refer to as `rollouts'. Our results demonstrate that this agent learns to plan when planning is beneficial, explaining the empirical variability in human thinking times. Additionally, the patterns of policy rollouts employed by the artificial agent closely resemble patterns of rodent hippocampal replays recently recorded in a spatial navigation task, in terms of both their spatial statistics and their relationship to subsequent behavior. Our work provides a new theory of how the brain could implement planning through prefrontal-hippocampal interactions, where hippocampal replays are triggered by -- and in turn adaptively affect -- prefrontal dynamics.
Extracting heading and goal through structured action
Many flexible behaviors are thought to rely on internal representations of an animal’s spatial relationship to its environment and of the consequences of its actions in that environment. While such representations—e.g. of head direction and value—have been extensively studied, how they are combined to guide behavior is not well understood. I will discuss how we are exploring these questions using a classical visual learning paradigm for the fly. I’ll begin by describing a simple policy that, when tethered to an internal representation of heading, captures structured behavioral variability in this task. I’ll describe how ambiguities in the fly’s visual surroundings affect its perception and, when coupled to this policy, manifest in predictable changes in behavior. Informed by newly-released connectomic data, I’ll then discuss how these computations might be carried out and combined within specific circuits in the fly’s central brain, and how perception and action might interact to shape individual differences in learning performance.
Three levels of variability in the collective behavior of locusts
Many aspects of collective behavior depend on interactions between conspecifics. This is especially true for the collective motion of locusts, which swarm in millions while maintaining synchrony among individuals. However, whether locusts share and maintain the same socio-behavioral patterns – between groups, individuals and situations – remains an open question. Studying marching locusts under lab conditions, we found that (1) different groups behave differently; (2) locusts within a group homogenize their behavior; and (3) individuals have different socio-behavioral tendencies and context-dependent states. These variability levels suggest that behavioral differences within and among individuals exist, affect others, and shape the collective behavior of the entire group.