Topic: actor-critic models

How do animals adapt in a dynamic world? Sometimes, our expectations about the world are drastically violated, such as when we accidentally bite into spoiled food. In these circumstances, we must adjust or face further harm. A classical experimental paradigm to study this behavior is reversal learning, where the values of stimuli are suddenly reversed, for example from positive to negative. Here we investigate how computational models of neural circuits can express the many behavioral strategies empirically observed in reversal learning. We report that simply introducing more neurons in a neu