Topic: future reward timing

Causal inference based on temporal relationships is fundamental for adaptive, intelligent behavior. However, standard value-based reinforcement learning (RL) models learn estimates of temporally discounted average future reward, leading to ambiguity about future reward timing and magnitude. Extending these algorithms to learn a set of values that differ in their sensitivity to reward prediction errors (RPEs) and temporal discounting can support inference. Midbrain dopamine (DA) neurons, known to encode RPEs, display signatures of learning about distributions of reward magnitude. However, it is