Topic: belief state

When faced with a constantly changing, uncertain environment it is necessary to infer its underlying structure to guide behaviour. This has often been formalised as a value updating problem – where actions are chosen based on an incrementally updated weighted average of past reward. Activity of midbrain dopamine neurons has been commonly associated with the error in such value prediction, and it has been proposed to be crucial for learning and updating of values that inform decision making. However, it has become increasingly apparent that both humans and animals often use an alternative strat