Topic: inductive bias

Research in Neuroscience, as in many scientific disciplines, is undergoing a renaissance based on deep learning. Unique to Neuroscience, deep learning models can be used not only as a tool but interpreted as models of the brain. The central claims of recent deep learning-based models of brain circuits are that they shed light on fundamental functions being optimized or make novel predictions about neural phenomena. We show, through the case-study of grid cells in the entorhinal-hippocampal circuit, that one may get neither. We rigorously examine the claims of deep learning models of grid cells

Animals are presented with noisy and incomplete information from which we learn how to react in novel situations. For example, a given training set could have many explanations, each implying a different behavioural response; acting appropriately requires inferring the most plausible explanation. The way animals choose to wield Occam's razor, selecting the most parsimonious explanation, is called their inductive bias, and it is implicitly built into the operation of animals' neural circuits. This relationship between an observed sensory circuit and its inductive bias is a useful explanatory wi

Many regions of the human brain conduct highly specific functions, such as recognizing faces, understanding language, and thinking about other people’s thoughts. Why might this domain specific organization be a good design strategy for brains, and what is the origin of domain specificity in the first place? In this talk, I will present recent work testing whether the segregation of face and object perception in human brains emerges naturally from an optimization for both tasks. We trained artificial neural networks on face and object recognition, and found that networks were able to perform bo