Efficient Random Codes in a Shallow Neural Network
Rava Azeredo da Silveira · French National Centre for Scientific Research (CNRS), Paris
Wed, Jun 15, 2022 · 05:00 UTC
Efficient coding has served as a guiding principle in understanding the neural code. To date, however, it has been explored mainly in the context of peripheral sensory cells with simple tuning curves. By contrast, ‘deeper’ neurons such as grid cells come with more complex tuning properties which imply a different, yet highly efficient, strategy for representing information. I will show that a highly efficient code is not specific to a population of neurons with finely tuned response properties: it emerges robustly in a shallow network with random synapses. Here, the geometry of population resp