The cortical dictionary: high-capacity memory in sparsely connected networks with columnar organization
Haozhe Shan, Ludovica Bachschmid Romano, Haim Sompolinsky · COSYNE 2023
Sun, Mar 12, 2023
Neurons with recurrent connectivity can store memory patterns as attractor states in their dynamics, forming a plausible basis for associative memory in the brain. Classical theoretical results concerning fully connected recurrent neural networks (RNNs) with binary neurons and Hebbian learning rules find that they can store at most O(N) memories, where N is the number of neurons. However, under the physiological constraint that neurons are sparsely connected, this capacity is dramatically reduced to O(K), where K is the average number of presynaptic neurons (estimated to be O(10^3 ∼ 10^4) in m