Topic: information coding

Normalization mechanism has often been used to describe neurons' sublinear responses to multiple stimuli in visual cortex. Neurons in the visual cortex exhibit highly heterogeneous degrees of normalization. Past work has proposed several hypotheses of the functions of normalization in both biological and artificial neural network. For example, normalization can maximize sensitivity in retina neurons, reduce redundancy in sensory cortex, and accelerate and stabilize the learning process in deep neural networks. However, the mechanism underlying the neuronal heterogeneity of normalization and