Topic: perceptron capacity

Recent experimental results have found that a cortical neuron typically has multiple synaptic contacts with a given postsynaptic neuron. Here, we refer to such synaptic connections with the same presynaptic axon and the same postsynaptic neuron as parallel synapses. Whether they provide a functional benefit is currently under investigation. To avoid functional redundancy, these parallel synapses must have different computational properties. To model this, we assume that the amount of neurotransmitter released by each synapse can be described by a sigmoidal transmission function of its presynap

The brain must recognize objects in the face of identity-preserving transformations such as changes in lighting, position, and orientation. However, to achieve general purpose geometric reasoning these view transformations should also be represented in neural codes. A natural strategy to encode both the identity of an object and its view is to utilize an equivariant code, where the neural representation transforms in a manner consistent with the transformations to the inputs, and consistent across objects. A classic example of such a code is given by an intermediate layer of a convolutional ne