Topic: backpropagation

We introduce a statistical physics framework for learning in neural architectures composed of single or interconnected asymmetric attractor networks. These systems can exhibit a manifold of global fixed points capable of implementing sophisticated input-output mappings, which we characterize analytically. Learning from extensive datasets is achieved through the stabilization of fixed points via a fully distributed and local learning process, implemented at the single-neuron level. This simple mechanism yields performance comparable to that of conventional feedforward deep neural networks train

Gradient-based optimization powered by the backpropagation algorithm proved to be the pivotal method in the training of non-spiking artificial neural networks. At the same time, spiking neural networks hold the promise for efficient processing of real-world sensory data by communicating using discrete events in continuous time. We derive the backpropagation algorithm for a recurrent network of spiking (leaky integrate-and-fire) neurons with hard thresholds and show that the backward dynamics amount to an event-based backpropagation of errors through time. Our derivation uses the jump condition

Artificial neural networks (ANNs) achieve remarkable results on various tasks, but understanding the computational mechanisms underlying their performance remains difficult. Furthermore, traditionally employed artificial networks have little in common with real biological networks. Overcoming this difference, machine-learning-based training methods for spiking neuronal networks (SNNs) have been developed to create functional networks, enabling the investigation of these neural networks with neuroscientific analysis methods. Here we analyze one such SNN trained with backpropagation based on a

Learning in neuronal circuits requires coordinated modifications of synaptic strengths across hierarchical networks to refine computation and improve behavioral outcomes. This coordination requires solving the credit assignment problem. Yet, how neuronal circuits achieve credit assignment remains a central unsolved question in systems neuroscience [1]. Several modeling studies have suggested putative biological mechanisms for back-propagating error signals through multi-layer networks. These functionally motivated models assume distinct neuronal compartments representing local error signals t