Seminar · Machine Learning
Event-based Backpropagation for Exact Gradients in Spiking Neural Networks
Christian Pehle · Heidelberg University
Wed, Nov 3, 2021 · 15:15 UTC
Gradient-based optimization powered by the backpropagation algorithm proved to be the pivotal method in the training of non-spiking artificial neural networks. At the same time, spiking neural networks hold the promise for efficient processing of real-world sensory data by communicating using discrete events in continuous time. We derive the backpropagation algorithm for a recurrent network of spiking (leaky integrate-and-fire) neurons with hard thresholds and show that the backward dynamics amount to an event-based backpropagation of errors through time. Our derivation uses the jump condition