Skip to contentSkip to filters

We use cookies for analytics.

Eligibility Traces Provide a Data-Inspired Alternative to Backpropagation Through Time

Guillaume Bellec and Franz Scherr

Graz University of Technology

Abstract

Guillaume Bellec and Franz Scherr present eligibility propagation, or e-prop, a way to train recurrent networks by combining traces of local activity with learning signals. The gradient factorization yields a three-factor plasticity rule for spiking neuron models. On a speech-recognition benchmark, e-prop was competitive with backpropagation through time for both spiking recurrent networks and long short-term memory networks. The authors also examine how diverse learning signals and slow neural dynamics contribute to performance.

Topics