Discrete communication mediates effective regularization in recurrent neural networks
Neuronal computation is mediated by spikes, yet it is unclear what the benefits of discrete spiking dynamics over continuous firing rates are. Many theoretical and computational studies treat single neurons as continuous units and their output as an effective firing rate. These works view spiking dynamics as a biophysical constraint, e.g., for energy efficiency. Conversely, other theories suggest that the exact timings of single spikes are meaningful. We propose a novel theory that shows the benefits of spiking dynamics on neural computation. In particular, we show that spiking neural dynamics