Inhibition-controlled Hebbian learning unifies phenomenological and normative models of plasticity
Computational Neuroscience, Control Theory, Dynamical Systems and ePoster by Julian Rossbroich and Friedemann Zenke
Audio
Abstract
Learning in neuronal circuits requires coordinated modifications of synaptic strengths across hierarchical networks to refine computation and improve behavioral outcomes. This coordination requires solving the credit assignment problem. Yet, how neuronal circuits achieve credit assignment remains a central unsolved question in systems neuroscience [1]. Several modeling studies have suggested putative biological mechanisms for back-propagating error signals through multi-layer networks. These functionally motivated models assume distinct neuronal compartments representing local error signals that dictate the sign of synaptic plasticity [2-4]. However, this explicit error modulation is inconsistent with experimental findings [5,6] and phenomenological plasticity models [7] in which the sign is determined by a postsynaptic activity threshold.
Here, we demonstrate that an inhibition-controlled Hebbian learning rule embedded in a plausible microcircuit model can resolve this discrepancy between normative and phenomenological models of plasticity. Inspired by experiments highlighting the control of inhibitory microcircuits over excitatory plasticity [8,9], we propose an inhibition-controlled plasticity (ICP) rule, in which inhibitory currents directly affect the plasticity threshold similar to previous work [10,11]. When embedded in a microcircuit with recurrent inhibition, ICP creates a stable fixed point for synaptic weights that naturally stabilizes Hebbian learning. At this fixed point, deviations from the expected inhibitory current dictate the sign of plasticity. In our model, receptive fields of excitatory neurons naturally de-correlate through lateral inhibition without the need for inhibitory plasticity. Finally, assuming top-down dis-inhibitory afferents carry credit information, ICP can be derived from first principles within an adaptive control theory framework and naturally performs error-modulated learning. Our empirical results show that such dis-inhibitory control performs comparably to backpropagation on several non-linearly separable benchmarks.
In summary, we propose a Hebbian learning rule with an inhibitory contribution to the plasticity threshold that unifies the learning dynamics of phenomenological plasticity rules and normative models of gradient-based learning. Our findings make concrete predictions on inhibitory modulation of excitatory plasticity.
Topics
Details
- Citation
- Julian Rossbroich, Friedemann Zenke (2024). Inhibition-controlled Hebbian learning unifies phenomenological and normative models of plasticity. Bernstein Conference 2024. https://doi.org/10.12751/nncn.bc2024.132 (opens in a new tab)
Related ePosters
Learning Hebbian/Anti-Hebbian networks in continuous time
Frankfurt, GermanyNonlinear Hebbian plasticity for dimensionality reduction
Sep 28, 2022Online
More with Julian Rossbroich
All their workEfficient cortical spike train decoding for brain-machine interface implants with recurrent spiking neural networks
ePoster · Sep 29, 2024Bernstein Conference 2024
More with Friedemann Zenke
All their workSNUFA 2026
Workshop · Nov 4–5, 2026Learning predictable factors from sequences: it’s not only about slow features
ePoster · Sep 29, 2024Bernstein Conference 2024Learning and using predictive maps for strategic planning
ePoster · Sep 29, 2024Bernstein Conference 2024On synaptic learning rules for spiking neurons - with Friedemann Zenke - #11
Episode · Apr 27, 2024Theoretical Neuroscience Podcast