Topic: topologically-informed pruning

Recurrent neural networks (RNNs) have increasingly been employed to model cortical function, but conventional architectures lack biological realism. Notably, they often ignore two key biological principles: i) Dale’s Law, which constrains neurons to either be strictly excitatory or inhibitory, and ii) Sparse, structured connectivity motifs observed in the brain. Incorporating these constraints however poses challenges, as they often affect model performance negatively. Our work presents a novel approach that integrates Dale’s backpropagation, a sign-constrained training method, with topologica