Dendrites endow artificial neural networks with accurate, robust and parameter-efficient learning
Spyridon Chavlis, Panayiota Poirazi
Poster
Poster audio
Abstract
Artificial neural networks (ANNs) form the basis of most successful Deep Learning (DL) algorithms, which are capable of solving complex problems such as image recognition and natural language processing. However, unlike biological brains, which efficiently solve similar problems, DL algorithms require a large number of adjustable parameters, making them energy-intensive and susceptible to overfitting. In this study, a new ANN architecture is introduced that incorporates the structured connectivity and restricted sampling properties of biological dendrites, aiming to overcome these limitations. The research reveals that dendritic ANNs are less prone to overfitting and outperform traditional ANNs in various image classification tasks, while also using significantly fewer adjustable parameters. This achievement is realized through the application of a distinct learning strategy where most nodes respond to multiple classes, unlike classical ANNs that pursue class-specific responses. These findings indicate that the integration of dendrites can enhance the precision, resilience, and parameter efficiency of learning in ANNs, offering insight into how biological features can influence the learning strategies of ANNs.
Details
- Cite
- Spyridon Chavlis, Panayiota Poirazi (2024). Dendrites endow artificial neural networks with accurate, robust and parameter-efficient learning. Bernstein Conference 2024. https://doi.org/10.12751/nncn.bc2024.248 (opens in a new tab)
Related Posters
Dendritic computation: A comprehensive review of current biological and computational developments
Co-Design of Analog Neuromorphic Systems and Cortical Motifs with Local Dendritic Learning Rules
Continual learning using dendritic modulations on view-invariant feedforward weights