ePoster, Bernstein Conference 2024
Dendrites endow artificial neural networks with accurate, robust and parameter-efficient learning
- Goethe University, Frankfurt, Germany
- DOI 10.12751/nncn.bc2024.248 (opens in a new tab)
- Machine Learning, Deep Learning and
Poster
Poster audio
Abstract
Artificial neural networks (ANNs) form the basis of most successful Deep Learning (DL) algorithms, which are capable of solving complex problems such as image recognition and natural language processing. However, unlike biological brains, which efficiently solve similar problems, DL algorithms require a large number of adjustable parameters, making them energy-intensive and susceptible to overfitting. In this study, a new ANN architecture is introduced that incorporates the structured connectivity and restricted sampling properties of biological dendrites, aiming to overcome these limitations. The research reveals that dendritic ANNs are less prone to overfitting and outperform traditional ANNs in various image classification tasks, while also using significantly fewer adjustable parameters. This achievement is realized through the application of a distinct learning strategy where most nodes respond to multiple classes, unlike classical ANNs that pursue class-specific responses. These findings indicate that the integration of dendrites can enhance the precision, resilience, and parameter efficiency of learning in ANNs, offering insight into how biological features can influence the learning strategies of ANNs.
Topics
- Artificial neural networks, search World Wide
- Deep Learning, search World Wide
- dendritic ANNs, search World Wide
- biological dendrites, search World Wide
- structured connectivity, search World Wide
- restricted sampling, search World Wide
- image classification, search World Wide
- overfitting, search World Wide
- adjustable parameters, search World Wide
- parameter efficiency, search World Wide
Details
- Citation
- Spyridon Chavlis, Panayiota Poirazi (2024). Dendrites endow artificial neural networks with accurate, robust and parameter-efficient learning. Bernstein Conference 2024. https://doi.org/10.12751/nncn.bc2024.248 (opens in a new tab)