Topic: functional representation learning

Learning in the brain is thought to be largely unsupervised since the bulk of an animal’s natural experience arrives neither with associated reinforcement signals nor explicit supervisory signals. A compelling account of unsupervised learning in animals is provided by the notion that the brain learns by trying to predict the future, thereby identifying statistical redundancies in sensory inputs over time. Based on this principle, self-supervised learning (SSL) techniques have enabled deep artificial neural networks (ANNs) to achieve competitive results on challenging perceptual tasks. SSL atte