Topic: representation learning

Representation learning underlies visual search, retrieval and recognition by encoding gallery images and matching them with queries. Most early work assumes a fixed model, but new training data or more expressive architectures can change the feature representation. Recomputing every gallery vector after an update is expensive for collections containing billions of images and may be impossible when the original images are unavailable because of privacy or storage restrictions. Compatible representation learning aims to update the model while retaining usable existing gallery features. The talk

Develop pretrained models of functional, diffusion and structural MRI that predict individual cognition with calibrated uncertainty. The ANR-funded MIND–GIN Bordeaux collaboration combines preprocessing and harmonization of large datasets, generative and self-supervised models, and transfer to smaller cognitive-neuroscience studies. The doctorate will release open pipelines and benchmarks. Python and PyTorch or JAX, probability, statistics and representation learning are required; neuroimaging and large-scale computing experience are desirable. Appointment: 3 years; advertised start 2027-01-01

Developing scientifically-grounded theories for representation learning and generalization in artificial deep neural networks remains a grand challenge of fundamental interest to theoretical neuroscience and machine learning. I will discuss our work on one facet of this challenge — namely understanding generalization or “scaling laws” in learned neural networks as a function of basic control variables. I’ll discuss a taxonomy we develop that classifies different regimes of scaling behavior. We identify regimes where generalization exhibits universal scaling behavior and others where it can be

Children learn to build a visual representation of the world from unsupervised exploration and we hypothesize that a key part of this learning ability is the use of self-generated navigational information as a similarity label to drive a learning objective for self-supervised learning. The goal of this work is to exploit navigational information in a visual environment to provide performance in training that exceeds the state-of-the-art self-supervised training. Here, we show that using spatial and temporal information in the pretraining stage of contrastive learning can improve the performan

How can neural networks learn to efficiently represent complex and high-dimensional inputs via local plasticity mechanisms? Classical models of representation learning assume that input weights are learned via pairwise Hebbian-like plasticity. Here, we show that pairwise Hebbian-like plasticity only works under specific requirements on neural dynamics and input statistics. To overcome these limitations, we derive from first principles a learning scheme based on voltage-dependent synaptic plasticity rules. Here, inhibition learns to locally balance excitatory input in individual dendritic compa

Irina is a research scientist at DeepMind, where she works in the Froniers team. Her work aims to bring together insights from the fields of neuroscience and physics to advance general artificial intelligence through improved representation learning. Before joining DeepMind, Irina was a British Psychological Society Undergraduate Award winner for her achievements as an undergraduate student in Experimental Psychology at Westminster University, followed by a DPhil at the Oxford Centre for Computational Neuroscience and Artificial Intelligence, where she focused on understanding the computationa