ePoster · Computer Vision
Using navigational information to learn visual representations
Lizhen Zhu,Brad Wyble,James Wang · COSYNE 2022
Sat, Mar 19, 2022
Children learn to build a visual representation of the world from unsupervised exploration and we hypothesize that a key part of this learning ability is the use of self-generated navigational information as a similarity label to drive a learning objective for self-supervised learning. The goal of this work is to exploit navigational information in a visual environment to provide performance in training that exceeds the state-of-the-art self-supervised training. Here, we show that using spatial and temporal information in the pretraining stage of contrastive learning can improve the performan