Topic: Contrastive Language Image Pretraining

Cameras allow recording animal behavior with high temporal and spatial resolution. However, cameras also produce large amounts of data, which become time-consuming to annotate. Hence, recent research has turned to machine-learning-assisted tools to automate animal behavior labeling. Existing Deep Learning methods commonly use a fixed set of behavioral classes and require many labeled instances per class to be trained. Large pretrained vision-language models, such as Contrastive Language Image Pretraining (CLIP), offer great promises to improve and facilitate this annotation process: natural la