1 h 7 min
Why it Matters That Babies and Language Models are the Only Known Language Learners
Computational Linguistics, Cognition, Machine Learning and seminar by Alex Warstadt, UC San Diego
Tuesday 11:00–12:00 Los Angeles (GMT-8)
Recording available
Recording
Abstract
Small language models trained on limited data can provide economical, controlled simulations for studying human language acquisition. Alex Warstadt discusses the BabyLM Challenge and its goals of improving data efficiency, cognitive plausibility and accessibility. Studies from his UC San Diego lab train models from scratch under controlled conditions to investigate critical periods in second-language learning, inductive biases behind cross-linguistic patterns, and distributional signatures of word-learning trajectories. Comparing cases where these models resemble human learners with cases where they diverge helps locate human language acquisition within a broader space of possible learning systems. The approach supports fundamental work across machine learning, linguistics and cognitive science.
Topics
Related seminars
How Linguistics Learned to Stop Worrying and Love the Language Models
Video · 56 min · Captions · Feb 4, 2025Kyle Mahowald, UT AustinDo large language models solve verbal analogies like children do?
Video · 31 min · Nov 17, 2022Claire Stevenson, University of AmsterdamA Comprehensive Overview of Large Language Models
Video · 55 min · Mar 15, 2024
More from Simons Institute for the Theory of Computing
All talksPractical Matrix Multiplication
Video · 1 h 12 min · Captions · Sep 18, 2025Oded SchwartzMore accurate behavioral predictions with hybrid Bayesian-Transformer models
Video · 1 h 2 min · Captions · Feb 5, 2025Brenden LakeA Bi-metric Framework for Fast Similarity Search
Video · 38 min · Captions · Jun 21, 2024Piotr IndykWhen Hashes Met Wedges - A Distributed Algorithm for Finding High Similarity Vectors
Video · 42 min · Nov 30, 2018C. Seshadhri