56 min
How Linguistics Learned to Stop Worrying and Love the Language Models
Computational Linguistics, Linguistics, Psycholinguistics and seminar by Kyle Mahowald, UT Austin
Tuesday 09:30–10:30 Los Angeles (GMT-8)
Recording available
Recording
Abstract
What can fluent language models tell us about linguistic structure and human language learning? Kyle Mahowald evaluates two opposing positions: that models do not learn language in a way relevant to people, and that their success makes linguistic theory unnecessary. Drawing on a position paper with Richard Futrell, he argues that language models provide useful evidence about structure, processing and acquisition while leaving an essential role for theory. The talk examines grammaticality judgments in language models and controlled pretraining experiments in which small models learn from systematically manipulated corpora. These methods allow researchers to revisit claims about learning and identify which properties of the input support linguistic generalisation.
Topics
Related seminars
Why it Matters That Babies and Language Models are the Only Known Language Learners
Video · 1 h 7 min · Captions · Feb 4, 2025Alex Warstadt, UC San DiegoThe Expressive Power of Large Language Models
Dec 7, 2026Gabriel Peyré, CNRS and École Normale Supérieure, ParisDo large language models solve verbal analogies like children do?
Video · 31 min · Nov 17, 2022Claire Stevenson, University of Amsterdam
More from Simons Institute for the Theory of Computing
All talksPractical Matrix Multiplication
Video · 1 h 12 min · Captions · Sep 18, 2025Oded SchwartzMore accurate behavioral predictions with hybrid Bayesian-Transformer models
Video · 1 h 2 min · Captions · Feb 5, 2025Brenden LakeA Bi-metric Framework for Fast Similarity Search
Video · 38 min · Captions · Jun 21, 2024Piotr IndykWhen Hashes Met Wedges - A Distributed Algorithm for Finding High Similarity Vectors
Video · 42 min · Nov 30, 2018C. Seshadhri