1 h 30 min
Seminar, Hosted by Simons Institute for the Theory of Computing
Toward Understanding In-context Learning
Stanford University
Recording
Abstract
Tengyu Ma introduces prompt-based learning from input-output examples in large language models and surveys theoretical work on simplified distributions. The focus is on how a model can learn to solve a new task from examples in context while its parameters stay fixed.