Skip to contentSkip to filters

We use cookies for analytics.

In-Context Learning: A Case Study of Simple Function Classes

Gregory Valiant

Stanford University

Recording

1 h 4 min

Abstract

Gregory Valiant compares how transformers and recurrent architectures learn functions from input-output examples embedded in the prompt. The talk uses linear and sparse linear functions and small decision trees to examine training efficiency, evaluation methods and differences between architectures. It also discusses whether regression and similar primitives help explain in-context learning in language tasks.

Topics