Skip to contentSkip to filters

We use cookies for analytics.

Generalization in the representations and computations of frontier language models.

Joshua Batson

Anthropic

Recording

52 min

Abstract

Joshua Batson examines how frontier language models reuse representations across languages, encodings and analogies while remaining sensitive to superficial changes in reasoning prompts. He introduces superposition and sparse autoencoders, illustrates features recovered from a frontier model, and poses questions about how representation geometry affects computation, training and reliability.

Topics