Publication
A collection of publications written with DevInterp in mind.
Modes of Sequence Models and Learning Coefficients
Chen and Murfet
2025-04-25
Studying Small Language Models with Susceptibilities
Baker et al.
2025-04-25
Programs as Singularities
Murfet and Troiani
2025-04-10
You Are What You Eat – AI Alignment Requires Understanding How Data Shapes Structure and Generalisation
Lehalleur et al.
2025-02-08
Structure Development in List-Sorting Transformers
Urdshals and Urdshals
2025-01-30
Dynamics of Transient Structure in In-Context Linear Regression Transformers
Carroll et al.
2025-01-29
Differentiation and Specialization of Attention Heads via the Refined Local Learning Coefficient
Wang et al.
2024-10-04
Loss landscape geometry reveals stagewise development of transformers
Wang et al.
2024-06-16
Estimating the Local Learning Coefficient at Scale
Furman and Lau
2024-02-06
The Developmental Landscape of In-Context Learning
Hoogland et al.
2024-02-04
Dynamical versus Bayesian Phase Transitions in a Toy Model of Superposition
Chen et al.
2023-10-10
The Local Learning Coefficient: A Singularity-Aware Complexity Measure
Lau et al.
2023-08-23