Bayesian Influence Functions for Hessian-Free Data Attribution
September 30, 2025 | Kreer et al.
Classical influence functions face significant challenges when applied to deep neural networks, prim...
You Are What You Eat – AI Alignment Requires Understanding How Data Shapes Structure and Generalisation
February 8, 2025 | Lehalleur et al.
In this position paper, we argue that understanding the relation between structure in the data distr...
Loss landscape geometry reveals stagewise development of transformers
June 16, 2024 | Wang et al. | ICML HiLD Workshop | Best Paper
The development of the internal structure of neural networks throughout training occurs in tandem wi...
Loss Landscape Degeneracy and Stagewise Development of Transformers
February 4, 2024 | Hoogland et al. | TMLR | Best Paper at 2024 ICML HiLD Workshop
We show that in-context learning emerges in transformers in discrete developmental stages, when they...
September 2025
Bayesian Influence Functions for Hessian-Free Data Attribution
September 30, 2025 | Kreer et al.
Classical influence functions face significant challenges when applied to deep neural networks, prim...
August 2025
July 2025
April 2025
February 2025
You Are What You Eat – AI Alignment Requires Understanding How Data Shapes Structure and Generalisation
February 8, 2025 | Lehalleur et al.
In this position paper, we argue that understanding the relation between structure in the data distr...
January 2025
October 2024
June 2024
Loss landscape geometry reveals stagewise development of transformers
June 16, 2024 | Wang et al. | ICML HiLD Workshop | Best Paper
The development of the internal structure of neural networks throughout training occurs in tandem wi...
February 2024
Loss Landscape Degeneracy and Stagewise Development of Transformers
February 4, 2024 | Hoogland et al. | TMLR | Best Paper at 2024 ICML HiLD Workshop
We show that in-context learning emerges in transformers in discrete developmental stages, when they...