Björn Deiseroth

Researcher, Aleph Alpha

Joined

August 2022

Names

Björn Deiseroth (Preferred)

Bjoern Deiseroth

Emails

****@tu-darmstadt.de (Confirmed)

****@gmail.com (Confirmed)

****@aleph-alpha-ip.ai (Confirmed)

****@aleph-alpha-research.com (Confirmed)

Personal Links

Google Scholar

DBLP

ACL Anthology

Career & Education History

Researcher

Aleph Alpha (aleph-alpha.com)

2021 – Present

PhD student

Technische Universität Darmstadt (tu-darmstadt.de)

2021 – 2025

Advisors, Relations & Conflicts

PhD Advisor

Kristian Kersting

2021 – 2025

Expertise

interpretable language models

2021 – Present

Publications

AtManRL: Towards Faithful Reasoning via Differentiable Attention Saliency
Max Henning Höth, Kristian Kersting, Björn Deiseroth, Letitia Parcalabescu
- ICLR 2026 Workshop LLM Reasoning
- Readers: Everyone
$\texttt{LIME}$: Making LLM Data More Efficient with Linguistic Metadata Embeddings
Sebastian Sztwiertnia, Felix Friedrich, Kristian Kersting, Patrick Schramowski, Björn Deiseroth
- Submitted to ICLR 2026
- Readers: Everyone
Measuring and Guiding Monosemanticity
Ruben Härle, Felix Friedrich, Manuel Brack, Björn Deiseroth, Stephan Waeldchen, Patrick Schramowski, Kristian Kersting
- NeurIPS 2025 spotlight
- Readers: Everyone
u-$\mu$P: The Unit-Scaled Maximal Update Parametrization
Charlie Blake, Constantin Eichenberg, Josef Dean, Lukas Balles, Luke Yuri Prince, Björn Deiseroth, Andres Felipe Cruz-Salinas, Carlo Luschi, Samuel Weinbach, Douglas Orr
- NeurIPS 2024 Workshop
- Readers: Everyone
Hierarchical Autoregressive Transformers: Combining Byte- and Word-Level Processing for Robust, Adaptable Language Models
Pit Neitemeier, Björn Deiseroth, Constantin Eichenberg, Lukas Balles
- ICLR 2025 Poster
- Readers: Everyone
u-$\mu$P: The Unit-Scaled Maximal Update Parametrization
Charlie Blake, Constantin Eichenberg, Josef Dean, Lukas Balles, Luke Yuri Prince, Björn Deiseroth, Andres Felipe Cruz-Salinas, Carlo Luschi, Samuel Weinbach, Douglas Orr
- ICLR 2025 Spotlight
- Readers: Everyone
SCAR: Sparse Conditioned Autoencoders for Concept Detection and Steering in LLMs
Ruben Härle, Felix Friedrich, Manuel Brack, Björn Deiseroth, Patrick Schramowski, Kristian Kersting
- SoLaR Poster
- Readers: Everyone
u-μP: The Unit-Scaled Maximal Update Parametrization
Charlie Blake, Constantin Eichenberg, Josef Dean, Lukas Balles, Luke Yuri Prince, Björn Deiseroth, Andres Felipe Cruz-Salinas, Carlo Luschi, Samuel Weinbach, Douglas Orr
- WANT@ICML 2024 Poster
- Readers: Everyone
u-μP: The Unit-Scaled Maximal Update Parametrization
Charlie Blake, Constantin Eichenberg, Josef Dean, Lukas Balles, Luke Yuri Prince, Björn Deiseroth, Andres Felipe Cruz-Salinas, Carlo Luschi, Samuel Weinbach, Douglas Orr
- HiLD at ICML 2024 Poster
- Readers: Everyone
Mechanistic Design and Scaling of Hybrid Architectures
Michael Poli, Armin W Thomas, Eric Nguyen, Pragaash Ponnusamy, Björn Deiseroth, Kristian Kersting, Taiji Suzuki, Brian Hie, Stefano Ermon, Christopher Re, Ce Zhang, Stefano Massaroli
- ICML 2024 Poster
- Readers: Everyone

View all 27 publications

Co-Authors

View all 58 co-authors