Arthur Szlam

Joined

November 2022

Names

Arthur Szlam (Preferred)

Emails

****@google.com (Confirmed)

Personal Links

Career & Education History

Researcher

GDM, Google (google.com)

2022 – 2025

Researcher

FAIR, Facebook (fb.com)

2014 – 2022

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo
Zachary Charles, Gabriel Teston, Lucio M. Dery, J Keith Rush, Nova Fallen, Zachary Garrett, Arthur Szlam, Arthur Douillard
- NeurIPS 2025 spotlight
- Readers: Everyone
Streaming DiLoCo with overlapping communication
Arthur Douillard, Yani Donchev, J Keith Rush, Satyen Kale, Zachary Charles, Gabriel Teston, Zachary Garrett, Jiajun Shen, Ross McIlroy, David Lacey, Alexandre Rame, Arthur Szlam, MarcAurelio Ranzato, Paul R Barham
- COLM 2025
- Readers: Everyone
Deliberation in Latent Space via Differentiable Cache Augmentation
Luyang Liu, Jonas Pfeiffer, Jiaxing Wu, Jun Xie, Arthur Szlam
- ICML 2025 poster
- Readers: Everyone
Asynchronous Local-SGD Training for Language Modeling
Bo Liu, Rachita Chhaparia, Arthur Douillard, Satyen Kale, Andrei Alex Rusu, Jiajun Shen, Arthur Szlam, MarcAurelio Ranzato
- WANT@ICML 2024 Oral
- Readers: Everyone
DiLoCo: Distributed Low-Communication Training of Language Models
Arthur Douillard, Qixuan Feng, Andrei Alex Rusu, Rachita Chhaparia, Yani Donchev, Adhiguna Kuncoro, MarcAurelio Ranzato, Arthur Szlam, Jiajun Shen
- WANT@ICML 2024 Poster
- Readers: Everyone
Compositional Interfaces for Compositional Generalization
Jelena Luketina, Jack Lanchantin, Sainbayar Sukhbaatar, Arthur Szlam
- Submitted to ICLR 2024
- Readers: Everyone
Compositional Interfaces for Compositional Generalization
Jelena Luketina, Jack Lanchantin, Sainbayar Sukhbaatar, Arthur Szlam
- ES-FoMO 2023 Poster
- Readers: Everyone

Co-Authors

View all 27 co-authors