Daniele Calandriello

Researcher, DeepMind

Joined

April 2017

Names

Emails

****@inria.fr (Confirmed)

****@gmail.com (Confirmed)

****@iit.it (Confirmed)

****@google.com (Confirmed)

Personal Links

DBLP

Career & Education History

Researcher

DeepMind (deepmind.com)

2020 – Present

Postdoc

Università degli Studi di Genova, Istituto Italiano di Tecnologia (iit.it)

2018 – 2020

PhD student

INRIA (inria.fr)

2015 – 2018

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

On Teacher Hacking in Language Model Distillation
Daniil Tiapkin, Daniele Calandriello, Johan Ferret, Sarah Perrin, Nino Vieillard, Alexandre Rame, Mathieu Blondel
- ICML 2025 poster
- Readers: Everyone
Building Math Agents with Multi-Turn Iterative Preference Learning
Wei Xiong, Chengshuai Shi, Jiaming Shen, Aviv Rosenberg, Zhen Qin, Daniele Calandriello, Misha Khalman, Rishabh Joshi, Bilal Piot, Mohammad Saleh, Chi Jin, Tong Zhang, Tianqi Liu
- ICLR 2025 Poster
- Readers: Everyone
Multi-turn Reinforcement Learning with Preference Human Feedback
Lior Shani, Aviv Rosenberg, Asaf Cassel, Oran Lang, Daniele Calandriello, Avital Zipori, Hila Noga, Orgad Keller, Bilal Piot, Idan Szpektor, Avinatan Hassidim, Yossi Matias, Remi Munos
- NeurIPS 2024 poster
- Readers: Everyone
Decoding-time Realignment of Language Models
Tianlin Liu, Shangmin Guo, Leonardo Bianco, Daniele Calandriello, Quentin Berthet, Felipe Llinares-López, Jessica Hoffmann, Lucas Dixon, Michal Valko, Mathieu Blondel
- ICML 2024 Spotlight
- Readers: Everyone
Human Alignment of Large Language Models through Online Preference Optimisation
Daniele Calandriello, Zhaohan Daniel Guo, Remi Munos, Mark Rowland, Yunhao Tang, Bernardo Avila Pires, Pierre Harvey Richemond, Charline Le Lan, Michal Valko, Tianqi Liu, Rishabh Joshi, Zeyu Zheng, Bilal Piot
- ICML 2024 Poster
- Readers: Everyone
Generalized Preference Optimization: A Unified Approach to Offline Alignment
Yunhao Tang, Zhaohan Daniel Guo, Zeyu Zheng, Daniele Calandriello, Remi Munos, Mark Rowland, Pierre Harvey Richemond, Michal Valko, Bernardo Avila Pires, Bilal Piot
- ICML 2024 Poster
- Readers: Everyone
Nash Learning from Human Feedback
Remi Munos, Michal Valko, Daniele Calandriello, Mohammad Gheshlaghi Azar, Mark Rowland, Zhaohan Daniel Guo, Yunhao Tang, Matthieu Geist, Thomas Mesnard, Côme Fiegel, Andrea Michi, Marco Selvi, Sertan Girgin, Nikola Momchev, Olivier Bachem, Daniel J Mankowitz, Doina Precup, Bilal Piot
- ICML 2024 Spotlight
- Readers: Everyone
Unlocking the Power of Representations in Long-term Novelty-based Exploration
Steven Kapturowski, Alaa Saade, Daniele Calandriello, Charles Blundell, Pablo Sprechmann, Leopoldo Sarra, Oliver Groth, Michal Valko, Bilal Piot
- ALOE 2023 Poster
- Readers: Everyone
Demonstration-Regularized RL
Daniil Tiapkin, Denis Belomestny, Daniele Calandriello, Eric Moulines, Alexey Naumov, Pierre Perrault, Michal Valko, Pierre Menard
- ICLR 2024 poster
- Readers: Everyone
Unlocking the Power of Representations in Long-term Novelty-based Exploration
Alaa Saade, Steven Kapturowski, Daniele Calandriello, Charles Blundell, Pablo Sprechmann, Leopoldo Sarra, Oliver Groth, Michal Valko, Bilal Piot
- ICLR 2024 spotlight
- Readers: Everyone

View all 27 publications

Co-Authors

View all 89 co-authors