Joan Puigcerver

Researcher, Google

Joined

November 2016

Names

Joan Puigcerver (Preferred)

Emails

****@gmail.com (Confirmed)

****@upv.es (Confirmed)

****@google.com (Confirmed)

Personal Links

Homepage

Google Scholar

DBLP

Career & Education History

Researcher

Google (google.com)

2018 – Present

PhD student

Universitat Politècnica de València (upv.es)

2013 – 2018

Advisors, Relations & Conflicts

PhD Advisor

Enrique Vidal

2012 – 2018

Expertise

Mixture of Experts

2020 – Present

Deep Learning

2013 – Present

Transfer Learning

2018 – 2020

Publications

Routers in Vision Mixture of Experts: An Empirical Study
Tianlin Liu, Mathieu Blondel, Carlos Riquelme Ruiz, Joan Puigcerver
- Accepted by TMLR
- Readers: Everyone
From Sparse to Soft Mixtures of Experts
Joan Puigcerver, Carlos Riquelme Ruiz, Basil Mustafa, Neil Houlsby
- ICLR 2024 spotlight
- Readers: Everyone
Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution
Mostafa Dehghani, Basil Mustafa, Josip Djolonga, Jonathan Heek, Matthias Minderer, Mathilde Caron, Andreas Peter Steiner, Joan Puigcerver, Robert Geirhos, Ibrahim Alabdulmohsin, Avital Oliver, Piotr Padlewski, Alexey A. Gritsenko, Mario Lucic, Neil Houlsby
- NeurIPS 2023 poster
- Readers: Everyone
Scaling Vision Transformers to 22 Billion Parameters
Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Peter Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang, Carlos Riquelme Ruiz, Matthias Minderer, Joan Puigcerver, Utku Evci, Manoj Kumar et al. (22 additional authors not shown)
- ICML 2023 OralPoster
- Readers: Everyone
Fast, Differentiable and Sparse Top-k: a Convex Analysis Perspective
Michael Eli Sander, Joan Puigcerver, Josip Djolonga, Gabriel Peyré, Mathieu Blondel
- ICML 2023 Poster
- Readers: Everyone
Scaling Vision Transformers to 22 Billion Parameters
Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang, Carlos Riquelme, Matthias Minderer, Joan Puigcerver, Utku Evci, Manoj Kumar et al. (22 additional authors not shown)
- 2023 (modified: 02 Apr 2023)
- CoRR 2023
- Readers: Everyone
Fast, Differentiable and Sparse Top-k: a Convex Analysis Perspective
Michael E. Sander, Joan Puigcerver, Josip Djolonga, Gabriel Peyré, Mathieu Blondel
- 2023 (modified: 17 Apr 2023)
- CoRR 2023
- Readers: Everyone
Sparsity-Constrained Optimal Transport
Tianlin Liu, Joan Puigcerver, Mathieu Blondel
- 17 Nov 2022
- OpenReview Archive Direct Upload
- Readers: Everyone
Pali: A jointly-scaled multilingual language-image model
Xi Chen, Xiao Wang, Soravit Changpinyo, AJ Piergiovanni, Piotr Padlewski, Daniel Salz, Sebastian Goodman, Adam Grycner, Basil Mustafa, Lucas Beyer, Alexander Kolesnikov, Joan Puigcerver, Nan Ding, Keran Rong, Hassan Akbari, Gaurav Mishra, Linting Xue, Ashish V Thapliyal, James Bradbury, Weicheng Kuo et al. (9 additional authors not shown)
- 16 Nov 2022
- OpenReview Archive Direct Upload
- Readers: Everyone
Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints
Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, Carlos Riquelme Ruiz, Basil Mustafa, Joshua Ainslie, Yi Tay, Mostafa Dehghani, Neil Houlsby
- Published: 01 Feb 2023, Last Modified: 14 Jan 2026
- ICLR 2023 poster
- Readers: Everyone

View all 35 publications

Co-Authors

View all 97 co-authors