Carlos Riquelme Ruiz

Researcher, Google

Joined

October 2017

Names

Carlos Riquelme Ruiz

Emails

****@google.com (Confirmed)

,

****@gmail.com (Confirmed)

Personal Links

Career & Education History

Researcher

Google (google.com)

2017 – Present

Advisors, Relations & Conflicts

PhD Advisor

2012 – 2017

Expertise

large language models

2017 – 2023

Publications

Routers in Vision Mixture of Experts: An Empirical Study
Tianlin Liu, Mathieu Blondel, Carlos Riquelme Ruiz, Joan Puigcerver
- Accepted by TMLR
- Readers: Everyone
From Sparse to Soft Mixtures of Experts
Joan Puigcerver, Carlos Riquelme Ruiz, Basil Mustafa, Neil Houlsby
- ICLR 2024 spotlight
- Readers: Everyone
Scaling Laws for Sparsely-Connected Foundation Models
Elias Frantar, Carlos Riquelme Ruiz, Neil Houlsby, Dan Alistarh, Utku Evci
- ICLR 2024 spotlight
- Readers: Everyone
Scaling Vision Transformers to 22 Billion Parameters
Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Peter Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang, Carlos Riquelme Ruiz, Matthias Minderer, Joan Puigcerver, Utku Evci, Manoj Kumar et al. (22 additional authors not shown)
- ICML 2023 OralPoster
- Readers: Everyone
Pali: A jointly-scaled multilingual language-image model
Xi Chen, Xiao Wang, Soravit Changpinyo, AJ Piergiovanni, Piotr Padlewski, Daniel Salz, Sebastian Goodman, Adam Grycner, Basil Mustafa, Lucas Beyer, Alexander Kolesnikov, Joan Puigcerver, Nan Ding, Keran Rong, Hassan Akbari, Gaurav Mishra, Linting Xue, Ashish V Thapliyal, James Bradbury, Weicheng Kuo et al. (9 additional authors not shown)
- 16 Nov 2022
- OpenReview Archive Direct Upload
- Readers: Everyone
Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints
Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, Carlos Riquelme Ruiz, Basil Mustafa, Joshua Ainslie, Yi Tay, Mostafa Dehghani, Neil Houlsby
- Published: 01 Feb 2023, Last Modified: 14 Jan 2026
- ICLR 2023 poster
- Readers: Everyone
PaLI: A Jointly-Scaled Multilingual Language-Image Model
Xi Chen, Xiao Wang, Soravit Changpinyo, AJ Piergiovanni, Piotr Padlewski, Daniel Salz, Sebastian Goodman, Adam Grycner, Basil Mustafa, Lucas Beyer, Alexander Kolesnikov, Joan Puigcerver, Nan Ding, Keran Rong, Hassan Akbari, Gaurav Mishra, Linting Xue, Ashish V Thapliyal, James Bradbury, Weicheng Kuo et al. (9 additional authors not shown)
- Published: 01 Feb 2023, Last Modified: 14 Jan 2026
- ICLR 2023 notable top 5%
- Readers: Everyone
Sparse MoEs meet Efficient Ensembles
James Urquhart Allingham, Florian Wenzel, Zelda E Mariet, Basil Mustafa, Joan Puigcerver, Neil Houlsby, Ghassen Jerfel, Vincent Fortuin, Balaji Lakshminarayanan, Jasper Snoek, Dustin Tran, Carlos Riquelme Ruiz, Rodolphe Jenatton
- Accepted by TMLR
- Readers: Everyone
On the Adversarial Robustness of Mixture of Experts
Joan Puigcerver, Rodolphe Jenatton, Carlos Riquelme Ruiz, Pranjal Awasthi, Srinadh Bhojanapalli
- Published: 31 Oct 2022, Last Modified: 08 Feb 2026
- NeurIPS 2022 Accept
- Readers: Everyone
Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts
Basil Mustafa, Carlos Riquelme Ruiz, Joan Puigcerver, Rodolphe Jenatton, Neil Houlsby
- Published: 31 Oct 2022, Last Modified: 13 Jan 2023
- NeurIPS 2022 Accept
- Readers: Everyone

View all 16 publications

Co-Authors

View all 82 co-authors