Amjad Almahairi

Researcher, Google

Joined

September 2016

Names

Amjad Almahairi (Preferred)

Emails

****@gmail.com (Confirmed)

****@umontreal.ca (Confirmed)

****@elementai.com (Confirmed)

****@meta.com (Confirmed)

****@anyscale.com (Confirmed)

Personal Links

Google Scholar

DBLP

Career & Education History

Researcher

Google (google.com)

2026 – Present

Researcher

Anyscale Inc. (anyscale.com)

2024 – 2025

Research Scientist

Facebook (facebook.com)

2020 – 2024

Research Scientist

Element AI (elementai.com)

2018 – 2020

Research Intern

Microsoft (microsoft.com)

2016 – 2018

PhD student

MILA-University of Montreal (umontreal.ca)

2013 – 2018

Advisors, Relations & Conflicts

Coauthor

Ion Stoica

2024 – 2025

PhD Advisor

Aaron Courville

2013 – 2018

Expertise

Agents

LLMs

VLLMs

generative models

deep learning

Present

Publications

RouteLLM: Learning to Route LLMs from Preference Data
Isaac Ong, Amjad Almahairi, Vincent Wu, Wei-Lin Chiang, Tianhao Wu, Joseph E. Gonzalez, M Waleed Kadous, Ion Stoica
- ICLR 2025 Poster
- Readers: Everyone
Llama 2: Open Foundation and Fine-Tuned Chat Models
Amjad Almahairi
- arxiv
- Readers: Everyone
Learning Easily Updated General Purpose Text Representations with Adaptable Task-Specific Prefix
Kuan-Hao Huang, Liang Tan, Rui Hou, Sinong Wang, Amjad Almahairi, Ruty Rinott
- EMNLP 2023 Findings
- Readers: Everyone
Residual Prompt Tuning: Improving Prompt Tuning with Residual Reparameterization
Amjad Almahairi
- 28 Mar 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
PROGRESSIVE PROMPTS: CONTINUAL LEARNING FOR LANGUAGE MODELS
Amjad Almahairi
- 29 Jan 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
Progressive Prompts: Continual Learning for Language Models
Anastasia Razdaibiedina, Yuning Mao, Rui Hou, Madian Khabsa, Mike Lewis, Amjad Almahairi
- Published: 01 Jan 2023, Last Modified: 01 May 2023
- CoRR 2023
- Readers: Everyone
Residual Prompt Tuning: Improving Prompt Tuning with Residual Reparameterization
Anastasia Razdaibiedina, Yuning Mao, Rui Hou, Madian Khabsa, Mike Lewis, Jimmy Ba, Amjad Almahairi
- Published: 01 Jan 2023, Last Modified: 12 May 2023
- CoRR 2023
- Readers: Everyone
Learning Easily Updated General Purpose Text Representations with Adaptable Task-Specific Prefixes
Kuan-Hao Huang, Liang Tan, Rui Hou, Sinong Wang, Amjad Almahairi, Ruty Rinott
- Published: 01 Jan 2023, Last Modified: 20 Jun 2023
- CoRR 2023
- Readers: Everyone
Llama 2: Open Foundation and Fine-Tuned Chat Models
Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton-Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller et al. (48 additional authors not shown)
- Published: 01 Jan 2023, Last Modified: 24 Aug 2023
- CoRR 2023
- Readers: Everyone
Residual Prompt Tuning: improving prompt tuning with residual reparameterization
Anastasia Razdaibiedina, Yuning Mao, Madian Khabsa, Mike Lewis, Rui Hou, Jimmy Ba, Amjad Almahairi
- Published: 01 Jan 2023, Last Modified: 24 Aug 2023
- ACL (Findings) 2023
- Readers: Everyone

View all 18 publications

Co-Authors

View all 95 co-authors