Mehdi Rezagholizadeh

Principal Researcher, Generative AI Models, Advanced Micro Devices

Joined

October 2017

Names

Mehdi Rezagholizadeh (Preferred)

Emails

****@gmail.com (Confirmed)

****@huawei.com (Confirmed)

****@amd.com (Confirmed)

Personal Links

Google Scholar

ACL Anthology

Career & Education History

Principal Researcher

Generative AI Models, Advanced Micro Devices (amd.com)

2005 – Present

Principal Researcher

Noah's Ark Lab, Huawei Technologies Ltd. (huawei.com)

2017 – 2025

Advisors, Relations & Conflicts

PhD Advisor

James J. Clark

2011 – 2016

Expertise

Efficient AI

2019 – Present

Natural Language Processing

2017 – 2024

Deep Learning

2017 – 2024

Machine Learning

2009 – 2024

Computer vision

2009 – 2017

Publications

DTRNet: Dynamic Token Routing Network to Reduce Quadratic Costs in Transformers
Aman Sharma, Saeed Najafi, Parsa Farinneya, Benyamin Jamialahmadi, Marzieh S. Tahaei, Yuhe Fan, Mehdi Rezagholizadeh, Boxing Chen, Aref Jafari
- OpenReview Archive Direct Upload
- Readers: Everyone
Towards fine-tuning pre-trained language models with integer forward and backward propagation
Mohammadreza Tayaranian, Alireza Ghaffari, Marzieh S. Tahaei, Mehdi Rezagholizadeh, Masoud Asgharian, Vahid Partovi Nia
- Findings of the Association for Computational Linguistics: EACL 2023
- Readers: Everyone
EWEK-QA : Enhanced Web and Efficient Knowledge Graph Retrieval for Citation-based Question Answering Systems
Mohammad Dehghan, Mohammad Ali Alomrani, Sunyam Bagga, David Alfonso-Hermelo, Khalil Bibi, Abbas Ghaddar, Yingxue Zhang, Xiaoguang Li, Jianye HAO, Qun Liu, Jimmy Lin, Boxing Chen, Prasanna Parthasarathi, Mahdi Biparva, Mehdi Rezagholizadeh
- Association for Computational Linguistics
- Readers: Everyone
The Order Effect: Investigating Prompt Sensitivity to Input Order in LLMs
Bryan Guan, Mehdi Rezagholizadeh, Tanya G. Roosta, Peyman Passban
- KDD 2025 Workshop on Prompt Optimization Poster
- Readers: Everyone
Zebra-Llama: Towards Extremely Efficient Hybrid Models
Mingyu Yang, Mehdi Rezagholizadeh, Guihong Li, Vikram Appia, Emad Barsoum
- NeurIPS 2025 poster
- Readers: Everyone
Batch-Max: Higher LLM Throughput using Larger Batch Sizes and KV Cache Compression
Michael R. Metel, Boxing Chen, Mehdi Rezagholizadeh
- ES-FoMo III
- Readers: Everyone
X-EcoMLA: Upcycling Pre-Trained Attention into MLA for Efficient and Extreme KV Compression
Guihong Li, Mehdi Rezagholizadeh, Mingyu Yang, Vikram Appia, Emad Barsoum
- COLM 2025
- Readers: Everyone
Do we need Label Regularization to Fine-tune Pre-trained Language Models?
Ivan Kobyzev, Aref Jafari, Mehdi Rezagholizadeh, Tianda Li, Alan Do-Omri, Peng Lu, Pascal Poupart, Ali Ghodsi
- 15 Dec 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
Continuation KD: Improved Knowledge Distillation through the Lens of Continuation Optimization
Aref Jafari, Ivan Kobyzev, Mehdi Rezagholizadeh, Pascal Poupart, Ali Ghodsi
- 15 Dec 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
Annealing knowledge distillation
Aref Jafari, Mehdi Rezagholizadeh, Pranav Sharma, Ali Ghodsi
- 15 Dec 2023
- OpenReview Archive Direct Upload
- Readers: Everyone

View all 25 publications

Co-Authors

View all 58 co-authors