Saurav Muralidharan

Researcher, NVIDIA

Joined

May 2021

Names

Saurav Muralidharan (Preferred)

Emails

****@nvidia.com (Confirmed)

Personal Links

Career & Education History

Researcher

NVIDIA (nvidia.com)

2016 – Present

PhD student

University of Utah (utah.edu)

2010 – 2016

Advisors, Relations & Conflicts

PhD Advisor

2010 – 2016

Expertise

model compression

,

weight pruning

,

neural architecture search

Present

Publications

EoRA: Fine-tuning-free Compensation for Compressed LLM with Eigenspace Low-Rank Approximation
Shih-Yang Liu, Maksim Khadkevich, Nai Chit FUNG, Charbel Sakr, Chao-Han Huck Yang, Chien-Yi Wang, Saurav Muralidharan, Hongxu Yin, Kwang-Ting Cheng, Jan Kautz, Yu-Chiang Frank Wang, Pavlo Molchanov, Min-Hung Chen
- TTU at ICLR 2026 (Main)
- Readers: Everyone
EoRA: Fine-tuning-free Compensation for Compressed LLM with Eigenspace Low-Rank Approximation
Shih-Yang Liu, Maksim Khadkevich, Nai Chit FUNG, Charbel Sakr, Chao-Han Huck Yang, Chien-Yi Wang, Saurav Muralidharan, Hongxu Yin, Kwang-Ting Cheng, Jan Kautz, Yu-Chiang Frank Wang, Pavlo Molchanov, Min-Hung Chen
- ICLR 2026 Workshop ICBINB
- Readers: Everyone
Efficient Hybrid Language Model Compression through Group-Aware SSM Pruning
Ali Taghibakhshi, Sharath Turuvekere Sreenivas, Saurav Muralidharan, Marcin Chochowski, Yashaswi Karnati, Raviraj Bhuminand Joshi, Ameya Sunil Mahabaleshwarkar, ZIJIA CHEN, Yoshi Suhara, Oluwatobi Olabiyi, Daniel Korzekwa, Mostofa Patwary, Mohammad Shoeybi, Jan Kautz, Bryan Catanzaro, Ashwath Aithal, Nima Tajbakhsh, Pavlo Molchanov
- NeurIPS 2025 poster
- Readers: Everyone
UNAST: Unified framework for Neural Architecture Search for Transformers
Ilia Markov, Chenhan D. Yu, Hongxu Yin, Saurav Muralidharan, Greg Heinrich, Jan Kautz, Dan Alistarh, Pavlo Molchanov
- ICLR 2025 Conference Withdrawn Submission
- Readers: Everyone
LLM Pruning and Distillation in Practice
Sharath Turuvekere Sreenivas, Saurav Muralidharan, Raviraj Bhuminand Joshi, Marcin Chochowski, Mostofa Patwary, Pavlo Molchanov, Mohammad Shoeybi, Jan Kautz, Ameya Sunil Mahabaleshwarkar, Gerald Shen, Jiaqi Zeng, Oleksii Kuchaiev, ZIJIA CHEN, Yoshi Suhara, Shizhe Diao, Chenhan D. Yu, Wei-Chun Chen, Hayley Ross, Daniel Korzekwa, Oluwatobi Olabiyi et al. (2 additional authors not shown)
- Submitted to ICLR 2025
- Readers: Everyone
LLaMaFlex: Many-in-one LLMs via Generalized Pruning and Weight Sharing
Ruisi Cai, Saurav Muralidharan, Hongxu Yin, Zhangyang Wang, Jan Kautz, Pavlo Molchanov
- ICLR 2025 Poster
- Readers: Everyone
Compact Language Models via Pruning and Knowledge Distillation
Saurav Muralidharan, Sharath Turuvekere Sreenivas, Raviraj Bhuminand Joshi, Marcin Chochowski, Mostofa Patwary, Mohammad Shoeybi, Bryan Catanzaro, Jan Kautz, Pavlo Molchanov
- NeurIPS 2024 poster
- Readers: Everyone
MaskLLM: Learnable Semi-Structured Sparsity for Large Language Models
Gongfan Fang, Hongxu Yin, Saurav Muralidharan, Greg Heinrich, Jeff Pool, Jan Kautz, Pavlo Molchanov, Xinchao Wang
- NeurIPS 2024 spotlight
- Readers: Everyone
Flextron: Many-in-One Flexible Large Language Model
Ruisi Cai, Saurav Muralidharan, Greg Heinrich, Hongxu Yin, Zhangyang Wang, Jan Kautz, Pavlo Molchanov
- ICML 2024 Oral
- Readers: Everyone
Compact Language Models via Pruning and Knowledge Distillation
Saurav Muralidharan, Sharath Turuvekere Sreenivas, Raviraj Joshi, Marcin Chochowski, Mostofa Patwary, Mohammad Shoeybi, Bryan Catanzaro, Jan Kautz, Pavlo Molchanov
- NeurIPS 2024
- Readers: Everyone

View all 27 publications

Co-Authors

View all 76 co-authors