Devang Naik

Joined

September 2022

Names

Devang Naik (Preferred)

Emails

****@apple.com (Confirmed)

Personal Links

Career & Education History

PhD student

Rutgers University, Newark (rutgers.edu)

1989 – 1995

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

From Dense to Dynamic: Token-Difficulty Driven MoEfication of Pre-Trained LLMs
Kumari Nishu, Sachin Mehta, Samira Abnar, Mehrdad Farajtabar, Maxwell Horton, Mahyar Najibi, Moin Nabi, Minsik Cho, Devang Naik
- SLLM
- Readers: Everyone
M2R2: EFFICIENT TRANSFORMERS WITH MIXTURE OF MULTI-RATE RESIDUALS
Nikhil Bhendawade, Mahyar Najibi, Devang Naik, Irina Belousova
- SCOPE - ICLR 2025 Oral
- Readers: Everyone
KV-Runahead: Scalable Causal LLM Inference by Parallel Key-Value Cache Generation
Minsik Cho, Mohammad Rastegari, Devang Naik
- ICML 2024 Poster
- Readers: Everyone
eDKM: An Efficient and Accurate Train-time Weight Clustering for Large Language Models
Minsik Cho, Keivan Alizadeh-Vahid, Qichen Fu, Saurabh Adya, Carlo C del Mundo, Mohammad Rastegari, Devang Naik, Peter Zatloukal
- SAGE 2023
- Readers: Everyone
PDP: Parameter-free Differentiable Pruning is All You Need
Minsik Cho, Saurabh Adya, Devang Naik
- Differentiable Almost Everything
- Readers: Everyone
PDP: Parameter-free Differentiable Pruning is All You Need
Minsik Cho, Saurabh Adya, Devang Naik
- NeurIPS 2023 poster
- Readers: Everyone

Co-Authors