Rohan Anil

Joined

October 2017

Names

Rohan Anil

Emails

****@google.com (Confirmed)

Personal Links

DBLP

Career & Education History

Distinguished Engineer

Gemini, Google (google.com)

2013 – 2025

Undergrad student

Google, BITS Pilani, Dhirubhai Ambani Institute Of Information and Communication Technology (bits-pilani.ac.in)

2006 – 2010

Advisors, Relations & Conflicts

No relations added

Expertise

optimization

hardware software codesign for DNN

2015 – Present

distillation

model compression

2015 – Present

Publications

A Little Help Goes a Long Way: Efficient LLM Training by Leveraging Small LMs
Ankit Singh Rawat, Veeranjaneyulu Sadhanala, Afshin Rostamizadeh, Ayan Chakrabarti, Wittawat Jitkrittum, Vladimir Feinberg, Seungyeon Kim, Hrayr Harutyunyan, Nikunj Saunshi, Zachary Nado, Rakesh Shivanna, Sashank J. Reddi, Aditya Krishna Menon, Rohan Anil, Sanjiv Kumar
- Submitted to ICLR 2026
- Readers: Everyone
Fast and Simplex: 2-Simplicial Attention in Triton
Aurko Roy, Timothy Chou, Sai Surya Duvvuri, Sijia Chen, Jiecao Yu, Xiaodong Wang, Ying Zhang, Manzil Zaheer, Rohan Anil
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
A Little Help Goes a Long Way: Efficient LLM Training by Leveraging Small LMs
Ankit Singh Rawat, Veeranjaneyulu Sadhanala, Afshin Rostamizadeh, Ayan Chakrabarti, Wittawat Jitkrittum, Vladimir Feinberg, Seungyeon Kim, Hrayr Harutyunyan, Nikunj Saunshi, Zachary Nado, Rakesh Shivanna, Sashank J. Reddi, Aditya Krishna Menon, Rohan Anil, Sanjiv Kumar
- Submitted to ICLR 2025
- Readers: Everyone
Combining Axes Preconditioners through Kronecker Approximation for Deep Learning
Sai Surya Duvvuri, Fnu Devvrit, Rohan Anil, Cho-Jui Hsieh, Inderjit S Dhillon
- ICLR 2024 poster
- Readers: Everyone
Sketchy: Memory-efficient Adaptive Regularization with Frequent Directions
Vladimir Feinberg, Xinyi Chen, Y. Jennifer Sun, Rohan Anil, Elad Hazan
- NeurIPS 2023 poster
- Readers: Everyone
A Computationally Efficient Sparsified Online Newton Method
Fnu Devvrit, Sai Surya Duvvuri, Rohan Anil, Vineet Gupta, Cho-Jui Hsieh, Inderjit S Dhillon
- NeurIPS 2023 poster
- Readers: Everyone
Wide and Deep learning for Recommender Systems
Rohan Anil
- 16 Feb 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
Fishy: Layerwise Fisher Approximation for Higher-order Neural Network Optimization
Abel Peirson, Ehsan Amid, Yatong Chen, Vladimir Feinberg, Manfred K Warmuth, Rohan Anil
- Published: 20 Oct 2022, Last Modified: 05 May 2023
- HITY Workshop NeurIPS 2022
- Readers: Everyone
Layerwise Bregman Representation Learning of Neural Networks with Applications to Knowledge Distillation
Ehsan Amid, Rohan Anil, Christopher Fifty, Manfred K Warmuth
- Accepted by TMLR
- Readers: Everyone
A Computationally Efficient Sparsified Online Newton Method
Fnu Devvrit, Sai Surya Duvvuri, Rohan Anil, Vineet Gupta, Cho-Jui Hsieh, Inderjit S Dhillon
- Published: 01 Feb 2023, Last Modified: 14 Jan 2026
- Submitted to ICLR 2023
- Readers: Everyone

View all 24 publications

Co-Authors

View all 127 co-authors