Dwaraknath Gnaneshwar

Joined

October 2020

Names

Dwaraknath Gnaneshwar (Preferred)

Emails

****@gmail.com (Confirmed)

Personal Links

Career & Education History

Undergrad student

Manipal Institute of Technology (manipal.edu)

2017 – 2021

Advisors, Relations & Conflicts

No relations added

Expertise

Deep Learning

,

Sparse Neural Networks

,

Uncertainty

,

Computer Vision

,

Graph Neural Networks

,

Natural Language Processing

2017 – 2021

Publications

Rope to Nope and Back Again: A New Hybrid Attention Strategy
Bowen Yang, Bharat Venkitesh, Dwaraknath Gnaneshwar, Hangyu Lin, David Cairuz, Phil Blunsom, Acyr Locatelli
- NeurIPS 2025 poster
- Readers: Everyone
Procedural Knowledge in Pretraining Drives Reasoning in Large Language Models
Laura Ruis, Maximilian Mozes, Juhan Bae, Siddhartha Rao Kamalakara, Dwaraknath Gnaneshwar, Acyr Locatelli, Robert Kirk, Tim Rocktäschel, Edward Grefenstette, Max Bartolo
- ICLR 2025 Poster
- Readers: Everyone
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts
Qizhen Zhang, Nikolas Gritsch, Dwaraknath Gnaneshwar, Simon Guo, David Cairuz, Bharat Venkitesh, Jakob Nicolaus Foerster, Phil Blunsom, Sebastian Ruder, Ahmet Üstün, Acyr Locatelli
- ES-FoMo-II 2024 Poster
- Readers: Everyone
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts
Qizhen Zhang, Nikolas Gritsch, Dwaraknath Gnaneshwar, Simon Guo, David Cairuz, Bharat Venkitesh, Jakob Nicolaus Foerster, Phil Blunsom, Sebastian Ruder, Ahmet Üstün, Acyr Locatelli
- NeurIPS 2024 poster
- Readers: Everyone
Know Where To Drop Your Weights: Towards Faster Uncertainty Estimation
Akshatha Kamath, Dwaraknath Gnaneshwar, Matias Valdenegro-Toro
- Published: 09 Dec 2020, Last Modified: 05 May 2023
- ICBINB 2020 Poster
- Readers: Everyone

Co-Authors