Dhruv Choudhary

Researcher, OpenAI

Joined

September 2021

Names

Dhruv Choudhary (Preferred)

Emails

****@fb.com (Confirmed)

****@gmail.com (Confirmed)

****@gatech.edu (Confirmed)

Personal Links

Google Scholar

DBLP

Career & Education History

Researcher

OpenAI (openai.com)

2025 – Present

Researcher

Facebook (meta.com)

2018 – 2025

Researcher

Machine Zone (mz.com)

2016 – 2018

MS student

ECE, Georgia Institute of Technology (gatech.edu)

2008 – 2011

Advisors, Relations & Conflicts

Coauthor

qiang liu

2019 – 2025

Coauthor

Christos Kozyrakis

2020 – 2024

Expertise

Deep Learning

Present

Algorithmic Efficiency

Present

Large Language Models

Present

Pruning and Distillation

Present

Long Context for Training and Inference

Present

Optimization Algorithms

Present

Publications

Accelerating Transformer Inference and Training with 2:4 Activation Sparsity
Daniel Haziza, Timothy Chou, Dhruv Choudhary, Luca Wehrstedt, Francisco Massa, Jiecao Yu, Geonhwa Jeong, Supriya Rao, Patrick Labatut, Jesse Cai
- CoRR 2025
- Readers: Everyone
Accelerating Transformer Inference and Training with 2:4 Activation Sparsity
Daniel HAZIZA, Timothy Chou, Dhruv Choudhary, Jesse Cai, Luca Wehrstedt, Francisco Massa, Jiecao Yu, Geonhwa Jeong, Supriya Rao, Patrick Labatut
- SLLM
- Readers: Everyone
SpinQuant: LLM Quantization with Learned Rotations
Zechun Liu, Changsheng Zhao, Igor Fedorov, Bilge Soran, Dhruv Choudhary, Raghuraman Krishnamoorthi, Vikas Chandra, Yuandong Tian, Tijmen Blankevoort
- ICLR 2025
- Readers: Everyone
SpinQuant: LLM Quantization with Learned Rotations
Zechun Liu, Changsheng Zhao, Igor Fedorov, Bilge Soran, Dhruv Choudhary, Raghuraman Krishnamoorthi, Vikas Chandra, Yuandong Tian, Tijmen Blankevoort
- ICLR 2025 Poster
- Readers: Everyone
Movie Gen: A Cast of Media Foundation Models
Adam Polyak, Amit Zohar, Andrew Brown, Andros Tjandra, Animesh Sinha, Ann Lee, Apoorv Vyas, Bowen Shi, Chih-Yao Ma, Ching-Yao Chuang, David Yan, Dhruv Choudhary, Dingkang Wang, Geet Sethi, Guan Pang, Haoyu Ma, Ishan Misra, Ji Hou, Jialiang Wang, Kiran Jagadeesh et al. (68 additional authors not shown)
- CoRR 2024
- Readers: Everyone
The Llama 3 Herd of Models
Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Amy Yang, Angela Fan, Anirudh Goyal, Anthony Hartshorn, Aobo Yang, Archi Mitra, Archie Sravankumar, Artem Korenev, Arthur Hinsvark, Arun Rao, Aston Zhang, Aurélien Rodriguez et al. (81 additional authors not shown)
- CoRR 2024
- Readers: Everyone
Layer Compression of Deep Networks with Straight Flows
Chengyue Gong, Xiaocong Du, Bhargav Bhushanam, Lemeng Wu, Xingchao Liu, Dhruv Choudhary, Arun Kejariwal, Qiang Liu
- AAAI 2024
- Readers: Everyone
Positive Unlabeled Contrastive Learning
Anish Acharya, sujay sanghavi, Li Jing, Bhargav Bhushanam, Dhruv Choudhary, Michael Rabbat, Inderjit S Dhillon
- 30 Jan 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
Microscaling Data Formats for Deep Learning
Bita Darvish Rouhani, Ritchie Zhao, Ankit More, Mathew Hall, Alireza Khodamoradi, Summer Deng, Dhruv Choudhary, Marius Cornea, Eric Dellinger, Kristof Denolf, Dusan Stosic, Venmugil Elango, Maximilian Golub, Alexander Heinecke, Phil James-Roxby, Dharmesh Jani, Gaurav Kolhe, Martin Langhammer, Ada Li, Levi Melnick et al. (13 additional authors not shown)
- CoRR 2023
- Readers: Everyone
RecD: Deduplication for End-to-End Deep Learning Recommendation Model Training Infrastructure
Mark Zhao, Dhruv Choudhary, Devashish Tyagi, Ajay Somani, Max Kaplan, Sung-Han Lin, Sarunya Pumma, Jongsoo Park, Aarti Basant, Niket Agarwal, Carole-Jean Wu, Christos Kozyrakis
- MLSys 2023
- Readers: Everyone

View all 25 publications

Co-Authors

View all 300 co-authors