Greg Heinrich

Researcher, NVIDIA

Joined

October 2022

Names

Greg Heinrich (Preferred)

Emails

****@nvidia.com (Confirmed)

Personal Links

Career & Education History

Researcher

NVIDIA (nvidia.com)

2023 – Present

Advisors, Relations & Conflicts

Coauthor

2023 – 2025

Coauthor

Pavlo Molchanov

2022 – 2025

Coauthor

Ali Hatamizadeh

2022 – 2023

Expertise

Computer Vision

2015 – Present

Publications

FeatSharp: Your Vision Model Features, Sharper
Mike Ranzinger, Greg Heinrich, Pavlo Molchanov, Bryan Catanzaro, Andrew Tao
- ICML 2025 poster
- Readers: Everyone
UNAST: Unified framework for Neural Architecture Search for Transformers
Ilia Markov, Chenhan D. Yu, Hongxu Yin, Saurav Muralidharan, Greg Heinrich, Jan Kautz, Dan Alistarh, Pavlo Molchanov
- ICLR 2025 Conference Withdrawn Submission
- Readers: Everyone
Minifinetuning: Low-Data Generation Domain Adaptation through Corrective Self-Distillation
Peter Belcak, Greg Heinrich, Pavlo Molchanov, Jan Kautz
- Submitted to ICLR 2025
- Readers: Everyone
PHI-S: Distribution Balancing for Agglomerative Models
Mike Ranzinger, Jon Barker, Greg Heinrich, Pavlo Molchanov, Jan Kautz, Bryan Catanzaro, Andrew Tao
- Submitted to ICLR 2025
- Readers: Everyone
A deeper look at depth pruning of LLMs
Shoaib Ahmed Siddiqui, Xin Dong, Greg Heinrich, Thomas Breuel, Jan Kautz, David Krueger, Pavlo Molchanov
- TF2M 2024 Poster
- Readers: Everyone
MaskLLM: Learnable Semi-Structured Sparsity for Large Language Models
Gongfan Fang, Hongxu Yin, Saurav Muralidharan, Greg Heinrich, Jeff Pool, Jan Kautz, Pavlo Molchanov, Xinchao Wang
- NeurIPS 2024 spotlight
- Readers: Everyone
Flextron: Many-in-One Flexible Large Language Model
Ruisi Cai, Saurav Muralidharan, Greg Heinrich, Hongxu Yin, Zhangyang Wang, Jan Kautz, Pavlo Molchanov
- ICML 2024 Oral
- Readers: Everyone
FasterViT: Fast Vision Transformers with Hierarchical Attention
Ali Hatamizadeh, Greg Heinrich, Hongxu Yin, Andrew Tao, Jose M. Alvarez, Jan Kautz, Pavlo Molchanov
- ICLR 2024 poster
- Readers: Everyone
Global Context Vision Transformers
Ali Hatamizadeh, Hongxu Yin, Greg Heinrich, Jan Kautz, Pavlo Molchanov
- ICML 2023 Poster
- Readers: Everyone

Co-Authors