Ron Banner

Researcher, NVIDIA

Joined

September 2018

Names

Ron Banner (Preferred)

Emails

****@intel.com (Confirmed)

****@habana.ai (Confirmed)

****@nvidia.com (Confirmed)

Personal Links

DBLP

Career & Education History

Researcher

NVIDIA (nvidia.com)

2025 – Present

Researcher

Intel (intel.com)

2018 – 2024

Postdoc

Hewlett Packard Enterprise (hpe.com)

2007 – 2017

Advisors, Relations & Conflicts

Coworker

Brian Chmiel

2018 – 2025

Coauthor

Daniel Soudry

2018 – 2025

Expertise

No areas of expertise listed

Publications

FP4 All the Way: Fully Quantized Training of Large Language Models
Brian Chmiel, Maxim Fishman, Ron Banner, Daniel Soudry
- NeurIPS 2025 spotlight
- Readers: Everyone
Scaling FP8 training to trillion-token LLMs
Maxim Fishman, Brian Chmiel, Ron Banner, Daniel Soudry
- ICLR 2025 Spotlight
- Readers: Everyone
EXAQ: Exponent Aware Quantization For LLMs Acceleration
Moran Shkolnik, Maxim Fishman, Brian Chmiel, Hilla Ben-Yaacov, Ron Banner, Kfir Yehuda Levy
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
DropCompute: simple and more robust distributed synchronous training via compute variance reduction
Niv Giladi, Shahar Gottlieb, Moran Shkolnik, Asaf Karnieli, Ron Banner, Elad Hoffer, Kfir Yehuda Levy, Daniel Soudry
- NeurIPS 2023 poster
- Readers: Everyone
Minimum Variance Unbiased N:M Sparsity for the Neural Gradients
Brian Chmiel, Itay Hubara, Ron Banner, Daniel Soudry
- Published: 01 Feb 2023, Last Modified: 22 Feb 2023
- ICLR 2023 notable top 25%
- Readers: Everyone
Accurate Neural Training with 4-bit Matrix Multiplications at Standard Formats
Brian Chmiel, Ron Banner, Elad Hoffer, Hilla Ben-Yaacov, Daniel Soudry
- Published: 01 Feb 2023, Last Modified: 22 Feb 2023
- ICLR 2023 poster
- Readers: Everyone
ON RECOVERABILITY OF GRAPH NEURAL NETWORK REPRESENTATIONS
Maxim Fishman, Chaim Baskin, Evgenii Zheltonozhskii, Ron Banner, Avi Mendelson
- Published: 25 Mar 2022, Last Modified: 14 Jan 2026
- GTRL 2022 Poster
- Readers: Everyone
Beyond Quantization: Power aware neural networks
Nurit Spingarn, Elad Hoffer, Ron Banner, Hilla Ben Yaacov, Tomer Michaeli
- Published: 28 Jan 2022, Last Modified: 13 Feb 2023
- ICLR 2022 Submitted
- Readers: Everyone
Logarithmic Unbiased Quantization: Practical 4-bit Training in Deep Learning
Brian Chmiel, Ron Banner, Elad Hoffer, Hilla Ben Yaacov, Daniel Soudry
- Published: 28 Jan 2022, Last Modified: 13 Feb 2023
- ICLR 2022 Submitted
- Readers: Everyone
Accelerated Sparse Neural Training: A Provable and Efficient Method to Find N:M Transposable Masks
Itay Hubara, Brian Chmiel, Moshe Island, Ron Banner, Joseph Naor, Daniel Soudry
- Published: 09 Nov 2021, Last Modified: 26 May 2025
- NeurIPS 2021 Poster
- Readers: Everyone

View all 15 publications