Elad Hoffer

Principal Researcher, Research, NVIDIA

Joined

October 2016

Names

Elad Hoffer (Preferred)

Emails

****@tx.technion.ac.il (Confirmed)

****@gmail.com (Confirmed)

****@campus.technion.ac.il (Confirmed)

****@habana.ai (Confirmed)

****@nvidia.com (Confirmed)

Personal Links

Homepage

Google Scholar

DBLP

Career & Education History

Principal Researcher

Research, NVIDIA (nvidia.com)

2025 – Present

Researcher

Habana Labs (Intel) (habana.ai)

2019 – 2024

PhD student

Technion (tx.technion.ac.il)

2014 – 2019

Advisors, Relations & Conflicts

PhD Advisor

Daniel Soudry

2017 – 2019

PhD Advisor

Nir Ailon

2016 – 2019

Expertise

Deep learning

machine learning

Present

Publications

Task-agnostic continual learning using online variational bayes with fixed-point updates
Chen Zeno, Itay Golan, Elad Hoffer, Daniel Soudry
- 12 May 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
Task agnostic continual learning using online variational bayes
Chen Zeno, Itay Golan, Elad Hoffer, Daniel Soudry
- 12 May 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
Accurate Neural Training with 4-bit Matrix Multiplications at Standard Formats
Brian Chmiel, Ron Banner, Elad Hoffer, Hilla Ben-Yaacov, Daniel Soudry
- Published: 01 Feb 2023, Last Modified: 22 Feb 2023
- ICLR 2023 poster
- Readers: Everyone
Beyond Quantization: Power aware neural networks
Nurit Spingarn, Elad Hoffer, Ron Banner, Hilla Ben Yaacov, Tomer Michaeli
- Published: 28 Jan 2022, Last Modified: 13 Feb 2023
- ICLR 2022 Submitted
- Readers: Everyone
Logarithmic Unbiased Quantization: Practical 4-bit Training in Deep Learning
Brian Chmiel, Ron Banner, Elad Hoffer, Hilla Ben Yaacov, Daniel Soudry
- Published: 28 Jan 2022, Last Modified: 13 Feb 2023
- ICLR 2022 Submitted
- Readers: Everyone
Neural gradients are near-lognormal: improved quantized and sparse training
Brian Chmiel, Liad Ben-Uri, Moran Shkolnik, Elad Hoffer, Ron Banner, Daniel Soudry
- Published: 12 Jan 2021, Last Modified: 05 May 2023
- ICLR 2021 Poster
- Readers: Everyone
MixSize: Training Convnets With Mixed Image Sizes for Improved Accuracy, Speed and Scale Resiliency
Elad Hoffer, Berry Weinstein, Itay Hubara, Tal Ben-Nun, Torsten Hoefler, Daniel Soudry
- 28 Sept 2020 (modified: 05 May 2023)
- ICLR 2021 Conference Blind Submission
- Readers: Everyone
Augment Your Batch: Improving Generalization Through Instance Repetition
Elad Hoffer, Tal Ben-Nun, Itay Hubara, Niv Giladi, Torsten Hoefler, Daniel Soudry
- 2020 (modified: 21 Jan 2026)
- CVPR 2020
- Readers: Everyone
Neural gradients are lognormally distributed: understanding sparse and quantized training
Brian Chmiel, Liad Ben-Uri, Moran Shkolnik, Elad Hoffer, Ron Banner, Daniel Soudry
- 2020 (modified: 13 May 2025)
- CoRR 2020
- Readers: Everyone
The Knowledge Within: Methods for Data-Free Model Compression
Matan Haroush, Itay Hubara, Elad Hoffer, Daniel Soudry
- 2019 (modified: 08 Nov 2022)
- CoRR 2019
- Readers: Everyone

View all 18 publications