Haihao Shen

Researcher, Intel

Joined

February 2018

Names

Haihao Shen

Emails

****@intel.com (Confirmed)

Personal Links

Semantic Scholar

Career & Education History

Researcher

Intel (intel.com)

2010 – Present

MS student

Shanghai Jiaotong University (sjtu.edu.cn)

2007 – 2010

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
Wenhua Cheng, Weiwei Zhang, Haihao Shen, Yiyang Cai, Xin He, Lv Kaokao
- Submitted to ICLR 2024
- Readers: Everyone
Efficient Post-training Quantization with FP8 Formats
Haihao Shen, Naveen Mellempudi, Xin He, Qun Gao, Chang Wang, Mengni Wang
- CoRR 2023
- Readers: Everyone
An Efficient Sparse Inference Software Accelerator for Transformer-based Language Models on CPUs
Haihao Shen, Hengyu Meng, Bo Dong, Zhe Wang, Ofir Zafrir, Yi Ding, Yu Luo, Hanwen Chang, Qun Gao, Ziheng Wang, Guy Boudoukh, Moshe Wasserblat
- CoRR 2023
- Readers: Everyone
Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
Wenhua Cheng, Weiwei Zhang, Haihao Shen, Yiyang Cai, Xin He, Kaokao Lv
- CoRR 2023
- Readers: Everyone
TEQ: Trainable Equivalent Transformation for Quantization of LLMs
Wenhua Cheng, Yiyang Cai, Kaokao Lv, Haihao Shen
- CoRR 2023
- Readers: Everyone
Effective Quantization for Diffusion Models on CPUs
Hanwen Chang, Haihao Shen, Yiyang Cai, Xinyu Ye, Zhenzhong Xu, Wenhua Cheng, Kaokao Lv, Weiwei Zhang, Yintong Lu, Heng Guo
- CoRR 2023
- Readers: Everyone
Efficient LLM Inference on CPUs
Haihao Shen, Hanwen Chang, Bo Dong, Yu Luo, Hengyu Meng
- CoRR 2023
- Readers: Everyone
QuaLA-MiniLM: a Quantized Length Adaptive MiniLM
Shira Guskin, Moshe Wasserblat, Chang Wang, Haihao Shen
- CoRR 2022
- Readers: Everyone
Fast DistilBERT on CPUs
Haihao Shen, Ofir Zafrir, Bo Dong, Hengyu Meng, Xinyu Ye, Zhe Wang, Yi Ding, Hanwen Chang, Guy Boudoukh, Moshe Wasserblat
- Published: 01 Jan 2022, Last Modified: 12 Jun 2023
- CoRR 2022
- Readers: Everyone
Prune Once for All: Sparse Pre-Trained Language Models
Ofir Zafrir, Ariel Larey, Guy Boudoukh, Haihao Shen, Moshe Wasserblat
- Published: 01 Jan 2021, Last Modified: 12 Jun 2023
- CoRR 2021
- Readers: Everyone

View all 17 publications

Co-Authors

View all 46 co-authors