Kang Zhao

Researcher, Huawei Technologies Ltd.

Joined

May 2022

Names

Kang Zhao (Preferred)

Emails

****@huawei.com (Confirmed)

****@yeah.net (Confirmed)

****@tsinghua.org.cn (Confirmed)

Personal Links

Homepage

Google Scholar

ORCID

Career & Education History

Researcher

Huawei Technologies Ltd. (huawei.com)

2021 – Present

Advisors, Relations & Conflicts

Coworker

Kai Han

2021 – 2023

Social

Yunhe Wang

2021 – 2023

Social

Xianzhi Yu

2021 – 2023

Postdoc Advisor

Jun Yao

2021 – 2023

Expertise

model compression

pruning

LLM pruning

quantization

efficient deep learning

2014 – 2025

Publications

BoundaryDPT: Pushing the Boundaries of Depth Pruning for Vision Transformers
Zhenfeng Su, Kang Zhao, Han Bao, Tao Yuan, Xianzhi Yu
- Submitted to ICLR 2026
- Readers: Everyone
A Simple Linear Patch Revives Layer-Pruned Large Language Models
Xinrui Chen, Haoli Bai, Tao Yuan, Ruikang Liu, Kang Zhao, Xianzhi Yu, Lu Hou, Tian Guan, Yonghong He, Chun Yuan
- NeurIPS 2025 poster
- Readers: Everyone
FlatQuant: Flatness Matters for LLM Quantization
Yuxuan Sun, Ruikang Liu, Haoli Bai, Han Bao, Kang Zhao, Yuening Li, JiaxinHu, Xianzhi Yu, Lu Hou, Chun Yuan, Xin Jiang, Wulong Liu, Jun Yao
- ICML 2025 poster
- Readers: Everyone
1-Bit FQT: Pushing the Limit of Fully Quantized Training to 1-bit
Chang Gao, JingRen Hou, Kang Zhao, Jiaqi Wang, Jianfei Chen, Liping Jing
- Submitted to ICLR 2025
- Readers: Everyone
Beyond 2:4: Exploring V:N:M Sparsity for Efficient Transformer Inference on GPUs
Kang Zhao, Tao Yuan, Han Bao, Zhenfeng Su, Chang Gao, Zhaofeng Sun, Zichen Liang, Liping Jing, Jianfei Chen
- Submitted to ICLR 2025
- Readers: Everyone
FlatQuant: Flatness Matters for LLM Quantization
Yuxuan Sun, Ruikang Liu, Haoli Bai, Han Bao, Kang Zhao, Yuening Li, JiaxinHu, Xianzhi Yu, Lu Hou, Chun Yuan, Xin Jiang, Wulong Liu, Jun Yao
- Submitted to ICLR 2025
- Readers: Everyone
FastAttention: Extend FlashAttention2 to NPUs and Low-resource GPUs for Efficient Inference
Haoran Lin, Xianzhi Yu, Kang Zhao, Lu Hou, ZongYuan Zhan, Stanislav Kamenev, Han Bao, Ting Hu, Mingkai Wang, QixinChang, Siyue Sui, Weihao sun, JiaxinHu, Jun Yao, Zekun Yin, Cheng Qian, Ying Zhang, PanYinfei, Yang yu, Weiguo Liu
- Submitted to ICLR 2025
- Readers: Everyone
Zero-shot Quantization for Object Detection
ChangHao Li, Xinrui Chen, Kang Zhao, Jun Zhu, Jianfei Chen
- Submitted to ICLR 2025
- Readers: Everyone
Jetfire: Efficient and Accurate Transformer Pretraining with INT8 Data Flow and Per-Block Quantization
Haocheng Xi, Yuxiang Chen, Kang Zhao, KAI JUN TEH, Jianfei Chen, Jun Zhu
- ICML 2024 Spotlight
- Readers: Everyone
Accelerating Transformer Pre-training with 2:4 Sparsity
Yuezhou Hu, Kang Zhao, Weiyu Huang, Jianfei Chen, Jun Zhu
- ICML 2024 Poster
- Readers: Everyone

View all 12 publications

Co-Authors

View all 51 co-authors