Zhe Zhao

Joined

December 2017

Names

Zhe Zhao

Emails

****@ruc.edu.cn (Confirmed)

,

****@tencent.com (Confirmed)

Personal Links

Career & Education History

Researcher

Tencent AI Lab (tencent.com)

2019 – 2025

PhD student

Renmin University of China (ruc.edu.cn)

2014 – 2019

Advisors, Relations & Conflicts

No relations added

Expertise

large language model

2022 – 2025

pre-training model

2019 – 2022

word embedding

2014 – 2019

Publications

$\rm SP^3$: Enhancing Structured Pruning via PCA Projection
Yuxuan Hu, Jing Zhang, Zhe Zhao, Chen Zhao, Xiaodong Chen, Cuiping Li, Hong Chen
- OpenReview Archive Direct Upload
- Readers: Everyone
No Loss, No Gain: Gated Refinement and Adaptive Compression for Prompt Optimization
Wenhang Shi, Yiren Chen, Shuqing Bian, Xinyi Zhang, Kai Tang, Pengfei Hu, Zhe Zhao, WEI LU, Xiaoyong Du
- NeurIPS 2025 poster
- Readers: Everyone
Joint Knowledge Editing for Information Enrichment and Probability Promotion
Wenhang Shi, Yiren Chen, Shuqing Bian, Xinyi Zhang, Zhe Zhao, Pengfei Hu, Wei Lu, Xiaoyong Du
- AAAI 2025
- Readers: Everyone
Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models
Taiqiang Wu, Chaofan Tao, Jiahao Wang, Runming Yang, Zhe Zhao, Ngai Wong
- COLING 2025
- Readers: Everyone
Edge-free but Structure-aware: Prototype-Guided Knowledge Distillation from GNNs to MLPs
Taiqiang Wu, Zhe Zhao, Jiahao Wang, Xingyu Bai, Lei Wang, Ngai Wong, Yujiu Yang
- COLING 2025
- Readers: Everyone
SP-LoRA: Sparsity-Preserved Low-Rank Adaptation for Sparse Large Language Model
Yuxuan Hu, Jing Zhang, Zhe Zhao, Cuiping Li, Hong Chen
- ICLR 2025 Conference Withdrawn Submission
- Readers: Everyone
FLIP-80M: 80 Million Visual-Linguistic Pairs for Facial Language-Image Pre-Training
Yudong Li, Xianxu Hou, Dezhi Zheng, Linlin Shen, Zhe Zhao
- MM2024 Oral
- Readers: Everyone
Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models
Taiqiang Wu, Chaofan Tao, Jiahao Wang, Zhe Zhao, Ngai Wong
- CoRR 2024
- Readers: Everyone
Mixture-of-Subspaces in Low-Rank Adaptation
Taiqiang Wu, Jiahao Wang, Zhe Zhao, Ngai Wong
- CoRR 2024
- Readers: Everyone
Weight-Inherited Distillation for Task-Agnostic BERT Compression
Taiqiang Wu, Cheng Hou, Shanshan Lao, Jiayi Li, Ngai Wong, Zhe Zhao, Yujiu Yang
- NAACL-HLT (Findings) 2024
- Readers: Everyone

View all 65 publications

Co-Authors

View all 131 co-authors