Xiaozhe Ren

Joined

May 2021

Names

Xiaozhe Ren (Preferred)

Emails

****@huawei.com (Confirmed)

****@connect.ust.hk (Confirmed)

Personal Links

Google Scholar

DBLP

ORCID

Career & Education History

Researcher

Noah's Ark Lab (huawei.com)

2018 – 2025

Advisors, Relations & Conflicts

No relations added

Expertise

machine learning

2018 – 2025

large scale distributed training

2018 – 2025

large language model pretraining

2018 – 2025

Publications

Elevating Large Language Models with Module-of-Thought
Jingyao Li, Pengguang Chen, Bin Xia, Sitong Wu, Chuanyang Zheng, Minbin Huang, Chengyao Wang, Xiaozhe Ren, Hong Xu, Jiaya Jia
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
DynamicBench: Evaluating Real-Time Report Generation in Large Language Models
Jingyao Li, Hao Sun, Zile Qiao, Yong Jiang, Sitong Wu, Guoxuan Chen, Bin Xia, Xiaozhe Ren, Pengjun Xie, Fei Huang, Hong Xu, Jiaya Jia
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
End-to-End QA Construction Pipeline for Continual Pre-training of Large Language Models
Jingyao Li, Zile Qiao, Xinyu Wang, Zhen Zhang, Sitong Wu, Guoxuan Chen, Bin Xia, Xiaozhe Ren, Yong Jiang, Pengjun Xie, Fei Huang, Hong Xu, Jiaya Jia
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
DeepDiver: Adaptive Web-Search Intensity Scaling via Reinforcement Learning
Wenxuan Shi, Haochen Tan, Chuqiao Kuang, Xiaoguang Li, Hanting Chen, Xiaozhe Ren, Yasheng Wang, Lu Hou, Lifeng Shang
- NeurIPS 2025 spotlight
- Readers: Everyone
SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separator
Guoxuan Chen, Han Shi, Jiawei Li, Yihang Gao, Xiaozhe Ren, Yimeng Chen, Xin Jiang, Zhenguo Li, Weiyang Liu, Chao Huang
- ICML 2025 poster
- Readers: Everyone
DAPE V2: Process Attention Score as Feature Map for Length Extrapolation
Chuanyang Zheng, Yihang Gao, Han Shi, Jing Xiong, Jiankai Sun, Jingyao Li, Minbin Huang, Xiaozhe Ren, Michael Ng, Xin Jiang, Zhenguo Li, Yu Li
- Submitted to ICLR 2025
- Readers: Everyone
DAPE: Data-Adaptive Positional Encoding for Length Extrapolation
Chuanyang Zheng, Yihang Gao, Han Shi, Minbin Huang, Jingyao Li, Jing Xiong, Xiaozhe Ren, Michael Ng, Xin Jiang, Zhenguo Li, Yu Li
- NeurIPS 2024 poster
- Readers: Everyone
Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline
Zangwei Zheng, Xiaozhe Ren, Fuzhao Xue, Yang Luo, Xin Jiang, Yang You
- NeurIPS 2023 poster
- Readers: Everyone
One Student Knows All Experts Know: From Sparse to Dense
Fuzhao Xue, Xiaoxin He, Xiaozhe Ren, Yuxuan Lou, Yang You
- 01 Mar 2023 (modified: 11 Apr 2023)
- Submitted to Tiny Papers @ ICLR 2023
- Readers: Everyone
A Study on Transformer Configuration and Training Objective
Fuzhao Xue, Jianghai Chen, Aixin Sun, Xiaozhe Ren, Zangwei Zheng, Xiaoxin He, Yongming Chen, Xin Jiang, Yang You
- ICML 2023 Poster
- Readers: Everyone

Co-Authors

View all 46 co-authors