Cunxiao Du

Researcher, Sea AI LAB

Joined

November 2017

Names

Cunxiao Du (Preferred)

cunxiao du

Emails

****@gmail.com (Confirmed)

Personal Links

Career & Education History

Researcher

Sea AI LAB (sea.com)

2024 – Present

PhD student

Singapore Management University (smu.edu.sg)

2019 – 2024

Undergrad student

shandong university (sdu.edu.cn)

2015 – 2019

Advisors, Relations & Conflicts

PhD Advisor

Jing Jiang

2019 – Present

PhD Advisor

Zhaopeng Tu

2019 – Present

Expertise

Text Classification

Present

Machine Translation (NAT)

Present

Publications

Demystifying the Slash Pattern in Attention: The Role of RoPE
Yuan Cheng, Fengzhuo Zhang, Yunlong Hou, Cunxiao Du, Chao Du, Tianyu Pang, Aixin Sun, Zhuoran Yang
- ICML 2026 FoGen Workshop Poster
- Readers: Everyone
Anatomy of a Hybrid Mind: Deconstructing Hybrid Reasoning in Large Language Models
Penghui Yang, Fengzhuo Zhang, Yunlong Hou, Tianyu Pang, Chao Du, Bo An, Cunxiao Du
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
Muon Outperforms Adam in Tail-End Associative Memory Learning
Shuche Wang, Fengzhuo Zhang, Jiaxiang Li, Cunxiao Du, Chao Du, Tianyu Pang, Zhuoran Yang, Mingyi Hong, Vincent Y. F. Tan
- ICLR 2026 Poster
- Readers: Everyone
LightTransfer: Your Long-Context LLM is Secretly a Hybrid Model with Effortless Adaptation
Xuan Zhang, Fengzhuo Zhang, Cunxiao Du, Chao Du, Tianyu Pang, Wei Gao, Min Lin
- Accepted by TMLR
- Readers: Everyone
LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification
Penghui Yang, Cunxiao Du, Fengzhuo Zhang, Haonan Wang, Tianyu Pang, Chao Du, Bo An
- ES-FoMo III
- Readers: Everyone
LightTransfer: Your Long-Context LLM is Secretly a Hybrid Model with Effortless Adaptation
Xuan Zhang, Fengzhuo Zhang, Cunxiao Du, Chao Du, Tianyu Pang, Wei Gao, Min Lin
- Reasoning and Planning for LLMs @ ICLR2025
- Readers: Everyone
BanditSpec: Adaptive Speculative Decoding via Bandit Algorithms
Yunlong Hou, Fengzhuo Zhang, Cunxiao Du, Xuan Zhang, Jiachun Pan, Tianyu Pang, Chao Du, Vincent Y. F. Tan, Zhuoran Yang
- ICML 2025 poster
- Readers: Everyone
When Precision Meets Position: BFloat16 Breaks Down RoPE in Long-Context Training
Haonan Wang, Qian Liu, Chao Du, Tongyao Zhu, Cunxiao Du, Kenji Kawaguchi, Tianyu Pang
- Accepted by TMLR
- Readers: Everyone
SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction
Xuan Zhang, Cunxiao Du, Chao Du, Tianyu Pang, Wei Gao, Min Lin
- Submitted to ICLR 2025
- Readers: Everyone
Efficient Inference for Large Language Model-based Generative Recommendation
Xinyu Lin, Chaoqun Yang, Wenjie Wang, Yongqi Li, Cunxiao Du, Fuli Feng, See-Kiong Ng, Tat-Seng Chua
- ICLR 2025 Poster
- Readers: Everyone

View all 16 publications

Co-Authors

View all 46 co-authors