Shuohang Wang

Joined

October 2016

Names

Shuohang Wang (Preferred)

Emails

****@phdis.smu.edu.sg (Confirmed)

****@microsoft.com (Confirmed)

Personal Links

Career & Education History

Researcher

Microsoft (microsoft.com)

2019 – 2025

PhD student

Singapore Management University (phdis.smu.edu.sg)

2014 – 2019

Advisors, Relations & Conflicts

PhD Advisor

Jing Jiang

2014 – 2019

Expertise

Natural Language Processing

2014 – 2024

Question Answering

2014 – 2024

Publications

DenseMixer: Improving MoE Post-Training with Precise Router Gradient
Feng Yao, Junxia Cui, Ruohan Zhang, Liyuan Liu, Shibo Hao, Li Zhang, Chengyu Dong, Churan Zhi, Shuohang Wang, yelong shen, Jianfeng Gao, Jingbo Shang
- Submitted to ICLR 2026
- Readers: Everyone
DenseMixer: Improving MoE Post-Training with Precise Router Gradient
Feng Yao, Junxia Cui, Ruohan Zhang, Liyuan Liu, Shibo Hao, Li Zhang, Chengyu Dong, Shuohang Wang, yelong shen, Jianfeng Gao, Jingbo Shang
- SPIGM @ NeurIPS
- Readers: Everyone
Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation
Liliang Ren, Congcong Chen, Haoran Xu, Young Jin Kim, Adam Atkinson, Zheng Zhan, Jiankai Sun, Baolin Peng, Liyuan Liu, Shuohang Wang, Hao Cheng, Jianfeng Gao, Weizhu Chen, yelong shen
- ES-FoMo III
- Readers: Everyone
Reinforcement Learning for Reasoning in Large Language Models with One Training Example
Yiping Wang, Qing Yang, Zhiyuan Zeng, Liliang Ren, Liyuan Liu, Baolin Peng, Hao Cheng, Xuehai He, Kuan Wang, Jianfeng Gao, Weizhu Chen, Shuohang Wang, Simon Shaolei Du, yelong shen
- NeurIPS 2025 poster
- Readers: Everyone
Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation
Liliang Ren, Congcong Chen, Haoran Xu, Young Jin Kim, Adam Atkinson, Zheng Zhan, Jiankai Sun, Baolin Peng, Liyuan Liu, Shuohang Wang, Hao Cheng, Jianfeng Gao, Weizhu Chen, yelong shen
- NeurIPS 2025 poster
- Readers: Everyone
Routing Mamba: Scaling State Space Models with Mixture-of-Experts Projection
Zheng Zhan, Liliang Ren, Shuohang Wang, Liyuan Liu, Yang Liu, Yeyun Gong, Yanzhi Wang, yelong shen
- NeurIPS 2025 poster
- Readers: Everyone
Self-Exploring Language Models: Active Preference Elicitation for Online Alignment
Shenao Zhang, Donghan Yu, Hiteshi Sharma, Han Zhong, Zhihan Liu, Ziyi Yang, Shuohang Wang, Hany Hassan Awadalla, Zhaoran Wang
- Accepted by TMLR
- Readers: Everyone
LORC: Low-Rank Compression for LLMs KV Cache with a Progressive Compression Strategy
Rongzhi Zhang, Kuan Wang, Liyuan Liu, Shuohang Wang, Hao Cheng, Chao Zhang, yelong shen
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
LoRC: Low-Rank Compression for LLMs KV Cache with a Progressive Compression Strategy
Rongzhi Zhang, Kuan Wang, Liyuan Liu, Shuohang Wang, Hao Cheng, Chao Zhang, yelong shen
- Submitted to ICLR 2025
- Readers: Everyone
Self-Exploring Language Models: Active Preference Elicitation for Online Alignment
Shenao Zhang, Donghan Yu, Hiteshi Sharma, Han Zhong, Zhihan Liu, Ziyi Yang, Shuohang Wang, Hany Hassan Awadalla, Zhaoran Wang
- ICLR 2025 Conference Withdrawn Submission
- Readers: Everyone

View all 87 publications

Co-Authors

View all 145 co-authors