Siyuan Qiao

Researcher, Meta

Joined

December 2017

Names

Siyuan Qiao (Preferred)

Emails

****@jhu.edu (Confirmed)

****@google.com (Confirmed)

****@gmail.com (Confirmed)

****@bytedance.com (Confirmed)

Personal Links

Homepage

Google Scholar

DBLP

Career & Education History

Researcher

Meta (meta.com)

2025 – Present

Researcher

ByteDance Inc. (bytedance.com)

2025 – 2025

Research Scientist

Google (google.com)

2021 – 2025

PhD student

Johns Hopkins University (jhu.edu)

2016 – 2021

Undergrad student

Shanghai Jiao Tong University (sjtu.edu.cn)

2012 – 2016

Advisors, Relations & Conflicts

PhD Advisor

Alan Yuille

2016 – Present

Expertise

computer vision

deep learning

2016 – Present

Publications

Coupling Experts and Routers in Mixture-of-Experts via an Auxiliary Loss
Ang Lv, Jin Ma, Yiyuan Ma, Siyuan Qiao
- ICLR 2026 Oral
- Readers: Everyone
Balanced Actor Initialization: Stable RLHF Training of Distillation Reasoning Models
Chen Zheng, Yiyuan Ma, Yuan Yang, Deyi Liu, Jing Liu, Zuquan Song, Yuxin Song, Cheng Ren, Hang Zhu, Xin Liu, Xun Zhou, Siyuan Qiao
- ICLR 2026 Conference Desk Rejected Submission
- Readers: Everyone
GatePro: Parameter-Free Expert Selection Optimization for Mixture-of-Experts Models
Chen Zheng, Yuhang Cai, Deyi Liu, Jin Ma, Yiyuan Ma, Yuan Yang, Jing Liu, Yutao Zeng, Xun Zhou, Siyuan Qiao
- Submitted to ICLR 2026
- Readers: Everyone
HSA: Head-wise Sparse Attention for Efficient and Accurate Long-context Inference
Jing Liu, Jianqiao Lu, Yao Luo, Yuan Yang, Chen Zheng, Deyi Liu, Mengzhao Chen, Chaoyi Zhang, Yunshui Li, Jin Ma, Yutao Zeng, Ya Wang, Hongmin chen, Ziqiang Pei, Fan Xia, Tianqi Zhang, Xiaoying Jia, Yiyuan Ma, Siyuan Qiao
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
UltraMemV2: Memory Networks Scaling to 120B Parameters with Superior Long-Context Learning
Zihao Huang, Yu Bao, Qiyang Min, Siyan Chen, Ran Guo, Hongzhi Huang, Defa Zhu, Banggu Wu, Yutao Zeng, zhou Xun, Siyuan Qiao
- ICLR 2026 Poster
- Readers: Everyone
SeeDNorm: Self-Rescaled Dynamic Normalization
Wenrui Cai, Defa Zhu, Siyuan Qiao, Qingjie Liu, Qiyang Min
- ICLR 2026 Poster
- Readers: Everyone
SensorLM: Learning the Language of Wearable Sensors
Yuwei Zhang, Kumar Ayush, Siyuan Qiao, A. Ali Heydari, Girish Narayanswamy, Maxwell A Xu, Ahmed Metwally, Jinhua Xu, Jake Garrison, Xuhai Xu, Tim Althoff, Yun Liu, Pushmeet Kohli, Jiening Zhan, Mark Malhotra, Shwetak Patel, Cecilia Mascolo, Xin Liu, Daniel McDuff, Yuzhe Yang
- NeurIPS 2025 poster
- Readers: Everyone
MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions
Kai Zhang, Yi Luan, Hexiang Hu, Kenton Lee, Siyuan Qiao, Wenhu Chen, Yu Su, Ming-Wei Chang
- ICML 2024
- Readers: Everyone
MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions
Kai Zhang, Yi Luan, Hexiang Hu, Kenton Lee, Siyuan Qiao, Wenhu Chen, Yu Su, Ming-Wei Chang
- ICML 2024 Oral
- Readers: Everyone
Relative Margin for Contrastive Learning
Siyuan Qiao, Chenxi Liu, Yonghui Wu, Jiahui Yu
- ICLR 2024 Conference Withdrawn Submission
- Readers: Everyone

View all 64 publications

Co-Authors

View all 136 co-authors