Shaohan Huang

Researcher, Microsoft

Joined

October 2018

Names

Shaohan Huang (Preferred)

Emails

****@gmail.com (Confirmed)

****@microsoft.com (Confirmed)

Personal Links

DBLP

ORCID

Career & Education History

Researcher

Microsoft (microsoft.com)

2017 – 2027

MS student

Beihang University (buaa.edu.cn)

2014 – 2017

Advisors, Relations & Conflicts

Coauthor

Furu Wei

2014 – 2025

Expertise

Large language model

2020 – 2025

Publications

Dual-Alignment Pre-training for Cross-lingual Sentence Embedding
Ziheng Li, Shaohan Huang, Zihan Zhang, Zhi-Hong Deng, Qiang Lou, Haizhen Huang, Jian Jiao, Furu Wei, Weiwei Deng, Qi Zhang
- 17 Jun 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation
Jian Yang, Shaohan Huang, Shuming Ma, Yuwei Yin, Li Dong, Dongdong Zhang, Hongcheng Guo, Zhoujun Li, Furu Wei
- 08 Jun 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator
Jian Yang, Shuming Ma, Li Dong, Shaohan Huang, Haoyang Huang, Yuwei Yin, Dongdong Zhang, Liqun Yang, Furu Wei, Zhoujun Li
- 08 Jun 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
Language Is Not All You Need: Aligning Perception with Language Models
Shaohan Huang, Li Dong, Wenhui Wang, Yaru Hao, Saksham Singhal, Shuming Ma, Tengchao Lv, Lei Cui, Owais Khan Mohammed, Barun Patra, Qiang Liu, Kriti Aggarwal, Zewen Chi, Johan Bjorck, Vishrav Chaudhary, Subhojit Som, Xia Song, Furu Wei
- 2023 (modified: 16 Apr 2023)
- CoRR 2023
- Readers: Everyone
Pre-training Language Model as a Multi-perspective Course Learner
Beiduo Chen, Shaohan Huang, Zihan Zhang, Wu Guo, Zhenhua Ling, Haizhen Huang, Furu Wei, Weiwei Deng, Qi Zhang
- Published: 01 Jan 2023, Last Modified: 08 Jun 2023
- CoRR 2023
- Readers: Everyone
UPRISE: Universal Prompt Retrieval for Improving Zero-Shot Evaluation
Daixuan Cheng, Shaohan Huang, Junyu Bi, Yuefeng Zhan, Jianfeng Liu, Yujing Wang, Hao Sun, Furu Wei, Denvy Deng, Qi Zhang
- Published: 01 Jan 2023, Last Modified: 20 Jun 2023
- CoRR 2023
- Readers: Everyone
Kosmos-2: Grounding Multimodal Large Language Models to the World
Zhiliang Peng, Wenhui Wang, Li Dong, Yaru Hao, Shaohan Huang, Shuming Ma, Furu Wei
- Published: 01 Jan 2023, Last Modified: 04 Sept 2023
- CoRR 2023
- Readers: Everyone
Magneto: A Foundation Transformer
Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei
- Published: 01 Jan 2023, Last Modified: 04 Sept 2023
- ICML 2023
- Readers: Everyone
Kosmos-2.5: A Multimodal Literate Model
Tengchao Lv, Yupan Huang, Jingye Chen, Lei Cui, Shuming Ma, Yaoyao Chang, Shaohan Huang, Wenhui Wang, Li Dong, Weiyao Luo, Shaoxiang Wu, Guoxin Wang, Cha Zhang, Furu Wei
- Published: 01 Jan 2023, Last Modified: 05 Nov 2023
- CoRR 2023
- Readers: Everyone
Retentive Network: A Successor to Transformer for Large Language Models
Yutao Sun, Li Dong, Shaohan Huang, Shuming Ma, Yuqing Xia, Jilong Xue, Jianyong Wang, Furu Wei
- Published: 01 Jan 2023, Last Modified: 13 Nov 2023
- CoRR 2023
- Readers: Everyone

View all 103 publications

Co-Authors

View all 139 co-authors