Shuai Zheng

Joined

September 2018

Names

Shuai Zheng (Preferred)

Emails

****@cse.ust.hk (Confirmed)

****@gmail.com (Confirmed)

****@amazon.com (Confirmed)

****@gmail.com (Confirmed)

Personal Links

Homepage

Google Scholar

DBLP

Career & Education History

Senior Applied Scientist

Amazon Web Services (amazon.com)

2019 – 2023

PhD student

Department of Computer Science and Engineering, Hong Kong University of Science and Technology (cse.ust.hk)

2015 – 2019

Advisors, Relations & Conflicts

PhD Advisor

James Kwok

2015 – 2019

Expertise

Stochastic Optimization

Present

Natural Language Processing

Present

Distributed Training and System

Present

Publications

Prompt Pre-Training with Twenty-Thousand Classes for Open-Vocabulary Visual Recognition
Shuhuai Ren, Aston Zhang, Yi Zhu, Shuai Zhang, Shuai Zheng, Mu Li, Alex Smola, Xu Sun
- 08 Jun 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
Prompt Pre-Training with Twenty-Thousand Classes for Open-Vocabulary Visual Recognition
Shuhuai Ren, Aston Zhang, Yi Zhu, Shuai Zhang, Shuai Zheng, Mu Li, Alex Smola, Xu Sun
- NeurIPS 2023 poster
- Readers: Everyone
VCC: Scaling Transformers to 128K Tokens or More by Prioritizing Important Tokens
Zhanpeng Zeng, Cole Hawkins, Mingyi Hong, Aston Zhang, Nikolaos Pappas, Vikas Singh, Shuai Zheng
- NeurIPS 2023 poster
- Readers: Everyone
Decoupled Model Schedule for Deep Learning Training
Hongzheng Chen, Cody Hao Yu, Shuai Zheng, Zhen Zhang, Zhiru Zhang, Yida Wang
- Published: 01 Jan 2023, Last Modified: 07 Feb 2024
- CoRR 2023
- Readers: Everyone
Partial and Asymmetric Contrastive Learning for Out-of-Distribution Detection in Long-Tailed Recognition
Haotao Wang, Aston Zhang, Yi Zhu, Shuai Zheng, Mu Li, Alex Smola, Zhangyang Wang
- 2022 (modified: 02 Nov 2022)
- CoRR 2022
- Readers: Everyone
Partial and Asymmetric Contrastive Learning for Out-of-Distribution Detection in Long-Tailed Recognition
Haotao Wang, Aston Zhang, Yi Zhu, Shuai Zheng, Mu Li, Alex J. Smola, Zhangyang Wang
- 2022 (modified: 02 Nov 2022)
- ICML 2022
- Readers: Everyone
Removing Batch Normalization Boosts Adversarial Training
Haotao Wang, Aston Zhang, Shuai Zheng, Xingjian Shi, Mu Li, Zhangyang Wang
- 2022 (modified: 18 Jan 2023)
- ICML 2022
- Readers: Everyone
Removing Batch Normalization Boosts Adversarial Training
Haotao Wang, Aston Zhang, Shuai Zheng, Xingjian Shi, Mu Li, Zhangyang Wang
- 2022 (modified: 18 Jan 2023)
- CoRR 2022
- Readers: Everyone
SPT: Semi-Parametric Prompt Tuning for Multitask Prompted Learning
M. Saiful Bari, Aston Zhang, Shuai Zheng, Xingjian Shi, Yi Zhu, Shafiq Joty, Mu Li
- 2022 (modified: 18 Apr 2023)
- CoRR 2022
- Readers: Everyone
Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems
Jack FitzGerald, Shankar Ananthakrishnan, Konstantine Arkoudas, Davide Bernardi, Abhishek Bhagia, Claudio Delli Bovi, Jin Cao, Rakesh Chada, Amit Chauhan, Luoxin Chen, Anurag Dwarakanath, Satyam Dwivedi, Turan Gojayev, Karthik Gopalakrishnan, Thomas Gueudré, Dilek Hakkani-Tur, Wael Hamza, Jonathan J. Hüser, Kevin Martin Jose, Haidar Khan et al. (21 additional authors not shown)
- Published: 01 Jan 2022, Last Modified: 12 May 2023
- KDD 2022
- Readers: Everyone

View all 29 publications

Co-Authors

View all 100 co-authors