Zihang Dai

Research Scientist, Google

Joined

November 2016

Names

Zihang Dai (Preferred)

Emails

****@gmail.com (Confirmed)

Personal Links

Homepage

Google Scholar

Career & Education History

Research Scientist

Google (google.com)

2020 – Present

PhD student

Carnegie Mellon University (cmu.edu)

2016 – 2020

Advisors, Relations & Conflicts

PhD Advisor

Jaime Carbonell

2018 – 2020

Expertise

Unsupervised Representation Learning

2017 – Present

Natural Language Processing

2016 – Present

Deep Generative Models

2015 – Present

Publications

Meta Pseudo Labels
Hieu Pham, Zihang Dai, Michael Qizhe Xie, Thang Luong, Quoc V Le
- 26 Sept 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
Transformer Quality in Linear Time
Weizhe Hua, Zihang Dai, Hanxiao Liu, Quoc V Le
- 01 Apr 2022
- OpenReview Archive Direct Upload
- Readers: Everyone
SimVLM: Simple Visual Language Model Pretraining with Weak Supervision
Zirui Wang, Jiahui Yu, Adams Wei Yu, Zihang Dai, Yulia Tsvetkov, Yuan Cao
- Published: 28 Jan 2022, Last Modified: 13 Feb 2023
- ICLR 2022 Poster
- Readers: Everyone
Combiner: Full Attention Transformer with Sparse Computation Cost
Hongyu Ren, Hanjun Dai, Zihang Dai, Mengjiao Yang, Jure Leskovec, Dale Schuurmans, Bo Dai
- Published: 09 Nov 2021, Last Modified: 26 May 2025
- NeurIPS 2021 Spotlight
- Readers: Everyone
CoAtNet: Marrying Convolution and Attention for All Data Sizes
Zihang Dai, Hanxiao Liu, Quoc V Le, Mingxing Tan
- Published: 09 Nov 2021, Last Modified: 05 May 2023
- NeurIPS 2021 Poster
- Readers: Everyone
CoAtNet: Marrying Convolution and Attention for All Data Sizes
Zihang Dai, Hanxiao Liu, Quoc V Le, Mingxing Tan
- Published: 09 Nov 2021, Last Modified: 05 May 2023
- NeurIPS 2021 Poster
- Readers: Everyone
Pay Attention to MLPs
Hanxiao Liu, Zihang Dai, David So, Quoc V Le
- Published: 09 Nov 2021, Last Modified: 05 May 2023
- NeurIPS 2021 Poster
- Readers: Everyone
Searching for Efficient Transformers for Language Modeling
David So, Wojciech Mańke, Hanxiao Liu, Zihang Dai, Noam Shazeer, Quoc V Le
- Published: 09 Nov 2021, Last Modified: 05 May 2023
- NeurIPS 2021 Poster
- Readers: Everyone
Xlnet: Generalized autoregressive pretraining for language understanding
Zihang Dai
- 06 May 2021
- OpenReview Archive Direct Upload
- Readers: Everyone
A Mutual Information Maximization Perspective of Language Representation Learning
Lingpeng Kong, Cyprien de Masson d'Autume, Lei Yu, Wang Ling, Zihang Dai, Dani Yogatama
- 2020 (modified: 04 Nov 2022)
- ICLR 2020
- Readers: Everyone

View all 27 publications

Co-Authors

View all 48 co-authors