David So

Research Engineer, Google DeepMind

Joined

December 2017

Names

David So

Emails

****@google.com (Confirmed)

,

****@gmail.com (Confirmed)

Personal Links

Career & Education History

Research Engineer

Google DeepMind (google.com)

2017 – Present

Advisors, Relations & Conflicts

No relations added

Expertise

Deep Learning

Present

Publications

Transcending Scaling Laws with 0.1% Extra Compute
Yi Tay, Jason Wei, Hyung Won Chung, Vinh Q. Tran, David So, Siamak Shakeri, Xavier Garcia, Steven Zheng, Jinfeng Rao, Aakanksha Chowdhery, Denny Zhou, Donald Metzler, Slav Petrov, Neil Houlsby, Quoc V Le, Mostafa Dehghani
- EMNLP 2023 Main
- Readers: Everyone
EvoPrompting: Language Models for Code-Level Neural Architecture Search
Angelica Chen, David Dohan, David So
- NeurIPS 2023 poster
- Readers: Everyone
Brainformers: Trading Simplicity for Efficiency
Yanqi Zhou, Nan Du, Yanping Huang, Daiyi Peng, Chang Lan, Da Huang, Siamak Shakeri, David So, Andrew M. Dai, Yifeng Lu, Zhifeng Chen, Quoc V Le, Claire Cui, James Laudon, Jeff Dean
- ICML 2023 Poster
- Readers: Everyone
Brainformers: Trading Simplicity for Efficiency
Yanqi Zhou, Nan Du, Yanping Huang, David So, Daiyi Peng, Siamak Shakeri, Andrew M. Dai, Da Huang, Yifeng Lu, Quoc V Le, Zhifeng Chen, James Laudon
- 22 Sept 2022 (modified: 13 Feb 2023)
- ICLR 2023 Conference Withdrawn Submission
- Readers: Everyone
Pay Attention to MLPs
Hanxiao Liu, Zihang Dai, David So, Quoc V Le
- Published: 09 Nov 2021, Last Modified: 05 May 2023
- NeurIPS 2021 Poster
- Readers: Everyone
Searching for Efficient Transformers for Language Modeling
David So, Wojciech Mańke, Hanxiao Liu, Zihang Dai, Noam Shazeer, Quoc V Le
- Published: 09 Nov 2021, Last Modified: 05 May 2023
- NeurIPS 2021 Poster
- Readers: Everyone
The Evolved Transformer
David So, Quoc Le, Chen Liang
- 2019 (modified: 11 Nov 2022)
- ICML 2019
- Readers: Everyone

Co-Authors

View all 35 co-authors