Yi Tay

Research Scientist, Google

Joined

October 2017

Names

Yi Tay (Preferred)

Emails

****@e.ntu.edu.sg (Confirmed)

****@google.com (Confirmed)

****@gmail.com (Confirmed)

Personal Links

Homepage

Google Scholar

Career & Education History

Research Scientist

Google (google.com)

2019 – Present

Advisors, Relations & Conflicts

No relations added

Expertise

AGI

2023 – 2023

Large language models

2019 – 2023

Publications

Larger language models do in-context learning differently
Jerry Wei, Jason Wei, Yi Tay, Dustin Tran, Albert Webson, Yifeng Lu, Xinyun Chen, Hanxiao Liu, Da Huang, Denny Zhou, Tengyu Ma
- Submitted to ICLR 2025
- Readers: Everyone
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V Le, Barret Zoph, Jason Wei, Adam Roberts
- 16 Feb 2024
- OpenReview Archive Direct Upload
- Readers: Everyone
Larger language models do in-context learning differently
Jerry Wei, Jason Wei, Yi Tay, Dustin Tran, Albert Webson, Yifeng Lu, Xinyun Chen, Hanxiao Liu, Da Huang, Denny Zhou, Tengyu Ma
- ICLR 2024 Conference Withdrawn Submission
- Readers: Everyone
Nearest neighbor-based out-of-distribution detection via label smoothing
Dara Bahri, Heinrich Jiang, Yi Tay, Donald Metzler
- Submitted to ICLR 2024
- Readers: Everyone
Transcending Scaling Laws with 0.1% Extra Compute
Yi Tay, Jason Wei, Hyung Won Chung, Vinh Q. Tran, David So, Siamak Shakeri, Xavier Garcia, Steven Zheng, Jinfeng Rao, Aakanksha Chowdhery, Denny Zhou, Donald Metzler, Slav Petrov, Neil Houlsby, Quoc V Le, Mostafa Dehghani
- EMNLP 2023 Main
- Readers: Everyone
DSI++: Updating Transformer Memory with New Documents
Sanket Vaibhav Mehta, Jai Gupta, Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Jinfeng Rao, Marc Najork, Emma Strubell, Donald Metzler
- EMNLP 2023 Main
- Readers: Everyone
Inverse Scaling Can Become U-Shaped
Jason Wei, Najoung Kim, Yi Tay, Quoc V Le
- EMNLP 2023 Main
- Readers: Everyone
Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
Yi Tay, Mostafa Dehghani, Samira Abnar, Hyung Won Chung, William Fedus, Jinfeng Rao, Sharan Narang, Vinh Q. Tran, Dani Yogatama, Donald Metzler
- EMNLP 2023 Findings
- Readers: Everyone
CoLT5: Faster Long-Range Transformers with Conditional Computation
Joshua Ainslie, Tao Lei, Michiel de Jong, Santiago Ontanon, Siddhartha Brahma, Yury Zemlyanskiy, David Uthus, Mandy Guo, James Lee-Thorp, Yi Tay, Yun-Hsuan Sung, Sumit Sanghai
- EMNLP 2023 Main
- Readers: Everyone
Symbol tuning improves in-context learning in language models
Jerry Wei, Le Hou, Andrew Kyle Lampinen, Xiangning Chen, Da Huang, Yi Tay, Xinyun Chen, Yifeng Lu, Denny Zhou, Tengyu Ma, Quoc V Le
- EMNLP 2023 Main
- Readers: Everyone

View all 63 publications

Co-Authors

View all 171 co-authors