Vinh Q. Tran

Researcher, Google DeepMind

Joined

May 2021

Names

Vinh Q. Tran (Preferred)

Emails

****@google.com (Confirmed)

Personal Links

Homepage

Google Scholar

DBLP

Career & Education History

Researcher

Google DeepMind (google.com)

2024 – Present

Researcher

Google (google.com)

2016 – 2023

Undergrad student

Brown University (brown.edu)

2012 – 2016

Advisors, Relations & Conflicts

No relations added

Expertise

transformer

Present

pretraining

Present

LLMs

Present

Publications

Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
Yi Tay, Mostafa Dehghani, Samira Abnar, Hyung Won Chung, William Fedus, Jinfeng Rao, Sharan Narang, Vinh Q. Tran, Dani Yogatama, Donald Metzler
- Published: 01 Feb 2023, Last Modified: 13 Feb 2023
- Submitted to ICLR 2023
- Readers: Everyone
UL2: Unifying Language Learning Paradigms
Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Xavier Garcia, Jason Wei, Xuezhi Wang, Hyung Won Chung, Dara Bahri, Tal Schuster, Steven Zheng, Denny Zhou, Neil Houlsby, Donald Metzler
- Published: 01 Feb 2023, Last Modified: 02 Mar 2023
- ICLR 2023 poster
- Readers: Everyone
DSI++: Updating Transformer Memory with New Documents
Sanket Vaibhav Mehta, Jai Gupta, Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Jinfeng Rao, Marc Najork, Emma Strubell, Donald Metzler
- 22 Sept 2022 (modified: 13 Feb 2023)
- ICLR 2023 Conference Withdrawn Submission
- Readers: Everyone
Transformer Memory as a Differentiable Search Index
Yi Tay, Vinh Q. Tran, Mostafa Dehghani, Jianmo Ni, Dara Bahri, Harsh Mehta, Zhen Qin, Kai Hui, Zhe Zhao, Jai Gupta, Tal Schuster, William W. Cohen, Donald Metzler
- Published: 31 Oct 2022, Last Modified: 08 Feb 2026
- NeurIPS 2022 Accept
- Readers: Everyone
Confident Adaptive Language Modeling
Tal Schuster, Adam Fisch, Jai Gupta, Mostafa Dehghani, Dara Bahri, Vinh Q. Tran, Yi Tay, Donald Metzler
- Published: 31 Oct 2022, Last Modified: 08 Feb 2026
- NeurIPS 2022 Accept
- Readers: Everyone
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning
Vamsi Aribandi, Yi Tay, Tal Schuster, Jinfeng Rao, Huaixiu Steven Zheng, Sanket Vaibhav Mehta, Honglei Zhuang, Vinh Q. Tran, Dara Bahri, Jianmo Ni, Jai Gupta, Kai Hui, Sebastian Ruder, Donald Metzler
- Published: 28 Jan 2022, Last Modified: 12 Oct 2025
- ICLR 2022 Poster
- Readers: Everyone
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization
Yi Tay, Vinh Q. Tran, Sebastian Ruder, Jai Gupta, Hyung Won Chung, Dara Bahri, Zhen Qin, Simon Baumgartner, Cong Yu, Donald Metzler
- Published: 28 Jan 2022, Last Modified: 12 Oct 2025
- ICLR 2022 Poster
- Readers: Everyone

Co-Authors

View all 34 co-authors

Vinh Q. Tran

Names

Emails

Personal Links

Career & Education History

Advisors, Relations & Conflicts

Expertise

Publications

Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?

UL2: Unifying Language Learning Paradigms

DSI++: Updating Transformer Memory with New Documents

Transformer Memory as a Differentiable Search Index

Confident Adaptive Language Modeling

ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning

Charformer: Fast Character Transformers via Gradient-based Subword Tokenization

Co-Authors