Albert Webson

Research Scientist, Google DeepMind

Joined

April 2021

Names

Albert Webson (Preferred)

Emails

****@brown.edu (Confirmed)

****@google.com (Confirmed)

****@awebson.org (Confirmed)

****@awebson.com (Confirmed)

Personal Links

Career & Education History

Research Scientist

Google DeepMind (google.com)

2022 – Present

PhD student

Brown University (brown.edu)

2018 – 2023

Advisors, Relations & Conflicts

PhD Advisor

Ellie Pavlick

2018 – Present

Expertise

developmental psychology

theory of concepts

theory of meaning

Present

natural language inference

semantic representations

probing

causality

heuristics

Present

prompt

instruction tuning

zero-shot

chain-of-thought

reasoning

Present

alignment

model organism

Present

Publications

Larger language models do in-context learning differently
Jerry Wei, Jason Wei, Yi Tay, Dustin Tran, Albert Webson, Yifeng Lu, Xinyun Chen, Hanxiao Liu, Da Huang, Denny Zhou, Tengyu Ma
- Submitted to ICLR 2025
- Readers: Everyone
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V Le, Barret Zoph, Jason Wei, Adam Roberts
- 16 Feb 2024
- OpenReview Archive Direct Upload
- Readers: Everyone
Mixture-of-experts meets instruction tuning: A winning combination for large language models
Sheng Shen, Le Hou, Yanqi Zhou, Nan Du, Shayne Longpre, Jason Wei, Hyung Won Chung, Barret Zoph, William Fedus, Xinyun Chen, Tu Vu, Yuexin Wu, Wuyang Chen, Albert Webson, Yunxuan Li, Vincent Y Zhao, Hongkun Yu, Kurt Keutzer, Trevor Darrell, Denny Zhou
- 16 Feb 2024
- OpenReview Archive Direct Upload
- Readers: Everyone
Larger language models do in-context learning differently
Jerry Wei, Jason Wei, Yi Tay, Dustin Tran, Albert Webson, Yifeng Lu, Xinyun Chen, Hanxiao Liu, Da Huang, Denny Zhou, Tengyu Ma
- ICLR 2024 Conference Withdrawn Submission
- Readers: Everyone
Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models
Sheng Shen, Le Hou, Yanqi Zhou, Nan Du, Shayne Longpre, Jason Wei, Hyung Won Chung, Barret Zoph, William Fedus, Xinyun Chen, Tu Vu, Yuexin Wu, Wuyang Chen, Albert Webson, Yunxuan Li, Vincent Y Zhao, Hongkun Yu, Kurt Keutzer, Trevor Darrell, Denny Zhou
- ICLR 2024 poster
- Readers: Everyone
Are Language Models Worse than Humans at Following Prompts? It's Complicated
Albert Webson, Alyssa Marie Loo, Qinan Yu, Ellie Pavlick
- EMNLP 2023 Findings
- Readers: Everyone
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V Le, Barret Zoph, Jason Wei, Adam Roberts
- ICML 2023 Poster
- Readers: Everyone
Multitask Prompted Training Enables Zero-Shot Task Generalization
Victor Sanh, Albert Webson, Colin Raffel, Stephen Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Arun Raja, Manan Dey, M Saiful Bari, Canwen Xu, Urmish Thakker, Shanya Sharma Sharma, Eliza Szczechla, Taewoon Kim, Gunjan Chhablani, Nihal Nayak, Debajyoti Datta, Jonathan Chang et al. (20 additional authors not shown)
- Published: 28 Jan 2022, Last Modified: 12 Oct 2025
- ICLR 2022 Spotlight
- Readers: Everyone
Multitask Prompted Training Enables Zero-Shot Task Generalization
Victor Sanh, Albert Webson, Colin Raffel, Stephen H. Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Teven Le Scao, Arun Raja, Manan Dey, M. Saiful Bari, Canwen Xu, Urmish Thakker, Shanya Sharma, Eliza Szczechla, Taewoon Kim, Gunjan Chhablani, Nihal V. Nayak, Debajyoti Datta et al. (21 additional authors not shown)
- 2021 (modified: 07 Nov 2021)
- CoRR 2021
- Readers: Everyone
Do Prompt-Based Models Really Understand the Meaning of their Prompts?
Albert Webson, Ellie Pavlick
- 2021 (modified: 12 Jan 2022)
- CoRR 2021
- Readers: Everyone

View all 11 publications

Co-Authors

View all 78 co-authors