Adam Roberts

Software Engineer, Google

Joined

October 2017

Names

Adam Roberts

Emails

****@google.com (Confirmed)

Personal Links

Google Scholar

DBLP

Career & Education History

Software Engineer

Google (google.com)

2013 – Present

PhD student

University of California Berkeley (berkeley.edu)

2009 – 2013

Undergrad student

University of North Carolina, Chapel Hill (unc.edu)

2003 – 2007

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

A multi-modal transformer for cell type-agnostic regulatory predictions
Nauman Javed, Thomas Weingarten, Arijit Sehanobish, Adam Roberts, Kumar Avinava Dubey, Krzysztof Marcin Choromanski, Bradley Bernstein
- Cell Genomics
- Readers: Everyone
Live Music Models
Antoine Caillon, Brian McWilliams, Cassie Tarakajian, Ian Simon, Ilaria Manco, Jesse Engel, Noah Constant, Yunpeng Li, Timo I. Denk, Alberto Lalama, Andrea Agostinelli, Cheng-Zhi Anna Huang, Ethan Manilow, George Brower, Hakan Erdogan, Heidi Lei, Itai Rolnick, Ivan Grishchenko, Manu Orsini, Matej Kastelic et al. (14 additional authors not shown)
- NeurIPS Creative AI Track 2025
- Readers: Everyone
Training LLMs over Neurally Compressed Text
Brian Lester, Jaehoon Lee, Alexander A Alemi, Jeffrey Pennington, Adam Roberts, Jascha Sohl-Dickstein, Noah Constant
- Accepted by TMLR
- Readers: Everyone
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V Le, Barret Zoph, Jason Wei, Adam Roberts
- 16 Feb 2024
- OpenReview Archive Direct Upload
- Readers: Everyone
Adaptive Accompaniment with ReaLchords
Yusong Wu, Tim Cooijmans, Kyle Kastner, Adam Roberts, Ian Simon, Alexander Scarlatos, Chris Donahue, Cassie Tarakajian, Shayegan Omidshafiei, Aaron Courville, Pablo Samuel Castro, Natasha Jaques, Cheng-Zhi Anna Huang
- ICML 2024 Poster
- Readers: Everyone
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V Le, Barret Zoph, Jason Wei, Adam Roberts
- ICML 2023 Poster
- Readers: Everyone
Large Language Models Struggle to Learn Long-Tail Knowledge
Nikhil Kandpal, Haikang Deng, Adam Roberts, Eric Wallace, Colin Raffel
- ICML 2023 Poster
- Readers: Everyone
UniMax: Fairer and More Effective Language Sampling for Large-Scale Multilingual Pretraining
Hyung Won Chung, Xavier Garcia, Adam Roberts, Yi Tay, Orhan Firat, Sharan Narang, Noah Constant
- Published: 01 Feb 2023, Last Modified: 14 Jan 2026
- ICLR 2023 poster
- Readers: Everyone
Self-supervised Pitch Detection by Inverse Audio Synthesis
Jesse Engel, Rigel Swavely, Lamtharn Hanoi Hantrakul, Adam Roberts, Curtis Hawthorne
- Published: 02 Jul 2020, Last Modified: 05 May 2023
- SAS 2020
- Readers: Everyone
How Much Knowledge Can You Pack Into the Parameters of a Language Model?
Adam Roberts, Colin Raffel, Noam Shazeer
- 2020 (modified: 09 Nov 2022)
- CoRR2020
- Readers: Everyone

View all 33 publications

Co-Authors

View all 124 co-authors