Ethan Dyer

Staff, Google

Joined

July 2019

Names

Ethan Dyer

Emails

****@google.com (Confirmed)

Personal Links

Career & Education History

Staff

Google (google.com)

2018 – Present

Postdoc

Stanford University (stanford.edu)

2014 – 2017

PhD student

Massachusetts Institute of Technology (mit.edu)

2009 – 2014

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
Avi Singh, John D Co-Reyes, Rishabh Agarwal, Ankesh Anand, Piyush Patil, Xavier Garcia, Peter J Liu, James Harrison, Jaehoon Lee, Kelvin Xu, Aaron T Parisi, Abhishek Kumar, Alexander A Alemi, Alex Rizkowsky, Azade Nova, Ben Adlam, Bernd Bohnet, Gamaleldin Fathy Elsayed, Hanie Sedghi, Igor Mordatch et al. (20 additional authors not shown)
- Accepted by TMLR
- Readers: Everyone
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R. Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, Agnieszka Kluska, Aitor Lewkowycz, Akshat Agarwal, Alethea Power, Alex Ray, Alex Warstadt, Alexander W. Kocurek, Ali Safaya, Ali Tazarv, Alice Xiang et al. (430 additional authors not shown)
- Accepted by TMLR
- Readers: Everyone
Exploring Length Generalization in Large Language Models
Cem Anil, Yuhuai Wu, Anders Johan Andreassen, Aitor Lewkowycz, Vedant Misra, Vinay Venkatesh Ramasesh, Ambrose Slone, Guy Gur-Ari, Ethan Dyer, Behnam Neyshabur
- Published: 31 Oct 2022, Last Modified: 16 Dec 2022
- NeurIPS 2022 Accept
- Readers: Everyone
Block-Recurrent Transformers
DeLesley Hutchins, Imanol Schlag, Yuhuai Wu, Ethan Dyer, Behnam Neyshabur
- Published: 31 Oct 2022, Last Modified: 08 Feb 2026
- NeurIPS 2022 Accept
- Readers: Everyone
Solving Quantitative Reasoning Problems with Language Models
Aitor Lewkowycz, Anders Johan Andreassen, David Dohan, Ethan Dyer, Henryk Michalewski, Vinay Venkatesh Ramasesh, Ambrose Slone, Cem Anil, Imanol Schlag, Theo Gutman-Solo, Yuhuai Wu, Behnam Neyshabur, Guy Gur-Ari, Vedant Misra
- Published: 31 Oct 2022, Last Modified: 14 Oct 2022
- NeurIPS 2022 Accept
- Readers: Everyone
Explaining Scaling Laws of Neural Network Generalization
Yasaman Bahri, Ethan Dyer, Jared Kaplan, Jaehoon Lee, Utkarsh Sharma
- Published: 28 Jan 2022, Last Modified: 13 Feb 2023
- ICLR 2022 Submitted
- Readers: Everyone
Effect of scale on catastrophic forgetting in neural networks
Vinay Venkatesh Ramasesh, Aitor Lewkowycz, Ethan Dyer
- Published: 28 Jan 2022, Last Modified: 13 Feb 2023
- ICLR 2022 Poster
- Readers: Everyone
Explaining Neural Scaling Laws
Yasaman Bahri, Jaehoon Lee, Ethan Dyer, Jared Kaplan, Utkarsh Sharma
- 13 May 2021 (modified: 13 May 2021)
- OpenReview Archive Direct Upload
- Readers: Everyone
The large learning rate phase of deep learning
Aitor Lewkowycz, Yasaman Bahri, Ethan Dyer, Jascha Sohl-Dickstein, Guy Gur-Ari
- 28 Sept 2020 (modified: 12 Oct 2025)
- ICLR 2021 Conference Blind Submission
- Readers: Everyone
When Do Curricula Work?
Xiaoxia Wu, Ethan Dyer, Behnam Neyshabur
- Published: 12 Jan 2021, Last Modified: 12 Oct 2025
- ICLR 2021 Oral
- Readers: Everyone

View all 13 publications

Co-Authors

View all 493 co-authors