Jesse Dodge

Researcher, Meta

Joined

October 2017

Names

Jesse Dodge

Emails

****@gmail.com (Confirmed)

****@cs.cmu.edu (Confirmed)

****@cs.washington.edu (Confirmed)

****@allenai.org (Confirmed)

****@meta.com (Confirmed)

Personal Links

Career & Education History

Researcher

Meta (meta.com)

2025 – Present

Researcher

Allen Institute for Artificial Intelligence (allenai.org)

2021 – 2025

Postdoc

Allen Institute for Artificial Intelligence (allenai.org)

2020 – 2021

PhD student

Carnegie Mellon University (cmu.edu)

2013 – 2020

Undergrad student

University of Washington (washington.edu)

2009 – 2013

Advisors, Relations & Conflicts

PhD Advisor

Noah Smith

2014 – 2020

Expertise

reproducibility

Present

fine-tuning language models

Present

model compression

Present

language model evaluation

Present

Publications

Position: Machine Learning Conferences Should Establish a "Refutations and Critiques" Track
Rylan Schaeffer, Joshua Kazdan, Yegor Denisov-Blanch, Brando Miranda, Matthias Gerstgrasser, Susan Zhang, Andreas Haupt, Isha Gupta, Elyas Obbad, Jesse Dodge, Jessica Zosa Forde, Francesco Orabona, Sanmi Koyejo, David L. Donoho
- NeurIPS 2025 Position Paper Track Oral
- Readers: Everyone
Signal and Noise: A Framework for Reducing Uncertainty in Language Model Evaluation
David Heineman, Valentin Hofmann, Ian Magnusson, Yuling Gu, Noah A. Smith, Hannaneh Hajishirzi, Kyle Lo, Jesse Dodge
- NeurIPS 2025 spotlight
- Readers: Everyone
SciArena: An Open Evaluation Platform for Non-Verifiable Scientific Literature-Grounded Tasks
Yilun Zhao, Kaiyan Zhang, Tiansheng Hu, Sihong Wu, Ronan Le Bras, Yixin Liu, Xiangru Tang, Joseph Chee Chang, Jesse Dodge, Jonathan Bragg, Chen Zhao, Hannaneh Hajishirzi, Doug Downey, Arman Cohan
- NeurIPS 2025 Datasets and Benchmarks Track spotlight
- Readers: Everyone
Fluid Language Model Benchmarking
Valentin Hofmann, David Heineman, Ian Magnusson, Kyle Lo, Jesse Dodge, Maarten Sap, Pang Wei Koh, Chun Wang, Hannaneh Hajishirzi, Noah A. Smith
- COLM 2025
- Readers: Everyone
Establishing Task Scaling Laws via Compute-Efficient Model Ladders
Akshita Bhagia, Jiacheng Liu, Alexander Wettig, David Heineman, Oyvind Tafjord, Ananya Harsh Jha, Luca Soldaini, Noah A. Smith, Dirk Groeneveld, Pang Wei Koh, Jesse Dodge, Hannaneh Hajishirzi
- COLM 2025
- Readers: Everyone
DataDecide: How to Predict Best Pretraining Data with Small Experiments
Ian Magnusson, Nguyen Tai, Ben Bogin, David Heineman, Jena D. Hwang, Luca Soldaini, Akshita Bhagia, Jiacheng Liu, Dirk Groeneveld, Oyvind Tafjord, Noah A. Smith, Pang Wei Koh, Jesse Dodge
- ICML 2025 poster
- Readers: Everyone
Holistically Evaluating the Environmental Impact of Creating Language Models
Jacob Morrison, Clara Na, Jared Fernandez, Tim Dettmers, Emma Strubell, Jesse Dodge
- ICLR 2025 Spotlight
- Readers: Everyone
Paloma: A Benchmark for Evaluating Language Model Fit
Ian Magnusson, Akshita Bhagia, Valentin Hofmann, Luca Soldaini, Ananya Harsh Jha, Oyvind Tafjord, Dustin Schwenk, Evan Pete Walsh, Yanai Elazar, Kyle Lo, Dirk Groeneveld, Iz Beltagy, Hannaneh Hajishirzi, Noah A. Smith, Kyle Richardson, Jesse Dodge
- NeurIPS 2024 Track Datasets and Benchmarks Poster
- Readers: Everyone
OLMo: Accelerating the Science of Language Models
Dirk Groeneveld, Iz Beltagy, Evan Pete Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, Russell Authur, Khyathi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill et al. (22 additional authors not shown)
- 20 Feb 2024
- OpenReview Archive Direct Upload
- Readers: Everyone
Catwalk: A Unified Language Model Evaluation Framework for Many Datasets
Dirk Groeneveld, Anas Awadalla, Iz Beltagy, Akshita Bhagia, Ian Magnusson, Hao Peng, Oyvind Tafjord, Evan Pete Walsh, Kyle Richardson, Jesse Dodge
- 20 Feb 2024
- OpenReview Archive Direct Upload
- Readers: Everyone

View all 34 publications

Co-Authors

View all 142 co-authors