Benjamin Newman

PhD student, University of Washington

Joined

September 2021

Names

Benjamin Newman (Preferred)

Emails

****@cs.stanford.edu (Confirmed)

****@allenai.org (Confirmed)

****@cs.washington.edu (Confirmed)

Personal Links

Career & Education History

PhD student

University of Washington (cs.washington.edu)

2023 – Present

Researcher

Allen Institute for Artificial Intelligence (allenai.org)

2022 – 2023

MS student

Stanford University (stanford.edu)

2021 – 2022

Intern

SalesForce.com (salesforce.com)

2021 – 2021

Advisors, Relations & Conflicts

No relations added

Expertise

NLP

interpretability

probing

prompting

psycholinguistics

Present

Publications

ARXIVDIGESTABLES: Synthesizing Scientific Literature into Tables using Language Models
Benjamin Newman
- EMNLP 2024
- Readers: Everyone
Spectrum Tuning: Post-Training for Distributional Coverage and In-Context Steerability
Taylor Sorensen, Benjamin Newman, Jared Moore, Chan Young Park, Jillian Fisher, Niloofar Mireshghallah, Liwei Jiang, Yejin Choi
- ICLR 2026 Poster
- Readers: Everyone
Verifying the Verifiers: Unveiling Pitfalls and Potentials in Fact Verifiers
Wooseok Seo, Seungju Han, Jaehun Jung, Benjamin Newman, Seungwon Lim, Seungbeen Lee, Ximing Lu, Yejin Choi, Youngjae Yu
- COLM 2025
- Readers: Everyone
The Generative AI Paradox: “What It Can Create, It May Not Understand”
Peter West, Ximing Lu, Nouha Dziri, Faeze Brahman, Linjie Li, Jena D. Hwang, Liwei Jiang, Jillian Fisher, Abhilasha Ravichander, Khyathi Chandu, Benjamin Newman, Pang Wei Koh, Allyson Ettinger, Yejin Choi
- ICLR 2024 poster
- Readers: Everyone
A Question Answering Framework for Decontextualizing User-facing Snippets from Scientific Documents
Benjamin Newman, Luca Soldaini, Raymond Fok, Arman Cohan, Kyle Lo
- EMNLP 2023 Main
- Readers: Everyone
Holistic Evaluation of Language Models
Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, Benjamin Newman, Binhang Yuan, Bobby Yan, Ce Zhang, Christian Cosgrove, Christopher D Manning, Christopher Re, Diana Acosta-Navas, Drew A. Hudson, Eric Zelikman et al. (30 additional authors not shown)
- Accepted by TMLR
- Readers: Everyone
A Controllable QA-based Framework for Decontextualization
Benjamin Newman, Luca Soldaini, Raymond Fok, Arman Cohan, Kyle Lo
- Published: 01 Jan 2023, Last Modified: 17 Jun 2023
- CoRR 2023
- Readers: Everyone
Comparing Sentence-Level Suggestions to Message-Level Suggestions in AI-Mediated Communication
Liye Fu, Benjamin Newman, Maurice Jakesch, Sarah Kreps
- Published: 01 Jan 2023, Last Modified: 10 Jul 2023
- CHI 2023
- Readers: Everyone
Holistic Evaluation of Language Models
Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, Benjamin Newman, Binhang Yuan, Bobby Yan, Ce Zhang, Christian Cosgrove, Christopher D. Manning, Christopher Ré, Diana Acosta-Navas, Drew A. Hudson, Eric Zelikman et al. (30 additional authors not shown)
- 2022 (modified: 09 Dec 2022)
- CoRR 2022
- Readers: Everyone
P-Adapters: Robustly Extracting Factual Information from Language Models with Diverse Prompts
Benjamin Newman, Prafulla Kumar Choubey, Nazneen Rajani
- 2022 (modified: 24 Apr 2023)
- ICLR 2022
- Readers: Everyone

View all 17 publications

Co-Authors

View all 93 co-authors