Sayash Kapoor

PhD student, Princeton University

Joined

May 2022

Names

Sayash Kapoor (Preferred)

Emails

****@princeton.edu (Confirmed)

****@gmail.com (Confirmed)

Personal Links

Homepage

Career & Education History

PhD student

Princeton University (princeton.edu)

2021 – 2026

Advisors, Relations & Conflicts

Coauthor

Rishi Bommasani

2023 – 2026

Coauthor

Percy Liang

2023 – 2026

PhD Advisor

Arvind Narayanan

2021 – 2026

Expertise

No areas of expertise listed

Publications

Establishing Best Practices for Building Rigorous Agentic Benchmarks
Yuxuan Zhu, Tengjun Jin, Yada Pruksachatkun, Andy K Zhang, Shu Liu, Sasha Cui, Sayash Kapoor, Shayne Longpre, Kevin Meng, Rebecca Weiss, Fazl Barez, Rahul Gupta, Jwala Dhamala, Jacob Merizian, Mario Giulianelli, Harry Coppock, Cozmin Ududec, Jasjeet S Sekhon, Jacob Steinhardt, Antony Kellermann et al. (5 additional authors not shown)
- NeurIPS 2025
- Readers: Everyone
The Limits of Inference Scaling Through Resampling
Benedikt Stroebl, Sayash Kapoor, Arvind Narayanan
- ICLR 2026 Poster
- Readers: Everyone
Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluation
Sayash Kapoor, Benedikt Stroebl, Peter Kirgis, Nitya Nadgir, Zachary S Siegel, Boyi Wei, Tianci Xue, Ziru Chen, Felix Chen, Saiteja Utpala, Franck Ndzomga, Dheeraj Oruganty, Sophie Luskin, Kangheng Liu, Botao Yu, Amit Arora, Dongyoon Hahm, Harsh Trivedi, Huan Sun, Juyong Lee et al. (11 additional authors not shown)
- ICLR 2026 Poster
- Readers: Everyone
The Leaderboard Illusion
Shivalika Singh, Yiyang Nan, Alex Wang, Daniel D'souza, Sayash Kapoor, Ahmet Üstün, Sanmi Koyejo, Yuntian Deng, Shayne Longpre, Noah A. Smith, Beyza Ermis, Marzieh Fadaee, Sara Hooker
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
In-House Evaluation Is Not Enough: Towards Robust Third-Party Flaw Disclosure for General-Purpose AI
Shayne Longpre, Kevin Klyman, Ruth E. Appel, Sayash Kapoor, Rishi Bommasani, Michelle Sahar, Sean McGregor, Avijit Ghosh, Borhane Blili-Hamelin, Nathan Butters, Alondra Nelson, Dr. Amit Elazari, Andrew Sellars, Casey John Ellis, Dane Sherrets, Dawn Song, Harley Geiger, Ilona Cohen, Lauren McIlvenny, Madhulika Srikumar et al. (14 additional authors not shown)
- ICML 2025 Workshop TAIG Poster
- Readers: Everyone
Establishing Best Practices in Building Rigorous Agentic Benchmarks
Yuxuan Zhu, Tengjun Jin, Yada Pruksachatkun, Andy K Zhang, Shu Liu, Sasha Cui, Sayash Kapoor, Shayne Longpre, Kevin Meng, Rebecca Weiss, Fazl Barez, Rahul Gupta, Jwala Dhamala, Jacob Merizian, Mario Giulianelli, Harry Coppock, Cozmin Ududec, Antony Kellermann, Jasjeet S Sekhon, Jacob Steinhardt et al. (6 additional authors not shown)
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
Inference Scaling fLaws: The Limits of LLM Resampling with Imperfect Verifiers
Benedikt Stroebl, Sayash Kapoor, Arvind Narayanan
- Preprint (arxiv)
- Readers: Everyone
Position: In-House Evaluation Is Not Enough. Towards Robust Third-Party Evaluation and Flaw Disclosure for General-Purpose AI
Shayne Longpre, Kevin Klyman, Ruth Elisabeth Appel, Sayash Kapoor, Rishi Bommasani, Michelle Sahar, Sean McGregor, Avijit Ghosh, Borhane Blili-Hamelin, Nathan Butters, Alondra Nelson, Dr. Amit Elazari, Andrew Sellars, Casey John Ellis, Dane Sherrets, Dawn Song, Harley Geiger, Ilona Cohen, Lauren McIlvenny, Madhulika Srikumar et al. (14 additional authors not shown)
- ICML 2025 Position Paper Track spotlightposter
- Readers: Everyone
Position: Build Agent Advocates, Not Platform Agents
Sayash Kapoor, Noam Kolt, Seth Lazar
- ICML 2025 Position Paper Track poster
- Readers: Everyone
AI Agents That Matter
Sayash Kapoor, Benedikt Stroebl, Zachary S Siegel, Nitya Nadgir, Arvind Narayanan
- Accepted by TMLR
- Readers: Everyone

View all 16 publications

Co-Authors

View all 130 co-authors