Harsh Trivedi

Researcher, Aristo, Allen Institute for Artificial Intelligence

Joined

July 2019

Names

Harsh Trivedi (Preferred)

Emails

****@cs.stonybrook.edu (Confirmed)

****@allenai.org (Confirmed)

Personal Links

Career & Education History

Researcher

Aristo, Allen Institute for Artificial Intelligence (allenai.org)

2025 – Present

PhD student

Aristo, State University of New York, Stony Brook (stonybrook.edu)

2019 – 2025

Advisors, Relations & Conflicts

Coworker

Ashish Sabharwal

2025 – Present

PhD Advisor

Niranjan Balasubramanian

2019 – 2025

Expertise

Agents

Present

Tool use

Interactive code generation

Present

Web agents

Computer use

Present

Publications

Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces
Mike A Merrill, Alexander Glenn Shaw, Nicholas Carlini, Boxuan Li, Harsh Raj, Ivan Bercovich, Lin Shi, Jeong Yeon Shin, Thomas Walshe, E. Kelly Buchanan, Junhong Shen, Guanghao Ye, Haowei Lin, Jason Poulos, Maoyu Wang, Marianna Nezhurina, Di Lu, Orfeas Menis Mastromichalakis, Zhiwei Xu, Zizhao Chen et al. (64 additional authors not shown)
- ICLR 2026 Poster
- Readers: Everyone
Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluation
Sayash Kapoor, Benedikt Stroebl, Peter Kirgis, Nitya Nadgir, Zachary S Siegel, Boyi Wei, Tianci Xue, Ziru Chen, Felix Chen, Saiteja Utpala, Franck Ndzomga, Dheeraj Oruganty, Sophie Luskin, Kangheng Liu, Botao Yu, Amit Arora, Dongyoon Hahm, Harsh Trivedi, Huan Sun, Juyong Lee et al. (11 additional authors not shown)
- ICLR 2026 Poster
- Readers: Everyone
AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents
Harsh Trivedi, Tushar Khot, Mareike Hartmann, Ruskin Manku, Vinty Dong, Edward Li, Shashank Gupta, Ashish Sabharwal, Niranjan Balasubramanian
- ACL 2024
- Readers: Everyone
Two-Turn Debate Does Not Help Humans Answer Hard Reading Comprehension Questions
Alicia Parrish, Harsh Trivedi, Nikita Nangia, Jason Phang, Vishakh Padmakumar, Amanpreet Singh Saimbhi, Samuel R. Bowman
- Published: 05 Dec 2022, Last Modified: 05 May 2023
- MLSW2022
- Readers: Everyone
Decomposed Prompting: A Modular Approach for Solving Complex Tasks
Tushar Khot, Harsh Trivedi, Matthew Finlayson, Yao Fu, Kyle Richardson, Peter Clark, Ashish Sabharwal
- Published: 01 Feb 2023, Last Modified: 14 Jan 2026
- ICLR 2023 poster
- Readers: Everyone
Single-Turn Debate Does Not Help Humans Answer Hard Reading-Comprehension Questions
Alicia Parrish, Harsh Trivedi, Ethan Perez, Angelica Chen, Nikita Nangia, Jason Phang, Samuel R. Bowman
- 13 Mar 2022 (modified: 08 Feb 2026)
- LNLS
- Readers: Everyone
Decomposed Prompting: A Modular Approach for Solving Complex Tasks
Tushar Khot, Harsh Trivedi, Matthew Finlayson, Yao Fu, Kyle Richardson, Peter Clark, Ashish Sabharwal
- 2022 (modified: 17 Apr 2023)
- CoRR 2022
- Readers: Everyone
Two-Turn Debate Doesn't Help Humans Answer Hard Reading Comprehension Questions
Alicia Parrish, Harsh Trivedi, Nikita Nangia, Vishakh Padmakumar, Jason Phang, Amanpreet Singh Saimbhi, Samuel R. Bowman
- 2022 (modified: 24 Apr 2023)
- CoRR 2022
- Readers: Everyone
Single-Turn Debate Does Not Help Humans Answer Hard Reading-Comprehension Questions
Alicia Parrish, Harsh Trivedi, Ethan Perez, Angelica Chen, Nikita Nangia, Jason Phang, Samuel R. Bowman
- 2022 (modified: 24 Apr 2023)
- CoRR 2022
- Readers: Everyone
♫ MuSiQue: Multihop Questions via Single-hop Question Composition
Harsh Trivedi, Niranjan Balasubramanian, Tushar Khot, Ashish Sabharwal
- Published: 01 Jan 2022, Last Modified: 27 Jun 2023
- Trans. Assoc. Comput. Linguistics 2022
- Readers: Everyone

View all 26 publications

Co-Authors

View all 144 co-authors