Andy K Zhang

Researcher, Computer Science Department, Stanford University

Joined

September 2023

Names

Andy K Zhang (Preferred)

Emails

****@cs.stanford.edu (Confirmed)

****@stanford.edu (Confirmed)

Personal Links

Homepage

Career & Education History

Researcher

Computer Science Department, Stanford University (cs.stanford.edu)

2023 – Present

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

Establishing Best Practices for Building Rigorous Agentic Benchmarks
Yuxuan Zhu, Tengjun Jin, Yada Pruksachatkun, Andy K Zhang, Shu Liu, Sasha Cui, Sayash Kapoor, Shayne Longpre, Kevin Meng, Rebecca Weiss, Fazl Barez, Rahul Gupta, Jwala Dhamala, Jacob Merizian, Mario Giulianelli, Harry Coppock, Cozmin Ududec, Jasjeet S Sekhon, Jacob Steinhardt, Antony Kellermann et al. (5 additional authors not shown)
- NeurIPS 2025
- Readers: Everyone
BountyBench: Dollar Impact of AI Agent Attackers and Defenders on Real-World Cybersecurity Systems
Andy K Zhang, Joey Ji, Celeste Menders, Riya Dulepet, Thomas Qin, Ron Yifeng Wang, Junrong Wu, Kyleen Liao, Jiliang Li, Jinghan Hu, Sara Hong, Nardos Demilew, Shivatmica Murgai, Jason Khiem Tran, Nishka Kacheria, Ethan Jun-shen Ho, Denis Liu, Lauren McLane, Olivia Beyer Bruvik, Dai-Rong Han et al. (14 additional authors not shown)
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
Fallacies of Data Transparency: Rethinking Nutrition Facts for AI
Judy Hanwen Shen, Ken Liu, Angelina Wang, Sarah H. Cen, Andy K Zhang, Caroline Meinhardt, Daniel Zhang, Kevin Klyman, Rishi Bommasani, Daniel E. Ho
- ICML 2025 Workshop TAIG Poster
- Readers: Everyone
Establishing Best Practices in Building Rigorous Agentic Benchmarks
Yuxuan Zhu, Tengjun Jin, Yada Pruksachatkun, Andy K Zhang, Shu Liu, Sasha Cui, Sayash Kapoor, Shayne Longpre, Kevin Meng, Rebecca Weiss, Fazl Barez, Rahul Gupta, Jwala Dhamala, Jacob Merizian, Mario Giulianelli, Harry Coppock, Cozmin Ududec, Antony Kellermann, Jasjeet S Sekhon, Jacob Steinhardt et al. (6 additional authors not shown)
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
Position: Language model developers should report train-test overlap
Andy K Zhang, Kevin Klyman, Yifan Mai, Yoav Levine, Yian Zhang, Rishi Bommasani, Percy Liang
- ICML 2025 Position Paper Track spotlightposter
- Readers: Everyone
Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risks of Language Models
Andy K Zhang, Neil Perry, Riya Dulepet, Joey Ji, Celeste Menders, Justin W Lin, Eliot Jones, Gashon Hussein, Samantha Liu, Donovan Julian Jasper, Pura Peetathawatchai, Ari Glenn, Vikram Sivashankar, Daniel Zamoshchin, Leo Glikbarg, Derek Askaryar, Haoxiang Yang, Aolin Zhang, Rishi Alluri, Nathan Tran et al. (5 additional authors not shown)
- ICLR 2025 Oral
- Readers: Everyone

Co-Authors

View all 85 co-authors

Andy K Zhang

Names

Emails

Personal Links

Career & Education History

Advisors, Relations & Conflicts

Expertise

Publications

Establishing Best Practices for Building Rigorous Agentic Benchmarks

BountyBench: Dollar Impact of AI Agent Attackers and Defenders on Real-World Cybersecurity Systems

Fallacies of Data Transparency: Rethinking Nutrition Facts for AI

Establishing Best Practices in Building Rigorous Agentic Benchmarks

Position: Language model developers should report train-test overlap

Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risks of Language Models

Co-Authors