Katharyn Garcia

Joined

January 2025

Names

Katharyn Garcia (Preferred)

Emails

****@metr.org (Confirmed)

,

****@gmail.com (Confirmed)

Personal Links

Career & Education History

Researcher

Engineering, Model Evaluation and Threat Research (metr.org)

2024 – 2025

Undergrad student

CNS, California Institute of Technology (caltech.edu)

2011 – 2015

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

Measuring AI Ability to Complete Long Software Tasks
Thomas Kwa, Ben West, Joel Becker, Amy Deng, Katharyn Garcia, Max Hasin, Sami Jawhar, Megan Kinniment, Nate Rush, Sydney Von Arx, Ryan Bloom, Thomas Broadley, Haoxing Du, Brian Goodrich, Nikola Jurkovic, Luke Harold Miles, Seraphina Nix, Tao Roa Lin, Neev Parikh, David Rein et al. (5 additional authors not shown)
- NeurIPS 2025 poster
- Readers: Everyone
RE-Bench: Evaluating Frontier AI R&D Capabilities of Language Model Agents against Human Experts
Hjalmar Wijk, Tao Roa Lin, Joel Becker, Sami Jawhar, Neev Parikh, Thomas Broadley, Lawrence Chan, Michael Chen, Joshua M Clymer, Jai Dhyani, Elena Ericheva, Katharyn Garcia, Brian Goodrich, Nikola Jurkovic, Megan Kinniment, Aron Lajko, Seraphina Nix, Lucas Jun Koba Sato, William Saunders, Maksym Taran et al. (2 additional authors not shown)
- ICML 2025 spotlightposter
- Readers: Everyone

Co-Authors

View all 31 co-authors