Megan Kinniment

Researcher, METR (formerly ARC Evals)

Joined

March 2024

Names

Megan Kinniment (Preferred)

Emails

****@evals.alignment.org (Confirmed)

,

****@metr.org (Confirmed)

Personal Links

Career & Education History

Researcher

METR (formerly ARC Evals) (evals.alignment.org)

2023 – Present

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

Measuring AI Ability to Complete Long Software Tasks
Thomas Kwa, Ben West, Joel Becker, Amy Deng, Katharyn Garcia, Max Hasin, Sami Jawhar, Megan Kinniment, Nate Rush, Sydney Von Arx, Ryan Bloom, Thomas Broadley, Haoxing Du, Brian Goodrich, Nikola Jurkovic, Luke Harold Miles, Seraphina Nix, Tao Roa Lin, Neev Parikh, David Rein et al. (5 additional authors not shown)
- NeurIPS 2025 poster
- Readers: Everyone
RE-Bench: Evaluating Frontier AI R&D Capabilities of Language Model Agents against Human Experts
Hjalmar Wijk, Tao Roa Lin, Joel Becker, Sami Jawhar, Neev Parikh, Thomas Broadley, Lawrence Chan, Michael Chen, Joshua M Clymer, Jai Dhyani, Elena Ericheva, Katharyn Garcia, Brian Goodrich, Nikola Jurkovic, Megan Kinniment, Aron Lajko, Seraphina Nix, Lucas Jun Koba Sato, William Saunders, Maksym Taran et al. (2 additional authors not shown)
- ICML 2025 spotlightposter
- Readers: Everyone
Evaluating Language-Model Agents on Realistic Autonomous Tasks
Megan Kinniment, Lucas Jun Koba Sato, Haoxing Du, Brian Goodrich, Max Hasin, Lawrence Chan, Luke Harold Miles, Tao Roa Lin, Hjalmar Wijk, Joel Burget, Aaron Ho, Elizabeth Barnes, Paul Christiano
- OpenReview Archive Direct Upload
- Readers: Everyone

Co-Authors

View all 34 co-authors