Karolina Korgul

PhD student, University of Oxford

Joined

October 2023

Names

Karolina Korgul (Preferred)

Emails

****@gmail.com (Confirmed)

****@oii.ox.ac.uk (Confirmed)

Personal Links

Google Scholar

ORCID

Career & Education History

PhD student

University of Oxford (ox.ac.uk)

2024 – Present

MS student

University of Oxford (ox.ac.uk)

2022 – 2023

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

It's a TRAP! Task-Redirecting Agent Persuasion Benchmark for Web Agents
Karolina Korgul, Yushi Yang, Arkadiusz Drohomirecki, Piotr Blaszczyk, Will Howard, Lukas Aichberger, Chris Russell, Philip Torr, Adam Mahdi, Adel Bibi
- ICML 2026 AIWILD
- Readers: Everyone
It's a TRAP! Task-Redirecting Agent Persuasion Benchmark for Web Agents
Karolina Korgul, Yushi Yang, Arkadiusz Drohomirecki, Piotr Blaszczyk, Will Howard, Lukas Aichberger, Chris Russell, Philip Torr, Adam Mahdi, Adel Bibi
- Submitted to ICLR 2026
- Readers: Everyone
LINGOLY-TOO: Disentangling Reasoning from Knowledge with Templatised Orthographic Obfuscation
Jude Khouja, Lingyi Yang, Karolina Korgul, Simeon Hellsten, Vlad A. Neacșu, Harry Mayne, Ryan Othniel Kearns, Andrew M. Bean, Adam Mahdi
- ICLR 2026 Poster
- Readers: Everyone
Measuring what Matters: Construct Validity in Large Language Model Benchmarks
Andrew M. Bean, Ryan Othniel Kearns, Angelika Romanou, Franziska Sofia Hafner, Harry Mayne, Jan Batzner, Negar Foroutan, Chris Schmitz, Karolina Korgul, Hunar Batra, Oishi Deb, Emma Beharry, Cornelius Emde, Thomas Foster, Anna Gausen, María Grandury, Simeng Han, Valentin Hofmann, Lujain Ibrahim, Hazel Kim et al. (22 additional authors not shown)
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
Do Large Language Models have Shared Weaknesses in Medical Question Answering?
Andrew Michael Bean, Karolina Korgul, Felix Krones, Robert McCraith, Adam Mahdi
- AIM-FM Workshop @ NeurIPS'24 Poster
- Readers: Everyone

Co-Authors

View all 53 co-authors