Kilian Lieret

Researcher, FAIR, Facebook

Researcher, Computer Science, Princeton University

Joined

May 2024

Names

Kilian Lieret (Preferred)

Kilian Adriano Lieret

Emails

****@princeton.edu (Confirmed)

****@posteo.de (Confirmed)

****@campus.lmu.de

****@lmu.de

****@meta.com (Confirmed)

Personal Links

Career & Education History

Researcher

FAIR, Facebook (meta.com)

2026 – Present

Researcher

Computer Science, Princeton University (princeton.edu)

2024 – 2026

Postdoc

Physics, Princeton University (princeton.edu)

2022 – 2024

PhD student

Physics, Ludwig-Maximilians-Universität München (lmu.de)

2018 – 2022

Advisors, Relations & Conflicts

Coauthor

Ofir Press

Present

Coauthor

John Yang

Present

Coauthor

Carlos E. Jimenez

Present

Postdoc Advisor

Karthik R Narasimhan

2024 – 2025

Postdoc Advisor

G.J. Peter Elmer

2022 – 2024

PhD Advisor

Thomas Kuhr

2018 – 2022

Expertise

Benchmarks

Present

AI for Software engineering

Present

AI agents

2024 – Present

Publications

CodeClash: Benchmarking Goal-Oriented Software Engineering
John Yang, Kilian Lieret, Joyce Yang, Carlos E. Jimenez, Ofir Press, Ludwig Schmidt, Diyi Yang
- CoRR 2025
- Readers: Everyone
Locality-Sensitive Hashing-Based Efficient Point Transformer for Charged Particle Reconstruction
Shitij Govil, Jack P. Rodgers, Yuan-Tang Chou, Siqi Miao, Amit Saha, Advaith Anand, Kilian Lieret, Gage DeZoort, Mia Liu, Javier M. Duarte, Pan Li, Shih-Chieh Hsu
- CoRR 2025
- Readers: Everyone
AlgoTune: Can Language Models Speed Up General-Purpose Numerical Programs?
Ori Press, Brandon Amos, Haoyu Zhao, Yikai Wu, Samuel K. Ainsworth, Dominik Krupke, Patrick Kidger, Touqir Sajed, Bartolomeo Stellato, Jisun Park, Nathanael Bosch, Eli Meril, Albert Steppi, Arman Zharmagambetov, Fangzhao Zhang, David Perez-Pineiro, Alberto Mercurio, Ni Zhan, Talor Abramovich, Kilian Lieret et al. (4 additional authors not shown)
- CoRR 2025
- Readers: Everyone
AlgoTune: Can Language Models Speed Up General-Purpose Numerical Programs?
Ori Press, Brandon Amos, Haoyu Zhao, Yikai Wu, Samuel Ainsworth, Dominik Krupke, Patrick Kidger, Touqir Sajed, Bartolomeo Stellato, Jisun Park, Nathanael Bosch, Eli Meril, Albert Steppi, Arman Zharmagambetov, Fangzhao Zhang, David Pérez-Piñeiro, Alberto Mercurio, Ni Zhan, Talor Abramovich, Kilian Lieret et al. (4 additional authors not shown)
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
SWE-smith: Scaling Data for Software Engineering Agents
John Yang, Kilian Lieret, Carlos E Jimenez, Alexander Wettig, Kabir Khandpur, Yanzhe Zhang, Binyuan Hui, Ofir Press, Ludwig Schmidt, Diyi Yang
- NeurIPS 2025 Datasets and Benchmarks Track spotlight
- Readers: Everyone
EnIGMA: Interactive Tools Substantially Assist LM Agents in Finding Security Vulnerabilities
Talor Abramovich, Meet Udeshi, Minghao Shao, Kilian Lieret, Haoran Xi, Kimberly Milner, Sofija Jancheska, John Yang, Carlos E Jimenez, Farshad Khorrami, Prashanth Krishnamurthy, Brendan Dolan-Gavitt, Muhammad Shafique, Karthik R Narasimhan, Ramesh Karri, Ofir Press
- ICML 2025 poster
- Readers: Everyone
EnIGMA: Interactive Tools Substantially Assist LM Agents in Finding Security Vulnerabilities
Talor Abramovich, Meet Udeshi, Minghao Shao, Kilian Lieret, Haoran Xi, Kimberly Milner, Sofija Jancheska, John Yang, Carlos E. Jimenez, Farshad Khorrami, Prashanth Krishnamurthy, Brendan Dolan-Gavitt, Muhammad Shafique, Karthik R. Narasimhan, Ramesh Karri, Ofir Press
- ICML 2025
- Readers: Everyone
SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?
John Yang, Carlos E. Jimenez, Alex L. Zhang, Kilian Lieret, Joyce Yang, Xindi Wu, Ori Press, Niklas Muennighoff, Gabriel Synnaeve, Karthik R. Narasimhan, Diyi Yang, Sida Wang, Ofir Press
- ICLR 2025
- Readers: Everyone
SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?
John Yang, Carlos E Jimenez, Alex L Zhang, Kilian Lieret, Joyce Yang, Xindi Wu, Ori Press, Niklas Muennighoff, Gabriel Synnaeve, Karthik R Narasimhan, Diyi Yang, Sida Wang, Ofir Press
- ICLR 2025 Poster
- Readers: Everyone
SciCode: A Research Coding Benchmark Curated by Scientists
Minyang Tian, Luyu Gao, Dylan Zhang, Xinan Chen, Cunwei Fan, Xuefei Guo, Roland Haas, Pan Ji, Kittithat Krongchon, Yao Li, Shengyan Liu, Di Luo, Yutao Ma, HAO TONG, Kha Trinh, Chenyu Tian, Zihan Wang, Bohao Wu, Shengzhu Yin, Minhui Zhu et al. (9 additional authors not shown)
- NeurIPS 2024 Track Datasets and Benchmarks Poster
- Readers: Everyone

View all 20 publications

Co-Authors

View all 157 co-authors