Danny Karmon

Researcher, Research, Google

Joined

July 2019

Names

Danny Karmon (Preferred)

Emails

****@karmon.org (Confirmed)

Personal Links

Career & Education History

Researcher

Research, Google (research.google.com)

2022 – 2026

Advisors, Relations & Conflicts

Coauthor

2020 – 2024

Expertise

LLM

2020 – 2024

NLP

2018 – 2024

Publications

Evaluating Generalization Capabilities of LLM-Based Agents in Mixed-Motive Scenarios Using Concordia
Chandler Smith, Marwa Abdulhai, Manfred Diaz, Marko Tesic, Rakshit Trivedi, Sasha Vezhnevets, Lewis Hammond, Jesse Clifton, Minsuk Chang, Edgar A. Duéñez-Guzmán, John P Agapiou, Jayd Matyas, Danny Karmon, Beining Zhang, Jim Dilkes, Akash Kundu, Jord Nguyen, Emanuel Tewolde, Jebish Purbey, Ram Mohan Rao Kadiyala et al. (66 additional authors not shown)
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone
ReCogLab: a framework testing relational reasoning & cognitive hypotheses on LLMs
Andrew Liu, Henry Prior, Gargi Balasubramaniam, Rivka Moroshko, Amir Zait, Ilia Labzovsky, Danny Karmon, Ishita Dasgupta, Kim Stachenfeld, Kenneth Marino
- ICLR 2025 Poster
- Readers: Everyone
The Cognitive Capabilities of Generative AI: A Comparative Analysis with Human Benchmarks
Isaac Galatzer-Levy, David Alexander Munday, Xin Liu, Danny Karmon, Ilia Labzovsky, Rivka Moroshko, Amir Zait, Daniel McDuff
- Submitted to ICLR 2025
- Readers: Everyone
The Ability of Large Language Models to Evaluate Constraint-satisfaction in Agent Responses to Open-ended Requests
Lior Madmoni, Amir Zait, Ilia Labzovsky, Danny Karmon
- Submitted to ICLR 2025
- Readers: Everyone
The Concordia Contest: Advancing the Cooperative Intelligence of Language Agents
Chandler Smith, Rakshit Trivedi, Jesse Clifton, Lewis Hammond, Akbir Khan, Sasha Vezhnevets, John P Agapiou, Edgar A. Duéñez-Guzmán, Jayd Matyas, Danny Karmon, Marwa Abdulhai, Dylan Hadfield-Menell, Natasha Jaques, Joel Z Leibo, Oliver Slumbers, Tim Baarslag, Minsuk Chang
- NeurIPS 2024 Competition Track
- Readers: Everyone
The Ability of Large Language Models to Evaluate Constraint-satisfaction in Agent Responses to Open-ended Requests
Lior Madmoni, Amir Zait, Ilia Labzovsky, Danny Karmon
- CoRR 2024
- Readers: Everyone
Generative agent-based modeling with actions grounded in physical, social, or digital space using Concordia
Alexander Sasha Vezhnevets, John P. Agapiou, Avia Aharon, Ron Ziv, Jayd Matyas, Edgar A. Duéñez-Guzmán, William A. Cunningham, Simon Osindero, Danny Karmon, Joel Z. Leibo
- CoRR 2023
- Readers: Everyone
Federated Multilingual Models for Medical Transcript Analysis
Andre Manoel, Mirian del Carmen Hipolito Garcia, Tal Baumel, Shize Su, Jialei Chen, Robert Sim, Dan Miller, Danny Karmon, Dimitrios Dimitriadis
- CHIL 2023
- Readers: Everyone
Federated Multilingual Models for Medical Transcript Analysis
Andre Manoel, Mirian Hipolito Garcia, Tal Baumel, Shize Su, Jialei Chen, Dan Miller, Danny Karmon, Robert Sim, Dimitrios Dimitriadis
- Published: 01 Jan 2022, Last Modified: 14 May 2023
- CoRR 2022
- Readers: Everyone
Algorithmic copywriting: automated generation of health-related advertisements to improve their performance
Brit Youngmann, Elad Yom-Tov, Ran Gilad-Bachrach, Danny Karmon
- 2021 (modified: 14 Apr 2023)
- Inf. Retr. J. 2021
- Readers: Everyone

View all 15 publications

Co-Authors

View all 123 co-authors