Patrick Chao

Researcher, OpenAI

Joined

June 2022

Names

Patrick Chao (Preferred)

Emails

****@gmail.com (Confirmed)

****@wharton.upenn.edu (Confirmed)

****@openai.com (Confirmed)

Personal Links

Homepage

DBLP

Career & Education History

Researcher

OpenAI (openai.com)

2024 – Present

PhD student

Statistics, The Wharton School, University of Pennsylvania (wharton.upenn.edu)

2020 – 2024

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Tasks
Tejal Patwardhan, Rachel Dias, Elizabeth Proehl, Grace Kim, Michele Wang, Olivia Watkins, Simon Posada Fishman, Marwan Aljubeh, Phoebe Thacker, Laurance Fauconnet, Natalie S. Kim, Samuel Miserendino, Gildas Chabot, David Li, Patrick Chao, Michael Sharman, Alexandra Barr, Amelia Glaese, Jerry Tworek
- ICLR 2026 Poster
- Readers: Everyone
Watermarking Language Models with Error Correcting Codes
Patrick Chao, Yan Sun, Edgar Dobriban, Hamed Hassani
- WMARK@ICLR2025
- Readers: Everyone
Modeling Causal Mechanisms with Diffusion Models for Interventional and Counterfactual Queries
Patrick Chao, Patrick Blöbaum, Sapan Kirit Patel, Shiva Kasiviswanathan
- Accepted by TMLR
- Readers: Everyone
JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models
Patrick Chao, Edoardo Debenedetti, Alexander Robey, Maksym Andriushchenko, Francesco Croce, Vikash Sehwag, Edgar Dobriban, Nicolas Flammarion, George J. Pappas, Florian Tramèr, Hamed Hassani, Eric Wong
- NextGenAISafety 2024 Poster
- Readers: Everyone
JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models
Patrick Chao, Edoardo Debenedetti, Alexander Robey, Maksym Andriushchenko, Francesco Croce, Vikash Sehwag, Edgar Dobriban, Nicolas Flammarion, George J. Pappas, Florian Tramèr, Hamed Hassani, Eric Wong
- NeurIPS 2024 Track Datasets and Benchmarks Poster
- Readers: Everyone
Position: A Safe Harbor for AI Evaluation and Red Teaming
Shayne Longpre, Sayash Kapoor, Kevin Klyman, Ashwin Ramaswami, Rishi Bommasani, Borhane Blili-Hamelin, Yangsibo Huang, Aviya Skowron, Zheng Xin Yong, Suhas Kotha, Yi Zeng, Weiyan Shi, Xianjun Yang, Reid Southen, Alexander Robey, Patrick Chao, Diyi Yang, Ruoxi Jia, Daniel Kang, Alex Pentland et al. (3 additional authors not shown)
- ICML 2024 Oral
- Readers: Everyone
Jailbreaking Black Box Large Language Models in Twenty Queries
Patrick Chao, Alexander Robey, Edgar Dobriban, Hamed Hassani, George J. Pappas, Eric Wong
- R0-FoMo Poster
- Readers: Everyone
Jailbreaking Black Box Large Language Models in Twenty Queries
Patrick Chao, Alexander Robey, Edgar Dobriban, Hamed Hassani, George J. Pappas, Eric Wong
- Submitted to ICLR 2024
- Readers: Everyone
Black Box Adversarial Prompting for Foundation Models
Natalie Maus, Patrick Chao, Eric Wong, Jacob R. Gardner
- AdvML-Frontiers 2023
- Readers: Everyone
Interventional and Counterfactual Inference with Diffusion Models
Patrick Chao, Patrick Blöbaum, Shiva Prasad Kasiviswanathan
- 2023 (modified: 10 Apr 2023)
- CoRR 2023
- Readers: Everyone

View all 11 publications

Co-Authors

View all 57 co-authors