Jun Shern Chan

Joined

March 2022

Names

Jun Shern Chan (Preferred)

Emails

****@gmail.com (Confirmed)

****@nyu.edu (Confirmed)

****@berkeley.edu (Confirmed)

****@c-openai.com (Confirmed)

Personal Links

Career & Education History

Researcher

OpenAI (openai.com)

2023 – 2025

Researcher

New York University (nyu.edu)

2022 – 2022

Intern

University of California, Berkeley (berkeley.edu)

2022 – 2022

Undergrad student

Imperial College London, Imperial College London (imperial.ac.uk)

2014 – 2018

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

PaperBench: Evaluating AI’s Ability to Replicate AI Research
Giulio Starace, Oliver Jaffe, Dane Sherburn, James Aung, Jun Shern Chan, Leon Maksin, Rachel Dias, Evan Mays, Benjamin Kinsella, Wyatt Thompson, Johannes Heidecke, Amelia Glaese, Tejal Patwardhan
- ICML 2025 poster
- Readers: Everyone
MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering
Jun Shern Chan, Neil Chowdhury, Oliver Jaffe, James Aung, Dane Sherburn, Evan Mays, Giulio Starace, Kevin Liu, Leon Maksin, Tejal Patwardhan, Aleksander Madry, Lilian Weng
- ICLR 2025 Oral
- Readers: Everyone
Learning from Natural Language Feedback
Angelica Chen, Jérémy Scheurer, Jon Ander Campos, Tomasz Korbak, Jun Shern Chan, Samuel R. Bowman, Kyunghyun Cho, Ethan Perez
- Accepted by TMLR
- Readers: Everyone
Robustness Evaluation of Proxy Models against Adversarial Optimization
Andy Zou, Long Phan, Nathaniel Li, Jun Shern Chan, Mantas Mazeika, Aidan O'Gara, Steven Basart, Jonathan Ng, Scott Emmons, J Zico Kolter, Matt Fredrikson, Dan Hendrycks
- Submitted to ICLR 2024
- Readers: Everyone
Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the Machiavelli Benchmark
Alexander Pan, Jun Shern Chan, Andy Zou, Nathaniel Li, Steven Basart, Thomas Woodside, Hanlin Zhang, Scott Emmons, Dan Hendrycks
- ICML 2023 OralPoster
- Readers: Everyone
How Would The Viewer Feel? Estimating Wellbeing From Video Scenarios
Mantas Mazeika, Eric Tang, Andy Zou, Steven Basart, Jun Shern Chan, Dawn Song, David Forsyth, Jacob Steinhardt, Dan Hendrycks
- Published: 17 Sept 2022, Last Modified: 08 Feb 2026
- NeurIPS 2022 Datasets and Benchmarks
- Readers: Everyone
Learning from Natural Language Feedback
Jérémy Scheurer, Jon Ander Campos, Jun Shern Chan, Angelica Chen, Kyunghyun Cho, Ethan Perez
- 13 Mar 2022 (modified: 05 May 2023)
- LNLS
- Readers: Everyone
Learning from Natural Language Feedback
Jérémy Scheurer, Jon Ander Campos, Jun Shern Chan, Angelica Chen, Kyunghyun Cho, Ethan Perez
- 2022 (modified: 20 Aug 2022)
- CoRR 2022
- Readers: Everyone
Retrospective on the 2021 BASALT Competition on Learning from Human Feedback
Rohin Shah, Steven H. Wang, Cody Wild, Stephanie Milani, Anssi Kanervisto, Vinicius G. Goecks, Nicholas R. Waytowich, David Watkins-Valls, Bharat Prakash, Edmund Mills, Divyansh Garg, Alexander Fries, Alexandra Souly, Jun Shern Chan, Daniel del Castillo, Tom Lieberum
- 2022 (modified: 20 Aug 2022)
- CoRR 2022
- Readers: Everyone
Retrospective on the 2021 MineRL BASALT Competition on Learning from Human Feedback
Rohin Shah, Steven H. Wang, Cody Wild, Stephanie Milani, Anssi Kanervisto, Vinicius G. Goecks, Nicholas R. Waytowich, David Watkins-Valls, Bharat Prakash, Edmund Mills, Divyansh Garg, Alexander Fries, Alexandra Souly, Jun Shern Chan, Daniel del Castillo, Tom Lieberum
- 2021 (modified: 20 Aug 2022)
- NeurIPS (Competition and Demos) 2021
- Readers: Everyone

Co-Authors

View all 56 co-authors