Summer Yue

Researcher, Scale AI

Joined

January 2024

Names

Summer Yue (Preferred)

Emails

****@scale.com (Confirmed)

Personal Links

Career & Education History

Researcher

Scale AI (scale.ai)

2023 – Present

Researcher

Google (deepmind.com)

2018 – 2023

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

Beyond Truthfulness: Evaluating Honesty in Large Language Models
Richard Ren, Arunim Agarwal, Mantas Mazeika, Cristina Menghini, Brad Kenstler, Robert Vacareanu, Mick Yang, Isabelle Barrass, Alice Gatti, Xuwang Yin, Eduardo Trevino, Matias Geralnik, Dean Lee, Summer Yue, Dan Hendrycks
- Submitted to ICLR 2026
- Readers: Everyone
Best Practices for Biorisk Evaluations on Open-Weight Bio-Foundation Models
Boyi Wei, Zora Che, Nathaniel Li, Jasper Götting, Samira Nedungadi, Julian Michael, Summer Yue, Dan Hendrycks, Peter Henderson, Zifan Wang, Seth Donoughe, Mantas Mazeika
- BioSafe GenAI 2025 Poster
- Readers: Everyone
Humanity's Last Exam
Long Phan, Alice Gatti, Ziwen Han, Nathaniel Li, Ori Press, Eli Meril, Summer Yue, Alexandr Wang, Dan Hendrycks
- OpenReview Archive Direct Upload
- Readers: Everyone
Aligned LLMs Are Not Aligned Browser Agents
Priyanshu Kumar, Elaine Lau, Saranya Vijayakumar, Tu Trinh, Elaine T Chang, Vaughn Robinson, Shuyan Zhou, Matt Fredrikson, Sean M. Hendryx, Summer Yue, Zifan Wang
- ICLR 2025 Poster
- Readers: Everyone
Planning in Natural Language Improves LLM Search for Code Generation
Evan Z Wang, Federico Cassano, Catherine Wu, Yunfeng Bai, William Song, Vaskar Nath, Ziwen Han, Sean M. Hendryx, Summer Yue, Hugh Zhang
- Sys2-Reasoning Poster
- Readers: Everyone
Planning in Natural Language Improves LLM Search for Code Generation
Evan Z Wang, Federico Cassano, Catherine Wu, Yunfeng Bai, William Song, Vaskar Nath, Ziwen Han, Sean M. Hendryx, Summer Yue, Hugh Zhang
- ICLR 2025 Spotlight
- Readers: Everyone
Uncovering Model Vulnerabilities With Multi-Turn Red Teaming
Nathaniel Li, Ziwen Han, Ian Steneker, Willow E. Primack, Riley Goodside, Hugh Zhang, Zifan Wang, Cristina Menghini, Summer Yue
- Submitted to ICLR 2025
- Readers: Everyone
LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yet
Nathaniel Li, Ziwen Han, Ian Steneker, Willow E. Primack, Riley Goodside, Hugh Zhang, Zifan Wang, Cristina Menghini, Summer Yue
- Red Teaming GenAI Workshop @ NeurIPS'24 Oral
- Readers: Everyone
A Careful Examination of Large Language Model Performance on Grade School Arithmetic
Hugh Zhang, Jeff Da, Dean Lee, Vaughn Robinson, Catherine Wu, William Song, Tiffany Zhao, Pranav Vishnu Raja, Charlotte Zhuang, Dylan Z Slack, Qin Lyu, Sean M. Hendryx, Russell Kaplan, Michele Lunati, Summer Yue
- NeurIPS 2024 Track Datasets and Benchmarks Spotlight
- Readers: Everyone
The WMDP Benchmark: Measuring and Reducing Malicious Use with Unlearning
Nathaniel Li, Alexander Pan, Anjali Gopal, Summer Yue, Daniel Berrios, Alice Gatti, Justin D. Li, Ann-Kathrin Dombrowski, Shashwat Goel, Gabriel Mukobi, Nathan Helm-Burger, Rassin Lababidi, Lennart Justen, Andrew Bo Liu, Michael Chen, Isabelle Barrass, Oliver Zhang, Xiaoyuan Zhu, Rishub Tamirisa, Bhrugu Bharathi et al. (26 additional authors not shown)
- ICML 2024 Poster
- Readers: Everyone

Co-Authors

View all 92 co-authors