Mirac Suzgun

PhD student, Stanford University

Joined

August 2021

Names

Mirac Suzgun (Preferred)

Emails

****@stanford.edu (Confirmed)

****@cs.stanford.edu (Confirmed)

Personal Links

Homepage

Google Scholar

DBLP

Career & Education History

PhD student

Stanford University (stanford.edu)

2021 – 2026

Undergrad student

Harvard University (harvard.edu)

2016 – 2020

Advisors, Relations & Conflicts

PhD Advisor

Dan Jurafsky

Present

PhD Advisor

James Zou

Present

PhD Advisor

Daniel E. Ho

Present

Expertise

Natural Language Processing

Present

Test-Time Reasoning

Present

Hallucination Detection and Mitigation

Present

AI and Law

Present

Test-Time Learning

Present

LLM Reasoning

Present

Publications

Cost-of-Pass: An Economic Framework for Evaluating Language Models
Mehmet Hamza Erol, Batu El, Mirac Suzgun, Mert Yuksekgonul, James Zou
- ICLR 2026 Poster
- Readers: Everyone
Assessing the potential of GPT-4 to perpetuate racial and gender biases in health care: a model evaluation study
Travis Zack, Eric Lehman, Mirac Suzgun, Jorge A Rodriguez, Leo Anthony Celi, Judy Gichoya, Peter Szolovits, Dan Jurafsky, David Bates, Raja-Elie Abdulnour, Atul J. Butte, Emily Alsentzer
- Lancet Digital Health
- Readers: Everyone
Do Language Models Know When They're Hallucinating References?
Ayush Agrawal, Mirac Suzgun, Lester Mackey, Adam Kalai
- ICBINB 2023
- Readers: Everyone
A Benchmark for Learning to Translate a New Language from One Grammar Book
Garrett Tanzer, Mirac Suzgun, Eline Visser, Dan Jurafsky, Luke Melas-Kyriazi
- ICLR 2024 spotlight
- Readers: Everyone
Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructions
Federico Bianchi, Mirac Suzgun, Giuseppe Attanasio, Paul Rottger, Dan Jurafsky, Tatsunori Hashimoto, James Zou
- ICLR 2024 poster
- Readers: Everyone
The Harvard USPTO Patent Dataset: A Large-Scale, Well-Structured, and Multi-Purpose Corpus of Patent Applications
Mirac Suzgun, Luke Melas-Kyriazi, Suproteem K Sarkar, Scott Kominers, Stuart Shieber
- NeurIPS 2023 Datasets and Benchmarks Spotlight
- Readers: Everyone
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R. Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, Agnieszka Kluska, Aitor Lewkowycz, Akshat Agarwal, Alethea Power, Alex Ray, Alex Warstadt, Alexander W. Kocurek, Ali Safaya, Ali Tazarv, Alice Xiang et al. (430 additional authors not shown)
- Accepted by TMLR
- Readers: Everyone
Holistic Evaluation of Language Models
Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, Benjamin Newman, Binhang Yuan, Bobby Yan, Ce Zhang, Christian Cosgrove, Christopher D Manning, Christopher Re, Diana Acosta-Navas, Drew A. Hudson, Eric Zelikman et al. (30 additional authors not shown)
- Accepted by TMLR
- Readers: Everyone
Language models are multilingual chain-of-thought reasoners
Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, Dipanjan Das, Jason Wei
- Published: 01 Feb 2023, Last Modified: 14 Jan 2026
- ICLR 2023 poster
- Readers: Everyone
Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Models
Mirac Suzgun, Luke Melas-Kyriazi, Dan Jurafsky
- 2022 (modified: 10 Jun 2022)
- CoRR 2022
- Readers: Everyone

View all 14 publications

Co-Authors

View all 529 co-authors