OpenReview
.net
OpenReview
.net
Login
OpenReview
.net
Login
Alice Oh
Researcher, Google
Full Professor, Korea Advanced Institute of Science and Technology
Joined
September 2018
Names
Alice Oh
(Preferred)
,
Alice H. Oh
,
Alice Haeyun Oh
Emails
****@kaist.edu
(Confirmed)
,
****@google.com
(Confirmed)
Personal Links
Homepage
Google Scholar
DBLP
LinkedIn
Career & Education History
Researcher
Google
(google.com)
2025
–
Present
Full Professor
Korea Advanced Institute of Science and Technology
(kaist.ac.kr)
2008
–
Present
PhD student
Massachusetts Institute of Technology
(mit.edu)
2001
–
2008
MS student
Carnegie Mellon University
(cmu.edu)
1998
–
2000
Advisors, Relations & Conflicts
PhD Advisor
Howard Shrobe
2001
–
2008
Expertise
machine learning
,
natural language processing
,
computational social science
Present
Publications
Benchmarks Are Not Atomic: Composition-Aware LLM Evaluation using BenchHub
Eunsu Kim
,
Haneul Yoo
,
Guijin Son
,
Hitesh Laxmichand Patel
,
Amit Agarwal
,
Alice Oh
CTB@ICML 2026
Readers:
Everyone
Investigating Counterfactual Unfairness in LLMs towards Identities through Humor
Shubin Kim
,
Yejin Son
,
Junyeong Park
,
Keummin Ka
,
Seungbeen Lee
,
Jaeyoung Lee
,
Hyeju Jang
,
Alice Oh
,
Youngjae Yu
ACL 2026 MainConference
Readers:
Everyone
LoCar: Localization-Aware Evaluation of In-Vehicle Assistants through Fine-Grained Sociolinguistic Control
Seogyeong Jeong
,
Kiwoong Park
,
Seyoung Song
,
Eunsu Kim
,
Ken E Friedl
,
Jaeho Kim
,
Alice Oh
ACL 2026 Industry Track Poster
Readers:
Everyone
BenchHub: A Unified Benchmark Suite for Holistic and Customizable LLM Evaluation
Eunsu Kim
,
Haneul Yoo
,
Guijin Son
,
Hitesh Laxmichand Patel
,
Amit Agarwal
,
Alice Oh
NeurIPS 2025 ER Workshop
Readers:
Everyone
RoleConflictBench: A Benchmark of Role Conflict Scenarios for Evaluating LLMs' Contextual Sensitivity
Jisu Shin
,
Hoyun Song
,
Juhyun Oh
,
Changgeon Ko
,
Eunsu Kim
,
Chani Jung
,
Alice Oh
ICLR 2026 Conference Desk Rejected Submission
Readers:
Everyone
BenchHub: A Unified Benchmark Suite for Holistic and Customizable LLM Evaluation
Eunsu Kim
,
Haneul Yoo
,
Guijin Son
,
Hitesh Laxmichand Patel
,
Amit Agarwal
,
Alice Oh
Submitted to ICLR 2026
Readers:
Everyone
Mind the Gap: LLM Actions vs. Human Social Understanding in Moral Dilemmas
Jiseon Kim
,
Jea Kwon
,
Luiz Felipe Vecchietti
,
Wenchao Dong
,
Alice Oh
,
Meeyoung Cha
WiML @ NeurIPS 2025
Readers:
Everyone
Evaluating LLMs' Language Confusion in Code-switching Context
Juhyun Oh
,
Haneul Yoo
,
Alice Oh
NeurIPS 2025 LLM Evaluation Workshop Poster
Readers:
Everyone
How Do LLMs Ask Questions? A Pragmatic Comparison with Human Question-Asking
Chani Jung
,
Jimin Mun
,
Xuhui Zhou
,
Alice Oh
,
Maarten Sap
,
Hyunwoo Kim
CogInterp @ NeurIPS 2025 Poster
Readers:
Everyone
Trans-EnV: A Framework for Evaluating the Linguistic Robustness of LLMs Against English Varieties
Jiyoung Lee
,
Seungho Kim
,
Jieun Han
,
Jun-Min Lee
,
Kitaek Kim
,
Alice Oh
,
Edward Choi
NeurIPS 2025 Datasets and Benchmarks Track poster
Readers:
Everyone
View all 98 publications
Co-Authors
Aaron Adler
Abinew Ali Ayele
Ahsan H. Khandoker
Alejandro Jaimes
Alexander I. Rudnicky
Amin Mantrach
Amit Agarwal
Anar Sabuhi Rzayev
Arnav Arora
Auk Kim
Behzad Tabibian
Bernhard Schölkopf
Brian C. Keegan
Brian Keegan
Bumsoo Kang
Carla Perez-Almendros
Changgeon Ko
Changmin Seo
Changyoon Lee
Chani Jung
Cheul Young Park
Chin-Wan Chung
Chin-Yew Lin
Chisung Song
Chris Schmandt
View all 187 co-authors