Emily Sheng

Researcher, Computer Science, Research, Microsoft

Joined

July 2019

Names

Emily Sheng

Emails

****@isi.edu (Confirmed)

****@gmail.com (Confirmed)

****@microsoft.com (Confirmed)

Personal Links

Career & Education History

Researcher

Computer Science, Research, Microsoft (research.microsoft.com)

2022 – Present

PhD student

Computer Science, USC/ISI (isi.edu)

2015 – 2021

MS student

Computer Science, University of Southern California (usc.edu)

2015 – 2017

Advisors, Relations & Conflicts

No relations added

Expertise

evaluation

fairness and bias in NLP

2015 – Present

Publications

Position: Evaluating Generative AI Systems Is a Social Science Measurement Challenge
Hanna Wallach, Meera Desai, A. Feder Cooper, Angelina Wang, Chad Atalla, Solon Barocas, Su Lin Blodgett, Alexandra Chouldechova, Emily Corvi, P. Alex Dow, Jean Garcia-Gathright, Alexandra Olteanu, Nicholas J Pangakis, Stefanie Reed, Emily Sheng, Dan Vann, Jennifer Wortman Vaughan, Matthew Vogel, Hannah Washington, Abigail Z. Jacobs
- ICML 2025 Position Paper Track poster
- Readers: Everyone
AI Red Teaming through the Lens of Measurement Theory
Alexandra Chouldechova, A. Feder Cooper, Abhinav Palia, Dan Vann, Chad Atalla, Hannah Washington, Emily Sheng, Hanna Wallach
- SafeGenAi Poster
- Readers: Everyone
On Measures of Biases and Harms in NLP
Aubrie Amstutz, Sunipa Dev, Emily Sheng, Jieyu Zhao
- Association for Computational Linguistics
- Readers: Everyone
FairPrism: evaluating fairness-related harms in text generation
Aubrie Amstutz, Eve Fleisig, Chad Atalla, Su Lin Blodgett, Hal Daumé III, Alexandra Olteanu, Emily Sheng, Dan Vann, Hanna Wallach
- Association for Computational Linguistics
- Readers: Everyone
Societal Biases in Language Generation: Progress and Challenges
Emily Sheng, Kai-Wei Chang, Prem Natarajan, Nanyun Peng
- 2021 (modified: 10 Sept 2021)
- ACL/IJCNLP (1) 2021
- Readers: Everyone
"Nice Try, Kiddo": Investigating Ad Hominems in Dialogue Responses
Emily Sheng, Kai-Wei Chang, Prem Natarajan, Nanyun Peng
- 2021 (modified: 10 Sept 2021)
- NAACL-HLT 2021
- Readers: Everyone
What do Bias Measures Measure?
Sunipa Dev, Emily Sheng, Jieyu Zhao, Jiao Sun, Yu Hou, Mattie Sanseverino, Jiin Kim, Nanyun Peng, Kai-Wei Chang
- 2021 (modified: 10 Sept 2021)
- CoRR 2021
- Readers: Everyone
Revealing Persona Biases in Dialogue Systems
Emily Sheng, Josh Arnold, Zhou Yu, Kai-Wei Chang, Nanyun Peng
- 2021 (modified: 10 Sept 2021)
- CoRR 2021
- Readers: Everyone
Investigating Societal Biases in a Poetry Composition System
Emily Sheng, David Uthus
- 2020 (modified: 23 Oct 2021)
- CoRR 2020
- Readers: Everyone
Towards Controllable Biases in Language Generation
Emily Sheng, Kai-Wei Chang, Prem Natarajan, Nanyun Peng
- 2020 (modified: 23 Oct 2021)
- EMNLP (Findings) 2020
- Readers: Everyone

View all 11 publications

Co-Authors

View all 36 co-authors