Hanna Wallach

Partner Research Manager, Microsoft

Joined

December 2017

Names

Hanna Wallach

Hanna M. Wallach

Emails

****@dirichlet.net (Confirmed)

****@cs.umass.edu

****@microsoft.com

****@cam.ac.uk

Personal Links

Homepage

DBLP

Career & Education History

Partner Research Manager

Microsoft (microsoft.com)

Present

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

Comparison requires valid measurement: Rethinking attack success rate comparisons in AI red teaming
Alexandra Chouldechova, A. Feder Cooper, Solon Barocas, Abhinav Palia, Dan Vann, Hanna Wallach
- NeurIPS 2025 Position Paper Track
- Readers: Everyone
Machine Unlearning Doesn't Do What You Think: Lessons for Generative AI Policy and Research
A. Feder Cooper, Christopher A. Choquette-Choo, Miranda Bogen, Kevin Klyman, Matthew Jagielski, Katja Filippova, Ken Liu, Alexandra Chouldechova, Jamie Hayes, Yangsibo Huang, Eleni Triantafillou, Peter Kairouz, Nicole Elyse Mitchell, Niloofar Mireshghallah, Abigail Z. Jacobs, James Grimmelmann, Vitaly Shmatikov, Christopher De Sa, Ilia Shumailov, Andreas Terzis et al. (17 additional authors not shown)
- NeurIPS 2025 Position Paper Track Oral
- Readers: Everyone
Validating LLM-as-a-Judge Systems under Rating Indeterminacy
Luke Guerdan, Solon Barocas, Ken Holstein, Hanna Wallach, Steven Wu, Alexandra Chouldechova
- NeurIPS 2025 poster
- Readers: Everyone
Position: Evaluating Generative AI Systems Is a Social Science Measurement Challenge
Hanna Wallach, Meera Desai, A. Feder Cooper, Angelina Wang, Chad Atalla, Solon Barocas, Su Lin Blodgett, Alexandra Chouldechova, Emily Corvi, P. Alex Dow, Jean Garcia-Gathright, Alexandra Olteanu, Nicholas J Pangakis, Stefanie Reed, Emily Sheng, Dan Vann, Jennifer Wortman Vaughan, Matthew Vogel, Hannah Washington, Abigail Z. Jacobs
- ICML 2025 Position Paper Track poster
- Readers: Everyone
AI Red Teaming through the Lens of Measurement Theory
Alexandra Chouldechova, A. Feder Cooper, Abhinav Palia, Dan Vann, Chad Atalla, Hannah Washington, Emily Sheng, Hanna Wallach
- SafeGenAi Poster
- Readers: Everyone
FairPrism: evaluating fairness-related harms in text generation
Aubrie Amstutz, Eve Fleisig, Chad Atalla, Su Lin Blodgett, Hal Daumé III, Alexandra Olteanu, Emily Sheng, Dan Vann, Hanna Wallach
- Association for Computational Linguistics
- Readers: Everyone
Combining Sentiment Lexica with a Multi-View Variational Autoencoder
Alexander Hoyle, Isabelle Augenstein, Ryan Cotterell, Hanna Wallach
- 14 Dec 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
Unsupervised Discovery of Gendered Language through Latent-Variable Modeling
Alexander Hoyle, Hanna Wallach, Isabelle Augenstein, Ryan Cotterell
- 14 Dec 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for Support
Michael A. Madaio, Lisa Egede, Hariharan Subramonyam, Jennifer Wortman Vaughan, Hanna Wallach
- 05 Oct 2022
- OpenReview Archive Direct Upload
- Readers: Everyone
Co-designing checklists to understand organizational challenges and opportunities around fairness in AI
Michael A. Madaio, Hanna Wallach, Jennifer Wortman Vaughan
- 05 Oct 2022
- OpenReview Archive Direct Upload
- Readers: Everyone

View all 28 publications

Co-Authors

View all 114 co-authors