Margaret Li

PhD student, Computer Science and Engineering, University of Washington

Joined

September 2018

Names

Margaret Li (Preferred)

Emails

****@gmail.com (Confirmed)

****@fb.com (Confirmed)

****@cs.washington.edu (Confirmed)

****@uw.edu (Confirmed)

****@meta.com (Confirmed)

Personal Links

Career & Education History

PhD student

Computer Science and Engineering , University of Washington (uw.edu)

2020 – Present

Researcher

Meta (meta.com)

2022 – 2024

Research Engineer

Facebook (fb.com)

2017 – 2020

Undergrad student

Computer and Information Sciences, University of Pennsylvania (upenn.edu)

2013 – 2017

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

Byte Latent Transformer: Patches Scale Better Than Tokens
Artidoro Pagnoni, Ramakanth Pasunuru, Pedro Rodriguez, John Nguyen, Benjamin Muller, Margaret Li, Chunting Zhou, Lili Yu, Jason E Weston, Luke Zettlemoyer, Gargi Ghosh, Mike Lewis, Ari Holtzman, Srini Iyer
- TokShop
- Readers: Everyone
Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)
Liwei Jiang, Yuanjun Chai, Margaret Li, Mickel Liu, Raymond Fok, Nouha Dziri, Yulia Tsvetkov, Maarten Sap, Yejin Choi
- NeurIPS 2025 Datasets and Benchmarks Track oral
- Readers: Everyone
Precise Information Control in Long-Form Text Generation
Jacqueline He, Howard Yen, Margaret Li, Shuyue Stella Li, Zhiyuan Zeng, Weijia Shi, Yulia Tsvetkov, Danqi Chen, Pang Wei Koh, Luke Zettlemoyer
- NeurIPS 2025 poster
- Readers: Everyone
FlexOLMo: Open Language Models for Flexible Data Use
Weijia Shi, Akshita Bhagia, Kevin Farhat, Niklas Muennighoff, Jacob Morrison, Evan Pete Walsh, Dustin Schwenk, Shayne Longpre, Jake Poznanski, Allyson Ettinger, Daogao Liu, Margaret Li, Mike Lewis, Wen-tau Yih, Dirk Groeneveld, Luca Soldaini, Kyle Lo, Noah A. Smith, Luke Zettlemoyer, Pang Wei Koh et al. (3 additional authors not shown)
- NeurIPS 2025 spotlight
- Readers: Everyone
(Mis)Fitting Scaling Laws: A Survey of Scaling Law Fitting Techniques in Deep Learning
Margaret Li, Sneha Kudugunta, Luke Zettlemoyer
- ICLR 2025 Poster
- Readers: Everyone
LLM Merging: Building LLMs Efficiently through Merging
Derek Tam, Margaret Li, Prateek Yadav, Rickard Brüel Gabrielsson, Jiacheng Zhu, Kristjan Greenewald, Mikhail Yurochkin, Mohit Bansal, Colin Raffel, Leshem Choshen
- NeurIPS 2024 Competition Track
- Readers: Everyone
HAC: The Hacker-Cup AI Competition
Weiwei Yang, Mark Saroufim, Joe Issacson, Luca Antiga, Greg Bowyer, Christian Puhrsch, Driss Guessous, Supriya Rao, Geeta Chauhan, Margaret Li, David Harmeyer, Wesley May
- NeurIPS 2024 Competition Track
- Readers: Everyone
Breaking the Curse of Multilinguality with Cross-lingual Expert Language Models
Terra Blevins, Tomasz Limisiewicz, Suchin Gururangan, Margaret Li, Hila Gonen, Noah A. Smith, Luke Zettlemoyer
- 17 Feb 2024
- OpenReview Archive Direct Upload
- Readers: Everyone
In-Context Pretraining: Language Modeling Beyond Document Boundaries
Weijia Shi, Sewon Min, Maria Lomeli, Chunting Zhou, Margaret Li, Xi Victoria Lin, Noah A. Smith, Luke Zettlemoyer, Wen-tau Yih, Mike Lewis
- ICLR 2024 spotlight
- Readers: Everyone
Scaling Expert Language Models with Unsupervised Domain Discovery
Suchin Gururangan, Margaret Li, Mike Lewis, Weijia Shi, Tim Althoff, Noah A. Smith, Luke Zettlemoyer
- 2023 (modified: 24 Apr 2023)
- CoRR 2023
- Readers: Everyone

View all 27 publications

Co-Authors

View all 102 co-authors