Punit Singh Koura

Researcher, Microsoft AI

Joined

February 2022

Names

Punit Singh Koura (Preferred)

Emails

****@fb.com (Confirmed)

****@gmail.com (Confirmed)

****@meta.com (Confirmed)

****@alumni.cmu.edu (Confirmed)

****@pilani.bits-pilani.ac.in (Confirmed)

****@microsoft.com (Confirmed)

Personal Links

Career & Education History

Researcher

Microsoft AI (microsoft.com)

2026 – Present

Researcher

Meta AI (meta.com)

2020 – 2025

MS student

CMU, Carnegie Mellon University (andrew.cmu.edu)

2018 – 2019

Undergrad student

BITS Pilani, Birla Institute of Technology and Science (pilani.bits-pilani.ac.in)

2011 – 2015

Advisors, Relations & Conflicts

No relations added

Expertise

Scaling language models

2021 – Present

Large language models

2021 – Present

Deep learning

2020 – Present

Publications

Correlating and Predicting Human Evaluations of Language Models from Natural Language Processing Benchmarks
Rylan Schaeffer, Punit Singh Koura, Binh Tang, Ranjan Subramanian, Aaditya K Singh, Todor Mihaylov, Prajjwal Bhargava, Lovish Madaan, Niladri S. Chatterji, Vedanuj Goswami, Sergey Edunov, Dieuwke Hupkes, Sanmi Koyejo, Sharan Narang
- Submitted to ICLR 2025
- Readers: Everyone
A Theory on Adam Instability in Large-Scale Machine Learning
Igor Molybog, Peter Albert, Moya Chen, Zachary DeVito, David Esiobu, Naman Goyal, Punit Singh Koura, Sharan Narang, Andrew Poulton, Ruan Silva, Binh Tang, Diana Liskovich, Puxin Xu, Yuchen Zhang, Melanie Kambadur, Stephen Roller, Susan Zhang
- Published: 01 Jan 2023, Last Modified: 12 May 2023
- CoRR 2023
- Readers: Everyone
Llama 2: Open Foundation and Fine-Tuned Chat Models
Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton-Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller et al. (48 additional authors not shown)
- Published: 01 Jan 2023, Last Modified: 24 Aug 2023
- CoRR 2023
- Readers: Everyone
OPT: Open Pre-trained Transformer Language Models
Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona T. Diab, Xian Li, Xi Victoria Lin, Todor Mihaylov, Myle Ott, Sam Shleifer, Kurt Shuster, Daniel Simig, Punit Singh Koura, Anjali Sridhar, Tianlu Wang, Luke Zettlemoyer
- 2022 (modified: 14 Dec 2022)
- CoRR 2022
- Readers: Everyone
Few-shot Learning with Multilingual Generative Language Models
Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, Ramakanth Pasunuru, Sam Shleifer, Punit Singh Koura, Vishrav Chaudhary, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Zornitsa Kozareva, Mona Diab, Veselin Stoyanov et al. (1 additional authors not shown)
- 2022 (modified: 14 Mar 2023)
- EMNLP 2022
- Readers: Everyone
Efficient Large Scale Language Modeling with Mixtures of Experts
Mikel Artetxe, Shruti Bhosale, Naman Goyal, Todor Mihaylov, Myle Ott, Sam Shleifer, Xi Victoria Lin, Jingfei Du, Srinivasan Iyer, Ramakanth Pasunuru, Giridharan Anantharaman, Xian Li, Shuohui Chen, Halil Akin, Mandeep Baines, Louis Martin, Xing Zhou, Punit Singh Koura, Brian O'Horo, Jeffrey Wang et al. (4 additional authors not shown)
- 2022 (modified: 14 Mar 2023)
- EMNLP 2022
- Readers: Everyone
OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization
Srinivasan Iyer, Xi Victoria Lin, Ramakanth Pasunuru, Todor Mihaylov, Daniel Simig, Ping Yu, Kurt Shuster, Tianlu Wang, Qing Liu, Punit Singh Koura, Xian Li, Brian O'Horo, Gabriel Pereyra, Jeff Wang, Christopher Dewan, Asli Celikyilmaz, Luke Zettlemoyer, Ves Stoyanov
- 2022 (modified: 14 Mar 2023)
- CoRR 2022
- Readers: Everyone
Few-shot Learning with Multilingual Language Models
Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, Ramakanth Pasunuru, Sam Shleifer, Punit Singh Koura, Vishrav Chaudhary, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Zornitsa Kozareva, Mona T. Diab, Veselin Stoyanov et al. (1 additional authors not shown)
- 2021 (modified: 06 Jan 2022)
- CoRR 2021
- Readers: Everyone
Efficient Large Scale Language Modeling with Mixtures of Experts
Mikel Artetxe, Shruti Bhosale, Naman Goyal, Todor Mihaylov, Myle Ott, Sam Shleifer, Xi Victoria Lin, Jingfei Du, Srinivasan Iyer, Ramakanth Pasunuru, Giri Anantharaman, Xian Li, Shuohui Chen, Halil Akin, Mandeep Baines, Louis Martin, Xing Zhou, Punit Singh Koura, Brian O'Horo, Jeff Wang et al. (4 additional authors not shown)
- 2021 (modified: 06 Jan 2022)
- CoRR 2021
- Readers: Everyone

Co-Authors

View all 109 co-authors