Jacob Kahn

Research Engineer, Facebook AI Research

Research Engineer, Meta AI

Joined

January 2020

Names

Jacob Kahn (Preferred)

Emails

****@gmail.com (Confirmed)

****@fb.com (Confirmed)

****@alumni.upenn.edu (Confirmed)

****@meta.com (Confirmed)

****@seas.upenn.edu (Confirmed)

Personal Links

Career & Education History

Research Engineer

Facebook AI Research (fb.com)

2018 – Present

Research Engineer

Meta AI (meta.com)

2018 – Present

MS student

University of Pennsylvania (upenn.edu)

2016 – 2018

Undergrad student

University of Pennsylvania (upenn.edu)

2014 – 2018

Undergrad student

The Wharton School, University of Pennsylvania (wharton.upenn.edu)

2014 – 2018

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

Efficient Hardware Scaling and Diminishing Returns in Large-Scale Training of Language Models
Jared Fernandez, Luca Wehrstedt, Leonid Shamis, Mostafa Elhoushi, Kalyan Saladi, Yonatan Bisk, Emma Strubell, Jacob Kahn
- Accepted by TMLR
- Readers: Everyone
Characterizing and Efficiently Accelerating Multimodal Generation Model Inference
Kaushik Ram Sadagopan, Yejin Lee, Basil Hosmer, Daniel HAZIZA, Carole-Jean Wu, Wen-tau Yih, Anna Sun, Bilge Acun, Changhan Wang, Charles David Hernandez, Christian Puhrsch, Driss Guessous, Francisco Massa, Jacob Kahn, Jeremy Francis Reizenstein, Jiaqi Zhai, Joe Isaacson, Joel Schlosser, Juan Pino, Leonid Shamis et al. (8 additional authors not shown)
- OpenReview Archive Direct Upload
- Readers: Everyone
Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model
Chunting Zhou, LILI YU, Arun Babu, Kushal Tirumala, Michihiro Yasunaga, Leonid Shamis, Jacob Kahn, Xuezhe Ma, Luke Zettlemoyer, Omer Levy
- ICLR 2025 Oral
- Readers: Everyone
Hardware Scaling Trends and Diminishing Returns in Large-Scale Distributed Training
Jared Fernandez, Luca Wehrstedt, Leonid Shamis, Mostafa Elhoushi, Kalyan Saladi, Yonatan Bisk, Emma Strubell, Jacob Kahn
- ICLR 2025 Conference Withdrawn Submission
- Readers: Everyone
Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
Sainbayar Sukhbaatar, Olga Golovneva, Vasu Sharma, Hu Xu, Xi Victoria Lin, Baptiste Roziere, Jacob Kahn, Shang-Wen Li, Wen-tau Yih, Jason E Weston, Xian Li
- COLM
- Readers: Everyone
RA-DIT: Retrieval-Augmented Dual Instruction Tuning
Xi Victoria Lin, Xilun Chen, Mingda Chen, Weijia Shi, Maria Lomeli, Richard James, Pedro Rodriguez, Jacob Kahn, Gergely Szilvasy, Mike Lewis, Luke Zettlemoyer, Wen-tau Yih
- ICLR 2024 poster
- Readers: Everyone
The Framework Tax: Disparities Between Inference Efficiency in NLP Research and Deployment
Jared Fernandez, Jacob Kahn, Clara Na, Yonatan Bisk, Emma Strubell
- EMNLP 2023 Main
- Readers: Everyone
The Framework Tax: Disparities Between Inference Efficiency in Research and Deployment
Jared Fernandez, Jacob Kahn, Clara Na, Yonatan Bisk, Emma Strubell
- ES-FoMO 2023 Poster
- Readers: Everyone
MODeL: Memory Optimizations for Deep Learning
Benoit Steiner, Mostafa Elhoushi, Jacob Kahn, James Hegarty
- ICML 2023 Poster
- Readers: Everyone
Flashlight: Enabling Innovation in Tools for Machine Learning
Jacob Kahn, Vineel Pratap, Tatiana Likhomanenko, Qiantong Xu, Awni Hannun, Jeff Cai, Paden Tomasello, Ann Lee, Edouard Grave, Gilad Avidov, Benoit Steiner, Vitaliy Liptchinsky, Gabriel Synnaeve, Ronan Collobert
- Published: 28 Jan 2022, Last Modified: 12 Oct 2025
- ICLR 2022 Submitted
- Readers: Everyone

View all 15 publications

Co-Authors

View all 74 co-authors