Lukasz Kaiser

Researcher, OpenAI

Joined

October 2016

Names

Lukasz Kaiser (Preferred)

Emails

****@google.com (Confirmed)

,

****@gmail.com (Confirmed)

Personal Links

Semantic Scholar

Career & Education History

Researcher

OpenAI (openai.com)

2021 – Present

Research Scientist

Google (google.com)

2013 – 2021

Advisors, Relations & Conflicts

Coauthor

Katja Filippova

2015 – 2015

Coauthor

Enrique Alfonseca

2015 – 2015

Coauthor

Carlos Colmenares

2015 – 2015

Coauthor

2015 – 2015

Expertise

deep learning

,

machine learning

,

logic

,

complexity theory

2004 – Present

Publications

Sparse is Enough in Scaling Transformers
Sebastian Jaszczur, Aakanksha Chowdhery, Afroz Mohiuddin, Lukasz Kaiser, Wojciech Gajewski, Henryk Michalewski, Jonni Kanerva
- Published: 09 Nov 2021, Last Modified: 26 May 2025
- NeurIPS 2021 Poster
- Readers: Everyone
Evaluating Large Language Models Trained on Code
Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harrison Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, Alex Ray, Raul Puri, Gretchen Krueger, Michael Petrov, Heidy Khlaaf, Girish Sastry, Pamela Mishkin, Brooke Chan, Scott Gray, Nick Ryder et al. (38 additional authors not shown)
- 2021 (modified: 14 Nov 2021)
- CoRR 2021
- Readers: Everyone
Hierarchical Transformers Are More Efficient Language Models
Piotr Nawrot, Szymon Tworkowski, Michal Tyrolski, Lukasz Kaiser, Yuhuai Wu, Christian Szegedy, Henryk Michalewski
- 2021 (modified: 17 Nov 2021)
- CoRR 2021
- Readers: Everyone
Rethinking Attention with Performers
Krzysztof Marcin Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Andreea Gane, Tamás Sarlós, Peter Hawkins, Jared Quincy Davis, Afroz Mohiuddin, Lukasz Kaiser, David Benjamin Belanger, Lucy J. Colwell, Adrian Weller
- 2021 (modified: 17 Nov 2021)
- ICLR 2021
- Readers: Everyone
Q-Value Weighted Regression: Reinforcement Learning with Limited Data
Piotr Kozakowski, Lukasz Kaiser, Henryk Michalewski, Afroz Mohiuddin, Katarzyna Kanska
- 2021 (modified: 17 Nov 2021)
- CoRR 2021
- Readers: Everyone
Q-Value Weighted Regression: Reinforcement Learning with Limited Data
Piotr Kozakowski, Lukasz Kaiser, Henryk Michalewski, Afroz Mohiuddin, Katarzyna Kańska
- 28 Sept 2020 (modified: 12 Oct 2025)
- ICLR 2021 Conference Blind Submission
- Readers: Everyone
Rethinking Attention with Performers
Krzysztof Marcin Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Andreea Gane, Tamas Sarlos, Peter Hawkins, Jared Quincy Davis, Afroz Mohiuddin, Lukasz Kaiser, David Benjamin Belanger, Lucy J Colwell, Adrian Weller
- Published: 12 Jan 2021, Last Modified: 12 Oct 2025
- ICLR 2021 Oral
- Readers: Everyone
Rethinking Attention with Performers
Krzysztof Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Andreea Gane, Tamás Sarlós, Peter Hawkins, Jared Davis, Afroz Mohiuddin, Lukasz Kaiser, David Belanger, Lucy Colwell, Adrian Weller
- 2020 (modified: 12 Apr 2023)
- CoRR 2020
- Readers: Everyone
Reformer: The Efficient Transformer
Nikita Kitaev, Lukasz Kaiser, Anselm Levskaya
- 2020 (modified: 17 Nov 2021)
- ICLR 2020
- Readers: Everyone
Model Based Reinforcement Learning for Atari
Lukasz Kaiser, Mohammad Babaeizadeh, Piotr Milos, Blazej Osinski, Roy H. Campbell, Konrad Czechowski, Dumitru Erhan, Chelsea Finn, Piotr Kozakowski, Sergey Levine, Afroz Mohiuddin, Ryan Sepassi, George Tucker, Henryk Michalewski
- 2020 (modified: 17 Nov 2021)
- ICLR 2020
- Readers: Everyone

View all 85 publications

Co-Authors

View all 235 co-authors