Jakob Uszkoreit

Joined

October 2017

Names

Jakob Uszkoreit

Emails

****@google.com (Confirmed)

,

****@google.com (Confirmed)

,

****@uszkoreit.net (Confirmed)

Personal Links

Career & Education History

Employee

Google (google.com)

2008 – 2021

MS student

Technische Universität Berlin (tu-berlin.de)

2003 – 2008

Advisors, Relations & Conflicts

No relations added

Expertise

Machine Translation

2008 – Present

Deep Learning

2008 – Present

Representation Learning

2008 – Present

Publications

How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers
Andreas Peter Steiner, Alexander Kolesnikov, Xiaohua Zhai, Ross Wightman, Jakob Uszkoreit, Lucas Beyer
- 16 Nov 2022
- OpenReview Archive Direct Upload
- Readers: Everyone
Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representations
Mehdi S. M. Sajjadi, Henning Meyer, Etienne Pot, Urs M Bergmann, Klaus Greff, Noha Radwan, Suhani Vora, Daniel Duckworth, Alexey Dosovitskiy, Jakob Uszkoreit, Thomas Funkhouser, Andrea Tagliasacchi
- 02 Nov 2022 (modified: 02 Nov 2022)
- OpenReview Archive Direct Upload
- Readers: Everyone
How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers
Andreas Peter Steiner, Alexander Kolesnikov, Xiaohua Zhai, Ross Wightman, Jakob Uszkoreit, Lucas Beyer
- Accepted by TMLR
- Readers: Everyone
MLP-Mixer: An all-MLP Architecture for Vision
Ilya Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer, Xiaohua Zhai, Thomas Unterthiner, Jessica Yung, Andreas Peter Steiner, Daniel Keysers, Jakob Uszkoreit, Mario Lucic, Alexey Dosovitskiy
- Published: 09 Nov 2021, Last Modified: 26 May 2025
- NeurIPS 2021 Poster
- Readers: Everyone
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, Neil Houlsby
- Published: 12 Jan 2021, Last Modified: 12 Oct 2025
- ICLR 2021 Oral
- Readers: Everyone
Insertion Transformer: Flexible Sequence Generation via Insertion Operations
Mitchell Stern, William Chan, Jamie Kiros, Jakob Uszkoreit
- 2019 (modified: 11 Nov 2022)
- ICML 2019
- Readers: Everyone
The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation
Mia Xu Chen, Orhan Firat, Ankur Bapna, Melvin Johnson, Wolfgang Macherey, George Foster, Llion Jones, Mike Schuster, Noam Shazeer, Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Zhifeng Chen, Yonghui Wu, Macduff Hughes
- 2018 (modified: 06 Apr 2025)
- ACL (1) 2018
- Readers: Everyone
Self-Attention with Relative Position Representations
Peter Shaw, Jakob Uszkoreit, Ashish Vaswani
- 2018 (modified: 16 Jul 2019)
- NAACL-HLT (2) 2018
- Readers: Everyone
Blockwise Parallel Decoding for Deep Autoregressive Models
Mitchell Stern, Noam Shazeer, Jakob Uszkoreit
- 2018 (modified: 11 Nov 2022)
- NeurIPS 2018
- Readers: Everyone
Image Transformer
Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Noam Shazeer, Alexander Ku, Dustin Tran
- 2018 (modified: 11 Nov 2022)
- ICML 2018
- Readers: Everyone

View all 23 publications

Co-Authors

View all 72 co-authors