Ashish Vaswani

Joined

August 2017

Names

Ashish Vaswani

Emails

****@google.com (Confirmed)

Personal Links

Career & Education History

PhD student

University of Southern California (usc.edu)

2004 – 2014

Advisors, Relations & Conflicts

No relations added

Expertise

Deep learning

,

NLP

,

Machine learning

,

Image generation

Present

Publications

Self-Attention based Feature Extractors for 3D Object Detection in Point Clouds
Arulkumar Subramaniam, Ashish Vaswani, Niki Parmar
- Workshop on Perception for Autonomous Driving, ECCV-2020
- Readers: Everyone
Attention is all you need
Ashish Vaswani, Noam Shazeer
- 16 Feb 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
The Efficiency Misnomer
Mostafa Dehghani, Yi Tay, Anurag Arnab, Lucas Beyer, Ashish Vaswani
- Published: 28 Jan 2022, Last Modified: 13 Feb 2023
- ICLR 2022 Poster
- Readers: Everyone
Scale Efficiently: Insights from Pretraining and Finetuning Transformers
Yi Tay, Mostafa Dehghani, Jinfeng Rao, William Fedus, Samira Abnar, Hyung Won Chung, Sharan Narang, Dani Yogatama, Ashish Vaswani, Donald Metzler
- Published: 28 Jan 2022, Last Modified: 13 Feb 2023
- ICLR 2022 Poster
- Readers: Everyone
The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation
Mia Xu Chen, Orhan Firat, Ankur Bapna, Melvin Johnson, Wolfgang Macherey, George Foster, Llion Jones, Mike Schuster, Noam Shazeer, Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Zhifeng Chen, Yonghui Wu, Macduff Hughes
- 2018 (modified: 06 Apr 2025)
- ACL (1) 2018
- Readers: Everyone
Self-Attention with Relative Position Representations
Peter Shaw, Jakob Uszkoreit, Ashish Vaswani
- 2018 (modified: 16 Jul 2019)
- NAACL-HLT (2) 2018
- Readers: Everyone
Mesh-TensorFlow: Deep Learning for Supercomputers
Noam Shazeer, Youlong Cheng, Niki Parmar, Dustin Tran, Ashish Vaswani, Penporn Koanantakool, Peter Hawkins, HyoukJoong Lee, Mingsheng Hong, Cliff Young, Ryan Sepassi, Blake A. Hechtman
- 2018 (modified: 11 Nov 2022)
- NeurIPS 2018
- Readers: Everyone
Image Transformer
Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Noam Shazeer, Alexander Ku, Dustin Tran
- 2018 (modified: 11 Nov 2022)
- ICML 2018
- Readers: Everyone
Fast Decoding in Sequence Models Using Discrete Latent Variables
Lukasz Kaiser, Samy Bengio, Aurko Roy, Ashish Vaswani, Niki Parmar, Jakob Uszkoreit, Noam Shazeer
- 2018 (modified: 11 Nov 2022)
- ICML 2018
- Readers: Everyone
Attention is All you Need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
- 2017 (modified: 11 Nov 2022)
- NIPS 2017
- Readers: Everyone

View all 24 publications

Co-Authors

View all 69 co-authors