Aurko Roy

Research Scientist, Google

Joined

January 2017

Names

Aurko Roy

Emails

****@gatech.edu (Confirmed)

****@google.com (Confirmed)

Personal Links

Homepage

Google Scholar

DBLP

Career & Education History

Research Scientist

Google (google.com)

2018 – Present

Software Engineer

Google (google.com)

2017 – 2018

PhD student

Georgia Institute of Technology (gatech.edu)

2013 – 2017

Intern

Google (google.com)

2016 – 2016

Advisors, Relations & Conflicts

No relations added

Expertise

Deep learning

2016 – Present

Machine learning

2013 – Present

Algorithms

2010 – Present

Publications

Fast and Simplex: 2-Simplicial Attention in Triton
Aurko Roy, Timothy Chou, Sai Surya Duvvuri, Sijia Chen, Jiecao Yu, Xiaodong Wang, Ying Zhang, Manzil Zaheer, Rohan Anil
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
The Matching Problem Has No Small Symmetric SDP.
Gábor Braun, Jonah Brown-Cohen, Arefin Huq, Sebastian Pokutta, Prasad Raghavendra, Aurko Roy, Daniel Zink, Benjamn Weitz
- 17 May 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
N-Grammer: Augmenting Transformers with latent n-grams
Aurko Roy, Rohan Anil, Guangda Lai, Benjamin Lee, Jeffrey Zhao, Shuyuan Zhang, Shibo Wang, Ye Zhang, Shen Wu, Rigel Swavely, Tao Yu, Phuong Dao, Christopher Fifty, Zhifeng Chen, Yonghui Wu
- Published: 01 Jan 2022, Last Modified: 28 Apr 2023
- CoRR 2022
- Readers: Everyone
Hurdles to Progress in Long-form Question Answering
Kalpesh Krishna, Aurko Roy, Mohit Iyyer
- 2021 (modified: 28 Apr 2023)
- CoRR 2021
- Readers: Everyone
Hurdles to Progress in Long-form Question Answering
Kalpesh Krishna, Aurko Roy, Mohit Iyyer
- 2021 (modified: 17 Apr 2023)
- NAACL-HLT 2021
- Readers: Everyone
Efficient Content-Based Sparse Attention with Routing Transformers
Aurko Roy, Mohammad Saffar, Ashish Vaswani, David Grangier
- Published: 01 Jan 2021, Last Modified: 28 Apr 2023
- Trans. Assoc. Comput. Linguistics 2021
- Readers: Everyone
Efficient Content-Based Sparse Attention with Routing Transformers
Aurko Roy, Mohammad Saffar, Ashish Vaswani, David Grangier
- Published: 01 Jan 2020, Last Modified: 28 Apr 2023
- CoRR 2020
- Readers: Everyone
Unsupervised Paraphrasing without Translation
Aurko Roy, David Grangier
- Published: 01 Jan 2019, Last Modified: 28 Apr 2023
- ACL (1) 2019
- Readers: Everyone
Unsupervised Paraphrasing without Translation
Aurko Roy, David Grangier
- Published: 01 Jan 2019, Last Modified: 28 Apr 2023
- CoRR 2019
- Readers: Everyone
Understanding and Improving Interpolation in Autoencoders via an Adversarial Regularizer
David Berthelot, Colin Raffel, Aurko Roy, Ian J. Goodfellow
- Published: 01 Jan 2019, Last Modified: 28 Apr 2023
- ICLR (Poster) 2019
- Readers: Everyone

View all 30 publications

Co-Authors

View all 50 co-authors