Rami Al-Rfou'

Researcher, Waymo

Joined

July 2019

Names

Rami Al-Rfou'

Emails

****@google.com (Confirmed)

****@alrfou.com

****@waymo.com

****@openai.com (Confirmed)

Personal Links

Career & Education History

Researcher

Waymo (waymo.com)

2021 – Present

Researcher

Google (google.com)

2015 – 2021

PhD student

State University of New York at Stony Brook (stonybrook.edu)

2010 – 2015

Advisors, Relations & Conflicts

PhD Advisor

Steven Skiena

2010 – 2015

Expertise

Motion Forecasting

2021 – Present

Natural Language Processing

2010 – 2021

Graph Neural Networks

2014 – 2019

Publications

Parameter Efficient Graph Encoding for Large Language Models
Bryan Perozzi, Bahare Fatemi, Dustin Zelle, Syed A Rizvi, Anton Tsitsulin, Sami Abu-El-Haija, Hasan Awais, Mehran Kazemi, David van Dijk, Rami Al-Rfou', Jonathan Halcrow
- Submitted to ICLR 2025
- Readers: Everyone
SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer
Tu Vu, Brian Lester, Noah Constant, Rami Al-Rfou', Daniel Cer
- 15 Feb 2024
- OpenReview Archive Direct Upload
- Readers: Everyone
VN-Transformer: Rotation-Equivariant Attention for Vector Neurons
Serge Assaad, Carlton Downey, Rami Al-Rfou', Nigamaa Nayakanti, Benjamin Sapp
- Accepted by TMLR
- Readers: Everyone
The Power of Scale for Parameter-Efficient Prompt Tuning
Brian Lester, Rami Al-Rfou, Noah Constant
- 2021 (modified: 15 Nov 2021)
- EMNLP (1) 2021
- Readers: Everyone
nmT5 - Is parallel data still relevant for pre-training massively multilingual language models?
Mihir Kale, Aditya Siddhant, Rami Al-Rfou, Linting Xue, Noah Constant, Melvin Johnson
- 2021 (modified: 15 Nov 2021)
- ACL/IJCNLP (2) 2021
- Readers: Everyone
mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer
Linting Xue, Noah Constant, Adam Roberts, Mihir Kale, Rami Al-Rfou, Aditya Siddhant, Aditya Barua, Colin Raffel
- 2021 (modified: 15 Nov 2021)
- NAACL-HLT 2021
- Readers: Everyone
nmT5 - Is parallel data still relevant for pre-training massively multilingual language models?
Mihir Kale, Aditya Siddhant, Rami Al-Rfou, Linting Xue, Noah Constant, Melvin Johnson
- 2021 (modified: 15 Nov 2021)
- ACL/IJCNLP (2) 2021
- Readers: Everyone
The Power of Scale for Parameter-Efficient Prompt Tuning
Brian Lester, Rami Al-Rfou, Noah Constant
- 2021 (modified: 15 Nov 2021)
- EMNLP (1) 2021
- Readers: Everyone
ByT5: Towards a token-free future with pre-trained byte-to-byte models
Linting Xue, Aditya Barua, Noah Constant, Rami Al-Rfou, Sharan Narang, Mihir Kale, Adam Roberts, Colin Raffel
- 2021 (modified: 15 Nov 2021)
- CoRR 2021
- Readers: Everyone
Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-training
Oshin Agarwal, Heming Ge, Siamak Shakeri, Rami Al-Rfou
- 2021 (modified: 15 Nov 2021)
- NAACL-HLT 2021
- Readers: Everyone

View all 54 publications

Co-Authors

View all 175 co-authors