Mostafa Dehghani

Research Scientist, Google DeepMind

Joined

October 2017

Names

Mostafa Dehghani

Emails

****@gmail.com (Confirmed)

****@uva.nl (Confirmed)

****@google.com (Confirmed)

Personal Links

Homepage

Google Scholar

DBLP

Career & Education History

Research Scientist

Google DeepMind (google.com)

2020 – Present

PhD student

University of Amsterdam (uva.nl)

2014 – 2019

Advisors, Relations & Conflicts

No relations added

Expertise

Deep Learning

2014 – Present

Publications

Frozen Feature Augmentation for Few-Shot Image Classification
Manoj Kumar, Neil Houlsby, Mostafa Dehghani, Andreas Bär
- CVPR 2024
- Readers: Everyone
Fractal Patterns May Illuminate the Success of Next-Token Prediction
Ibrahim Alabdulmohsin, Vinh Q. Tran, Mostafa Dehghani
- NeurIPS 2024 poster
- Readers: Everyone
How (not) to ensemble LVLMs for VQA
Lisa Alazraki, Lluis Castrejon, Mostafa Dehghani, Fantine Huot, Jasper Uijlings, Thomas Mensink
- ICBINB 2023
- Readers: Everyone
Fractal Patterns May Unravel the Intelligence in Next-Token Prediction
Ibrahim Alabdulmohsin, Mostafa Dehghani
- Submitted to ICLR 2024
- Readers: Everyone
End-to-End Spatio-Temporal Action Localisation with Video Transformers
Alexey A. Gritsenko, Xuehan Xiong, Josip Djolonga, Mostafa Dehghani, Chen Sun, Mario Lucic, Cordelia Schmid, Anurag Arnab
- ICLR 2024 Conference Withdrawn Submission
- Readers: Everyone
Transcending Scaling Laws with 0.1% Extra Compute
Yi Tay, Jason Wei, Hyung Won Chung, Vinh Q. Tran, David So, Siamak Shakeri, Xavier Garcia, Steven Zheng, Jinfeng Rao, Aakanksha Chowdhery, Denny Zhou, Donald Metzler, Slav Petrov, Neil Houlsby, Quoc V Le, Mostafa Dehghani
- EMNLP 2023 Main
- Readers: Everyone
DSI++: Updating Transformer Memory with New Documents
Sanket Vaibhav Mehta, Jai Gupta, Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Jinfeng Rao, Marc Najork, Emma Strubell, Donald Metzler
- EMNLP 2023 Main
- Readers: Everyone
Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
Yi Tay, Mostafa Dehghani, Samira Abnar, Hyung Won Chung, William Fedus, Jinfeng Rao, Sharan Narang, Vinh Q. Tran, Dani Yogatama, Donald Metzler
- EMNLP 2023 Findings
- Readers: Everyone
Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution
Mostafa Dehghani, Basil Mustafa, Josip Djolonga, Jonathan Heek, Matthias Minderer, Mathilde Caron, Andreas Peter Steiner, Joan Puigcerver, Robert Geirhos, Ibrahim Alabdulmohsin, Avital Oliver, Piotr Padlewski, Alexey A. Gritsenko, Mario Lucic, Neil Houlsby
- NeurIPS 2023 poster
- Readers: Everyone
L2 Norm Guided Adaptive Computation
Mani Shemiranifar, Mostafa Dehghani
- 01 Mar 2023 (modified: 30 May 2023)
- Submitted to Tiny Papers @ ICLR 2023
- Readers: Everyone

View all 38 publications

Co-Authors

View all 135 co-authors