Mohammadreza Banaei

Joined

January 2022

Names

Mohammadreza Banaei (Preferred)

Emails

****@epfl.ch (Confirmed)

****@gmail.com (Confirmed)

Personal Links

Homepage

DBLP

Career & Education History

PhD student

EPFL - EPF Lausanne (epfl.ch)

2018 – 2025

Undergrad student

Sharif University of Technology (sharif.edu)

2013 – 2018

Advisors, Relations & Conflicts

PhD Advisor

Karl Aberer

2018 – 2024

Expertise

natural language processing

deep learning

multilingual

model compression

Present

Publications

LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters
Klaudia Bałazy, Mohammadreza Banaei, Karl Aberer, Jacek Tabor
- ICLR 2025 Conference Withdrawn Submission
- Readers: Everyone
Discovering Language-neutral Sub-networks in Multilingual Language Models
Negar Foroutan, Antoine Bosselut, Karl Aberer, Rémi Lebret, Mohammadreza Banaei
- EMNLP 2022
- Readers: Everyone
Could ChatGPT be an Engineer? Evaluating Higher Education Vulnerability to AI Assistants
Beatriz Borges, Negar Foroutan, Deniz Bayazit, Syrielle Montariol, Mohammadreza Banaei, Alireza Sakhaeirad, Philippe Servant, Anna Sotnikova, Tanya Nazaretsky, Seyed Parsa Neshaei, Jibril Frej, Angelika Romanou, Gail Weiss, Sepideh Mamooler, Zeming Chen, Simin Fan, Silin Gao, Mete Ismayilzada, Debjit Paul, Tanja Käser et al. (1 additional authors not shown)
- AI4ED-AAAI-2024 day2spotlight
- Readers: Everyone
Breaking the Language Barrier: Improving Cross-Lingual Reasoning with Structured Self-Attention
Negar Foroutan, Mohammadreza Banaei, Karl Aberer, Antoine Bosselut
- EMNLP 2023 Findings
- Readers: Everyone
Revisiting Offline Compression: Going Beyond Factorization-based Methods for Transformer Language Models
Mohammadreza Banaei, Klaudia Balazy, Artur Kasymov, Rémi Lebret, Jacek Tabor, Karl Aberer
- Published: 01 Jan 2023, Last Modified: 11 Jun 2023
- EACL (Findings) 2023
- Readers: Everyone
Discovering Language-neutral Sub-networks in Multilingual Language Models
Negar Foroutan, Mohammadreza Banaei, Rémi Lebret, Antoine Bosselut, Karl Aberer
- Published: 01 Jan 2022, Last Modified: 11 Jun 2023
- EMNLP 2022
- Readers: Everyone
AdaGrid: Adaptive Grid Search for Link Prediction Training Objective
Tim Postuvan, Jiaxuan You, Mohammadreza Banaei, Rémi Lebret, Jure Leskovec
- Published: 01 Jan 2022, Last Modified: 11 Jun 2023
- CoRR 2022
- Readers: Everyone
Direction is what you need: Improving Word Embedding Compression in Large Language Models
Klaudia Balazy, Mohammadreza Banaei, Rémi Lebret, Jacek Tabor, Karl Aberer
- Published: 01 Jan 2021, Last Modified: 11 Jun 2023
- RepL4NLP@ACL-IJCNLP 2021
- Readers: Everyone
Spoken Dialect Identification in Twitter using a Multi-filter Architecture
Mohammadreza Banaei, Rémi Lebret, Karl Aberer
- Published: 01 Jan 2020, Last Modified: 11 Jun 2023
- SwissText/KONVENS 2020
- Readers: Everyone

Co-Authors

View all 29 co-authors