Arun Babu

Joined

May 2021

Names

Arun Babu (Preferred)

Emails

****@fb.com (Confirmed)

****@gmail.com (Confirmed)

Personal Links

Homepage

Google Scholar

Career & Education History

Researcher

Waymo (waymo.com)

2024 – 2025

Researcher

Facebook (meta.com)

2017 – 2024

MS student

State University of New York, Stony Brook (stonybrook.edu)

2015 – 2016

Advisors, Relations & Conflicts

Coauthor

Jingwei Ji

2024 – 2025

Coauthor

James Guo

2024 – 2025

Coauthor

Anelia Angelova

2024 – 2025

Coauthor

Dahun Kim

2024 – 2025

Coauthor

Han Deng

2024 – 2025

Expertise

large language models

2021 – 2025

Publications

Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model
Chunting Zhou, LILI YU, Arun Babu, Kushal Tirumala, Michihiro Yasunaga, Leonid Shamis, Jacob Kahn, Xuezhe Ma, Luke Zettlemoyer, Omer Levy
- ICLR 2025 Oral
- Readers: Everyone
Toward Joint Language Modeling for Speech Units and Text
Ju-Chieh Chou, Chung-Ming Chien, Wei-Ning Hsu, Karen Livescu, Arun Babu, Alexis Conneau, Alexei Baevski, Michael Auli
- 29 Jan 2024 (modified: 29 Jan 2024)
- OpenReview Archive Direct Upload
- Readers: Everyone
Toward Joint Language Modeling for Speech Units and Text
Ju-Chieh Chou, Chung-Ming Chien, Wei-Ning Hsu, Karen Livescu, Arun Babu, Alexis Conneau, Alexei Baevski, Michael Auli
- EMNLP 2023 Findings
- Readers: Everyone
Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language
Alexei Baevski, Arun Babu, Wei-Ning Hsu, Michael Auli
- ICML 2023 OralPoster
- Readers: Everyone
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language
Alexei Baevski, Wei-Ning Hsu, Qiantong Xu, Arun Babu, Jiatao Gu, Michael Auli
- 14 Nov 2022
- OpenReview Archive Direct Upload
- Readers: Everyone
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language
Alexei Baevski, Wei-Ning Hsu, Qiantong Xu, Arun Babu, Jiatao Gu, Michael Auli
- 2022 (modified: 25 Mar 2022)
- CoRR 2022
- Readers: Everyone
XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale
Arun Babu, Changhan Wang, Andros Tjandra, Kushal Lakhotia, Qiantong Xu, Naman Goyal, Kritika Singh, Patrick von Platen, Yatharth Saraf, Juan Pino, Alexei Baevski, Alexis Conneau, Michael Auli
- 2022 (modified: 18 Apr 2023)
- INTERSPEECH 2022
- Readers: Everyone
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language
Alexei Baevski, Wei-Ning Hsu, Qiantong Xu, Arun Babu, Jiatao Gu, Michael Auli
- 2022 (modified: 24 Apr 2023)
- ICML 2022
- Readers: Everyone
Non-Autoregressive Semantic Parsing for Compositional Task-Oriented Dialog
Arun Babu, Akshat Shrivastava, Armen Aghajanyan, Ahmed Aly, Angela Fan, Marjan Ghazvininejad
- 2021 (modified: 14 Nov 2021)
- NAACL-HLT 2021
- Readers: Everyone
XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale
Arun Babu, Changhan Wang, Andros Tjandra, Kushal Lakhotia, Qiantong Xu, Naman Goyal, Kritika Singh, Patrick von Platen, Yatharth Saraf, Juan Pino, Alexei Baevski, Alexis Conneau, Michael Auli
- 2021 (modified: 30 Nov 2021)
- CoRR 2021
- Readers: Everyone

View all 15 publications

Co-Authors

View all 43 co-authors