Rafael Valle

Researcher, Meta Superintelligence Labs, Facebook

Joined

September 2018

Names

Rafael Valle (Preferred)

Emails

****@berkeley.edu (Confirmed)

****@nvidia.com (Confirmed)

Personal Links

Homepage

Google Scholar

Career & Education History

Researcher

Meta Superintelligence Labs, Facebook (meta.com)

2025 – 2026

Senior Research Scientist

ADLR, NVIDIA (nvidia.com)

2018 – 2025

PhD student

University of California Berkeley (berkeley.edu)

2012 – 2018

Advisors, Relations & Conflicts

Advisor

Sanjit Seshia

2014 – 2018

Expertise

Deep learning

2014 – 2018

Publications

UALM: Unified Audio Language Model for Understanding, Generation and Reasoning
Jinchuan Tian, Sang-gil Lee, Zhifeng Kong, Sreyan Ghosh, Arushi Goel, Chao-Han Huck Yang, Wenliang Dai, Zihan Liu, Hanrong Ye, Shinji Watanabe, Mohammad Shoeybi, Bryan Catanzaro, Rafael Valle, Wei Ping
- ICLR 2026 Oral
- Readers: Everyone
TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching and Clap-Ranked Preference Optimization
Chia-Yu Hung, Navonil Majumder, Zhifeng Kong, Ambuj Mehrish, Amir Zadeh, Chuan Li, Rafael Valle, Bryan Catanzaro, Soujanya Poria
- ICLR 2026 Poster
- Readers: Everyone
OmniVinci: Enhancing Architecture and Data for Omni-Modal Understanding LLM
Hanrong Ye, Chao-Han Huck Yang, Arushi Goel, Wei Huang, Zhen Wan, Jinchuan Tian, An-Chieh Cheng, Ligeng Zhu, Yuanhang Su, Yuming Lou, Yong-Xiang Lin, Dong Yang, Sreyan Ghosh, Zhijian Liu, Yukang Chen, Ehsan Jahangiri, Ambrish Dantrey, Daguang Xu, Ehsan Hosseini-Asl, Seyed Danial Mohseni Taheri et al. (12 additional authors not shown)
- ICLR 2026 Poster
- Readers: Everyone
Audio-to-Audio Schrodinger Bridges
Kevin J. Shih, Zhifeng Kong, Weili Nie, Arash Vahdat, Sang-gil Lee, Joao Felipe Santos, Ante Jukić, Rafael Valle, Bryan Catanzaro
- AI4Music
- Readers: Everyone
Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Models
Sreyan Ghosh, Arushi Goel, Jaehyeon Kim, Sonal Kumar, Zhifeng Kong, Sang-gil Lee, Chao-Han Huck Yang, Ramani Duraiswami, Dinesh Manocha, Rafael Valle, Bryan Catanzaro
- NeurIPS 2025 spotlight
- Readers: Everyone
Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities
Sreyan Ghosh, Zhifeng Kong, Sonal Kumar, S Sakshi, Jaehyeon Kim, Wei Ping, Rafael Valle, Dinesh Manocha, Bryan Catanzaro
- ICML 2025 poster
- Readers: Everyone
ETTA: Elucidating the Design Space of Text-to-Audio Models
Sang-gil Lee, Zhifeng Kong, Arushi Goel, Sungwon Kim, Rafael Valle, Bryan Catanzaro
- ICML 2025 poster
- Readers: Everyone
TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching and Clap-Ranked Preference Optimization
Chia-Yu Hung, Navonil Majumder, Zhifeng Kong, Ambuj Mehrish, Rafael Valle, Bryan Catanzaro, Soujanya Poria
- OpenReview Archive Direct Upload
- Readers: Everyone
A$^2$-Flow: Alignment-Aware Pre-training for Speech Synthesis with Flow Matching
Sungwon Kim, Sang-gil Lee, Alexander H. Liu, Joao Felipe Santos, Mikyas T. Desta, Sudheer Kovela, Rafael Valle, Bryan Catanzaro
- Submitted to ICLR 2025
- Readers: Everyone
Fugatto 1: Foundational Generative Audio Transformer Opus 1
Rafael Valle, Rohan Badlani, Zhifeng Kong, Sang-gil Lee, Arushi Goel, Sungwon Kim, Joao Felipe Santos, Shuqi Dai, Siddharth Gururani, Aya Aljafari, Alexander H. Liu, Kevin J. Shih, Ryan Prenger, Wei Ping, Chao-Han Huck Yang, Bryan Catanzaro
- ICLR 2025 Poster
- Readers: Everyone

View all 21 publications

Co-Authors

View all 78 co-authors