Zhaoheng Ni

Researcher, Reality Labs, Meta

Joined

December 2017

Names

Zhaoheng Ni

Emails

****@gradcenter.cuny.edu (Confirmed)

****@meta.com (Confirmed)

Personal Links

Google Scholar

Career & Education History

Researcher

Reality Labs, Meta (meta.com)

2019 – Present

Advisors, Relations & Conflicts

PhD Advisor

Michael Mandel

2015 – 2023

Expertise

Self-supervised Learning

2021 – Present

Speech Enhancement

2016 – Present

Natural Language Processing

2013 – Present

Publications

High Fidelity Text-Guided Music Editing via Single-Stage Flow Matching
Gael Le Lan, Bowen Shi, Zhaoheng Ni, Sidd Srinivasan, Anurag Kumar, Brian Ellis, David Kant, Varun K. Nagaraja, Ernie Chang, Wei-Ning Hsu, Yangyang Shi, Vikas Chandra
- ICLR 2025 Conference Withdrawn Submission
- Readers: Everyone
SyncFlow: Temporally Aligned Joint Audio-Video Generation from Text
Haohe Liu, Gael Le Lan, Xinhao Mei, Zhaoheng Ni, Anurag Kumar, Varun K. Nagaraja, Wenwu Wang, Mark D Plumbley, Yangyang Shi, Vikas Chandra
- Submitted to ICLR 2025
- Readers: Everyone
High Fidelity Text-Guided Music Editing via Single-Stage Flow Matching
Gael Le Lan, Bowen Shi, Zhaoheng Ni, Sidd Srinivasan, Anurag Kumar, Brian Ellis, David Kant, Varun K. Nagaraja, Ernie Chang, Wei-Ning Hsu, Yangyang Shi, Vikas Chandra
- Audio Imagination: NeurIPS 2024 Workshop
- Readers: Everyone
Towards Temporally Synchronized Visually Indicated Sounds Through Scale-Adapted Positional Embeddings
Xinhao Mei, Gael Le Lan, Haohe Liu, Zhaoheng Ni, Varun K. Nagaraja, Anurag Kumar, Yangyang Shi, Vikas Chandra
- Audio Imagination: NeurIPS 2024 Workshop
- Readers: Everyone
FSD: Acoustic Echo Cancellation with Fewer Step Diffusion
Yang Liu, Li Wan, Yiteng Huang, Ming Sun, Changsheng Zhao, Zhaoheng Ni, Xinhao Mei, Yangyang Shi, Florian Metze
- Audio Imagination: NeurIPS 2024 Workshop
- Readers: Everyone
Stack-and-Delay: A New Codebook Pattern for Music Generation
Gael Le Lan, Varun K. Nagaraja, Ernie Chang, David Kant, Zhaoheng Ni, Yangyang Shi, Forrest Iandola, Vikas Chandra
- ICASSP 2024
- Readers: Everyone
A Time-Frequency Attention Module for Neural Speech Enhancement
Qiquan Zhang, Xinyuan Qian, Zhaoheng Ni, Aaron Nicolson, Eliathamby Ambikairajah, Haizhou Li
- Published: 01 Jan 2023, Last Modified: 15 May 2023
- IEEE ACM Trans. Audio Speech Lang. Process. 2023
- Readers: Everyone
Scaling Speech Technology to 1, 000+ Languages
Vineel Pratap, Andros Tjandra, Bowen Shi, Paden Tomasello, Arun Babu, Sayani Kundu, Ali Elkahky, Zhaoheng Ni, Apoorv Vyas, Maryam Fazel-Zarandi, Alexei Baevski, Yossi Adi, Xiaohui Zhang, Wei-Ning Hsu, Alexis Conneau, Michael Auli
- Published: 01 Jan 2023, Last Modified: 15 Jun 2023
- CoRR 2023
- Readers: Everyone
Ripple sparse self-attention for monaural speech enhancement
Qiquan Zhang, Hongxu Zhu, Qi Song, Xinyuan Qian, Zhaoheng Ni, Haizhou Li
- Published: 01 Jan 2023, Last Modified: 15 Jun 2023
- CoRR 2023
- Readers: Everyone
Towards Low-distortion Multi-channel Speech Enhancement: The ESPNet-SE Submission to The L3DAS22 Challenge
Yen-Ju Lu, Samuele Cornell, Xuankai Chang, Wangyou Zhang, Chenda Li, Zhaoheng Ni, Zhong-Qiu Wang, Shinji Watanabe
- 2022 (modified: 14 Apr 2023)
- CoRR 2022
- Readers: Everyone

View all 25 publications

Co-Authors

View all 90 co-authors