Zhihao Du

Joined

September 2023

Names

Zhihao Du (Preferred)

Emails

****@alibaba-inc.com (Confirmed)

****@gmail.com (Confirmed)

****@163.com (Confirmed)

Personal Links

Career & Education History

Principal Researcher

Speech Lab, Alibaba Group (alibaba-inc.com)

2021 – 2025

PhD student

CS, Harbin Institute of Technology (hit.edu.cn)

2015 – 2021

Advisors, Relations & Conflicts

PhD Advisor

Jiqing Han

2015 – 2021

Expertise

Speech Generation

2023 – 2025

Audio Generation

2023 – 2025

Speech Codec

2022 – 2023

Speech Diarization

2021 – 2022

Speech Enhancement

2015 – 2021

Publications

InspireMusic: Integrating Super Resolution and Large Language Model for High-Fidelity Long-Form Music Generation
Chong Zhang, Yukun Ma, Qian Chen, Wen Wang, Shengkui Zhao, Zexu Pan, Hao Wang, Chongjia Ni, Trung Hieu Nguyen, Kun Zhou, Yidi Jiang, Chaohong Tan, Zhifu Gao, Zhihao Du, Bin Ma
- CoRR 2025
- Readers: Everyone
SyncSpeech: Low-Latency and Efficient Dual-Stream Text-to-Speech based on Temporal Masked Transformer
Zhengyan Sheng, Zhihao Du, Shiliang Zhang, Zhijie Yan, Yexin Yang, Zhenhua Ling
- CoRR 2025
- Readers: Everyone
Unispeaker: A Unified Approach for Multimodality-driven Speaker Generation
Zhengyan Sheng, Zhihao Du, Heng Lu, Shiliang Zhang, Zhen-Hua Ling
- CoRR 2025
- Readers: Everyone
MinMo: A Multimodal Large Language Model for Seamless Voice Interaction
Qian Chen, Yafeng Chen, Yanni Chen, Mengzhe Chen, Yingda Chen, Chong Deng, Zhihao Du, Ruize Gao, Changfeng Gao, Zhifu Gao, Yabin Li, Xiang Lv, Jiaqing Liu, Haoneng Luo, Bin Ma, Chongjia Ni, Xian Shi, Jialong Tang, Hui Wang, Hao Wang et al. (16 additional authors not shown)
- CoRR 2025
- Readers: Everyone
Speech Recognition Meets Large Language Model: Benchmarking, Models, and Exploration
Ziyang Ma, Guanrou Yang, Yifan Yang, Zhifu Gao, Jiaming Wang, Zhihao Du, Fan Yu, Qian Chen, Siqi Zheng, Shiliang Zhang, Xie Chen
- AAAI 2025
- Readers: Everyone
Unispeaker: A unified speech generation model for multimodality-driven voice control
Zhengyan Sheng, Zhihao Du, Heng Lu, ShiLiang Zhang, Zhen-Hua Ling
- ICLR 2025 Conference Withdrawn Submission
- Readers: Everyone
FunCodec: A Fundamental, Reproducible and Integrable Open-Source Toolkit for Neural Speech Codec
Zhihao Du, Shiliang Zhang, Kai Hu, Siqi Zheng
- ICASSP 2024
- Readers: Everyone
FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMs
Keyu An, Qian Chen, Chong Deng, Zhihao Du, Changfeng Gao, Zhifu Gao, Yue Gu, Ting He, Hangrui Hu, Kai Hu, Shengpeng Ji, Yabin Li, Zerui Li, Heng Lu, Haoneng Luo, Xiang Lv, Bin Ma, Ziyang Ma, Chongjia Ni, Changhe Song et al. (13 additional authors not shown)
- CoRR 2024
- Readers: Everyone
CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokens
Zhihao Du, Qian Chen, Shiliang Zhang, Kai Hu, Heng Lu, Yexin Yang, Hangrui Hu, Siqi Zheng, Yue Gu, Ziyang Ma, Zhifu Gao, Zhijie Yan
- CoRR 2024
- Readers: Everyone

View all 94 publications

Co-Authors

View all 102 co-authors