Xin Zhang

Joined

June 2023

Names

Xin Zhang (Preferred)

Emails

****@m.fudan.edu.cn (Confirmed)

Personal Links

Career & Education History

MS student

School of Computer Science, Fudan University (fudan.edu.cn)

2022 – 2025

Undergrad student

School of Data Science, Fudan University (fudan.edu.cn)

2017 – 2022

Advisors, Relations & Conflicts

Postdoc Advisor

2022 – 2025

Expertise

Multimodal Large Language Model

2022 – Present

Speech synthesis

2022 – Present

Speech Pretrain

2022 – Present

Publications

DrVoice: Parallel Speech-Text Voice Conversation Model via Dual-Resolution Speech Representations
Chao-Hong Tan, Qian Chen, Wen Wang, Chong Deng, Qinglin Zhang, Luyao Cheng, Hai Yu, Xin Zhang, Xiang Lyu, Tianyu Zhao, Chong Zhang, Yukun Ma, Yafeng Chen, Hui Wang, Jiaqing Liu, Xiangang Li, Jieping Ye
- ICLR 2026 Poster
- Readers: Everyone
XY-Tokenizer: Mitigating the Semantic-Acoustic Conflict in Low-Bitrate Speech Codecs
Yitian Gong, Luozhijie Jin, Dong Zhang, Xiaogui Yang, Ruifan Deng, Xin Zhang, Qinyuan Cheng, Zhaoye Fei, Shimin Li, Xipeng Qiu
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
SpeechAlign: Aligning Speech Generation to Human Preferences
Dong Zhang, Zhaowei Li, Shimin Li, Xin Zhang, Pengyu Wang, Yaqian Zhou, Xipeng Qiu
- NeurIPS 2024 poster
- Readers: Everyone
SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models
Xin Zhang, Dong Zhang, Shimin Li, Yaqian Zhou, Xipeng Qiu
- ICLR 2024 poster
- Readers: Everyone
SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities
Dong Zhang, Shimin Li, Xin Zhang, Jun Zhan, Pengyu Wang, Yaqian Zhou, Xipeng Qiu
- EMNLP 2023 Findings
- Readers: Everyone

Co-Authors

View all 29 co-authors