Xinfa Zhu

Joined

September 2023

Names

Xinfa Zhu (Preferred)

Emails

****@mail.nwpu.edu.cn (Confirmed)

Personal Links

Career & Education History

MS student

School of Computer Science, Northwestern Polytechnical University, Northwest Polytechnical University Xi'an (mai.nwpu.edu.cn)

2022 – 2025

Advisors, Relations & Conflicts

PhD Advisor

Lei Xie

2022 – 2025

Expertise

Speech Generation and Processing

Present

Language Modeling

Present

Publications

PodEval: A Multimodal Evaluation Framework for Podcast Audio Generation
Yujia Xiao, Liumeng Xue, Lei He, Xinyi Chen, Aemon Yat Fei Chiu, Wenjie Tian, Shaofei Zhang, Qiuqiang Kong, Xinfa Zhu, Wei Xue, Tan Lee
- Submitted to ICLR 2026
- Readers: Everyone
UniStyle: Unified Style Modeling for Speaking Style Captioning and Stylistic Speech Synthesis
Xinfa Zhu, Wenjie Tian, Xinsheng Wang, Lei He, Yujia Xiao, Xi Wang, Xu Tan, sheng zhao, Lei Xie
- MM2024 Oral
- Readers: Everyone
Contrastive Context-Speech Pretraining for Expressive Text-to-Speech Synthesis
Yujia Xiao, Xi Wang, Xu Tan, Lei He, Xinfa Zhu, sheng zhao, Tan Lee
- MM2024 Poster
- Readers: Everyone
U-Style: Cascading U-Nets With Multi-Level Speaker and Style Modeling for Zero-Shot Voice Cloning
Tao Li, Zhichao Wang, Xinfa Zhu, Jian Cong, Qiao Tian, Yuping Wang, Lei Xie
- IEEE ACM Trans. Audio Speech Lang. Process. 2024
- Readers: Everyone
UniStyle: Unified Style Modeling for Speaking Style Captioning and Stylistic Speech Synthesis
Xinfa Zhu, Wenjie Tian, Xinsheng Wang, Lei He, Yujia Xiao, Xi Wang, Xu Tan, Sheng Zhao, Lei Xie
- ACM Multimedia 2024
- Readers: Everyone
METTS: Multilingual Emotional Text-to-Speech by Cross-Speaker and Cross-Lingual Emotion Transfer
Xinfa Zhu, Yi Lei, Tao Li, Yongmao Zhang, Hongbin Zhou, Heng Lu, Lei Xie
- IEEE ACM Trans. Audio Speech Lang. Process. 2024
- Readers: Everyone
Contrastive Context-Speech Pretraining for Expressive Text-to-Speech Synthesis
Yujia Xiao, Xi Wang, Xu Tan, Lei He, Xinfa Zhu, Sheng Zhao, Tan Lee
- ACM Multimedia 2024
- Readers: Everyone
Boosting Multi-Speaker Expressive Speech Synthesis with Semi-Supervised Contrastive Learning
Xinfa Zhu, Yuke Li, Yi Lei, Ning Jiang, Guoqing Zhao, Lei Xie
- ICME 2024
- Readers: Everyone
Spontts: Modeling and Transferring Spontaneous Style for TTS
Hanzhao Li, Xinfa Zhu, Liumeng Xue, Yang Song, Yunlin Chen, Lei Xie
- ICASSP 2024
- Readers: Everyone
SELM: Speech Enhancement using Discrete Tokens and Language Models
Ziqian Wang, Xinfa Zhu, Zihan Zhang, Yuanjun Lv, Ning Jiang, Guoqing Zhao, Lei Xie
- ICASSP 2024
- Readers: Everyone

View all 17 publications

Co-Authors

View all 50 co-authors