Ziyang Ma

PhD student, Shanghai Jiaotong University

PhD student, Nanyang Technological University

Joined

March 2022

Names

Ziyang Ma (Preferred)

Emails

****@mail.sdu.edu.cn (Confirmed)

****@sjtu.edu.cn (Confirmed)

****@e.ntu.edu.sg (Confirmed)

Personal Links

Career & Education History

PhD student

Shanghai Jiaotong University (sjtu.edu.cn)

2022 – 2027

PhD student

Nanyang Technological University (ntu.edu.sg)

2022 – 2027

Undergrad student

Shandong University (sdu.edu.cn)

2018 – 2022

Advisors, Relations & Conflicts

PhD Advisor

Xie Chen

Present

Expertise

speech processing

natural nanguage processing

multimodal large language model

2022 – Present

Publications

SLAM-LLM: A Modular, Open-Source Multimodal Large Language Model Framework and Best Practice for Speech, Language, Audio and Music Processing
Ziyang Ma, Guanrou Yang, Wenxi Chen, Zhifu Gao, Yexing Du, Xiquan Li, Zhisheng Zheng, Haina Zhu, Jianheng Zhuo, Zheshu Song, Ruiyang Xu, Tiranrui Wang, Yifan Yang, Yanqiao Zhu, Zhikang Niu, Liumeng Xue, Yinghao Ma, Ruibin Yuan, Shiliang Zhang, Kai Yu et al. (2 additional authors not shown)
- IEEE Journal of Selected Topics in Signal Processing
- Readers: Everyone
MuQ: Self-Supervised Music Representation Learning With Mel Residual Vector Quantization
Haina Zhu, Yizhi Zhou, Hangting Chen, Jianwei Yu, Ziyang Ma, Rongzhi Gu, Yi Luo, Wei Tan, Xie Chen
- IEEE Transactions on Audio, Speech and Language Processing
- Readers: Everyone
AudioTrust: Benchmarking the Multifaceted Trustworthiness of Audio Large Language Models
Kai Li, Can Shen, Yile Liu, Jirui Han, Kelong zheng, Xuechao Zou, Lionel Z. WANG, Shun Zhang, Xingjian Du, Hanjun Luo, Yingbin Jin, Xinxin Xing, Ziyang Ma, Yue Liu, YiFan Zhang, Junfeng Fang, Kun Wang, Yibo Yan, Gelei Deng, Haoyang LI et al. (14 additional authors not shown)
- ResponsibleFM @ NeurIPS 2025
- Readers: Everyone
EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting
Guanrou Yang, Chen Yang, Qian Chen, Ziyang Ma, Wenxi Chen, Wen Wang, Tianrui Wang, Yifan Yang, Zhikang Niu, Wenrui Liu, Fan Yu, Zhihao Du, Zhifu Gao, Shiliang Zhang, Xie Chen
- Crossref
- Readers: Everyone
Evaluating Bias in Spoken Dialogue LLMs for Real-World Decisions and Recommendations
Yihao Wu, Tianrui Wang, Yizhou Peng, Yi-Wen Chao, Xuyi Zhuang, Xinsheng Wang, Shunshun Yin, Ziyang Ma
- CoRR 2025
- Readers: Everyone
Omni-Captioner: Data Pipeline, Models, and Benchmark for Omni Detailed Perception
Ziyang Ma, Ruiyang Xu, Zhenghao Xing, Yunfei Chu, Yuxuan Wang, Jinzheng He, Jin Xu, Pheng-Ann Heng, Kai Yu, Junyang Lin, Eng Siong Chng, Xie Chen
- CoRR 2025
- Readers: Everyone
UltraVoice: Scaling Fine-Grained Style-Controlled Speech Conversations for Spoken Dialogue Models
Wenming Tu, Guanrou Yang, Ruiqi Yan, Wenxi Chen, Ziyang Ma, Yipeng Kang, Kai Yu, Xie Chen, Zilong Zheng
- CoRR 2025
- Readers: Everyone
ISA-Bench: Benchmarking Instruction Sensitivity for Large Audio Language Models
Bohan Li, Wenbin Huang, Yuhang Qiu, Yiwei Guo, Hankun Wang, Zhihan Li, Jing Peng, Ziyang Ma, Xie Chen, Kai Yu
- CoRR 2025
- Readers: Everyone
SAC: Neural Speech Codec with Semantic-Acoustic Dual-Stream Quantization
Wenxi Chen, Xinsheng Wang, Ruiqi Yan, Yushen Chen, Zhikang Niu, Ziyang Ma, Xiquan Li, Yuzhe Liang, Hanlin Wen, Shunshun Yin, Ming Tao, Xie Chen
- CoRR 2025
- Readers: Everyone
Audio-FLAN: An Instruction-Following Dataset for Unified Understanding and Generation of Speech, Music, and Sound
Liumeng Xue, Ziya Zhou, Jiahao Pan, Zixuan Li, Shuai Fan, Yinghao Ma, Ruibin Yuan, Sitong Cheng, Dongchao Yang, Haohan Guo, Yujia Xiao, Xinsheng Wang, Zixuan Shen, Chuanbo Zhu, ZHANG Xinshen, Tianchi Liu, Zeyue Tian, Ziyang Ma, Haohe Liu, Ge Zhang et al. (5 additional authors not shown)
- Submitted to ICLR 2026
- Readers: Everyone

View all 132 publications

Co-Authors

View all 463 co-authors