Jiatong Shi

PhD student, LTI, CMU, Carnegie Mellon University

Joined

July 2021

Names

Jiatong Shi (Preferred)

Emails

****@andrew.cmu.edu (Confirmed)

****@cs.cmu.edu (Confirmed)

****@gmail.com (Confirmed)

****@anuttacon.com (Confirmed)

Personal Links

Career & Education History

PhD student

LTI, CMU, Carnegie Mellon University (andrew.cmu.edu)

2021 – 2026

MS student

CS Department, Johns Hopkins University (jhu.edu)

2019 – 2021

Undergrad student

School of Information, Renmin University of China (ruc.edu.cn)

2015 – 2019

Advisors, Relations & Conflicts

PhD Advisor

Shinji Watanabe

2019 – 2026

Expertise

Speech Processing

2018 – Present

Publications

ESPnet3: Infrastructure for Scalable Speech and Audio Research in the Foundation Model Era
Masao Someki, Alexander Polok, Carlos Carvalho, Chyi-Jiunn Lin, Da-Hee Yang, Jiatong Shi, Jinchuan Tian, Nelson Yalta, Samuele Cornell, Siddhant Arora, Francisco Teixeira, Wei Wang, William Chen, Alberto Abad Gareta, Chenda Li, Shinji Watanabe, Wangyou Zhang
- MSLD 2026 Poster
- Readers: Everyone
SingingSDS: A Singing-Capable Spoken Dialogue System for Conversational Roleplay Applications
Jionghao Han, Jiatong Shi, Masao Someki, Yuxun Tang, Lan Liu, Yiwen Zhao, Wenhao Feng, Shinji Watanabe
- EAIM Poster
- Readers: Everyone
CartoonSing: Unifying Human and Nonhuman Timbres in Singing Generation
Jionghao Han, Jiatong Shi, Zhuoyan Tao, Yuxun Tang, Yiwen Zhao, Gus Xia, Shinji Watanabe
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
Speech-DRAME: A Framework for Human-Aligned Benchmarks in Speech Role-Play
Jiatong Shi, Jionghao Han, Yichen Lu, Santiago Pascual, Pengfei Wu, Chenye Cui, Shinji Watanabe, CHAO WENG, Cong Zhou
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
Adapting Speech Language Model to Singing Voice Synthesis
Yiwen Zhao, Jiatong Shi, Jinchuan Tian, Yuxun Tang, Jiarui Hai, Jionghao Han, Shinji Watanabe
- AI4Music
- Readers: Everyone
OpusLM: A Family of Open Unified Speech Language Models
Jinchuan Tian, William Chen, Yifan Peng, Jiatong Shi, Siddhant Arora, Shikhar Bharadwaj, Takashi Maekaku, Yusuke Shinohara, Keita Goto, Xiang Yue, Chao-Han Huck Yang, Shinji Watanabe
- SpeechAI TTIC 2025 OralorPoster
- Readers: Everyone
Chain-of-Thought Training for Open E2E Spoken Dialogue Systems
Siddhant Arora, Jinchuan Tian, Hayato Futami, Jee-weon Jung, Jiatong Shi, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
- SpeechAI TTIC 2025 OralorPoster
- Readers: Everyone
VERSA-v2: A Modular and Scalable Toolkit for Speech and Audio Evaluation with Expanded Metrics, Visualization, and LLM Integration
Jiatong Shi, Bo-Hao Su, Shikhar Bharadwaj, Yiwen Zhao, Shih-Heng Wang, Jionghao Han, Haoran Wang, Wei Wang, Wenhao Feng, Yuxun Tang, Siddhant Arora, Jinchuan Tian, William Chen, Hye-jin Shim, Wangyou Zhang, Wen-Chin Huang, Shinji Watanabe
- SpeechAI TTIC 2025 OralorPoster
- Readers: Everyone
Discrete Audio Tokens: More Than a Survey!
Pooneh Mousavi, Gallil Maimon, Adel Moumen, Darius Petermann, Jiatong Shi, Haibin Wu, Haici Yang, Anastasia Kuznetsova, Artem Ploujnikov, Ricard Marxer, Bhuvana Ramabhadran, Benjamin Elizalde, Loren Lugosch, Jinyu Li, Cem Subakan, Phil Woodland, Minje Kim, Hung-yi Lee, Shinji Watanabe, Yossi Adi et al. (1 additional authors not shown)
- Accepted by TMLR
- Readers: Everyone
ARECHO: Autoregressive Evaluation via Chain-Based Hypothesis Optimization for Speech Multi-Metric Estimation
Jiatong Shi, Yifan Cheng, Bo-Hao Su, Hye-jin Shim, Jinchuan Tian, Samuele Cornell, Yiwen Zhao, Siddhant Arora, Shinji Watanabe
- NeurIPS 2025 spotlight
- Readers: Everyone

View all 16 publications

Co-Authors

View all 156 co-authors