Kuntai Du

Chief Scientist, Tensormesh, Inc.

Joined

September 2024

Names

Kuntai Du (Preferred)

Emails

****@uchicago.edu (Confirmed)

****@gmail.com (Confirmed)

Personal Links

Career & Education History

Chief Scientist

Tensormesh, Inc. (tensormesh.ai)

2025 – 2026

PhD student

Computer Science, University of Chicago (uchicago.edu)

2019 – 2025

Undergrad student

Computer Intelligence Science, Peking University (pku.edu.cn)

2015 – 2019

Advisors, Relations & Conflicts

PhD Advisor

Junchen Jiang

2019 – 2025

Expertise

No areas of expertise listed

Publications

PrefillOnly: An Inference Engine for Prefill-only Workloads in Large Language Model Applications
Kuntai Du, Bowen Wang, Chen Zhang, Yiming Cheng, Qing Lan, Hejian Sang, Yihua Cheng, Jiayi Yao, Xiaoxuan Liu, Yifan Qiao, Ion Stoica, Junchen Jiang
- CoRR 2025
- Readers: Everyone
Towards More Economical Context-Augmented LLM Generation by Reusing Stored KV Cache
Hanchen Li, Yuhan Liu, Yihua Cheng, Kuntai Du, Junchen Jiang
- CoRR 2025
- Readers: Everyone
Jenga: Effective Memory Management for Serving LLM with Heterogeneity
Chen Zhang, Kuntai Du, Shu Liu, Woosuk Kwon, Xiangxi Mo, Yufeng Wang, Xiaoxuan Liu, Kaichao You, Zhuohan Li, Mingsheng Long, Jidong Zhai, Joseph Gonzalez, Ion Stoica
- CoRR 2025
- Readers: Everyone
CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion
Jiayi Yao, Hanchen Li, Yuhan Liu, Siddhant Ray, Yihua Cheng, Qizheng Zhang, Kuntai Du, Shan Lu, Junchen Jiang
- EuroSys 2025
- Readers: Everyone
Earth+: On-Board Satellite Imagery Compression Leveraging Historical Earth Observations
Kuntai Du, Yihua Cheng, Peder A. Olsen, Shadi A. Noghabi, Junchen Jiang
- ASPLOS (1) 2025
- Readers: Everyone
Do Large Language Models Need a Content Delivery Network?
Yihua Cheng, Kuntai Du, Jiayi Yao, Junchen Jiang
- CoRR 2024
- Readers: Everyone
LLMSteer: Improving Long-Context LLM Inference by Steering Attention on Reused Contexts
Zhuohan Gu, Jiayi Yao, Kuntai Du, Junchen Jiang
- CoRR 2024
- Readers: Everyone
Eloquent: A More Robust Transmission Scheme for LLM Token Streaming
Hanchen Li, Yuhan Liu, Yihua Cheng, Siddhant Ray, Kuntai Du, Junchen Jiang
- NAIC 2024
- Readers: Everyone
GRACE: Loss-Resilient Real-Time Video through Neural Codecs
Yihua Cheng, Ziyi Zhang, Hanchen Li, Anton Arapin, Yue Zhang, Qizheng Zhang, Yuhan Liu, Kuntai Du, Xu Zhang, Francis Y. Yan, Amrita Mazumdar, Nick Feamster, Junchen Jiang
- NSDI 2024
- Readers: Everyone
CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving
Yuhan Liu, Hanchen Li, Yihua Cheng, Siddhant Ray, Yuyang Huang, Qizheng Zhang, Kuntai Du, Jiayi Yao, Shan Lu, Ganesh Ananthanarayanan, Michael Maire, Henry Hoffmann, Ari Holtzman, Junchen Jiang
- SIGCOMM 2024
- Readers: Everyone

View all 26 publications

Co-Authors

View all 60 co-authors