Tianqi Wu

MS student, Tsinghua University

Joined

September 2023

Names

Tianqi Wu (Preferred)

Emails

****@qq.com (Confirmed)

Personal Links

Career & Education History

MS student

Tsinghua University (tsinghua.edu.cn)

2024 – 2027

Intern

Infinigence (infini-ai.com)

2023 – 2025

Undergrad student

Tsinghua University, Tsinghua University (tsinghua.edu.cn)

2020 – 2024

Advisors, Relations & Conflicts

Coauthor

2023 – 2027

Expertise

No areas of expertise listed

Publications

Mixture of Attention Spans: Optimizing LLM Inference Efficiency with Heterogeneous Sliding-Window Lengths
Tianyu Fu, Haofeng Huang, Xuefei Ning, Genghan Zhang, Boju Chen, Tianqi Wu, Hongyi Wang, Zixiao Huang, Shiyao Li, Shengen Yan, Guohao Dai, Huazhong Yang, Yu Wang
- COLM 2025
- Readers: Everyone
MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression
Tianyu Fu, Haofeng Huang, Xuefei Ning, Genghan Zhang, Boju Chen, Tianqi Wu, Hongyi Wang, Zixiao Huang, Shiyao Li, Shengen Yan, Guohao Dai, Huazhong Yang, Yu Wang
- ICLR 2025 FM-Wild Workshop
- Readers: Everyone
MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression
Tianyu Fu, Haofeng Huang, Xuefei Ning, Genghan Zhang, Boju Chen, Tianqi Wu, Hongyi Wang, Zixiao Huang, Shiyao Li, Shengen Yan, Guohao Dai, Huazhong Yang, Yu Wang
- Submitted to ICLR 2025
- Readers: Everyone
SemSA: Semantic Sparse Attention is hidden in Large Language Models.
Tianyu Fu, Xuefei Ning, Boju Chen, Tianqi Wu, Genghan Zhang, Guohao Dai, Huazhong Yang, Yu Wang
- ICLR 2024 Conference Withdrawn Submission
- Readers: Everyone

Co-Authors