Tianyi Zhang

Researcher, Together AI

Joined

June 2022

Names

Tianyi Zhang (Preferred)

Emails

****@rice.edu (Confirmed)

****@workato.com (Confirmed)

****@together.ai (Confirmed)

****@gmail.com (Confirmed)

Personal Links

Career & Education History

Researcher

Together AI (together.ai)

2026 – Present

PhD student

Rice University (rice.edu)

2021 – 2025

Undergrad student

University of Waterloo (uwaterloo.ca)

2016 – 2021

Advisors, Relations & Conflicts

PhD Advisor

Anshumali Shrivastava

2021 – 2026

Expertise

Model Compression

2024 – 2026

Large Language Models

2023 – 2026

Efficient Machine Learning

2021 – 2026

Publications

NyoomFloat12: Lossless 12-bit Weight Compression for Post-Training Inference
Sylvie Liberman, Tianyi Zhang, Daniel Y Fu
- SPOT
- Readers: Everyone
To Compress or Not? Pushing the Frontier of Lossless GenAI Model Weights Compression with Exponent Concentration
Zeyu Yang, Tianyi Zhang, Jianwen Xie, Chuan Li, Zhaozhuo Xu, Anshumali Shrivastava
- ICLR 2026 Poster
- Readers: Everyone
Breaking the Frozen Subspace: Importance Sampling for Low-Rank Optimization in LLM Pretraining
Haochen Zhang, Junze Yin, Guanchu Wang, Zirui Liu, Lin Yang, Tianyi Zhang, Anshumali Shrivastava, Vladimir Braverman
- NeurIPS 2025 poster
- Readers: Everyone
70% Size, 100% Accuracy: Lossless LLM Compression for Efficient GPU Inference via Dynamic-Length Float (DFloat11)
Tianyi Zhang, Mohsen Hariri, Shaochen Zhong, Vipin Chaudhary, Yang Sui, Xia Hu, Anshumali Shrivastava
- NeurIPS 2025 poster
- Readers: Everyone
Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models
Yang Sui, Yu-Neng Chuang, Guanchu Wang, Jiamu Zhang, Tianyi Zhang, Jiayi Yuan, Hongyi Liu, Andrew Wen, Shaochen Zhong, Na Zou, Hanjie Chen, Xia Hu
- Accepted by TMLR
- Readers: Everyone
Sketch to Adapt: Fine-Tunable Sketches for Efficient LLM Adaptation
Tianyi Zhang, Junda Su, Aditya Desai, Oscar Wu, Zhaozhuo Xu, Anshumali Shrivastava
- ICML 2025 poster
- Readers: Everyone
LeanQuant: Accurate and Scalable Large Language Model Quantization with Loss-error-aware Grid
Tianyi Zhang, Anshumali Shrivastava
- ICLR 2025 Poster
- Readers: Everyone
SpaLLM: Unified Compressive Adaptation of Large Language Models with Sketching
Tianyi Zhang, Junda Su, Oscar Wu, Zhaozhuo Xu, Anshumali Shrivastava
- Submitted to ICLR 2025
- Readers: Everyone
NoMAD-Attention: Efficient LLM Inference on CPUs Through Multiply-add-free Attention
Tianyi Zhang, Jonah Wonkyu Yi, Bowen Yao, Zhaozhuo Xu, Anshumali Shrivastava
- NeurIPS 2024 poster
- Readers: Everyone
KV Cache is 1 Bit Per Channel: Efficient Large Language Model Inference with Coupled Quantization
Tianyi Zhang, Jonah Wonkyu Yi, Zhaozhuo Xu, Anshumali Shrivastava
- NeurIPS 2024 poster
- Readers: Everyone

View all 16 publications

Co-Authors

View all 38 co-authors