Zixin Wen

PhD student, Carnegie Mellon University

Joined

January 2021

Names

Zixin Wen (Preferred)

Emails

****@icloud.com (Confirmed)

****@andrew.cmu.edu (Confirmed)

Personal Links

DBLP

Career & Education History

PhD student

Carnegie Mellon University (cmu.edu)

2021 – Present

Advisors, Relations & Conflicts

PhD Advisor

Yuanzhi Li

Present

PhD Advisor

Yuejie Chi

Present

PhD Advisor

Aarti Singh

Present

Expertise

Deep Learning Theory

Present

Efficient Language Models

Present

Publications

Transformers Provably Learn Chain-of-Thought Reasoning with Length Generalization
Yu Huang, Zixin Wen, Aarti Singh, Yuejie Chi, Yuxin Chen
- NeurIPS 2025 poster
- Readers: Everyone
Faster WIND: Accelerating Iterative Best-of-$N$ Distillation for LLM Alignment
Tong Yang, Jincheng Mei, Hanjun Dai, Zixin Wen, Shicong Cen, Dale Schuurmans, Yuejie Chi, Bo Dai
- AISTATS 2025 Poster
- Readers: Everyone
Feynman: Knowledge-Infused Diagramming Agent for Scaling Visual Reasoning Data
Zixin Wen, Yifu Cai, Kyle Lee, Sam Estep, Joshua Sunshine, Aarti Singh, Yuejie Chi, Wode Ni
- Submitted to ICLR 2025
- Readers: Everyone
A Theoretical Analysis of Self-Supervised Learning for Vision Transformers
Yu Huang, Zixin Wen, Yuejie Chi, Yingbin Liang
- ICLR 2025 Poster
- Readers: Everyone
How Transformers Learn Diverse Attention Correlations in Masked Vision Pretraining
Yu Huang, Zixin Wen, Yuejie Chi, Yingbin Liang
- TF2M 2024 Poster
- Readers: Everyone
What Matters In The Structured Pruning of Generative Language Models?
Michael Santacroce, Zixin Wen, yelong shen, Weizhu Chen, Yuanzhi Li
- Published: 01 Feb 2023, Last Modified: 14 Jan 2026
- Submitted to ICLR 2023
- Readers: Everyone
On the Necessity of Disentangled Representations for Downstream Tasks
Ruiqian Nai, Zixin Wen, Ji Li, Yuanzhi Li, Yang Gao
- Published: 01 Feb 2023, Last Modified: 13 Feb 2023
- Submitted to ICLR 2023
- Readers: Everyone
The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning
Zixin Wen, Yuanzhi Li
- Published: 31 Oct 2022, Last Modified: 15 Jan 2023
- NeurIPS 2022 Accept
- Readers: Everyone
Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning
Zixin Wen, Yuanzhi Li
- 2021 (modified: 02 Nov 2022)
- CoRR 2021
- Readers: Everyone

Zixin Wen

Names

Emails

Personal Links

Career & Education History

Advisors, Relations & Conflicts

Expertise

Publications

Co-Authors