Zhijian Zhuo

Researcher, ByteDance Inc.

Joined

September 2022

Names

Zhijian Zhuo (Preferred)

Emails

****@stu.pku.edu.cn (Confirmed)

****@gmail.com (Confirmed)

****@bytedance.com (Confirmed)

Personal Links

Homepage

DBLP

ORCID

Career & Education History

Researcher

ByteDance Inc. (bytedance.com)

2025 – Present

PhD student

Peking University (pku.edu.cn)

2020 – 2025

Advisors, Relations & Conflicts

PhD Advisor

Jinwen Ma

2020 – 2025

Expertise

Self-Supervised Learning

Present

Large Language Models

Present

Pre-training

Present

Publications

Scale-Distribution Decoupling: Enabling Stable and Effective Training of Large Language Models
Ya Wang, Yutao Zeng, Zhijian Zhuo, Jian Yang, zhou Xun, Xiaoqing Li
- Submitted to ICLR 2026
- Readers: Everyone
HybridNorm: Towards Stable and Efficient Transformer Training via Hybrid Normalization
Zhijian Zhuo, Yutao Zeng, Ya Wang, Sijun Zhang, Xiaoqing Li, Jian Yang, zhou Xun, Jinwen Ma
- NeurIPS 2025 poster
- Readers: Everyone
HybridNorm: Towards Stable and Efficient Transformer Training via Hybrid Normalization
Zhijian Zhuo, Yutao Zeng, Ya Wang, Sijun Zhang, Jian Yang, Xiaoqing Li, Xun Zhou, Jinwen Ma
- CoRR 2025
- Readers: Everyone
Scale-Distribution Decoupling: Enabling Stable and Effective Training of Large Language Models
Ya Wang, Zhijian Zhuo, Yutao Zeng, Xun Zhou, Jian Yang, Xiaoqing Li
- CoRR 2025
- Readers: Everyone
Polynomial Composition Activations: Unleashing the Dynamics of Large Language Models
Zhijian Zhuo, Ya Wang, Yutao Zeng, Xiaoqing Li, Xun Zhou, Jinwen Ma
- ICLR 2025
- Readers: Everyone
Polynomial Composition Activations: Unleashing the Dynamics of Large Language Models
Zhijian Zhuo, Ya Wang, Yutao Zeng, Xiaoqing Li, Xun Zhou, Jinwen Ma
- ICLR 2025 Poster
- Readers: Everyone
Graph Neural Networks (with Proper Weights) Can Escape Oversmoothing
Zhijian Zhuo, Yifei Wang, Jinwen Ma, Yisen Wang
- ACML 2024 Conference Track
- Readers: Everyone
Graph Neural Networks (with Proper Weights) Can Escape Oversmoothing
Zhijian Zhuo, Yifei Wang, Jinwen Ma, Yisen Wang
- ACML 2024
- Readers: Everyone
Towards a Unified Theoretical Understanding of Non-contrastive Learning via Rank Differential Mechanism
Zhijian Zhuo, Yifei Wang, Jinwen Ma, Yisen Wang
- Published: 01 Jan 2023, Last Modified: 15 Nov 2023
- ICLR 2023
- Readers: Everyone

View all 12 publications

Zhijian Zhuo

Names

Emails

Personal Links

Career & Education History

Advisors, Relations & Conflicts

Expertise

Publications

Co-Authors