Peng Liang

Joined

October 2023

Names

Peng Liang (Preferred)

Emails

****@nudt.edu.cn (Confirmed)

Personal Links

DBLP

ORCID

Career & Education History

PhD student

PDL, National University of Defense Technology (nudt.edu.cn)

2019 – 2025

Undergrad student

National University of Defense Technology (nudt.edu.cn)

2015 – 2019

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

Memory-efficient tensor parallelism for long-sequence Transformer training
Peng Liang, Linbo Qiao, Yanqi Shi, Hao Zheng, Yu Tang, Dongsheng Li
- Frontiers Inf. Technol. Electron. Eng. 2025
- Readers: Everyone
Training large-scale language models with limited GPU memory: a survey
Yu Tang, Linbo Qiao, Lujia Yin, Peng Liang, Ao Shen, Zhilin Yang, Lizhi Zhang, Dongsheng Li
- Frontiers Inf. Technol. Electron. Eng. 2025
- Readers: Everyone
Automatic parallelism strategy generation with minimal memory redundancy
Yanqi Shi, Peng Liang, Hao Zheng, Linbo Qiao, Dongsheng Li
- Frontiers Inf. Technol. Electron. Eng. 2025
- Readers: Everyone
3D Parallelism for Transformers via Integer Programming
Hao Zheng, Peng Liang, Yu Tang, Yanqi Shi, Linbo Qiao, Dongsheng Li
- ICASSP 2024
- Readers: Everyone
A Survey on Auto-Parallelism of Large-Scale Deep Learning Training
Peng Liang, Yu Tang, Xiaoda Zhang, Youhui Bai, Teng Su, Zhiquan Lai, Linbo Qiao, Dongsheng Li
- IEEE Trans. Parallel Distributed Syst. 2023
- Readers: Everyone
TAPS: Topology-Aware Intra-Operator Parallelism Strategy Searching Algorithm for Deep Neural Networks
Peng Liang, Hao Zheng, Teng Su, Linbo Qiao, Dongsheng Li
- Published: 01 Jan 2023, Last Modified: 16 May 2023
- CoRR 2023
- Readers: Everyone
HPH: Hybrid Parallelism on Heterogeneous Clusters for Accelerating Large-scale DNNs Training
Yabo Duan, Zhiquan Lai, Shengwei Li, Weijie Liu, Keshi Ge, Peng Liang, Dongsheng Li
- 2022 (modified: 05 Nov 2022)
- CLUSTER 2022
- Readers: Everyone

Peng Liang

Names

Emails

Personal Links

Career & Education History

Advisors, Relations & Conflicts

Expertise

Publications

Memory-efficient tensor parallelism for long-sequence Transformer training

Training large-scale language models with limited GPU memory: a survey

Automatic parallelism strategy generation with minimal memory redundancy

3D Parallelism for Transformers via Integer Programming

A Survey on Auto-Parallelism of Large-Scale Deep Learning Training

TAPS: Topology-Aware Intra-Operator Parallelism Strategy Searching Algorithm for Deep Neural Networks

HPH: Hybrid Parallelism on Heterogeneous Clusters for Accelerating Large-scale DNNs Training

Co-Authors