Mengshu Sun

Assistant Professor, School of Information Science and Technology, Beijing University of Technology

Joined

February 2020

Names

Mengshu Sun (Preferred)

Emails

****@husky.neu.edu (Confirmed)

****@northeastern.edu (Confirmed)

****@bjut.edu.cn (Confirmed)

Personal Links

Google Scholar

DBLP

ORCID

Career & Education History

Assistant Professor

School of Information Science and Technology, Beijing University of Technology (bjut.edu.cn)

2022 – Present

PhD student

Department of Electrical & Computer Engineering, Northeastern University (northeastern.edu)

2017 – 2022

Advisors, Relations & Conflicts

PhD Advisor

Xue Lin

2017 – 2022

Expertise

model compression and hardware acceleration

2017 – Present

Publications

HeatViT: Hardware-Efficient Adaptive Token Pruning for Vision Transformers
Peiyan Dong, Mengshu Sun, Alec Lu, Yanyue Xie, Kenneth Liu, Zhenglun Kong, Xin Meng, Zhengang Li, Xue Lin, Zhenman Fang, Yanzhi Wang
- 2023 (modified: 17 Apr 2023)
- HPCA 2023
- Readers: Everyone
Gaining the Sparse Rewards by Exploring Binary Lottery Tickets in Spiking Neural Network
Hao Cheng, Jiahang Cao, Erjia Xiao, Pu Zhao, Mengshu Sun, Jiaxu Wang, Jize Zhang, Xue Lin, Bhavya Kailkhura, Kaidi Xu, Renjing Xu
- Published: 01 Jan 2023, Last Modified: 04 Oct 2023
- CoRR 2023
- Readers: Everyone
Peeling the Onion: Hierarchical Reduction of Data Redundancy for Efficient Vision Transformer Training
Zhenglun Kong, Haoyu Ma, Geng Yuan, Mengshu Sun, Yanyue Xie, Peiyan Dong, Xin Meng, Xuan Shen, Hao Tang, Minghai Qin, Tianlong Chen, Xiaolong Ma, Xiaohui Xie, Zhangyang Wang, Yanzhi Wang
- Published: 01 Jan 2023, Last Modified: 05 Nov 2023
- AAAI 2023
- Readers: Everyone
ESRU: Extremely Low-Bit and Hardware-Efficient Stochastic Rounding Unit Design for Low-Bit DNN Training
Sung-En Chang, Geng Yuan, Alec Lu, Mengshu Sun, Yanyu Li, Xiaolong Ma, Zhengang Li, Yanyue Xie, Minghai Qin, Xue Lin, Zhenman Fang, Yanzhi Wang
- Published: 01 Jan 2023, Last Modified: 10 Nov 2023
- DATE 2023
- Readers: Everyone
Mobile or FPGA? A Comprehensive Evaluation on Energy Efficiency and a Unified Optimization Framework
Geng Yuan, Peiyan Dong, Mengshu Sun, Wei Niu, Zhengang Li, Yuxuan Cai, Yanyu Li, Jun Liu, Weiwen Jiang, Xue Lin, Bin Ren, Xulong Tang, Yanzhi Wang
- Sept 2022 (modified: 17 Apr 2023)
- ACM Trans. Embed. Comput. Syst. 2022
- Readers: Everyone
VAQF: Fully Automatic Software-hardware Co-design Framework for Low-bit Vision Transformer
Mengshu Sun, Haoyu Ma, Guoliang Kang, Yifan Jiang, Tianlong Chen, Xiaolong Ma, Zhangyang Wang, Yanzhi Wang
- 2022 (modified: 09 Nov 2022)
- CoRR 2022
- Readers: Everyone
FPGA-aware automatic acceleration framework for vision transformer with mixed-scheme quantization: late breaking results
Mengshu Sun, Zhengang Li, Alec Lu, Haoyu Ma, Geng Yuan, Yanyue Xie, Hao Tang, Yanyu Li, Miriam Leeser, Zhangyang Wang, Xue Lin, Zhenman Fang
- 2022 (modified: 18 Nov 2022)
- DAC 2022
- Readers: Everyone
FILM-QNN: Efficient FPGA Acceleration of Deep Neural Networks with Intra-Layer, Mixed-Precision Quantization
Mengshu Sun, Zhengang Li, Alec Lu, Yanyu Li, Sung-En Chang, Xiaolong Ma, Xue Lin, Zhenman Fang
- 2022 (modified: 18 Nov 2022)
- FPGA 2022
- Readers: Everyone
Auto-ViT-Acc: An FPGA-Aware Automatic Acceleration Framework for Vision Transformer with Mixed-Scheme Quantization
Zhengang Li, Mengshu Sun, Alec Lu, Haoyu Ma, Geng Yuan, Yanyue Xie, Hao Tang, Yanyu Li, Miriam Leeser, Zhangyang Wang, Xue Lin, Zhenman Fang
- 2022 (modified: 18 Nov 2022)
- CoRR 2022
- Readers: Everyone
SPViT: Enabling Faster Vision Transformers via Latency-Aware Soft Token Pruning
Zhenglun Kong, Peiyan Dong, Xiaolong Ma, Xin Meng, Wei Niu, Mengshu Sun, Xuan Shen, Geng Yuan, Bin Ren, Hao Tang, Minghai Qin, Yanzhi Wang
- 2022 (modified: 22 Nov 2022)
- ECCV (11) 2022
- Readers: Everyone

View all 37 publications

Co-Authors

View all 69 co-authors