OpenReview
.net
OpenReview
.net
Login
OpenReview
.net
Login
Bo Zhu
Joined
September 2024
Names
Bo Zhu
(Preferred)
,
Bo.zhu
Emails
****@gmail.com
(Confirmed)
,
****@singularity-ai.com
(Confirmed)
Personal Links
Homepage
Career & Education History
Researcher
Institute Of 2050 Kunlun Tiangong,
Kunlun Tiangong Singularity AI
(singularity-ai.com)
2021
–
2024
Instructor
ee,
Harbin Institute of Technology
(hit.edu.cn)
2012
–
2016
Advisors, Relations & Conflicts
No relations added
Expertise
No areas of expertise listed
Publications
MoH: Multi-Head Attention as Mixture-of-Head Attention
Peng Jin
,
Bo Zhu
,
Li Yuan
,
Shuicheng YAN
ICML 2025 poster
Readers:
Everyone
MOEfication by Experts as Masks
Peiyu Liu
,
Tianwen Wei
,
Bo Zhu
,
Xin Zhao
,
Shuicheng YAN
ICLR 2025 Conference Withdrawn Submission
Readers:
Everyone
MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts
Peng Jin
,
Bo Zhu
,
Li Yuan
,
Shuicheng YAN
ICLR 2025 Oral
Readers:
Everyone
MoH: Multi-Head Attention as Mixture-of-Head Attention
Peng Jin
,
Bo Zhu
,
Li Yuan
,
Shuicheng YAN
Submitted to ICLR 2025
Readers:
Everyone
Co-Authors
Li Yuan
Peiyu Liu
Peng Jin
Shuicheng YAN
Tianwen Wei
Xin Zhao