Jianqiao Lu

Joined

June 2023

Names

Jianqiao Lu (Preferred)

Emails

****@cs.hku.hk (Confirmed)

****@gmail.com

Personal Links

Career & Education History

PhD student

University of Hong Kong (hku.hk)

2020 – 2025

Undergrad student

Tongji University (tongji.edu.cn)

2015 – 2020

Advisors, Relations & Conflicts

PhD Advisor

Zhiyi Huang

2020 – 2024

Expertise

Large Language Models

2023 – Present

Online Matching Algorithm

2020 – Present

Speech and Multimodality

2022 – 2023

Publications

FlexLinearAttention: Compiling a Unified Abstraction into Scalable Kernels for Linear Attention
Haojie Duanmu, Size Zheng, Ningxin Zheng, Jianqiao Lu, Xuegui Zheng, Xingcheng Zhang, Li-Wen Chang, Xin Liu, Dahua Lin
- ICLR 2026 Poster
- Readers: Everyone
HSA: Head-wise Sparse Attention for Efficient and Accurate Long-context Inference
Jing Liu, Jianqiao Lu, Yao Luo, Yuan Yang, Chen Zheng, Deyi Liu, Mengzhao Chen, Chaoyi Zhang, Yunshui Li, Jin Ma, Yutao Zeng, Ya Wang, Hongmin chen, Ziqiang Pei, Fan Xia, Tianqi Zhang, Xiaoying Jia, Yiyuan Ma, Siyuan Qiao
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
Enhancing linear attention with residual learning
Xunhao Lai, Jialiang Kang, Jianqiao Lu, Tong Lin, Pengyu Zhao
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
DeltaFormer: Unlock the state space of Transformer
Mingyu Xu, Tenglong Ao, Jiaao He, Jianqiao Lu, Guang Shi, Shu Zhong
- NeurIPS 2025 poster
- Readers: Everyone
Model Merging in Pre-training of Large Language Models
Yunshui Li, Yiyuan Ma, Shen Yan, Chaoyi Zhang, Jing Liu, Jianqiao Lu, Ziwen Xu, Mengzhao Chen, Minrui Wang, Shiyi Zhan, Jin Ma, Xunhao Lai, Yao Luo, Xingyan Bin, Hongbin Ren, Mingji Han, Wenhao Hao, Bairen Yi, LingJun Liu, Bole Ma et al. (4 additional authors not shown)
- NeurIPS 2025 poster
- Readers: Everyone
UncertaintyRAG: Span Uncertainty Enhanced Long-Context Modeling for Retrieval-Augmented Generation
Zixuan Li, Jing Xiong, Fanghua Ye, Chuanyang Zheng, Xun Wu, Jianqiao Lu, Zhongwei Wan, Xiaodan Liang, Chengming Li, Zhenan Sun, Lingpeng Kong, Ngai Wong
- Submitted to ICLR 2025
- Readers: Everyone
UNComp: Uncertainty-Aware Long-context Compressor for Efficient Large Language Model Inference
Jing Xiong, Jianghan Shen, Fanghua Ye, Chaofan Tao, Zhongwei Wan, Jianqiao Lu, Xun Wu, Chuanyang Zheng, Zhijiang Guo, Lingpeng Kong, Ngai Wong
- Submitted to ICLR 2025
- Readers: Everyone
Scaling Laws For Mixed Quantization In Large Language Models
Zeyu Cao, Cheng Zhang, Pedro Gimenes, Jianqiao Lu, Jianyi Cheng, Yiren Zhao
- ICLR 2025 Conference Withdrawn Submission
- Readers: Everyone
MHPP: Exploring the Capabilities and Limitations of Language Models Beyond Basic Code Generation
Jianbo Dai, Jianqiao Lu, Yunlong Feng, Dong HUANG, Guangtao Zeng, Rongju Ruan, Ming Cheng, Haochen Tan, Zhijiang Guo
- Submitted to ICLR 2025
- Readers: Everyone
Process-Driven Autoformalization in Lean 4
Jianqiao Lu, Yingjia Wan, Zhengying Liu, Yinya Huang, Jing Xiong, Liu Chengwu, Jianhao Shen, Hui Jin, Jipeng Zhang, Haiming Wang, Zhicheng Yang, Jing Tang, Zhijiang Guo
- Submitted to ICLR 2025
- Readers: Everyone

View all 24 publications

Co-Authors

View all 131 co-authors