Kai Lv

PhD student, Fudan University

Joined

May 2022

Names

Kai Lv (Preferred)

Emails

****@m.fudan.edu.cn (Confirmed)

****@qq.com (Confirmed)

Personal Links

Career & Education History

PhD student

Fudan University (fudan.edu.cn)

2021 – 2026

Undergrad student

Fudan University (fudan.edu.cn)

2017 – 2021

Advisors, Relations & Conflicts

PhD Advisor

Xipeng Qiu

2021 – 2026

Expertise

No areas of expertise listed

Publications

Explicit Multi-head Attention for Inter-head Interaction in Large Language Models
Runyu Peng, Yunhua Zhou, Demin Song, Kai Lv, Bo Wang, Qipeng Guo, Xipeng Qiu
- ICLR 2026 Conference Desk Rejected Submission
- Readers: Everyone
Full Parameter Fine-tuning for Large Language Models with Limited Resources
Kai Lv, Yuqing Yang, Tengxiao Liu, Qipeng Guo, Xipeng Qiu
- ACL
- Readers: Everyone
ReAttention: Training-Free Infinite Context with Finite Attention Scope
Xiaoran Liu, Ruixiao Li, Zhigeng Liu, Qipeng Guo, Yuerong Song, Kai Lv, Hang Yan, Linlin Li, Qun Liu, Xipeng Qiu
- ICLR 2025 Poster
- Readers: Everyone
Full Parameter Fine-tuning for Large Language Models with Limited Resources
Kai Lv, Yuqing Yang, Tengxiao Liu, Qipeng Guo, Xipeng Qiu
- ACL (1) 2024
- Readers: Everyone
InternLM2 Technical Report
Zheng Cai, Maosong Cao, Haojiong Chen, Kai Chen, Keyu Chen, Xin Chen, Xun Chen, Zehui Chen, Zhi Chen, Pei Chu, Xiaoyi Dong, Haodong Duan, Qi Fan, Zhaoye Fei, Yang Gao, Jiaye Ge, Chenya Gu, Yuzhe Gu, Tao Gui, Aijia Guo et al. (51 additional authors not shown)
- CoRR 2024
- Readers: Everyone
LongWanjuan: Towards Systematic Measurement for Long Text Quality
Xiaoran Liu, Kai Lv, Qipeng Guo, Hang Yan, Conghui He, Xipeng Qiu, Dahua Lin
- EMNLP (Findings) 2024
- Readers: Everyone
Farewell to Length Extrapolation, a Training-Free Infinite Context with Finite Attention Scope
Xiaoran Liu, Qipeng Guo, Yuerong Song, Zhigeng Liu, Kai Lv, Hang Yan, Linlin Li, Qun Liu, Xipeng Qiu
- CoRR 2024
- Readers: Everyone
AdaLomo: Low-memory Optimization with Adaptive Learning Rate
Kai Lv, Hang Yan, Qipeng Guo, Haijun Lv, Xipeng Qiu
- ACL (Findings) 2024
- Readers: Everyone
LongWanjuan: Towards Systematic Measurement for Long Text Quality
Kai Lv, Xiaoran Liu, Qipeng Guo, Hang Yan, Conghui He, Xipeng Qiu, Dahua Lin
- CoRR 2024
- Readers: Everyone
AdaLomo: Low-memory Optimization with Adaptive Learning Rate
Kai Lv, Hang Yan, Qipeng Guo, Haijun Lv, Xipeng Qiu
- ICLR 2024 Conference Withdrawn Submission
- Readers: Everyone

View all 19 publications

Co-Authors

View all 98 co-authors