LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Open Webpage

Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang

Published: 01 Jan 2024, Last Modified: 14 May 2025ICML 2024EveryoneRevisionsBibTeXCC BY-SA 4.0