ICML 2025 Workshop LCFM Submissions

Dynamic Causal‐Graph Memory: Structured Retrieval for Million–Token Reasoning
Thomas Y Chen
- Published: 10 Jun 2025, Last Modified: 21 Jun 2025
- LCFM 2025
- Readers: Everyone
Unable to Forget: Proactive Interference Reveals Working Memory Limits in LLMs Beyond Context Length
Chupei Wang, Jiaqiu Vince Sun
- Published: 10 Jun 2025, Last Modified: 28 Jun 2025
- LCFM 2025
- Readers: Everyone
Improving Context Fidelity via Native Retrieval-Augmented Reasoning
Suyuchen Wang, Jinlin Wang, Xinyu Wang, Shiqi Li, Xiangru Tang, Sirui Hong, Xiao-Wen Chang, Chenglin Wu, Bang Liu
- Published: 10 Jun 2025, Last Modified: 10 Jun 2025
- LCFM 2025
- Readers: Everyone
Language Modeling with Learned Meta-Tokens
Alok Shah, Khush Gupta, Keshav Ramji, Pratik Chaudhari
- Published: 10 Jun 2025, Last Modified: 28 Jun 2025
- LCFM 2025
- Readers: Everyone
BSA: Ball Sparse Attention for Large-scale Geometries
Cătălin-Emanuel Brița, Hieu Nguyen, Lohithsai Yadala Chanchu, Domonkos Nagy, Maksim Zhdanov
- Published: 10 Jun 2025, Last Modified: 24 Jun 2025
- LCFM 2025
- Readers: Everyone
OracleKV: Oracle Guidance for Question-Independent KV Cache Eviction
Yuanbing Zhu, Zhenheng Tang, Xiang Liu, Ang Li, Bo Li, Xiaowen Chu, Bo Han
- Published: 10 Jun 2025, Last Modified: 25 Jun 2025
- LCFM 2025
- Readers: Everyone
Accelerated Inference with Long-Sequence Transformers on CPUs
Yuzhen Mao, Martin Ester, Ke Li
- Published: 10 Jun 2025, Last Modified: 02 Jul 2025
- LCFM 2025
- Readers: Everyone
CalibQuant: 1-Bit KV Cache Quantization for Multimodal LLMs
Insu Han, Zeliang Zhang, Zhiyuan Wang, Yifan Zhu, Susan Liang, Jiani Liu, Haiting Lin, Mingjie Zhao, Chenliang Xu, Kun Wan, Wentian Zhao
- Published: 10 Jun 2025, Last Modified: 28 Jun 2025
- LCFM 2025
- Readers: Everyone
Kinetics: Rethinking Test-Time Scaling Laws
Ranajoy Sadhukhan, Zhuoming Chen, Haizhong Zheng, Yang Zhou, Emma Strubell, Beidi Chen
- Published: 10 Jun 2025, Last Modified: 10 Jun 2025
- LCFM 2025
- Readers: Everyone
GSM-Infinite: How Do your LLMs Behave over Infinitely Increasing Reasoning Complexity and Context Length?
Yang Zhou, Hongyi Liu, Zhuoming Chen, Yuandong Tian, Beidi Chen
- Published: 10 Jun 2025, Last Modified: 28 Jun 2025
- LCFM 2025
- Readers: Everyone
Foreign Sparse Attention: Effective Distillation into Sparse Attention
Vijaykaarti Sundarapandiyan, Tom Goldstein, Ashwinee Panda
- Published: 10 Jun 2025, Last Modified: 28 Jun 2025
- LCFM 2025
- Readers: Everyone
e3: Learning to Explore Enables Extrapolation of Test-Time Compute for LLMs
Amrith Setlur, Matthew Y. R. Yang, Charlie Victor Snell, Jeremiah Greer, Ian Wu, Virginia Smith, Max Simchowitz, Aviral Kumar
- Published: 10 Jun 2025, Last Modified: 20 Jun 2025
- LCFM 2025
- Readers: Everyone
Multiscale Byte Language Models -- A Hierarchical Architecture for Causal Million-Length Sequence Modeling
Eric Egli, Matteo Manica, Jannis Born
- Published: 10 Jun 2025, Last Modified: 23 Jun 2025
- LCFM 2025
- Readers: Everyone
Enhancing Retrieval-Augmented Generation with Dehallucinating Parallel Context Extension
Zexiong Ma, Shengnan An, Zeqi Lin, Yanzhen Zou, Jian-Guang Lou, Bing Xie
- Published: 10 Jun 2025, Last Modified: 24 Jun 2025
- LCFM 2025
- Readers: Everyone
Looking beyond the next token
Abitha Thankaraj, Yiding Jiang, J Zico Kolter, Yonatan Bisk
- Published: 10 Jun 2025, Last Modified: 10 Jun 2025
- LCFM 2025
- Readers: Everyone
Making Small Language Models Efficient Reasoners: Intervention, Supervision, Reinforcement
Xuechen Zhang, Zijian Huang, Chenshun Ni, Ziyang Xiong, Jiasi Chen, Samet Oymak
- Published: 10 Jun 2025, Last Modified: 27 Jun 2025
- LCFM 2025
- Readers: Everyone
Jailbreaking in the Haystack
Rishi Rajesh Shah, Chen Henry Wu, Ziqian Zhong, Alexander Robey, Aditi Raghunathan
- Published: 10 Jun 2025, Last Modified: 24 Jun 2025
- LCFM 2025
- Readers: Everyone
Simple, Scalable Reasoning via Iterated Summarization
Vivek Vajipey, Aditya Tadimeti, Justin Shen, Ben Prystawski, Michael Y. Li, Noah Goodman
- Published: 10 Jun 2025, Last Modified: 28 Jun 2025
- LCFM 2025
- Readers: Everyone
SWAN-GPT: An Efficient and Scalable Approach for Long-Context Language Modeling
Krishna C Puvvada, Faisal Ladhak, Santiago Akle Serano, Cheng-Ping Hsieh, Shantanu Acharya, Somshubra Majumdar, Fei Jia, Samuel Kriman, Simeng Sun, Dima Rekesh, Boris Ginsburg
- Published: 10 Jun 2025, Last Modified: 28 Jun 2025
- LCFM 2025
- Readers: Everyone
Towards Understanding Self-Pretraining for Sequence Classification
Omar Coser, Antonio Orvieto
- Published: 10 Jun 2025, Last Modified: 27 Jun 2025
- LCFM 2025
- Readers: Everyone
Scaling Laws for Many-Shot In-Context Learning with Self-Generated Annotations
Zhengyao Gu, Henry Peng Zou, Aiwei Liu, Yankai Chen, Weizhi Zhang, Philip S. Yu
- Published: 10 Jun 2025, Last Modified: 10 Jun 2025
- LCFM 2025
- Readers: Everyone
NovelHopQA: Diagnosing Multi-Hop Reasoning Failures in Long Narrative Contexts
Abhay Gupta, Kevin Zhu, Vasu Sharma, Sean O'Brien, Michael Lu
- Published: 10 Jun 2025, Last Modified: 21 Jun 2025
- LCFM 2025
- Readers: Everyone
MMLongBench: Benchmarking Long-Context Vision-Language Models Effectively and Thoroughly
Zhaowei Wang, Wenhao Yu, Xiyu REN, Jipeng Zhang, Yu Zhao, Rohit Saxena, Liang Cheng, Ginny Wong, Simon See, Pasquale Minervini, Yangqiu Song, Mark Steedman
- Published: 10 Jun 2025, Last Modified: 20 Jun 2025
- LCFM 2025
- Readers: Everyone
ALCo-FM: Adaptive Long-Context Foundation Model for Accident Prediction
Pinaki Prasad Guha Neogi, Ahmad Mohammadshirazi, Rajiv Ramnath
- Published: 10 Jun 2025, Last Modified: 27 Jun 2025
- LCFM 2025
- Readers: Everyone
How Much Context Does Natural Language Actually Require? An Analysis Using LLMs as Statistical Oracles
Vala Vakilian, Sadegh Mahdavi, Christos Thrampoulidis
- Published: 10 Jun 2025, Last Modified: 26 Jun 2025
- LCFM 2025
- Readers: Everyone