ICML 2024 Workshop LCFM Submissions

FastDecode: High-Throughput LLM Serving through Disaggregating Attention Computation
Jiaao He, Kezhao Huang, Jidong Zhai
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
Stress-Testing Long-Context Language Models with Lifelong ICL and Task Haystack
Xiaoyue Xu, Qinyuan Ye, Xiang Ren
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
RepoQA: Evaluating Long Context Code Understanding
Jiawei Liu, Jia Le Tian, Vijay Daita, Yuxiang Wei, Yifeng Ding, Yuhan Katherine Wang, Jun Yang, LINGMING ZHANG
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
Probing the Decision Boundaries of In-context Learning in Large Language Models
Siyan Zhao, Tung Nguyen, Aditya Grover
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
Fine-Tuning Medical Language Models for Enhanced Long-Contextual Understanding and Domain Expertise
Qimin Yang, rongshengwang, CHEN JIEXIN, Runqi Su, Tao Tan
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
In-Context Learning with Long-Context Models: An In-Depth Exploration
Amanda Bertsch, Maor Ivgi, Uri Alon, Jonathan Berant, Matthew R. Gormley, Graham Neubig
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
Improved Algorithms for Kernel Matrix-Vector Multiplication
Piotr Indyk, Michael Kapralov, Kshiteej Sheth, Tal Wagner
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modeling
Yair Schiff, Chia Hsiang Kao, Aaron Gokaslan, Tri Dao, Albert Gu, Volodymyr Kuleshov
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
Learning to Reduce: Towards Improving Performance of Large Language Models on Structured Data
Younghun Lee, Sungchul Kim, Ryan A. Rossi, Tong Yu, Xiang Chen
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
PhaseEvo: Towards Unified Long-Context Prompt Optimization for Large Language Models
Wendi Cui, Jiaxin Zhang, Zhuohang Li, Hao Sun, Damien Lopez, Kamalika Das, Bradley A. Malin, Sricharan Kumar
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory
Chaojun Xiao, Pengle Zhang, Xu Han, Guangxuan Xiao, Yankai Lin, Zhengyan Zhang, Zhiyuan Liu, Maosong Sun
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
Many-Shot In-Context Learning
Rishabh Agarwal, Avi Singh, Lei M Zhang, Bernd Bohnet, Luis Rosias, Stephanie C.Y. Chan, Biao Zhang, Ankesh Anand, Zaheer Abbas, Azade Nova, John D Co-Reyes, Eric Chu, Feryal Behbahani, Aleksandra Faust, Hugo Larochelle
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
Spatio-Spectral Graph Neural Networks
Simon Geisler, Arthur Kosmala, Daniel Herbst, Stephan Günnemann
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
MSAMamba: Adapting Subquadratic Models To Long-Context DNA MSA Analysis
Vishrut Thoutam, Dina Ellsworth
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
Long Context Understanding using Self-Generated Synthetic Data
Jerry Li, Subhro Das, Aude Oliva, Dmitry Krotov, Leonid Karlinsky, Rogerio Feris
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
CAMELoT: Towards Large Language Models with Training-Free Consolidated Associative Memory
Zexue He, Leonid Karlinsky, Donghyun Kim, Julian McAuley, Dmitry Krotov, Rogerio Feris
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
Spectral State Space Models
Naman Agarwal, Daniel Suo, Xinyi Chen, Elad Hazan
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
xLSTM: Extended Long Short-Term Memory
Korbinian Pöppel, Maximilian Beck, Markus Spanring, Andreas Auer, Oleksandra Prudnikova, Michael K Kopp, Günter Klambauer, Johannes Brandstetter, Sepp Hochreiter
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
Vision-LSTM: xLSTM as Generic Vision Backbone
Benedikt Alkin, Maximilian Beck, Korbinian Pöppel, Sepp Hochreiter, Johannes Brandstetter
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
ELITR-Bench: A Meeting Assistant Benchmark for Long-Context Language Models
Thibaut Thonet, Jos Rozen, laurent besacier
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
Position Coupling: Leveraging Task Structure for Improved Length Generalization of Transformers
Hanseul Cho, Jaeyoung Cha, Pranjal Awasthi, Srinadh Bhojanapalli, Anupam Gupta, Chulhee Yun
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
Mitigate Position Bias in Large Language Models via Scaling a Single Dimension
Yijiong Yu, Huiqiang Jiang, Xufang Luo, Qianhui Wu, Chin-Yew Lin, Dongsheng Li, Yuqing Yang, Yongfeng Huang, Lili Qiu
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
Pretrained Hybrids with MAD Skills
Nicholas Roberts, Samuel Guo, Zhiqi Gao, Satya Sai Srinath Namburi GNVV, Sonia Cromp, Chengjun Wu, Chengyu Duan, Frederic Sala
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
Long-Context Vision Large Language Models: Empirical Insights and A Baseline
Yongshuo Zong, Ismail Elezi, Yongxin Yang, Jiankang Deng, Timothy Hospedales
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone
LongAlign: A Recipe for Long Context Alignment of Large Language Models
Yushi Bai, Xin Lv, Jiajie Zhang, Yuze He, Ji Qi, Lei Hou, Jie Tang, Yuxiao Dong, Juanzi Li
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- LCFM 2024
- Readers: Everyone