COLM 2025 Conference Submissions

Can a Crow Hatch a Falcon? Lineage Matters in Predicting Large Language Model Performance
Takuya Tamura, Taro Yano, Masafumi Enomoto, Masafumi Oyamada
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
E$^2$-RAG: Towards Editable Efficient RAG by Editing Compressed KV Caches
Tongxu Luo, Wenyu Du, HanWen Hao, Min Zhang, Hao Yang, Benyou Wang
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Fleurs-SLU: A Massively Multilingual Benchmark for Spoken Language Understanding
Fabian David Schmidt, Ivan Vulić, Goran Glavaš, David Ifeoluwa Adelani
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
NoWag: A Unified Framework for Shape Preserving Com- pression of Large Language Models
Lawrence Ray Liu, Inesh Chakrabarti, Yixiao Li, Mengdi Wang, Tuo Zhao, Lin Yang
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Evaluating Large Language Models as Expert Annotators
Yu-Min Tseng, Wei-Lin Chen, Chung-Chi Chen, Hsin-Hsi Chen
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Yourbench: Dynamic Evaluation Set Generation with LLMs
Sumuk Shashidhar, Clémentine Fourrier, Alina Lozovskaya, Thomas Wolf, Gokhan Tur, Dilek Hakkani-Tür
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
LawFlow: Collecting and Simulating Lawyers’ Thought Processes on Business Formation Case Studies
Debarati Das, Khanh Chi Le, Ritik Sachin Parkar, Karin De Langis, Brendan Madson, Chad M. Berryman, Robin M Willis, Daniel H Moses, Brett McDonnell, Daniel Schwarcz, Dongyeop Kang
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Traceable and Explainable Multimodal Large Language Models: An Information-Theoretic View
Zihan Huang, Junda Wu, Rohan Surana, Raghav Jain, Tong Yu, Raghavendra Addanki, David Arbour, Sungchul Kim, Julian McAuley
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Understanding and Improving Noisy Embedding Techniques in Instruction Finetuning
Abhay Yadav
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
REFA: Reference Free Alignment with Fine-Grained Length Control
Taneesh Gupta, Rahul Madhavan, Xuchao Zhang, Chetan Bansal, Saravan Rajmohan
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Hyperparameter Loss Surfaces Are Simple Near their Optima
Nicholas Lourie, He He, Kyunghyun Cho
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
From Next-Token to Mathematics: The Learning Dynamics of Mathematical Reasoning in Language Models
Shubhra Mishra, Gabriel Poesia, Noah Goodman
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
The Surprising Effectiveness of Membership Inference with Simple N-Gram Coverage
Skyler Hallinan, Jaehun Jung, Melanie Sclar, Ximing Lu, Abhilasha Ravichander, Sahana Ramnath, Yejin Choi, Sai Praneeth Karimireddy, Niloofar Mireshghallah, Xiang Ren
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Synthetic Data Generation and Multi-Step Reinforcement Learning for Reasoning and Tool Use
Anna Goldie, Azalia Mirhoseini, Hao Zhou, Irene Cai, Christopher D Manning
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Readability ≠ Learnability: Rethinking the Role of Simplicity in Training Small Language Models
Ivan Lee, Taylor Berg-Kirkpatrick
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
MSRS: Evaluating Multi-Source Retrieval-Augmented Generation
Rohan Phanse, Ej Zhou, Kejian Shi, WENCAI ZHANG, Yixin Liu, Yilun Zhao, Arman Cohan
- Published: 08 Jul 2025, Last Modified: 28 Aug 2025
- COLM 2025
- Readers: Everyone
Epistemic Alignment: A Mediating Framework for User-LLM Knowledge Delivery
Nicholas Clark, Hua Shen, Bill Howe, Tanu Mitra
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
PrefPalette: Personalized Preference Modeling with Latent Attributes
Shuyue Stella Li, Melanie Sclar, Hunter Lang, Ansong Ni, Jacqueline He, Puxin Xu, Andrew Cohen, Chan Young Park, Yulia Tsvetkov, Asli Celikyilmaz
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
X-Teaming: Multi-Turn Jailbreaks and Defenses with Adaptive Multi-Agents
Salman Rahman, Liwei Jiang, James Shiffer, Genglin Liu, Sheriff Issaka, Md Rizwan Parvez, Hamid Palangi, Kai-Wei Chang, Yejin Choi, Saadia Gabriel
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scale
Bowen Jiang, Zhuoqun Hao, Young Min Cho, Bryan Li, Yuan Yuan, Sihao Chen, Lyle Ungar, Camillo Jose Taylor, Dan Roth
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Language models align with brain regions that represent concepts across modalities
Maria Ryskina, Greta Tuckute, Alexander Fung, Ashley Malkin, Evelina Fedorenko
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
SUV: Scalable Large Language Model Copyright Compliance with Regularized Selective Unlearning
Tianyang Xu, Xiaoze Liu, Feijie Wu, Xiaoqian Wang, Jing Gao
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Can LLMs Handle WebShell Detection? Overcoming Detection Challenges with Behavioral Function-Aware Framework
Feijiang Han, Jiaming Zhang, Chuyi Deng, Jianheng Tang, Yunhuai Liu
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
LLM Unlearning Without an Expert Curated Dataset
Xiaoyuan Zhu, Muru Zhang, Ollie Liu, Robin Jia, Willie Neiswanger
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Steering Large Language Model Activations in Sparse Spaces
Reza Bayat, Ali Rahimi-Kalahroudi, Mohammad Pezeshki, Sarath Chandar, Pascal Vincent
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone