COLM 2025 Conference Submissions

RADLADS: Rapid Attention Distillation to Linear Attention Decoders at Scale
Daniel Goldstein, Eric Alcaide, Janna Lu, Eugene Cheah
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Learning Adaptive Parallel Reasoning with Language Models
Jiayi Pan, Xiuyu Li, Long Lian, Charlie Victor Snell, Yifei Zhou, Adam Yala, Trevor Darrell, Kurt Keutzer, Alane Suhr
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
EllieSQL: Cost-Efficient Text-to-SQL with Complexity-Aware Routing
Yizhang Zhu, Runzhi JIANG, Boyan Li, Nan Tang, Yuyu Luo
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Why do LLMs attend to the first token?
Federico Barbero, Alvaro Arroyo, Xiangming Gu, Christos Perivolaropoulos, Petar Veličković, Razvan Pascanu, Michael M. Bronstein
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Overfill: Two-Stage Models for Efficient Language Model Decoding
Woojeong Kim, Junxiong Wang, Jing Nathan Yan, Mohamed S. Abdelfattah, Alexander M Rush
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
CLIPPER: Compression enables long-context synthetic data generation
Chau Minh Pham, Yapei Chang, Mohit Iyyer
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Society of Mind Meets Real-Time Strategy: A Hierarchical Multi-Agent Framework for Strategic Reasoning
Daechul Ahn, San Kim, Jonghyun Choi
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
A Sober Look at Progress in Language Model Reasoning: Pitfalls and Paths to Reproducibility
Andreas Hochlehnert, Hardik Bhatnagar, Vishaal Udandarao, Samuel Albanie, Ameya Prabhu, Matthias Bethge
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
SPIN-Bench: How Well Do LLMs Plan Strategically and Reason Socially?
Jianzhu Yao, Kevin Wang, Ryan Hsieh, Haisu Zhou, Tianqing Zou, Zerui Cheng, Zhangyang Wang, Pramod Viswanath
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Resource-efficient Inference with Foundation Model Programs
Lunyiu Nie, Zhimin Ding, Kevin Yu, Marco Cheung, Chris Jermaine, Swarat Chaudhuri
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Teach Old SAEs New Domain Tricks with Boosting
Nikita Koriagin, Yaroslav Aksenov, Daniil Laptev, Gleb Gerasimov, Nikita Balagansky, Daniil Gavrilov
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Improving LLMs‘ Generalized Reasoning Abilities by Graph Problems
Qifan Zhang, Nuo Chen, Zehua Li, Miao Peng, Jing Tang, Jia Li
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Zero-shot Benchmarking: A Framework for Flexible and Scalable Automatic Evaluation of Language Models
José Pombal, Nuno M Guerreiro, Ricardo Rei, Andre Martins
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Register Always Matters: Analysis of LLM Pretraining Data Through the Lens of Language Variation
Amanda Myntti, Erik Henriksson, Veronika Laippala, Sampo Pyysalo
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Scoring Verifiers: Evaluating Synthetic Verification for Code and Reasoning
Aleksander Ficek, Somshubra Majumdar, Vahid Noroozi, Boris Ginsburg
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Cascade Reward Sampling for Efficient Decoding-Time Alignment
Bolian Li, Yifan Wang, Anamika Lochab, Ananth Grama, Ruqi Zhang
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Reverse-engineering NLI: A study of the meta-inferential properties of Natural Language Inference
Rasmus Blanck, Bill Noble, Stergios Chatzikyriakidis
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Have Large Language Models Learned to Reason? A Characterization via 3-SAT
RISHI HAZRA, Gabriele Venturato, Pedro Zuidberg Dos Martires, Luc De Raedt
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
HIPPO-VIDEO : Simulating Watch Histories with Large Language Models for History-Driven Video Highlighting
Jeongeun Lee, Youngjae Yu, Dongha Lee
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Adversarial Training of Reward Models
Alexander Bukharin, Haifeng Qian, Shengyang Sun, Adithya Renduchintala, Soumye Singhal, Zhilin Wang, Oleksii Kuchaiev, Olivier Delalleau, Tuo Zhao
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
The Unlearning Mirage: A Dynamic Framework for Evaluating LLM Unlearning
Raj Sanjay Shah, Jing Huang, Keerthiram Murugesan, Nathalie Baracaldo, Diyi Yang
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
Planted in Pretraining, Swayed by Finetuning: A Case Study on the Origins of Cognitive Biases in LLMs
Itay Itzhak, Yonatan Belinkov, Gabriel Stanovsky
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
ALOPE: Adaptive Layer Optimization for Translation Quality Estimation using Large Language Models
Archchana Sindhujan, Shenbin Qian, Chan Chi Chun Matthew, Constantin Orasan, Diptesh Kanojia
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
The Blessing and Curse of Dimensionality in Safety Alignment
Rachel S.Y. Teo, Laziz Abdullaev, Tan Minh Nguyen
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone
AdaptiVocab: Enhancing LLM Efficiency in Focused Domains through Lightweight Vocabulary Adaptation
Itay Nakash, Nitay Calderon, Eyal Ben-David, Elad Hoffer, Roi Reichart
- Published: 08 Jul 2025, Last Modified: 26 Aug 2025
- COLM 2025
- Readers: Everyone