COLM 2024 Conference Submissions

Prompt Exploration with Prompt Regression
Michael Feffer, Ronald Xu, Yuekai Sun, Mikhail Yurochkin
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Information-Theoretic Distillation for Reference-less Summarization
Jaehun Jung, Ximing Lu, Liwei Jiang, Faeze Brahman, Peter West, Pang Wei Koh, Yejin Choi
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Impact of Preference Noise on the Alignment Performance of Generative Language Models
Yang Gao, Dana Alon, Donald Metzler
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
PAPERCLIP: Associating Astronomical Observations and Natural Language with Multi-Modal Models
Siddharth Mishra-Sharma, YIDING SONG, Jesse Thaler
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
On Limitations of the Transformer Architecture
Binghui Peng, Srini Narayanan, Christos Papadimitriou
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
LITE: Modeling Environmental Ecosystems with Multimodal Large Language Models
Haoran Li, Junqi Liu, Zexian Wang, Shiyuan Luo, Xiaowei Jia, Huaxiu Yao
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Should We Attend More or Less? Modulating Attention for Fairness
Abdelrahman Zayed, Goncalo Mordido, Samira Shabanian, Sarath Chandar
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
The Larger the Better? Improved LLM Code-Generation via Budget Reallocation
Michael Hassid, Tal Remez, Jonas Gehring, Roy Schwartz, Yossi Adi
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models - A Survey
Philipp Mondorf, Barbara Plank
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Tabular Transfer Learning via Prompting LLMs
Jaehyun Nam, Woomin Song, Seong Hyeon Park, Jihoon Tack, Sukmin Yun, Jaehyung Kim, Kyu Hwan Oh, Jinwoo Shin
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Look at the Text: Instruction-Tuned Language Models are More Robust Multiple Choice Selectors than You Think
Xinpeng Wang, Chengzhi Hu, Bolei Ma, Paul Rottger, Barbara Plank
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Efficient Parallelization Layouts for Large-Scale Distributed Model Training
Johannes Hagemann, Samuel Weinbach, Konstantin Dobler, Maximilian Schall, Gerard de Melo
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Learning From Correctness Without Prompting Makes LLM Efficient Reasoner
Yuxuan YAO, Han Wu, Zhijiang Guo, Zhou Biyan, Jiahui Gao, Sichun Luo, Hanxu Hou, Xiaojin Fu, Linqi Song
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Bot or Human? Detecting ChatGPT Imposters with A Single Question
Hong Wang, Xuan Luo, Weizhi Wang, Melody Yu, Xifeng Yan
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Eliciting Latent Knowledge from "Quirky" Language Models
Alex Troy Mallen, Madeline Brumley, Julia Kharchenko, Nora Belrose
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructions
Federico Cassano, Luisa Li, Akul Sethi, Noah Shinn, Abby Brennan-Jones, Jacob Ginesin, Edward Berman, George Chakhnashvili, Anton Lozhkov, Carolyn Jane Anderson, Arjun Guha
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
What Are Tools Anyway? A Survey from the Language Model Perspective
Zhiruo Wang, Zhoujun Cheng, Hao Zhu, Daniel Fried, Graham Neubig
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation
Biqing Qi, Kaiyan Zhang, Kai Tian, Haoxiang Li, Zhang-Ren Chen, Sihang Zeng, Ermo Hua, Hu Jinfang, Bowen Zhou
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
OpenAgents: An Open Platform for Language Agents in the Wild
Tianbao Xie, Fan Zhou, Zhoujun Cheng, Peng Shi, Luoxuan Weng, Yitao Liu, Toh Jing Hua, Junning Zhao, Qian Liu, Che Liu, Zeyu Liu, Yiheng Xu, Hongjin SU, Dongchan Shin, Caiming Xiong, Tao Yu
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
How Easily do Irrelevant Inputs Skew the Responses of Large Language Models?
Siye Wu, Jian Xie, Jiangjie Chen, Tinghui Zhu, Kai Zhang, Yanghua Xiao
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
How Far Are We from Intelligent Visual Deductive Reasoning?
Yizhe Zhang, Richard He Bai, Ruixiang ZHANG, Jiatao Gu, Shuangfei Zhai, Joshua M. Susskind, Navdeep Jaitly
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?
Junpeng Liu, Yifan Song, Bill Yuchen Lin, Wai Lam, Graham Neubig, Yuanzhi Li, Xiang Yue
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking
Eric Zelikman, Georges Raif Harik, Yijia Shao, Varuna Jayasiri, Nick Haber, Noah Goodman
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Learning to Plan for Language Modeling from Unlabeled Data
Nathan Cornille, Marie-Francine Moens, Florian Mai
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
How bad is training on synthetic data? A statistical analysis of language model collapse
Mohamed El Amine Seddik, Suei-Wen Chen, Soufiane Hayou, Pierre Youssef, Merouane Abdelkader DEBBAH
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone