NeurIPS 2024 Workshop AFM Submissions

Exploring Visual Prompt Tuning for Demographic Adaptation in Foundation Models for Medical Imaging
Artur Parkhimchyk, Amirreza Naziri, Laleh Seyyed-Kalantari
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
CTRL-O: Language-Controllable Object-Centric Visual Representation Learning
Aniket Rajiv Didolkar, Andrii Zadaianchuk, Rabiul Awal, Maximilian Seitzer, Efstratios Gavves, Aishwarya Agrawal
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Text as Images: Can Multimodal Large Language Models Follow Printed Instructions in Pixels?
Xiujun Li, Yujie Lu, William Yang Wang, Yejin Choi
- Published: 10 Oct 2024, Last Modified: 21 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Warmstarting for Scaling Language Models
Neeratyoy Mallik, Maciej Janowski, Johannes Hog, Herilalaina Rakotoarison, Aaron Klein, Josif Grabocka, Frank Hutter
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory
Di Wu, Hongwei Wang, Wenhao Yu, Yuwei Zhang, Kai-Wei Chang, Dong Yu
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Fast and Accurate Language Model Decoding via Parallel Token Processing
Zhepei Wei, Wei-Lin Chen, Xinyu Zhu, Yu Meng
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Oral
- Readers: Everyone
InstructRAG: Instructing Retrieval Augmented Generation via Self-Synthesized Rationales
Zhepei Wei, Wei-Lin Chen, Yu Meng
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Accelerated Preference Optimization for Large Language Model Alignment
Jiafan He, Huizhuo Yuan, Quanquan Gu
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Evaluating RAG System Performance: The Impact of Knowledge Cut-off and Fine-Tuning
Omkar Dige, John Willes, D. B. Emerson
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
P3O: Pessimistic Preference-based Policy Optimization for Robust Alignment from Preferences
Dhawal Gupta, Christoph Dann, Alekh Agarwal
- Published: 10 Oct 2024, Last Modified: 20 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
GraphText: Graph Reasoning in Text Space
Jianan Zhao, Le Zhuo, Yikang Shen, Meng Qu, Kai Liu, Michael M. Bronstein, Zhaocheng Zhu, Jian Tang
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Personalized Language Modeling from Personalized Human Feedback
Xinyu Li, Ruiyang Zhou, Zachary Chase Lipton, Liu Leqi
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
FlashDP: Memory-Efficient and High-Throughput DP-SGD Training for Large Language Models
Liangyu Wang, Junxiao Wang, Jie Ren, Zihang Xiang, David E. Keyes, Di Wang
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
MagicPIG: LSH Sampling for Efficient LLM Generation
Zhuoming Chen, Ranajoy Sadhukhan, Zihao Ye, Yang Zhou, Jianyu Zhang, Niklas Nolte, Yuandong Tian, Matthijs Douze, Leon Bottou, Zhihao Jia, Beidi Chen
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Domain Adaptation for Robust Model Routing
Christoph Dann, Yishay Mansour, Teodor Vanislavov Marinov, Mehryar Mohri
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Visual Language Alignment Tuning
Le Zhang, Qian Yang, Aishwarya Agrawal
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Extracting Parallelism from Large Language Model Queries
Steven Kolawole, Keshav Santhanam, Virginia Smith, Pratiksha Thaker
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
On Pre-training of Multimodal Language Models Customized for Chart Understanding
Wan-Cyuan Fan, Yen-Chun Chen, Mengchen Liu, Lu Yuan, Leonid Sigal
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
COrAL: Order-Agnostic Language Modeling for Efficient Iterative Refinement
Yuxi Xie, Anirudh Goyal, Xiaobao Wu, Xunjian Yin, Xiao Xu, Min-Yen Kan, Liangming Pan, William Yang Wang
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
ZO-Offloading: Fine-Tuning LLMs with 100 Billion Parameters on a Single GPU
Liangyu Wang, Jie Ren, Hang Xu, Junxiao Wang, David E. Keyes, Di Wang
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Controlling Multimodal LLMs via Reward-guided Decoding
Oscar Mañas, Pierluca D'Oro, Koustuv Sinha, Adriana Romero-Soriano, Michal Drozdzal, Aishwarya Agrawal
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
CAT Pruning: Cluster-Aware Token Pruning For Text-to-Image Diffusion Models
Xinle Cheng, Zhuoming Chen, Zhihao Jia
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Synergistic Weak-Strong Collaboration by Aligning Preferences
Yizhu Jiao, Xuchao Zhang, Zhaoyang Wang, Yubo Ma, Zhun Deng, Rujia Wang, Chetan Bansal, Saravan Rajmohan, Jiawei Han, Huaxiu Yao
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Situated Instruction Following Under Ambiguous Human Intent
So Yeon Min, Xavier Puig, Devendra Singh Chaplot, Tsung-Yen Yang, Akshara Rai, Priyam Parashar, Russ Salakhutdinov, Yonatan Bisk, Roozbeh Mottaghi
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Model Developmental Safety: A Safety-Centric Method and Applications in Vision-Language Models
Gang Li, Wendi Yu, Yao Yao, Wei Tong, Yingbin Liang, Qihang Lin, Tianbao Yang
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone