NeurIPS 2024 Workshop AFM Submissions

CITER: Collaborative Inference for Efficient Large Language Model Decoding with Token-Level Routing
Wenhao Zheng, Yixiao Chen, Weitong Zhang, Souvik Kundu, Yun Li, Zhengzhong Liu, Eric P. Xing, Hongyi Wang, Huaxiu Yao
- Published: 10 Oct 2024, Last Modified: 23 Dec 2024
- AFM 2024 Poster
- Readers: Everyone
Adaptive LoRA Merging for Efficient Domain Incremental Learning
Eric Nuertey Coleman, Luigi Quarantiello, Julio Hurtado, Vincenzo Lomonaco
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
AoP-SAM: Automation of Prompts for Efficient Segmentation
Yi Chen, Muyoung Son, Chuanbo Hua, Joo-Young Kim
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Instant Transformer Adaption via HyperLoRA
Rujikorn Charakorn, Edoardo Cetin, Yujin Tang, Robert Tjarko Lange
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Enhancing Fine-Tuning Efficiency of LLMs Through Gradient Subspace Tracking
Sahar Rajabi, Sirisha Rambhatla
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
metaTextGrad: Learning to learn with language models as optimizers
Guowei Xu, Mert Yuksekgonul, Carlos Guestrin, James Zou
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
MMIE: Massive Multimodal Interleaved Comprehension Benchmark for Large Vision-Language Models
Peng Xia, Siwei Han, Shi Qiu, Yiyang Zhou, Zhaoyang Wang, Wenhao Zheng, Zhaorun Chen, Chenhang Cui, Mingyu Ding, Linjie Li, Lijuan Wang, Huaxiu Yao
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
MMed-RAG: Versatile Multimodal RAG System for Medical Vision Language Models
Peng Xia, Kangyu Zhu, Haoran Li, Tianze Wang, Weijia Shi, Linjun Zhang, James Zou, Huaxiu Yao
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Memory Efficient Continual Learning with CLIP Models
Ryan King, Gang Li, Bobak J Mortazavi, Tianbao Yang
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Enhancing Cross-Language Code Translation via Task-Specific Embedding Alignment in Retrieval-Augmented Generation
Manish Bhattarai, Minh N. Vu, Javier E. Santos, Ismael Boureima, Daniel O'Malley
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Tensor Attention Training: Provably Efficient Learning of Higher-order Transformers
Yingyu Liang, Zhenmei Shi, Zhao Song, Yufa Zhou
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Nexus: Specialization meets Adaptability for Efficiently Training Mixture of Experts
Nikolas Gritsch, Qizhen Zhang, Acyr Locatelli, Sara Hooker, Ahmet Üstün
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Device-Directed Speech Detection for Follow-up Conversations Using Large Language Models
Ognjen Rudovic, Pranay Dighe, Yi Su, Vineet Garg, Sameer Dharur, Xiaochuan Niu, Ahmed Hussen Abdelaziz, Saurabh Adya, Ahmed Tewfik
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Deliberate Practice with Synthetic Data
Reyhane Askari-Hemmat, Mohammad Pezeshki, Pietro Astolfi, Melissa Hall, Florian Bordes, Jakob Verbeek, Michal Drozdzal, Adriana Romero-Soriano
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Efficient Fine-Tuning of Image-Conditional Diffusion Models for Depth and Surface Normal Estimation
Gonzalo Martin Garcia, Karim Abou Zeid, Christian Schmidt, Daan de Geus, Alexander Hermans, Bastian Leibe
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Enhancing Multi-Agent Multi-Modal Collaboration with Fine-Grained Reward Modeling
Qian Yang, Weixiang Yan, Aishwarya Agrawal
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Narrow Transformer: Mono-lingual Code SLM for Desktop
Kamalkumar Rathinasamy, Balaji A J, Ankush Kumar, Gagan Gayari, Harshini K, Rajab Ali Mondal, Sreenivasa Raghavan K S, Swayam Singh, Mohammed Rafee Tarafdar
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Efficiently Learning at Test-Time: Active Fine-Tuning of LLMs
Jonas Hübotter, Sascha Bongni, Ido Hakimi, Andreas Krause
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Pre-trained Language Models Improve the Few-shot Prompt Ability of Decision Transformer
Yu Yang, Pan Xu
- Published: 19 Nov 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
ViPCap: Retrieval Text-based Visual Prompts for Lightweight Image Captioning
Taewhan Kim, Soeun Lee, Si-Woo Kim, Dong-Jin Kim
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Automated Design of Agentic Systems
Shengran Hu, Cong Lu, Jeff Clune
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Retrieval-Augmented Data Augmentation for Low-Resource Domain Tasks
Minju Seo, Jinheon Baek, James Thorne, Sung Ju Hwang
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Adapting Language Models via Token Translation
Zhili Feng, Tanya Marwah, Nicolo Fusi, David Alvarez-Melis, Lester Mackey
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
XLand-100B: A Large-Scale Multi-Task Dataset for In-Context Reinforcement Learning
Alexander Nikulin, Ilya Zisman, Alexey Zemtsov, Vladislav Kurenkov
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
N-Gram Induction Heads for In-Context RL: Improving Stability and Reducing Data Needs
Ilya Zisman, Alexander Nikulin, Andrei Polubarov, Lyubaykin Nikita, Vladislav Kurenkov
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone