NeurIPS 2024 Workshop AFM Submissions

Fine-Grained Visual Recognition in the Age of Multimodal LLMs
Hari Chandana Kuchibhotla, Abbavaram Gowtham Reddy, Sai Srinivas Kancheti, Vineeth N. Balasubramanian
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
In-Context Learning behaves as a greedy layer-wise gradient descent algorithm
Brian K Chen, Tianyang Hu, Hui Jin, Hwee Kuan Lee, Kenji Kawaguchi
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Adaptive World Models: Learning Behaviors by Latent Imagination Under Non-Stationarity
Emiliyan Gospodinov, Vaisakh Shaj, Philipp Becker, Stefan Geyer, Gerhard Neumann
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Sirius: Contextual Sparsity with Correction for Efficient LLM
Yang Zhou, Zhuoming Chen, Zhaozhuo Xu, Xi Victoria Lin, Beidi Chen
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
LangDA: Language-guided Domain Adaptive Semantic Segmentation
Chang Liu, Saad Hossain, C Thomas, Kwei-Herng Lai, Raviteja Vemulapalli, Sirisha Rambhatla, Alexander Wong
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Towards Personalized Language Models via Inference-time Human Preference Optimization
Nikki Lijing Kuang, Wei Sun, Scott McFaddin, Yian Ma, Markus Ettl
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Personas within Parameters: Fine-Tuning Small Language Models with Low-Rank Adapters to Mimic User Behaviors
Himanshu Thakur, Eshani Agrawal, Smruthi Mukund
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Continuous Language Model Interpolation for Dynamic and Controllable Text Generation
Sara Kangaslahti, David Alvarez-Melis
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
AgentMerge: Enhancing Generalization in Fine-Tuned LLM Agents
Megh Thakkar, Léo Boisvert, Thibault Le Sellier de Chezelles, Alexandre Piché, Maxime Gasse, Alexandre Lacoste, Massimo Caccia
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Fine-tuning LLM Agents with Retrospective In-Context Online Learning
Wentse Chen, Jiayu Chen, Fahim Tajwar, Hao Zhu, Xintong Duan, Russ Salakhutdinov, Jeff Schneider
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Oral
- Readers: Everyone
Mitigating Hallucination in Large Vision-Language Models via Modular Attribution and Intervention
Tianyun Yang, Ziniu Li, Juan Cao, Chang Xu
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
InvestAlign: Align LLMs with Investor Decision-Making under Herd Behavior
Huisheng Wang, Zhuoshi Pan, Hangjing Zhang, Mingxiao Liu, Yiqing Lin, H. Vicky Zhao
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Is In-Context Learning Sufficient for Instruction Following in LLMs?
Hao Zhao, Maksym Andriushchenko, Francesco Croce, Nicolas Flammarion
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
REGENT: A Retrieval-Augmented Generalist Agent That Can Act in-Context In New Environments
Kaustubh Sridhar, Souradeep Dutta, Dinesh Jayaraman, Insup Lee
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Assisted Few-Shot Learning for Vision-Language Models in Agricultural Stress Phenotype Identification
Muhammad Arbab Arshad, Talukder Zaki Jubery, Asheesh K Singh, ARTI SINGH, Chinmay Hegde, Baskar Ganapathysubramanian, Aditya Balu, Adarsh Krishnamurthy, Soumik Sarkar
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Personalized Adaptation via In-Context Preference Learning
Allison Lau, Younwoo Choi, Vahid Balazadeh, Keertana Chidambaram, Vasilis Syrgkanis, Rahul Krishnan
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Are LLMs Prescient? A Continuous Evaluation using Daily News as the Oracle
Hui Dai, Ryan Teehan, Mengye Ren
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Oral
- Readers: Everyone
Combining Domain and Alignment Vectors to Achieve Better Knowledge-Safety Trade-offs in LLMs
Megh Thakkar, Yash More, Quentin Fournier, Matthew Riemer, Pin-Yu Chen, Amal Zouaq, Payel Das, Sarath Chandar
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Enhancing Reasoning to Adapt Large Language Models for Domain-Specific Applications
Bo Wen, Xin Zhang
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Towards Full Delegation: Designing Ideal Agentic Behaviors for Travel Planning
Song Jiang, Da JU, Andrew Cohen, Sasha Mitts, Aaron Foss, Justine T Kao, Xian Li, Yuandong Tian
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
A Common Pitfall of Margin-based Language Model Alignment: Gradient Entanglement
Hui Yuan, Yifan Zeng, Yue Wu, Huazheng Wang, Mengdi Wang, Liu Leqi
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Can the Spectrum of the Neural Tangent Kernel Anticipate Fine-Tuning Performance?
Zahra Rahimi Afzal, Tara Esmaeilbeig, Mojtaba Soltanalian, Mesrob I Ohannessian
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Better Prompt Compression Without Multi-Layer Perceptrons
Edouardo Honig, Andrew Lizarraga, Zijun Frank Zhang, Ying Nian Wu
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Towards Federated Low-Rank Adaptation with Rank Heterogeneity
Yuji Byun, Jaeho Lee
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Poster
- Readers: Everyone
Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Benjamin Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
- Published: 10 Oct 2024, Last Modified: 19 Nov 2024
- AFM 2024 Oral
- Readers: Everyone