NeurIPS 2024 Workshop FITML Submissions

Towards Natural Machine Unlearning
Zhengbao He, Tao Li, Xinwen Cheng, Zhehao Huang, Xiaolin Huang
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Efficient Fine-Tuning of Behavior Cloned Policies with Reinforcement Learning from Limited Demonstrations
Samyeul Noh, Seonghyun Kim, Ingook Jang
- Published: 10 Oct 2024, Last Modified: 28 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Efficiently Learning at Test-Time: Active Fine-Tuning of LLMs
Jonas Hübotter, Sascha Bongni, Ido Hakimi, Andreas Krause
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Oral
- Readers: Everyone
Adapting Language Models via Token Translation
Zhili Feng, Tanya Marwah, Nicolo Fusi, David Alvarez-Melis, Lester Mackey
- Published: 10 Oct 2024, Last Modified: 05 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
REACT: Residual-Adaptive Contextual Tuning for Fast Model Adaptation in Cybersecurity
Jiayun Zhang, Junshen Xu, Yi Fan
- Published: 10 Oct 2024, Last Modified: 28 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Flexora: Flexible Low-Rank Adaptation for Large Language Models
Chenxing Wei, Yao Shu, Ying Tiffany He, Fei Yu
- Published: 10 Oct 2024, Last Modified: 16 May 2025
- FITML 2024 Poster
- Readers: Everyone
Balancing Cost and Effectiveness of Synthetic Data Generation Strategies for LLMs
Yung-Chieh Chan, George Pu, Apaar Shanker, Parth Suresh, Penn Jenks, John Heyer, Samuel Marc Denton
- Published: 10 Oct 2024, Last Modified: 30 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Model Soup for Better RLHF: Weight Space Averaging to Improve Alignment in LLMs
Atoosa Chegini, Hamid Kazemi, Seyed Iman Mirzadeh, Dong Yin, Maxwell Horton, Moin Nabi, Mehrdad Farajtabar, Keivan Alizadeh
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Investigating the Role of Fine-Tuning in Addressing the Gap Between Synthetic and Real Data in Generative Foundation Models
Leonhard Hennicke, Christian Medeiros Adriano, Holger Giese, Lukas Schott, Jan Mathias Koehler
- Published: 10 Oct 2024, Last Modified: 02 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
What Causes a Disparate Impact in a Quantized Model?
Abhimanyu Bellam, Jung-Eun Kim
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Towards Long-Context Time Series Foundation Models With A Handful Of Additional Parameters
Nina Żukowska, Mononito Goswami, Michał Wiliński, Willa Potosnak, Artur Dubrawski
- Published: 10 Oct 2024, Last Modified: 03 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Learning the Regularization Strength for Deep Fine-Tuning via a Data-Emphasized Variational Objective
Ethan Harvey, Mikhail Petrov, Michael C Hughes
- Published: 10 Oct 2024, Last Modified: 25 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Addax: Utilizing Zeroth-Order Gradients to Improve Memory Efficiency and Performance of SGD for Fine-Tuning Language Models
Zeman Li, Xinwei Zhang, Peilin Zhong, Yuan Deng, Meisam Razaviyayn, Vahab Mirrokni
- Published: 10 Oct 2024, Last Modified: 28 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Online Fine-Tuning with Uncertainty Quantification for Offline Pre-Trained Agents
Ingook Jang, Seonghyun Kim, Samyeul Noh
- Published: 10 Oct 2024, Last Modified: 28 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Comparing Bad Apples to Good Oranges: Aligning Large Language Models via Joint Preference Optimization
Hritik Bansal, Ashima Suvarna, Gantavya Bhatt, Nanyun Peng, Kai-Wei Chang, Aditya Grover
- Published: 10 Oct 2024, Last Modified: 10 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Faster, More Efficient RLHF through Off-Policy Asynchronous Learning
Michael Noukhovitch, Shengyi Huang, Sophie Xhonneux, Arian Hosseini, Rishabh Agarwal, Aaron Courville
- Published: 10 Oct 2024, Last Modified: 10 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Inconsistencies In Consistency Models: Better ODE Solving Does Not Imply Better Samples
Noël Vouitsis, Rasa Hosseinzadeh, Brendan Leigh Ross, Valentin Villecroze, Satya Krishna Gorti, Jesse C. Cresswell, Gabriel Loaiza-Ganem
- Published: 10 Oct 2024, Last Modified: 23 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Improving LLM Generation with Inverse and Forward Alignment: Reward Modeling, Prompting, Fine-Tuning, and Inference-Time Optimization
Hao Sun, Thomas Pouplin, Nicolás Astorga, Tennison Liu, Mihaela van der Schaar
- Published: 10 Oct 2024, Last Modified: 28 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Token Pruning using a Lightweight Background Aware Vision Transformer
Sudhakar Sah, Ravish Kumar, Honnesh Rohmetra, Ehsan Saboori
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Inducing Semi-Structured Sparsity by Masking for Efficient Model Inference in Convolutional Networks
David Danhofer
- Published: 10 Oct 2024, Last Modified: 30 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
E-Tamba: Efficient Transformer-Mamba Layer Transplantation
DAZHI PENG, Hangrui Cao
- Published: 10 Oct 2024, Last Modified: 31 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
FourierKAN outperforms MLP on Text Classification Head Fine-tuning
Abdullah Al Imran, Md Farhan Ishmam
- Published: 10 Oct 2024, Last Modified: 23 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Flat-LoRA: Low-Rank Adaption over a Flat Loss Landscape
Tao Li, Zhengbao He, Yujun Li, Yasheng Wang, Lifeng Shang, Xiaolin Huang
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Parasite Networks: Transfer Learning in Resource-Constrained Domains
Andrew Alini, Douglas E. Sturim, Kevin Brady, Pooya Khorrami
- Published: 10 Oct 2024, Last Modified: 16 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Generalizing Alignment Paradigm of Text-to-Image Generation with Preferences through $f$-divergence Minimization
Haoyuan Sun, Bo Xia, Yongzhe Chang, Xueqian Wang
- Published: 10 Oct 2024, Last Modified: 31 Oct 2024
- FITML 2024 Poster
- Readers: Everyone