NeurIPS 2024 Workshop FITML Submissions

Fitness Aware Human Motion Generation with Fine-Tuning
Kiril Bikov, Shiye Su, Deepro Choudhury, Zhilin Guo, Weihao Xia, Mehmet Salih Çeliktenyıldız, Chenliang Zhou, Param Hanji, Cengiz Oztireli
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Sharp Analysis for KL-Regularized Contextual Bandits and RLHF
Heyang Zhao, Chenlu Ye, Quanquan Gu, Tong Zhang
- Published: 10 Oct 2024, Last Modified: 10 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Semi-Supervised Fine-Tuning of Vision Foundation Models with Content-Style Decomposition
Mariia Drozdova, Vitaliy Kinakh, Yury Belousov, Erica Lastufka, Slava Voloshynovskiy
- Published: 10 Oct 2024, Last Modified: 30 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Variational Best-of-N Alignment
Afra Amini, Tim Vieira, Elliott Ash, Ryan Cotterell
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
FRACTAL: Fine-Grained Scoring from Aggregate Text Labels
Yukti Makhija, Priyanka Agrawal, Rishi Saket, Aravindan Raghuveer
- Published: 10 Oct 2024, Last Modified: 30 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Uncertainty-Penalized Direct Preference Optimization
Sam Houliston, Alizée Pace, Alexander Immer, Gunnar Ratsch
- Published: 10 Oct 2024, Last Modified: 26 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
TreeTop: Topology-Aware Fine-Tuning for LLM Conversation Tree Understanding
Jashn Arora, Rahul Madhavan, Karthikeyan Shanmugam, John Palowitch, Manish Jain
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Improving Fine-Tuning with Latent Cluster Correction
Cédric Ho Thanh
- Published: 10 Oct 2024, Last Modified: 31 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Memory retaining finetuning via distillation
Zitong Yang, Aonan Zhang, Sam Wiseman, Xiang Kong, Ke Ye, Dong Yin
- Published: 10 Oct 2024, Last Modified: 22 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Scalability of memorization-based machine unlearning
Kairan Zhao, Peter Triantafillou
- Published: 10 Oct 2024, Last Modified: 27 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Discrepancy-Guided Parameter Suppression for Robust Fine-tuning
Chang Liu, Jingyu Ma
- Published: 10 Oct 2024, Last Modified: 30 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
TOU: Truncated-factorized reduction for an efficient-parameter model fine-tuning
Phuong Thi-Mai Nguyen, Minh-Son Dao, Koji Zettsu
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
DistRL: An Asynchronous Distributed Reinforcement Learning Framework for On-Device Control Agent
Taiyi Wang, Zhihao Wu, Jianheng Liu, Derek Yuen, Jianye HAO, Jun Wang, Kun Shao
- Published: 10 Oct 2024, Last Modified: 25 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Entropic Distribution Matching for Supervised Fine-tuning of LLMs: Less Overfitting and Better Diversity
Ziniu Li, Congliang Chen, Tian Xu, Zeyu Qin, Jiancong Xiao, Ruoyu Sun, Zhi-Quan Luo
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Oral
- Readers: Everyone
Mastering Task Arithmetic: $\tau$Jp as a Key Indicator for Weight Disentanglement
Kotaro Yoshida, Yuji Naraki, Takafumi Horie, Ryosuke Yamaki, Ryotaro Shimizu, Yuki Saito, Julian McAuley, Hiroki Naganuma
- Published: 10 Oct 2024, Last Modified: 18 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Variational Low-Rank Adaptation Using IVON
Bai Cong, Nico Daheim, Yuesong Shen, Daniel Cremers, Rio Yokota, Mohammad Emtiyaz Khan, Thomas Möllenhoff
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Parameter-Efficient Fine-Tuning of State Space Models
Kevin Galim, Wonjun Kang, Yuchen Zeng, Hyung Il Koo, Kangwook Lee
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Oral
- Readers: Everyone
Fine-tuning Vision Classifiers On A Budget
Sunil Kumar, Ted Sandler, Paulina Varshavskaya
- Published: 10 Oct 2024, Last Modified: 31 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Analysing Softmax Entropy Minimization for Adaptating Multitask Models at Test-time
Soumyajit Chatterjee, Abhirup Ghosh, Fahim Kawsar, Mohammad Malekzadeh
- Published: 10 Oct 2024, Last Modified: 29 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
HyperDPO: Conditioned One-Shot Multi-Objective Fine-Tuning Framework
Yinuo Ren, Tesi Xiao, Michael Shavlovsky, Lexing Ying, Holakou Rahmanian
- Published: 10 Oct 2024, Last Modified: 26 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Noise Stability Optimization for Finding Flat Minima: A Hessian-based Regularization Approach
Hongyang R. Zhang, Dongyue Li, Zhenshuo Zhang
- Published: 10 Oct 2024, Last Modified: 20 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
XoRA: Expander Adapted LoRA Finetuning
Amaljith EV, Arindam Biswas, Suryam Arnav Kalra, Pabitra Mitra, BISWAJIT BASU
- Published: 10 Oct 2024, Last Modified: 10 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
An empirical study of CLIP fine-tuning with similarity clusters
Shixuan Liu, Yiwei Lyu, Honglak Lee, Todd C Hollon
- Published: 10 Oct 2024, Last Modified: 30 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
MPLoRA: Orthogonal Multi-Path Low-Rank Adaptation for Parameter Efficient Fine-Tuning
Junhan Shi, Fulin Wang, Qing Li, Yong Jiang
- Published: 10 Oct 2024, Last Modified: 02 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Self-Stitching: Widely Applicable and Efficient Transfer Learning Using Stitching Layer
Tanachai Anakewat, YUSUKE Mukuta, Thomas Westfechtel, Tatsuya Harada
- Published: 10 Oct 2024, Last Modified: 30 Oct 2024
- FITML 2024 Poster
- Readers: Everyone