ICML 2024 Workshop WANT Submissions

Can LLMs Enhance Performance Prediction for Deep Learning Models?
Karthick Panner Selvam, Phitchaya Mangpo Phothilimthana, Sami Abu-El-Haija, Bryan Perozzi, Mats Brorsson
- Published: 18 Jun 2024, Last Modified: 09 Jul 2024
- WANT@ICML 2024 Oral
- Readers: Everyone
Towards Efficient and Scalable Training of Differentially Private Deep Learning
Sebastian Rodriguez Beltran, Marlon Tobaben, Niki Andreas Loppi, Antti Honkela
- Published: 18 Jun 2024, Last Modified: 25 Jun 2024
- WANT@ICML 2024 Poster
- Readers: Everyone
Memory and Bandwidth are All You Need for Fully Sharded Data Parallel
Jiangtao Wang, Jan Ebert, Oleg Filatov, Stefan Kesselheim
- Published: 18 Jun 2024, Last Modified: 10 Jul 2024
- WANT@ICML 2024 Poster
- Readers: Everyone
Resolving Discrepancies in Compute-Optimal Scaling of Language Models
Tomer Porian, Mitchell Wortsman, Jenia Jitsev, Ludwig Schmidt, Yair Carmon
- Published: 18 Jun 2024, Last Modified: 09 Jul 2024
- WANT@ICML 2024 Oral
- Readers: Everyone
Communication Efficient Federated Learning with Differentiated Aggregation
Peyman Gholami, Hulya Seferoglu
- Published: 18 Jun 2024, Last Modified: 09 Jul 2024
- WANT@ICML 2024 Poster
- Readers: Everyone
Adaptive Model Pruning in Federated Learning through Loss Exploration
Christian Internò, Elena Raponi, Niki van Stein, Thomas Bäck, Markus Olhofer, Yaochu Jin, Barbara Hammer
- Published: 18 Jun 2024, Last Modified: 10 Jul 2024
- WANT@ICML 2024 Poster
- Readers: Everyone
DASH: Warm-Starting Neural Network Training Without Loss of Plasticity Under Stationarity
Baekrok Shin, Junsoo Oh, Hanseul Cho, Chulhee Yun
- Published: 18 Jun 2024, Last Modified: 11 Jul 2024
- WANT@ICML 2024 Poster
- Readers: Everyone
ECO: Efficient Computational Optimization for Exact Machine Unlearning in Deep Neural Networks
Yu-Ting Huang, Pei-Yuan Wu, Chuan-Ju Wang
- Published: 18 Jun 2024, Last Modified: 09 Jul 2024
- WANT@ICML 2024 Poster
- Readers: Everyone
Fisher-aware Quantization for DETR Detectors with Critical-category Objectives
Huanrui Yang, Yafeng Huang, Zhen Dong, Denis A Gudovskiy, Tomoyuki Okuno, Yohei Nakata, Yuan Du, Kurt Keutzer, Shanghang Zhang
- Published: 18 Jun 2024, Last Modified: 02 Jul 2024
- WANT@ICML 2024 Poster
- Readers: Everyone
SVFT: Parameter-Efficient Fine-Tuning with Singular Vectors
Vijay Lingam, Atula Tejaswi Neerkaje, Aditya Vavre, Aneesh Shetty, Gautham Krishna Gudur, Joydeep Ghosh, Eunsol Choi, Alex Dimakis, Aleksandar Bojchevski, sujay sanghavi
- Published: 18 Jun 2024, Last Modified: 06 Jul 2024
- WANT@ICML 2024 Oral
- Readers: Everyone
Effective Layer Pruning Through Similarity Metric Perspective
Ian Pons, Bruno Yamamoto, Anna Helena Reali Costa, Artur Jordao
- Published: 18 Jun 2024, Last Modified: 07 Jul 2024
- WANT@ICML 2024 Poster
- Readers: Everyone
Enhancing Fine-grained Multi-modal Alignment via Adapters: A Parameter-Efficient Training Framework for Referring Image Segmentation
Zunnan Xu, Jiaqi Huang, Ting Liu, Yong Liu, Haonan Han, Kehong Yuan, Xiu Li
- Published: 18 Jun 2024, Last Modified: 06 Jul 2024
- WANT@ICML 2024 Poster
- Readers: Everyone
MoReDrop: Dropout without Dropping
Li Jiang, Duo Li, Yichuan Ding, Xue Liu, Victor Wai Kin Chan
- Published: 18 Jun 2024, Last Modified: 11 Jul 2024
- WANT@ICML 2024 Poster
- Readers: Everyone
Zeroth-Order Fine-Tuning of LLMs with Extreme Sparsity
Wentao Guo, Jikai Long, Yimeng Zeng, Zirui Liu, Xinyu Yang, Yide Ran, Jacob R. Gardner, Osbert Bastani, Christopher De Sa, Xiaodong Yu, Beidi Chen, Zhaozhuo Xu
- Published: 18 Jun 2024, Last Modified: 03 Jul 2024
- WANT@ICML 2024 Poster
- Readers: Everyone
DiLoCo: Distributed Low-Communication Training of Language Models
Arthur Douillard, Qixuan Feng, Andrei Alex Rusu, Rachita Chhaparia, Yani Donchev, Adhiguna Kuncoro, MarcAurelio Ranzato, Arthur Szlam, Jiajun Shen
- Published: 18 Jun 2024, Last Modified: 09 Jul 2024
- WANT@ICML 2024 Poster
- Readers: Everyone
Multi-objective Differentiable Neural Architecture Search
Rhea Sanjay Sukthanker, Arber Zela, Benedikt Staffler, Samuel Dooley, Josif Grabocka, Frank Hutter
- Published: 18 Jun 2024, Last Modified: 01 Jul 2024
- WANT@ICML 2024 Poster
- Readers: Everyone
Efficient Document Ranking with Learnable Late Interactions
Himanshu Jain, Ziwei Ji, Ankit Singh Rawat, Andreas Veit, Sadeep Jayasumana, Sashank J. Reddi, Aditya Krishna Menon, Felix Yu
- Published: 18 Jun 2024, Last Modified: 19 Jul 2024
- WANT@ICML 2024 Poster
- Readers: Everyone