ICML 2023 Workshop ES-FoMO Submissions

Landmark Attention: Random-Access Infinite Context Length for Transformers
Amirkeivan Mohtashami, Martin Jaggi
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
Dissecting Efficient Architectures for Wake-Word Detection
Cody Berger, Juncheng B Li, Yiyuan Li, Aaron Berger, Dmitri Berger, Karthik Ganesan, Emma Strubell, Florian Metze
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
MRMP: Multi-Rate Magnitude Pruning of Graph Convolutional Networks
Hichem Sahbi
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
Progressive Knowledge Distillation: Balancing Inference Latency and Accuracy at Runtime
Don Dennis, Abhishek Shetty, Anish Sevekari, Kazuhito Koishida, Virginia Smith
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
Language Models are Weak Learners
Hariharan Manikandan, Yiding Jiang, J Zico Kolter
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
On Robustness-Accuracy Characterization of Large Language Models using Synthetic Datasets
Ching-Yun Ko, Pin-Yu Chen, Payel Das, Yung-Sung Chuang, Luca Daniel
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
Memory-Efficient Selective Fine-Tuning
Antoine Simoulin, Namyong Park, Xiaoyi Liu, Grey Yang
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Oral
- Readers: Everyone
Training Diffusion Models with Reinforcement Learning
Kevin Black, Michael Janner, Yilun Du, Ilya Kostrikov, Sergey Levine
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
GPT-Zip: Deep Compression of Finetuned Large Language Models
Berivan Isik, Hermann Kumbong, Wanyi Ning, Xiaozhe Yao, Sanmi Koyejo, Ce Zhang
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
A Simple and Effective Pruning Approach for Large Language Models
Mingjie Sun, Zhuang Liu, Anna Bair, J Zico Kolter
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
Fast Causal Attention with Dynamic Sparsity
Daniele Paliotta, Matteo Pagliardini, Martin Jaggi, François Fleuret
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Oral
- Readers: Everyone
Incremental Low-Rank Learning
Jiawei Zhao, Yifei Zhang, Beidi Chen, Florian Tobias Schaefer, Anima Anandkumar
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
Deep Fusion: Efficient Network Training via Pre-trained Initializations
Hanna Mazzawi, Javier Gonzalvo, Michael Wunder
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
ROSA: Random Orthogonal Subspace Adaptation
Marawan Gamal, Guillaume Rabusseau
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
Towards Fair Knowledge Distillation using Student Feedback
Abhinav Java, Surgan Jandial, Chirag Agarwal
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
Audio-Journey: Efficient Visual+LLM-aided Audio Encodec Diffusion
Juncheng B Li, Jackson Sam Michaels, Laura Yao, Lijun Yu, Zach Wood-Doughty, Florian Metze
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
Semi-supervised Tabular Classification via In-context Learning of Large Language Models
Jaehyun Nam, Woomin Song, Seong Hyeon Park, Jihoon Tack, Sukmin Yun, Jaehyung Kim, Jinwoo Shin
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
BK-SDM: Architecturally Compressed Stable Diffusion for Efficient Text-to-Image Generation
Bo-Kyeong Kim, Hyoung-Kyu Song, Thibault Castells, Shinkook Choi
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
Transformers as Statisticians: Provable In-Context Learning with In-Context Algorithm Selection
Yu Bai, Fan Chen, Huan Wang, Caiming Xiong, Song Mei
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
Can Public Large Language Models Help Private Cross-device Federated Learning?
Boxin Wang, Yibo Jacky Zhang, Yuan Cao, Bo Li, Hugh Brendan McMahan, Sewoong Oh, Zheng Xu, Manzil Zaheer
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
Reasoning Ability Emerges in Large Language Models as Aggregation of Reasoning Paths: A Case Study With Knowledge Graphs
Xinyi Wang, William Yang Wang
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
Learned Thresholds Token Merging and Pruning for Vision Transformers
Maxim Bonnaerens, Joni Dambre
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
Three Towers: Flexible Contrastive Learning with Pretrained Image Models
Jannik Kossen, Mark Collier, Basil Mustafa, Xiao Wang, Xiaohua Zhai, Lucas Beyer, Andreas Peter Steiner, Jesse Berent, Rodolphe Jenatton, Efi Kokiopoulou
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone
ViT Graph Head Attention for Small Sized Datasets
HyeongJin Kim, GyungHyun Lee, Byoung Chul Ko
- Published: 20 Jun 2023, Last Modified: 09 Aug 2023
- ICML 2023 Workshop ESFoMO Withdrawn Submission
- Readers: Everyone
A Closer Look at In-Context Learning under Distribution Shifts
Kartik Ahuja, David Lopez-Paz
- Published: 20 Jun 2023, Last Modified: 16 Jul 2023
- ES-FoMO 2023 Poster
- Readers: Everyone