NeurIPS 2024 Workshop Compression Submissions

Efficient and Robust Spike Ensemble Coding of Signals
Anik Chattopadhyay, Arunava Banerjee
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
Training Block-wise Sparse Models Using Kronecker Product Decomposition
Ding Zhu, Zhiqun Zuo, Mohammad Mahdi Khalili
- Published: 09 Oct 2024, Last Modified: 29 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
Formalizing Limits of Knowledge Distillation Using Partial Information Decomposition
Pasan Dissanayake, Faisal Hamman, Barproda Halder, Ilia Sucholutsky, Qiuyi Zhang, Sanghamitra Dutta
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
Empirical Upper Bounds for Unstructured Sparsity in Compute-Efficient Language Modeling
Esha Singh, Shane Bergsma, Nolan Simran Dey, Joel Hestness, Gavia Gray
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
On the Relationship Between Model Training Dynamics and Early Pruning Periods
Elvis Nunez, Stefano Soatto
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
Self-Data Distillation for Recovering Quality in Pruned Large Language Models
Vithursan Thangarasa, Ganesh Venkatesh, Nish Sinnadurai, Sean Lie
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
An Information Theory of Compute-Optimal Size Scaling, Emergence, and Plateaus in Language Models
Anuj K. Nayak, Lav R. Varshney
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
Improving Knowledge Distillation with Teacher's Explanation
Sayantan Chowdhury, Ben Liang, Ali Tizghadam, Ilijc Albanese
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
Transformers Learn to Compress Variable-order Markov Chains in-Context
Ruida Zhou, Chao Tian, Suhas Diggavi
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
Grow to Compress? Efficient Training of Robust Networks on the Edge
Vignesh Sundaresha, Naresh Shanbhag
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
MAPLE: Memory-Aware Predict and Load for Efficient LLM Inference
Zhenyu Liu, Zhemin Zhang, Zirui Zhang, Yanyuan Qin, Jiayi Luo, Zhenyu Gu, Liu Liu
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
Dense Backpropagation Improves Routing for Sparsely-Gated Mixture-of-Experts
Ashwinee Panda, Vatsal Baherwani, Zain Sarwar, Benjamin Thérien, Stephen Rawls, Sambit Sahu, Supriyo Chakraborty, Tom Goldstein
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
SpikingVTG: Saliency Feedback Gating Enabled Spiking Video Temporal Grounding
Malyaban Bal, Brian Matejek, Susmit Jha, Adam D. Cobb
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
Interpretability as Compression: Reconsidering SAE Explanations of Neural Activations
Kola Ayonrinde, Michael T Pearce, Lee Sharkey
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
Compressing Recurrent Neural Networks for FPGA-accelerated Implementation in Fluorescence Lifetime Imaging
Ismail Erbas, Vikas Pandey, Aporva Amarnath, Naigang Wang, Karthik Swaminathan, Stefan T. Radev, Xavier Intes
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
SNeRV: Scalable Neural Representations for Video Coding
Yiying Wei, Hadi Amirpour, Christian Timmerer
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models
Makoto Shing, Kou Misaki, Han Bao, Sho Yokoi, Takuya Akiba
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
P-SpikeSSM: Harnessing Probabilistic Spiking State Space Models for Long-Range Dependency Tasks
Malyaban Bal, Abhronil Sengupta
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
Does Representation Matter? Exploring Intermediate Layers in Large Language Models
Oscar Skean, Md Rifat Arefin, Ravid Shwartz-Ziv
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
Graph Transformation Augmentation for Contrastive Learning of Graph-Level Representation: An Initial Exploration
Tianchao Li, Yulong Pei
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
Polar Codes for Channel Simulation
Sharang M. Sriramu, Rochelle Barsz, Elizabeth Polito, Aaron B. Wagner
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
Copula-based Estimation of Continuous Sources for a Class of Constrained Rate-Distortion Functions
Giuseppe Serra, Photios A. Stavrou, Marios Kountouris
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
Breaking Smoothness: The Struggles of Neural Compressors with Discontinuous Mappings
Ezgi Ozyilkan, Jona Ballé, Sourbh Bhadane, Aaron B. Wagner, Elza Erkip
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
Sample Compression Hypernetworks: From Generalization Bounds to Meta-Learning
Benjamin Leblanc, Mathieu Bazinet, Nathaniel D'Amours, Alexandre Drouin, Pascal Germain
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone
Flexible image decoding in learned image compression
Hossein Motamednia, Azadeh Mansouri, Fariba Saadati Monem, Ahmad Mahmoudi-Aznaveh
- Published: 09 Oct 2024, Last Modified: 19 Nov 2024
- Compression Workshop @ NeurIPS 2024
- Readers: Everyone