Entropy-Adapter-Based Deep Image Compression for User-Generated Content with Knowledge Distillation

Ke Ma, Yaojun Wu, Chaoyi Lin, Zhipin Deng, Xiaoyan Sun

Abstract: This study addresses the challenge of domain adaptation in learned image compression, focusing on shifting the model from natural images to user-generated content (UGC) domain. We propose a novel entropy adapter framework augmented with knowledge distillation techniques to improve performance. Unlike existing adapter-based methods that primarily enhance transformation modules, we identify the mismatch between the adapter-based transformation and the fixed entropy network. To resolve this, we introduce adapters within the hypernet and entropy model. Specifically, our decoupled entropy adapter features a deeper residual structure with two independent branches, enabling a separate refinement of mean and scale components. This design improves the accuracy of probability estimation and overall compression efficiency. To further enhance the effectiveness of the adapters, we incorporate a knowledge distillation (KD) strategy with a progressive loss function. It facilitates a smooth transition from KD loss to a rate-distortion (RD) loss in the training process, effectively transferring knowledge from a directly fine-tuned model to the student model. Consequently, this strengthens the adapter's learning capability and improves compression performance. Experimental results show that the proposed method achieves a significant 11.5% bitrate savings compared to the baseline model. Additionally, it demonstrates robust adaptability across diverse network architectures.

External IDs:dblp:conf/dcc/Ma0LDS25