Multi-Scale Dual-Attention Unfolding Network for Compressed Sensing Image Reconstruction

Liangjun Wang, Meixin Wang

Keywords: Compressed Sensing; Image Reconstruction; Deep Unfolding Network; Deep Learning

Verify Author List: I have double-checked the author list and understand that additions and removals will not be allowed after the submission deadline.

TL;DR: This paper introduces a novel approach for compressed sensing image reconstruction, using multi-scale and attention mechanisms to enhance feature transmission and texture restoration, achieving superior performance over existing methods.

Abstract: Deep Unfolding Networks have emerged as a prominent strategy in compressed sensing image reconstruction, effectively merging optimization techniques with deep learning through end-to-end training of truncated inferences. Despite their advantages, these algorithms generally require extensive iterations and parameters, potentially limited by storage capacity. Additionally, the image-level transmission at each iterative step does not optimally harness the inter-scale feature information available. To address these issues, we introduce a novel approach in this paper: the $\textbf{M}$ulti-$\textbf{S}$cale $\textbf{D}$ual-$\textbf{A}$ttention $\textbf{U}$nfolding $\textbf{N}$etwork ($\textbf{MSDAUN}$) for compressed sensing image reconstruction. We propose a cross-stage multi-scale deep reconstruction module $\textbf{D}$ as an iterative process, which is composed of multiple attention sub-modules. These include Cross Attention Transformer($\textbf{CAT}$) Modules that enhance the reconstruction with multi-channel inertia, thereby facilitating feature-level transmission and robust information exchange. Concurrently, Texture Attention Transformer($\textbf{TAT}$) Modules are designed to meticulously extract salient reconstruction information, subsequently channeling it into the texture path to effectuate the precise prediction of textural regions, thereby contributing to the meticulous restoration of textural details. Our comprehensive experimental evaluation across diverse datasets confirms that MSDAUN surpasses existing state-of-the-art methods. This work presents significant potential for further advancements and applications in inverse imaging problems and optimization models.

Primary Area: Deep Learning (architectures, deep reinforcement learning, generative models, deep learning theory, etc.)

Paper Checklist Guidelines: I certify that all co-authors of this work have read and commit to adhering to the guidelines in Call for Papers.

Student Author: No

Submission Number: 76