Dual-MambaNet: A Lightweight Dual-Branch Brain Image Segmentation Network Based on Local Attention and Mamba

Feifei Zhang, Fei Shi, Dayong Ren, Zhenhong Jia, Jianyi Wang

Abstract: Brain tissue segmentation is critical for diagnosing and treating brain diseases. While Mamba-based models excel in the medical field, they face performance bottlenecks with high-resolution MRI images, often losing local feature information in complex texture structures. To address these challenges and enable deployment in resource-limited settings, we propose Dual-MambaNet, a lightweight segmentation model based on Mamba. In Dual-MambaNet, we introduce the Outlook attention module to capture local complex textures and structures in brain MRI images. Subsequently, we combined it with the Mamba block to construct a feature extractor (FE) encoder layer to couple local and global features. Additionally, we integrate dual decoder branches and a multi-level pixel contrastive loss function(MPCL) to better integrate local and global features. This method optimizes global feature representation by refining local complex textures and structural details, effectively capturing multi-level features in MRI images. Experimental results on public brain MRI datasets OASIS1 and MRBrainS13 demonstrate that Dual-MambaNet achieves high segmentation accuracy with minimal parameters and computational complexity, making it suitable for deployment in resource-limited medical environments.

External IDs:dblp:conf/icpr/ZhangSRJW24