ICL-NoiseUNet - A Novel In-Context Learning Based Framework For Ultrasound Segmentation With Adaptive Noise Modulation
Keywords: ultrasound segmentation, in-context learning, noise-aware segmentation
Abstract: The complex patterns, artifacts and speckle noise that are present in ultrasound images make precise segmentation very challenging. Existing approaches, such as convolutional neural network architectures and foundation models, have shown promising results across a wide range of tasks. However, they struggle to adapt to the unique characteristics of ultrasound data, leading to poor delineation of anatomical boundaries. For that reason, we propose ICL-NoiseUNet, an in-context-learning segmentation framework that combines guidance from a set of input-output pairs, called the context set, with analytic noise descriptors. More specifically, the model leverages an In-Context Feature Conditioning (ICFC) module to incorporate context examples and a Noise Modulation Block (NMB) that adapts feature representation to ultrasound characteristics. After extensive evaluation across several datasets, ICL-NoiseUNet consistently outperforms state-of-the-art methods, enhancing the segmentation quality. Moreover, ablation studies confirm the synergy effect of contextual conditioning and noise modulation. Overall, these findings pave the way for noise-guided ultrasound segmentation.
Primary Subject Area: Segmentation
Secondary Subject Area: Foundation Models
Registration Requirement: Yes
Reproducibility: https://github.com/johnchart98/ICL-Noise_UNet.git
Visa & Travel: Yes
Read CFP & Author Instructions: Yes
Originality Policy: Yes
Single-blind & Not Under Review Elsewhere: Yes
LLM Policy: Yes
Submission Number: 70
Loading