Occlusion Segmentation: Restore and Segment Invisible Areas for Particle Objects

Jinshi Liu

Abstract:

The occlusion problem has consistently posed a significant challenge in the field of segmentation.
Most existing segmentation methods require additional annotations and fail to capture the contour information of occluded regions, thus not truly addressing the occlusion issue.
Although segmentation tasks involving particle objects also suffer from occlusion problems, the homogeneity of particle objects offers new possibilities for overcoming this challenge.
In this paper, we propose an occlusion segmentation framework for particle objects that does not require additional annotations.
This framework only necessitates instance-level segmentation labels to obtain complete contour information of particle objects, including occluded regions.
First, we decompose the occlusion segmentation task into a generic instance segmentation task and an occlusion repair task for occluded objects.
Then, to train the occlusion repair model with only instance segmentation-level labels, we quantitatively analyze the occlusion phenomenon, including the mathematical descriptions of occlusion relationships, degrees, and distributions.
Next, we geometrically transform and layer overlay the unobscured samples to construct occlusion samples containing labeling information of the occluded regions.
These sample sets are used to train a generative model that predicts the contour information of occluded regions.
Finally, we fine-tune or post-process the pre-segmentation model with the particle objects containing restored complete contour information to achieve the final occlusion segmentation.
We conducted extensive ablation experiments on both the ore-particle dataset and publicly available cell-particle datasets.
The experimental results validate the effectiveness, accuracy, and generalizability of our method.