Tracking Failure Prediction for Siamese Trackers Based on Channel Feature Statistics

Kyuewang Lee, Hoseok Do, Taegil Ha, Jongwon Choi, Jin Young Choi

Abstract: Failure prediction has rarely been studied for Siamese trackers due to a lack of meaningful analysis of tracking failing cases. In this paper, we provide a meaningful analysis of tracking failure in Siamese trackers. Our analysis includes the statistics of the channel-wise feature correlation between the exemplar and tracked target patches. We observe that the correlation statistics (max, mean, and std) are highly related to the overlapping ratio between tracked and ground-truth bounding boxes. Based on this observation, we devise a tracking failure prediction model that extracts more plentiful factors than simple statistics. The proposed tracking failure prediction model is validated on most-popular tracking benchmark datasets through extensive experiments.