RANK++LETR: Learn to Rank and Optimize Candidates for Line Segment Detection

Xin Tong, Baojie Tian, Yufei Guo, Zhe Ma

Keywords: line segment detection, RANK++LETR, Transformer, wireframe parsing

Abstract: It is observed that the confidence score may fail to reflect the predicting quality accurately in previous proposal-based line segment detection methods, since the scores and the line locations are predicted simultaneously. We find that the line segment detection performance can be further improved by learning-based line candidate ranking and optimizing strategy. To this end, we build a novel end-to-end line detecting model named RANK++LETR upon deformable DETR architecture, where the encoder is used to select the line candidates while the decoder is applied to rank and optimize these candidates. We design line-aware deformable attention (LADA) module in which attention positions are distributed in a long narrow area and can align well with the elongated geometry of line segments. Moreover, we innovatively apply ranking-based supervision in line segment detection task with the design of contiguous labels according to the detection quality. Experimental results demonstrate that our method outperforms previous SOTA methods in prediction accuracy and gets faster inferring speed than other Transformer-based methods.

Primary Area: Applications (e.g., vision, language, speech and audio, Creative AI)

Submission Number: 16821