LPRR: Locality preserving robust regression based jointly sparse feature extraction

Yufei Zhu, Jiajun Wen, Zhihui Lai, Jie Zhou, Heng Kong

Abstract: Jointly sparse projection learning attracts considerable attention due to its strong interpretability in feature extraction. To address the challenges related to weak discriminating representation in supervised feature extraction, we propose a more powerful regression framework. Based on the framework, we exhibit a new regression model called locality preserving robust regression (LPRR). In LPRR, we first combine the reconstruction error minimization and the projection variance maximization to explore the structured information of the data. Then, the label information is utilized and the low rank representation can be learned to explore the latent correlation structures among different classes. Furthermore, L2,1<math><msub is="true"><mrow is="true"><mi is="true">L</mi></mrow><mrow is="true"><mn is="true">2</mn><mo is="true">,</mo><mn is="true">1</mn></mrow></msub></math>-norm is applied to measure the loss function and regularization terms, enhancing the robustness of the model and ensuring the joint sparsity of the projection matrix. An iterative algorithm is elaborately designed to achieve the optimal solutions of LPRR, in which the subproblem of LPRR can be regarded as a general quadratic problem on the Stiefel manifold. The convergence and the computational complexity of LPRR are analyzed rigorously. Finally, comprehensive experiments demonstrate the competitive performance of the proposed algorithm.