A Joint Optimization Framework of Sparse Coding and Discriminative Clustering

Zhangyang Wang, Yingzhen Yang, Shiyu Chang, Jinyan Li, Simon Fong, Thomas S. Huang

Abstract: Many clustering methods highly depend on extracted features. In this paper, we propose a joint optimization framework in terms of both feature extraction and discriminative clustering. We utilize graph regularized sparse codes as the features, and formulate sparse coding as the constraint for clustering. Two cost functions are developed based on entropy-minimization and maximum-margin clustering principles, respectively, as the objectives to be minimized. Solving such a bi-level optimization mutually reinforces both sparse coding and clustering steps. Experiments on several benchmark datasets verify remarkable performance improvements led by the proposed joint optimization.