Stochastic optimization for PCA and PLS

Raman Arora, Andrew Cotter, Karen Livescu, Nathan Srebro

Abstract: We study PCA, PLS, and CCA as stochastic optimization problems, of optimizing a population objective based on a sample. We suggest several stochastic approximation (SA) methods for PCA and PLS, and investigate their empirical performance.