Structured covariance estimation via tensor-train decomposition

ICLR 2026 Conference Submission14001 Authors

Keywords: covariance estimation, tensor train, dimension-free bounds, concentration, Kronecker product, CANDECOMP/PARAFAC

TL;DR: Structured covariance estimation with dimension-free concentration bounds

Abstract: We consider a problem of covariance estimation from a sample of i.i.d. high-dimensional random vectors. To avoid the curse of dimensionality, we impose an additional assumption on the structure of the covariance matrix $\Sigma$. To be more precise, we study the case when $\Sigma$ can be approximated by a sum of double Kronecker products of smaller matrices in a tensor train (TT) format. Our setup naturally extends widely known Kronecker sum and CANDECOMP/PARAFAC models but admits richer interaction across modes. We suggest an iterative polynomial time algorithm based on TT-SVD and higher-order orthogonal iteration (HOOI) adapted to Tucker‑2 hybrid structure. We derive non-asymptotic dimension-free bounds on the accuracy of covariance estimation taking into account hidden Kronecker product and tensor train structures. The efficiency of our approach is illustrated with numerical experiments.

Primary Area: learning theory

Submission Number: 14001