Estimation of Markov Chain via Rank-constrained Likelihood

Xudong Li, Mengdi Wang, Anru Zhang

Abstract: This paper studies the estimation of low-rank Markov chains from empirical trajectories. We propose a non-convex estimator based on rank-constrained likelihood maximization. Statistical upper bound...