Adapting to Mixing Time in Stochastic Optimization with Markovian Data

Ron Dorfman, Kfir Yehuda Levy

Abstract: We consider stochastic optimization problems where data is drawn from a Markov chain. Existing methods for this setting crucially rely on knowing the mixing time of the chain, which in real-world a...