Nearly Optimal Latent State Decoding in Block MDPs

Yassir Jedra, Junghyun Lee, Alexandre Proutière, Se-Young Yun

Abstract: We consider the problem of model estimation in episodic Block MDPs. In these MDPs, the decision maker has access to rich observations or contexts generated from a small number of latent states. We ...