Sample-Optimal Parametric Q-Learning Using Linearly Additive Features

Lin Yang, Mengdi Wang

Abstract: Consider a Markov decision process (MDP) that admits a set of state-action features, which can linearly express the process’s probabilistic transition model. We propose a parametric Q-learning algo...