Variance-Reduced Conservative Policy Iteration

Naman Agarwal, Brian Bullins, Karan Singh

Abstract: We study the sample complexity of reducing reinforcement learning to a sequence of empirical risk minimization problems over the policy space. Such reductions-based algorithms exhibit local converg...