PID Accelerated Value Iteration Algorithm

Amir Massoud Farahmand, Mohammad Ghavamzadeh

Abstract: The convergence rate of Value Iteration (VI), a fundamental procedure in dynamic programming and reinforcement learning, for solving MDPs can be slow when the discount factor is close to one. We pr...