A game theoretic approach to curriculum reinforcement learning

Michalis Smyrnakis, Lan Hoang

Abstract: Current reinforcement learning automated curricu-lum approaches continual learning by updating the environment. The update is often treated as an optimisation problem - with the teacher agent updating the environment to optimise the student's learning. This work proposes an alternative framing of the problem using a game-theoretic formulation. The learning is defined by a leader - follower cooperative game. This formulation provides an approach for multi-agent curriculum learning that improves agent learning and provides more game equilibrium insights. We observed that under this framework, the agents converge faster to perform on the desired outcomes, compared to the reinforcement learning agent baseline.