Robust Reinforcement Learning via Adversarial Training with Langevin Dynamics

Huang Yu-Ting, Parameswaran Kamalaruban, Paul Rolland, Ya-Ping Hsieh, Volkan Cevher

Keywords: deep reinforcement learning, robust reinforcement learning, min-max problem

Abstract: We re-think the Two-Player Reinforcement Learning (RL) as an instance of a distribution sampling problem in infinite dimensions. Using the powerful Stochastic Gradient Langevin Dynamics, we propose a new two-player RL algorithm, which is a sampling variant of the two-player policy gradient method. Our new algorithm consistently outperforms existing baselines, in terms of generalization across differing training and testing conditions, on several MuJoCo environments.

Code: https://anonymous.4open.science/r/658167da-96b7-4689-8dd9-ca3dcaf19dd1/