These three directories contain the code for experiments in the paper "Understanding Reinforcement Learning Policies by Identifying Strategic States". 

Please follow the README files in the corresponding directories to run experiments on the three games discussed in the paper: Four Rooms, Door-Key, and Minipacman.

Note: Four Rooms requires Python2 and Door-Key and Minipacman require Python3. This is due to dependencies on other packages.