These python codes are for the paper 
"On the Duality Gap of Constrained Cooperative Multi-Agent Reinforcement Learning"

Run "CCMARL on examples/CCMARL_egs.py" to implemen experiments on Examples 1 and 2. It will generate result figures in "CCMARL on examples/results". The results of the primal-dual algorithm will be printed in the console. 

Run "CCMARL on grid/CCMARL_main_grid.py" to implemen experiments on the constrained grid task. It will generate result figures ("grid_V0.png", "grid_V1.png")  and result data folders in "CCMARL on grid/results".