Evaluating DR_CNN-S5_SEED1 against population in Overcooked-CoordRing6_9 for xpid dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0

k eval/a0:test_return:Overcooked-CoordRing6_9, v [3.0, 0.0, 0.3999999761581421, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 1.5999999046325684, 0.0, 0.0, 0.0, 0.0, 0.0, 10.800000190734863, 0.0, 9.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 2.200000047683716, 0.0, 12.799999237060547, 0.0, 0.0, 0.0, 0.3999999761581421, 0.0, 3.799999952316284, 0.0, 0.0, 0.0, 1.5999999046325684, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [3.0, 0.0, 0.0, 0.0, 1.5999999046325684, 0.0, 10.800000190734863, 0.0, 0.0, 0.0, 2.200000047683716, 0.0, 0.3999999761581421, 0.0, 1.5999999046325684, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [0.3999999761581421, 0.0, 0.0, 0.0, 0.0, 0.0, 9.0, 0.0, 0.0, 0.0, 12.799999237060547, 0.0, 3.799999952316284, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
--------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  0.95+/- 0.3949 (max:  12.8)       |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  0.0+/- 0.0 (max:  0.0)            |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  1.225+/- 0.6824 (max:  10.8)      |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  1.625+/- 0.9513 (max:  12.8)      |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  1.459+/- 0.4567 (max:  11.5)      |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  0.0+/- 0.0 (max:  0.0)            |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  2.372+/- 0.8713 (max:  10.36)     |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  2.006+/- 0.992 (max:  11.5)       |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.001458+/- 0.001073 (max:  0.05) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.0+/- 0.0 (max:  0.0)            |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.00125+/- 0.0008539 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.003125+/- 0.003125 (max:  0.05) |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  0.0                               |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  0.0                               |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  0.0                               |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.0                               |
--------------------------------------------------------------------------------------------------
Evaluating DR_CNN-S5_SEED1 against population in Overcooked-ForcedCoord6_9 for xpid dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0

k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
-----------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0) |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                    |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                    |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                    |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                    |
-----------------------------------------------------------------------------------------
Evaluating DR_CNN-S5_SEED1 against population in Overcooked-CounterCircuit6_9 for xpid dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0

k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.19999998807907104, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.19999998807907104, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  0.004167+/- 0.004167 (max:  0.2) |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  0.0125+/- 0.0125 (max:  0.2)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  0.04146+/- 0.04146 (max:  1.99)  |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  0.1244+/- 0.1244 (max:  1.99)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.0+/- 0.0 (max:  0.0)           |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  0.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  0.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                              |
------------------------------------------------------------------------------------------------------
Evaluating DR_CNN-S5_SEED1 against population in Overcooked-AsymmAdvantages6_9 for xpid dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0

k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [0.0, 1.0, 0.0, 6.399999618530273, 0.0, 0.0, 0.0, 4.599999904632568, 0.0, 44.20000076293945, 0.0, 0.19999998807907104, 0.0, 32.0, 0.0, 60.39999771118164, 0.0, 9.199999809265137, 0.0, 16.399999618530273, 0.0, 7.0, 0.0, 0.19999998807907104, 0.0, 0.5999999642372131, 0.0, 14.59999942779541, 0.0, 0.7999999523162842, 0.0, 1.7999999523162842, 0.0, 26.599998474121094, 0.0, 0.0, 0.0, 0.7999999523162842, 0.0, 15.59999942779541, 0.0, 1.1999999284744263, 0.0, 2.3999998569488525, 0.0, 18.799999237060547, 0.0, 0.0]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.0, 1.0, 0.0, 4.599999904632568, 0.0, 32.0, 0.0, 16.399999618530273, 0.0, 0.5999999642372131, 0.0, 1.7999999523162842, 0.0, 0.7999999523162842, 0.0, 2.3999998569488525]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.0, 6.399999618530273, 0.0, 44.20000076293945, 0.0, 60.39999771118164, 0.0, 7.0, 0.0, 14.59999942779541, 0.0, 26.599998474121094, 0.0, 15.59999942779541, 0.0, 18.799999237060547]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [0.0, 0.0, 0.0, 0.19999998807907104, 0.0, 9.199999809265137, 0.0, 0.19999998807907104, 0.0, 0.7999999523162842, 0.0, 0.0, 0.0, 1.1999999284744263, 0.0, 0.0]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  5.517+/- 1.782 (max:  60.4)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  0.725+/- 0.5715 (max:  9.2)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  3.725+/- 2.144 (max:  32.0)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  12.1+/- 4.503 (max:  60.4)      |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  5.472+/- 1.273 (max:  35.1)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  1.414+/- 0.6869 (max:  9.968)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  4.819+/- 1.914 (max:  27.71)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  10.18+/- 2.912 (max:  35.1)     |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.06771+/- 0.02541 (max:  0.76) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.0+/- 0.0 (max:  0.0)          |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.04187+/- 0.03017 (max:  0.44) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.1612+/- 0.06501 (max:  0.76)  |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                             |
------------------------------------------------------------------------------------------------------
Evaluating DR_CNN-S5_SEED1 against population in Overcooked-CrampedRoom6_9 for xpid dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0

k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [7.799999713897705, 0.0, 95.5999984741211, 0.0, 65.79999542236328, 0.0, 15.0, 0.0, 69.4000015258789, 0.0, 19.0, 0.0, 14.399999618530273, 0.0, 98.79999542236328, 0.0, 6.599999904632568, 0.0, 17.0, 0.0, 89.0, 0.0, 21.19999885559082, 0.0, 8.800000190734863, 0.0, 97.0, 0.0, 23.399999618530273, 0.0, 16.799999237060547, 0.0, 59.79999923706055, 0.0, 12.799999237060547, 0.0, 14.199999809265137, 0.0, 105.19999694824219, 0.0, 13.0, 0.0, 21.0, 0.0, 90.79999542236328, 0.0, 10.0, 0.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [7.799999713897705, 0.0, 15.0, 0.0, 14.399999618530273, 0.0, 17.0, 0.0, 8.800000190734863, 0.0, 16.799999237060547, 0.0, 14.199999809265137, 0.0, 21.0, 0.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [95.5999984741211, 0.0, 69.4000015258789, 0.0, 98.79999542236328, 0.0, 89.0, 0.0, 97.0, 0.0, 59.79999923706055, 0.0, 105.19999694824219, 0.0, 90.79999542236328, 0.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [65.79999542236328, 0.0, 19.0, 0.0, 6.599999904632568, 0.0, 21.19999885559082, 0.0, 23.399999618530273, 0.0, 12.799999237060547, 0.0, 13.0, 0.0, 10.0, 0.0]
--------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  20.67+/- 4.772 (max:  105.2)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  10.74+/- 4.242 (max:  65.8)     |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  7.187+/- 1.998 (max:  21.0)     |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  44.1+/- 11.69 (max:  105.2)     |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  11.87+/- 2.129 (max:  47.28)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  9.75+/- 2.695 (max:  31.6)      |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  6.978+/- 1.844 (max:  17.52)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  18.89+/- 5.173 (max:  47.28)    |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.2175+/- 0.04867 (max:  1.0)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.1394+/- 0.05959 (max:  0.94)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.07687+/- 0.02623 (max:  0.33) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.4362+/- 0.1145 (max:  1.0)    |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  0.0                             |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  0.0                             |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  0.0                             |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.0                             |
--------------------------------------------------------------------------------------------------
Evaluating DR_CNN-S5_SEED2 against population in Overcooked-CoordRing6_9 for xpid SEED_2_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0

k eval/a0:test_return:Overcooked-CoordRing6_9, v [5.599999904632568, 6.0, 20.399999618530273, 19.799999237060547, 16.799999237060547, 17.19999885559082, 14.799999237060547, 15.799999237060547, 28.799999237060547, 33.79999923706055, 17.0, 18.399999618530273, 12.799999237060547, 13.0, 26.399999618530273, 23.600000381469727, 17.0, 18.399999618530273, 14.799999237060547, 13.59999942779541, 19.799999237060547, 19.19999885559082, 13.59999942779541, 16.19999885559082, 15.199999809265137, 14.0, 21.0, 20.19999885559082, 17.600000381469727, 20.799999237060547, 16.0, 14.399999618530273, 28.0, 27.399999618530273, 31.399999618530273, 32.39999771118164, 3.799999952316284, 2.799999952316284, 20.399999618530273, 20.399999618530273, 22.799999237060547, 26.399999618530273, 11.399999618530273, 12.799999237060547, 16.399999618530273, 15.59999942779541, 15.59999942779541, 17.600000381469727]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [5.599999904632568, 6.0, 14.799999237060547, 15.799999237060547, 12.799999237060547, 13.0, 14.799999237060547, 13.59999942779541, 15.199999809265137, 14.0, 16.0, 14.399999618530273, 3.799999952316284, 2.799999952316284, 11.399999618530273, 12.799999237060547]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [20.399999618530273, 19.799999237060547, 28.799999237060547, 33.79999923706055, 26.399999618530273, 23.600000381469727, 19.799999237060547, 19.19999885559082, 21.0, 20.19999885559082, 28.0, 27.399999618530273, 20.399999618530273, 20.399999618530273, 16.399999618530273, 15.59999942779541]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [16.799999237060547, 17.19999885559082, 17.0, 18.399999618530273, 17.0, 18.399999618530273, 13.59999942779541, 16.19999885559082, 17.600000381469727, 20.799999237060547, 31.399999618530273, 32.39999771118164, 22.799999237060547, 26.399999618530273, 15.59999942779541, 17.600000381469727]
-----------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  18.07+/- 0.9793 (max:  33.8)   |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  19.95+/- 1.385 (max:  32.4)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  11.67+/- 1.115 (max:  16.0)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  22.57+/- 1.24 (max:  33.8)     |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  12.57+/- 0.3182 (max:  17.95)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  12.31+/- 0.6169 (max:  17.95)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  12.03+/- 0.5932 (max:  15.05)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  13.38+/- 0.3891 (max:  17.66)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.184+/- 0.02202 (max:  0.6)   |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.1869+/- 0.04031 (max:  0.56) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.08437+/- 0.01557 (max:  0.2) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.2806+/- 0.03748 (max:  0.6)  |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  2.8                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  13.6                           |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  2.8                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  15.6                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  6.94                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  9.666                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  6.94                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  11.16                          |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.06                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.07                           |
-----------------------------------------------------------------------------------------------
Evaluating DR_CNN-S5_SEED2 against population in Overcooked-ForcedCoord6_9 for xpid SEED_2_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0

k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
-----------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0) |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                    |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                    |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                    |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                    |
-----------------------------------------------------------------------------------------
Evaluating DR_CNN-S5_SEED2 against population in Overcooked-CounterCircuit6_9 for xpid SEED_2_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0

k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [6.0, 2.799999952316284, 10.399999618530273, 6.199999809265137, 7.599999904632568, 1.399999976158142, 3.799999952316284, 2.3999998569488525, 5.0, 3.5999999046325684, 4.199999809265137, 0.0, 2.3999998569488525, 1.1999999284744263, 11.0, 4.799999713897705, 6.199999809265137, 1.7999999523162842, 4.199999809265137, 3.0, 13.199999809265137, 10.800000190734863, 10.0, 2.3999998569488525, 4.599999904632568, 1.7999999523162842, 10.800000190734863, 6.799999713897705, 8.800000190734863, 1.7999999523162842, 8.399999618530273, 1.5999999046325684, 10.0, 4.199999809265137, 12.0, 6.399999618530273, 3.799999952316284, 2.200000047683716, 10.800000190734863, 8.0, 7.399999618530273, 1.1999999284744263, 3.1999998092651367, 2.200000047683716, 5.799999713897705, 6.799999713897705, 7.599999904632568, 0.19999998807907104]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [6.0, 2.799999952316284, 3.799999952316284, 2.3999998569488525, 2.3999998569488525, 1.1999999284744263, 4.199999809265137, 3.0, 4.599999904632568, 1.7999999523162842, 8.399999618530273, 1.5999999046325684, 3.799999952316284, 2.200000047683716, 3.1999998092651367, 2.200000047683716]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [10.399999618530273, 6.199999809265137, 5.0, 3.5999999046325684, 11.0, 4.799999713897705, 13.199999809265137, 10.800000190734863, 10.800000190734863, 6.799999713897705, 10.0, 4.199999809265137, 10.800000190734863, 8.0, 5.799999713897705, 6.799999713897705]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [7.599999904632568, 1.399999976158142, 4.199999809265137, 0.0, 6.199999809265137, 1.7999999523162842, 10.0, 2.3999998569488525, 8.800000190734863, 1.7999999523162842, 12.0, 6.399999618530273, 7.399999618530273, 1.1999999284744263, 7.599999904632568, 0.19999998807907104]
-------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  5.433+/- 0.506 (max:  13.2)       |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  4.937+/- 0.9451 (max:  12.0)      |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  3.35+/- 0.4573 (max:  8.4)        |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  8.012+/- 0.7453 (max:  13.2)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  8.302+/- 0.3819 (max:  13.03)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  7.307+/- 0.7994 (max:  10.58)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  7.157+/- 0.3573 (max:  10.27)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  10.44+/- 0.3814 (max:  13.03)     |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.01042+/- 0.002962 (max:  0.1)   |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.0025+/- 0.001443 (max:  0.02)   |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.000625+/- 0.000625 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.02812+/- 0.006965 (max:  0.1)   |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  0.0                               |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                               |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  1.2                               |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  3.6                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  4.75                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  8.146                             |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                               |
-------------------------------------------------------------------------------------------------------
Evaluating DR_CNN-S5_SEED2 against population in Overcooked-AsymmAdvantages6_9 for xpid SEED_2_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0

k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [0.0, 0.7999999523162842, 0.0, 8.199999809265137, 0.0, 0.0, 0.0, 3.799999952316284, 0.0, 42.599998474121094, 0.0, 0.19999998807907104, 0.0, 30.19999885559082, 0.0, 50.39999771118164, 0.0, 8.59999942779541, 0.0, 13.799999237060547, 0.0, 5.599999904632568, 0.0, 0.5999999642372131, 0.0, 1.1999999284744263, 0.0, 16.799999237060547, 0.0, 0.3999999761581421, 0.0, 0.7999999523162842, 0.0, 25.399999618530273, 0.0, 0.19999998807907104, 0.0, 1.5999999046325684, 0.0, 13.199999809265137, 0.0, 2.5999999046325684, 0.0, 2.3999998569488525, 0.0, 19.799999237060547, 0.0, 0.0]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.0, 0.7999999523162842, 0.0, 3.799999952316284, 0.0, 30.19999885559082, 0.0, 13.799999237060547, 0.0, 1.1999999284744263, 0.0, 0.7999999523162842, 0.0, 1.5999999046325684, 0.0, 2.3999998569488525]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.0, 8.199999809265137, 0.0, 42.599998474121094, 0.0, 50.39999771118164, 0.0, 5.599999904632568, 0.0, 16.799999237060547, 0.0, 25.399999618530273, 0.0, 13.199999809265137, 0.0, 19.799999237060547]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [0.0, 0.0, 0.0, 0.19999998807907104, 0.0, 8.59999942779541, 0.0, 0.5999999642372131, 0.0, 0.3999999761581421, 0.0, 0.19999998807907104, 0.0, 2.5999999046325684, 0.0, 0.0]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  5.192+/- 1.612 (max:  50.4)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  0.7875+/- 0.5454 (max:  8.6)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  3.412+/- 1.981 (max:  30.2)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  11.37+/- 4.019 (max:  50.4)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  5.41+/- 1.211 (max:  31.68)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  1.676+/- 0.7238 (max:  9.902)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  5.024+/- 1.983 (max:  27.2)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  9.528+/- 2.696 (max:  31.68)    |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.06604+/- 0.02441 (max:  0.76) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.0+/- 0.0 (max:  0.0)          |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.03875+/- 0.0274 (max:  0.4)   |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.1594+/- 0.0627 (max:  0.76)   |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                             |
------------------------------------------------------------------------------------------------------
Evaluating DR_CNN-S5_SEED2 against population in Overcooked-CrampedRoom6_9 for xpid SEED_2_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0

k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [9.199999809265137, 8.59999942779541, 67.79999542236328, 66.79999542236328, 103.19999694824219, 105.0, 15.399999618530273, 14.799999237060547, 76.5999984741211, 75.19999694824219, 102.5999984741211, 107.0, 20.0, 18.19999885559082, 95.4000015258789, 95.4000015258789, 100.5999984741211, 101.4000015258789, 17.799999237060547, 17.0, 89.4000015258789, 87.19999694824219, 90.19999694824219, 90.19999694824219, 9.59999942779541, 7.0, 76.4000015258789, 75.19999694824219, 100.0, 100.79999542236328, 18.19999885559082, 17.399999618530273, 85.79999542236328, 82.5999984741211, 102.0, 104.79999542236328, 17.600000381469727, 16.600000381469727, 84.19999694824219, 83.0, 100.4000015258789, 103.0, 21.19999885559082, 22.399999618530273, 86.0, 86.79999542236328, 100.79999542236328, 97.5999984741211]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [9.199999809265137, 8.59999942779541, 15.399999618530273, 14.799999237060547, 20.0, 18.19999885559082, 17.799999237060547, 17.0, 9.59999942779541, 7.0, 18.19999885559082, 17.399999618530273, 17.600000381469727, 16.600000381469727, 21.19999885559082, 22.399999618530273]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [67.79999542236328, 66.79999542236328, 76.5999984741211, 75.19999694824219, 95.4000015258789, 95.4000015258789, 89.4000015258789, 87.19999694824219, 76.4000015258789, 75.19999694824219, 85.79999542236328, 82.5999984741211, 84.19999694824219, 83.0, 86.0, 86.79999542236328]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [103.19999694824219, 105.0, 102.5999984741211, 107.0, 100.5999984741211, 101.4000015258789, 90.19999694824219, 90.19999694824219, 100.0, 100.79999542236328, 102.0, 104.79999542236328, 100.4000015258789, 103.0, 100.79999542236328, 97.5999984741211]
-------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  66.13+/- 5.39 (max:  107.0)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  100.6+/- 1.16 (max:  107.0)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  15.69+/- 1.165 (max:  22.4)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  82.11+/- 2.127 (max:  95.4)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  18.98+/- 0.7133 (max:  32.68)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  21.69+/- 1.192 (max:  32.68)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  13.78+/- 0.3937 (max:  15.49)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  21.47+/- 0.7079 (max:  26.1)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.7112+/- 0.05656 (max:  1.0)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.99+/- 0.005083 (max:  1.0)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.1675+/- 0.02118 (max:  0.32) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.9762+/- 0.004366 (max:  1.0) |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  7.0                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  90.2                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  7.0                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  66.8                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  10.34                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  17.46                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  10.34                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  16.84                          |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.02                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.94                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.02                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.95                           |
-------------------------------------------------------------------------------------------------
Evaluating DR_CNN-S5_SEED3 against population in Overcooked-CoordRing6_9 for xpid SEED_3_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [3.0, 0.0, 0.3999999761581421, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 1.5999999046325684, 0.0, 0.0, 0.0, 0.0, 0.0, 10.800000190734863, 0.0, 9.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 2.200000047683716, 0.0, 12.799999237060547, 0.0, 0.0, 0.0, 0.3999999761581421, 0.0, 3.799999952316284, 0.0, 0.0, 0.0, 1.5999999046325684, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [3.0, 0.0, 0.0, 0.0, 1.5999999046325684, 0.0, 10.800000190734863, 0.0, 0.0, 0.0, 2.200000047683716, 0.0, 0.3999999761581421, 0.0, 1.5999999046325684, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [0.3999999761581421, 0.0, 0.0, 0.0, 0.0, 0.0, 9.0, 0.0, 0.0, 0.0, 12.799999237060547, 0.0, 3.799999952316284, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
--------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  0.95+/- 0.3949 (max:  12.8)       |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  0.0+/- 0.0 (max:  0.0)            |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  1.225+/- 0.6824 (max:  10.8)      |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  1.625+/- 0.9513 (max:  12.8)      |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  1.459+/- 0.4567 (max:  11.5)      |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  0.0+/- 0.0 (max:  0.0)            |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  2.372+/- 0.8713 (max:  10.36)     |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  2.006+/- 0.992 (max:  11.5)       |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.001458+/- 0.001073 (max:  0.05) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.0+/- 0.0 (max:  0.0)            |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.00125+/- 0.0008539 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.003125+/- 0.003125 (max:  0.05) |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  0.0                               |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  0.0                               |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  0.0                               |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.0                               |
--------------------------------------------------------------------------------------------------
Evaluating DR_CNN-S5_SEED3 against population in Overcooked-ForcedCoord6_9 for xpid SEED_3_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
-----------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0) |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                    |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                    |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                    |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                    |
-----------------------------------------------------------------------------------------
Evaluating DR_CNN-S5_SEED3 against population in Overcooked-CounterCircuit6_9 for xpid SEED_3_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.19999998807907104, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.19999998807907104, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  0.004167+/- 0.004167 (max:  0.2) |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  0.0125+/- 0.0125 (max:  0.2)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  0.04146+/- 0.04146 (max:  1.99)  |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  0.1244+/- 0.1244 (max:  1.99)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.0+/- 0.0 (max:  0.0)           |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  0.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  0.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                              |
------------------------------------------------------------------------------------------------------
Evaluating DR_CNN-S5_SEED3 against population in Overcooked-AsymmAdvantages6_9 for xpid SEED_3_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [0.0, 1.0, 0.0, 6.399999618530273, 0.0, 0.0, 0.0, 4.599999904632568, 0.0, 44.20000076293945, 0.0, 0.19999998807907104, 0.0, 32.0, 0.0, 60.39999771118164, 0.0, 9.199999809265137, 0.0, 16.399999618530273, 0.0, 7.0, 0.0, 0.19999998807907104, 0.0, 0.5999999642372131, 0.0, 14.59999942779541, 0.0, 0.7999999523162842, 0.0, 1.7999999523162842, 0.0, 26.599998474121094, 0.0, 0.0, 0.0, 0.7999999523162842, 0.0, 15.59999942779541, 0.0, 1.1999999284744263, 0.0, 2.3999998569488525, 0.0, 18.799999237060547, 0.0, 0.0]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.0, 1.0, 0.0, 4.599999904632568, 0.0, 32.0, 0.0, 16.399999618530273, 0.0, 0.5999999642372131, 0.0, 1.7999999523162842, 0.0, 0.7999999523162842, 0.0, 2.3999998569488525]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.0, 6.399999618530273, 0.0, 44.20000076293945, 0.0, 60.39999771118164, 0.0, 7.0, 0.0, 14.59999942779541, 0.0, 26.599998474121094, 0.0, 15.59999942779541, 0.0, 18.799999237060547]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [0.0, 0.0, 0.0, 0.19999998807907104, 0.0, 9.199999809265137, 0.0, 0.19999998807907104, 0.0, 0.7999999523162842, 0.0, 0.0, 0.0, 1.1999999284744263, 0.0, 0.0]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  5.517+/- 1.782 (max:  60.4)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  0.725+/- 0.5715 (max:  9.2)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  3.725+/- 2.144 (max:  32.0)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  12.1+/- 4.503 (max:  60.4)      |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  5.472+/- 1.273 (max:  35.1)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  1.414+/- 0.6869 (max:  9.968)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  4.819+/- 1.914 (max:  27.71)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  10.18+/- 2.912 (max:  35.1)     |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.06771+/- 0.02541 (max:  0.76) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.0+/- 0.0 (max:  0.0)          |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.04187+/- 0.03017 (max:  0.44) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.1612+/- 0.06501 (max:  0.76)  |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                             |
------------------------------------------------------------------------------------------------------
Evaluating DR_CNN-S5_SEED3 against population in Overcooked-CrampedRoom6_9 for xpid SEED_3_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [7.799999713897705, 0.0, 95.5999984741211, 0.0, 65.79999542236328, 0.0, 15.0, 0.0, 69.4000015258789, 0.0, 19.0, 0.0, 14.399999618530273, 0.0, 98.79999542236328, 0.0, 6.599999904632568, 0.0, 17.0, 0.0, 89.0, 0.0, 21.19999885559082, 0.0, 8.800000190734863, 0.0, 97.0, 0.0, 23.399999618530273, 0.0, 16.799999237060547, 0.0, 59.79999923706055, 0.0, 12.799999237060547, 0.0, 14.199999809265137, 0.0, 105.19999694824219, 0.0, 13.0, 0.0, 21.0, 0.0, 90.79999542236328, 0.0, 10.0, 0.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [7.799999713897705, 0.0, 15.0, 0.0, 14.399999618530273, 0.0, 17.0, 0.0, 8.800000190734863, 0.0, 16.799999237060547, 0.0, 14.199999809265137, 0.0, 21.0, 0.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [95.5999984741211, 0.0, 69.4000015258789, 0.0, 98.79999542236328, 0.0, 89.0, 0.0, 97.0, 0.0, 59.79999923706055, 0.0, 105.19999694824219, 0.0, 90.79999542236328, 0.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [65.79999542236328, 0.0, 19.0, 0.0, 6.599999904632568, 0.0, 21.19999885559082, 0.0, 23.399999618530273, 0.0, 12.799999237060547, 0.0, 13.0, 0.0, 10.0, 0.0]
--------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  20.67+/- 4.772 (max:  105.2)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  10.74+/- 4.242 (max:  65.8)     |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  7.187+/- 1.998 (max:  21.0)     |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  44.1+/- 11.69 (max:  105.2)     |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  11.87+/- 2.129 (max:  47.28)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  9.75+/- 2.695 (max:  31.6)      |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  6.978+/- 1.844 (max:  17.52)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  18.89+/- 5.173 (max:  47.28)    |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.2175+/- 0.04867 (max:  1.0)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.1394+/- 0.05959 (max:  0.94)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.07687+/- 0.02623 (max:  0.33) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.4362+/- 0.1145 (max:  1.0)    |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  0.0                             |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  0.0                             |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  0.0                             |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.0                             |
--------------------------------------------------------------------------------------------------
Evaluating PLR_CNN-S5_SEED1 against population in Overcooked-CoordRing6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [6.599999904632568, 5.0, 16.19999885559082, 19.0, 23.0, 22.399999618530273, 16.0, 14.0, 31.599998474121094, 34.0, 21.0, 21.600000381469727, 12.199999809265137, 13.799999237060547, 23.399999618530273, 23.0, 23.19999885559082, 23.0, 14.799999237060547, 10.399999618530273, 17.19999885559082, 16.600000381469727, 20.19999885559082, 21.799999237060547, 17.0, 16.399999618530273, 22.399999618530273, 21.0, 23.19999885559082, 24.600000381469727, 15.59999942779541, 17.0, 26.399999618530273, 30.0, 36.0, 36.0, 6.599999904632568, 6.599999904632568, 21.799999237060547, 20.799999237060547, 31.599998474121094, 31.799999237060547, 15.0, 15.399999618530273, 21.19999885559082, 19.19999885559082, 22.399999618530273, 23.600000381469727]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [6.599999904632568, 5.0, 16.0, 14.0, 12.199999809265137, 13.799999237060547, 14.799999237060547, 10.399999618530273, 17.0, 16.399999618530273, 15.59999942779541, 17.0, 6.599999904632568, 6.599999904632568, 15.0, 15.399999618530273]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [16.19999885559082, 19.0, 31.599998474121094, 34.0, 23.399999618530273, 23.0, 17.19999885559082, 16.600000381469727, 22.399999618530273, 21.0, 26.399999618530273, 30.0, 21.799999237060547, 20.799999237060547, 21.19999885559082, 19.19999885559082]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [23.0, 22.399999618530273, 21.0, 21.600000381469727, 23.19999885559082, 23.0, 20.19999885559082, 21.799999237060547, 23.19999885559082, 24.600000381469727, 36.0, 36.0, 31.599998474121094, 31.799999237060547, 22.399999618530273, 23.600000381469727]
------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  20.24+/- 1.062 (max:  36.0)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  25.34+/- 1.324 (max:  36.0)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  12.65+/- 1.053 (max:  17.0)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  22.74+/- 1.322 (max:  34.0)     |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  12.17+/- 0.242 (max:  16.22)    |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  11.37+/- 0.4545 (max:  14.45)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  12.17+/- 0.4191 (max:  14.86)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  12.95+/- 0.2916 (max:  16.22)   |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.234+/- 0.02608 (max:  0.72)   |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.3194+/- 0.04962 (max:  0.72)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.09187+/- 0.01412 (max:  0.18) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.2906+/- 0.04108 (max:  0.69)  |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  5.0                             |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  20.2                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  5.0                             |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  16.2                            |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  8.818                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  8.818                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  9.11                            |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  11.6                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.15                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.12                            |
------------------------------------------------------------------------------------------------
Evaluating PLR_CNN-S5_SEED1 against population in Overcooked-ForcedCoord6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [4.400000095367432, 0.0, 6.0, 0.19999998807907104, 3.799999952316284, 0.7999999523162842, 3.0, 0.0, 3.799999952316284, 0.3999999761581421, 3.5999999046325684, 0.0, 4.199999809265137, 0.19999998807907104, 5.599999904632568, 0.5999999642372131, 2.3999998569488525, 0.7999999523162842, 4.400000095367432, 0.19999998807907104, 4.199999809265137, 0.0, 2.5999999046325684, 0.0, 3.1999998092651367, 0.0, 5.199999809265137, 0.0, 5.199999809265137, 0.0, 3.1999998092651367, 0.19999998807907104, 3.3999998569488525, 0.0, 1.5999999046325684, 0.0, 2.5999999046325684, 0.0, 2.200000047683716, 0.0, 1.1999999284744263, 0.0, 5.400000095367432, 0.0, 6.199999809265137, 0.0, 6.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [4.400000095367432, 0.0, 3.0, 0.0, 4.199999809265137, 0.19999998807907104, 4.400000095367432, 0.19999998807907104, 3.1999998092651367, 0.0, 3.1999998092651367, 0.19999998807907104, 2.5999999046325684, 0.0, 5.400000095367432, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [6.0, 0.19999998807907104, 3.799999952316284, 0.3999999761581421, 5.599999904632568, 0.5999999642372131, 4.199999809265137, 0.0, 5.199999809265137, 0.0, 3.3999998569488525, 0.0, 2.200000047683716, 0.0, 6.199999809265137, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [3.799999952316284, 0.7999999523162842, 3.5999999046325684, 0.0, 2.3999998569488525, 0.7999999523162842, 2.5999999046325684, 0.0, 5.199999809265137, 0.0, 1.5999999046325684, 0.0, 1.1999999284744263, 0.0, 6.0, 0.0]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  2.017+/- 0.31 (max:  6.2)           |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  1.75+/- 0.4968 (max:  6.0)          |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  1.937+/- 0.5075 (max:  5.4)         |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  2.362+/- 0.6211 (max:  6.2)         |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  4.349+/- 0.5361 (max:  10.08)       |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  4.044+/- 0.8899 (max:  9.165)       |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  4.286+/- 0.9403 (max:  8.879)       |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  4.716+/- 1.005 (max:  10.08)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0008333+/- 0.0005012 (max:  0.02) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0)              |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.000625+/- 0.000625 (max:  0.01)   |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.001875+/- 0.00136 (max:  0.02)    |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                                 |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                                 |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                                 |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                                 |
------------------------------------------------------------------------------------------------------
Evaluating PLR_CNN-S5_SEED1 against population in Overcooked-CounterCircuit6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [5.0, 2.799999952316284, 7.399999618530273, 7.599999904632568, 1.5999999046325684, 2.5999999046325684, 3.3999998569488525, 3.0, 5.199999809265137, 4.0, 0.5999999642372131, 0.0, 4.799999713897705, 2.3999998569488525, 13.799999237060547, 5.400000095367432, 9.0, 4.199999809265137, 5.599999904632568, 2.200000047683716, 15.799999237060547, 12.199999809265137, 4.799999713897705, 1.1999999284744263, 4.400000095367432, 3.5999999046325684, 12.199999809265137, 11.399999618530273, 4.599999904632568, 0.5999999642372131, 7.0, 2.5999999046325684, 9.199999809265137, 5.400000095367432, 5.400000095367432, 2.200000047683716, 4.0, 2.3999998569488525, 7.199999809265137, 6.199999809265137, 2.799999952316284, 0.3999999761581421, 5.199999809265137, 1.7999999523162842, 7.199999809265137, 8.800000190734863, 4.599999904632568, 0.3999999761581421]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [5.0, 2.799999952316284, 3.3999998569488525, 3.0, 4.799999713897705, 2.3999998569488525, 5.599999904632568, 2.200000047683716, 4.400000095367432, 3.5999999046325684, 7.0, 2.5999999046325684, 4.0, 2.3999998569488525, 5.199999809265137, 1.7999999523162842]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [7.399999618530273, 7.599999904632568, 5.199999809265137, 4.0, 13.799999237060547, 5.400000095367432, 15.799999237060547, 12.199999809265137, 12.199999809265137, 11.399999618530273, 9.199999809265137, 5.400000095367432, 7.199999809265137, 6.199999809265137, 7.199999809265137, 8.800000190734863]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [1.5999999046325684, 2.5999999046325684, 0.5999999642372131, 0.0, 9.0, 4.199999809265137, 4.799999713897705, 1.1999999284744263, 4.599999904632568, 0.5999999642372131, 5.400000095367432, 2.200000047683716, 2.799999952316284, 0.3999999761581421, 4.599999904632568, 0.3999999761581421]
-------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  5.087+/- 0.5241 (max:  15.8)      |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  2.812+/- 0.616 (max:  9.0)        |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  3.762+/- 0.3652 (max:  7.0)       |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  8.687+/- 0.8618 (max:  15.8)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  8.045+/- 0.3831 (max:  12.11)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  5.964+/- 0.7107 (max:  9.95)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  7.664+/- 0.3013 (max:  9.95)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  10.51+/- 0.2844 (max:  12.11)     |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.01083+/- 0.002627 (max:  0.06)  |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.000625+/- 0.000625 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.00125+/- 0.0008539 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.03062+/- 0.004956 (max:  0.06)  |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  0.0                               |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                               |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  1.8                               |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  4.0                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  5.724                             |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  8.485                             |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                               |
-------------------------------------------------------------------------------------------------------
Evaluating PLR_CNN-S5_SEED1 against population in Overcooked-AsymmAdvantages6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [0.3999999761581421, 8.199999809265137, 0.0, 21.19999885559082, 0.19999998807907104, 10.0, 0.0, 10.199999809265137, 0.0, 45.79999923706055, 0.19999998807907104, 6.799999713897705, 0.0, 44.79999923706055, 0.5999999642372131, 63.39999771118164, 0.3999999761581421, 19.399999618530273, 0.0, 25.599998474121094, 0.0, 16.600000381469727, 0.0, 12.199999809265137, 0.0, 8.59999942779541, 0.0, 30.399999618530273, 0.0, 13.199999809265137, 0.0, 9.59999942779541, 0.0, 35.79999923706055, 0.3999999761581421, 7.599999904632568, 0.0, 7.799999713897705, 0.0, 30.599998474121094, 0.19999998807907104, 14.399999618530273, 0.19999998807907104, 9.59999942779541, 0.0, 27.0, 0.19999998807907104, 6.799999713897705]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.3999999761581421, 8.199999809265137, 0.0, 10.199999809265137, 0.0, 44.79999923706055, 0.0, 25.599998474121094, 0.0, 8.59999942779541, 0.0, 9.59999942779541, 0.0, 7.799999713897705, 0.19999998807907104, 9.59999942779541]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.0, 21.19999885559082, 0.0, 45.79999923706055, 0.5999999642372131, 63.39999771118164, 0.0, 16.600000381469727, 0.0, 30.399999618530273, 0.0, 35.79999923706055, 0.0, 30.599998474121094, 0.0, 27.0]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [0.19999998807907104, 10.0, 0.19999998807907104, 6.799999713897705, 0.3999999761581421, 19.399999618530273, 0.0, 12.199999809265137, 0.0, 13.199999809265137, 0.3999999761581421, 7.599999904632568, 0.19999998807907104, 14.399999618530273, 0.19999998807907104, 6.799999713897705]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  10.17+/- 2.111 (max:  63.4)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  5.75+/- 1.618 (max:  19.4)      |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  7.812+/- 3.011 (max:  44.8)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  16.96+/- 5.046 (max:  63.4)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  8.741+/- 1.279 (max:  28.15)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  7.385+/- 1.53 (max:  15.8)      |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  7.799+/- 2.103 (max:  27.87)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  11.04+/- 2.843 (max:  28.15)    |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.13+/- 0.03234 (max:  0.89)    |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.04687+/- 0.01736 (max:  0.23) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.08937+/- 0.0458 (max:  0.69)  |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.2537+/- 0.07644 (max:  0.89)  |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                             |
------------------------------------------------------------------------------------------------------
Evaluating PLR_CNN-S5_SEED1 against population in Overcooked-CrampedRoom6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [8.199999809265137, 6.799999713897705, 70.0, 70.0, 102.79999542236328, 103.5999984741211, 13.399999618530273, 13.399999618530273, 79.0, 70.0, 105.19999694824219, 108.79999542236328, 16.799999237060547, 15.199999809265137, 97.4000015258789, 95.79999542236328, 112.39999389648438, 110.0, 16.0, 15.0, 89.5999984741211, 80.19999694824219, 82.19999694824219, 84.79999542236328, 6.399999618530273, 7.0, 66.0, 68.19999694824219, 99.4000015258789, 107.39999389648438, 15.799999237060547, 16.799999237060547, 94.0, 87.5999984741211, 109.39999389648438, 104.79999542236328, 15.59999942779541, 15.59999942779541, 84.79999542236328, 76.4000015258789, 105.5999984741211, 104.0, 14.799999237060547, 15.199999809265137, 92.79999542236328, 86.0, 111.5999984741211, 108.79999542236328]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [8.199999809265137, 6.799999713897705, 13.399999618530273, 13.399999618530273, 16.799999237060547, 15.199999809265137, 16.0, 15.0, 6.399999618530273, 7.0, 15.799999237060547, 16.799999237060547, 15.59999942779541, 15.59999942779541, 14.799999237060547, 15.199999809265137]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [70.0, 70.0, 79.0, 70.0, 97.4000015258789, 95.79999542236328, 89.5999984741211, 80.19999694824219, 66.0, 68.19999694824219, 94.0, 87.5999984741211, 84.79999542236328, 76.4000015258789, 92.79999542236328, 86.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [102.79999542236328, 103.5999984741211, 105.19999694824219, 108.79999542236328, 112.39999389648438, 110.0, 82.19999694824219, 84.79999542236328, 99.4000015258789, 107.39999389648438, 109.39999389648438, 104.79999542236328, 105.5999984741211, 104.0, 111.5999984741211, 108.79999542236328]
-------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  66.26+/- 5.743 (max:  112.4)   |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  103.8+/- 2.162 (max:  112.4)   |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  13.25+/- 0.9498 (max:  16.8)   |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  81.74+/- 2.679 (max:  97.4)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  20.45+/- 0.9273 (max:  32.84)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  21.97+/- 0.8477 (max:  29.82)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  13.05+/- 0.4577 (max:  15.31)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  26.32+/- 1.025 (max:  32.84)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.6823+/- 0.05864 (max:  1.0)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.9875+/- 0.005809 (max:  1.0) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.1181+/- 0.01651 (max:  0.18) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.9412+/- 0.01103 (max:  1.0)  |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  6.4                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  82.2                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  6.4                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  66.0                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  9.887                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  18.59                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  9.887                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  20.3                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.01                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.93                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.01                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.85                           |
-------------------------------------------------------------------------------------------------
Evaluating PLR_CNN-S5_SEED2 against population in Overcooked-CoordRing6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [6.799999713897705, 5.400000095367432, 17.0, 18.19999885559082, 22.0, 21.19999885559082, 14.59999942779541, 13.0, 32.0, 30.599998474121094, 21.399999618530273, 21.600000381469727, 11.199999809265137, 12.59999942779541, 24.399999618530273, 24.0, 22.799999237060547, 22.600000381469727, 16.600000381469727, 11.800000190734863, 14.799999237060547, 15.199999809265137, 18.600000381469727, 19.399999618530273, 14.399999618530273, 13.59999942779541, 19.19999885559082, 17.0, 22.0, 23.399999618530273, 13.59999942779541, 14.199999809265137, 22.600000381469727, 24.799999237060547, 34.39999771118164, 34.79999923706055, 3.799999952316284, 5.0, 15.799999237060547, 17.600000381469727, 24.799999237060547, 25.0, 13.0, 12.0, 10.199999809265137, 12.199999809265137, 9.800000190734863, 10.399999618530273]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [6.799999713897705, 5.400000095367432, 14.59999942779541, 13.0, 11.199999809265137, 12.59999942779541, 16.600000381469727, 11.800000190734863, 14.399999618530273, 13.59999942779541, 13.59999942779541, 14.199999809265137, 3.799999952316284, 5.0, 13.0, 12.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [17.0, 18.19999885559082, 32.0, 30.599998474121094, 24.399999618530273, 24.0, 14.799999237060547, 15.199999809265137, 19.19999885559082, 17.0, 22.600000381469727, 24.799999237060547, 15.799999237060547, 17.600000381469727, 10.199999809265137, 12.199999809265137]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [22.0, 21.19999885559082, 21.399999618530273, 21.600000381469727, 22.799999237060547, 22.600000381469727, 18.600000381469727, 19.399999618530273, 22.0, 23.399999618530273, 34.39999771118164, 34.79999923706055, 24.799999237060547, 25.0, 9.800000190734863, 10.399999618530273]
------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  17.74+/- 1.045 (max:  34.8)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  22.14+/- 1.633 (max:  34.8)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  11.35+/- 0.972 (max:  16.6)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  19.72+/- 1.545 (max:  32.0)     |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  11.87+/- 0.265 (max:  14.73)    |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  10.88+/- 0.4691 (max:  14.16)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  11.98+/- 0.4862 (max:  14.17)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  12.76+/- 0.2903 (max:  14.73)   |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.1806+/- 0.02446 (max:  0.73)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.24+/- 0.05151 (max:  0.73)    |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.07625+/- 0.01217 (max:  0.13) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.2256+/- 0.04152 (max:  0.58)  |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  3.8                             |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  9.8                             |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  3.8                             |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  10.2                            |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  7.618                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  7.618                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  7.846                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  11.28                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.02                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.04                            |
------------------------------------------------------------------------------------------------
Evaluating PLR_CNN-S5_SEED2 against population in Overcooked-ForcedCoord6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [3.1999998092651367, 0.19999998807907104, 2.799999952316284, 0.7999999523162842, 2.799999952316284, 2.0, 2.799999952316284, 0.7999999523162842, 1.7999999523162842, 0.7999999523162842, 1.1999999284744263, 0.7999999523162842, 1.0, 0.5999999642372131, 2.3999998569488525, 0.7999999523162842, 2.3999998569488525, 1.399999976158142, 1.5999999046325684, 1.1999999284744263, 2.200000047683716, 1.399999976158142, 0.3999999761581421, 1.399999976158142, 2.3999998569488525, 1.0, 4.199999809265137, 1.7999999523162842, 1.5999999046325684, 0.5999999642372131, 1.0, 0.19999998807907104, 0.5999999642372131, 0.19999998807907104, 1.0, 0.5999999642372131, 1.1999999284744263, 0.3999999761581421, 1.0, 0.19999998807907104, 0.3999999761581421, 0.7999999523162842, 2.5999999046325684, 0.19999998807907104, 2.200000047683716, 0.3999999761581421, 1.7999999523162842, 0.19999998807907104]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [3.1999998092651367, 0.19999998807907104, 2.799999952316284, 0.7999999523162842, 1.0, 0.5999999642372131, 1.5999999046325684, 1.1999999284744263, 2.3999998569488525, 1.0, 1.0, 0.19999998807907104, 1.1999999284744263, 0.3999999761581421, 2.5999999046325684, 0.19999998807907104]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [2.799999952316284, 0.7999999523162842, 1.7999999523162842, 0.7999999523162842, 2.3999998569488525, 0.7999999523162842, 2.200000047683716, 1.399999976158142, 4.199999809265137, 1.7999999523162842, 0.5999999642372131, 0.19999998807907104, 1.0, 0.19999998807907104, 2.200000047683716, 0.3999999761581421]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [2.799999952316284, 2.0, 1.1999999284744263, 0.7999999523162842, 2.3999998569488525, 1.399999976158142, 0.3999999761581421, 1.399999976158142, 1.5999999046325684, 0.5999999642372131, 1.0, 0.5999999642372131, 0.3999999761581421, 0.7999999523162842, 1.7999999523162842, 0.19999998807907104]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  1.321+/- 0.1358 (max:  4.2)         |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  1.212+/- 0.1893 (max:  2.8)         |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  1.275+/- 0.2442 (max:  3.2)         |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  1.475+/- 0.2744 (max:  4.2)         |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  4.608+/- 0.2413 (max:  8.623)       |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  4.51+/- 0.3564 (max:  6.94)         |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  4.475+/- 0.4438 (max:  7.332)       |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  4.84+/- 0.467 (max:  8.623)         |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0002083+/- 0.0002083 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0)              |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0)              |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.000625+/- 0.000625 (max:  0.01)   |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.2                                 |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.2                                 |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.2                                 |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.2                                 |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  1.99                                |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  1.99                                |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  1.99                                |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  1.99                                |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                                 |
------------------------------------------------------------------------------------------------------
Evaluating PLR_CNN-S5_SEED2 against population in Overcooked-CounterCircuit6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [2.200000047683716, 1.1999999284744263, 2.5999999046325684, 2.5999999046325684, 0.5999999642372131, 1.399999976158142, 1.0, 1.399999976158142, 1.5999999046325684, 2.799999952316284, 1.0, 0.0, 4.400000095367432, 1.399999976158142, 10.59999942779541, 4.799999713897705, 6.199999809265137, 3.0, 3.1999998092651367, 1.1999999284744263, 8.800000190734863, 7.799999713897705, 4.400000095367432, 1.7999999523162842, 2.5999999046325684, 2.799999952316284, 9.800000190734863, 5.0, 5.799999713897705, 2.0, 3.5999999046325684, 1.5999999046325684, 5.199999809265137, 3.799999952316284, 3.1999998092651367, 1.1999999284744263, 0.19999998807907104, 1.399999976158142, 1.0, 0.7999999523162842, 1.399999976158142, 1.1999999284744263, 3.799999952316284, 3.1999998092651367, 2.0, 1.7999999523162842, 1.7999999523162842, 0.3999999761581421]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [2.200000047683716, 1.1999999284744263, 1.0, 1.399999976158142, 4.400000095367432, 1.399999976158142, 3.1999998092651367, 1.1999999284744263, 2.5999999046325684, 2.799999952316284, 3.5999999046325684, 1.5999999046325684, 0.19999998807907104, 1.399999976158142, 3.799999952316284, 3.1999998092651367]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [2.5999999046325684, 2.5999999046325684, 1.5999999046325684, 2.799999952316284, 10.59999942779541, 4.799999713897705, 8.800000190734863, 7.799999713897705, 9.800000190734863, 5.0, 5.199999809265137, 3.799999952316284, 1.0, 0.7999999523162842, 2.0, 1.7999999523162842]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [0.5999999642372131, 1.399999976158142, 1.0, 0.0, 6.199999809265137, 3.0, 4.400000095367432, 1.7999999523162842, 5.799999713897705, 2.0, 3.1999998092651367, 1.1999999284744263, 1.399999976158142, 1.1999999284744263, 1.7999999523162842, 0.3999999761581421]
-------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  2.95+/- 0.3522 (max:  10.6)       |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  2.212+/- 0.4617 (max:  6.2)       |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  2.2+/- 0.3 (max:  4.4)            |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  4.437+/- 0.8009 (max:  10.6)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  6.484+/- 0.35 (max:  12.8)        |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  5.596+/- 0.5967 (max:  9.25)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  5.967+/- 0.4242 (max:  8.34)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  7.889+/- 0.6428 (max:  12.8)      |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.004167+/- 0.001903 (max:  0.08) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.000625+/- 0.000625 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.000625+/- 0.000625 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.01125+/- 0.005313 (max:  0.08)  |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  0.0                               |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                               |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  0.2                               |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  0.8                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  1.99                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  3.919                             |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                               |
-------------------------------------------------------------------------------------------------------
Evaluating PLR_CNN-S5_SEED2 against population in Overcooked-AsymmAdvantages6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [1.1999999284744263, 7.0, 5.799999713897705, 16.399999618530273, 1.7999999523162842, 7.799999713897705, 2.0, 10.59999942779541, 4.0, 47.79999923706055, 1.5999999046325684, 10.199999809265137, 3.3999998569488525, 40.599998474121094, 5.400000095367432, 66.79999542236328, 2.5999999046325684, 17.19999885559082, 4.0, 27.399999618530273, 4.199999809265137, 16.19999885559082, 1.5999999046325684, 13.59999942779541, 2.200000047683716, 6.599999904632568, 4.799999713897705, 28.19999885559082, 4.799999713897705, 15.199999809265137, 2.200000047683716, 8.199999809265137, 5.199999809265137, 33.20000076293945, 2.5999999046325684, 11.0, 1.0, 7.199999809265137, 5.400000095367432, 29.0, 1.0, 16.0, 1.399999976158142, 11.0, 5.599999904632568, 31.599998474121094, 2.0, 7.599999904632568]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [1.1999999284744263, 7.0, 2.0, 10.59999942779541, 3.3999998569488525, 40.599998474121094, 4.0, 27.399999618530273, 2.200000047683716, 6.599999904632568, 2.200000047683716, 8.199999809265137, 1.0, 7.199999809265137, 1.399999976158142, 11.0]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [5.799999713897705, 16.399999618530273, 4.0, 47.79999923706055, 5.400000095367432, 66.79999542236328, 4.199999809265137, 16.19999885559082, 4.799999713897705, 28.19999885559082, 5.199999809265137, 33.20000076293945, 5.400000095367432, 29.0, 5.599999904632568, 31.599998474121094]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [1.7999999523162842, 7.799999713897705, 1.5999999046325684, 10.199999809265137, 2.5999999046325684, 17.19999885559082, 1.5999999046325684, 13.59999942779541, 4.799999713897705, 15.199999809265137, 2.5999999046325684, 11.0, 1.0, 16.0, 2.0, 7.599999904632568]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  11.71+/- 1.985 (max:  66.8)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  7.287+/- 1.46 (max:  17.2)      |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  8.5+/- 2.688 (max:  40.6)       |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  19.35+/- 4.669 (max:  66.8)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  12.37+/- 0.9426 (max:  29.58)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  10.65+/- 1.203 (max:  17.67)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  10.46+/- 1.462 (max:  26.15)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  15.99+/- 1.858 (max:  29.58)    |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.1371+/- 0.03183 (max:  0.91)  |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.065+/- 0.01895 (max:  0.2)    |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.08812+/- 0.04367 (max:  0.61) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.2581+/- 0.07598 (max:  0.91)  |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  1.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  1.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  1.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  4.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  4.359                           |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  4.359                           |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  4.359                           |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  8.998                           |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.01                            |
------------------------------------------------------------------------------------------------------
Evaluating PLR_CNN-S5_SEED2 against population in Overcooked-CrampedRoom6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [7.599999904632568, 9.800000190734863, 65.4000015258789, 61.39999771118164, 92.79999542236328, 89.5999984741211, 14.799999237060547, 14.799999237060547, 67.5999984741211, 64.5999984741211, 85.4000015258789, 85.79999542236328, 16.799999237060547, 16.19999885559082, 79.0, 90.0, 83.0, 82.5999984741211, 14.799999237060547, 17.399999618530273, 79.4000015258789, 79.0, 73.19999694824219, 66.4000015258789, 8.399999618530273, 9.0, 73.19999694824219, 64.79999542236328, 80.79999542236328, 78.0, 16.799999237060547, 14.59999942779541, 77.0, 74.5999984741211, 89.0, 82.0, 14.199999809265137, 13.59999942779541, 73.79999542236328, 70.79999542236328, 82.79999542236328, 80.4000015258789, 17.600000381469727, 16.19999885559082, 83.5999984741211, 79.19999694824219, 82.19999694824219, 86.79999542236328]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [7.599999904632568, 9.800000190734863, 14.799999237060547, 14.799999237060547, 16.799999237060547, 16.19999885559082, 14.799999237060547, 17.399999618530273, 8.399999618530273, 9.0, 16.799999237060547, 14.59999942779541, 14.199999809265137, 13.59999942779541, 17.600000381469727, 16.19999885559082]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [65.4000015258789, 61.39999771118164, 67.5999984741211, 64.5999984741211, 79.0, 90.0, 79.4000015258789, 79.0, 73.19999694824219, 64.79999542236328, 77.0, 74.5999984741211, 73.79999542236328, 70.79999542236328, 83.5999984741211, 79.19999694824219]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [92.79999542236328, 89.5999984741211, 85.4000015258789, 85.79999542236328, 83.0, 82.5999984741211, 73.19999694824219, 66.4000015258789, 80.79999542236328, 78.0, 89.0, 82.0, 82.79999542236328, 80.4000015258789, 82.19999694824219, 86.79999542236328]
-------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  56.81+/- 4.538 (max:  92.8)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  82.55+/- 1.595 (max:  92.8)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  13.91+/- 0.8347 (max:  17.6)   |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  73.96+/- 1.959 (max:  90.0)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  21.84+/- 0.9106 (max:  32.97)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  25.4+/- 0.6193 (max:  29.1)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  13.69+/- 0.433 (max:  16.42)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  26.42+/- 0.745 (max:  32.97)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.6762+/- 0.05639 (max:  1.0)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.965+/- 0.008165 (max:  1.0)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.1337+/- 0.01741 (max:  0.23) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.93+/- 0.006831 (max:  0.99)  |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  7.6                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  66.4                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  7.6                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  61.4                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  10.65                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  19.9                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  10.65                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  20.95                          |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.02                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.87                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.02                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.88                           |
-------------------------------------------------------------------------------------------------
Evaluating PLR_CNN-S5_SEED3 against population in Overcooked-CoordRing6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [4.400000095367432, 3.5999999046325684, 13.59999942779541, 12.59999942779541, 16.19999885559082, 11.800000190734863, 16.19999885559082, 14.0, 25.19999885559082, 24.799999237060547, 12.59999942779541, 10.199999809265137, 12.0, 11.800000190734863, 15.199999809265137, 14.0, 14.59999942779541, 11.0, 9.399999618530273, 7.599999904632568, 17.0, 16.19999885559082, 11.800000190734863, 10.0, 16.799999237060547, 13.59999942779541, 17.0, 17.600000381469727, 15.59999942779541, 13.199999809265137, 9.800000190734863, 10.199999809265137, 19.19999885559082, 18.600000381469727, 24.0, 25.19999885559082, 2.5999999046325684, 2.5999999046325684, 16.600000381469727, 14.799999237060547, 20.0, 21.799999237060547, 6.0, 8.0, 12.199999809265137, 7.199999809265137, 15.399999618530273, 16.399999618530273]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [4.400000095367432, 3.5999999046325684, 16.19999885559082, 14.0, 12.0, 11.800000190734863, 9.399999618530273, 7.599999904632568, 16.799999237060547, 13.59999942779541, 9.800000190734863, 10.199999809265137, 2.5999999046325684, 2.5999999046325684, 6.0, 8.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [13.59999942779541, 12.59999942779541, 25.19999885559082, 24.799999237060547, 15.199999809265137, 14.0, 17.0, 16.19999885559082, 17.0, 17.600000381469727, 19.19999885559082, 18.600000381469727, 16.600000381469727, 14.799999237060547, 12.199999809265137, 7.199999809265137]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [16.19999885559082, 11.800000190734863, 12.59999942779541, 10.199999809265137, 14.59999942779541, 11.0, 11.800000190734863, 10.0, 15.59999942779541, 13.199999809265137, 24.0, 25.19999885559082, 20.0, 21.799999237060547, 15.399999618530273, 16.399999618530273]
------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  13.75+/- 0.8015 (max:  25.2)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  15.61+/- 1.204 (max:  25.2)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  9.287+/- 1.156 (max:  16.8)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  16.36+/- 1.113 (max:  25.2)     |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  11.34+/- 0.2731 (max:  15.56)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  11.22+/- 0.3897 (max:  15.13)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  10.89+/- 0.5991 (max:  14.34)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  11.9+/- 0.3934 (max:  15.56)    |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.09083+/- 0.01369 (max:  0.35) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.09562+/- 0.028 (max:  0.35)   |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.05437+/- 0.01369 (max:  0.17) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.1225+/- 0.02514 (max:  0.32)  |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  2.6                             |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  10.0                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  2.6                             |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  7.2                             |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  6.726                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  9.113                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  6.726                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  9.6                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.0                             |
------------------------------------------------------------------------------------------------
Evaluating PLR_CNN-S5_SEED3 against population in Overcooked-ForcedCoord6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.0, 0.0, 0.0, 0.0, 0.3999999761581421, 0.0, 0.19999998807907104, 0.0, 0.3999999761581421, 0.0, 0.19999998807907104, 0.0, 0.3999999761581421, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.0, 0.0, 0.0, 0.0, 0.19999998807907104, 0.0, 0.0, 0.0, 0.5999999642372131, 0.0, 0.19999998807907104, 0.0, 1.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [0.19999998807907104, 0.0, 0.0, 0.0, 0.19999998807907104, 0.0, 0.0, 0.0, 0.3999999761581421, 0.0, 0.19999998807907104, 0.0, 0.0, 0.0, 0.5999999642372131, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [0.19999998807907104, 0.0, 0.0, 0.0, 0.19999998807907104, 0.0, 0.3999999761581421, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.19999998807907104, 0.0, 0.3999999761581421, 0.0, 0.0, 0.0, 0.0, 0.0, 1.0, 0.0]
-------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  0.1+/- 0.02793 (max:  1.0)     |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  0.1+/- 0.06583 (max:  1.0)     |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  0.1+/- 0.04472 (max:  0.6)     |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  0.1+/- 0.03162 (max:  0.4)     |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  0.7515+/- 0.1719 (max:  4.359) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  0.5718+/- 0.3264 (max:  4.359) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  0.7614+/- 0.3034 (max:  3.412) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  0.9212+/- 0.274 (max:  2.8)    |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0)         |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0)         |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                            |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                            |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                            |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                            |
-------------------------------------------------------------------------------------------------
Evaluating PLR_CNN-S5_SEED3 against population in Overcooked-CounterCircuit6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [2.200000047683716, 0.5999999642372131, 3.5999999046325684, 3.0, 3.0, 2.5999999046325684, 0.7999999523162842, 2.0, 2.5999999046325684, 2.0, 0.3999999761581421, 0.0, 3.1999998092651367, 1.7999999523162842, 10.399999618530273, 4.400000095367432, 8.0, 2.200000047683716, 3.3999998569488525, 2.3999998569488525, 11.800000190734863, 8.0, 3.1999998092651367, 0.19999998807907104, 4.400000095367432, 1.1999999284744263, 13.799999237060547, 9.199999809265137, 7.399999618530273, 1.399999976158142, 2.5999999046325684, 1.1999999284744263, 6.0, 4.799999713897705, 4.599999904632568, 0.7999999523162842, 0.7999999523162842, 0.5999999642372131, 4.0, 4.599999904632568, 1.0, 0.0, 1.5999999046325684, 0.19999998807907104, 2.5999999046325684, 2.0, 2.5999999046325684, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [2.200000047683716, 0.5999999642372131, 0.7999999523162842, 2.0, 3.1999998092651367, 1.7999999523162842, 3.3999998569488525, 2.3999998569488525, 4.400000095367432, 1.1999999284744263, 2.5999999046325684, 1.1999999284744263, 0.7999999523162842, 0.5999999642372131, 1.5999999046325684, 0.19999998807907104]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [3.5999999046325684, 3.0, 2.5999999046325684, 2.0, 10.399999618530273, 4.400000095367432, 11.800000190734863, 8.0, 13.799999237060547, 9.199999809265137, 6.0, 4.799999713897705, 4.0, 4.599999904632568, 2.5999999046325684, 2.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [3.0, 2.5999999046325684, 0.3999999761581421, 0.0, 8.0, 2.200000047683716, 3.1999998092651367, 0.19999998807907104, 7.399999618530273, 1.399999976158142, 4.599999904632568, 0.7999999523162842, 1.0, 0.0, 2.5999999046325684, 0.0]
-------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  3.317+/- 0.4574 (max:  13.8)      |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  2.337+/- 0.6255 (max:  8.0)       |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  1.812+/- 0.2935 (max:  4.4)       |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  5.8+/- 0.9293 (max:  13.8)        |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  6.457+/- 0.437 (max:  12.68)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  5.064+/- 0.8473 (max:  10.2)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  5.37+/- 0.4351 (max:  8.285)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  8.936+/- 0.5195 (max:  12.68)     |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.006458+/- 0.00257 (max:  0.08)  |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.00125+/- 0.0008539 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.0+/- 0.0 (max:  0.0)            |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.01812+/- 0.006905 (max:  0.08)  |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  0.0                               |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                               |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  0.2                               |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  2.0                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  1.99                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  6.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                               |
-------------------------------------------------------------------------------------------------------
Evaluating PLR_CNN-S5_SEED3 against population in Overcooked-AsymmAdvantages6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [0.0, 6.599999904632568, 0.0, 15.59999942779541, 0.0, 5.400000095367432, 0.0, 7.599999904632568, 0.0, 44.599998474121094, 0.0, 2.5999999046325684, 0.0, 40.79999923706055, 0.0, 62.19999694824219, 0.0, 17.799999237060547, 0.0, 20.600000381469727, 0.0, 11.59999942779541, 0.0, 6.599999904632568, 0.0, 5.400000095367432, 0.0, 22.600000381469727, 0.0, 11.0, 0.0, 5.599999904632568, 0.0, 31.599998474121094, 0.0, 3.1999998092651367, 0.0, 6.599999904632568, 0.0, 18.600000381469727, 0.0, 10.199999809265137, 0.19999998807907104, 6.799999713897705, 0.0, 27.19999885559082, 0.0, 2.200000047683716]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.0, 6.599999904632568, 0.0, 7.599999904632568, 0.0, 40.79999923706055, 0.0, 20.600000381469727, 0.0, 5.400000095367432, 0.0, 5.599999904632568, 0.0, 6.599999904632568, 0.19999998807907104, 6.799999713897705]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.0, 15.59999942779541, 0.0, 44.599998474121094, 0.0, 62.19999694824219, 0.0, 11.59999942779541, 0.0, 22.600000381469727, 0.0, 31.599998474121094, 0.0, 18.600000381469727, 0.0, 27.19999885559082]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [0.0, 5.400000095367432, 0.0, 2.5999999046325684, 0.0, 17.799999237060547, 0.0, 6.599999904632568, 0.0, 11.0, 0.0, 3.1999998092651367, 0.0, 10.199999809265137, 0.0, 2.200000047683716]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  8.192+/- 1.951 (max:  62.2)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  3.687+/- 1.321 (max:  17.8)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  6.262+/- 2.672 (max:  40.8)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  14.62+/- 4.747 (max:  62.2)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  7.613+/- 1.283 (max:  30.45)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  5.605+/- 1.624 (max:  18.52)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  6.955+/- 2.099 (max:  29.11)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  10.28+/- 2.768 (max:  30.45)    |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.1017+/- 0.02945 (max:  0.84)  |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.03062+/- 0.01487 (max:  0.21) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.065+/- 0.04174 (max:  0.65)   |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.2094+/- 0.07065 (max:  0.84)  |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                             |
------------------------------------------------------------------------------------------------------
Evaluating PLR_CNN-S5_SEED3 against population in Overcooked-CrampedRoom6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [7.799999713897705, 7.199999809265137, 61.79999923706055, 61.0, 69.0, 75.0, 16.19999885559082, 16.799999237060547, 70.5999984741211, 71.19999694824219, 79.5999984741211, 71.0, 17.600000381469727, 16.799999237060547, 83.4000015258789, 92.0, 71.4000015258789, 67.5999984741211, 16.799999237060547, 19.399999618530273, 77.5999984741211, 77.4000015258789, 60.599998474121094, 52.19999694824219, 7.0, 7.199999809265137, 66.79999542236328, 70.0, 69.0, 60.79999923706055, 16.600000381469727, 17.19999885559082, 75.19999694824219, 78.79999542236328, 67.79999542236328, 64.19999694824219, 16.19999885559082, 16.399999618530273, 74.0, 70.79999542236328, 72.79999542236328, 65.5999984741211, 16.0, 17.600000381469727, 79.0, 80.79999542236328, 73.5999984741211, 65.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [7.799999713897705, 7.199999809265137, 16.19999885559082, 16.799999237060547, 17.600000381469727, 16.799999237060547, 16.799999237060547, 19.399999618530273, 7.0, 7.199999809265137, 16.600000381469727, 17.19999885559082, 16.19999885559082, 16.399999618530273, 16.0, 17.600000381469727]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [61.79999923706055, 61.0, 70.5999984741211, 71.19999694824219, 83.4000015258789, 92.0, 77.5999984741211, 77.4000015258789, 66.79999542236328, 70.0, 75.19999694824219, 78.79999542236328, 74.0, 70.79999542236328, 79.0, 80.79999542236328]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [69.0, 75.0, 79.5999984741211, 71.0, 71.4000015258789, 67.5999984741211, 60.599998474121094, 52.19999694824219, 69.0, 60.79999923706055, 67.79999542236328, 64.19999694824219, 72.79999542236328, 65.5999984741211, 73.5999984741211, 65.0]
-------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  52.26+/- 4.014 (max:  92.0)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  67.82+/- 1.64 (max:  79.6)     |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  14.55+/- 1.099 (max:  19.4)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  74.4+/- 1.985 (max:  92.0)     |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  20.95+/- 0.9244 (max:  30.37)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  27.35+/- 0.4303 (max:  30.37)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  12.93+/- 0.4385 (max:  15.68)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  22.56+/- 0.6814 (max:  27.47)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.6635+/- 0.05573 (max:  1.0)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.9056+/- 0.01599 (max:  0.97) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.13+/- 0.01839 (max:  0.23)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.955+/- 0.007246 (max:  1.0)  |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  7.0                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  52.2                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  7.0                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  61.0                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  10.34                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  24.72                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  10.34                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  18.78                          |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.02                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.74                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.02                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.9                            |
-------------------------------------------------------------------------------------------------
Evaluating PAIRED_CNN-S5_SEED1 against population in Overcooked-CoordRing6_9 for xpid paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [2.3999998569488525, 0.0, 0.5999999642372131, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.7999999523162842, 0.0, 0.0, 0.0, 0.0, 0.0, 7.799999713897705, 0.0, 4.400000095367432, 0.0, 0.0, 0.0, 0.19999998807907104, 0.0, 0.0, 0.0, 0.0, 0.0, 1.5999999046325684, 0.0, 10.59999942779541, 0.0, 0.0, 0.0, 1.1999999284744263, 0.0, 4.0, 0.0, 0.0, 0.0, 0.7999999523162842, 0.0, 0.19999998807907104, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [2.3999998569488525, 0.0, 0.0, 0.0, 0.7999999523162842, 0.0, 7.799999713897705, 0.0, 0.19999998807907104, 0.0, 1.5999999046325684, 0.0, 1.1999999284744263, 0.0, 0.7999999523162842, 0.0]
k eval/a1:test_return:Overcooked-CoordRing6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CoordRing6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [0.5999999642372131, 0.0, 0.0, 0.0, 0.0, 0.0, 4.400000095367432, 0.0, 0.0, 0.0, 10.59999942779541, 0.0, 4.0, 0.0, 0.19999998807907104, 0.0]
k eval/a1:test_return:Overcooked-CoordRing6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CoordRing6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
---------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  0.7208+/- 0.2941 (max:  10.6)      |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  0.0+/- 0.0 (max:  0.0)             |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  0.925+/- 0.4926 (max:  7.8)        |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  1.237+/- 0.7177 (max:  10.6)       |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  1.474+/- 0.4333 (max:  11.47)      |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  0.0+/- 0.0 (max:  0.0)             |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  2.291+/- 0.7855 (max:  10.16)      |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  2.132+/- 0.9643 (max:  11.47)      |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.001458+/- 0.0009411 (max:  0.04) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.0+/- 0.0 (max:  0.0)             |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.000625+/- 0.000625 (max:  0.01)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.00375+/- 0.00272 (max:  0.04)    |
| eval/a1:test_return:Overcooked-CoordRing6_9               |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_return:Overcooked-CoordRing6_9:high          |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_return:Overcooked-CoordRing6_9:low           |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_return:Overcooked-CoordRing6_9:mid           |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_return_std:Overcooked-CoordRing6_9           |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_return_std:Overcooked-CoordRing6_9:high      |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_return_std:Overcooked-CoordRing6_9:low       |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_return_std:Overcooked-CoordRing6_9:mid       |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9          |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.0+/- 0.0 (max:  0.0)             |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  0.0                                |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  0.0                                |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  0.0                                |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  0.0                                |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  0.0                                |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  0.0                                |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  0.0                                |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  0.0                                |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                                |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.0                                |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                                |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.0                                |
| min:eval/a1:test_return:Overcooked-CoordRing6_9           |  0.0                                |
| min:eval/a1:test_return:Overcooked-CoordRing6_9:high      |  0.0                                |
| min:eval/a1:test_return:Overcooked-CoordRing6_9:low       |  0.0                                |
| min:eval/a1:test_return:Overcooked-CoordRing6_9:mid       |  0.0                                |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9       |  0.0                                |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9:high  |  0.0                                |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9:low   |  0.0                                |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9:mid   |  0.0                                |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                                |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9:high |  0.0                                |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                                |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.0                                |
---------------------------------------------------------------------------------------------------
Evaluating PAIRED_CNN-S5_SEED1 against population in Overcooked-ForcedCoord6_9 for xpid paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-ForcedCoord6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-ForcedCoord6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-ForcedCoord6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-ForcedCoord6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
-----------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_return:Overcooked-ForcedCoord6_9               |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_return:Overcooked-ForcedCoord6_9:high          |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_return:Overcooked-ForcedCoord6_9:low           |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_return:Overcooked-ForcedCoord6_9:mid           |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9           |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9:high      |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9:low       |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9:mid       |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0) |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                    |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                    |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                    |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                    |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9           |  0.0                    |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                    |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                    |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                    |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                    |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                    |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                    |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                    |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                    |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                    |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                    |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                    |
-----------------------------------------------------------------------------------------
Evaluating PAIRED_CNN-S5_SEED1 against population in Overcooked-CounterCircuit6_9 for xpid paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.19999998807907104, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CounterCircuit6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CounterCircuit6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.19999998807907104, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CounterCircuit6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CounterCircuit6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  0.004167+/- 0.004167 (max:  0.2) |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  0.0125+/- 0.0125 (max:  0.2)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  0.04146+/- 0.04146 (max:  1.99)  |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  0.1244+/- 0.1244 (max:  1.99)    |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return:Overcooked-CounterCircuit6_9               |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return:Overcooked-CounterCircuit6_9:high          |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return:Overcooked-CounterCircuit6_9:low           |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return:Overcooked-CounterCircuit6_9:mid           |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9           |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9:high      |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9:low       |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9:mid       |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.0+/- 0.0 (max:  0.0)           |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  0.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  0.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                              |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9           |  0.0                              |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                              |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9:low       |  0.0                              |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9:mid       |  0.0                              |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                              |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                              |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9:low   |  0.0                              |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9:mid   |  0.0                              |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                              |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                              |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                              |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                              |
------------------------------------------------------------------------------------------------------
Evaluating PAIRED_CNN-S5_SEED1 against population in Overcooked-AsymmAdvantages6_9 for xpid paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [0.0, 1.0, 0.0, 8.399999618530273, 0.0, 0.0, 0.0, 4.799999713897705, 0.0, 43.0, 0.0, 0.7999999523162842, 0.0, 29.0, 0.0, 58.0, 0.0, 7.799999713897705, 0.0, 15.399999618530273, 0.0, 8.59999942779541, 0.0, 0.3999999761581421, 0.0, 0.7999999523162842, 0.0, 17.399999618530273, 0.0, 0.5999999642372131, 0.0, 1.5999999046325684, 0.0, 26.599998474121094, 0.0, 0.0, 0.0, 2.200000047683716, 0.0, 13.799999237060547, 0.0, 2.0, 0.0, 2.5999999046325684, 0.0, 16.799999237060547, 0.0, 0.0]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.0, 1.0, 0.0, 4.799999713897705, 0.0, 29.0, 0.0, 15.399999618530273, 0.0, 0.7999999523162842, 0.0, 1.5999999046325684, 0.0, 2.200000047683716, 0.0, 2.5999999046325684]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.0, 8.399999618530273, 0.0, 43.0, 0.0, 58.0, 0.0, 8.59999942779541, 0.0, 17.399999618530273, 0.0, 26.599998474121094, 0.0, 13.799999237060547, 0.0, 16.799999237060547]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [0.0, 0.0, 0.0, 0.7999999523162842, 0.0, 7.799999713897705, 0.0, 0.3999999761581421, 0.0, 0.5999999642372131, 0.0, 0.0, 0.0, 2.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
-----------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  5.45+/- 1.71 (max:  58.0)      |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  0.725+/- 0.4899 (max:  7.8)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  3.587+/- 1.948 (max:  29.0)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  12.04+/- 4.341 (max:  58.0)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  5.772+/- 1.305 (max:  34.35)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  1.618+/- 0.7191 (max:  9.755)  |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  5.192+/- 2.033 (max:  29.98)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  10.5+/- 2.948 (max:  34.35)    |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.06833+/- 0.0244 (max:  0.77) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.0+/- 0.0 (max:  0.0)         |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.04+/- 0.0277 (max:  0.39)    |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.165+/- 0.06196 (max:  0.77)  |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9               |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9:high          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9:low           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9:mid           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.0+/- 0.0 (max:  0.0)         |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.0                            |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.0                            |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.0                            |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                            |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9           |  0.0                            |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.0                            |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.0                            |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                            |
-----------------------------------------------------------------------------------------------------
Evaluating PAIRED_CNN-S5_SEED1 against population in Overcooked-CrampedRoom6_9 for xpid paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [9.0, 0.0, 97.79999542236328, 0.0, 65.0, 0.0, 13.59999942779541, 0.0, 75.19999694824219, 0.0, 17.19999885559082, 0.0, 14.59999942779541, 0.0, 94.19999694824219, 0.0, 6.399999618530273, 0.0, 14.59999942779541, 0.0, 79.4000015258789, 0.0, 14.399999618530273, 0.0, 6.399999618530273, 0.0, 94.0, 0.0, 21.19999885559082, 0.0, 13.59999942779541, 0.0, 58.599998474121094, 0.0, 11.399999618530273, 0.0, 14.0, 0.0, 107.79999542236328, 0.0, 13.0, 0.0, 24.600000381469727, 0.0, 102.39999389648438, 0.0, 9.0, 0.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [9.0, 0.0, 13.59999942779541, 0.0, 14.59999942779541, 0.0, 14.59999942779541, 0.0, 6.399999618530273, 0.0, 13.59999942779541, 0.0, 14.0, 0.0, 24.600000381469727, 0.0]
k eval/a1:test_return:Overcooked-CrampedRoom6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CrampedRoom6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [97.79999542236328, 0.0, 75.19999694824219, 0.0, 94.19999694824219, 0.0, 79.4000015258789, 0.0, 94.0, 0.0, 58.599998474121094, 0.0, 107.79999542236328, 0.0, 102.39999389648438, 0.0]
k eval/a1:test_return:Overcooked-CrampedRoom6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [65.0, 0.0, 17.19999885559082, 0.0, 6.399999618530273, 0.0, 14.399999618530273, 0.0, 21.19999885559082, 0.0, 11.399999618530273, 0.0, 13.0, 0.0, 9.0, 0.0]
k eval/a1:test_return:Overcooked-CrampedRoom6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
-------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  20.36+/- 4.81 (max:  107.8)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  9.85+/- 4.106 (max:  65.0)     |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  6.9+/- 1.997 (max:  24.6)      |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  44.34+/- 11.78 (max:  107.8)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  11.5+/- 2.081 (max:  49.84)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  9.037+/- 2.414 (max:  23.22)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  6.978+/- 1.859 (max:  17.17)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  18.49+/- 5.137 (max:  49.84)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.21+/- 0.04861 (max:  0.98)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.1262+/- 0.05903 (max:  0.95) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.07+/- 0.02566 (max:  0.35)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.4337+/- 0.1138 (max:  0.98)  |
| eval/a1:test_return:Overcooked-CrampedRoom6_9               |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CrampedRoom6_9:high          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CrampedRoom6_9:low           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CrampedRoom6_9:mid           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9:high      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9:low       |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9:mid       |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.0+/- 0.0 (max:  0.0)         |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  0.0                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  0.0                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  0.0                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.0                            |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9           |  0.0                            |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9:high      |  0.0                            |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9:low       |  0.0                            |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9:mid       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9:high  |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9:low   |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9:mid   |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.0                            |
-------------------------------------------------------------------------------------------------
Evaluating PAIRED_CNN-S5_SEED2 against population in Overcooked-CoordRing6_9 for xpid SEED_2_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [0.3999999761581421, 3.1999998092651367, 0.0, 0.19999998807907104, 0.0, 0.0, 1.5999999046325684, 8.800000190734863, 1.399999976158142, 2.799999952316284, 0.0, 0.0, 1.5999999046325684, 5.199999809265137, 0.0, 0.0, 0.0, 0.0, 0.5999999642372131, 1.0, 0.3999999761581421, 1.0, 0.0, 0.0, 1.0, 3.3999998569488525, 0.0, 0.0, 0.0, 0.0, 0.7999999523162842, 2.3999998569488525, 3.799999952316284, 4.799999713897705, 0.19999998807907104, 0.0, 0.3999999761581421, 0.0, 1.399999976158142, 3.0, 0.0, 0.0, 0.19999998807907104, 0.19999998807907104, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [0.3999999761581421, 3.1999998092651367, 1.5999999046325684, 8.800000190734863, 1.5999999046325684, 5.199999809265137, 0.5999999642372131, 1.0, 1.0, 3.3999998569488525, 0.7999999523162842, 2.3999998569488525, 0.3999999761581421, 0.0, 0.19999998807907104, 0.19999998807907104]
k eval/a1:test_return:Overcooked-CoordRing6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CoordRing6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [0.0, 0.19999998807907104, 1.399999976158142, 2.799999952316284, 0.0, 0.0, 0.3999999761581421, 1.0, 0.0, 0.0, 3.799999952316284, 4.799999713897705, 1.399999976158142, 3.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CoordRing6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.19999998807907104, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CoordRing6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
-------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  1.037+/- 0.2565 (max:  8.8)      |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  0.0125+/- 0.0125 (max:  0.2)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  1.925+/- 0.5819 (max:  8.8)      |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  1.175+/- 0.3945 (max:  4.8)      |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  2.755+/- 0.4724 (max:  11.77)    |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  0.1244+/- 0.1244 (max:  1.99)    |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  4.941+/- 0.7438 (max:  11.77)    |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  3.201+/- 0.858 (max:  9.432)     |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.001875+/- 0.00114 (max:  0.05) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.0+/- 0.0 (max:  0.0)           |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.00375+/- 0.003146 (max:  0.05) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.001875+/- 0.00136 (max:  0.02) |
| eval/a1:test_return:Overcooked-CoordRing6_9               |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return:Overcooked-CoordRing6_9:high          |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return:Overcooked-CoordRing6_9:low           |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return:Overcooked-CoordRing6_9:mid           |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return_std:Overcooked-CoordRing6_9           |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return_std:Overcooked-CoordRing6_9:high      |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return_std:Overcooked-CoordRing6_9:low       |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return_std:Overcooked-CoordRing6_9:mid       |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9          |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.0+/- 0.0 (max:  0.0)           |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  0.0                              |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  0.0                              |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  0.0                              |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.0                              |
| min:eval/a1:test_return:Overcooked-CoordRing6_9           |  0.0                              |
| min:eval/a1:test_return:Overcooked-CoordRing6_9:high      |  0.0                              |
| min:eval/a1:test_return:Overcooked-CoordRing6_9:low       |  0.0                              |
| min:eval/a1:test_return:Overcooked-CoordRing6_9:mid       |  0.0                              |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9       |  0.0                              |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9:high  |  0.0                              |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9:low   |  0.0                              |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9:mid   |  0.0                              |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                              |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9:high |  0.0                              |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                              |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.0                              |
-------------------------------------------------------------------------------------------------
Evaluating PAIRED_CNN-S5_SEED2 against population in Overcooked-ForcedCoord6_9 for xpid SEED_2_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-ForcedCoord6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-ForcedCoord6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-ForcedCoord6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-ForcedCoord6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
-----------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_return:Overcooked-ForcedCoord6_9               |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_return:Overcooked-ForcedCoord6_9:high          |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_return:Overcooked-ForcedCoord6_9:low           |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_return:Overcooked-ForcedCoord6_9:mid           |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9           |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9:high      |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9:low       |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9:mid       |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0) |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0) |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                    |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                    |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                    |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                    |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                    |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                    |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9           |  0.0                    |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                    |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                    |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                    |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                    |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                    |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                    |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                    |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                    |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                    |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                    |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                    |
-----------------------------------------------------------------------------------------
Evaluating PAIRED_CNN-S5_SEED2 against population in Overcooked-CounterCircuit6_9 for xpid SEED_2_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [0.0, 0.0, 1.7999999523162842, 0.0, 0.3999999761581421, 0.0, 0.0, 0.19999998807907104, 1.7999999523162842, 0.0, 0.0, 0.0, 0.19999998807907104, 0.0, 0.0, 0.0, 0.3999999761581421, 0.19999998807907104, 1.5999999046325684, 0.19999998807907104, 14.399999618530273, 7.199999809265137, 0.5999999642372131, 0.0, 1.5999999046325684, 0.5999999642372131, 4.599999904632568, 1.7999999523162842, 2.799999952316284, 0.7999999523162842, 0.19999998807907104, 0.0, 3.3999998569488525, 0.5999999642372131, 0.5999999642372131, 0.3999999761581421, 0.19999998807907104, 0.0, 2.200000047683716, 0.0, 0.0, 0.0, 1.0, 0.3999999761581421, 6.599999904632568, 0.7999999523162842, 0.3999999761581421, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [0.0, 0.0, 0.0, 0.19999998807907104, 0.19999998807907104, 0.0, 1.5999999046325684, 0.19999998807907104, 1.5999999046325684, 0.5999999642372131, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 1.0, 0.3999999761581421]
k eval/a1:test_return:Overcooked-CounterCircuit6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CounterCircuit6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [1.7999999523162842, 0.0, 1.7999999523162842, 0.0, 0.0, 0.0, 14.399999618530273, 7.199999809265137, 4.599999904632568, 1.7999999523162842, 3.3999998569488525, 0.5999999642372131, 2.200000047683716, 0.0, 6.599999904632568, 0.7999999523162842]
k eval/a1:test_return:Overcooked-CounterCircuit6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [0.3999999761581421, 0.0, 0.0, 0.0, 0.3999999761581421, 0.19999998807907104, 0.5999999642372131, 0.0, 2.799999952316284, 0.7999999523162842, 0.5999999642372131, 0.3999999761581421, 0.0, 0.0, 0.3999999761581421, 0.0]
k eval/a1:test_return:Overcooked-CounterCircuit6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
---------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  1.208+/- 0.3632 (max:  14.4)        |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  0.4125+/- 0.1727 (max:  2.8)        |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  0.3875+/- 0.136 (max:  1.6)         |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  2.825+/- 0.9647 (max:  14.4)        |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  2.87+/- 0.4278 (max:  9.82)         |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  1.93+/- 0.5105 (max:  6.94)         |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  1.961+/- 0.4815 (max:  5.426)       |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  4.72+/- 0.9409 (max:  9.82)         |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.0004167+/- 0.0002915 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.0+/- 0.0 (max:  0.0)              |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.0+/- 0.0 (max:  0.0)              |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.00125+/- 0.0008539 (max:  0.01)   |
| eval/a1:test_return:Overcooked-CounterCircuit6_9               |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_return:Overcooked-CounterCircuit6_9:high          |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_return:Overcooked-CounterCircuit6_9:low           |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_return:Overcooked-CounterCircuit6_9:mid           |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9           |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9:high      |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9:low       |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9:mid       |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.0+/- 0.0 (max:  0.0)              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  0.0                                 |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                                 |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  0.0                                 |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                                 |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9           |  0.0                                 |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                                 |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9:low       |  0.0                                 |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9:mid       |  0.0                                 |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                                 |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                                 |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9:low   |  0.0                                 |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9:mid   |  0.0                                 |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                                 |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                                 |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                                 |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                                 |
---------------------------------------------------------------------------------------------------------
Evaluating PAIRED_CNN-S5_SEED2 against population in Overcooked-AsymmAdvantages6_9 for xpid SEED_2_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [0.0, 8.399999618530273, 0.0, 21.799999237060547, 0.0, 1.7999999523162842, 0.0, 8.800000190734863, 0.0, 28.0, 0.0, 1.399999976158142, 0.0, 36.39999771118164, 0.0, 68.19999694824219, 0.0, 13.799999237060547, 0.0, 22.600000381469727, 0.0, 7.799999713897705, 0.0, 7.0, 0.0, 10.59999942779541, 0.0, 24.0, 0.0, 20.0, 0.0, 9.800000190734863, 0.0, 26.599998474121094, 0.0, 1.0, 0.0, 9.800000190734863, 0.0, 12.59999942779541, 0.0, 11.0, 0.0, 15.59999942779541, 0.0, 27.399999618530273, 0.0, 1.5999999046325684]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.0, 8.399999618530273, 0.0, 8.800000190734863, 0.0, 36.39999771118164, 0.0, 22.600000381469727, 0.0, 10.59999942779541, 0.0, 9.800000190734863, 0.0, 9.800000190734863, 0.0, 15.59999942779541]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.0, 21.799999237060547, 0.0, 28.0, 0.0, 68.19999694824219, 0.0, 7.799999713897705, 0.0, 24.0, 0.0, 26.599998474121094, 0.0, 12.59999942779541, 0.0, 27.399999618530273]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [0.0, 1.7999999523162842, 0.0, 1.399999976158142, 0.0, 13.799999237060547, 0.0, 7.0, 0.0, 20.0, 0.0, 1.0, 0.0, 11.0, 0.0, 1.5999999046325684]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
--------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  8.25+/- 1.906 (max:  68.2)        |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  3.6+/- 1.53 (max:  20.0)          |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  7.625+/- 2.583 (max:  36.4)       |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  13.52+/- 4.672 (max:  68.2)       |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  6.361+/- 1.15 (max:  34.65)       |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  3.48+/- 0.977 (max:  9.95)        |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  6.666+/- 1.93 (max:  24.88)       |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  8.937+/- 2.599 (max:  34.65)      |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.07937+/- 0.02494 (max:  0.83)   |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.003125+/- 0.003125 (max:  0.05) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.06187+/- 0.03528 (max:  0.51)   |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.1731+/- 0.05997 (max:  0.83)    |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9               |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9:high          |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9:low           |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9:mid           |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9           |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.0+/- 0.0 (max:  0.0)            |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.0                               |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.0                               |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.0                               |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                               |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9           |  0.0                               |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.0                               |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.0                               |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.0                               |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9       |  0.0                               |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  0.0                               |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  0.0                               |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  0.0                               |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                               |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                               |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                               |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                               |
--------------------------------------------------------------------------------------------------------
Evaluating PAIRED_CNN-S5_SEED2 against population in Overcooked-CrampedRoom6_9 for xpid SEED_2_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [0.7999999523162842, 0.7999999523162842, 4.799999713897705, 3.0, 2.0, 0.7999999523162842, 3.3999998569488525, 3.0, 4.799999713897705, 2.5999999046325684, 1.5999999046325684, 0.0, 3.1999998092651367, 3.1999998092651367, 3.1999998092651367, 3.1999998092651367, 1.399999976158142, 0.3999999761581421, 2.200000047683716, 2.0, 3.1999998092651367, 2.200000047683716, 1.0, 0.19999998807907104, 1.399999976158142, 1.399999976158142, 7.199999809265137, 4.400000095367432, 0.7999999523162842, 0.3999999761581421, 2.200000047683716, 3.1999998092651367, 1.5999999046325684, 1.399999976158142, 1.399999976158142, 0.3999999761581421, 3.1999998092651367, 3.1999998092651367, 4.799999713897705, 4.599999904632568, 1.1999999284744263, 0.3999999761581421, 4.0, 2.799999952316284, 6.0, 3.799999952316284, 1.1999999284744263, 0.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [0.7999999523162842, 0.7999999523162842, 3.3999998569488525, 3.0, 3.1999998092651367, 3.1999998092651367, 2.200000047683716, 2.0, 1.399999976158142, 1.399999976158142, 2.200000047683716, 3.1999998092651367, 3.1999998092651367, 3.1999998092651367, 4.0, 2.799999952316284]
k eval/a1:test_return:Overcooked-CrampedRoom6_9, v [0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104]
k eval/a1:test_return:Overcooked-CrampedRoom6_9:low, v [0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [4.799999713897705, 3.0, 4.799999713897705, 2.5999999046325684, 3.1999998092651367, 3.1999998092651367, 3.1999998092651367, 2.200000047683716, 7.199999809265137, 4.400000095367432, 1.5999999046325684, 1.399999976158142, 4.799999713897705, 4.599999904632568, 6.0, 3.799999952316284]
k eval/a1:test_return:Overcooked-CrampedRoom6_9:mid, v [0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [2.0, 0.7999999523162842, 1.5999999046325684, 0.0, 1.399999976158142, 0.3999999761581421, 1.0, 0.19999998807907104, 0.7999999523162842, 0.3999999761581421, 1.399999976158142, 0.3999999761581421, 1.1999999284744263, 0.3999999761581421, 1.1999999284744263, 0.0]
k eval/a1:test_return:Overcooked-CrampedRoom6_9:high, v [0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104]
----------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  2.375+/- 0.238 (max:  7.2)        |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  0.825+/- 0.1504 (max:  2.0)       |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  2.5+/- 0.2456 (max:  4.0)         |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  3.8+/- 0.3912 (max:  7.2)         |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  6.011+/- 0.3493 (max:  10.4)      |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  3.532+/- 0.4474 (max:  6.0)       |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  6.68+/- 0.3846 (max:  9.798)      |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  7.82+/- 0.3758 (max:  10.4)       |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.003333+/- 0.001127 (max:  0.04) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.0+/- 0.0 (max:  0.0)            |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.005+/- 0.002582 (max:  0.04)    |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.005+/- 0.002041 (max:  0.02)    |
| eval/a1:test_return:Overcooked-CrampedRoom6_9               |  0.1+/- 0.01459 (max:  0.2)        |
| eval/a1:test_return:Overcooked-CrampedRoom6_9:high          |  0.1+/- 0.02582 (max:  0.2)        |
| eval/a1:test_return:Overcooked-CrampedRoom6_9:low           |  0.1+/- 0.02582 (max:  0.2)        |
| eval/a1:test_return:Overcooked-CrampedRoom6_9:mid           |  0.1+/- 0.02582 (max:  0.2)        |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9           |  0.995+/- 0.1451 (max:  1.99)      |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9:high      |  0.995+/- 0.2569 (max:  1.99)      |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9:low       |  0.995+/- 0.2569 (max:  1.99)      |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9:mid       |  0.995+/- 0.2569 (max:  1.99)      |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.0+/- 0.0 (max:  0.0)            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  0.0                               |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  0.0                               |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  0.8                               |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  1.4                               |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  3.919                             |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  5.103                             |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.0                               |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9           |  0.0                               |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9:high      |  0.0                               |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9:low       |  0.0                               |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9:mid       |  0.0                               |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9       |  0.0                               |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9:high  |  0.0                               |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9:low   |  0.0                               |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9:mid   |  0.0                               |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.0                               |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.0                               |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.0                               |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.0                               |
----------------------------------------------------------------------------------------------------
Evaluating PAIRED_CNN-S5_SEED3 against population in Overcooked-CoordRing6_9 for xpid SEED_3_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [4.799999713897705, 5.199999809265137, 17.799999237060547, 17.19999885559082, 23.399999618530273, 26.0, 13.59999942779541, 15.799999237060547, 27.19999885559082, 25.399999618530273, 22.19999885559082, 23.19999885559082, 13.0, 11.59999942779541, 25.599998474121094, 23.0, 22.399999618530273, 23.0, 13.59999942779541, 12.399999618530273, 16.19999885559082, 15.0, 17.19999885559082, 18.399999618530273, 14.59999942779541, 17.19999885559082, 20.399999618530273, 21.0, 21.19999885559082, 23.0, 13.59999942779541, 14.799999237060547, 24.399999618530273, 22.799999237060547, 33.79999923706055, 31.399999618530273, 3.0, 2.799999952316284, 17.399999618530273, 15.0, 27.799999237060547, 29.599998474121094, 10.59999942779541, 12.799999237060547, 12.799999237060547, 12.799999237060547, 19.19999885559082, 19.799999237060547]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [4.799999713897705, 5.199999809265137, 13.59999942779541, 15.799999237060547, 13.0, 11.59999942779541, 13.59999942779541, 12.399999618530273, 14.59999942779541, 17.19999885559082, 13.59999942779541, 14.799999237060547, 3.0, 2.799999952316284, 10.59999942779541, 12.799999237060547]
k eval/a1:test_return:Overcooked-CoordRing6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CoordRing6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [17.799999237060547, 17.19999885559082, 27.19999885559082, 25.399999618530273, 25.599998474121094, 23.0, 16.19999885559082, 15.0, 20.399999618530273, 21.0, 24.399999618530273, 22.799999237060547, 17.399999618530273, 15.0, 12.799999237060547, 12.799999237060547]
k eval/a1:test_return:Overcooked-CoordRing6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [23.399999618530273, 26.0, 22.19999885559082, 23.19999885559082, 22.399999618530273, 23.0, 17.19999885559082, 18.399999618530273, 21.19999885559082, 23.0, 33.79999923706055, 31.399999618530273, 27.799999237060547, 29.599998474121094, 19.19999885559082, 19.799999237060547]
k eval/a1:test_return:Overcooked-CoordRing6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
-----------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  18.23+/- 1.013 (max:  33.8)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  23.85+/- 1.182 (max:  33.8)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  11.21+/- 1.157 (max:  17.2)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  19.62+/- 1.182 (max:  27.2)    |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  12.0+/- 0.2966 (max:  16.63)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  11.37+/- 0.4493 (max:  14.28)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  11.66+/- 0.6011 (max:  14.66)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  12.96+/- 0.4105 (max:  16.63)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.1858+/- 0.02108 (max:  0.66) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.265+/- 0.042 (max:  0.66)    |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.0775+/- 0.01315 (max:  0.16) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.215+/- 0.03134 (max:  0.42)  |
| eval/a1:test_return:Overcooked-CoordRing6_9               |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CoordRing6_9:high          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CoordRing6_9:low           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CoordRing6_9:mid           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CoordRing6_9           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CoordRing6_9:high      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CoordRing6_9:low       |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CoordRing6_9:mid       |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.0+/- 0.0 (max:  0.0)         |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  2.8                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  17.2                           |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  2.8                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  12.8                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  6.94                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  8.818                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  6.94                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  10.4                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.11                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.02                           |
| min:eval/a1:test_return:Overcooked-CoordRing6_9           |  0.0                            |
| min:eval/a1:test_return:Overcooked-CoordRing6_9:high      |  0.0                            |
| min:eval/a1:test_return:Overcooked-CoordRing6_9:low       |  0.0                            |
| min:eval/a1:test_return:Overcooked-CoordRing6_9:mid       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9:high  |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9:low   |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9:mid   |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9:high |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.0                            |
-----------------------------------------------------------------------------------------------
Evaluating PAIRED_CNN-S5_SEED3 against population in Overcooked-ForcedCoord6_9 for xpid SEED_3_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [1.5999999046325684, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 0.5999999642372131, 0.0, 1.7999999523162842, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.19999998807907104, 1.5999999046325684, 0.0, 0.19999998807907104, 0.19999998807907104, 1.1999999284744263, 0.0, 2.3999998569488525, 0.0, 1.0, 0.0, 1.7999999523162842, 0.0, 2.5999999046325684, 0.0, 1.0, 0.0, 1.1999999284744263, 0.0, 0.3999999761581421, 0.0, 0.19999998807907104, 0.19999998807907104, 0.3999999761581421, 0.0, 1.0, 0.19999998807907104, 1.0, 0.0, 2.0, 0.0, 3.1999998092651367, 0.0, 2.3999998569488525, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [1.5999999046325684, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.19999998807907104, 1.1999999284744263, 0.0, 1.7999999523162842, 0.0, 1.1999999284744263, 0.0, 0.3999999761581421, 0.0, 2.0, 0.0]
k eval/a1:test_return:Overcooked-ForcedCoord6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-ForcedCoord6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [1.1999999284744263, 0.0, 1.7999999523162842, 0.0, 1.5999999046325684, 0.0, 2.3999998569488525, 0.0, 2.5999999046325684, 0.0, 0.3999999761581421, 0.0, 1.0, 0.19999998807907104, 3.1999998092651367, 0.0]
k eval/a1:test_return:Overcooked-ForcedCoord6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [1.1999999284744263, 0.0, 0.5999999642372131, 0.0, 0.19999998807907104, 0.19999998807907104, 1.0, 0.0, 1.0, 0.0, 0.19999998807907104, 0.19999998807907104, 1.0, 0.0, 2.3999998569488525, 0.0]
k eval/a1:test_return:Overcooked-ForcedCoord6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  0.6667+/- 0.1231 (max:  3.2)  |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  0.5+/- 0.1673 (max:  2.4)     |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  0.6+/- 0.1807 (max:  2.0)     |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  0.9+/- 0.2757 (max:  3.2)     |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  2.491+/- 0.3565 (max:  7.332) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  2.231+/- 0.5387 (max:  6.499) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  2.391+/- 0.6017 (max:  6.0)   |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  2.85+/- 0.7269 (max:  7.332)  |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0)        |
| eval/a1:test_return:Overcooked-ForcedCoord6_9               |  0.0+/- 0.0 (max:  0.0)        |
| eval/a1:test_return:Overcooked-ForcedCoord6_9:high          |  0.0+/- 0.0 (max:  0.0)        |
| eval/a1:test_return:Overcooked-ForcedCoord6_9:low           |  0.0+/- 0.0 (max:  0.0)        |
| eval/a1:test_return:Overcooked-ForcedCoord6_9:mid           |  0.0+/- 0.0 (max:  0.0)        |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9           |  0.0+/- 0.0 (max:  0.0)        |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9:high      |  0.0+/- 0.0 (max:  0.0)        |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9:low       |  0.0+/- 0.0 (max:  0.0)        |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9:mid       |  0.0+/- 0.0 (max:  0.0)        |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0)        |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0)        |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0)        |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0)        |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                           |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9           |  0.0                           |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                           |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                           |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                           |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                           |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                           |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                           |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                           |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                           |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                           |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                           |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                           |
------------------------------------------------------------------------------------------------
Evaluating PAIRED_CNN-S5_SEED3 against population in Overcooked-CounterCircuit6_9 for xpid SEED_3_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [9.59999942779541, 6.599999904632568, 15.0, 8.399999618530273, 8.59999942779541, 8.59999942779541, 5.0, 5.400000095367432, 8.0, 9.0, 4.0, 1.0, 5.0, 3.3999998569488525, 11.800000190734863, 11.800000190734863, 10.399999618530273, 6.0, 8.800000190734863, 6.0, 19.19999885559082, 15.59999942779541, 10.800000190734863, 7.799999713897705, 7.799999713897705, 7.599999904632568, 16.799999237060547, 13.399999618530273, 8.800000190734863, 2.3999998569488525, 11.199999809265137, 8.59999942779541, 16.399999618530273, 9.199999809265137, 8.399999618530273, 6.199999809265137, 9.199999809265137, 5.599999904632568, 9.800000190734863, 9.800000190734863, 8.0, 5.599999904632568, 12.0, 7.199999809265137, 13.399999618530273, 13.399999618530273, 9.59999942779541, 4.799999713897705]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [9.59999942779541, 6.599999904632568, 5.0, 5.400000095367432, 5.0, 3.3999998569488525, 8.800000190734863, 6.0, 7.799999713897705, 7.599999904632568, 11.199999809265137, 8.59999942779541, 9.199999809265137, 5.599999904632568, 12.0, 7.199999809265137]
k eval/a1:test_return:Overcooked-CounterCircuit6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CounterCircuit6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [15.0, 8.399999618530273, 8.0, 9.0, 11.800000190734863, 11.800000190734863, 19.19999885559082, 15.59999942779541, 16.799999237060547, 13.399999618530273, 16.399999618530273, 9.199999809265137, 9.800000190734863, 9.800000190734863, 13.399999618530273, 13.399999618530273]
k eval/a1:test_return:Overcooked-CounterCircuit6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [8.59999942779541, 8.59999942779541, 4.0, 1.0, 10.399999618530273, 6.0, 10.800000190734863, 7.799999713897705, 8.800000190734863, 2.3999998569488525, 8.399999618530273, 6.199999809265137, 8.0, 5.599999904632568, 9.59999942779541, 4.799999713897705]
k eval/a1:test_return:Overcooked-CounterCircuit6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  8.979+/- 0.5517 (max:  19.2)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  6.937+/- 0.7049 (max:  10.8)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  7.437+/- 0.5939 (max:  12.0)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  12.56+/- 0.848 (max:  19.2)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  11.04+/- 0.3655 (max:  17.45)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  9.48+/- 0.4317 (max:  11.48)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  10.18+/- 0.3669 (max:  12.43)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  13.46+/- 0.577 (max:  17.45)     |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.04729+/- 0.008826 (max:  0.22) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.01187+/- 0.003561 (max:  0.04) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.02187+/- 0.006783 (max:  0.07) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.1081+/- 0.01733 (max:  0.22)   |
| eval/a1:test_return:Overcooked-CounterCircuit6_9               |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return:Overcooked-CounterCircuit6_9:high          |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return:Overcooked-CounterCircuit6_9:low           |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return:Overcooked-CounterCircuit6_9:mid           |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9           |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9:high      |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9:low       |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9:mid       |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.0+/- 0.0 (max:  0.0)           |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  1.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  1.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  3.4                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  8.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  5.196                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  5.196                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  7.513                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  9.837                            |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                              |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9           |  0.0                              |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                              |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9:low       |  0.0                              |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9:mid       |  0.0                              |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                              |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                              |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9:low   |  0.0                              |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9:mid   |  0.0                              |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                              |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                              |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                              |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                              |
------------------------------------------------------------------------------------------------------
Evaluating PAIRED_CNN-S5_SEED3 against population in Overcooked-AsymmAdvantages6_9 for xpid SEED_3_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [0.3999999761581421, 2.3999998569488525, 0.3999999761581421, 7.0, 0.5999999642372131, 0.5999999642372131, 0.3999999761581421, 5.599999904632568, 0.3999999761581421, 41.599998474121094, 0.3999999761581421, 0.5999999642372131, 0.19999998807907104, 33.599998474121094, 0.19999998807907104, 55.79999923706055, 0.5999999642372131, 11.59999942779541, 0.19999998807907104, 17.19999885559082, 0.3999999761581421, 7.599999904632568, 1.0, 1.0, 0.5999999642372131, 2.200000047683716, 0.19999998807907104, 17.19999885559082, 0.5999999642372131, 2.200000047683716, 0.5999999642372131, 2.799999952316284, 0.19999998807907104, 27.799999237060547, 0.19999998807907104, 0.19999998807907104, 0.3999999761581421, 4.599999904632568, 0.7999999523162842, 15.199999809265137, 0.0, 2.200000047683716, 0.7999999523162842, 6.199999809265137, 0.3999999761581421, 17.799999237060547, 1.1999999284744263, 1.1999999284744263]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.3999999761581421, 2.3999998569488525, 0.3999999761581421, 5.599999904632568, 0.19999998807907104, 33.599998474121094, 0.19999998807907104, 17.19999885559082, 0.5999999642372131, 2.200000047683716, 0.5999999642372131, 2.799999952316284, 0.3999999761581421, 4.599999904632568, 0.7999999523162842, 6.199999809265137]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.3999999761581421, 7.0, 0.3999999761581421, 41.599998474121094, 0.19999998807907104, 55.79999923706055, 0.3999999761581421, 7.599999904632568, 0.19999998807907104, 17.19999885559082, 0.19999998807907104, 27.799999237060547, 0.7999999523162842, 15.199999809265137, 0.3999999761581421, 17.799999237060547]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [0.5999999642372131, 0.5999999642372131, 0.3999999761581421, 0.5999999642372131, 0.5999999642372131, 11.59999942779541, 1.0, 1.0, 0.5999999642372131, 2.200000047683716, 0.19999998807907104, 0.19999998807907104, 0.0, 2.200000047683716, 1.1999999284744263, 1.1999999284744263]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  6.154+/- 1.689 (max:  55.8)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  1.512+/- 0.6909 (max:  11.6)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  4.887+/- 2.193 (max:  33.6)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  12.06+/- 4.204 (max:  55.8)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  7.68+/- 1.121 (max:  33.14)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  4.076+/- 0.588 (max:  10.65)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  7.48+/- 1.785 (max:  28.83)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  11.49+/- 2.54 (max:  33.14)     |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.07417+/- 0.02551 (max:  0.73) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.00125+/- 0.00125 (max:  0.02) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.05437+/- 0.03504 (max:  0.5)  |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.1669+/- 0.06274 (max:  0.73)  |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9               |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9:high          |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9:low           |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9:mid           |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9           |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.0+/- 0.0 (max:  0.0)          |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.0                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.2                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.2                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  1.99                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  1.99                            |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                             |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9           |  0.0                             |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.0                             |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.0                             |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.0                             |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9       |  0.0                             |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  0.0                             |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  0.0                             |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  0.0                             |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                             |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                             |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                             |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                             |
------------------------------------------------------------------------------------------------------
Evaluating PAIRED_CNN-S5_SEED3 against population in Overcooked-CrampedRoom6_9 for xpid SEED_3_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [11.800000190734863, 8.59999942779541, 57.599998474121094, 56.39999771118164, 68.79999542236328, 63.0, 18.0, 15.0, 58.0, 53.79999923706055, 55.79999923706055, 51.79999923706055, 15.799999237060547, 16.0, 56.39999771118164, 60.0, 58.79999923706055, 55.19999694824219, 17.399999618530273, 19.600000381469727, 62.599998474121094, 59.39999771118164, 47.0, 47.20000076293945, 11.59999942779541, 11.59999942779541, 53.0, 46.39999771118164, 42.0, 46.79999923706055, 20.19999885559082, 16.0, 56.39999771118164, 58.0, 58.79999923706055, 51.79999923706055, 14.799999237060547, 16.399999618530273, 60.39999771118164, 61.79999923706055, 59.79999923706055, 55.599998474121094, 19.799999237060547, 18.600000381469727, 64.0, 58.0, 47.20000076293945, 44.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [11.800000190734863, 8.59999942779541, 18.0, 15.0, 15.799999237060547, 16.0, 17.399999618530273, 19.600000381469727, 11.59999942779541, 11.59999942779541, 20.19999885559082, 16.0, 14.799999237060547, 16.399999618530273, 19.799999237060547, 18.600000381469727]
k eval/a1:test_return:Overcooked-CrampedRoom6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CrampedRoom6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [57.599998474121094, 56.39999771118164, 58.0, 53.79999923706055, 56.39999771118164, 60.0, 62.599998474121094, 59.39999771118164, 53.0, 46.39999771118164, 56.39999771118164, 58.0, 60.39999771118164, 61.79999923706055, 64.0, 58.0]
k eval/a1:test_return:Overcooked-CrampedRoom6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [68.79999542236328, 63.0, 55.79999923706055, 51.79999923706055, 58.79999923706055, 55.19999694824219, 47.0, 47.20000076293945, 42.0, 46.79999923706055, 58.79999923706055, 51.79999923706055, 59.79999923706055, 55.599998474121094, 47.20000076293945, 44.0]
k eval/a1:test_return:Overcooked-CrampedRoom6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
-------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  42.23+/- 2.848 (max:  68.8)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  53.35+/- 1.857 (max:  68.8)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  15.7+/- 0.8418 (max:  20.2)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  57.64+/- 1.053 (max:  64.0)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  24.3+/- 1.199 (max:  35.03)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  29.12+/- 0.5422 (max:  32.41)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  13.31+/- 0.2789 (max:  15.1)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  30.45+/- 1.004 (max:  35.03)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.5702+/- 0.04507 (max:  0.94) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.7775+/- 0.01811 (max:  0.92) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.1431+/- 0.01653 (max:  0.25) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.79+/- 0.01579 (max:  0.94)   |
| eval/a1:test_return:Overcooked-CrampedRoom6_9               |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CrampedRoom6_9:high          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CrampedRoom6_9:low           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CrampedRoom6_9:mid           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9:high      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9:low       |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9:mid       |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.0+/- 0.0 (max:  0.0)         |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  8.6                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  42.0                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  8.6                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  46.4                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  11.05                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  25.69                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  11.05                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  20.25                          |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.03                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.65                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.03                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.66                           |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9           |  0.0                            |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9:high      |  0.0                            |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9:low       |  0.0                            |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9:mid       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9:high  |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9:low   |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9:mid   |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.0                            |
-------------------------------------------------------------------------------------------------
Evaluating ACCEL_CNN-S5_SEED1 against population in Overcooked-CoordRing6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [3.0, 3.0, 12.799999237060547, 9.0, 11.199999809265137, 12.0, 10.399999618530273, 8.0, 17.600000381469727, 21.19999885559082, 12.399999618530273, 13.799999237060547, 9.0, 11.0, 15.399999618530273, 15.799999237060547, 15.199999809265137, 17.0, 13.199999809265137, 10.399999618530273, 13.59999942779541, 12.59999942779541, 11.800000190734863, 11.399999618530273, 12.0, 8.800000190734863, 8.59999942779541, 8.0, 15.399999618530273, 17.0, 10.399999618530273, 9.800000190734863, 16.600000381469727, 19.600000381469727, 24.799999237060547, 26.399999618530273, 2.0, 2.200000047683716, 13.0, 15.59999942779541, 24.600000381469727, 31.399999618530273, 11.800000190734863, 14.399999618530273, 10.0, 10.59999942779541, 20.19999885559082, 23.600000381469727]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [3.0, 3.0, 10.399999618530273, 8.0, 9.0, 11.0, 13.199999809265137, 10.399999618530273, 12.0, 8.800000190734863, 10.399999618530273, 9.800000190734863, 2.0, 2.200000047683716, 11.800000190734863, 14.399999618530273]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [12.799999237060547, 9.0, 17.600000381469727, 21.19999885559082, 15.399999618530273, 15.799999237060547, 13.59999942779541, 12.59999942779541, 8.59999942779541, 8.0, 16.600000381469727, 19.600000381469727, 13.0, 15.59999942779541, 10.0, 10.59999942779541]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [11.199999809265137, 12.0, 12.399999618530273, 13.799999237060547, 15.199999809265137, 17.0, 11.800000190734863, 11.399999618530273, 15.399999618530273, 17.0, 24.799999237060547, 26.399999618530273, 24.600000381469727, 31.399999618530273, 20.19999885559082, 23.600000381469727]
------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  13.49+/- 0.8864 (max:  31.4)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  18.01+/- 1.589 (max:  31.4)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  8.712+/- 1.002 (max:  14.4)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  13.75+/- 0.9831 (max:  21.2)    |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  11.45+/- 0.3211 (max:  16.73)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  11.08+/- 0.5 (max:  14.77)      |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  10.94+/- 0.6586 (max:  14.55)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  12.34+/- 0.4533 (max:  16.73)   |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.09854+/- 0.01743 (max:  0.56) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.1444+/- 0.04506 (max:  0.56)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.05375+/- 0.01052 (max:  0.14) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.0975+/- 0.02101 (max:  0.3)   |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  2.0                             |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  11.2                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  2.0                             |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  8.0                             |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  6.0                             |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  8.417                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  6.0                             |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  9.798                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.0                             |
------------------------------------------------------------------------------------------------
Evaluating ACCEL_CNN-S5_SEED1 against population in Overcooked-ForcedCoord6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [0.0, 0.19999998807907104, 0.0, 0.0, 0.19999998807907104, 0.19999998807907104, 0.19999998807907104, 0.19999998807907104, 0.19999998807907104, 0.0, 0.0, 0.3999999761581421, 0.19999998807907104, 0.5999999642372131, 0.3999999761581421, 0.5999999642372131, 0.19999998807907104, 1.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.19999998807907104, 0.0, 0.19999998807907104, 0.19999998807907104, 0.19999998807907104, 0.19999998807907104, 0.0, 0.0, 0.3999999761581421, 0.19999998807907104, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.19999998807907104, 0.0, 0.0, 0.0, 0.19999998807907104, 0.0, 0.0, 0.19999998807907104, 0.5999999642372131, 0.0, 0.19999998807907104]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [0.0, 0.19999998807907104, 0.19999998807907104, 0.19999998807907104, 0.19999998807907104, 0.5999999642372131, 0.3999999761581421, 0.0, 0.19999998807907104, 0.19999998807907104, 0.19999998807907104, 0.0, 0.0, 0.19999998807907104, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [0.0, 0.0, 0.19999998807907104, 0.0, 0.3999999761581421, 0.5999999642372131, 0.3999999761581421, 0.19999998807907104, 0.19999998807907104, 0.0, 0.0, 0.0, 0.0, 0.0, 0.19999998807907104, 0.5999999642372131]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [0.19999998807907104, 0.19999998807907104, 0.0, 0.3999999761581421, 0.19999998807907104, 1.0, 0.0, 0.19999998807907104, 0.0, 0.3999999761581421, 0.0, 0.0, 0.0, 0.19999998807907104, 0.0, 0.19999998807907104]
------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  0.175+/- 0.03073 (max:  1.0)  |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  0.1875+/- 0.06447 (max:  1.0) |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  0.1625+/- 0.04171 (max:  0.6) |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  0.175+/- 0.05439 (max:  0.6)  |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  1.342+/- 0.1859 (max:  4.359) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  1.369+/- 0.3444 (max:  4.359) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  1.383+/- 0.2926 (max:  3.412) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  1.274+/- 0.3466 (max:  3.412) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0)        |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                           |
------------------------------------------------------------------------------------------------
Evaluating ACCEL_CNN-S5_SEED1 against population in Overcooked-CounterCircuit6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [14.59999942779541, 11.199999809265137, 33.0, 18.399999618530273, 17.19999885559082, 12.799999237060547, 6.0, 6.399999618530273, 13.199999809265137, 9.0, 2.799999952316284, 0.3999999761581421, 1.5999999046325684, 0.5999999642372131, 5.0, 3.799999952316284, 4.400000095367432, 3.0, 9.59999942779541, 6.799999713897705, 26.399999618530273, 21.19999885559082, 11.199999809265137, 6.399999618530273, 12.59999942779541, 10.800000190734863, 23.600000381469727, 17.399999618530273, 5.799999713897705, 3.0, 14.199999809265137, 12.59999942779541, 23.19999885559082, 15.59999942779541, 11.800000190734863, 7.199999809265137, 10.0, 7.799999713897705, 20.600000381469727, 13.799999237060547, 11.800000190734863, 6.799999713897705, 16.19999885559082, 12.199999809265137, 38.39999771118164, 28.799999237060547, 11.0, 6.799999713897705]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [14.59999942779541, 11.199999809265137, 6.0, 6.399999618530273, 1.5999999046325684, 0.5999999642372131, 9.59999942779541, 6.799999713897705, 12.59999942779541, 10.800000190734863, 14.199999809265137, 12.59999942779541, 10.0, 7.799999713897705, 16.19999885559082, 12.199999809265137]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [33.0, 18.399999618530273, 13.199999809265137, 9.0, 5.0, 3.799999952316284, 26.399999618530273, 21.19999885559082, 23.600000381469727, 17.399999618530273, 23.19999885559082, 15.59999942779541, 20.600000381469727, 13.799999237060547, 38.39999771118164, 28.799999237060547]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [17.19999885559082, 12.799999237060547, 2.799999952316284, 0.3999999761581421, 4.400000095367432, 3.0, 11.199999809265137, 6.399999618530273, 5.799999713897705, 3.0, 11.800000190734863, 7.199999809265137, 11.800000190734863, 6.799999713897705, 11.0, 6.799999713897705]
-----------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  12.23+/- 1.203 (max:  38.4)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  7.65+/- 1.141 (max:  17.2)      |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  9.575+/- 1.114 (max:  16.2)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  19.46+/- 2.388 (max:  38.4)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  11.78+/- 0.5775 (max:  21.97)   |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  9.269+/- 0.5789 (max:  12.17)   |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  10.74+/- 0.704 (max:  13.52)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  15.35+/- 0.9815 (max:  21.97)   |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.1144+/- 0.02353 (max:  0.62)  |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.02+/- 0.007528 (max:  0.11)   |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.05062+/- 0.01142 (max:  0.14) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.2725+/- 0.04985 (max:  0.62)  |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  0.4                             |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  0.4                             |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  0.6                             |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  3.8                             |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  2.8                             |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  2.8                             |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  3.412                           |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  7.846                           |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                             |
-----------------------------------------------------------------------------------------------------
Evaluating ACCEL_CNN-S5_SEED1 against population in Overcooked-AsymmAdvantages6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [1.7999999523162842, 2.5999999046325684, 0.5999999642372131, 11.0, 1.399999976158142, 3.5999999046325684, 1.7999999523162842, 6.599999904632568, 1.0, 45.599998474121094, 1.399999976158142, 3.5999999046325684, 1.399999976158142, 41.0, 1.5999999046325684, 57.79999923706055, 1.7999999523162842, 13.59999942779541, 1.0, 17.799999237060547, 1.7999999523162842, 10.0, 2.3999998569488525, 6.399999618530273, 1.1999999284744263, 3.1999998092651367, 1.5999999046325684, 19.0, 1.5999999046325684, 3.799999952316284, 0.19999998807907104, 2.200000047683716, 1.7999999523162842, 33.0, 2.0, 4.400000095367432, 1.0, 2.5999999046325684, 1.7999999523162842, 18.0, 1.1999999284744263, 7.599999904632568, 0.5999999642372131, 5.400000095367432, 0.5999999642372131, 20.600000381469727, 1.399999976158142, 2.0]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [1.7999999523162842, 2.5999999046325684, 1.7999999523162842, 6.599999904632568, 1.399999976158142, 41.0, 1.0, 17.799999237060547, 1.1999999284744263, 3.1999998092651367, 0.19999998807907104, 2.200000047683716, 1.0, 2.5999999046325684, 0.5999999642372131, 5.400000095367432]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.5999999642372131, 11.0, 1.0, 45.599998474121094, 1.5999999046325684, 57.79999923706055, 1.7999999523162842, 10.0, 1.5999999046325684, 19.0, 1.7999999523162842, 33.0, 1.7999999523162842, 18.0, 0.5999999642372131, 20.600000381469727]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [1.399999976158142, 3.5999999046325684, 1.399999976158142, 3.5999999046325684, 1.7999999523162842, 13.59999942779541, 2.3999998569488525, 6.399999618530273, 1.5999999046325684, 3.799999952316284, 2.0, 4.400000095367432, 1.1999999284744263, 7.599999904632568, 1.399999976158142, 2.0]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  7.8+/- 1.813 (max:  57.8)       |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  3.637+/- 0.8129 (max:  13.6)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  5.65+/- 2.583 (max:  41.0)      |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  14.11+/- 4.411 (max:  57.8)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  9.557+/- 0.9995 (max:  30.45)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  7.627+/- 0.6797 (max:  14.11)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  8.045+/- 1.619 (max:  28.34)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  13.0+/- 2.262 (max:  30.45)     |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.08854+/- 0.02773 (max:  0.78) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.01812+/- 0.00765 (max:  0.12) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.05688+/- 0.03978 (max:  0.61) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.1906+/- 0.06703 (max:  0.78)  |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.2                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  1.2                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.2                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.6                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  1.99                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  4.75                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  1.99                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  3.412                           |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                             |
------------------------------------------------------------------------------------------------------
Evaluating ACCEL_CNN-S5_SEED1 against population in Overcooked-CrampedRoom6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [8.399999618530273, 7.0, 65.19999694824219, 63.19999694824219, 76.4000015258789, 74.79999542236328, 13.59999942779541, 12.0, 63.39999771118164, 58.39999771118164, 82.0, 72.79999542236328, 17.0, 15.799999237060547, 77.5999984741211, 73.4000015258789, 71.5999984741211, 64.19999694824219, 15.799999237060547, 15.0, 70.0, 68.5999984741211, 53.39999771118164, 52.599998474121094, 8.199999809265137, 8.59999942779541, 66.4000015258789, 62.599998474121094, 67.0, 73.19999694824219, 16.799999237060547, 16.0, 65.5999984741211, 69.4000015258789, 83.19999694824219, 88.5999984741211, 16.19999885559082, 13.199999809265137, 70.19999694824219, 69.79999542236328, 73.19999694824219, 75.5999984741211, 17.19999885559082, 14.799999237060547, 75.4000015258789, 71.0, 73.79999542236328, 75.79999542236328]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [8.399999618530273, 7.0, 13.59999942779541, 12.0, 17.0, 15.799999237060547, 15.799999237060547, 15.0, 8.199999809265137, 8.59999942779541, 16.799999237060547, 16.0, 16.19999885559082, 13.199999809265137, 17.19999885559082, 14.799999237060547]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [65.19999694824219, 63.19999694824219, 63.39999771118164, 58.39999771118164, 77.5999984741211, 73.4000015258789, 70.0, 68.5999984741211, 66.4000015258789, 62.599998474121094, 65.5999984741211, 69.4000015258789, 70.19999694824219, 69.79999542236328, 75.4000015258789, 71.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [76.4000015258789, 74.79999542236328, 82.0, 72.79999542236328, 71.5999984741211, 64.19999694824219, 53.39999771118164, 52.599998474121094, 67.0, 73.19999694824219, 83.19999694824219, 88.5999984741211, 73.19999694824219, 75.5999984741211, 73.79999542236328, 75.79999542236328]
--------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  51.33+/- 4.021 (max:  88.6)     |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  72.39+/- 2.388 (max:  88.6)     |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  13.47+/- 0.8841 (max:  17.2)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  68.14+/- 1.26 (max:  77.6)      |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  25.21+/- 1.261 (max:  35.47)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  31.18+/- 0.5428 (max:  34.14)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  13.42+/- 0.4522 (max:  15.59)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  31.04+/- 0.7315 (max:  35.47)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.621+/- 0.05182 (max:  0.96)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.8762+/- 0.01604 (max:  0.96)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.125+/- 0.01725 (max:  0.22)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.8619+/- 0.008427 (max:  0.93) |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  7.0                             |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  52.6                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  7.0                             |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  58.4                            |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  10.34                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  27.66                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  10.34                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  24.96                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.02                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.73                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.02                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.77                            |
--------------------------------------------------------------------------------------------------
Evaluating ACCEL_CNN-S5_SEED2 against population in Overcooked-CoordRing6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [1.7999999523162842, 3.0, 5.599999904632568, 6.599999904632568, 1.7999999523162842, 6.599999904632568, 4.799999713897705, 8.59999942779541, 9.399999618530273, 10.59999942779541, 3.1999998092651367, 7.199999809265137, 5.199999809265137, 6.199999809265137, 7.399999618530273, 7.599999904632568, 4.599999904632568, 5.199999809265137, 5.199999809265137, 3.5999999046325684, 4.599999904632568, 7.399999618530273, 3.1999998092651367, 4.599999904632568, 7.399999618530273, 8.199999809265137, 3.5999999046325684, 6.0, 1.7999999523162842, 3.5999999046325684, 5.599999904632568, 6.0, 10.199999809265137, 13.199999809265137, 14.59999942779541, 16.600000381469727, 1.1999999284744263, 1.0, 8.800000190734863, 8.800000190734863, 14.59999942779541, 15.0, 5.599999904632568, 8.199999809265137, 6.0, 7.199999809265137, 11.399999618530273, 13.399999618530273]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [1.7999999523162842, 3.0, 4.799999713897705, 8.59999942779541, 5.199999809265137, 6.199999809265137, 5.199999809265137, 3.5999999046325684, 7.399999618530273, 8.199999809265137, 5.599999904632568, 6.0, 1.1999999284744263, 1.0, 5.599999904632568, 8.199999809265137]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [5.599999904632568, 6.599999904632568, 9.399999618530273, 10.59999942779541, 7.399999618530273, 7.599999904632568, 4.599999904632568, 7.399999618530273, 3.5999999046325684, 6.0, 10.199999809265137, 13.199999809265137, 8.800000190734863, 8.800000190734863, 6.0, 7.199999809265137]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [1.7999999523162842, 6.599999904632568, 3.1999998092651367, 7.199999809265137, 4.599999904632568, 5.199999809265137, 3.1999998092651367, 4.599999904632568, 1.7999999523162842, 3.5999999046325684, 14.59999942779541, 16.600000381469727, 14.59999942779541, 15.0, 11.399999618530273, 13.399999618530273]
-------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  6.917+/- 0.5506 (max:  16.6)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  7.962+/- 1.333 (max:  16.6)      |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  5.1+/- 0.6088 (max:  8.6)        |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  7.687+/- 0.6072 (max:  13.2)     |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  9.568+/- 0.2986 (max:  13.03)    |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  9.48+/- 0.5955 (max:  12.92)     |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  8.839+/- 0.5658 (max:  11.75)    |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  10.39+/- 0.2874 (max:  13.03)    |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.02437+/- 0.004334 (max:  0.11) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.0325+/- 0.01074 (max:  0.11)   |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.01562+/- 0.00418 (max:  0.05)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.025+/- 0.005845 (max:  0.1)    |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  1.0                              |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  1.8                              |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  1.0                              |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  3.6                              |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  4.359                            |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  5.724                            |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  4.359                            |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  8.188                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.0                              |
-------------------------------------------------------------------------------------------------
Evaluating ACCEL_CNN-S5_SEED2 against population in Overcooked-ForcedCoord6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [1.0, 0.0, 1.0, 0.0, 0.0, 0.0, 1.0, 0.3999999761581421, 0.7999999523162842, 0.3999999761581421, 0.3999999761581421, 0.19999998807907104, 0.5999999642372131, 0.0, 0.7999999523162842, 0.19999998807907104, 0.0, 0.0, 0.7999999523162842, 0.3999999761581421, 0.5999999642372131, 0.0, 0.7999999523162842, 0.3999999761581421, 1.399999976158142, 0.0, 0.7999999523162842, 0.0, 0.3999999761581421, 0.0, 0.5999999642372131, 0.0, 0.3999999761581421, 0.19999998807907104, 0.0, 0.5999999642372131, 0.0, 0.0, 0.19999998807907104, 0.19999998807907104, 0.19999998807907104, 1.0, 1.0, 0.0, 2.0, 0.19999998807907104, 2.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [1.0, 0.0, 1.0, 0.3999999761581421, 0.5999999642372131, 0.0, 0.7999999523162842, 0.3999999761581421, 1.399999976158142, 0.0, 0.5999999642372131, 0.0, 0.0, 0.0, 1.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [1.0, 0.0, 0.7999999523162842, 0.3999999761581421, 0.7999999523162842, 0.19999998807907104, 0.5999999642372131, 0.0, 0.7999999523162842, 0.0, 0.3999999761581421, 0.19999998807907104, 0.19999998807907104, 0.19999998807907104, 2.0, 0.19999998807907104]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [0.0, 0.0, 0.3999999761581421, 0.19999998807907104, 0.0, 0.0, 0.7999999523162842, 0.3999999761581421, 0.3999999761581421, 0.0, 0.0, 0.5999999642372131, 0.19999998807907104, 1.0, 2.0, 0.0]
------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  0.4375+/- 0.07236 (max:  2.0) |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  0.375+/- 0.134 (max:  2.0)    |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  0.45+/- 0.119 (max:  1.4)     |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  0.4875+/- 0.1291 (max:  2.0)  |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  2.201+/- 0.2716 (max:  6.0)   |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  1.879+/- 0.487 (max:  6.0)    |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  2.158+/- 0.5118 (max:  5.103) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  2.567+/- 0.422 (max:  6.0)    |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0)        |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                           |
------------------------------------------------------------------------------------------------
Evaluating ACCEL_CNN-S5_SEED2 against population in Overcooked-CounterCircuit6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [14.59999942779541, 10.59999942779541, 35.0, 22.600000381469727, 28.599998474121094, 27.0, 13.59999942779541, 10.800000190734863, 20.399999618530273, 13.799999237060547, 6.599999904632568, 0.7999999523162842, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 1.5999999046325684, 2.5999999046325684, 10.0, 10.800000190734863, 27.799999237060547, 22.19999885559082, 15.199999809265137, 5.599999904632568, 15.0, 12.0, 32.79999923706055, 25.599998474121094, 8.0, 3.3999998569488525, 15.0, 15.0, 34.0, 23.799999237060547, 15.199999809265137, 5.599999904632568, 16.19999885559082, 8.800000190734863, 43.0, 19.0, 9.399999618530273, 3.1999998092651367, 16.399999618530273, 9.800000190734863, 44.599998474121094, 23.19999885559082, 9.800000190734863, 5.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [14.59999942779541, 10.59999942779541, 13.59999942779541, 10.800000190734863, 0.3999999761581421, 0.0, 10.0, 10.800000190734863, 15.0, 12.0, 15.0, 15.0, 16.19999885559082, 8.800000190734863, 16.399999618530273, 9.800000190734863]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [35.0, 22.600000381469727, 20.399999618530273, 13.799999237060547, 0.3999999761581421, 0.0, 27.799999237060547, 22.19999885559082, 32.79999923706055, 25.599998474121094, 34.0, 23.799999237060547, 43.0, 19.0, 44.599998474121094, 23.19999885559082]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [28.599998474121094, 27.0, 6.599999904632568, 0.7999999523162842, 1.5999999046325684, 2.5999999046325684, 15.199999809265137, 5.599999904632568, 8.0, 3.3999998569488525, 15.199999809265137, 5.599999904632568, 9.399999618530273, 3.1999998092651367, 9.800000190734863, 5.0]
----------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  14.89+/- 1.623 (max:  44.6)    |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  9.225+/- 2.1 (max:  28.6)      |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  11.19+/- 1.234 (max:  16.4)    |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  24.26+/- 3.149 (max:  44.6)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  11.82+/- 0.7045 (max:  19.93)  |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  9.154+/- 0.6016 (max:  12.45)  |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  10.99+/- 0.979 (max:  15.19)   |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  15.32+/- 1.418 (max:  19.93)   |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.1773+/- 0.03269 (max:  0.81) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.06625+/- 0.0372 (max:  0.46) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.07187+/- 0.0117 (max:  0.17) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.3937+/- 0.06194 (max:  0.81) |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  0.0                            |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  0.8                            |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  0.0                            |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  3.919                          |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                            |
----------------------------------------------------------------------------------------------------
Evaluating ACCEL_CNN-S5_SEED2 against population in Overcooked-AsymmAdvantages6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [0.3999999761581421, 1.399999976158142, 0.0, 5.400000095367432, 0.0, 0.0, 0.0, 3.1999998092651367, 0.0, 36.20000076293945, 0.19999998807907104, 0.0, 0.19999998807907104, 31.19999885559082, 0.3999999761581421, 48.20000076293945, 0.3999999761581421, 7.599999904632568, 0.3999999761581421, 11.399999618530273, 0.3999999761581421, 5.400000095367432, 0.19999998807907104, 0.3999999761581421, 0.19999998807907104, 1.0, 0.0, 13.399999618530273, 0.19999998807907104, 0.7999999523162842, 0.0, 1.1999999284744263, 0.3999999761581421, 24.19999885559082, 0.19999998807907104, 0.3999999761581421, 0.19999998807907104, 1.399999976158142, 0.0, 13.399999618530273, 0.19999998807907104, 1.7999999523162842, 0.5999999642372131, 3.799999952316284, 0.0, 18.399999618530273, 0.3999999761581421, 0.19999998807907104]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.3999999761581421, 1.399999976158142, 0.0, 3.1999998092651367, 0.19999998807907104, 31.19999885559082, 0.3999999761581421, 11.399999618530273, 0.19999998807907104, 1.0, 0.0, 1.1999999284744263, 0.19999998807907104, 1.399999976158142, 0.5999999642372131, 3.799999952316284]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.0, 5.400000095367432, 0.0, 36.20000076293945, 0.3999999761581421, 48.20000076293945, 0.3999999761581421, 5.400000095367432, 0.0, 13.399999618530273, 0.3999999761581421, 24.19999885559082, 0.0, 13.399999618530273, 0.0, 18.399999618530273]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [0.0, 0.0, 0.19999998807907104, 0.0, 0.3999999761581421, 7.599999904632568, 0.19999998807907104, 0.3999999761581421, 0.19999998807907104, 0.7999999523162842, 0.19999998807907104, 0.3999999761581421, 0.19999998807907104, 1.7999999523162842, 0.3999999761581421, 0.19999998807907104]
--------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  4.904+/- 1.492 (max:  48.2)       |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  0.8125+/- 0.4653 (max:  7.6)      |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  3.537+/- 1.974 (max:  31.2)       |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  10.36+/- 3.684 (max:  48.2)       |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  6.068+/- 1.091 (max:  31.38)      |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  2.697+/- 0.6093 (max:  9.708)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  5.737+/- 1.62 (max:  25.51)       |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  9.771+/- 2.553 (max:  31.38)      |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.05958+/- 0.02192 (max:  0.67)   |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.000625+/- 0.000625 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.03937+/- 0.02983 (max:  0.47)   |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.1387+/- 0.0543 (max:  0.67)     |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.0                               |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.0                               |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.0                               |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                               |
--------------------------------------------------------------------------------------------------------
Evaluating ACCEL_CNN-S5_SEED2 against population in Overcooked-CrampedRoom6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [9.800000190734863, 6.799999713897705, 58.599998474121094, 54.39999771118164, 67.4000015258789, 67.5999984741211, 9.399999618530273, 10.800000190734863, 44.599998474121094, 35.39999771118164, 51.19999694824219, 44.0, 12.799999237060547, 11.0, 54.0, 48.0, 57.79999923706055, 60.0, 13.799999237060547, 13.199999809265137, 55.0, 51.39999771118164, 39.599998474121094, 40.0, 9.800000190734863, 8.800000190734863, 37.79999923706055, 35.79999923706055, 35.39999771118164, 35.20000076293945, 16.600000381469727, 15.199999809265137, 51.39999771118164, 43.0, 50.0, 48.39999771118164, 10.399999618530273, 9.0, 50.0, 46.20000076293945, 43.79999923706055, 42.0, 16.19999885559082, 14.799999237060547, 53.19999694824219, 50.20000076293945, 46.39999771118164, 54.79999923706055]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [9.800000190734863, 6.799999713897705, 9.399999618530273, 10.800000190734863, 12.799999237060547, 11.0, 13.799999237060547, 13.199999809265137, 9.800000190734863, 8.800000190734863, 16.600000381469727, 15.199999809265137, 10.399999618530273, 9.0, 16.19999885559082, 14.799999237060547]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [58.599998474121094, 54.39999771118164, 44.599998474121094, 35.39999771118164, 54.0, 48.0, 55.0, 51.39999771118164, 37.79999923706055, 35.79999923706055, 51.39999771118164, 43.0, 50.0, 46.20000076293945, 53.19999694824219, 50.20000076293945]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [67.4000015258789, 67.5999984741211, 51.19999694824219, 44.0, 57.79999923706055, 60.0, 39.599998474121094, 40.0, 35.39999771118164, 35.20000076293945, 50.0, 48.39999771118164, 43.79999923706055, 42.0, 46.39999771118164, 54.79999923706055]
-------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  36.27+/- 2.734 (max:  67.6)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  48.97+/- 2.562 (max:  67.6)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  11.77+/- 0.7335 (max:  16.6)   |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  48.06+/- 1.766 (max:  58.6)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  24.84+/- 1.26 (max:  37.12)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  30.03+/- 0.6819 (max:  33.59)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  13.28+/- 0.4056 (max:  15.63)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  31.22+/- 0.9342 (max:  37.12)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.4892+/- 0.04298 (max:  0.92) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.6844+/- 0.03431 (max:  0.92) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.09937+/- 0.0128 (max:  0.19) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.6837+/- 0.02876 (max:  0.91) |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  6.8                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  35.2                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  6.8                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  35.4                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  10.28                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  25.1                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  10.28                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  23.2                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.02                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.52                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.02                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.49                           |
-------------------------------------------------------------------------------------------------
Evaluating ACCEL_CNN-S5_SEED3 against population in Overcooked-CoordRing6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [2.799999952316284, 4.0, 14.0, 14.0, 11.800000190734863, 12.0, 12.399999618530273, 13.399999618530273, 22.399999618530273, 24.19999885559082, 9.59999942779541, 13.199999809265137, 9.59999942779541, 12.59999942779541, 12.799999237060547, 16.0, 10.59999942779541, 12.799999237060547, 12.199999809265137, 9.800000190734863, 16.19999885559082, 15.199999809265137, 11.0, 13.59999942779541, 11.399999618530273, 11.59999942779541, 10.0, 11.399999618530273, 12.0, 13.399999618530273, 8.0, 8.800000190734863, 18.19999885559082, 19.600000381469727, 23.19999885559082, 25.0, 3.5999999046325684, 2.5999999046325684, 11.59999942779541, 10.399999618530273, 19.399999618530273, 22.19999885559082, 7.199999809265137, 4.799999713897705, 9.199999809265137, 8.399999618530273, 7.799999713897705, 9.399999618530273]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [2.799999952316284, 4.0, 12.399999618530273, 13.399999618530273, 9.59999942779541, 12.59999942779541, 12.199999809265137, 9.800000190734863, 11.399999618530273, 11.59999942779541, 8.0, 8.800000190734863, 3.5999999046325684, 2.5999999046325684, 7.199999809265137, 4.799999713897705]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [14.0, 14.0, 22.399999618530273, 24.19999885559082, 12.799999237060547, 16.0, 16.19999885559082, 15.199999809265137, 10.0, 11.399999618530273, 18.19999885559082, 19.600000381469727, 11.59999942779541, 10.399999618530273, 9.199999809265137, 8.399999618530273]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [11.800000190734863, 12.0, 9.59999942779541, 13.199999809265137, 10.59999942779541, 12.799999237060547, 11.0, 13.59999942779541, 12.0, 13.399999618530273, 23.19999885559082, 25.0, 19.399999618530273, 22.19999885559082, 7.799999713897705, 9.399999618530273]
------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  12.4+/- 0.771 (max:  25.0)      |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  14.19+/- 1.317 (max:  25.0)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  8.425+/- 0.9527 (max:  13.4)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  14.6+/- 1.164 (max:  24.2)      |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  11.35+/- 0.2857 (max:  15.59)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  10.94+/- 0.4266 (max:  15.59)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  10.85+/- 0.5935 (max:  14.16)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  12.26+/- 0.3876 (max:  15.26)   |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.07625+/- 0.01365 (max:  0.38) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.075+/- 0.02958 (max:  0.38)   |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.045+/- 0.009531 (max:  0.12)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.1087+/- 0.02551 (max:  0.33)  |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  2.6                             |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  7.8                             |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  2.6                             |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  8.4                             |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  6.726                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  9.145                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  6.726                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  10.27                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.01                            |
------------------------------------------------------------------------------------------------
Evaluating ACCEL_CNN-S5_SEED3 against population in Overcooked-ForcedCoord6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [2.0, 0.0, 4.400000095367432, 0.0, 1.0, 0.0, 4.799999713897705, 0.0, 6.199999809265137, 0.0, 4.400000095367432, 0.0, 5.400000095367432, 0.0, 7.399999618530273, 0.0, 6.199999809265137, 0.0, 4.199999809265137, 0.0, 3.799999952316284, 0.0, 1.5999999046325684, 0.0, 1.1999999284744263, 0.0, 2.0, 0.0, 2.3999998569488525, 0.0, 4.0, 0.0, 5.799999713897705, 0.0, 2.0, 0.0, 3.5999999046325684, 0.0, 2.799999952316284, 0.0, 4.599999904632568, 0.0, 2.200000047683716, 0.0, 1.7999999523162842, 0.0, 4.199999809265137, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [2.0, 0.0, 4.799999713897705, 0.0, 5.400000095367432, 0.0, 4.199999809265137, 0.0, 1.1999999284744263, 0.0, 4.0, 0.0, 3.5999999046325684, 0.0, 2.200000047683716, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [4.400000095367432, 0.0, 6.199999809265137, 0.0, 7.399999618530273, 0.0, 3.799999952316284, 0.0, 2.0, 0.0, 5.799999713897705, 0.0, 2.799999952316284, 0.0, 1.7999999523162842, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [1.0, 0.0, 4.400000095367432, 0.0, 6.199999809265137, 0.0, 1.5999999046325684, 0.0, 2.3999998569488525, 0.0, 2.0, 0.0, 4.599999904632568, 0.0, 4.199999809265137, 0.0]
-----------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  1.833+/- 0.3216 (max:  7.4)        |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  1.65+/- 0.5258 (max:  6.2)         |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  1.712+/- 0.5089 (max:  5.4)        |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  2.137+/- 0.6539 (max:  7.4)        |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  3.782+/- 0.5769 (max:  10.45)      |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  3.587+/- 0.9751 (max:  9.673)      |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  3.75+/- 1.012 (max:  9.739)        |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  4.008+/- 1.071 (max:  10.45)       |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.001875+/- 0.0007682 (max:  0.02) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.00125+/- 0.0008539 (max:  0.01)  |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0025+/- 0.001708 (max:  0.02)    |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.001875+/- 0.00136 (max:  0.02)   |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                                |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                                |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                                |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                                |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                                |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                                |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                                |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                                |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                                |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                                |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                                |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                                |
-----------------------------------------------------------------------------------------------------
Evaluating ACCEL_CNN-S5_SEED3 against population in Overcooked-CounterCircuit6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [0.3999999761581421, 0.3999999761581421, 1.5999999046325684, 0.7999999523162842, 0.19999998807907104, 0.19999998807907104, 0.19999998807907104, 0.19999998807907104, 0.5999999642372131, 0.19999998807907104, 0.0, 0.0, 0.5999999642372131, 0.19999998807907104, 2.200000047683716, 1.399999976158142, 0.7999999523162842, 0.3999999761581421, 1.0, 0.0, 5.599999904632568, 2.3999998569488525, 0.7999999523162842, 0.0, 0.3999999761581421, 0.3999999761581421, 4.199999809265137, 2.0, 0.19999998807907104, 0.0, 1.399999976158142, 0.0, 1.399999976158142, 0.3999999761581421, 1.0, 0.0, 0.19999998807907104, 0.0, 0.7999999523162842, 0.3999999761581421, 0.0, 0.0, 0.5999999642372131, 0.0, 1.399999976158142, 0.7999999523162842, 0.19999998807907104, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [0.3999999761581421, 0.3999999761581421, 0.19999998807907104, 0.19999998807907104, 0.5999999642372131, 0.19999998807907104, 1.0, 0.0, 0.3999999761581421, 0.3999999761581421, 1.399999976158142, 0.0, 0.19999998807907104, 0.0, 0.5999999642372131, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [1.5999999046325684, 0.7999999523162842, 0.5999999642372131, 0.19999998807907104, 2.200000047683716, 1.399999976158142, 5.599999904632568, 2.3999998569488525, 4.199999809265137, 2.0, 1.399999976158142, 0.3999999761581421, 0.7999999523162842, 0.3999999761581421, 1.399999976158142, 0.7999999523162842]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [0.19999998807907104, 0.19999998807907104, 0.0, 0.0, 0.7999999523162842, 0.3999999761581421, 0.7999999523162842, 0.0, 0.19999998807907104, 0.0, 1.0, 0.0, 0.0, 0.0, 0.19999998807907104, 0.0]
---------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  0.75+/- 0.1558 (max:  5.6)    |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  0.2375+/- 0.0841 (max:  1.0)  |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  0.375+/- 0.09639 (max:  1.4)  |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  1.637+/- 0.3639 (max:  5.6)   |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  2.87+/- 0.328 (max:  8.98)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  1.435+/- 0.4106 (max:  4.359) |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  2.215+/- 0.3926 (max:  5.103) |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  4.961+/- 0.481 (max:  8.98)   |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.0+/- 0.0 (max:  0.0)        |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  0.0                           |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                           |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  0.0                           |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  0.2                           |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  1.99                          |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                           |
---------------------------------------------------------------------------------------------------
Evaluating ACCEL_CNN-S5_SEED3 against population in Overcooked-AsymmAdvantages6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [0.0, 6.0, 0.0, 15.799999237060547, 0.3999999761581421, 11.0, 0.0, 8.59999942779541, 0.0, 44.39999771118164, 0.19999998807907104, 2.5999999046325684, 0.0, 40.599998474121094, 0.0, 63.599998474121094, 0.19999998807907104, 10.199999809265137, 0.0, 18.0, 0.0, 15.0, 0.0, 4.599999904632568, 0.0, 6.799999713897705, 0.0, 21.799999237060547, 0.0, 7.799999713897705, 0.0, 6.199999809265137, 0.0, 30.799999237060547, 0.0, 1.7999999523162842, 0.19999998807907104, 7.799999713897705, 0.0, 17.19999885559082, 0.19999998807907104, 7.199999809265137, 0.0, 7.199999809265137, 0.0, 25.19999885559082, 0.0, 6.399999618530273]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.0, 6.0, 0.0, 8.59999942779541, 0.0, 40.599998474121094, 0.0, 18.0, 0.0, 6.799999713897705, 0.0, 6.199999809265137, 0.19999998807907104, 7.799999713897705, 0.0, 7.199999809265137]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.0, 15.799999237060547, 0.0, 44.39999771118164, 0.0, 63.599998474121094, 0.0, 15.0, 0.0, 21.799999237060547, 0.0, 30.799999237060547, 0.0, 17.19999885559082, 0.0, 25.19999885559082]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [0.3999999761581421, 11.0, 0.19999998807907104, 2.5999999046325684, 0.19999998807907104, 10.199999809265137, 0.0, 4.599999904632568, 0.0, 7.799999713897705, 0.0, 1.7999999523162842, 0.19999998807907104, 7.199999809265137, 0.0, 6.399999618530273]
-------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  8.079+/- 1.93 (max:  63.6)       |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  3.287+/- 0.9941 (max:  11.0)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  6.337+/- 2.612 (max:  40.6)      |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  14.61+/- 4.756 (max:  63.6)      |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  7.927+/- 1.275 (max:  31.8)      |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  5.898+/- 1.337 (max:  14.25)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  7.021+/- 2.041 (max:  27.78)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  10.86+/- 2.903 (max:  31.8)      |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.09708+/- 0.02841 (max:  0.83)  |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.02062+/- 0.007983 (max:  0.09) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.06812+/- 0.04038 (max:  0.63)  |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.2025+/- 0.06859 (max:  0.83)   |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.0                              |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.0                              |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.0                              |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                              |
-------------------------------------------------------------------------------------------------------
Evaluating ACCEL_CNN-S5_SEED3 against population in Overcooked-CrampedRoom6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc3se5ba_re_lpr_ahg1_s5_h64nb2nl2_0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [7.799999713897705, 7.599999904632568, 58.79999923706055, 60.19999694824219, 86.5999984741211, 91.0, 14.59999942779541, 15.799999237060547, 68.79999542236328, 67.4000015258789, 84.5999984741211, 88.4000015258789, 16.799999237060547, 17.0, 89.0, 89.0, 86.5999984741211, 90.19999694824219, 13.199999809265137, 13.399999618530273, 69.19999694824219, 73.5999984741211, 69.0, 68.79999542236328, 7.799999713897705, 8.800000190734863, 65.0, 63.19999694824219, 76.0, 79.0, 14.199999809265137, 14.59999942779541, 73.5999984741211, 75.5999984741211, 83.0, 85.79999542236328, 17.600000381469727, 15.199999809265137, 60.39999771118164, 66.4000015258789, 86.19999694824219, 85.4000015258789, 16.0, 17.399999618530273, 72.5999984741211, 71.0, 80.5999984741211, 83.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [7.799999713897705, 7.599999904632568, 14.59999942779541, 15.799999237060547, 16.799999237060547, 17.0, 13.199999809265137, 13.399999618530273, 7.799999713897705, 8.800000190734863, 14.199999809265137, 14.59999942779541, 17.600000381469727, 15.199999809265137, 16.0, 17.399999618530273]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [58.79999923706055, 60.19999694824219, 68.79999542236328, 67.4000015258789, 89.0, 89.0, 69.19999694824219, 73.5999984741211, 65.0, 63.19999694824219, 73.5999984741211, 75.5999984741211, 60.39999771118164, 66.4000015258789, 72.5999984741211, 71.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [86.5999984741211, 91.0, 84.5999984741211, 88.4000015258789, 86.5999984741211, 90.19999694824219, 69.0, 68.79999542236328, 76.0, 79.0, 83.0, 85.79999542236328, 86.19999694824219, 85.4000015258789, 80.5999984741211, 83.0]
--------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  55.54+/- 4.491 (max:  91.0)     |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  82.76+/- 1.664 (max:  91.0)     |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  13.61+/- 0.8997 (max:  17.6)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  70.24+/- 2.229 (max:  89.0)     |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  19.7+/- 0.7193 (max:  27.94)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  22.86+/- 0.5345 (max:  25.83)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  13.36+/- 0.3594 (max:  14.93)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  22.87+/- 0.654 (max:  27.94)    |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.6775+/- 0.05719 (max:  1.0)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.9762+/- 0.005468 (max:  1.0)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.1269+/- 0.0158 (max:  0.2)    |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.9294+/- 0.008731 (max:  0.98) |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  7.6                             |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  68.8                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  7.6                             |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  58.8                            |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  10.87                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  19.26                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  10.87                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  18.29                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.03                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.93                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.03                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.84                            |
--------------------------------------------------------------------------------------------------
