Evaluating DR_SoftMoE_SEED1 against population in Overcooked-CoordRing6_9 for xpid dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [4.199999809265137, 3.5999999046325684, 3.799999952316284, 3.0, 1.399999976158142, 3.0, 3.3999998569488525, 4.799999713897705, 5.599999904632568, 9.399999618530273, 2.5999999046325684, 3.0, 6.799999713897705, 7.799999713897705, 4.0, 5.0, 2.5999999046325684, 2.799999952316284, 13.799999237060547, 7.199999809265137, 11.0, 10.199999809265137, 3.0, 0.7999999523162842, 3.1999998092651367, 2.799999952316284, 1.0, 3.3999998569488525, 2.3999998569488525, 2.200000047683716, 14.399999618530273, 14.399999618530273, 21.19999885559082, 21.0, 5.599999904632568, 4.799999713897705, 3.1999998092651367, 2.3999998569488525, 11.399999618530273, 16.600000381469727, 13.799999237060547, 21.0, 9.0, 13.59999942779541, 8.199999809265137, 9.199999809265137, 4.599999904632568, 8.59999942779541]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [4.199999809265137, 3.5999999046325684, 3.3999998569488525, 4.799999713897705, 6.799999713897705, 7.799999713897705, 13.799999237060547, 7.199999809265137, 3.1999998092651367, 2.799999952316284, 14.399999618530273, 14.399999618530273, 3.1999998092651367, 2.3999998569488525, 9.0, 13.59999942779541]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [3.799999952316284, 3.0, 5.599999904632568, 9.399999618530273, 4.0, 5.0, 11.0, 10.199999809265137, 1.0, 3.3999998569488525, 21.19999885559082, 21.0, 11.399999618530273, 16.600000381469727, 8.199999809265137, 9.199999809265137]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [1.399999976158142, 3.0, 2.5999999046325684, 3.0, 2.5999999046325684, 2.799999952316284, 3.0, 0.7999999523162842, 2.3999998569488525, 2.200000047683716, 5.599999904632568, 4.799999713897705, 13.799999237060547, 21.0, 4.599999904632568, 8.59999942779541]
------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  7.1+/- 0.7939 (max:  21.2)      |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  5.137+/- 1.323 (max:  21.0)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  7.162+/- 1.134 (max:  14.4)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  9.0+/- 1.546 (max:  21.2)       |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  10.38+/- 0.4978 (max:  18.63)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  9.118+/- 0.947 (max:  18.63)    |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  10.27+/- 0.6658 (max:  14.39)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  11.74+/- 0.8718 (max:  17.52)   |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.06292+/- 0.01227 (max:  0.34) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.04687+/- 0.02196 (max:  0.34) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.04687+/- 0.01251 (max:  0.14) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.095+/- 0.02596 (max:  0.33)   |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  0.8                             |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  0.8                             |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  2.4                             |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  1.0                             |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  3.919                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  3.919                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  6.94                            |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  5.196                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.01                            |
------------------------------------------------------------------------------------------------
Evaluating DR_SoftMoE_SEED1 against population in Overcooked-ForcedCoord6_9 for xpid dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [0.3999999761581421, 0.3999999761581421, 0.3999999761581421, 1.7999999523162842, 0.5999999642372131, 2.0, 0.3999999761581421, 0.7999999523162842, 0.3999999761581421, 0.5999999642372131, 0.0, 1.0, 0.19999998807907104, 3.3999998569488525, 0.0, 5.400000095367432, 0.19999998807907104, 7.199999809265137, 0.3999999761581421, 0.3999999761581421, 0.3999999761581421, 1.0, 0.19999998807907104, 1.7999999523162842, 0.0, 2.0, 0.3999999761581421, 1.7999999523162842, 1.399999976158142, 1.1999999284744263, 0.19999998807907104, 0.3999999761581421, 0.19999998807907104, 0.19999998807907104, 0.19999998807907104, 0.5999999642372131, 0.19999998807907104, 0.3999999761581421, 0.3999999761581421, 0.19999998807907104, 0.7999999523162842, 0.19999998807907104, 0.3999999761581421, 1.1999999284744263, 0.3999999761581421, 0.3999999761581421, 1.1999999284744263, 1.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [0.3999999761581421, 0.3999999761581421, 0.3999999761581421, 0.7999999523162842, 0.19999998807907104, 3.3999998569488525, 0.3999999761581421, 0.3999999761581421, 0.0, 2.0, 0.19999998807907104, 0.3999999761581421, 0.19999998807907104, 0.3999999761581421, 0.3999999761581421, 1.1999999284744263]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [0.3999999761581421, 1.7999999523162842, 0.3999999761581421, 0.5999999642372131, 0.0, 5.400000095367432, 0.3999999761581421, 1.0, 0.3999999761581421, 1.7999999523162842, 0.19999998807907104, 0.19999998807907104, 0.3999999761581421, 0.19999998807907104, 0.3999999761581421, 0.3999999761581421]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [0.5999999642372131, 2.0, 0.0, 1.0, 0.19999998807907104, 7.199999809265137, 0.19999998807907104, 1.7999999523162842, 1.399999976158142, 1.1999999284744263, 0.19999998807907104, 0.5999999642372131, 0.7999999523162842, 0.19999998807907104, 1.1999999284744263, 1.0]
------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  0.9333+/- 0.1917 (max:  7.2)  |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  1.225+/- 0.4254 (max:  7.2)   |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  0.7+/- 0.216 (max:  3.4)      |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  0.875+/- 0.3291 (max:  5.4)   |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  3.491+/- 0.2874 (max:  9.6)   |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  3.959+/- 0.5544 (max:  9.6)   |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  3.159+/- 0.4342 (max:  7.513) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  3.354+/- 0.5072 (max:  8.879) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0)        |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                           |
------------------------------------------------------------------------------------------------
Evaluating DR_SoftMoE_SEED1 against population in Overcooked-CounterCircuit6_9 for xpid dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [6.399999618530273, 7.0, 10.59999942779541, 9.59999942779541, 6.399999618530273, 2.0, 5.0, 4.599999904632568, 6.199999809265137, 5.599999904632568, 1.0, 0.0, 0.0, 0.0, 1.0, 0.5999999642372131, 1.1999999284744263, 1.1999999284744263, 5.199999809265137, 3.0, 13.59999942779541, 10.59999942779541, 4.0, 2.3999998569488525, 7.399999618530273, 4.199999809265137, 9.800000190734863, 9.59999942779541, 1.5999999046325684, 1.399999976158142, 8.399999618530273, 3.3999998569488525, 10.199999809265137, 6.199999809265137, 5.599999904632568, 4.400000095367432, 6.399999618530273, 4.400000095367432, 7.399999618530273, 7.399999618530273, 7.599999904632568, 2.3999998569488525, 7.399999618530273, 5.799999713897705, 10.199999809265137, 10.0, 6.799999713897705, 1.1999999284744263]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [6.399999618530273, 7.0, 5.0, 4.599999904632568, 0.0, 0.0, 5.199999809265137, 3.0, 7.399999618530273, 4.199999809265137, 8.399999618530273, 3.3999998569488525, 6.399999618530273, 4.400000095367432, 7.399999618530273, 5.799999713897705]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [10.59999942779541, 9.59999942779541, 6.199999809265137, 5.599999904632568, 1.0, 0.5999999642372131, 13.59999942779541, 10.59999942779541, 9.800000190734863, 9.59999942779541, 10.199999809265137, 6.199999809265137, 7.399999618530273, 7.399999618530273, 10.199999809265137, 10.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [6.399999618530273, 2.0, 1.0, 0.0, 1.1999999284744263, 1.1999999284744263, 4.0, 2.3999998569488525, 1.5999999046325684, 1.399999976158142, 5.599999904632568, 4.400000095367432, 7.599999904632568, 2.3999998569488525, 6.799999713897705, 1.1999999284744263]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  5.342+/- 0.4983 (max:  13.6)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  3.075+/- 0.5977 (max:  7.6)      |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  4.912+/- 0.6099 (max:  8.4)      |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  8.037+/- 0.8747 (max:  13.6)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  8.861+/- 0.5576 (max:  16.37)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  6.63+/- 0.7181 (max:  11.59)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  8.289+/- 0.8692 (max:  12.71)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  11.67+/- 0.8794 (max:  16.37)    |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.02833+/- 0.005557 (max:  0.13) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.00625+/- 0.003521 (max:  0.05) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.01187+/- 0.003191 (max:  0.04) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.06687+/- 0.01087 (max:  0.13)  |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  0.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  0.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  0.6                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  3.412                            |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                              |
------------------------------------------------------------------------------------------------------
Evaluating DR_SoftMoE_SEED1 against population in Overcooked-AsymmAdvantages6_9 for xpid dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [10.59999942779541, 15.399999618530273, 9.0, 24.600000381469727, 16.19999885559082, 28.599998474121094, 10.59999942779541, 20.19999885559082, 14.199999809265137, 54.599998474121094, 11.59999942779541, 15.399999618530273, 16.19999885559082, 39.79999923706055, 14.199999809265137, 68.5999984741211, 15.199999809265137, 22.799999237060547, 12.0, 31.0, 13.59999942779541, 25.599998474121094, 13.799999237060547, 11.0, 11.800000190734863, 11.399999618530273, 10.399999618530273, 30.799999237060547, 13.799999237060547, 18.600000381469727, 12.199999809265137, 17.0, 12.0, 43.79999923706055, 13.199999809265137, 13.0, 10.800000190734863, 15.59999942779541, 15.799999237060547, 33.79999923706055, 12.59999942779541, 16.19999885559082, 9.399999618530273, 20.600000381469727, 8.59999942779541, 38.39999771118164, 18.19999885559082, 18.799999237060547]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [10.59999942779541, 15.399999618530273, 10.59999942779541, 20.19999885559082, 16.19999885559082, 39.79999923706055, 12.0, 31.0, 11.800000190734863, 11.399999618530273, 12.199999809265137, 17.0, 10.800000190734863, 15.59999942779541, 9.399999618530273, 20.600000381469727]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [9.0, 24.600000381469727, 14.199999809265137, 54.599998474121094, 14.199999809265137, 68.5999984741211, 13.59999942779541, 25.599998474121094, 10.399999618530273, 30.799999237060547, 12.0, 43.79999923706055, 15.799999237060547, 33.79999923706055, 8.59999942779541, 38.39999771118164]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [16.19999885559082, 28.599998474121094, 11.59999942779541, 15.399999618530273, 15.199999809265137, 22.799999237060547, 13.799999237060547, 11.0, 13.799999237060547, 18.600000381469727, 13.199999809265137, 13.0, 12.59999942779541, 16.19999885559082, 18.19999885559082, 18.799999237060547]
-----------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  19.62+/- 1.775 (max:  68.6)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  16.19+/- 1.132 (max:  28.6)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  16.54+/- 2.067 (max:  39.8)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  26.12+/- 4.452 (max:  68.6)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  19.33+/- 0.8651 (max:  35.24)  |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  19.19+/- 1.115 (max:  27.83)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  17.0+/- 1.186 (max:  30.0)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  21.81+/- 1.901 (max:  35.24)   |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.2521+/- 0.02769 (max:  0.83) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.1987+/- 0.01832 (max:  0.38) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.2056+/- 0.03832 (max:  0.61) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.3519+/- 0.06639 (max:  0.83) |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  8.6                            |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  11.0                           |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  9.4                            |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  8.6                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  12.08                          |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  13.92                          |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  12.68                          |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  12.08                          |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.04                           |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.11                           |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.08                           |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.04                           |
-----------------------------------------------------------------------------------------------------
Evaluating DR_SoftMoE_SEED1 against population in Overcooked-CrampedRoom6_9 for xpid dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [10.800000190734863, 8.399999618530273, 67.4000015258789, 51.19999694824219, 96.5999984741211, 88.5999984741211, 16.19999885559082, 15.59999942779541, 76.79999542236328, 61.19999694824219, 91.5999984741211, 85.4000015258789, 18.19999885559082, 15.59999942779541, 89.4000015258789, 83.5999984741211, 99.5999984741211, 91.79999542236328, 19.0, 16.600000381469727, 86.0, 73.19999694824219, 86.4000015258789, 79.19999694824219, 9.399999618530273, 10.0, 74.19999694824219, 62.39999771118164, 95.4000015258789, 88.0, 17.799999237060547, 14.59999942779541, 82.0, 67.5999984741211, 98.5999984741211, 90.19999694824219, 17.0, 15.399999618530273, 80.79999542236328, 67.5999984741211, 94.5999984741211, 91.0, 21.600000381469727, 16.799999237060547, 85.79999542236328, 72.4000015258789, 92.4000015258789, 90.79999542236328]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [10.800000190734863, 8.399999618530273, 16.19999885559082, 15.59999942779541, 18.19999885559082, 15.59999942779541, 19.0, 16.600000381469727, 9.399999618530273, 10.0, 17.799999237060547, 14.59999942779541, 17.0, 15.399999618530273, 21.600000381469727, 16.799999237060547]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [67.4000015258789, 51.19999694824219, 76.79999542236328, 61.19999694824219, 89.4000015258789, 83.5999984741211, 86.0, 73.19999694824219, 74.19999694824219, 62.39999771118164, 82.0, 67.5999984741211, 80.79999542236328, 67.5999984741211, 85.79999542236328, 72.4000015258789]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [96.5999984741211, 88.5999984741211, 91.5999984741211, 85.4000015258789, 99.5999984741211, 91.79999542236328, 86.4000015258789, 79.19999694824219, 95.4000015258789, 88.0, 98.5999984741211, 90.19999694824219, 94.5999984741211, 91.0, 92.4000015258789, 90.79999542236328]
-------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  60.1+/- 4.853 (max:  99.6)     |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  91.26+/- 1.298 (max:  99.6)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  15.19+/- 0.9285 (max:  21.6)   |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  73.85+/- 2.644 (max:  89.4)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  22.59+/- 0.9647 (max:  31.86)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  27.57+/- 0.8156 (max:  31.86)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  14.03+/- 0.3917 (max:  16.27)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  26.18+/- 0.7295 (max:  31.21)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.6775+/- 0.05446 (max:  1.0)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.96+/- 0.00677 (max:  1.0)    |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.1562+/- 0.01839 (max:  0.3)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.9162+/- 0.01615 (max:  0.98) |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  8.4                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  79.2                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  8.4                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  51.2                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  11.02                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  20.8                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  11.02                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  20.91                          |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.03                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.91                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.03                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.76                           |
-------------------------------------------------------------------------------------------------
Evaluating DR_SoftMoE_SEED2 against population in Overcooked-CoordRing6_9 for xpid SEED_2_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [4.799999713897705, 6.0, 17.19999885559082, 16.399999618530273, 20.799999237060547, 20.799999237060547, 17.600000381469727, 15.399999618530273, 33.599998474121094, 34.599998474121094, 17.0, 20.600000381469727, 16.19999885559082, 12.799999237060547, 22.0, 25.799999237060547, 18.19999885559082, 20.600000381469727, 14.399999618530273, 10.800000190734863, 19.0, 20.600000381469727, 17.799999237060547, 19.19999885559082, 18.600000381469727, 15.59999942779541, 23.399999618530273, 25.19999885559082, 19.399999618530273, 19.799999237060547, 13.59999942779541, 12.199999809265137, 29.399999618530273, 24.799999237060547, 36.599998474121094, 38.20000076293945, 5.0, 6.0, 18.600000381469727, 20.0, 27.399999618530273, 29.399999618530273, 8.399999618530273, 10.0, 15.199999809265137, 15.399999618530273, 17.799999237060547, 19.600000381469727]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [4.799999713897705, 6.0, 17.600000381469727, 15.399999618530273, 16.19999885559082, 12.799999237060547, 14.399999618530273, 10.800000190734863, 18.600000381469727, 15.59999942779541, 13.59999942779541, 12.199999809265137, 5.0, 6.0, 8.399999618530273, 10.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [17.19999885559082, 16.399999618530273, 33.599998474121094, 34.599998474121094, 22.0, 25.799999237060547, 19.0, 20.600000381469727, 23.399999618530273, 25.19999885559082, 29.399999618530273, 24.799999237060547, 18.600000381469727, 20.0, 15.199999809265137, 15.399999618530273]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [20.799999237060547, 20.799999237060547, 17.0, 20.600000381469727, 18.19999885559082, 20.600000381469727, 17.799999237060547, 19.19999885559082, 19.399999618530273, 19.799999237060547, 36.599998474121094, 38.20000076293945, 27.399999618530273, 29.399999618530273, 17.799999237060547, 19.600000381469727]
-----------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  19.0+/- 1.113 (max:  38.2)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  22.7+/- 1.656 (max:  38.2)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  11.71+/- 1.147 (max:  18.6)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  22.57+/- 1.511 (max:  34.6)    |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  12.18+/- 0.2692 (max:  16.76)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  11.08+/- 0.3451 (max:  14.45)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  12.18+/- 0.5189 (max:  15.82)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  13.29+/- 0.3601 (max:  16.76)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.2125+/- 0.02894 (max:  0.81) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.2487+/- 0.06103 (max:  0.81) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.08875+/- 0.017 (max:  0.24)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.3+/- 0.04734 (max:  0.69)    |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  4.8                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  17.0                           |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  4.8                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  15.2                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  8.542                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  8.716                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  8.542                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  11.7                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.06                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.08                           |
-----------------------------------------------------------------------------------------------
Evaluating DR_SoftMoE_SEED2 against population in Overcooked-ForcedCoord6_9 for xpid SEED_2_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [2.799999952316284, 0.0, 3.3999998569488525, 0.0, 2.3999998569488525, 0.3999999761581421, 2.3999998569488525, 0.0, 2.799999952316284, 0.0, 2.200000047683716, 0.0, 2.5999999046325684, 0.0, 3.3999998569488525, 0.0, 2.0, 0.19999998807907104, 3.1999998092651367, 0.0, 2.799999952316284, 0.0, 1.7999999523162842, 0.0, 2.3999998569488525, 0.19999998807907104, 3.5999999046325684, 0.3999999761581421, 2.3999998569488525, 0.0, 2.3999998569488525, 0.0, 3.1999998092651367, 0.0, 2.3999998569488525, 0.0, 1.399999976158142, 0.0, 2.200000047683716, 0.0, 2.200000047683716, 0.0, 2.0, 0.0, 3.1999998092651367, 0.19999998807907104, 3.5999999046325684, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [2.799999952316284, 0.0, 2.3999998569488525, 0.0, 2.5999999046325684, 0.0, 3.1999998092651367, 0.0, 2.3999998569488525, 0.19999998807907104, 2.3999998569488525, 0.0, 1.399999976158142, 0.0, 2.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [3.3999998569488525, 0.0, 2.799999952316284, 0.0, 3.3999998569488525, 0.0, 2.799999952316284, 0.0, 3.5999999046325684, 0.3999999761581421, 3.1999998092651367, 0.0, 2.200000047683716, 0.0, 3.1999998092651367, 0.19999998807907104]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [2.3999998569488525, 0.3999999761581421, 2.200000047683716, 0.0, 2.0, 0.19999998807907104, 1.7999999523162842, 0.0, 2.3999998569488525, 0.0, 2.3999998569488525, 0.0, 2.200000047683716, 0.0, 3.5999999046325684, 0.0]
------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  1.337+/- 0.1963 (max:  3.6)   |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  1.225+/- 0.3119 (max:  3.6)   |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  1.212+/- 0.3201 (max:  3.2)   |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  1.575+/- 0.3958 (max:  3.6)   |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  3.585+/- 0.468 (max:  7.684)  |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  3.513+/- 0.7831 (max:  7.684) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  3.349+/- 0.8175 (max:  7.332) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  3.894+/- 0.8759 (max:  7.684) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0)        |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                           |
------------------------------------------------------------------------------------------------
Evaluating DR_SoftMoE_SEED2 against population in Overcooked-CounterCircuit6_9 for xpid SEED_2_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [1.7999999523162842, 1.5999999046325684, 3.3999998569488525, 1.5999999046325684, 1.399999976158142, 0.5999999642372131, 1.0, 1.1999999284744263, 2.3999998569488525, 1.399999976158142, 0.19999998807907104, 0.0, 3.3999998569488525, 1.0, 10.399999618530273, 5.0, 6.0, 1.7999999523162842, 1.399999976158142, 0.7999999523162842, 10.399999618530273, 8.59999942779541, 2.3999998569488525, 0.0, 2.3999998569488525, 1.7999999523162842, 9.0, 4.599999904632568, 4.199999809265137, 0.5999999642372131, 3.0, 0.0, 5.400000095367432, 1.399999976158142, 1.7999999523162842, 0.3999999761581421, 1.399999976158142, 1.0, 4.0, 1.7999999523162842, 0.19999998807907104, 0.19999998807907104, 2.5999999046325684, 0.5999999642372131, 4.199999809265137, 2.200000047683716, 0.7999999523162842, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [1.7999999523162842, 1.5999999046325684, 1.0, 1.1999999284744263, 3.3999998569488525, 1.0, 1.399999976158142, 0.7999999523162842, 2.3999998569488525, 1.7999999523162842, 3.0, 0.0, 1.399999976158142, 1.0, 2.5999999046325684, 0.5999999642372131]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [3.3999998569488525, 1.5999999046325684, 2.3999998569488525, 1.399999976158142, 10.399999618530273, 5.0, 10.399999618530273, 8.59999942779541, 9.0, 4.599999904632568, 5.400000095367432, 1.399999976158142, 4.0, 1.7999999523162842, 4.199999809265137, 2.200000047683716]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [1.399999976158142, 0.5999999642372131, 0.19999998807907104, 0.0, 6.0, 1.7999999523162842, 2.3999998569488525, 0.0, 4.199999809265137, 0.5999999642372131, 1.7999999523162842, 0.3999999761581421, 0.19999998807907104, 0.19999998807907104, 0.7999999523162842, 0.0]
-------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  2.529+/- 0.3802 (max:  10.4)      |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  1.287+/- 0.4231 (max:  6.0)       |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  1.562+/- 0.2275 (max:  3.4)       |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  4.737+/- 0.7985 (max:  10.4)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  5.618+/- 0.421 (max:  11.79)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  3.794+/- 0.7308 (max:  10.0)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  5.007+/- 0.4442 (max:  7.513)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  8.053+/- 0.541 (max:  11.79)      |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.003125+/- 0.001269 (max:  0.05) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.00125+/- 0.00125 (max:  0.02)   |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.0+/- 0.0 (max:  0.0)            |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.008125+/- 0.003319 (max:  0.05) |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  0.0                               |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                               |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  0.0                               |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  1.4                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  5.103                             |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                               |
-------------------------------------------------------------------------------------------------------
Evaluating DR_SoftMoE_SEED2 against population in Overcooked-AsymmAdvantages6_9 for xpid SEED_2_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [0.0, 19.19999885559082, 0.0, 37.599998474121094, 0.0, 31.399999618530273, 0.0, 18.0, 0.0, 56.19999694824219, 0.0, 33.599998474121094, 0.0, 56.19999694824219, 0.0, 79.79999542236328, 0.0, 41.79999923706055, 0.0, 37.39999771118164, 0.0, 38.0, 0.0, 37.39999771118164, 0.0, 18.19999885559082, 0.0, 43.39999771118164, 0.0, 37.20000076293945, 0.0, 14.799999237060547, 0.0, 48.20000076293945, 0.0, 32.599998474121094, 0.0, 17.19999885559082, 0.0, 54.79999923706055, 0.0, 37.599998474121094, 0.0, 21.19999885559082, 0.0, 50.599998474121094, 0.0, 31.799999237060547]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.0, 19.19999885559082, 0.0, 18.0, 0.0, 56.19999694824219, 0.0, 37.39999771118164, 0.0, 18.19999885559082, 0.0, 14.799999237060547, 0.0, 17.19999885559082, 0.0, 21.19999885559082]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.0, 37.599998474121094, 0.0, 56.19999694824219, 0.0, 79.79999542236328, 0.0, 38.0, 0.0, 43.39999771118164, 0.0, 48.20000076293945, 0.0, 54.79999923706055, 0.0, 50.599998474121094]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [0.0, 31.399999618530273, 0.0, 33.599998474121094, 0.0, 41.79999923706055, 0.0, 37.39999771118164, 0.0, 37.20000076293945, 0.0, 32.599998474121094, 0.0, 37.599998474121094, 0.0, 31.799999237060547]
-----------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  18.63+/- 3.135 (max:  79.8)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  17.71+/- 4.616 (max:  41.8)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  12.64+/- 4.077 (max:  56.2)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  25.54+/- 6.988 (max:  79.8)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  11.13+/- 1.665 (max:  29.61)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  11.17+/- 2.889 (max:  23.61)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  9.704+/- 2.614 (max:  28.38)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  12.52+/- 3.26 (max:  29.61)    |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.2821+/- 0.04722 (max:  0.96) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.29+/- 0.076 (max:  0.69)     |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.1737+/- 0.05973 (max:  0.81) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.3825+/- 0.1008 (max:  0.96)  |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.0                            |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.0                            |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.0                            |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  0.0                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                            |
-----------------------------------------------------------------------------------------------------
Evaluating DR_SoftMoE_SEED2 against population in Overcooked-CrampedRoom6_9 for xpid SEED_2_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [8.399999618530273, 7.0, 69.0, 65.0, 102.19999694824219, 99.79999542236328, 14.399999618530273, 14.0, 72.4000015258789, 68.79999542236328, 107.0, 109.0, 18.19999885559082, 18.600000381469727, 90.5999984741211, 91.0, 107.19999694824219, 108.5999984741211, 16.0, 17.600000381469727, 82.79999542236328, 85.79999542236328, 86.79999542236328, 86.19999694824219, 8.399999618530273, 7.799999713897705, 69.4000015258789, 69.0, 95.4000015258789, 94.19999694824219, 20.0, 20.19999885559082, 91.0, 80.5999984741211, 103.79999542236328, 102.5999984741211, 16.0, 16.799999237060547, 75.4000015258789, 75.0, 102.0, 103.19999694824219, 19.600000381469727, 15.59999942779541, 83.19999694824219, 82.0, 103.5999984741211, 103.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [8.399999618530273, 7.0, 14.399999618530273, 14.0, 18.19999885559082, 18.600000381469727, 16.0, 17.600000381469727, 8.399999618530273, 7.799999713897705, 20.0, 20.19999885559082, 16.0, 16.799999237060547, 19.600000381469727, 15.59999942779541]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [69.0, 65.0, 72.4000015258789, 68.79999542236328, 90.5999984741211, 91.0, 82.79999542236328, 85.79999542236328, 69.4000015258789, 69.0, 91.0, 80.5999984741211, 75.4000015258789, 75.0, 83.19999694824219, 82.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [102.19999694824219, 99.79999542236328, 107.0, 109.0, 107.19999694824219, 108.5999984741211, 86.79999542236328, 86.19999694824219, 95.4000015258789, 94.19999694824219, 103.79999542236328, 102.5999984741211, 102.0, 103.19999694824219, 103.5999984741211, 103.0]
--------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  64.67+/- 5.399 (max:  109.0)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  100.9+/- 1.737 (max:  109.0)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  14.91+/- 1.142 (max:  20.2)     |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  78.19+/- 2.205 (max:  91.0)     |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  19.09+/- 0.7209 (max:  28.33)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  20.97+/- 0.6191 (max:  25.88)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  13.14+/- 0.341 (max:  15.56)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  23.15+/- 0.8303 (max:  28.33)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.6927+/- 0.05804 (max:  1.0)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.9937+/- 0.002213 (max:  1.0)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.1337+/- 0.01765 (max:  0.24)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.9506+/- 0.006675 (max:  0.99) |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  7.0                             |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  86.2                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  7.0                             |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  65.0                            |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  10.34                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  16.42                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  10.34                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  17.52                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.02                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.97                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.02                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.9                             |
--------------------------------------------------------------------------------------------------
Evaluating DR_SoftMoE_SEED3 against population in Overcooked-CoordRing6_9 for xpid SEED_3_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [14.199999809265137, 11.399999618530273, 34.599998474121094, 30.399999618530273, 25.399999618530273, 27.0, 25.799999237060547, 23.799999237060547, 39.20000076293945, 37.79999923706055, 28.19999885559082, 29.799999237060547, 27.799999237060547, 24.19999885559082, 40.79999923706055, 36.79999923706055, 21.0, 26.0, 28.399999618530273, 29.19999885559082, 30.599998474121094, 34.79999923706055, 25.0, 24.799999237060547, 24.799999237060547, 24.0, 33.79999923706055, 29.399999618530273, 27.399999618530273, 27.799999237060547, 23.799999237060547, 25.0, 34.39999771118164, 38.39999771118164, 38.79999923706055, 38.39999771118164, 8.800000190734863, 9.800000190734863, 27.599998474121094, 28.19999885559082, 25.399999618530273, 32.79999923706055, 22.19999885559082, 23.19999885559082, 27.399999618530273, 24.399999618530273, 24.600000381469727, 24.799999237060547]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [14.199999809265137, 11.399999618530273, 25.799999237060547, 23.799999237060547, 27.799999237060547, 24.19999885559082, 28.399999618530273, 29.19999885559082, 24.799999237060547, 24.0, 23.799999237060547, 25.0, 8.800000190734863, 9.800000190734863, 22.19999885559082, 23.19999885559082]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [34.599998474121094, 30.399999618530273, 39.20000076293945, 37.79999923706055, 40.79999923706055, 36.79999923706055, 30.599998474121094, 34.79999923706055, 33.79999923706055, 29.399999618530273, 34.39999771118164, 38.39999771118164, 27.599998474121094, 28.19999885559082, 27.399999618530273, 24.399999618530273]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [25.399999618530273, 27.0, 28.19999885559082, 29.799999237060547, 21.0, 26.0, 25.0, 24.799999237060547, 27.399999618530273, 27.799999237060547, 38.79999923706055, 38.39999771118164, 25.399999618530273, 32.79999923706055, 24.600000381469727, 24.799999237060547]
-----------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  27.55+/- 1.037 (max:  40.8)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  27.95+/- 1.225 (max:  38.8)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  21.65+/- 1.669 (max:  29.2)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  33.04+/- 1.22 (max:  40.8)     |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  17.07+/- 0.334 (max:  22.03)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  18.27+/- 0.5251 (max:  21.69)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  15.29+/- 0.4934 (max:  17.64)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  17.65+/- 0.4483 (max:  22.03)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.4375+/- 0.02383 (max:  0.73) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.45+/- 0.02714 (max:  0.67)   |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.2987+/- 0.03773 (max:  0.5)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.5637+/- 0.02863 (max:  0.73) |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  8.8                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  21.0                           |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  8.8                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  24.4                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  11.07                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  14.94                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  11.07                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  14.6                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.03                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.24                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.03                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.34                           |
-----------------------------------------------------------------------------------------------
Evaluating DR_SoftMoE_SEED3 against population in Overcooked-ForcedCoord6_9 for xpid SEED_3_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [0.0, 1.0, 0.19999998807907104, 1.399999976158142, 0.0, 1.399999976158142, 0.19999998807907104, 1.1999999284744263, 0.0, 0.5999999642372131, 0.5999999642372131, 2.200000047683716, 1.0, 1.5999999046325684, 1.5999999046325684, 2.0, 0.19999998807907104, 0.7999999523162842, 0.0, 1.0, 0.3999999761581421, 1.1999999284744263, 0.0, 1.0, 0.3999999761581421, 2.200000047683716, 0.3999999761581421, 0.7999999523162842, 0.19999998807907104, 2.799999952316284, 0.0, 3.0, 0.5999999642372131, 3.0, 0.0, 3.5999999046325684, 0.5999999642372131, 1.1999999284744263, 0.19999998807907104, 2.200000047683716, 0.0, 0.7999999523162842, 0.19999998807907104, 0.3999999761581421, 0.19999998807907104, 0.7999999523162842, 0.5999999642372131, 4.799999713897705]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [0.0, 1.0, 0.19999998807907104, 1.1999999284744263, 1.0, 1.5999999046325684, 0.0, 1.0, 0.3999999761581421, 2.200000047683716, 0.0, 3.0, 0.5999999642372131, 1.1999999284744263, 0.19999998807907104, 0.3999999761581421]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [0.19999998807907104, 1.399999976158142, 0.0, 0.5999999642372131, 1.5999999046325684, 2.0, 0.3999999761581421, 1.1999999284744263, 0.3999999761581421, 0.7999999523162842, 0.5999999642372131, 3.0, 0.19999998807907104, 2.200000047683716, 0.19999998807907104, 0.7999999523162842]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [0.0, 1.399999976158142, 0.5999999642372131, 2.200000047683716, 0.19999998807907104, 0.7999999523162842, 0.0, 1.0, 0.19999998807907104, 2.799999952316284, 0.0, 3.5999999046325684, 0.0, 0.7999999523162842, 0.5999999642372131, 4.799999713897705]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  1.012+/- 0.1544 (max:  4.8)         |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  1.187+/- 0.3603 (max:  4.8)         |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  0.875+/- 0.212 (max:  3.0)          |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  0.975+/- 0.2144 (max:  3.0)         |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  3.61+/- 0.3338 (max:  8.998)        |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  3.624+/- 0.7192 (max:  8.998)       |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  3.4+/- 0.5479 (max:  7.141)         |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  3.807+/- 0.4738 (max:  7.141)       |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0002083+/- 0.0002083 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.000625+/- 0.000625 (max:  0.01)   |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0)              |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0)              |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                                 |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                                 |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                                 |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                                 |
------------------------------------------------------------------------------------------------------
Evaluating DR_SoftMoE_SEED3 against population in Overcooked-CounterCircuit6_9 for xpid SEED_3_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [14.799999237060547, 14.59999942779541, 25.599998474121094, 18.19999885559082, 11.199999809265137, 10.0, 10.0, 8.399999618530273, 15.399999618530273, 11.399999618530273, 3.5999999046325684, 2.0, 13.0, 12.799999237060547, 16.0, 14.199999809265137, 14.799999237060547, 19.799999237060547, 10.0, 7.599999904632568, 20.799999237060547, 17.19999885559082, 8.199999809265137, 7.799999713897705, 11.399999618530273, 7.599999904632568, 24.19999885559082, 17.600000381469727, 4.199999809265137, 2.799999952316284, 13.399999618530273, 13.59999942779541, 19.399999618530273, 14.199999809265137, 5.799999713897705, 4.799999713897705, 8.800000190734863, 6.199999809265137, 22.799999237060547, 12.59999942779541, 9.399999618530273, 7.799999713897705, 15.59999942779541, 10.399999618530273, 33.39999771118164, 19.399999618530273, 10.399999618530273, 8.199999809265137]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [14.799999237060547, 14.59999942779541, 10.0, 8.399999618530273, 13.0, 12.799999237060547, 10.0, 7.599999904632568, 11.399999618530273, 7.599999904632568, 13.399999618530273, 13.59999942779541, 8.800000190734863, 6.199999809265137, 15.59999942779541, 10.399999618530273]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [25.599998474121094, 18.19999885559082, 15.399999618530273, 11.399999618530273, 16.0, 14.199999809265137, 20.799999237060547, 17.19999885559082, 24.19999885559082, 17.600000381469727, 19.399999618530273, 14.199999809265137, 22.799999237060547, 12.59999942779541, 33.39999771118164, 19.399999618530273]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [11.199999809265137, 10.0, 3.5999999046325684, 2.0, 14.799999237060547, 19.799999237060547, 8.199999809265137, 7.799999713897705, 4.199999809265137, 2.799999952316284, 5.799999713897705, 4.799999713897705, 9.399999618530273, 7.799999713897705, 10.399999618530273, 8.199999809265137]
-----------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  12.74+/- 0.9171 (max:  33.4)    |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  8.175+/- 1.153 (max:  19.8)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  11.14+/- 0.7311 (max:  15.6)    |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  18.9+/- 1.397 (max:  33.4)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  12.3+/- 0.4529 (max:  21.92)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  10.07+/- 0.531 (max:  13.71)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  11.43+/- 0.3169 (max:  13.52)   |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  15.4+/- 0.7245 (max:  21.92)    |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.1054+/- 0.01784 (max:  0.53)  |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.035+/- 0.01354 (max:  0.21)   |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.05062+/- 0.01105 (max:  0.13) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.2306+/- 0.03332 (max:  0.53)  |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  2.0                             |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  2.0                             |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  6.2                             |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  11.4                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  6.0                             |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  6.0                             |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  9.708                           |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  10.58                           |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.06                            |
-----------------------------------------------------------------------------------------------------
Evaluating DR_SoftMoE_SEED3 against population in Overcooked-AsymmAdvantages6_9 for xpid SEED_3_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [7.599999904632568, 13.399999618530273, 0.5999999642372131, 23.399999618530273, 19.600000381469727, 18.0, 10.399999618530273, 14.799999237060547, 7.799999713897705, 47.599998474121094, 10.0, 12.399999618530273, 15.59999942779541, 45.0, 11.0, 58.19999694824219, 16.600000381469727, 26.399999618530273, 4.0, 25.799999237060547, 3.799999952316284, 17.799999237060547, 18.600000381469727, 13.199999809265137, 8.199999809265137, 11.399999618530273, 8.399999618530273, 28.19999885559082, 4.400000095367432, 18.799999237060547, 9.59999942779541, 14.199999809265137, 4.599999904632568, 36.20000076293945, 16.600000381469727, 9.800000190734863, 7.399999618530273, 11.59999942779541, 4.599999904632568, 25.399999618530273, 20.0, 17.799999237060547, 8.59999942779541, 10.800000190734863, 1.1999999284744263, 35.39999771118164, 15.399999618530273, 12.799999237060547]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [7.599999904632568, 13.399999618530273, 10.399999618530273, 14.799999237060547, 15.59999942779541, 45.0, 4.0, 25.799999237060547, 8.199999809265137, 11.399999618530273, 9.59999942779541, 14.199999809265137, 7.399999618530273, 11.59999942779541, 8.59999942779541, 10.800000190734863]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.5999999642372131, 23.399999618530273, 7.799999713897705, 47.599998474121094, 11.0, 58.19999694824219, 3.799999952316284, 17.799999237060547, 8.399999618530273, 28.19999885559082, 4.599999904632568, 36.20000076293945, 4.599999904632568, 25.399999618530273, 1.1999999284744263, 35.39999771118164]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [19.600000381469727, 18.0, 10.0, 12.399999618530273, 16.600000381469727, 26.399999618530273, 18.600000381469727, 13.199999809265137, 4.400000095367432, 18.799999237060547, 16.600000381469727, 9.800000190734863, 20.0, 17.799999237060547, 15.399999618530273, 12.799999237060547]
-----------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  16.31+/- 1.731 (max:  58.2)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  15.65+/- 1.288 (max:  26.4)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  13.65+/- 2.419 (max:  45.0)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  19.64+/- 4.408 (max:  58.2)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  14.57+/- 0.7185 (max:  25.98)  |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  15.13+/- 0.6393 (max:  19.77)  |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  13.78+/- 1.065 (max:  25.98)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  14.8+/- 1.801 (max:  25.78)    |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.1917+/- 0.0299 (max:  0.83)  |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.1862+/- 0.02541 (max:  0.42) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.1306+/- 0.04228 (max:  0.67) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.2581+/- 0.07367 (max:  0.83) |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.6                            |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  4.4                            |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  4.0                            |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.6                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  3.412                          |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  9.2                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  8.485                          |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  3.412                          |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.02                           |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.01                           |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                            |
-----------------------------------------------------------------------------------------------------
Evaluating DR_SoftMoE_SEED3 against population in Overcooked-CrampedRoom6_9 for xpid SEED_3_dr-overcooked6x9w15_fs_IMAGE-r1s_32p_1e_400t_ae1e-05-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [24.600000381469727, 20.0, 81.79999542236328, 71.79999542236328, 97.19999694824219, 91.19999694824219, 28.799999237060547, 29.399999618530273, 83.0, 74.5999984741211, 91.0, 87.4000015258789, 31.599998474121094, 27.599998474121094, 103.5999984741211, 95.19999694824219, 96.0, 95.79999542236328, 29.399999618530273, 33.0, 93.79999542236328, 88.19999694824219, 87.19999694824219, 83.4000015258789, 21.600000381469727, 18.799999237060547, 82.19999694824219, 80.0, 104.0, 105.39999389648438, 33.599998474121094, 28.799999237060547, 95.5999984741211, 97.19999694824219, 94.19999694824219, 84.5999984741211, 31.599998474121094, 34.0, 90.79999542236328, 88.5999984741211, 103.79999542236328, 101.19999694824219, 33.39999771118164, 34.79999923706055, 89.79999542236328, 93.0, 92.5999984741211, 93.5999984741211]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [24.600000381469727, 20.0, 28.799999237060547, 29.399999618530273, 31.599998474121094, 27.599998474121094, 29.399999618530273, 33.0, 21.600000381469727, 18.799999237060547, 33.599998474121094, 28.799999237060547, 31.599998474121094, 34.0, 33.39999771118164, 34.79999923706055]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [81.79999542236328, 71.79999542236328, 83.0, 74.5999984741211, 103.5999984741211, 95.19999694824219, 93.79999542236328, 88.19999694824219, 82.19999694824219, 80.0, 95.5999984741211, 97.19999694824219, 90.79999542236328, 88.5999984741211, 89.79999542236328, 93.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [97.19999694824219, 91.19999694824219, 91.0, 87.4000015258789, 96.0, 95.79999542236328, 87.19999694824219, 83.4000015258789, 104.0, 105.39999389648438, 94.19999694824219, 84.5999984741211, 103.79999542236328, 101.19999694824219, 92.5999984741211, 93.5999984741211]
-------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  70.39+/- 4.417 (max:  105.4)   |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  94.29+/- 1.712 (max:  105.4)   |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  28.81+/- 1.274 (max:  34.8)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  88.07+/- 2.151 (max:  103.6)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  27.71+/- 0.9204 (max:  43.02)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  33.13+/- 0.8861 (max:  43.02)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  19.64+/- 0.4019 (max:  22.48)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  30.35+/- 0.5063 (max:  34.45)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.7933+/- 0.03521 (max:  1.0)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.9619+/- 0.00754 (max:  1.0)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.4637+/- 0.02647 (max:  0.6)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.9544+/- 0.00555 (max:  0.99) |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  18.8                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  83.4                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  18.8                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  71.8                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  17.52                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  27.86                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  17.52                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  27.44                          |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.25                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.89                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.25                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.9                            |
-------------------------------------------------------------------------------------------------
Evaluating PLR_SoftMoE_SEED1 against population in Overcooked-CoordRing6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [7.199999809265137, 7.199999809265137, 19.0, 18.600000381469727, 27.399999618530273, 22.399999618530273, 15.59999942779541, 17.0, 32.0, 32.0, 25.0, 24.0, 14.59999942779541, 14.0, 25.799999237060547, 27.19999885559082, 26.599998474121094, 27.19999885559082, 15.0, 14.399999618530273, 17.799999237060547, 17.399999618530273, 22.19999885559082, 24.0, 14.799999237060547, 14.199999809265137, 21.19999885559082, 22.0, 27.799999237060547, 28.399999618530273, 17.600000381469727, 19.600000381469727, 26.799999237060547, 31.599998474121094, 40.599998474121094, 34.20000076293945, 4.0, 5.799999713897705, 20.399999618530273, 19.399999618530273, 24.600000381469727, 28.19999885559082, 14.799999237060547, 13.799999237060547, 15.799999237060547, 15.199999809265137, 12.199999809265137, 16.600000381469727]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [7.199999809265137, 7.199999809265137, 15.59999942779541, 17.0, 14.59999942779541, 14.0, 15.0, 14.399999618530273, 14.799999237060547, 14.199999809265137, 17.600000381469727, 19.600000381469727, 4.0, 5.799999713897705, 14.799999237060547, 13.799999237060547]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [19.0, 18.600000381469727, 32.0, 32.0, 25.799999237060547, 27.19999885559082, 17.799999237060547, 17.399999618530273, 21.19999885559082, 22.0, 26.799999237060547, 31.599998474121094, 20.399999618530273, 19.399999618530273, 15.799999237060547, 15.199999809265137]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [27.399999618530273, 22.399999618530273, 25.0, 24.0, 26.599998474121094, 27.19999885559082, 22.19999885559082, 24.0, 27.799999237060547, 28.399999618530273, 40.599998474121094, 34.20000076293945, 24.600000381469727, 28.19999885559082, 12.199999809265137, 16.600000381469727]
-----------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  20.48+/- 1.116 (max:  40.6)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  25.71+/- 1.599 (max:  40.6)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  13.1+/- 1.128 (max:  19.6)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  22.64+/- 1.449 (max:  32.0)    |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  13.09+/- 0.2731 (max:  17.04)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  12.52+/- 0.4405 (max:  17.04)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  12.86+/- 0.5939 (max:  16.34)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  13.89+/- 0.2947 (max:  16.55)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.265+/- 0.02739 (max:  0.85)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.3687+/- 0.04959 (max:  0.85) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.1169+/- 0.01934 (max:  0.26) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.3094+/- 0.04365 (max:  0.62) |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  4.0                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  12.2                           |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  4.0                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  15.2                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  8.0                            |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  10.2                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  8.0                            |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  12.27                          |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.02                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.1                            |
-----------------------------------------------------------------------------------------------
Evaluating PLR_SoftMoE_SEED1 against population in Overcooked-ForcedCoord6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [4.400000095367432, 0.19999998807907104, 5.400000095367432, 0.19999998807907104, 5.599999904632568, 0.5999999642372131, 1.7999999523162842, 0.0, 2.5999999046325684, 0.19999998807907104, 3.0, 0.3999999761581421, 3.0, 0.19999998807907104, 4.599999904632568, 0.19999998807907104, 4.400000095367432, 0.3999999761581421, 3.1999998092651367, 0.5999999642372131, 3.5999999046325684, 0.3999999761581421, 4.400000095367432, 0.19999998807907104, 4.0, 0.3999999761581421, 4.0, 0.19999998807907104, 3.3999998569488525, 0.5999999642372131, 3.3999998569488525, 0.0, 2.5999999046325684, 0.3999999761581421, 2.5999999046325684, 0.0, 1.1999999284744263, 0.0, 2.5999999046325684, 0.3999999761581421, 2.200000047683716, 0.0, 3.1999998092651367, 0.0, 6.0, 0.0, 5.0, 0.3999999761581421]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [4.400000095367432, 0.19999998807907104, 1.7999999523162842, 0.0, 3.0, 0.19999998807907104, 3.1999998092651367, 0.5999999642372131, 4.0, 0.3999999761581421, 3.3999998569488525, 0.0, 1.1999999284744263, 0.0, 3.1999998092651367, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [5.400000095367432, 0.19999998807907104, 2.5999999046325684, 0.19999998807907104, 4.599999904632568, 0.19999998807907104, 3.5999999046325684, 0.3999999761581421, 4.0, 0.19999998807907104, 2.5999999046325684, 0.3999999761581421, 2.5999999046325684, 0.3999999761581421, 6.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [5.599999904632568, 0.5999999642372131, 3.0, 0.3999999761581421, 4.400000095367432, 0.3999999761581421, 4.400000095367432, 0.19999998807907104, 3.3999998569488525, 0.5999999642372131, 2.5999999046325684, 0.0, 2.200000047683716, 0.0, 5.0, 0.3999999761581421]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  1.921+/- 0.2739 (max:  6.0)         |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  2.075+/- 0.4983 (max:  5.6)         |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  1.6+/- 0.4119 (max:  4.4)           |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  2.087+/- 0.5263 (max:  6.0)         |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  4.706+/- 0.4548 (max:  9.539)       |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  5.028+/- 0.8035 (max:  9.539)       |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  4.171+/- 0.8164 (max:  8.754)       |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  4.918+/- 0.7769 (max:  9.165)       |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0008333+/- 0.0005012 (max:  0.02) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.001875+/- 0.00136 (max:  0.02)    |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.000625+/- 0.000625 (max:  0.01)   |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0)              |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                                 |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                                 |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                                 |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                                 |
------------------------------------------------------------------------------------------------------
Evaluating PLR_SoftMoE_SEED1 against population in Overcooked-CounterCircuit6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [5.599999904632568, 3.1999998092651367, 8.0, 5.199999809265137, 5.400000095367432, 1.7999999523162842, 2.200000047683716, 2.5999999046325684, 5.0, 3.0, 1.399999976158142, 0.0, 3.1999998092651367, 1.7999999523162842, 11.399999618530273, 7.199999809265137, 5.0, 3.3999998569488525, 4.599999904632568, 1.7999999523162842, 13.799999237060547, 9.399999618530273, 6.0, 1.5999999046325684, 3.0, 3.0, 11.399999618530273, 7.199999809265137, 4.199999809265137, 2.200000047683716, 4.400000095367432, 2.200000047683716, 9.399999618530273, 4.599999904632568, 3.1999998092651367, 2.200000047683716, 2.3999998569488525, 2.5999999046325684, 5.799999713897705, 4.199999809265137, 3.0, 0.5999999642372131, 5.400000095367432, 3.3999998569488525, 7.399999618530273, 3.1999998092651367, 4.199999809265137, 1.399999976158142]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [5.599999904632568, 3.1999998092651367, 2.200000047683716, 2.5999999046325684, 3.1999998092651367, 1.7999999523162842, 4.599999904632568, 1.7999999523162842, 3.0, 3.0, 4.400000095367432, 2.200000047683716, 2.3999998569488525, 2.5999999046325684, 5.400000095367432, 3.3999998569488525]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [8.0, 5.199999809265137, 5.0, 3.0, 11.399999618530273, 7.199999809265137, 13.799999237060547, 9.399999618530273, 11.399999618530273, 7.199999809265137, 9.399999618530273, 4.599999904632568, 5.799999713897705, 4.199999809265137, 7.399999618530273, 3.1999998092651367]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [5.400000095367432, 1.7999999523162842, 1.399999976158142, 0.0, 5.0, 3.3999998569488525, 6.0, 1.5999999046325684, 4.199999809265137, 2.200000047683716, 3.1999998092651367, 2.200000047683716, 3.0, 0.5999999642372131, 4.199999809265137, 1.399999976158142]
-------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  4.442+/- 0.4257 (max:  13.8)      |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  2.85+/- 0.438 (max:  6.0)         |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  3.212+/- 0.2986 (max:  5.6)       |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  7.262+/- 0.7888 (max:  13.8)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  8.003+/- 0.3485 (max:  12.85)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  6.449+/- 0.6006 (max:  9.319)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  7.313+/- 0.2724 (max:  9.415)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  10.25+/- 0.4224 (max:  12.85)     |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.01146+/- 0.003234 (max:  0.09)  |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.00125+/- 0.0008539 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.0025+/- 0.001118 (max:  0.01)   |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.03062+/- 0.007717 (max:  0.09)  |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  0.0                               |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                               |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  1.8                               |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  3.0                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  5.724                             |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  7.681                             |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                               |
-------------------------------------------------------------------------------------------------------
Evaluating PLR_SoftMoE_SEED1 against population in Overcooked-AsymmAdvantages6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [0.5999999642372131, 6.0, 0.0, 16.19999885559082, 0.5999999642372131, 6.599999904632568, 0.19999998807907104, 9.800000190734863, 0.0, 45.599998474121094, 0.3999999761581421, 6.599999904632568, 0.0, 41.599998474121094, 0.0, 61.79999923706055, 0.19999998807907104, 15.0, 0.0, 19.799999237060547, 0.0, 15.199999809265137, 0.19999998807907104, 9.0, 0.3999999761581421, 5.400000095367432, 0.0, 23.19999885559082, 0.0, 7.599999904632568, 0.5999999642372131, 7.599999904632568, 0.0, 28.399999618530273, 0.3999999761581421, 6.599999904632568, 0.19999998807907104, 5.400000095367432, 0.0, 22.0, 0.7999999523162842, 12.0, 0.19999998807907104, 7.399999618530273, 0.0, 24.399999618530273, 0.7999999523162842, 6.199999809265137]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.5999999642372131, 6.0, 0.19999998807907104, 9.800000190734863, 0.0, 41.599998474121094, 0.0, 19.799999237060547, 0.3999999761581421, 5.400000095367432, 0.5999999642372131, 7.599999904632568, 0.19999998807907104, 5.400000095367432, 0.19999998807907104, 7.399999618530273]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.0, 16.19999885559082, 0.0, 45.599998474121094, 0.0, 61.79999923706055, 0.0, 15.199999809265137, 0.0, 23.19999885559082, 0.0, 28.399999618530273, 0.0, 22.0, 0.0, 24.399999618530273]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [0.5999999642372131, 6.599999904632568, 0.3999999761581421, 6.599999904632568, 0.19999998807907104, 15.0, 0.19999998807907104, 9.0, 0.0, 7.599999904632568, 0.3999999761581421, 6.599999904632568, 0.7999999523162842, 12.0, 0.7999999523162842, 6.199999809265137]
-------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  8.646+/- 1.922 (max:  61.8)      |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  4.562+/- 1.2 (max:  15.0)        |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  6.575+/- 2.689 (max:  41.6)      |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  14.8+/- 4.704 (max:  61.8)       |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  8.702+/- 1.228 (max:  30.74)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  7.281+/- 1.246 (max:  13.56)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  7.979+/- 1.918 (max:  28.24)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  10.85+/- 2.908 (max:  30.74)     |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.1025+/- 0.02856 (max:  0.85)   |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.02937+/- 0.009809 (max:  0.13) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.06812+/- 0.03898 (max:  0.59)  |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.21+/- 0.06963 (max:  0.85)     |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.0                              |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.0                              |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.0                              |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                              |
-------------------------------------------------------------------------------------------------------
Evaluating PLR_SoftMoE_SEED1 against population in Overcooked-CrampedRoom6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [17.0, 17.600000381469727, 64.19999694824219, 64.0, 75.0, 75.0, 21.399999618530273, 25.0, 61.599998474121094, 53.79999923706055, 81.79999542236328, 83.4000015258789, 19.600000381469727, 21.799999237060547, 73.4000015258789, 70.0, 76.19999694824219, 70.5999984741211, 23.0, 23.19999885559082, 62.0, 64.5999984741211, 56.19999694824219, 57.599998474121094, 12.199999809265137, 16.0, 60.599998474121094, 56.79999923706055, 85.4000015258789, 79.79999542236328, 24.600000381469727, 24.399999618530273, 63.79999923706055, 60.0, 80.4000015258789, 82.4000015258789, 24.600000381469727, 26.399999618530273, 74.19999694824219, 68.4000015258789, 84.4000015258789, 84.79999542236328, 26.0, 25.599998474121094, 62.39999771118164, 63.599998474121094, 64.79999542236328, 73.4000015258789]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [17.0, 17.600000381469727, 21.399999618530273, 25.0, 19.600000381469727, 21.799999237060547, 23.0, 23.19999885559082, 12.199999809265137, 16.0, 24.600000381469727, 24.399999618530273, 24.600000381469727, 26.399999618530273, 26.0, 25.599998474121094]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [64.19999694824219, 64.0, 61.599998474121094, 53.79999923706055, 73.4000015258789, 70.0, 62.0, 64.5999984741211, 60.599998474121094, 56.79999923706055, 63.79999923706055, 60.0, 74.19999694824219, 68.4000015258789, 62.39999771118164, 63.599998474121094]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [75.0, 75.0, 81.79999542236328, 83.4000015258789, 76.19999694824219, 70.5999984741211, 56.19999694824219, 57.599998474121094, 85.4000015258789, 79.79999542236328, 80.4000015258789, 82.4000015258789, 84.4000015258789, 84.79999542236328, 64.79999542236328, 73.4000015258789]
--------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  53.81+/- 3.506 (max:  85.4)     |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  75.7+/- 2.32 (max:  85.4)       |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  21.77+/- 1.042 (max:  26.4)     |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  63.96+/- 1.36 (max:  74.2)      |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  29.84+/- 1.2 (max:  43.54)      |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  36.57+/- 0.8246 (max:  43.54)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  19.0+/- 0.4532 (max:  21.61)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  33.96+/- 0.8097 (max:  39.83)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.6675+/- 0.03748 (max:  0.95)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.8631+/- 0.01688 (max:  0.95)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.3169+/- 0.02188 (max:  0.41)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.8225+/- 0.009725 (max:  0.87) |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  12.2                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  56.2                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  12.2                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  53.8                            |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  14.94                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  29.26                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  14.94                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  28.53                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.14                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.72                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.14                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.74                            |
--------------------------------------------------------------------------------------------------
Evaluating PLR_SoftMoE_SEED2 against population in Overcooked-CoordRing6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [4.799999713897705, 4.400000095367432, 24.0, 21.0, 27.19999885559082, 29.599998474121094, 16.799999237060547, 14.0, 34.599998474121094, 35.79999923706055, 28.399999618530273, 31.0, 14.399999618530273, 15.0, 28.0, 29.19999885559082, 30.19999885559082, 34.599998474121094, 18.799999237060547, 12.0, 20.799999237060547, 21.600000381469727, 25.599998474121094, 25.599998474121094, 18.19999885559082, 14.799999237060547, 26.19999885559082, 24.799999237060547, 29.599998474121094, 30.399999618530273, 19.0, 17.399999618530273, 28.19999885559082, 26.0, 38.599998474121094, 39.0, 6.0, 5.0, 19.799999237060547, 21.399999618530273, 32.79999923706055, 35.79999923706055, 17.19999885559082, 15.399999618530273, 19.799999237060547, 21.399999618530273, 20.799999237060547, 25.399999618530273]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [4.799999713897705, 4.400000095367432, 16.799999237060547, 14.0, 14.399999618530273, 15.0, 18.799999237060547, 12.0, 18.19999885559082, 14.799999237060547, 19.0, 17.399999618530273, 6.0, 5.0, 17.19999885559082, 15.399999618530273]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [24.0, 21.0, 34.599998474121094, 35.79999923706055, 28.0, 29.19999885559082, 20.799999237060547, 21.600000381469727, 26.19999885559082, 24.799999237060547, 28.19999885559082, 26.0, 19.799999237060547, 21.399999618530273, 19.799999237060547, 21.399999618530273]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [27.19999885559082, 29.599998474121094, 28.399999618530273, 31.0, 30.19999885559082, 34.599998474121094, 25.599998474121094, 25.599998474121094, 29.599998474121094, 30.399999618530273, 38.599998474121094, 39.0, 32.79999923706055, 35.79999923706055, 20.799999237060547, 25.399999618530273]
-----------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  22.92+/- 1.261 (max:  39.0)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  30.29+/- 1.246 (max:  39.0)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  13.32+/- 1.319 (max:  19.0)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  25.16+/- 1.248 (max:  35.8)    |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  13.54+/- 0.3026 (max:  18.22)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  13.71+/- 0.5262 (max:  17.97)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  12.84+/- 0.5976 (max:  16.2)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  14.06+/- 0.418 (max:  18.22)   |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.336+/- 0.03009 (max:  0.75)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.5194+/- 0.03608 (max:  0.75) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.1231+/- 0.01947 (max:  0.26) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.3656+/- 0.03884 (max:  0.71) |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  4.4                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  20.8                           |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  4.4                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  19.8                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  8.542                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  11.09                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  8.542                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  11.66                          |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.26                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.19                           |
-----------------------------------------------------------------------------------------------
Evaluating PLR_SoftMoE_SEED2 against population in Overcooked-ForcedCoord6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [2.799999952316284, 0.0, 1.5999999046325684, 0.19999998807907104, 0.19999998807907104, 0.5999999642372131, 1.399999976158142, 0.19999998807907104, 0.7999999523162842, 0.3999999761581421, 1.1999999284744263, 0.0, 2.3999998569488525, 0.3999999761581421, 1.7999999523162842, 0.3999999761581421, 2.200000047683716, 0.7999999523162842, 1.7999999523162842, 0.0, 1.5999999046325684, 0.0, 1.0, 0.19999998807907104, 0.5999999642372131, 0.19999998807907104, 1.0, 0.19999998807907104, 1.399999976158142, 0.3999999761581421, 0.7999999523162842, 0.0, 0.5999999642372131, 0.5999999642372131, 0.3999999761581421, 0.19999998807907104, 0.5999999642372131, 0.0, 0.3999999761581421, 0.0, 0.5999999642372131, 0.0, 2.5999999046325684, 0.0, 2.5999999046325684, 0.0, 4.799999713897705, 0.19999998807907104]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [2.799999952316284, 0.0, 1.399999976158142, 0.19999998807907104, 2.3999998569488525, 0.3999999761581421, 1.7999999523162842, 0.0, 0.5999999642372131, 0.19999998807907104, 0.7999999523162842, 0.0, 0.5999999642372131, 0.0, 2.5999999046325684, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [1.5999999046325684, 0.19999998807907104, 0.7999999523162842, 0.3999999761581421, 1.7999999523162842, 0.3999999761581421, 1.5999999046325684, 0.0, 1.0, 0.19999998807907104, 0.5999999642372131, 0.5999999642372131, 0.3999999761581421, 0.0, 2.5999999046325684, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [0.19999998807907104, 0.5999999642372131, 1.1999999284744263, 0.0, 2.200000047683716, 0.7999999523162842, 1.0, 0.19999998807907104, 1.399999976158142, 0.3999999761581421, 0.3999999761581421, 0.19999998807907104, 0.5999999642372131, 0.0, 4.799999713897705, 0.19999998807907104]
------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  0.8375+/- 0.1423 (max:  4.8)  |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  0.8875+/- 0.2994 (max:  4.8)  |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  0.8625+/- 0.2521 (max:  2.8)  |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  0.7625+/- 0.1908 (max:  2.6)  |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  3.179+/- 0.3258 (max:  8.542) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  3.332+/- 0.5486 (max:  8.542) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  3.032+/- 0.6511 (max:  6.94)  |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  3.174+/- 0.5195 (max:  6.726) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0)        |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                           |
------------------------------------------------------------------------------------------------
Evaluating PLR_SoftMoE_SEED2 against population in Overcooked-CounterCircuit6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [8.0, 5.599999904632568, 10.59999942779541, 12.199999809265137, 7.199999809265137, 3.1999998092651367, 6.199999809265137, 3.0, 5.599999904632568, 4.799999713897705, 1.7999999523162842, 0.0, 5.0, 3.0, 15.399999618530273, 9.800000190734863, 7.599999904632568, 4.599999904632568, 5.199999809265137, 3.1999998092651367, 18.600000381469727, 16.0, 9.399999618530273, 3.5999999046325684, 5.0, 4.199999809265137, 12.799999237060547, 10.800000190734863, 6.0, 1.5999999046325684, 9.399999618530273, 3.799999952316284, 11.800000190734863, 9.399999618530273, 6.799999713897705, 2.200000047683716, 6.599999904632568, 3.3999998569488525, 8.399999618530273, 8.0, 7.599999904632568, 1.7999999523162842, 8.800000190734863, 5.400000095367432, 11.399999618530273, 10.0, 8.800000190734863, 2.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [8.0, 5.599999904632568, 6.199999809265137, 3.0, 5.0, 3.0, 5.199999809265137, 3.1999998092651367, 5.0, 4.199999809265137, 9.399999618530273, 3.799999952316284, 6.599999904632568, 3.3999998569488525, 8.800000190734863, 5.400000095367432]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [10.59999942779541, 12.199999809265137, 5.599999904632568, 4.799999713897705, 15.399999618530273, 9.800000190734863, 18.600000381469727, 16.0, 12.799999237060547, 10.800000190734863, 11.800000190734863, 9.399999618530273, 8.399999618530273, 8.0, 11.399999618530273, 10.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [7.199999809265137, 3.1999998092651367, 1.7999999523162842, 0.0, 7.599999904632568, 4.599999904632568, 9.399999618530273, 3.5999999046325684, 6.0, 1.5999999046325684, 6.799999713897705, 2.200000047683716, 7.599999904632568, 1.7999999523162842, 8.800000190734863, 2.0]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  6.992+/- 0.5864 (max:  18.6)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  4.637+/- 0.7459 (max:  9.4)      |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  5.362+/- 0.5047 (max:  9.4)      |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  10.97+/- 0.904 (max:  18.6)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  9.638+/- 0.41 (max:  16.06)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  7.581+/- 0.6792 (max:  10.75)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  9.033+/- 0.3242 (max:  11.43)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  12.3+/- 0.4854 (max:  16.06)     |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.03042+/- 0.006671 (max:  0.17) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.001875+/- 0.00136 (max:  0.02) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.01062+/- 0.003091 (max:  0.04) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.07875+/- 0.01307 (max:  0.17)  |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  0.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  3.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  4.8                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  7.141                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  8.998                            |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                              |
------------------------------------------------------------------------------------------------------
Evaluating PLR_SoftMoE_SEED2 against population in Overcooked-AsymmAdvantages6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [0.3999999761581421, 1.5999999046325684, 0.3999999761581421, 9.800000190734863, 1.1999999284744263, 6.599999904632568, 0.19999998807907104, 6.599999904632568, 0.0, 43.20000076293945, 0.0, 7.599999904632568, 0.3999999761581421, 33.79999923706055, 0.19999998807907104, 55.599998474121094, 0.7999999523162842, 10.800000190734863, 0.19999998807907104, 17.0, 0.3999999761581421, 9.399999618530273, 1.0, 3.1999998092651367, 0.7999999523162842, 2.0, 0.19999998807907104, 19.399999618530273, 0.3999999761581421, 4.599999904632568, 0.5999999642372131, 3.3999998569488525, 0.3999999761581421, 27.799999237060547, 0.0, 5.199999809265137, 0.0, 4.400000095367432, 0.19999998807907104, 18.19999885559082, 0.5999999642372131, 6.599999904632568, 0.19999998807907104, 2.799999952316284, 0.0, 21.799999237060547, 0.7999999523162842, 2.0]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.3999999761581421, 1.5999999046325684, 0.19999998807907104, 6.599999904632568, 0.3999999761581421, 33.79999923706055, 0.19999998807907104, 17.0, 0.7999999523162842, 2.0, 0.5999999642372131, 3.3999998569488525, 0.0, 4.400000095367432, 0.19999998807907104, 2.799999952316284]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.3999999761581421, 9.800000190734863, 0.0, 43.20000076293945, 0.19999998807907104, 55.599998474121094, 0.3999999761581421, 9.399999618530273, 0.19999998807907104, 19.399999618530273, 0.3999999761581421, 27.799999237060547, 0.19999998807907104, 18.19999885559082, 0.0, 21.799999237060547]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [1.1999999284744263, 6.599999904632568, 0.0, 7.599999904632568, 0.7999999523162842, 10.800000190734863, 1.0, 3.1999998092651367, 0.3999999761581421, 4.599999904632568, 0.0, 5.199999809265137, 0.5999999642372131, 6.599999904632568, 0.7999999523162842, 2.0]
-------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  6.933+/- 1.716 (max:  55.6)      |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  3.212+/- 0.8243 (max:  10.8)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  4.65+/- 2.213 (max:  33.8)       |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  12.94+/- 4.292 (max:  55.6)      |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  8.045+/- 1.111 (max:  31.19)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  6.305+/- 0.9994 (max:  11.93)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  6.692+/- 1.656 (max:  25.56)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  11.14+/- 2.627 (max:  31.19)     |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.07646+/- 0.0253 (max:  0.77)   |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.01375+/- 0.005072 (max:  0.06) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.04437+/- 0.03089 (max:  0.46)  |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.1712+/- 0.06408 (max:  0.77)   |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.0                              |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.0                              |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.0                              |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                              |
-------------------------------------------------------------------------------------------------------
Evaluating PLR_SoftMoE_SEED2 against population in Overcooked-CrampedRoom6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [8.399999618530273, 7.399999618530273, 68.4000015258789, 69.5999984741211, 101.79999542236328, 103.5999984741211, 14.399999618530273, 12.199999809265137, 81.19999694824219, 70.0, 109.79999542236328, 109.19999694824219, 16.19999885559082, 15.199999809265137, 99.19999694824219, 94.79999542236328, 108.79999542236328, 104.0, 19.19999885559082, 17.0, 90.79999542236328, 88.19999694824219, 93.4000015258789, 95.5999984741211, 9.0, 8.199999809265137, 72.5999984741211, 68.5999984741211, 96.19999694824219, 103.79999542236328, 16.399999618530273, 19.0, 94.79999542236328, 86.79999542236328, 109.0, 109.39999389648438, 14.199999809265137, 17.0, 83.0, 80.4000015258789, 108.5999984741211, 107.5999984741211, 21.600000381469727, 17.399999618530273, 91.19999694824219, 89.19999694824219, 111.19999694824219, 109.19999694824219]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [8.399999618530273, 7.399999618530273, 14.399999618530273, 12.199999809265137, 16.19999885559082, 15.199999809265137, 19.19999885559082, 17.0, 9.0, 8.199999809265137, 16.399999618530273, 19.0, 14.199999809265137, 17.0, 21.600000381469727, 17.399999618530273]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [68.4000015258789, 69.5999984741211, 81.19999694824219, 70.0, 99.19999694824219, 94.79999542236328, 90.79999542236328, 88.19999694824219, 72.5999984741211, 68.5999984741211, 94.79999542236328, 86.79999542236328, 83.0, 80.4000015258789, 91.19999694824219, 89.19999694824219]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [101.79999542236328, 103.5999984741211, 109.79999542236328, 109.19999694824219, 108.79999542236328, 104.0, 93.4000015258789, 95.5999984741211, 96.19999694824219, 103.79999542236328, 109.0, 109.39999389648438, 108.5999984741211, 107.5999984741211, 111.19999694824219, 109.19999694824219]
-------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  67.56+/- 5.716 (max:  111.2)   |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  105.1+/- 1.416 (max:  111.2)   |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  14.55+/- 1.087 (max:  21.6)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  83.05+/- 2.611 (max:  99.2)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  22.38+/- 0.9508 (max:  34.81)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  26.23+/- 0.5773 (max:  31.25)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  13.77+/- 0.4501 (max:  16.9)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  27.13+/- 0.7226 (max:  34.81)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.6887+/- 0.05664 (max:  1.0)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.9825+/- 0.003476 (max:  1.0) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.145+/- 0.01992 (max:  0.27)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.9387+/- 0.01076 (max:  0.99) |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  7.4                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  93.4                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  7.4                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  68.4                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  10.62                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  23.4                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  10.62                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  23.82                          |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.02                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.95                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.02                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.82                           |
-------------------------------------------------------------------------------------------------
Evaluating PLR_SoftMoE_SEED3 against population in Overcooked-CoordRing6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [5.599999904632568, 5.599999904632568, 25.19999885559082, 21.399999618530273, 29.19999885559082, 28.399999618530273, 15.799999237060547, 19.19999885559082, 35.79999923706055, 40.0, 29.19999885559082, 30.399999618530273, 14.59999942779541, 17.19999885559082, 30.799999237060547, 31.19999885559082, 28.19999885559082, 26.799999237060547, 14.59999942779541, 11.800000190734863, 20.19999885559082, 21.799999237060547, 24.19999885559082, 23.600000381469727, 18.600000381469727, 18.799999237060547, 26.799999237060547, 29.399999618530273, 31.599998474121094, 32.0, 15.399999618530273, 14.0, 23.0, 27.599998474121094, 41.599998474121094, 44.20000076293945, 3.1999998092651367, 5.400000095367432, 18.19999885559082, 20.19999885559082, 22.0, 22.19999885559082, 16.0, 16.19999885559082, 17.799999237060547, 17.799999237060547, 20.0, 17.799999237060547]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [5.599999904632568, 5.599999904632568, 15.799999237060547, 19.19999885559082, 14.59999942779541, 17.19999885559082, 14.59999942779541, 11.800000190734863, 18.600000381469727, 18.799999237060547, 15.399999618530273, 14.0, 3.1999998092651367, 5.400000095367432, 16.0, 16.19999885559082]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [25.19999885559082, 21.399999618530273, 35.79999923706055, 40.0, 30.799999237060547, 31.19999885559082, 20.19999885559082, 21.799999237060547, 26.799999237060547, 29.399999618530273, 23.0, 27.599998474121094, 18.19999885559082, 20.19999885559082, 17.799999237060547, 17.799999237060547]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [29.19999885559082, 28.399999618530273, 29.19999885559082, 30.399999618530273, 28.19999885559082, 26.799999237060547, 24.19999885559082, 23.600000381469727, 31.599998474121094, 32.0, 41.599998474121094, 44.20000076293945, 22.0, 22.19999885559082, 20.0, 17.799999237060547]
-----------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  22.3+/- 1.31 (max:  44.2)      |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  28.21+/- 1.776 (max:  44.2)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  13.25+/- 1.329 (max:  19.2)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  25.45+/- 1.662 (max:  40.0)    |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  14.12+/- 0.3525 (max:  18.19)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  14.19+/- 0.4903 (max:  17.59)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  12.99+/- 0.6906 (max:  16.93)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  15.16+/- 0.541 (max:  18.19)   |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.3258+/- 0.03085 (max:  0.87) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.4612+/- 0.04632 (max:  0.87) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.1312+/- 0.02313 (max:  0.29) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.385+/- 0.04779 (max:  0.74)  |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  3.2                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  17.8                           |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  3.2                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  17.8                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  7.859                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  11.13                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  7.859                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  11.49                          |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.2                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.12                           |
-----------------------------------------------------------------------------------------------
Evaluating PLR_SoftMoE_SEED3 against population in Overcooked-ForcedCoord6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [4.799999713897705, 0.19999998807907104, 8.199999809265137, 0.19999998807907104, 5.199999809265137, 0.19999998807907104, 5.599999904632568, 0.0, 4.799999713897705, 0.3999999761581421, 3.1999998092651367, 0.19999998807907104, 4.400000095367432, 0.19999998807907104, 4.0, 0.0, 3.5999999046325684, 0.0, 5.799999713897705, 0.19999998807907104, 3.799999952316284, 0.19999998807907104, 3.799999952316284, 0.7999999523162842, 4.400000095367432, 0.0, 6.0, 0.19999998807907104, 6.799999713897705, 0.3999999761581421, 3.5999999046325684, 0.3999999761581421, 3.3999998569488525, 0.19999998807907104, 2.0, 0.0, 3.0, 0.19999998807907104, 3.3999998569488525, 0.3999999761581421, 1.5999999046325684, 0.3999999761581421, 7.399999618530273, 0.19999998807907104, 8.0, 0.5999999642372131, 8.59999942779541, 0.7999999523162842]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [4.799999713897705, 0.19999998807907104, 5.599999904632568, 0.0, 4.400000095367432, 0.19999998807907104, 5.799999713897705, 0.19999998807907104, 4.400000095367432, 0.0, 3.5999999046325684, 0.3999999761581421, 3.0, 0.19999998807907104, 7.399999618530273, 0.19999998807907104]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [8.199999809265137, 0.19999998807907104, 4.799999713897705, 0.3999999761581421, 4.0, 0.0, 3.799999952316284, 0.19999998807907104, 6.0, 0.19999998807907104, 3.3999998569488525, 0.19999998807907104, 3.3999998569488525, 0.3999999761581421, 8.0, 0.5999999642372131]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [5.199999809265137, 0.19999998807907104, 3.1999998092651367, 0.19999998807907104, 3.5999999046325684, 0.0, 3.799999952316284, 0.7999999523162842, 6.799999713897705, 0.3999999761581421, 2.0, 0.0, 1.5999999046325684, 0.3999999761581421, 8.59999942779541, 0.7999999523162842]
---------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  2.537+/- 0.3839 (max:  8.6)      |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  2.35+/- 0.6607 (max:  8.6)       |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  2.525+/- 0.6514 (max:  7.4)      |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  2.737+/- 0.721 (max:  8.2)       |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  5.221+/- 0.5079 (max:  10.62)    |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  5.097+/- 0.8544 (max:  10.3)     |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  5.078+/- 0.93 (max:  9.831)      |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  5.487+/- 0.9074 (max:  10.62)    |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0025+/- 0.0008681 (max:  0.02) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0025+/- 0.001443 (max:  0.02)  |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.00125+/- 0.00125 (max:  0.02)  |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.00375+/- 0.001797 (max:  0.02) |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                              |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                              |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                              |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                              |
---------------------------------------------------------------------------------------------------
Evaluating PLR_SoftMoE_SEED3 against population in Overcooked-CounterCircuit6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [7.0, 6.599999904632568, 8.399999618530273, 7.199999809265137, 6.599999904632568, 2.799999952316284, 4.0, 3.799999952316284, 7.199999809265137, 4.599999904632568, 1.0, 0.19999998807907104, 2.5999999046325684, 3.1999998092651367, 10.800000190734863, 6.799999713897705, 11.59999942779541, 5.0, 6.199999809265137, 2.799999952316284, 14.59999942779541, 13.59999942779541, 7.0, 1.5999999046325684, 5.400000095367432, 3.5999999046325684, 8.199999809265137, 5.799999713897705, 4.400000095367432, 1.399999976158142, 3.3999998569488525, 1.5999999046325684, 9.399999618530273, 5.199999809265137, 5.0, 2.3999998569488525, 3.3999998569488525, 1.7999999523162842, 8.0, 6.399999618530273, 3.1999998092651367, 1.0, 4.199999809265137, 2.5999999046325684, 10.59999942779541, 10.0, 5.599999904632568, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [7.0, 6.599999904632568, 4.0, 3.799999952316284, 2.5999999046325684, 3.1999998092651367, 6.199999809265137, 2.799999952316284, 5.400000095367432, 3.5999999046325684, 3.3999998569488525, 1.5999999046325684, 3.3999998569488525, 1.7999999523162842, 4.199999809265137, 2.5999999046325684]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [8.399999618530273, 7.199999809265137, 7.199999809265137, 4.599999904632568, 10.800000190734863, 6.799999713897705, 14.59999942779541, 13.59999942779541, 8.199999809265137, 5.799999713897705, 9.399999618530273, 5.199999809265137, 8.0, 6.399999618530273, 10.59999942779541, 10.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [6.599999904632568, 2.799999952316284, 1.0, 0.19999998807907104, 11.59999942779541, 5.0, 7.0, 1.5999999046325684, 4.400000095367432, 1.399999976158142, 5.0, 2.3999998569488525, 3.1999998092651367, 1.0, 5.599999904632568, 0.0]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  5.371+/- 0.4917 (max:  14.6)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  3.675+/- 0.7696 (max:  11.6)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  3.887+/- 0.4078 (max:  7.0)      |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  8.55+/- 0.7082 (max:  14.6)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  8.672+/- 0.4168 (max:  15.86)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  6.968+/- 0.7983 (max:  11.38)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  7.776+/- 0.3347 (max:  9.95)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  11.27+/- 0.4302 (max:  15.86)    |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.01937+/- 0.004683 (max:  0.17) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.00875+/- 0.0034 (max:  0.04)   |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.0025+/- 0.001118 (max:  0.01)  |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.04687+/- 0.01079 (max:  0.17)  |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  0.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  1.6                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  4.6                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  5.426                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  8.773                            |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                              |
------------------------------------------------------------------------------------------------------
Evaluating PLR_SoftMoE_SEED3 against population in Overcooked-AsymmAdvantages6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [1.0, 1.7999999523162842, 0.3999999761581421, 11.399999618530273, 1.399999976158142, 3.5999999046325684, 1.0, 5.799999713897705, 1.1999999284744263, 45.39999771118164, 1.5999999046325684, 11.800000190734863, 1.0, 31.599998474121094, 1.1999999284744263, 54.39999771118164, 1.1999999284744263, 9.399999618530273, 1.0, 18.399999618530273, 1.1999999284744263, 8.199999809265137, 0.7999999523162842, 2.3999998569488525, 0.7999999523162842, 2.799999952316284, 0.19999998807907104, 17.0, 0.5999999642372131, 4.599999904632568, 0.7999999523162842, 4.0, 0.5999999642372131, 28.799999237060547, 1.0, 8.399999618530273, 0.19999998807907104, 4.400000095367432, 1.0, 21.19999885559082, 1.0, 6.599999904632568, 0.7999999523162842, 4.199999809265137, 0.19999998807907104, 22.0, 1.5999999046325684, 3.0]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [1.0, 1.7999999523162842, 1.0, 5.799999713897705, 1.0, 31.599998474121094, 1.0, 18.399999618530273, 0.7999999523162842, 2.799999952316284, 0.7999999523162842, 4.0, 0.19999998807907104, 4.400000095367432, 0.7999999523162842, 4.199999809265137]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.3999999761581421, 11.399999618530273, 1.1999999284744263, 45.39999771118164, 1.1999999284744263, 54.39999771118164, 1.1999999284744263, 8.199999809265137, 0.19999998807907104, 17.0, 0.5999999642372131, 28.799999237060547, 1.0, 21.19999885559082, 0.19999998807907104, 22.0]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [1.399999976158142, 3.5999999046325684, 1.5999999046325684, 11.800000190734863, 1.1999999284744263, 9.399999618530273, 0.7999999523162842, 2.3999998569488525, 0.5999999642372131, 4.599999904632568, 1.0, 8.399999618530273, 1.0, 6.599999904632568, 1.5999999046325684, 3.0]
-------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  7.354+/- 1.7 (max:  54.4)        |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  3.687+/- 0.8769 (max:  11.8)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  4.975+/- 2.086 (max:  31.6)      |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  13.4+/- 4.283 (max:  54.4)       |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  9.355+/- 1.051 (max:  32.26)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  7.904+/- 0.9881 (max:  16.52)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  7.804+/- 1.55 (max:  25.8)       |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  12.36+/- 2.471 (max:  32.26)     |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.08646+/- 0.02581 (max:  0.75)  |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.02562+/- 0.009397 (max:  0.12) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.05125+/- 0.03365 (max:  0.5)   |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.1825+/- 0.06401 (max:  0.75)   |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.2                              |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.6                              |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.2                              |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.2                              |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  1.99                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  3.412                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  1.99                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  1.99                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                              |
-------------------------------------------------------------------------------------------------------
Evaluating PLR_SoftMoE_SEED3 against population in Overcooked-CrampedRoom6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.5b4000t0.1s0.3m0.5r_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [13.59999942779541, 14.199999809265137, 66.0, 66.0, 87.79999542236328, 84.79999542236328, 19.399999618530273, 19.399999618530273, 66.0, 65.0, 85.19999694824219, 87.19999694824219, 22.600000381469727, 21.0, 81.19999694824219, 87.79999542236328, 93.0, 94.4000015258789, 19.799999237060547, 20.600000381469727, 78.0, 79.5999984741211, 69.5999984741211, 69.5999984741211, 15.0, 13.799999237060547, 67.4000015258789, 63.19999694824219, 77.5999984741211, 79.4000015258789, 19.19999885559082, 22.600000381469727, 83.19999694824219, 74.79999542236328, 96.19999694824219, 93.79999542236328, 20.600000381469727, 16.600000381469727, 75.5999984741211, 73.19999694824219, 90.0, 94.19999694824219, 22.399999618530273, 21.399999618530273, 82.79999542236328, 79.4000015258789, 83.5999984741211, 87.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [13.59999942779541, 14.199999809265137, 19.399999618530273, 19.399999618530273, 22.600000381469727, 21.0, 19.799999237060547, 20.600000381469727, 15.0, 13.799999237060547, 19.19999885559082, 22.600000381469727, 20.600000381469727, 16.600000381469727, 22.399999618530273, 21.399999618530273]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [66.0, 66.0, 66.0, 65.0, 81.19999694824219, 87.79999542236328, 78.0, 79.5999984741211, 67.4000015258789, 63.19999694824219, 83.19999694824219, 74.79999542236328, 75.5999984741211, 73.19999694824219, 82.79999542236328, 79.4000015258789]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [87.79999542236328, 84.79999542236328, 85.19999694824219, 87.19999694824219, 93.0, 94.4000015258789, 69.5999984741211, 69.5999984741211, 77.5999984741211, 79.4000015258789, 96.19999694824219, 93.79999542236328, 90.0, 94.19999694824219, 83.5999984741211, 87.0]
-------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  59.68+/- 4.371 (max:  96.2)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  85.84+/- 2.074 (max:  96.2)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  18.89+/- 0.8015 (max:  22.6)   |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  74.32+/- 1.954 (max:  87.8)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  26.11+/- 1.206 (max:  39.14)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  33.15+/- 0.6656 (max:  39.14)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  14.98+/- 0.3526 (max:  17.29)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  30.19+/- 0.6522 (max:  34.48)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.6881+/- 0.04774 (max:  0.99) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.9256+/- 0.01411 (max:  0.99) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.2337+/- 0.02162 (max:  0.36) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.905+/- 0.009874 (max:  0.96) |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  13.6                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  69.6                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  13.6                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  63.2                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  12.55                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  29.17                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  12.55                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  24.74                          |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.09                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.79                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.09                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.84                           |
-------------------------------------------------------------------------------------------------
Evaluating PAIRED_SoftMoE_SEED1 against population in Overcooked-CoordRing6_9 for xpid paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [14.799999237060547, 16.19999885559082, 44.79999923706055, 40.79999923706055, 20.399999618530273, 22.600000381469727, 25.799999237060547, 26.799999237060547, 45.20000076293945, 44.0, 22.0, 26.599998474121094, 23.799999237060547, 24.799999237060547, 41.20000076293945, 43.20000076293945, 21.799999237060547, 23.19999885559082, 37.599998474121094, 36.39999771118164, 40.0, 44.20000076293945, 25.799999237060547, 26.399999618530273, 22.0, 26.0, 28.19999885559082, 29.599998474121094, 19.799999237060547, 22.799999237060547, 26.19999885559082, 23.799999237060547, 48.79999923706055, 45.599998474121094, 51.19999694824219, 60.0, 15.799999237060547, 16.600000381469727, 37.599998474121094, 37.20000076293945, 39.599998474121094, 39.79999923706055, 16.399999618530273, 19.799999237060547, 30.19999885559082, 32.79999923706055, 27.799999237060547, 27.599998474121094]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [14.799999237060547, 16.19999885559082, 25.799999237060547, 26.799999237060547, 23.799999237060547, 24.799999237060547, 37.599998474121094, 36.39999771118164, 22.0, 26.0, 26.19999885559082, 23.799999237060547, 15.799999237060547, 16.600000381469727, 16.399999618530273, 19.799999237060547]
k eval/a1:test_return:Overcooked-CoordRing6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CoordRing6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [44.79999923706055, 40.79999923706055, 45.20000076293945, 44.0, 41.20000076293945, 43.20000076293945, 40.0, 44.20000076293945, 28.19999885559082, 29.599998474121094, 48.79999923706055, 45.599998474121094, 37.599998474121094, 37.20000076293945, 30.19999885559082, 32.79999923706055]
k eval/a1:test_return:Overcooked-CoordRing6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [20.399999618530273, 22.600000381469727, 22.0, 26.599998474121094, 21.799999237060547, 23.19999885559082, 25.799999237060547, 26.399999618530273, 19.799999237060547, 22.799999237060547, 51.19999694824219, 60.0, 39.599998474121094, 39.79999923706055, 27.799999237060547, 27.599998474121094]
k eval/a1:test_return:Overcooked-CoordRing6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
-----------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  30.91+/- 1.566 (max:  60.0)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  29.84+/- 2.937 (max:  60.0)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  23.3+/- 1.706 (max:  37.6)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  39.59+/- 1.596 (max:  48.8)    |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  16.96+/- 0.3158 (max:  23.38)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  17.3+/- 0.7194 (max:  23.38)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  16.28+/- 0.4104 (max:  18.63)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  17.32+/- 0.452 (max:  20.65)   |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.504+/- 0.03459 (max:  0.92)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.4494+/- 0.05703 (max:  0.92) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.3425+/- 0.04084 (max:  0.7)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.72+/- 0.03575 (max:  0.86)   |
| eval/a1:test_return:Overcooked-CoordRing6_9               |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CoordRing6_9:high          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CoordRing6_9:low           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CoordRing6_9:mid           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CoordRing6_9           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CoordRing6_9:high      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CoordRing6_9:low       |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CoordRing6_9:mid       |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.0+/- 0.0 (max:  0.0)         |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  14.8                           |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  19.8                           |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  14.8                           |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  28.2                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  12.84                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  14.06                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  12.84                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  13.86                          |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.11                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.2                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.11                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.44                           |
| min:eval/a1:test_return:Overcooked-CoordRing6_9           |  0.0                            |
| min:eval/a1:test_return:Overcooked-CoordRing6_9:high      |  0.0                            |
| min:eval/a1:test_return:Overcooked-CoordRing6_9:low       |  0.0                            |
| min:eval/a1:test_return:Overcooked-CoordRing6_9:mid       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9:high  |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9:low   |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9:mid   |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9:high |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.0                            |
-----------------------------------------------------------------------------------------------
Evaluating PAIRED_SoftMoE_SEED1 against population in Overcooked-ForcedCoord6_9 for xpid paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [6.399999618530273, 0.0, 7.599999904632568, 0.0, 1.7999999523162842, 0.0, 5.199999809265137, 0.0, 5.599999904632568, 0.0, 2.0, 0.0, 5.400000095367432, 0.0, 3.799999952316284, 0.0, 4.0, 0.0, 3.0, 0.0, 3.3999998569488525, 0.0, 1.399999976158142, 0.0, 4.199999809265137, 0.0, 5.199999809265137, 0.0, 5.599999904632568, 0.0, 2.799999952316284, 0.0, 2.200000047683716, 0.0, 0.19999998807907104, 0.0, 3.0, 0.0, 1.7999999523162842, 0.0, 2.5999999046325684, 0.0, 6.599999904632568, 0.0, 6.399999618530273, 0.0, 7.799999713897705, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [6.399999618530273, 0.0, 5.199999809265137, 0.0, 5.400000095367432, 0.0, 3.0, 0.0, 4.199999809265137, 0.0, 2.799999952316284, 0.0, 3.0, 0.0, 6.599999904632568, 0.0]
k eval/a1:test_return:Overcooked-ForcedCoord6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-ForcedCoord6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [7.599999904632568, 0.0, 5.599999904632568, 0.0, 3.799999952316284, 0.0, 3.3999998569488525, 0.0, 5.199999809265137, 0.0, 2.200000047683716, 0.0, 1.7999999523162842, 0.0, 6.399999618530273, 0.0]
k eval/a1:test_return:Overcooked-ForcedCoord6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [1.7999999523162842, 0.0, 2.0, 0.0, 4.0, 0.0, 1.399999976158142, 0.0, 5.599999904632568, 0.0, 0.19999998807907104, 0.0, 2.5999999046325684, 0.0, 7.799999713897705, 0.0]
k eval/a1:test_return:Overcooked-ForcedCoord6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
-----------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  2.042+/- 0.3644 (max:  7.8)        |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  1.587+/- 0.5912 (max:  7.8)        |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  2.287+/- 0.647 (max:  6.6)         |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  2.25+/- 0.6776 (max:  7.6)         |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  3.866+/- 0.5951 (max:  10.16)      |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  3.398+/- 0.9812 (max:  10.16)      |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  4.139+/- 1.083 (max:  9.404)       |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  4.061+/- 1.082 (max:  10.11)       |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.001458+/- 0.0005148 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0025+/- 0.001118 (max:  0.01)    |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.000625+/- 0.000625 (max:  0.01)  |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.00125+/- 0.0008539 (max:  0.01)  |
| eval/a1:test_return:Overcooked-ForcedCoord6_9               |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_return:Overcooked-ForcedCoord6_9:high          |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_return:Overcooked-ForcedCoord6_9:low           |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_return:Overcooked-ForcedCoord6_9:mid           |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9           |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9:high      |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9:low       |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9:mid       |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0)             |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0)             |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                                |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                                |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                                |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                                |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                                |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                                |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                                |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                                |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                                |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                                |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                                |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                                |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9           |  0.0                                |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                                |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                                |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                                |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                                |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                                |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                                |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                                |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                                |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                                |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                                |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                                |
-----------------------------------------------------------------------------------------------------
Evaluating PAIRED_SoftMoE_SEED1 against population in Overcooked-CounterCircuit6_9 for xpid paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [14.799999237060547, 16.399999618530273, 18.399999618530273, 16.799999237060547, 7.0, 10.59999942779541, 10.800000190734863, 12.399999618530273, 13.399999618530273, 15.59999942779541, 3.799999952316284, 4.400000095367432, 5.599999904632568, 3.799999952316284, 7.0, 8.0, 11.199999809265137, 7.199999809265137, 11.800000190734863, 15.59999942779541, 19.799999237060547, 21.600000381469727, 11.800000190734863, 12.799999237060547, 10.800000190734863, 12.799999237060547, 20.399999618530273, 18.799999237060547, 8.199999809265137, 8.800000190734863, 13.0, 13.799999237060547, 13.799999237060547, 13.799999237060547, 8.0, 11.0, 10.59999942779541, 15.199999809265137, 15.0, 13.399999618530273, 11.0, 9.800000190734863, 12.0, 16.19999885559082, 21.600000381469727, 15.59999942779541, 11.800000190734863, 9.59999942779541]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [14.799999237060547, 16.399999618530273, 10.800000190734863, 12.399999618530273, 5.599999904632568, 3.799999952316284, 11.800000190734863, 15.59999942779541, 10.800000190734863, 12.799999237060547, 13.0, 13.799999237060547, 10.59999942779541, 15.199999809265137, 12.0, 16.19999885559082]
k eval/a1:test_return:Overcooked-CounterCircuit6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CounterCircuit6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [18.399999618530273, 16.799999237060547, 13.399999618530273, 15.59999942779541, 7.0, 8.0, 19.799999237060547, 21.600000381469727, 20.399999618530273, 18.799999237060547, 13.799999237060547, 13.799999237060547, 15.0, 13.399999618530273, 21.600000381469727, 15.59999942779541]
k eval/a1:test_return:Overcooked-CounterCircuit6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [7.0, 10.59999942779541, 3.799999952316284, 4.400000095367432, 11.199999809265137, 7.199999809265137, 11.800000190734863, 12.799999237060547, 8.199999809265137, 8.800000190734863, 8.0, 11.0, 11.0, 9.800000190734863, 11.800000190734863, 9.59999942779541]
k eval/a1:test_return:Overcooked-CounterCircuit6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
-----------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  12.41+/- 0.6386 (max:  21.6)    |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  9.187+/- 0.6554 (max:  12.8)    |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  12.22+/- 0.8788 (max:  16.4)    |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  15.81+/- 1.08 (max:  21.6)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  12.17+/- 0.3143 (max:  18.91)   |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  10.86+/- 0.354 (max:  13.59)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  11.73+/- 0.4026 (max:  13.97)   |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  13.91+/- 0.5584 (max:  18.91)   |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.08708+/- 0.01136 (max:  0.33) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.0325+/- 0.007444 (max:  0.11) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.06812+/- 0.01212 (max:  0.17) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.1606+/- 0.02067 (max:  0.33)  |
| eval/a1:test_return:Overcooked-CounterCircuit6_9               |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return:Overcooked-CounterCircuit6_9:high          |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return:Overcooked-CounterCircuit6_9:low           |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return:Overcooked-CounterCircuit6_9:mid           |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9           |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9:high      |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9:low       |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9:mid       |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.0+/- 0.0 (max:  0.0)          |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  3.8                             |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  3.8                             |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  3.8                             |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  7.0                             |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  7.846                           |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  7.846                           |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  7.846                           |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  9.539                           |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                             |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9           |  0.0                             |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                             |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9:low       |  0.0                             |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9:mid       |  0.0                             |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                             |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                             |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9:low   |  0.0                             |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9:mid   |  0.0                             |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                             |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                             |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                             |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                             |
-----------------------------------------------------------------------------------------------------
Evaluating PAIRED_SoftMoE_SEED1 against population in Overcooked-AsymmAdvantages6_9 for xpid paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [1.7999999523162842, 37.79999923706055, 0.5999999642372131, 49.0, 1.5999999046325684, 80.0, 1.5999999046325684, 38.0, 0.5999999642372131, 74.79999542236328, 1.1999999284744263, 61.0, 1.7999999523162842, 70.19999694824219, 1.7999999523162842, 84.79999542236328, 1.399999976158142, 38.599998474121094, 1.0, 58.39999771118164, 3.5999999046325684, 63.79999923706055, 3.3999998569488525, 29.399999618530273, 0.5999999642372131, 30.599998474121094, 0.3999999761581421, 57.39999771118164, 0.7999999523162842, 51.39999771118164, 1.0, 36.20000076293945, 0.7999999523162842, 71.19999694824219, 1.1999999284744263, 66.79999542236328, 0.5999999642372131, 32.0, 0.5999999642372131, 73.0, 1.0, 29.0, 1.0, 36.20000076293945, 0.19999998807907104, 68.5999984741211, 3.5999999046325684, 55.39999771118164]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [1.7999999523162842, 37.79999923706055, 1.5999999046325684, 38.0, 1.7999999523162842, 70.19999694824219, 1.0, 58.39999771118164, 0.5999999642372131, 30.599998474121094, 1.0, 36.20000076293945, 0.5999999642372131, 32.0, 1.0, 36.20000076293945]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9, v [0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.5999999642372131, 49.0, 0.5999999642372131, 74.79999542236328, 1.7999999523162842, 84.79999542236328, 3.5999999046325684, 63.79999923706055, 0.3999999761581421, 57.39999771118164, 0.7999999523162842, 71.19999694824219, 0.5999999642372131, 73.0, 0.19999998807907104, 68.5999984741211]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [1.5999999046325684, 80.0, 1.1999999284744263, 61.0, 1.399999976158142, 38.599998474121094, 3.3999998569488525, 29.399999618530273, 0.7999999523162842, 51.39999771118164, 1.1999999284744263, 66.79999542236328, 1.0, 29.0, 3.5999999046325684, 55.39999771118164]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9:high, v [0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131]
-----------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  27.62+/- 4.231 (max:  84.8)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  26.61+/- 7.127 (max:  80.0)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  21.8+/- 5.846 (max:  70.2)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  34.45+/- 8.824 (max:  84.8)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  17.5+/- 2.017 (max:  42.51)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  20.13+/- 4.016 (max:  42.51)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  14.07+/- 2.526 (max:  30.53)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  18.3+/- 3.803 (max:  41.32)    |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.3604+/- 0.05515 (max:  0.95) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.3331+/- 0.09095 (max:  0.88) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.3212+/- 0.0873 (max:  0.91)  |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.4269+/- 0.1107 (max:  0.95)  |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9               |  0.3+/- 0.04376 (max:  0.6)     |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9:high          |  0.3+/- 0.07746 (max:  0.6)     |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9:low           |  0.3+/- 0.07746 (max:  0.6)     |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9:mid           |  0.3+/- 0.07746 (max:  0.6)     |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9           |  1.706+/- 0.2488 (max:  3.412)  |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  1.706+/- 0.4405 (max:  3.412)  |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  1.706+/- 0.4405 (max:  3.412)  |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  1.706+/- 0.4405 (max:  3.412)  |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.0+/- 0.0 (max:  0.0)         |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.2                            |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.8                            |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.6                            |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.2                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  1.99                           |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  3.919                          |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  3.412                          |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  1.99                           |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                            |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9           |  0.0                            |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.0                            |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.0                            |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                            |
-----------------------------------------------------------------------------------------------------
Evaluating PAIRED_SoftMoE_SEED1 against population in Overcooked-CrampedRoom6_9 for xpid paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [31.19999885559082, 28.799999237060547, 90.19999694824219, 94.79999542236328, 119.79999542236328, 125.39999389648438, 37.79999923706055, 38.39999771118164, 87.5999984741211, 94.0, 110.19999694824219, 111.5999984741211, 42.39999771118164, 37.39999771118164, 103.79999542236328, 106.39999389648438, 109.79999542236328, 112.19999694824219, 41.39999771118164, 41.20000076293945, 91.4000015258789, 96.0, 105.19999694824219, 103.79999542236328, 25.599998474121094, 26.0, 89.5999984741211, 88.4000015258789, 109.79999542236328, 113.19999694824219, 41.0, 39.599998474121094, 95.79999542236328, 103.39999389648438, 115.79999542236328, 106.19999694824219, 40.79999923706055, 40.39999771118164, 99.4000015258789, 97.5999984741211, 110.5999984741211, 117.19999694824219, 43.39999771118164, 43.599998474121094, 98.79999542236328, 95.0, 108.0, 111.79999542236328]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [31.19999885559082, 28.799999237060547, 37.79999923706055, 38.39999771118164, 42.39999771118164, 37.39999771118164, 41.39999771118164, 41.20000076293945, 25.599998474121094, 26.0, 41.0, 39.599998474121094, 40.79999923706055, 40.39999771118164, 43.39999771118164, 43.599998474121094]
k eval/a1:test_return:Overcooked-CrampedRoom6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CrampedRoom6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [90.19999694824219, 94.79999542236328, 87.5999984741211, 94.0, 103.79999542236328, 106.39999389648438, 91.4000015258789, 96.0, 89.5999984741211, 88.4000015258789, 95.79999542236328, 103.39999389648438, 99.4000015258789, 97.5999984741211, 98.79999542236328, 95.0]
k eval/a1:test_return:Overcooked-CrampedRoom6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [119.79999542236328, 125.39999389648438, 110.19999694824219, 111.5999984741211, 109.79999542236328, 112.19999694824219, 105.19999694824219, 103.79999542236328, 109.79999542236328, 113.19999694824219, 115.79999542236328, 106.19999694824219, 110.5999984741211, 117.19999694824219, 108.0, 111.79999542236328]
k eval/a1:test_return:Overcooked-CrampedRoom6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
-------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  81.7+/- 4.736 (max:  125.4)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  111.9+/- 1.387 (max:  125.4)   |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  37.44+/- 1.515 (max:  43.6)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  95.76+/- 1.407 (max:  106.4)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  27.63+/- 0.8489 (max:  40.17)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  33.46+/- 1.016 (max:  40.17)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  21.09+/- 0.447 (max:  23.66)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  28.35+/- 0.6247 (max:  34.93)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.8594+/- 0.02583 (max:  1.0)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.98+/- 0.004564 (max:  1.0)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.6244+/- 0.02644 (max:  0.74) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.9737+/- 0.005313 (max:  1.0) |
| eval/a1:test_return:Overcooked-CrampedRoom6_9               |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CrampedRoom6_9:high          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CrampedRoom6_9:low           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CrampedRoom6_9:mid           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9:high      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9:low       |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9:mid       |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.0+/- 0.0 (max:  0.0)         |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  25.6                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  103.8                          |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  25.6                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  87.6                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  18.44                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  27.13                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  18.44                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  25.24                          |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.41                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.94                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.41                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.92                           |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9           |  0.0                            |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9:high      |  0.0                            |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9:low       |  0.0                            |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9:mid       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9:high  |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9:low   |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9:mid   |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.0                            |
-------------------------------------------------------------------------------------------------
Evaluating PAIRED_SoftMoE_SEED2 against population in Overcooked-CoordRing6_9 for xpid SEED_2_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [9.399999618530273, 11.800000190734863, 28.19999885559082, 27.0, 23.0, 28.19999885559082, 19.600000381469727, 23.0, 39.0, 44.599998474121094, 22.799999237060547, 34.599998474121094, 20.19999885559082, 18.0, 32.0, 37.79999923706055, 26.0, 33.599998474121094, 21.19999885559082, 22.799999237060547, 23.0, 26.799999237060547, 13.59999942779541, 28.799999237060547, 21.0, 22.799999237060547, 34.79999923706055, 37.0, 27.19999885559082, 35.39999771118164, 16.600000381469727, 20.600000381469727, 26.19999885559082, 31.19999885559082, 30.19999885559082, 30.19999885559082, 6.599999904632568, 9.0, 22.399999618530273, 25.399999618530273, 21.19999885559082, 24.19999885559082, 21.799999237060547, 20.399999618530273, 21.600000381469727, 22.600000381469727, 17.19999885559082, 16.19999885559082]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [9.399999618530273, 11.800000190734863, 19.600000381469727, 23.0, 20.19999885559082, 18.0, 21.19999885559082, 22.799999237060547, 21.0, 22.799999237060547, 16.600000381469727, 20.600000381469727, 6.599999904632568, 9.0, 21.799999237060547, 20.399999618530273]
k eval/a1:test_return:Overcooked-CoordRing6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CoordRing6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [28.19999885559082, 27.0, 39.0, 44.599998474121094, 32.0, 37.79999923706055, 23.0, 26.799999237060547, 34.79999923706055, 37.0, 26.19999885559082, 31.19999885559082, 22.399999618530273, 25.399999618530273, 21.600000381469727, 22.600000381469727]
k eval/a1:test_return:Overcooked-CoordRing6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [23.0, 28.19999885559082, 22.799999237060547, 34.599998474121094, 26.0, 33.599998474121094, 13.59999942779541, 28.799999237060547, 27.19999885559082, 35.39999771118164, 30.19999885559082, 30.19999885559082, 21.19999885559082, 24.19999885559082, 17.19999885559082, 16.19999885559082]
k eval/a1:test_return:Overcooked-CoordRing6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
-----------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  24.52+/- 1.16 (max:  44.6)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  25.77+/- 1.635 (max:  35.4)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  17.8+/- 1.368 (max:  23.0)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  29.97+/- 1.735 (max:  44.6)    |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  17.12+/- 0.4028 (max:  24.08)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  17.2+/- 0.6717 (max:  24.08)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  15.23+/- 0.5825 (max:  17.67)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  18.94+/- 0.5247 (max:  21.88)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.3633+/- 0.02498 (max:  0.75) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.3931+/- 0.03747 (max:  0.65) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.2212+/- 0.02772 (max:  0.35) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.4756+/- 0.03807 (max:  0.75) |
| eval/a1:test_return:Overcooked-CoordRing6_9               |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CoordRing6_9:high          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CoordRing6_9:low           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CoordRing6_9:mid           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CoordRing6_9           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CoordRing6_9:high      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CoordRing6_9:low       |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CoordRing6_9:mid       |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.0+/- 0.0 (max:  0.0)         |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  6.6                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  13.6                           |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  6.6                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  21.6                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  10.22                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  13.86                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  10.22                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  15.91                          |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.02                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.16                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.02                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.27                           |
| min:eval/a1:test_return:Overcooked-CoordRing6_9           |  0.0                            |
| min:eval/a1:test_return:Overcooked-CoordRing6_9:high      |  0.0                            |
| min:eval/a1:test_return:Overcooked-CoordRing6_9:low       |  0.0                            |
| min:eval/a1:test_return:Overcooked-CoordRing6_9:mid       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9:high  |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9:low   |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9:mid   |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9:high |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.0                            |
-----------------------------------------------------------------------------------------------
Evaluating PAIRED_SoftMoE_SEED2 against population in Overcooked-ForcedCoord6_9 for xpid SEED_2_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [4.799999713897705, 0.7999999523162842, 5.799999713897705, 0.5999999642372131, 2.3999998569488525, 0.19999998807907104, 2.0, 0.0, 1.5999999046325684, 0.19999998807907104, 1.5999999046325684, 0.0, 3.5999999046325684, 1.5999999046325684, 3.3999998569488525, 0.3999999761581421, 3.1999998092651367, 1.1999999284744263, 3.3999998569488525, 0.5999999642372131, 2.200000047683716, 0.0, 2.0, 0.0, 4.599999904632568, 1.0, 5.599999904632568, 1.5999999046325684, 4.799999713897705, 0.3999999761581421, 2.3999998569488525, 0.3999999761581421, 2.3999998569488525, 0.3999999761581421, 0.7999999523162842, 0.19999998807907104, 1.7999999523162842, 0.19999998807907104, 2.0, 0.3999999761581421, 1.0, 0.3999999761581421, 3.0, 0.19999998807907104, 3.799999952316284, 0.19999998807907104, 7.0, 0.3999999761581421]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [4.799999713897705, 0.7999999523162842, 2.0, 0.0, 3.5999999046325684, 1.5999999046325684, 3.3999998569488525, 0.5999999642372131, 4.599999904632568, 1.0, 2.3999998569488525, 0.3999999761581421, 1.7999999523162842, 0.19999998807907104, 3.0, 0.19999998807907104]
k eval/a1:test_return:Overcooked-ForcedCoord6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-ForcedCoord6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [5.799999713897705, 0.5999999642372131, 1.5999999046325684, 0.19999998807907104, 3.3999998569488525, 0.3999999761581421, 2.200000047683716, 0.0, 5.599999904632568, 1.5999999046325684, 2.3999998569488525, 0.3999999761581421, 2.0, 0.3999999761581421, 3.799999952316284, 0.19999998807907104]
k eval/a1:test_return:Overcooked-ForcedCoord6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [2.3999998569488525, 0.19999998807907104, 1.5999999046325684, 0.0, 3.1999998092651367, 1.1999999284744263, 2.0, 0.0, 4.799999713897705, 0.3999999761581421, 0.7999999523162842, 0.19999998807907104, 1.0, 0.3999999761581421, 7.0, 0.3999999761581421]
k eval/a1:test_return:Overcooked-ForcedCoord6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
----------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  1.804+/- 0.2571 (max:  7.0)       |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  1.6+/- 0.4885 (max:  7.0)         |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  1.9+/- 0.3967 (max:  4.8)         |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  1.912+/- 0.4704 (max:  5.8)       |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  4.829+/- 0.3967 (max:  10.72)     |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  4.404+/- 0.7514 (max:  10.72)     |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  5.159+/- 0.6541 (max:  8.879)     |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  4.926+/- 0.6835 (max:  9.075)     |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.00125+/- 0.0007062 (max:  0.03) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0025+/- 0.001936 (max:  0.03)   |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.00125+/- 0.0008539 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_return:Overcooked-ForcedCoord6_9               |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_return:Overcooked-ForcedCoord6_9:high          |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_return:Overcooked-ForcedCoord6_9:low           |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_return:Overcooked-ForcedCoord6_9:mid           |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9           |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9:high      |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9:low       |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9:mid       |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0)            |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0)            |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                               |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                               |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                               |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                               |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9           |  0.0                               |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                               |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                               |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                               |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                               |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                               |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                               |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                               |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                               |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                               |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                               |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                               |
----------------------------------------------------------------------------------------------------
Evaluating PAIRED_SoftMoE_SEED2 against population in Overcooked-CounterCircuit6_9 for xpid SEED_2_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [15.59999942779541, 9.399999618530273, 22.19999885559082, 14.59999942779541, 11.59999942779541, 11.59999942779541, 7.799999713897705, 9.800000190734863, 13.799999237060547, 12.0, 4.799999713897705, 1.7999999523162842, 8.0, 5.0, 13.59999942779541, 10.0, 10.800000190734863, 11.0, 11.399999618530273, 8.59999942779541, 24.399999618530273, 21.799999237060547, 12.199999809265137, 6.799999713897705, 9.399999618530273, 7.799999713897705, 16.0, 13.799999237060547, 8.199999809265137, 5.0, 14.799999237060547, 8.199999809265137, 20.0, 11.199999809265137, 8.800000190734863, 7.399999618530273, 10.399999618530273, 9.0, 20.399999618530273, 15.199999809265137, 12.399999618530273, 8.59999942779541, 13.199999809265137, 8.800000190734863, 20.0, 17.799999237060547, 11.0, 5.799999713897705]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [15.59999942779541, 9.399999618530273, 7.799999713897705, 9.800000190734863, 8.0, 5.0, 11.399999618530273, 8.59999942779541, 9.399999618530273, 7.799999713897705, 14.799999237060547, 8.199999809265137, 10.399999618530273, 9.0, 13.199999809265137, 8.800000190734863]
k eval/a1:test_return:Overcooked-CounterCircuit6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CounterCircuit6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [22.19999885559082, 14.59999942779541, 13.799999237060547, 12.0, 13.59999942779541, 10.0, 24.399999618530273, 21.799999237060547, 16.0, 13.799999237060547, 20.0, 11.199999809265137, 20.399999618530273, 15.199999809265137, 20.0, 17.799999237060547]
k eval/a1:test_return:Overcooked-CounterCircuit6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [11.59999942779541, 11.59999942779541, 4.799999713897705, 1.7999999523162842, 10.800000190734863, 11.0, 12.199999809265137, 6.799999713897705, 8.199999809265137, 5.0, 8.800000190734863, 7.399999618530273, 12.399999618530273, 8.59999942779541, 11.0, 5.799999713897705]
k eval/a1:test_return:Overcooked-CounterCircuit6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  11.7+/- 0.7137 (max:  24.4)      |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  8.612+/- 0.7856 (max:  12.4)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  9.825+/- 0.6872 (max:  15.6)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  16.67+/- 1.086 (max:  24.4)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  12.1+/- 0.3574 (max:  18.74)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  10.57+/- 0.4904 (max:  14.54)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  11.2+/- 0.2517 (max:  12.83)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  14.52+/- 0.5448 (max:  18.74)    |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.08729+/- 0.01393 (max:  0.34)  |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.03062+/- 0.007498 (max:  0.1)  |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.04062+/- 0.007442 (max:  0.12) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.1906+/- 0.02534 (max:  0.34)   |
| eval/a1:test_return:Overcooked-CounterCircuit6_9               |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return:Overcooked-CounterCircuit6_9:high          |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return:Overcooked-CounterCircuit6_9:low           |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return:Overcooked-CounterCircuit6_9:mid           |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9           |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9:high      |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9:low       |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9:mid       |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.0+/- 0.0 (max:  0.0)           |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.0+/- 0.0 (max:  0.0)           |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  1.8                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  1.8                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  5.0                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  10.0                             |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  5.724                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  5.724                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  8.66                             |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  11.27                            |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.04                             |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9           |  0.0                              |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                              |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9:low       |  0.0                              |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9:mid       |  0.0                              |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                              |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                              |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9:low   |  0.0                              |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9:mid   |  0.0                              |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                              |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                              |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                              |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                              |
------------------------------------------------------------------------------------------------------
Evaluating PAIRED_SoftMoE_SEED2 against population in Overcooked-AsymmAdvantages6_9 for xpid SEED_2_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [18.19999885559082, 8.199999809265137, 6.0, 17.799999237060547, 36.79999923706055, 3.799999952316284, 19.600000381469727, 12.59999942779541, 24.799999237060547, 46.39999771118164, 26.19999885559082, 2.5999999046325684, 26.799999237060547, 37.20000076293945, 30.19999885559082, 64.79999542236328, 37.20000076293945, 15.799999237060547, 19.19999885559082, 22.0, 23.600000381469727, 11.199999809265137, 39.20000076293945, 6.599999904632568, 22.0, 8.59999942779541, 19.799999237060547, 20.600000381469727, 15.59999942779541, 8.399999618530273, 21.0, 6.799999713897705, 18.0, 31.799999237060547, 37.0, 3.3999998569488525, 20.600000381469727, 8.199999809265137, 25.19999885559082, 16.399999618530273, 46.39999771118164, 7.399999618530273, 17.0, 10.399999618530273, 10.399999618530273, 25.0, 35.39999771118164, 6.599999904632568]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [18.19999885559082, 8.199999809265137, 19.600000381469727, 12.59999942779541, 26.799999237060547, 37.20000076293945, 19.19999885559082, 22.0, 22.0, 8.59999942779541, 21.0, 6.799999713897705, 20.600000381469727, 8.199999809265137, 17.0, 10.399999618530273]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9, v [1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9:low, v [1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [6.0, 17.799999237060547, 24.799999237060547, 46.39999771118164, 30.19999885559082, 64.79999542236328, 23.600000381469727, 11.199999809265137, 19.799999237060547, 20.600000381469727, 18.0, 31.799999237060547, 25.19999885559082, 16.399999618530273, 10.399999618530273, 25.0]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9:mid, v [1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [36.79999923706055, 3.799999952316284, 26.19999885559082, 2.5999999046325684, 37.20000076293945, 15.799999237060547, 39.20000076293945, 6.599999904632568, 15.59999942779541, 8.399999618530273, 37.0, 3.3999998569488525, 46.39999771118164, 7.399999618530273, 35.39999771118164, 6.599999904632568]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9:high, v [1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.19999998807907104]
-----------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  20.81+/- 1.909 (max:  64.8)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  20.52+/- 3.944 (max:  46.4)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  17.4+/- 2.027 (max:  37.2)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  24.5+/- 3.593 (max:  64.8)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  16.82+/- 0.7477 (max:  31.89)  |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  15.61+/- 1.344 (max:  23.13)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  15.42+/- 1.057 (max:  28.99)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  19.44+/- 1.284 (max:  31.89)   |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.2815+/- 0.033 (max:  0.85)   |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.3006+/- 0.07319 (max:  0.75) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.2075+/- 0.03668 (max:  0.54) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.3362+/- 0.05425 (max:  0.85) |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9               |  0.6+/- 0.05835 (max:  1.0)     |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9:high          |  0.6+/- 0.1033 (max:  1.0)      |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9:low           |  0.6+/- 0.1033 (max:  1.0)      |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9:mid           |  0.6+/- 0.1033 (max:  1.0)      |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9           |  3.174+/- 0.1728 (max:  4.359)  |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  3.174+/- 0.3058 (max:  4.359)  |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  3.174+/- 0.3058 (max:  4.359)  |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  3.174+/- 0.3058 (max:  4.359)  |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.0+/- 0.0 (max:  0.0)         |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  2.6                            |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  2.6                            |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  6.8                            |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  6.0                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  7.297                          |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  7.297                          |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  9.887                          |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  10.77                          |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.01                           |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.01                           |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.01                           |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.04                           |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9           |  0.2                            |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.2                            |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.2                            |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.2                            |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9       |  1.99                           |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  1.99                           |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  1.99                           |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  1.99                           |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                            |
-----------------------------------------------------------------------------------------------------
Evaluating PAIRED_SoftMoE_SEED2 against population in Overcooked-CrampedRoom6_9 for xpid SEED_2_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [21.600000381469727, 15.799999237060547, 85.4000015258789, 87.0, 112.19999694824219, 116.39999389648438, 29.599998474121094, 26.399999618530273, 80.19999694824219, 80.5999984741211, 106.79999542236328, 105.19999694824219, 29.0, 27.399999618530273, 104.39999389648438, 98.5999984741211, 111.19999694824219, 112.5999984741211, 25.19999885559082, 29.599998474121094, 94.5999984741211, 93.5999984741211, 97.19999694824219, 101.0, 18.19999885559082, 22.0, 84.19999694824219, 89.0, 112.0, 109.5999984741211, 31.0, 30.599998474121094, 96.0, 96.19999694824219, 107.19999694824219, 112.39999389648438, 30.0, 29.599998474121094, 92.5999984741211, 87.79999542236328, 109.0, 109.39999389648438, 33.39999771118164, 34.20000076293945, 99.79999542236328, 96.79999542236328, 106.19999694824219, 104.79999542236328]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [21.600000381469727, 15.799999237060547, 29.599998474121094, 26.399999618530273, 29.0, 27.399999618530273, 25.19999885559082, 29.599998474121094, 18.19999885559082, 22.0, 31.0, 30.599998474121094, 30.0, 29.599998474121094, 33.39999771118164, 34.20000076293945]
k eval/a1:test_return:Overcooked-CrampedRoom6_9, v [0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421]
k eval/a1:test_return:Overcooked-CrampedRoom6_9:low, v [0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [85.4000015258789, 87.0, 80.19999694824219, 80.5999984741211, 104.39999389648438, 98.5999984741211, 94.5999984741211, 93.5999984741211, 84.19999694824219, 89.0, 96.0, 96.19999694824219, 92.5999984741211, 87.79999542236328, 99.79999542236328, 96.79999542236328]
k eval/a1:test_return:Overcooked-CrampedRoom6_9:mid, v [0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [112.19999694824219, 116.39999389648438, 106.79999542236328, 105.19999694824219, 111.19999694824219, 112.5999984741211, 97.19999694824219, 101.0, 112.0, 109.5999984741211, 107.19999694824219, 112.39999389648438, 109.0, 109.39999389648438, 106.19999694824219, 104.79999542236328]
k eval/a1:test_return:Overcooked-CrampedRoom6_9:high, v [0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.3999999761581421]
-------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  75.7+/- 5.175 (max:  116.4)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  108.3+/- 1.204 (max:  116.4)   |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  27.1+/- 1.316 (max:  34.2)     |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  91.67+/- 1.765 (max:  104.4)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  25.4+/- 0.8028 (max:  39.24)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  28.66+/- 0.9033 (max:  36.0)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  19.05+/- 0.4251 (max:  22.21)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  28.49+/- 1.016 (max:  39.24)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.7927+/- 0.03853 (max:  1.0)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.9812+/- 0.005692 (max:  1.0) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.4331+/- 0.02993 (max:  0.57) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.9637+/- 0.009349 (max:  1.0) |
| eval/a1:test_return:Overcooked-CrampedRoom6_9               |  0.2+/- 0.02917 (max:  0.4)     |
| eval/a1:test_return:Overcooked-CrampedRoom6_9:high          |  0.2+/- 0.05164 (max:  0.4)     |
| eval/a1:test_return:Overcooked-CrampedRoom6_9:low           |  0.2+/- 0.05164 (max:  0.4)     |
| eval/a1:test_return:Overcooked-CrampedRoom6_9:mid           |  0.2+/- 0.05164 (max:  0.4)     |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9           |  1.4+/- 0.2042 (max:  2.8)      |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9:high      |  1.4+/- 0.3615 (max:  2.8)      |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9:low       |  1.4+/- 0.3615 (max:  2.8)      |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9:mid       |  1.4+/- 0.3615 (max:  2.8)      |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.0+/- 0.0 (max:  0.0)         |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  15.8                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  97.2                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  15.8                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  80.2                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  15.52                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  22.51                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  15.52                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  22.95                          |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.2                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.92                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.2                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.85                           |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9           |  0.0                            |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9:high      |  0.0                            |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9:low       |  0.0                            |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9:mid       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9:high  |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9:low   |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9:mid   |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.0                            |
-------------------------------------------------------------------------------------------------
Evaluating PAIRED_SoftMoE_SEED3 against population in Overcooked-CoordRing6_9 for xpid SEED_3_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [12.399999618530273, 11.0, 41.20000076293945, 36.0, 35.79999923706055, 40.39999771118164, 25.799999237060547, 26.399999618530273, 48.599998474121094, 53.39999771118164, 43.20000076293945, 48.0, 25.799999237060547, 24.600000381469727, 48.20000076293945, 49.79999923706055, 50.39999771118164, 54.79999923706055, 38.0, 35.20000076293945, 38.599998474121094, 37.0, 34.79999923706055, 38.0, 24.19999885559082, 28.799999237060547, 37.79999923706055, 40.0, 46.599998474121094, 49.599998474121094, 23.0, 24.799999237060547, 44.0, 43.79999923706055, 33.79999923706055, 43.39999771118164, 9.0, 7.599999904632568, 35.20000076293945, 27.399999618530273, 31.0, 34.599998474121094, 20.0, 24.600000381469727, 24.19999885559082, 22.799999237060547, 23.799999237060547, 22.600000381469727]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [12.399999618530273, 11.0, 25.799999237060547, 26.399999618530273, 25.799999237060547, 24.600000381469727, 38.0, 35.20000076293945, 24.19999885559082, 28.799999237060547, 23.0, 24.799999237060547, 9.0, 7.599999904632568, 20.0, 24.600000381469727]
k eval/a1:test_return:Overcooked-CoordRing6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CoordRing6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [41.20000076293945, 36.0, 48.599998474121094, 53.39999771118164, 48.20000076293945, 49.79999923706055, 38.599998474121094, 37.0, 37.79999923706055, 40.0, 44.0, 43.79999923706055, 35.20000076293945, 27.399999618530273, 24.19999885559082, 22.799999237060547]
k eval/a1:test_return:Overcooked-CoordRing6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [35.79999923706055, 40.39999771118164, 43.20000076293945, 48.0, 50.39999771118164, 54.79999923706055, 34.79999923706055, 38.0, 46.599998474121094, 49.599998474121094, 33.79999923706055, 43.39999771118164, 31.0, 34.599998474121094, 23.799999237060547, 22.600000381469727]
k eval/a1:test_return:Overcooked-CoordRing6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
-----------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  33.75+/- 1.716 (max:  54.8)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  39.42+/- 2.333 (max:  54.8)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  22.57+/- 2.18 (max:  38.0)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  39.25+/- 2.235 (max:  53.4)    |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  16.77+/- 0.4238 (max:  25.72)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  19.48+/- 0.748 (max:  25.72)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  14.93+/- 0.4341 (max:  17.04)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  15.89+/- 0.4128 (max:  18.76)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.5819+/- 0.03686 (max:  0.95) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.68+/- 0.04593 (max:  0.93)   |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.3444+/- 0.05052 (max:  0.73) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.7212+/- 0.0491 (max:  0.95)  |
| eval/a1:test_return:Overcooked-CoordRing6_9               |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CoordRing6_9:high          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CoordRing6_9:low           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return:Overcooked-CoordRing6_9:mid           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CoordRing6_9           |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CoordRing6_9:high      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CoordRing6_9:low       |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_return_std:Overcooked-CoordRing6_9:mid       |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.0+/- 0.0 (max:  0.0)         |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  7.6                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  22.6                           |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  7.6                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  22.8                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  11.79                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  14.55                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  11.79                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  13.11                          |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.05                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.31                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.05                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.32                           |
| min:eval/a1:test_return:Overcooked-CoordRing6_9           |  0.0                            |
| min:eval/a1:test_return:Overcooked-CoordRing6_9:high      |  0.0                            |
| min:eval/a1:test_return:Overcooked-CoordRing6_9:low       |  0.0                            |
| min:eval/a1:test_return:Overcooked-CoordRing6_9:mid       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9:high  |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9:low   |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-CoordRing6_9:mid   |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9:high |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.0                            |
-----------------------------------------------------------------------------------------------
Evaluating PAIRED_SoftMoE_SEED3 against population in Overcooked-ForcedCoord6_9 for xpid SEED_3_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [0.19999998807907104, 1.0, 0.19999998807907104, 2.5999999046325684, 0.0, 1.0, 0.0, 3.0, 0.19999998807907104, 2.799999952316284, 0.0, 0.7999999523162842, 0.3999999761581421, 2.3999998569488525, 0.19999998807907104, 3.0, 0.0, 3.0, 0.0, 2.0, 0.3999999761581421, 1.1999999284744263, 0.19999998807907104, 1.0, 0.19999998807907104, 1.1999999284744263, 0.5999999642372131, 0.7999999523162842, 0.7999999523162842, 0.19999998807907104, 0.0, 3.0, 0.0, 2.0, 0.0, 2.5999999046325684, 0.0, 2.0, 0.19999998807907104, 1.0, 0.0, 0.5999999642372131, 0.0, 1.5999999046325684, 0.0, 2.5999999046325684, 0.0, 0.5999999642372131]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [0.19999998807907104, 1.0, 0.0, 3.0, 0.3999999761581421, 2.3999998569488525, 0.0, 2.0, 0.19999998807907104, 1.1999999284744263, 0.0, 3.0, 0.0, 2.0, 0.0, 1.5999999046325684]
k eval/a1:test_return:Overcooked-ForcedCoord6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-ForcedCoord6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [0.19999998807907104, 2.5999999046325684, 0.19999998807907104, 2.799999952316284, 0.19999998807907104, 3.0, 0.3999999761581421, 1.1999999284744263, 0.5999999642372131, 0.7999999523162842, 0.0, 2.0, 0.19999998807907104, 1.0, 0.0, 2.5999999046325684]
k eval/a1:test_return:Overcooked-ForcedCoord6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [0.0, 1.0, 0.0, 0.7999999523162842, 0.0, 3.0, 0.19999998807907104, 1.0, 0.7999999523162842, 0.19999998807907104, 0.0, 2.5999999046325684, 0.0, 0.5999999642372131, 0.0, 0.5999999642372131]
k eval/a1:test_return:Overcooked-ForcedCoord6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  0.95+/- 0.1513 (max:  3.0)          |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  0.675+/- 0.2287 (max:  3.0)         |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  1.062+/- 0.2809 (max:  3.0)         |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  1.112+/- 0.2763 (max:  3.0)         |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  3.264+/- 0.3728 (max:  7.141)       |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  2.577+/- 0.6121 (max:  7.141)       |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  3.421+/- 0.7182 (max:  7.141)       |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  3.796+/- 0.6033 (max:  7.141)       |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0002083+/- 0.0002083 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0)              |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.000625+/- 0.000625 (max:  0.01)   |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_return:Overcooked-ForcedCoord6_9               |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_return:Overcooked-ForcedCoord6_9:high          |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_return:Overcooked-ForcedCoord6_9:low           |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_return:Overcooked-ForcedCoord6_9:mid           |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9           |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9:high      |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9:low       |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_return_std:Overcooked-ForcedCoord6_9:mid       |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0)              |
| eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0)              |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                                 |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                                 |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                                 |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                                 |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                                 |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                                 |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9           |  0.0                                 |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                                 |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                                 |
| min:eval/a1:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                                 |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                                 |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                                 |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                                 |
| min:eval/a1:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                                 |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                                 |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                                 |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                                 |
| min:eval/a1:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                                 |
------------------------------------------------------------------------------------------------------
Evaluating PAIRED_SoftMoE_SEED3 against population in Overcooked-CounterCircuit6_9 for xpid SEED_3_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [3.5999999046325684, 2.5999999046325684, 8.59999942779541, 3.5999999046325684, 16.19999885559082, 13.399999618530273, 1.7999999523162842, 0.5999999642372131, 6.199999809265137, 2.5999999046325684, 9.59999942779541, 4.599999904632568, 12.59999942779541, 13.399999618530273, 14.399999618530273, 9.59999942779541, 33.79999923706055, 42.79999923706055, 6.599999904632568, 3.799999952316284, 13.0, 8.199999809265137, 15.399999618530273, 8.800000190734863, 5.199999809265137, 3.799999952316284, 18.0, 12.399999618530273, 15.399999618530273, 9.0, 8.399999618530273, 5.599999904632568, 11.800000190734863, 6.0, 13.0, 7.0, 3.0, 0.0, 4.799999713897705, 1.0, 14.799999237060547, 9.800000190734863, 6.0, 3.0, 5.799999713897705, 3.1999998092651367, 11.199999809265137, 8.59999942779541]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [3.5999999046325684, 2.5999999046325684, 1.7999999523162842, 0.5999999642372131, 12.59999942779541, 13.399999618530273, 6.599999904632568, 3.799999952316284, 5.199999809265137, 3.799999952316284, 8.399999618530273, 5.599999904632568, 3.0, 0.0, 6.0, 3.0]
k eval/a1:test_return:Overcooked-CounterCircuit6_9, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a1:test_return:Overcooked-CounterCircuit6_9:low, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [8.59999942779541, 3.5999999046325684, 6.199999809265137, 2.5999999046325684, 14.399999618530273, 9.59999942779541, 13.0, 8.199999809265137, 18.0, 12.399999618530273, 11.800000190734863, 6.0, 4.799999713897705, 1.0, 5.799999713897705, 3.1999998092651367]
k eval/a1:test_return:Overcooked-CounterCircuit6_9:mid, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [16.19999885559082, 13.399999618530273, 9.59999942779541, 4.599999904632568, 33.79999923706055, 42.79999923706055, 15.399999618530273, 8.800000190734863, 15.399999618530273, 9.0, 13.0, 7.0, 14.799999237060547, 9.800000190734863, 11.199999809265137, 8.59999942779541]
k eval/a1:test_return:Overcooked-CounterCircuit6_9:high, v [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
-----------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  9.221+/- 1.118 (max:  42.8)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  14.59+/- 2.492 (max:  42.8)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  5.0+/- 0.951 (max:  13.4)       |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  8.075+/- 1.2 (max:  18.0)       |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  10.17+/- 0.4812 (max:  19.74)   |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  11.86+/- 0.7161 (max:  19.74)   |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  8.197+/- 0.8849 (max:  14.71)   |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  10.46+/- 0.6527 (max:  14.55)   |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.06312+/- 0.02012 (max:  0.77) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.12+/- 0.05657 (max:  0.77)    |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.02062+/- 0.01047 (max:  0.14) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.04875+/- 0.01214 (max:  0.16) |
| eval/a1:test_return:Overcooked-CounterCircuit6_9               |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return:Overcooked-CounterCircuit6_9:high          |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return:Overcooked-CounterCircuit6_9:low           |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return:Overcooked-CounterCircuit6_9:mid           |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9           |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9:high      |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9:low       |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_return_std:Overcooked-CounterCircuit6_9:mid       |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.0+/- 0.0 (max:  0.0)          |
| eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.0+/- 0.0 (max:  0.0)          |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  0.0                             |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  4.6                             |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  0.0                             |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  1.0                             |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  8.879                           |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  0.0                             |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  4.359                           |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                             |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9           |  0.0                             |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9:high      |  0.0                             |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9:low       |  0.0                             |
| min:eval/a1:test_return:Overcooked-CounterCircuit6_9:mid       |  0.0                             |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9       |  0.0                             |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9:high  |  0.0                             |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9:low   |  0.0                             |
| min:eval/a1:test_return_std:Overcooked-CounterCircuit6_9:mid   |  0.0                             |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                             |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                             |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                             |
| min:eval/a1:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                             |
-----------------------------------------------------------------------------------------------------
Evaluating PAIRED_SoftMoE_SEED3 against population in Overcooked-AsymmAdvantages6_9 for xpid SEED_3_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [14.799999237060547, 23.19999885559082, 16.19999885559082, 32.0, 20.0, 34.39999771118164, 15.199999809265137, 20.0, 19.600000381469727, 58.599998474121094, 20.19999885559082, 31.19999885559082, 19.600000381469727, 51.0, 16.799999237060547, 71.5999984741211, 25.599998474121094, 16.399999618530273, 16.399999618530273, 37.20000076293945, 16.600000381469727, 34.0, 24.399999618530273, 17.0, 11.800000190734863, 18.799999237060547, 17.600000381469727, 35.20000076293945, 16.600000381469727, 23.799999237060547, 13.0, 21.600000381469727, 17.799999237060547, 47.20000076293945, 23.600000381469727, 25.399999618530273, 14.0, 16.399999618530273, 16.799999237060547, 40.79999923706055, 25.799999237060547, 18.0, 12.799999237060547, 23.399999618530273, 19.799999237060547, 42.79999923706055, 23.0, 27.799999237060547]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [14.799999237060547, 23.19999885559082, 15.199999809265137, 20.0, 19.600000381469727, 51.0, 16.399999618530273, 37.20000076293945, 11.800000190734863, 18.799999237060547, 13.0, 21.600000381469727, 14.0, 16.399999618530273, 12.799999237060547, 23.399999618530273]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9, v [0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [16.19999885559082, 32.0, 19.600000381469727, 58.599998474121094, 16.799999237060547, 71.5999984741211, 16.600000381469727, 34.0, 17.600000381469727, 35.20000076293945, 17.799999237060547, 47.20000076293945, 16.799999237060547, 40.79999923706055, 19.799999237060547, 42.79999923706055]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [20.0, 34.39999771118164, 20.19999885559082, 31.19999885559082, 25.599998474121094, 16.399999618530273, 24.399999618530273, 17.0, 16.600000381469727, 23.799999237060547, 23.600000381469727, 25.399999618530273, 25.799999237060547, 18.0, 23.0, 27.799999237060547]
k eval/a1:test_return:Overcooked-AsymmAdvantages6_9:high, v [0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263, 0.0, 1.1999999284744263]
-----------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  25.12+/- 1.806 (max:  71.6)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  23.32+/- 1.298 (max:  34.4)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  20.57+/- 2.548 (max:  51.0)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  31.46+/- 4.268 (max:  71.6)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  18.22+/- 0.8 (max:  34.55)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  17.81+/- 0.822 (max:  24.99)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  16.37+/- 1.116 (max:  27.48)   |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  20.47+/- 1.876 (max:  34.55)   |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.3327+/- 0.03005 (max:  0.87) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.3319+/- 0.02487 (max:  0.54) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.2475+/- 0.0495 (max:  0.76)  |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.4187+/- 0.06664 (max:  0.87) |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9               |  0.6+/- 0.08752 (max:  1.2)     |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9:high          |  0.6+/- 0.1549 (max:  1.2)      |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9:low           |  0.6+/- 0.1549 (max:  1.2)      |
| eval/a1:test_return:Overcooked-AsymmAdvantages6_9:mid           |  0.6+/- 0.1549 (max:  1.2)      |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9           |  2.375+/- 0.3464 (max:  4.75)   |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  2.375+/- 0.6132 (max:  4.75)   |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  2.375+/- 0.6132 (max:  4.75)   |
| eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  2.375+/- 0.6132 (max:  4.75)   |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.0+/- 0.0 (max:  0.0)         |
| eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.0+/- 0.0 (max:  0.0)         |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  11.8                           |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  16.4                           |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  11.8                           |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  16.2                           |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  11.66                          |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  13.56                          |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  11.84                          |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  11.66                          |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.06                           |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.21                           |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.06                           |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.16                           |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9           |  0.0                            |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.0                            |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.0                            |
| min:eval/a1:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9       |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  0.0                            |
| min:eval/a1:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                            |
| min:eval/a1:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                            |
-----------------------------------------------------------------------------------------------------
Evaluating PAIRED_SoftMoE_SEED3 against population in Overcooked-CrampedRoom6_9 for xpid SEED_3_paired-overcooked6x9w5_ld50_rb-r2s_32p_1e_400t_ae1e-05_sr-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___tch_ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98pc0.2_h64cf128fc1se10ba_re_lstm_h64_0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [45.39999771118164, 47.0, 98.4000015258789, 95.19999694824219, 107.19999694824219, 114.79999542236328, 60.39999771118164, 59.19999694824219, 101.5999984741211, 106.5999984741211, 113.79999542236328, 115.19999694824219, 58.0, 54.0, 116.0, 117.5999984741211, 94.0, 104.79999542236328, 56.19999694824219, 58.39999771118164, 104.5999984741211, 96.5999984741211, 80.5999984741211, 93.0, 45.599998474121094, 48.39999771118164, 101.79999542236328, 100.4000015258789, 95.79999542236328, 117.79999542236328, 53.19999694824219, 50.599998474121094, 114.19999694824219, 107.39999389648438, 104.39999389648438, 109.39999389648438, 62.599998474121094, 61.79999923706055, 103.79999542236328, 104.0, 117.19999694824219, 112.39999389648438, 67.0, 60.0, 118.39999389648438, 109.5999984741211, 81.19999694824219, 96.4000015258789]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [45.39999771118164, 47.0, 60.39999771118164, 59.19999694824219, 58.0, 54.0, 56.19999694824219, 58.39999771118164, 45.599998474121094, 48.39999771118164, 53.19999694824219, 50.599998474121094, 62.599998474121094, 61.79999923706055, 67.0, 60.0]
k eval/a1:test_return:Overcooked-CrampedRoom6_9, v [0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863]
k eval/a1:test_return:Overcooked-CrampedRoom6_9:low, v [0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [98.4000015258789, 95.19999694824219, 101.5999984741211, 106.5999984741211, 116.0, 117.5999984741211, 104.5999984741211, 96.5999984741211, 101.79999542236328, 100.4000015258789, 114.19999694824219, 107.39999389648438, 103.79999542236328, 104.0, 118.39999389648438, 109.5999984741211]
k eval/a1:test_return:Overcooked-CrampedRoom6_9:mid, v [0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [107.19999694824219, 114.79999542236328, 113.79999542236328, 115.19999694824219, 94.0, 104.79999542236328, 80.5999984741211, 93.0, 95.79999542236328, 117.79999542236328, 104.39999389648438, 109.39999389648438, 117.19999694824219, 112.39999389648438, 81.19999694824219, 96.4000015258789]
k eval/a1:test_return:Overcooked-CrampedRoom6_9:high, v [0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863, 0.0, 8.800000190734863]
--------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  88.37+/- 3.628 (max:  118.4)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  103.6+/- 3.045 (max:  117.8)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  55.49+/- 1.645 (max:  67.0)     |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  106.0+/- 1.84 (max:  118.4)     |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  30.95+/- 1.134 (max:  51.5)     |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  40.5+/- 1.371 (max:  51.5)      |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  24.7+/- 0.3532 (max:  27.13)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  27.65+/- 0.8123 (max:  32.75)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.9142+/- 0.01214 (max:  1.0)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.9225+/- 0.0158 (max:  0.99)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.8287+/- 0.01557 (max:  0.92)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.9912+/- 0.002394 (max:  1.0)  |
| eval/a1:test_return:Overcooked-CrampedRoom6_9               |  4.4+/- 0.6418 (max:  8.8)       |
| eval/a1:test_return:Overcooked-CrampedRoom6_9:high          |  4.4+/- 1.136 (max:  8.8)        |
| eval/a1:test_return:Overcooked-CrampedRoom6_9:low           |  4.4+/- 1.136 (max:  8.8)        |
| eval/a1:test_return:Overcooked-CrampedRoom6_9:mid           |  4.4+/- 1.136 (max:  8.8)        |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9           |  5.161+/- 0.7529 (max:  10.32)   |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9:high      |  5.161+/- 1.333 (max:  10.32)    |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9:low       |  5.161+/- 1.333 (max:  10.32)    |
| eval/a1:test_return_std:Overcooked-CrampedRoom6_9:mid       |  5.161+/- 1.333 (max:  10.32)    |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.005+/- 0.0007293 (max:  0.01) |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.005+/- 0.001291 (max:  0.01)  |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.005+/- 0.001291 (max:  0.01)  |
| eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.005+/- 0.001291 (max:  0.01)  |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  45.4                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  80.6                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  45.4                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  95.2                            |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  21.19                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  31.24                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  21.24                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  21.19                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.71                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.78                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.71                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.97                            |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9           |  0.0                             |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9:high      |  0.0                             |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9:low       |  0.0                             |
| min:eval/a1:test_return:Overcooked-CrampedRoom6_9:mid       |  0.0                             |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9       |  0.0                             |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9:high  |  0.0                             |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9:low   |  0.0                             |
| min:eval/a1:test_return_std:Overcooked-CrampedRoom6_9:mid   |  0.0                             |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.0                             |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.0                             |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.0                             |
| min:eval/a1:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.0                             |
--------------------------------------------------------------------------------------------------
Evaluating ACCEL_SoftMoE_SEED1 against population in Overcooked-CoordRing6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [4.799999713897705, 2.3999998569488525, 19.0, 18.600000381469727, 24.600000381469727, 25.799999237060547, 15.0, 14.0, 29.399999618530273, 33.0, 26.399999618530273, 29.0, 12.799999237060547, 12.199999809265137, 24.799999237060547, 28.0, 28.19999885559082, 30.0, 14.799999237060547, 11.199999809265137, 18.799999237060547, 14.59999942779541, 23.0, 22.399999618530273, 16.19999885559082, 15.59999942779541, 20.399999618530273, 22.799999237060547, 28.0, 31.0, 14.59999942779541, 12.0, 25.0, 20.0, 38.0, 39.39999771118164, 3.1999998092651367, 4.400000095367432, 19.0, 19.19999885559082, 36.0, 34.39999771118164, 15.399999618530273, 13.799999237060547, 16.399999618530273, 13.799999237060547, 25.599998474121094, 25.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [4.799999713897705, 2.3999998569488525, 15.0, 14.0, 12.799999237060547, 12.199999809265137, 14.799999237060547, 11.199999809265137, 16.19999885559082, 15.59999942779541, 14.59999942779541, 12.0, 3.1999998092651367, 4.400000095367432, 15.399999618530273, 13.799999237060547]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [19.0, 18.600000381469727, 29.399999618530273, 33.0, 24.799999237060547, 28.0, 18.799999237060547, 14.59999942779541, 20.399999618530273, 22.799999237060547, 25.0, 20.0, 19.0, 19.19999885559082, 16.399999618530273, 13.799999237060547]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [24.600000381469727, 25.799999237060547, 26.399999618530273, 29.0, 28.19999885559082, 30.0, 23.0, 22.399999618530273, 28.0, 31.0, 38.0, 39.39999771118164, 36.0, 34.39999771118164, 25.599998474121094, 25.0]
-----------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  20.67+/- 1.287 (max:  39.4)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  29.17+/- 1.318 (max:  39.4)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  11.4+/- 1.204 (max:  16.2)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  21.42+/- 1.341 (max:  33.0)    |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  13.38+/- 0.3369 (max:  16.97)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  13.57+/- 0.5546 (max:  16.97)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  12.36+/- 0.7336 (max:  15.15)  |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  14.21+/- 0.3214 (max:  16.84)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.2894+/- 0.02954 (max:  0.83) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.4837+/- 0.04042 (max:  0.83) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.1019+/- 0.01708 (max:  0.19) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.2825+/- 0.03753 (max:  0.65) |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  2.4                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  22.4                           |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  2.4                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  13.8                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  6.499                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  10.2                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  6.499                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  11.79                          |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.31                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.08                           |
-----------------------------------------------------------------------------------------------
Evaluating ACCEL_SoftMoE_SEED1 against population in Overcooked-ForcedCoord6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [0.7999999523162842, 0.19999998807907104, 0.5999999642372131, 0.19999998807907104, 0.0, 0.19999998807907104, 1.5999999046325684, 0.3999999761581421, 1.399999976158142, 1.0, 0.3999999761581421, 0.3999999761581421, 0.5999999642372131, 0.0, 1.0, 0.0, 0.3999999761581421, 0.0, 1.5999999046325684, 0.0, 1.399999976158142, 0.5999999642372131, 0.0, 0.3999999761581421, 0.3999999761581421, 0.0, 1.399999976158142, 0.19999998807907104, 1.0, 0.19999998807907104, 1.0, 0.0, 1.0, 0.3999999761581421, 0.3999999761581421, 0.0, 0.3999999761581421, 0.0, 0.19999998807907104, 0.19999998807907104, 0.7999999523162842, 0.19999998807907104, 1.1999999284744263, 0.19999998807907104, 0.7999999523162842, 0.5999999642372131, 1.5999999046325684, 0.5999999642372131]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [0.7999999523162842, 0.19999998807907104, 1.5999999046325684, 0.3999999761581421, 0.5999999642372131, 0.0, 1.5999999046325684, 0.0, 0.3999999761581421, 0.0, 1.0, 0.0, 0.3999999761581421, 0.0, 1.1999999284744263, 0.19999998807907104]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [0.5999999642372131, 0.19999998807907104, 1.399999976158142, 1.0, 1.0, 0.0, 1.399999976158142, 0.5999999642372131, 1.399999976158142, 0.19999998807907104, 1.0, 0.3999999761581421, 0.19999998807907104, 0.19999998807907104, 0.7999999523162842, 0.5999999642372131]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [0.0, 0.19999998807907104, 0.3999999761581421, 0.3999999761581421, 0.3999999761581421, 0.0, 0.0, 0.3999999761581421, 1.0, 0.19999998807907104, 0.3999999761581421, 0.0, 0.7999999523162842, 0.19999998807907104, 1.5999999046325684, 0.5999999642372131]
------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  0.5417+/- 0.0712 (max:  1.6)  |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  0.4125+/- 0.1072 (max:  1.6)  |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  0.525+/- 0.1401 (max:  1.6)   |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  0.6875+/- 0.1183 (max:  1.4)  |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  2.71+/- 0.251 (max:  5.426)   |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  2.318+/- 0.4111 (max:  5.426) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  2.479+/- 0.5021 (max:  5.426) |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  3.331+/- 0.3624 (max:  5.103) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.0+/- 0.0 (max:  0.0)        |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0+/- 0.0 (max:  0.0)        |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                           |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                           |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                           |
------------------------------------------------------------------------------------------------
Evaluating ACCEL_SoftMoE_SEED1 against population in Overcooked-CounterCircuit6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [9.800000190734863, 7.599999904632568, 13.199999809265137, 12.399999618530273, 12.59999942779541, 12.799999237060547, 6.399999618530273, 8.0, 11.199999809265137, 9.59999942779541, 3.0, 1.399999976158142, 5.599999904632568, 3.3999998569488525, 14.0, 12.399999618530273, 16.600000381469727, 9.0, 11.399999618530273, 8.199999809265137, 20.0, 17.0, 11.399999618530273, 6.0, 10.399999618530273, 8.800000190734863, 21.19999885559082, 18.0, 11.59999942779541, 6.199999809265137, 11.800000190734863, 12.199999809265137, 18.799999237060547, 12.399999618530273, 11.199999809265137, 5.599999904632568, 9.199999809265137, 5.199999809265137, 13.799999237060547, 11.199999809265137, 6.799999713897705, 6.399999618530273, 11.800000190734863, 8.59999942779541, 14.799999237060547, 15.199999809265137, 9.0, 4.199999809265137]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [9.800000190734863, 7.599999904632568, 6.399999618530273, 8.0, 5.599999904632568, 3.3999998569488525, 11.399999618530273, 8.199999809265137, 10.399999618530273, 8.800000190734863, 11.800000190734863, 12.199999809265137, 9.199999809265137, 5.199999809265137, 11.800000190734863, 8.59999942779541]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [13.199999809265137, 12.399999618530273, 11.199999809265137, 9.59999942779541, 14.0, 12.399999618530273, 20.0, 17.0, 21.19999885559082, 18.0, 18.799999237060547, 12.399999618530273, 13.799999237060547, 11.199999809265137, 14.799999237060547, 15.199999809265137]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [12.59999942779541, 12.799999237060547, 3.0, 1.399999976158142, 16.600000381469727, 9.0, 11.399999618530273, 6.0, 11.59999942779541, 6.199999809265137, 11.199999809265137, 5.599999904632568, 6.799999713897705, 6.399999618530273, 9.0, 4.199999809265137]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  10.57+/- 0.6443 (max:  21.2)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  8.362+/- 1.026 (max:  16.6)      |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  8.65+/- 0.6464 (max:  12.2)      |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  14.7+/- 0.8503 (max:  21.2)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  11.37+/- 0.3286 (max:  15.9)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  9.852+/- 0.4803 (max:  12.54)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  10.64+/- 0.3431 (max:  12.99)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  13.62+/- 0.3743 (max:  15.9)     |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.06312+/- 0.009956 (max:  0.25) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.02375+/- 0.00875 (max:  0.11)  |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.02875+/- 0.006575 (max:  0.09) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.1369+/- 0.01635 (max:  0.25)   |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  1.4                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  1.4                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  3.4                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  9.6                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  5.103                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  5.103                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  7.513                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  10.39                            |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.03                             |
------------------------------------------------------------------------------------------------------
Evaluating ACCEL_SoftMoE_SEED1 against population in Overcooked-AsymmAdvantages6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [0.5999999642372131, 4.199999809265137, 0.7999999523162842, 15.199999809265137, 0.7999999523162842, 3.5999999046325684, 1.0, 5.799999713897705, 1.399999976158142, 36.39999771118164, 0.3999999761581421, 6.399999618530273, 0.7999999523162842, 37.599998474121094, 0.5999999642372131, 60.0, 1.0, 11.59999942779541, 0.3999999761581421, 17.399999618530273, 1.5999999046325684, 12.799999237060547, 2.0, 8.0, 0.5999999642372131, 4.599999904632568, 1.0, 22.19999885559082, 0.19999998807907104, 8.0, 0.3999999761581421, 4.199999809265137, 0.3999999761581421, 29.19999885559082, 0.7999999523162842, 4.599999904632568, 0.5999999642372131, 5.799999713897705, 1.7999999523162842, 21.19999885559082, 0.5999999642372131, 9.800000190734863, 0.7999999523162842, 6.399999618530273, 0.7999999523162842, 23.0, 0.7999999523162842, 4.400000095367432]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [0.5999999642372131, 4.199999809265137, 1.0, 5.799999713897705, 0.7999999523162842, 37.599998474121094, 0.3999999761581421, 17.399999618530273, 0.5999999642372131, 4.599999904632568, 0.3999999761581421, 4.199999809265137, 0.5999999642372131, 5.799999713897705, 0.7999999523162842, 6.399999618530273]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [0.7999999523162842, 15.199999809265137, 1.399999976158142, 36.39999771118164, 0.5999999642372131, 60.0, 1.5999999046325684, 12.799999237060547, 1.0, 22.19999885559082, 0.3999999761581421, 29.19999885559082, 1.7999999523162842, 21.19999885559082, 0.7999999523162842, 23.0]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [0.7999999523162842, 3.5999999046325684, 0.3999999761581421, 6.399999618530273, 1.0, 11.59999942779541, 2.0, 8.0, 0.19999998807907104, 8.0, 0.7999999523162842, 4.599999904632568, 0.5999999642372131, 9.800000190734863, 0.7999999523162842, 4.400000095367432]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  7.971+/- 1.755 (max:  60.0)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  3.937+/- 0.9409 (max:  11.6)    |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  5.7+/- 2.385 (max:  37.6)       |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  14.27+/- 4.279 (max:  60.0)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  9.27+/- 0.9981 (max:  29.66)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  7.492+/- 1.044 (max:  15.79)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  7.73+/- 1.436 (max:  24.05)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  12.59+/- 2.261 (max:  29.66)    |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.09062+/- 0.02645 (max:  0.85) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.02375+/- 0.00841 (max:  0.12) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.05625+/- 0.03769 (max:  0.58) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.1919+/- 0.06343 (max:  0.85)  |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.2                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  0.2                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.4                             |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  0.4                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  1.99                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  1.99                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  2.8                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  2.8                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                             |
------------------------------------------------------------------------------------------------------
Evaluating ACCEL_SoftMoE_SEED1 against population in Overcooked-CrampedRoom6_9 for xpid plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [11.0, 9.800000190734863, 68.4000015258789, 68.0, 102.39999389648438, 99.19999694824219, 16.399999618530273, 15.59999942779541, 74.5999984741211, 74.4000015258789, 115.5999984741211, 114.19999694824219, 19.19999885559082, 17.399999618530273, 95.79999542236328, 100.4000015258789, 114.79999542236328, 113.0, 16.799999237060547, 18.600000381469727, 95.4000015258789, 95.5999984741211, 92.0, 93.5999984741211, 9.199999809265137, 9.199999809265137, 75.4000015258789, 75.79999542236328, 108.5999984741211, 110.79999542236328, 18.399999618530273, 19.19999885559082, 95.5999984741211, 96.4000015258789, 117.0, 121.0, 15.59999942779541, 15.59999942779541, 89.0, 85.0, 113.0, 111.39999389648438, 16.600000381469727, 20.799999237060547, 97.4000015258789, 94.79999542236328, 110.19999694824219, 107.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [11.0, 9.800000190734863, 16.399999618530273, 15.59999942779541, 19.19999885559082, 17.399999618530273, 16.799999237060547, 18.600000381469727, 9.199999809265137, 9.199999809265137, 18.399999618530273, 19.19999885559082, 15.59999942779541, 15.59999942779541, 16.600000381469727, 20.799999237060547]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [68.4000015258789, 68.0, 74.5999984741211, 74.4000015258789, 95.79999542236328, 100.4000015258789, 95.4000015258789, 95.5999984741211, 75.4000015258789, 75.79999542236328, 95.5999984741211, 96.4000015258789, 89.0, 85.0, 97.4000015258789, 94.79999542236328]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [102.39999389648438, 99.19999694824219, 115.5999984741211, 114.19999694824219, 114.79999542236328, 113.0, 92.0, 93.5999984741211, 108.5999984741211, 110.79999542236328, 117.0, 121.0, 113.0, 111.39999389648438, 110.19999694824219, 107.0]
-------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  70.32+/- 5.926 (max:  121.0)   |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  109.0+/- 2.066 (max:  121.0)   |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  15.59+/- 0.9417 (max:  20.8)   |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  86.37+/- 2.897 (max:  100.4)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  21.84+/- 0.9275 (max:  33.95)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  25.13+/- 1.029 (max:  31.98)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  13.99+/- 0.4335 (max:  16.95)  |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  26.4+/- 0.7863 (max:  33.95)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.7017+/- 0.05652 (max:  1.0)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.9887+/- 0.00427 (max:  1.0)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.1587+/- 0.02091 (max:  0.3)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.9575+/- 0.008342 (max:  1.0) |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  9.2                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  92.0                           |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  9.2                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  68.0                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  10.74                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  16.09                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  10.74                          |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  21.61                          |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.02                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.93                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.02                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.89                           |
-------------------------------------------------------------------------------------------------
Evaluating ACCEL_SoftMoE_SEED2 against population in Overcooked-CoordRing6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [3.3999998569488525, 4.400000095367432, 15.59999942779541, 17.399999618530273, 19.399999618530273, 20.399999618530273, 14.199999809265137, 13.799999237060547, 25.599998474121094, 25.599998474121094, 17.799999237060547, 20.0, 12.799999237060547, 13.799999237060547, 22.399999618530273, 20.600000381469727, 18.600000381469727, 20.399999618530273, 11.399999618530273, 12.199999809265137, 12.799999237060547, 16.399999618530273, 15.199999809265137, 17.600000381469727, 13.399999618530273, 13.199999809265137, 18.399999618530273, 19.0, 20.799999237060547, 21.19999885559082, 11.0, 13.0, 19.799999237060547, 21.399999618530273, 32.0, 29.399999618530273, 3.1999998092651367, 3.0, 13.799999237060547, 17.19999885559082, 26.0, 29.799999237060547, 12.799999237060547, 15.59999942779541, 10.199999809265137, 15.199999809265137, 21.0, 24.19999885559082]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [3.3999998569488525, 4.400000095367432, 14.199999809265137, 13.799999237060547, 12.799999237060547, 13.799999237060547, 11.399999618530273, 12.199999809265137, 13.399999618530273, 13.199999809265137, 11.0, 13.0, 3.1999998092651367, 3.0, 12.799999237060547, 15.59999942779541]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [15.59999942779541, 17.399999618530273, 25.599998474121094, 25.599998474121094, 22.399999618530273, 20.600000381469727, 12.799999237060547, 16.399999618530273, 18.399999618530273, 19.0, 19.799999237060547, 21.399999618530273, 13.799999237060547, 17.19999885559082, 10.199999809265137, 15.199999809265137]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [19.399999618530273, 20.399999618530273, 17.799999237060547, 20.0, 18.600000381469727, 20.399999618530273, 15.199999809265137, 17.600000381469727, 20.799999237060547, 21.19999885559082, 32.0, 29.399999618530273, 26.0, 29.799999237060547, 21.0, 24.19999885559082]
----------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  17.01+/- 0.9417 (max:  32.0)  |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  22.11+/- 1.208 (max:  32.0)   |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  10.7+/- 1.108 (max:  15.6)    |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  18.21+/- 1.079 (max:  25.6)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  12.48+/- 0.2989 (max:  16.31) |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  12.41+/- 0.4374 (max:  15.35) |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  11.54+/- 0.6308 (max:  14.67) |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  13.5+/- 0.349 (max:  16.31)   |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.174+/- 0.02075 (max:  0.65) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.2569+/- 0.0447 (max:  0.65) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.07+/- 0.01278 (max:  0.14)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.195+/- 0.02603 (max:  0.39) |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  3.0                           |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  15.2                          |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  3.0                           |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  10.2                          |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  7.141                         |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  10.16                         |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  7.141                         |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  11.49                         |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.07                          |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                           |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.04                          |
----------------------------------------------------------------------------------------------
Evaluating ACCEL_SoftMoE_SEED2 against population in Overcooked-ForcedCoord6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [3.1999998092651367, 0.19999998807907104, 4.0, 0.3999999761581421, 3.799999952316284, 0.7999999523162842, 5.0, 0.0, 3.3999998569488525, 0.7999999523162842, 3.1999998092651367, 0.5999999642372131, 2.799999952316284, 0.19999998807907104, 1.399999976158142, 0.7999999523162842, 0.7999999523162842, 0.0, 4.0, 0.19999998807907104, 4.599999904632568, 0.19999998807907104, 2.799999952316284, 1.399999976158142, 2.200000047683716, 0.19999998807907104, 2.799999952316284, 0.7999999523162842, 4.0, 1.0, 3.799999952316284, 0.19999998807907104, 2.5999999046325684, 0.0, 1.7999999523162842, 0.5999999642372131, 3.0, 0.0, 3.3999998569488525, 0.19999998807907104, 2.0, 0.3999999761581421, 5.400000095367432, 0.0, 4.0, 0.3999999761581421, 6.0, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [3.1999998092651367, 0.19999998807907104, 5.0, 0.0, 2.799999952316284, 0.19999998807907104, 4.0, 0.19999998807907104, 2.200000047683716, 0.19999998807907104, 3.799999952316284, 0.19999998807907104, 3.0, 0.0, 5.400000095367432, 0.0]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [4.0, 0.3999999761581421, 3.3999998569488525, 0.7999999523162842, 1.399999976158142, 0.7999999523162842, 4.599999904632568, 0.19999998807907104, 2.799999952316284, 0.7999999523162842, 2.5999999046325684, 0.0, 3.3999998569488525, 0.19999998807907104, 4.0, 0.3999999761581421]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [3.799999952316284, 0.7999999523162842, 3.1999998092651367, 0.5999999642372131, 0.7999999523162842, 0.0, 2.799999952316284, 1.399999976158142, 4.0, 1.0, 1.7999999523162842, 0.5999999642372131, 2.0, 0.3999999761581421, 6.0, 0.0]
-----------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  1.862+/- 0.2511 (max:  6.0)        |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  1.825+/- 0.4262 (max:  6.0)        |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  1.9+/- 0.4956 (max:  5.4)          |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  1.862+/- 0.4065 (max:  4.6)        |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  4.794+/- 0.4211 (max:  9.165)      |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  4.871+/- 0.6694 (max:  9.165)      |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  4.51+/- 0.8705 (max:  8.879)       |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  5.002+/- 0.6724 (max:  8.485)      |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.000625+/- 0.0003531 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0)             |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.00125+/- 0.0008539 (max:  0.01)  |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.000625+/- 0.000625 (max:  0.01)  |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                                |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.0                                |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                                |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                                |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                                |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  0.0                                |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                                |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                                |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                                |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                                |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                                |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                                |
-----------------------------------------------------------------------------------------------------
Evaluating ACCEL_SoftMoE_SEED2 against population in Overcooked-CounterCircuit6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [8.0, 6.599999904632568, 14.199999809265137, 10.59999942779541, 15.199999809265137, 13.59999942779541, 8.0, 6.0, 12.399999618530273, 10.59999942779541, 2.3999998569488525, 0.7999999523162842, 2.200000047683716, 2.200000047683716, 9.399999618530273, 6.0, 10.59999942779541, 6.599999904632568, 7.399999618530273, 8.800000190734863, 17.19999885559082, 15.59999942779541, 7.799999713897705, 6.199999809265137, 8.199999809265137, 8.800000190734863, 18.799999237060547, 13.59999942779541, 7.199999809265137, 4.799999713897705, 9.199999809265137, 10.399999618530273, 14.799999237060547, 11.59999942779541, 9.199999809265137, 7.199999809265137, 6.799999713897705, 6.399999618530273, 16.19999885559082, 10.800000190734863, 7.799999713897705, 4.199999809265137, 9.0, 8.399999618530273, 18.600000381469727, 12.59999942779541, 7.0, 4.599999904632568]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [8.0, 6.599999904632568, 8.0, 6.0, 2.200000047683716, 2.200000047683716, 7.399999618530273, 8.800000190734863, 8.199999809265137, 8.800000190734863, 9.199999809265137, 10.399999618530273, 6.799999713897705, 6.399999618530273, 9.0, 8.399999618530273]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [14.199999809265137, 10.59999942779541, 12.399999618530273, 10.59999942779541, 9.399999618530273, 6.0, 17.19999885559082, 15.59999942779541, 18.799999237060547, 13.59999942779541, 14.799999237060547, 11.59999942779541, 16.19999885559082, 10.800000190734863, 18.600000381469727, 12.59999942779541]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [15.199999809265137, 13.59999942779541, 2.3999998569488525, 0.7999999523162842, 10.59999942779541, 6.599999904632568, 7.799999713897705, 6.199999809265137, 7.199999809265137, 4.799999713897705, 9.199999809265137, 7.199999809265137, 7.799999713897705, 4.199999809265137, 7.0, 4.599999904632568]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  9.262+/- 0.6191 (max:  18.8)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  7.2+/- 0.9313 (max:  15.2)       |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  7.275+/- 0.5733 (max:  10.4)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  13.31+/- 0.8754 (max:  18.8)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  11.28+/- 0.4246 (max:  18.6)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  9.457+/- 0.53 (max:  13.6)       |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  10.17+/- 0.4309 (max:  12.8)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  14.2+/- 0.5951 (max:  18.6)      |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.06229+/- 0.01171 (max:  0.32)  |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.01812+/- 0.008814 (max:  0.14) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.02312+/- 0.005456 (max:  0.08) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.1456+/- 0.02204 (max:  0.32)   |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  0.8                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  0.8                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  2.2                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  6.0                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  3.919                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  3.919                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  6.258                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  9.165                            |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                              |
------------------------------------------------------------------------------------------------------
Evaluating ACCEL_SoftMoE_SEED2 against population in Overcooked-AsymmAdvantages6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [2.5999999046325684, 7.199999809265137, 2.3999998569488525, 19.399999618530273, 3.1999998092651367, 8.199999809265137, 2.799999952316284, 9.199999809265137, 2.799999952316284, 43.20000076293945, 2.799999952316284, 7.399999618530273, 3.1999998092651367, 38.0, 3.1999998092651367, 57.599998474121094, 3.1999998092651367, 11.199999809265137, 3.1999998092651367, 19.799999237060547, 3.3999998569488525, 13.399999618530273, 4.0, 6.199999809265137, 2.5999999046325684, 4.799999713897705, 2.799999952316284, 23.0, 2.200000047683716, 7.0, 2.5999999046325684, 7.799999713897705, 4.0, 29.599998474121094, 3.5999999046325684, 6.0, 2.799999952316284, 8.399999618530273, 2.5999999046325684, 21.600000381469727, 3.799999952316284, 8.0, 2.0, 7.599999904632568, 2.5999999046325684, 26.19999885559082, 4.199999809265137, 4.0]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [2.5999999046325684, 7.199999809265137, 2.799999952316284, 9.199999809265137, 3.1999998092651367, 38.0, 3.1999998092651367, 19.799999237060547, 2.5999999046325684, 4.799999713897705, 2.5999999046325684, 7.799999713897705, 2.799999952316284, 8.399999618530273, 2.0, 7.599999904632568]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [2.3999998569488525, 19.399999618530273, 2.799999952316284, 43.20000076293945, 3.1999998092651367, 57.599998474121094, 3.3999998569488525, 13.399999618530273, 2.799999952316284, 23.0, 4.0, 29.599998474121094, 2.5999999046325684, 21.600000381469727, 2.5999999046325684, 26.19999885559082]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [3.1999998092651367, 8.199999809265137, 2.799999952316284, 7.399999618530273, 3.1999998092651367, 11.199999809265137, 4.0, 6.199999809265137, 2.200000047683716, 7.0, 3.5999999046325684, 6.0, 3.799999952316284, 8.0, 4.199999809265137, 4.0]
-------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  9.737+/- 1.712 (max:  57.6)      |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  5.312+/- 0.6242 (max:  11.2)     |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  7.787+/- 2.305 (max:  38.0)      |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  16.11+/- 4.192 (max:  57.6)      |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  12.02+/- 0.9337 (max:  31.69)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  9.808+/- 0.547 (max:  13.66)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  11.32+/- 1.618 (max:  31.69)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  14.92+/- 2.087 (max:  31.66)     |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.1087+/- 0.02705 (max:  0.81)   |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.03312+/- 0.006875 (max:  0.09) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.08+/- 0.03578 (max:  0.55)     |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.2131+/- 0.06624 (max:  0.81)   |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  2.0                              |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  2.2                              |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  2.0                              |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  2.4                              |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  6.0                              |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  6.258                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  6.0                              |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  6.499                            |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                              |
-------------------------------------------------------------------------------------------------------
Evaluating ACCEL_SoftMoE_SEED2 against population in Overcooked-CrampedRoom6_9 for xpid SEED_2_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [10.59999942779541, 10.0, 66.4000015258789, 65.79999542236328, 86.4000015258789, 90.19999694824219, 13.799999237060547, 15.199999809265137, 71.0, 70.19999694824219, 96.5999984741211, 97.19999694824219, 16.600000381469727, 15.399999618530273, 90.4000015258789, 83.79999542236328, 95.19999694824219, 93.19999694824219, 16.399999618530273, 14.0, 84.0, 79.79999542236328, 64.5999984741211, 72.5999984741211, 7.199999809265137, 7.399999618530273, 70.79999542236328, 67.5999984741211, 91.0, 91.0, 15.0, 16.19999885559082, 80.79999542236328, 84.79999542236328, 104.5999984741211, 100.19999694824219, 15.0, 14.399999618530273, 81.0, 78.79999542236328, 96.79999542236328, 93.0, 18.600000381469727, 16.0, 90.19999694824219, 79.4000015258789, 96.5999984741211, 97.5999984741211]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [10.59999942779541, 10.0, 13.799999237060547, 15.199999809265137, 16.600000381469727, 15.399999618530273, 16.399999618530273, 14.0, 7.199999809265137, 7.399999618530273, 15.0, 16.19999885559082, 15.0, 14.399999618530273, 18.600000381469727, 16.0]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [66.4000015258789, 65.79999542236328, 71.0, 70.19999694824219, 90.4000015258789, 83.79999542236328, 84.0, 79.79999542236328, 70.79999542236328, 67.5999984741211, 80.79999542236328, 84.79999542236328, 81.0, 78.79999542236328, 90.19999694824219, 79.4000015258789]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [86.4000015258789, 90.19999694824219, 96.5999984741211, 97.19999694824219, 95.19999694824219, 93.19999694824219, 64.5999984741211, 72.5999984741211, 91.0, 91.0, 104.5999984741211, 100.19999694824219, 96.79999542236328, 93.0, 96.5999984741211, 97.5999984741211]
--------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  61.11+/- 5.062 (max:  104.6)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  91.67+/- 2.52 (max:  104.6)     |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  13.86+/- 0.8296 (max:  18.6)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  77.8+/- 2.035 (max:  90.4)      |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  24.45+/- 1.174 (max:  36.21)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  29.64+/- 0.6716 (max:  33.11)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  13.65+/- 0.4103 (max:  16.01)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  30.06+/- 0.8101 (max:  36.21)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.6667+/- 0.05556 (max:  0.99)  |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.9556+/- 0.008849 (max:  0.99) |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.1325+/- 0.0159 (max:  0.23)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.9119+/- 0.009274 (max:  0.95) |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  7.2                             |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  64.6                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  7.2                             |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  65.8                            |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  10.45                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  24.41                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  10.45                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  24.8                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.02                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.86                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.02                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.83                            |
--------------------------------------------------------------------------------------------------
Evaluating ACCEL_SoftMoE_SEED3 against population in Overcooked-CoordRing6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CoordRing6_9, v [3.5999999046325684, 4.400000095367432, 20.0, 16.600000381469727, 24.19999885559082, 24.0, 13.799999237060547, 16.399999618530273, 30.19999885559082, 35.0, 25.19999885559082, 25.399999618530273, 14.59999942779541, 11.59999942779541, 23.19999885559082, 25.399999618530273, 26.19999885559082, 28.399999618530273, 18.19999885559082, 12.799999237060547, 19.0, 20.600000381469727, 21.600000381469727, 21.0, 16.399999618530273, 14.799999237060547, 22.399999618530273, 24.600000381469727, 23.19999885559082, 28.799999237060547, 12.799999237060547, 12.399999618530273, 25.0, 23.799999237060547, 30.0, 36.20000076293945, 3.1999998092651367, 2.3999998569488525, 18.399999618530273, 20.19999885559082, 26.599998474121094, 30.599998474121094, 12.799999237060547, 14.0, 14.59999942779541, 17.19999885559082, 18.600000381469727, 25.19999885559082]
k eval/a0:test_return:Overcooked-CoordRing6_9:low, v [3.5999999046325684, 4.400000095367432, 13.799999237060547, 16.399999618530273, 14.59999942779541, 11.59999942779541, 18.19999885559082, 12.799999237060547, 16.399999618530273, 14.799999237060547, 12.799999237060547, 12.399999618530273, 3.1999998092651367, 2.3999998569488525, 12.799999237060547, 14.0]
k eval/a0:test_return:Overcooked-CoordRing6_9:mid, v [20.0, 16.600000381469727, 30.19999885559082, 35.0, 23.19999885559082, 25.399999618530273, 19.0, 20.600000381469727, 22.399999618530273, 24.600000381469727, 25.0, 23.799999237060547, 18.399999618530273, 20.19999885559082, 14.59999942779541, 17.19999885559082]
k eval/a0:test_return:Overcooked-CoordRing6_9:high, v [24.19999885559082, 24.0, 25.19999885559082, 25.399999618530273, 26.19999885559082, 28.399999618530273, 21.600000381469727, 21.0, 23.19999885559082, 28.799999237060547, 30.0, 36.20000076293945, 26.599998474121094, 30.599998474121094, 18.600000381469727, 25.19999885559082]
------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CoordRing6_9               |  19.91+/- 1.128 (max:  36.2)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:high          |  25.95+/- 1.063 (max:  36.2)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:low           |  11.51+/- 1.283 (max:  18.2)     |
| eval/a0:test_return:Overcooked-CoordRing6_9:mid           |  22.26+/- 1.3 (max:  35.0)       |
| eval/a0:test_return_std:Overcooked-CoordRing6_9           |  13.51+/- 0.3541 (max:  19.29)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:high      |  13.57+/- 0.58 (max:  19.29)     |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:low       |  12.26+/- 0.7193 (max:  15.17)   |
| eval/a0:test_return_std:Overcooked-CoordRing6_9:mid       |  14.71+/- 0.3518 (max:  17.37)   |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9          |  0.2606+/- 0.02445 (max:  0.68)  |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high     |  0.38+/- 0.03378 (max:  0.67)    |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low      |  0.09625+/- 0.01622 (max:  0.23) |
| eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid      |  0.3056+/- 0.03643 (max:  0.68)  |
| min:eval/a0:test_return:Overcooked-CoordRing6_9           |  2.4                             |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:high      |  18.6                            |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:low       |  2.4                             |
| min:eval/a0:test_return:Overcooked-CoordRing6_9:mid       |  14.6                            |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9       |  6.499                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:high  |  10.65                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:low   |  6.499                           |
| min:eval/a0:test_return_std:Overcooked-CoordRing6_9:mid   |  12.6                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9      |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:high |  0.17                            |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:low  |  0.0                             |
| min:eval/a0:test_solved_rate:Overcooked-CoordRing6_9:mid  |  0.1                             |
------------------------------------------------------------------------------------------------
Evaluating ACCEL_SoftMoE_SEED3 against population in Overcooked-ForcedCoord6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-ForcedCoord6_9, v [6.399999618530273, 0.3999999761581421, 6.599999904632568, 1.0, 3.1999998092651367, 0.3999999761581421, 7.799999713897705, 0.0, 6.399999618530273, 0.5999999642372131, 4.400000095367432, 0.5999999642372131, 5.199999809265137, 2.200000047683716, 4.599999904632568, 1.399999976158142, 1.5999999046325684, 1.0, 7.199999809265137, 0.3999999761581421, 5.599999904632568, 0.0, 5.799999713897705, 0.3999999761581421, 4.0, 0.3999999761581421, 5.599999904632568, 0.19999998807907104, 8.0, 0.3999999761581421, 5.799999713897705, 0.3999999761581421, 5.0, 0.0, 3.5999999046325684, 0.3999999761581421, 2.799999952316284, 0.19999998807907104, 4.0, 1.5999999046325684, 3.5999999046325684, 0.7999999523162842, 8.0, 0.19999998807907104, 7.599999904632568, 0.5999999642372131, 9.800000190734863, 0.3999999761581421]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:low, v [6.399999618530273, 0.3999999761581421, 7.799999713897705, 0.0, 5.199999809265137, 2.200000047683716, 7.199999809265137, 0.3999999761581421, 4.0, 0.3999999761581421, 5.799999713897705, 0.3999999761581421, 2.799999952316284, 0.19999998807907104, 8.0, 0.19999998807907104]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:mid, v [6.599999904632568, 1.0, 6.399999618530273, 0.5999999642372131, 4.599999904632568, 1.399999976158142, 5.599999904632568, 0.0, 5.599999904632568, 0.19999998807907104, 5.0, 0.0, 4.0, 1.5999999046325684, 7.599999904632568, 0.5999999642372131]
k eval/a0:test_return:Overcooked-ForcedCoord6_9:high, v [3.1999998092651367, 0.3999999761581421, 4.400000095367432, 0.5999999642372131, 1.5999999046325684, 1.0, 5.799999713897705, 0.3999999761581421, 8.0, 0.3999999761581421, 3.5999999046325684, 0.3999999761581421, 3.5999999046325684, 0.7999999523162842, 9.800000190734863, 0.3999999761581421]
----------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-ForcedCoord6_9               |  3.054+/- 0.4147 (max:  9.8)       |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:high          |  2.775+/- 0.7398 (max:  9.8)       |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:low           |  3.212+/- 0.7708 (max:  8.0)       |
| eval/a0:test_return:Overcooked-ForcedCoord6_9:mid           |  3.175+/- 0.6836 (max:  7.6)       |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9           |  5.863+/- 0.4681 (max:  10.2)      |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high      |  5.686+/- 0.6958 (max:  9.998)     |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low       |  5.847+/- 0.8881 (max:  10.2)      |
| eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid       |  6.056+/- 0.8845 (max:  10.11)     |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9          |  0.00125+/- 0.0004824 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high     |  0.0+/- 0.0 (max:  0.0)            |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low      |  0.00125+/- 0.0008539 (max:  0.01) |
| eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid      |  0.0025+/- 0.001118 (max:  0.01)   |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9           |  0.0                               |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:high      |  0.4                               |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:low       |  0.0                               |
| min:eval/a0:test_return:Overcooked-ForcedCoord6_9:mid       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9       |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:high  |  2.8                               |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:low   |  0.0                               |
| min:eval/a0:test_return_std:Overcooked-ForcedCoord6_9:mid   |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9      |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:high |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:low  |  0.0                               |
| min:eval/a0:test_solved_rate:Overcooked-ForcedCoord6_9:mid  |  0.0                               |
----------------------------------------------------------------------------------------------------
Evaluating ACCEL_SoftMoE_SEED3 against population in Overcooked-CounterCircuit6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CounterCircuit6_9, v [10.59999942779541, 10.800000190734863, 21.799999237060547, 13.59999942779541, 15.59999942779541, 13.199999809265137, 6.599999904632568, 6.599999904632568, 11.0, 11.199999809265137, 5.799999713897705, 1.399999976158142, 1.5999999046325684, 1.5999999046325684, 9.199999809265137, 9.199999809265137, 10.399999618530273, 9.0, 8.199999809265137, 7.399999618530273, 22.399999618530273, 17.799999237060547, 13.199999809265137, 7.399999618530273, 10.800000190734863, 8.399999618530273, 19.19999885559082, 15.799999237060547, 8.800000190734863, 4.199999809265137, 12.0, 9.800000190734863, 19.0, 13.59999942779541, 10.399999618530273, 8.0, 7.599999904632568, 7.199999809265137, 15.0, 13.799999237060547, 12.799999237060547, 5.0, 10.199999809265137, 9.0, 20.399999618530273, 17.600000381469727, 12.799999237060547, 4.199999809265137]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:low, v [10.59999942779541, 10.800000190734863, 6.599999904632568, 6.599999904632568, 1.5999999046325684, 1.5999999046325684, 8.199999809265137, 7.399999618530273, 10.800000190734863, 8.399999618530273, 12.0, 9.800000190734863, 7.599999904632568, 7.199999809265137, 10.199999809265137, 9.0]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:mid, v [21.799999237060547, 13.59999942779541, 11.0, 11.199999809265137, 9.199999809265137, 9.199999809265137, 22.399999618530273, 17.799999237060547, 19.19999885559082, 15.799999237060547, 19.0, 13.59999942779541, 15.0, 13.799999237060547, 20.399999618530273, 17.600000381469727]
k eval/a0:test_return:Overcooked-CounterCircuit6_9:high, v [15.59999942779541, 13.199999809265137, 5.799999713897705, 1.399999976158142, 10.399999618530273, 9.0, 13.199999809265137, 7.399999618530273, 8.800000190734863, 4.199999809265137, 10.399999618530273, 8.0, 12.799999237060547, 5.0, 12.799999237060547, 4.199999809265137]
------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CounterCircuit6_9               |  10.86+/- 0.7338 (max:  22.4)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:high          |  8.887+/- 1.011 (max:  15.6)      |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:low           |  8.025+/- 0.7492 (max:  12.0)     |
| eval/a0:test_return:Overcooked-CounterCircuit6_9:mid           |  15.66+/- 1.071 (max:  22.4)      |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9           |  11.78+/- 0.4498 (max:  19.79)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high      |  10.08+/- 0.437 (max:  12.07)     |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low       |  10.35+/- 0.5525 (max:  12.65)    |
| eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid       |  14.91+/- 0.6494 (max:  19.79)    |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9          |  0.07833+/- 0.01431 (max:  0.38)  |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high     |  0.02625+/- 0.006575 (max:  0.08) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low      |  0.02625+/- 0.006382 (max:  0.07) |
| eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid      |  0.1825+/- 0.02747 (max:  0.38)   |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9           |  1.4                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:high      |  1.4                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:low       |  1.6                              |
| min:eval/a0:test_return:Overcooked-CounterCircuit6_9:mid       |  9.2                              |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9       |  5.103                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:high  |  5.103                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:low   |  5.426                            |
| min:eval/a0:test_return_std:Overcooked-CounterCircuit6_9:mid   |  9.968                            |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-CounterCircuit6_9:mid  |  0.0                              |
------------------------------------------------------------------------------------------------------
Evaluating ACCEL_SoftMoE_SEED3 against population in Overcooked-AsymmAdvantages6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9, v [1.0, 6.0, 1.7999999523162842, 14.399999618530273, 2.200000047683716, 3.0, 1.5999999046325684, 9.199999809265137, 1.399999976158142, 42.39999771118164, 2.3999998569488525, 3.1999998092651367, 0.7999999523162842, 37.0, 1.0, 56.0, 1.0, 11.59999942779541, 1.5999999046325684, 19.799999237060547, 3.0, 9.59999942779541, 2.200000047683716, 4.799999713897705, 0.5999999642372131, 3.3999998569488525, 1.0, 18.19999885559082, 1.1999999284744263, 5.799999713897705, 0.7999999523162842, 6.599999904632568, 1.1999999284744263, 25.0, 2.0, 5.400000095367432, 0.7999999523162842, 5.400000095367432, 1.7999999523162842, 24.399999618530273, 1.7999999523162842, 8.800000190734863, 0.19999998807907104, 9.199999809265137, 1.1999999284744263, 22.600000381469727, 2.3999998569488525, 2.200000047683716]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low, v [1.0, 6.0, 1.5999999046325684, 9.199999809265137, 0.7999999523162842, 37.0, 1.5999999046325684, 19.799999237060547, 0.5999999642372131, 3.3999998569488525, 0.7999999523162842, 6.599999904632568, 0.7999999523162842, 5.400000095367432, 0.19999998807907104, 9.199999809265137]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid, v [1.7999999523162842, 14.399999618530273, 1.399999976158142, 42.39999771118164, 1.0, 56.0, 3.0, 9.59999942779541, 1.0, 18.19999885559082, 1.1999999284744263, 25.0, 1.7999999523162842, 24.399999618530273, 1.1999999284744263, 22.600000381469727]
k eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high, v [2.200000047683716, 3.0, 2.3999998569488525, 3.1999998092651367, 1.0, 11.59999942779541, 2.200000047683716, 4.799999713897705, 1.1999999284744263, 5.799999713897705, 2.0, 5.400000095367432, 1.7999999523162842, 8.800000190734863, 2.3999998569488525, 2.200000047683716]
-------------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9               |  8.104+/- 1.707 (max:  56.0)      |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high          |  3.75+/- 0.7297 (max:  11.6)      |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low           |  6.5+/- 2.401 (max:  37.0)        |
| eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid           |  14.06+/- 4.16 (max:  56.0)       |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9           |  9.987+/- 0.9854 (max:  30.59)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high      |  7.933+/- 0.6595 (max:  12.43)    |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low       |  8.856+/- 1.681 (max:  26.89)     |
| eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid       |  13.17+/- 2.196 (max:  30.59)     |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9          |  0.08833+/- 0.0261 (max:  0.75)   |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high     |  0.01812+/- 0.005643 (max:  0.07) |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low      |  0.06938+/- 0.04139 (max:  0.62)  |
| eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid      |  0.1775+/- 0.06143 (max:  0.75)   |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9           |  0.2                              |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:high      |  1.0                              |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:low       |  0.2                              |
| min:eval/a0:test_return:Overcooked-AsymmAdvantages6_9:mid       |  1.0                              |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9       |  1.99                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:high  |  4.359                            |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:low   |  1.99                             |
| min:eval/a0:test_return_std:Overcooked-AsymmAdvantages6_9:mid   |  4.359                            |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9      |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:high |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:low  |  0.0                              |
| min:eval/a0:test_solved_rate:Overcooked-AsymmAdvantages6_9:mid  |  0.0                              |
-------------------------------------------------------------------------------------------------------
Evaluating ACCEL_SoftMoE_SEED3 against population in Overcooked-CrampedRoom6_9 for xpid SEED_3_plr-overcooked6x9w15_fs_IMAGE-rpf_p0.8b4000t0.1s0.3m0.5r_mdef20bat_r1s_32p_1e_400t_ae1e-05_smm-ppo_lr0.0003g0.999cv0.5ce0.01e8mb4l0.98_pc0.2_h64cf32fc2se5ba_re_lstm_h64__SoftMoE_4E_32S___0
k eval/a0:test_return:Overcooked-CrampedRoom6_9, v [12.799999237060547, 12.0, 70.4000015258789, 67.0, 97.0, 94.5999984741211, 17.799999237060547, 14.799999237060547, 75.19999694824219, 69.0, 104.0, 102.79999542236328, 20.0, 21.399999618530273, 89.79999542236328, 93.0, 104.0, 110.0, 21.0, 23.799999237060547, 84.0, 81.5999984741211, 76.4000015258789, 78.5999984741211, 9.0, 12.399999618530273, 77.19999694824219, 67.19999694824219, 98.4000015258789, 96.5999984741211, 19.0, 20.799999237060547, 84.5999984741211, 86.0, 105.5999984741211, 97.79999542236328, 19.799999237060547, 18.399999618530273, 80.4000015258789, 75.79999542236328, 95.4000015258789, 104.19999694824219, 22.799999237060547, 21.19999885559082, 86.79999542236328, 80.79999542236328, 99.0, 98.4000015258789]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:low, v [12.799999237060547, 12.0, 17.799999237060547, 14.799999237060547, 20.0, 21.399999618530273, 21.0, 23.799999237060547, 9.0, 12.399999618530273, 19.0, 20.799999237060547, 19.799999237060547, 18.399999618530273, 22.799999237060547, 21.19999885559082]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:mid, v [70.4000015258789, 67.0, 75.19999694824219, 69.0, 89.79999542236328, 93.0, 84.0, 81.5999984741211, 77.19999694824219, 67.19999694824219, 84.5999984741211, 86.0, 80.4000015258789, 75.79999542236328, 86.79999542236328, 80.79999542236328]
k eval/a0:test_return:Overcooked-CrampedRoom6_9:high, v [97.0, 94.5999984741211, 104.0, 102.79999542236328, 104.0, 110.0, 76.4000015258789, 78.5999984741211, 98.4000015258789, 96.5999984741211, 105.5999984741211, 97.79999542236328, 95.4000015258789, 104.19999694824219, 99.0, 98.4000015258789]
--------------------------------------------------------------------------------------------------
| eval/a0:test_return:Overcooked-CrampedRoom6_9               |  64.97+/- 5.082 (max:  110.0)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:high          |  97.67+/- 2.235 (max:  110.0)    |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:low           |  17.94+/- 1.098 (max:  23.8)     |
| eval/a0:test_return:Overcooked-CrampedRoom6_9:mid           |  79.3+/- 2.015 (max:  93.0)      |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9           |  25.19+/- 1.1 (max:  35.14)      |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high      |  30.55+/- 0.7829 (max:  35.14)   |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low       |  15.09+/- 0.382 (max:  17.16)    |
| eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid       |  29.93+/- 0.6353 (max:  33.49)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9          |  0.7021+/- 0.05005 (max:  1.0)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high     |  0.96+/- 0.007692 (max:  1.0)    |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low      |  0.225+/- 0.02422 (max:  0.37)   |
| eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid      |  0.9212+/- 0.009259 (max:  0.99) |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9           |  9.0                             |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:high      |  76.4                            |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:low       |  9.0                             |
| min:eval/a0:test_return:Overcooked-CrampedRoom6_9:mid       |  67.0                            |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9       |  11.45                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:high  |  23.75                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:low   |  11.45                           |
| min:eval/a0:test_return_std:Overcooked-CrampedRoom6_9:mid   |  25.51                           |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9      |  0.04                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:high |  0.88                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:low  |  0.04                            |
| min:eval/a0:test_solved_rate:Overcooked-CrampedRoom6_9:mid  |  0.85                            |
--------------------------------------------------------------------------------------------------
