Logging to logs/HalfCheetah-v4/IRL/2025_02_18_09_34_43
2025-02-18 09:34:52.371703 ׼ʱ-
| Itration            | 0        |
| Real Det Return     | -0.26    |
| Real Sto Return     | -21      |
| Reward Loss         | 1.43     |
| Running Env Steps   | 0        |
| Running Forward KL  | 10.3     |
| Running Reverse KL  | 4.34     |
| Running Update Time | 0        |
----------------------------------
2025-02-18 09:35:01.666331 ׼ʱ-
| Itration            | 1        |
| Real Det Return     | -0.52    |
| Real Sto Return     | -33.8    |
| Reward Loss         | 1.61     |
| Running Env Steps   | 500      |
| Running Forward KL  | 8.74     |
| Running Reverse KL  | 4.28     |
| Running Update Time | 1        |
----------------------------------
2025-02-18 09:35:11.710787 ׼ʱ-
| Itration            | 2        |
| Real Det Return     | -0.47    |
| Real Sto Return     | -35.8    |
| Reward Loss         | 2.64     |
| Running Env Steps   | 1000     |
| Running Forward KL  | 9.62     |
| Running Reverse KL  | 4.4      |
| Running Update Time | 2        |
----------------------------------
2025-02-18 09:35:21.848984 ׼ʱ-
| Itration            | 3        |
| Real Det Return     | -1.45    |
| Real Sto Return     | -25      |
| Reward Loss         | -0.544   |
| Running Env Steps   | 1500     |
| Running Forward KL  | 10.1     |
| Running Reverse KL  | 4.39     |
| Running Update Time | 3        |
----------------------------------
2025-02-18 09:35:31.893428 ׼ʱ-
| Itration            | 4        |
| Real Det Return     | -3.19    |
| Real Sto Return     | -28.1    |
| Reward Loss         | -2.15    |
| Running Env Steps   | 2000     |
| Running Forward KL  | 10.3     |
| Running Reverse KL  | 4.5      |
| Running Update Time | 4        |
----------------------------------
2025-02-18 09:35:41.953506 ׼ʱ-
| Itration            | 5        |
| Real Det Return     | -2.53    |
| Real Sto Return     | -18.3    |
| Reward Loss         | -2.2     |
| Running Env Steps   | 2500     |
| Running Forward KL  | 10.8     |
| Running Reverse KL  | 4.9      |
| Running Update Time | 5        |
----------------------------------
2025-02-18 09:35:52.060448 ׼ʱ-
| Itration            | 6        |
| Real Det Return     | -1.49    |
| Real Sto Return     | -28.5    |
| Reward Loss         | 1.69     |
| Running Env Steps   | 3000     |
| Running Forward KL  | 9.68     |
| Running Reverse KL  | 5.11     |
| Running Update Time | 6        |
----------------------------------
2025-02-18 09:36:02.277130 ׼ʱ-
| Itration            | 7        |
| Real Det Return     | -1.47    |
| Real Sto Return     | -12.4    |
| Reward Loss         | 2.05     |
| Running Env Steps   | 3500     |
| Running Forward KL  | 9.79     |
| Running Reverse KL  | 5.38     |
| Running Update Time | 7        |
----------------------------------
2025-02-18 09:36:12.430935 ׼ʱ-
| Itration            | 8        |
| Real Det Return     | -1.81    |
| Real Sto Return     | -9.17    |
| Reward Loss         | 2.62     |
| Running Env Steps   | 4000     |
| Running Forward KL  | 9.79     |
| Running Reverse KL  | 5.46     |
| Running Update Time | 8        |
----------------------------------
2025-02-18 09:36:23.065212 ׼ʱ-
| Itration            | 9        |
| Real Det Return     | -1.42    |
| Real Sto Return     | -13.1    |
| Reward Loss         | -3.21    |
| Running Env Steps   | 4500     |
| Running Forward KL  | 9.97     |
| Running Reverse KL  | 5.05     |
| Running Update Time | 9        |
----------------------------------
2025-02-18 09:36:33.406481 ׼ʱ-
| Itration            | 10       |
| Real Det Return     | 0.34     |
| Real Sto Return     | -7.79    |
| Reward Loss         | 0.794    |
| Running Env Steps   | 5000     |
| Running Forward KL  | 9.96     |
| Running Reverse KL  | 5.82     |
| Running Update Time | 10       |
----------------------------------
2025-02-18 09:36:43.763362 ׼ʱ-
| Itration            | 11       |
| Real Det Return     | -2.89    |
| Real Sto Return     | -2.45    |
| Reward Loss         | 0.853    |
| Running Env Steps   | 5500     |
| Running Forward KL  | 9.71     |
| Running Reverse KL  | 6.46     |
| Running Update Time | 11       |
----------------------------------
2025-02-18 09:36:54.167116 ׼ʱ-
| Itration            | 12       |
| Real Det Return     | -1.47    |
| Real Sto Return     | 0.1      |
| Reward Loss         | -5.2     |
| Running Env Steps   | 6000     |
| Running Forward KL  | 9.86     |
| Running Reverse KL  | 5.19     |
| Running Update Time | 12       |
----------------------------------
2025-02-18 09:37:04.727082 ׼ʱ-
| Itration            | 13       |
| Real Det Return     | 3.53     |
| Real Sto Return     | 0.29     |
| Reward Loss         | -6.6     |
| Running Env Steps   | 6500     |
| Running Forward KL  | 9.48     |
| Running Reverse KL  | 5.8      |
| Running Update Time | 13       |
----------------------------------
2025-02-18 09:37:15.193295 ׼ʱ-
| Itration            | 14       |
| Real Det Return     | -1.83    |
| Real Sto Return     | -1.71    |
| Reward Loss         | -5.58    |
| Running Env Steps   | 7000     |
| Running Forward KL  | 9.59     |
| Running Reverse KL  | 5.61     |
| Running Update Time | 14       |
----------------------------------
2025-02-18 09:37:25.675160 ׼ʱ-
| Itration            | 15       |
| Real Det Return     | -1.77    |
| Real Sto Return     | -4.57    |
| Reward Loss         | -4.55    |
| Running Env Steps   | 7500     |
| Running Forward KL  | 10       |
| Running Reverse KL  | 6.3      |
| Running Update Time | 15       |
----------------------------------
2025-02-18 09:37:36.157007 ׼ʱ-
| Itration            | 16       |
| Real Det Return     | 9.24     |
| Real Sto Return     | -0.43    |
| Reward Loss         | -7.23    |
| Running Env Steps   | 8000     |
| Running Forward KL  | 10       |
| Running Reverse KL  | 6.16     |
| Running Update Time | 16       |
----------------------------------
2025-02-18 09:37:46.638851 ׼ʱ-
| Itration            | 17       |
| Real Det Return     | 12.3     |
| Real Sto Return     | 1.76     |
| Reward Loss         | -8.67    |
| Running Env Steps   | 8500     |
| Running Forward KL  | 9.46     |
| Running Reverse KL  | 5.81     |
| Running Update Time | 17       |
----------------------------------
2025-02-18 09:37:57.136332 ׼ʱ-
| Itration            | 18       |
| Real Det Return     | 7.2      |
| Real Sto Return     | -1.15    |
| Reward Loss         | -12.5    |
| Running Env Steps   | 9000     |
| Running Forward KL  | 9.38     |
| Running Reverse KL  | 5.36     |
| Running Update Time | 18       |
----------------------------------
2025-02-18 09:38:07.821225 ׼ʱ-
| Itration            | 19       |
| Real Det Return     | 10.8     |
| Real Sto Return     | 2.88     |
| Reward Loss         | -13.1    |
| Running Env Steps   | 9500     |
| Running Forward KL  | 9.48     |
| Running Reverse KL  | 5.42     |
| Running Update Time | 19       |
----------------------------------
2025-02-18 09:38:18.349982 ׼ʱ-
| Itration            | 20       |
| Real Det Return     | 5.82     |
| Real Sto Return     | -2.67    |
| Reward Loss         | -11.9    |
| Running Env Steps   | 10000    |
| Running Forward KL  | 9.39     |
| Running Reverse KL  | 6.21     |
| Running Update Time | 20       |
----------------------------------
2025-02-18 09:38:29.348461 ׼ʱ-
| Itration            | 21       |
| Real Det Return     | 3.77     |
| Real Sto Return     | -0.06    |
| Reward Loss         | -15.6    |
| Running Env Steps   | 10500    |
| Running Forward KL  | 9.14     |
| Running Reverse KL  | 5.8      |
| Running Update Time | 21       |
----------------------------------
2025-02-18 09:38:40.330168 ׼ʱ-
| Itration            | 22       |
| Real Det Return     | 3.89     |
| Real Sto Return     | -0.75    |
| Reward Loss         | -16.1    |
| Running Env Steps   | 11000    |
| Running Forward KL  | 9.37     |
| Running Reverse KL  | 5.84     |
| Running Update Time | 22       |
----------------------------------
2025-02-18 09:38:51.468136 ׼ʱ-
| Itration            | 23       |
| Real Det Return     | 7.68     |
| Real Sto Return     | -0.61    |
| Reward Loss         | -16.1    |
| Running Env Steps   | 11500    |
| Running Forward KL  | 8.7      |
| Running Reverse KL  | 6.15     |
| Running Update Time | 23       |
----------------------------------
2025-02-18 09:39:02.668958 ׼ʱ-
| Itration            | 24       |
| Real Det Return     | 6.81     |
| Real Sto Return     | 0.38     |
| Reward Loss         | -20.7    |
| Running Env Steps   | 12000    |
| Running Forward KL  | 9.15     |
| Running Reverse KL  | 5.39     |
| Running Update Time | 24       |
----------------------------------
2025-02-18 09:39:14.588360 ׼ʱ-
| Itration            | 25       |
| Real Det Return     | 5.22     |
| Real Sto Return     | 0.84     |
| Reward Loss         | -22.2    |
| Running Env Steps   | 12500    |
| Running Forward KL  | 9.26     |
| Running Reverse KL  | 5.24     |
| Running Update Time | 25       |
----------------------------------
2025-02-18 09:39:27.007210 ׼ʱ-
| Itration            | 26       |
| Real Det Return     | 8.13     |
| Real Sto Return     | 0.97     |
| Reward Loss         | -21.7    |
| Running Env Steps   | 13000    |
| Running Forward KL  | 8.9      |
| Running Reverse KL  | 5.89     |
| Running Update Time | 26       |
----------------------------------
2025-02-18 09:39:37.458239 ׼ʱ-
| Itration            | 27       |
| Real Det Return     | 8.44     |
| Real Sto Return     | 2.47     |
| Reward Loss         | -26.8    |
| Running Env Steps   | 13500    |
| Running Forward KL  | 9.1      |
| Running Reverse KL  | 6.21     |
| Running Update Time | 27       |
----------------------------------
2025-02-18 09:39:47.783875 ׼ʱ-
| Itration            | 28       |
| Real Det Return     | 7        |
| Real Sto Return     | 6.95     |
| Reward Loss         | -25.1    |
| Running Env Steps   | 14000    |
| Running Forward KL  | 8.75     |
| Running Reverse KL  | 5.89     |
| Running Update Time | 28       |
----------------------------------
2025-02-18 09:39:58.125145 ׼ʱ-
| Itration            | 29       |
| Real Det Return     | 7.82     |
| Real Sto Return     | 3.15     |
| Reward Loss         | -27      |
| Running Env Steps   | 14500    |
| Running Forward KL  | 9.07     |
| Running Reverse KL  | 6.22     |
| Running Update Time | 29       |
----------------------------------
2025-02-18 09:40:08.497648 ׼ʱ-
| Itration            | 30       |
| Real Det Return     | 9.71     |
| Real Sto Return     | -5.49    |
| Reward Loss         | -29      |
| Running Env Steps   | 15000    |
| Running Forward KL  | 8.89     |
| Running Reverse KL  | 6.12     |
| Running Update Time | 30       |
----------------------------------
2025-02-18 09:40:18.838899 ׼ʱ-
| Itration            | 31       |
| Real Det Return     | 8.7      |
| Real Sto Return     | 0.95     |
| Reward Loss         | -31.3    |
| Running Env Steps   | 15500    |
| Running Forward KL  | 8.66     |
| Running Reverse KL  | 5.53     |
| Running Update Time | 31       |
----------------------------------
2025-02-18 09:40:29.584436 ׼ʱ-
| Itration            | 32       |
| Real Det Return     | 7.45     |
| Real Sto Return     | 4.41     |
| Reward Loss         | -34.8    |
| Running Env Steps   | 16000    |
| Running Forward KL  | 8.65     |
| Running Reverse KL  | 5.66     |
| Running Update Time | 32       |
----------------------------------
2025-02-18 09:40:39.910075 ׼ʱ-
| Itration            | 33       |
| Real Det Return     | 7.62     |
| Real Sto Return     | 2.76     |
| Reward Loss         | -34.7    |
| Running Env Steps   | 16500    |
| Running Forward KL  | 9.14     |
| Running Reverse KL  | 5.79     |
| Running Update Time | 33       |
----------------------------------
2025-02-18 09:40:50.251340 ׼ʱ-
| Itration            | 34       |
| Real Det Return     | 7.23     |
| Real Sto Return     | 4.5      |
| Reward Loss         | -36.4    |
| Running Env Steps   | 17000    |
| Running Forward KL  | 9.06     |
| Running Reverse KL  | 5.38     |
| Running Update Time | 34       |
----------------------------------
2025-02-18 09:41:00.655091 ׼ʱ-
| Itration            | 35       |
| Real Det Return     | 8.22     |
| Real Sto Return     | 6.81     |
| Reward Loss         | -35.6    |
| Running Env Steps   | 17500    |
| Running Forward KL  | 9.16     |
| Running Reverse KL  | 5.87     |
| Running Update Time | 35       |
----------------------------------
2025-02-18 09:41:11.043240 ׼ʱ-
| Itration            | 36       |
| Real Det Return     | 7.77     |
| Real Sto Return     | 4.37     |
| Reward Loss         | -36.4    |
| Running Env Steps   | 18000    |
| Running Forward KL  | 8.04     |
| Running Reverse KL  | 5.87     |
| Running Update Time | 36       |
----------------------------------
2025-02-18 09:41:21.571940 ׼ʱ-
| Itration            | 37       |
| Real Det Return     | 10.1     |
| Real Sto Return     | 3.46     |
| Reward Loss         | -37.9    |
| Running Env Steps   | 18500    |
| Running Forward KL  | 8.53     |
| Running Reverse KL  | 5.69     |
| Running Update Time | 37       |
----------------------------------
2025-02-18 09:41:31.913570 ׼ʱ-
| Itration            | 38       |
| Real Det Return     | 8.6      |
| Real Sto Return     | 4.01     |
| Reward Loss         | -38.8    |
| Running Env Steps   | 19000    |
| Running Forward KL  | 8.25     |
| Running Reverse KL  | 5.67     |
| Running Update Time | 38       |
----------------------------------
2025-02-18 09:41:42.254878 ׼ʱ-
| Itration            | 39       |
| Real Det Return     | 7.76     |
| Real Sto Return     | 3.25     |
| Reward Loss         | -41.5    |
| Running Env Steps   | 19500    |
| Running Forward KL  | 7.96     |
| Running Reverse KL  | 5.84     |
| Running Update Time | 39       |
----------------------------------
2025-02-18 09:41:52.799217 ׼ʱ-
| Itration            | 40       |
| Real Det Return     | 6.85     |
| Real Sto Return     | 6.49     |
| Reward Loss         | -42.3    |
| Running Env Steps   | 20000    |
| Running Forward KL  | 8.6      |
| Running Reverse KL  | 5.74     |
| Running Update Time | 40       |
----------------------------------
2025-02-18 09:42:03.452869 ׼ʱ-
| Itration            | 41       |
| Real Det Return     | 7.55     |
| Real Sto Return     | 2.43     |
| Reward Loss         | -42.6    |
| Running Env Steps   | 20500    |
| Running Forward KL  | 8        |
| Running Reverse KL  | 5.64     |
| Running Update Time | 41       |
----------------------------------
2025-02-18 09:42:14.137836 ׼ʱ-
| Itration            | 42       |
| Real Det Return     | 6.81     |
| Real Sto Return     | 8.28     |
| Reward Loss         | -47.1    |
| Running Env Steps   | 21000    |
| Running Forward KL  | 8.24     |
| Running Reverse KL  | 5        |
| Running Update Time | 42       |
----------------------------------
2025-02-18 09:42:24.822759 ׼ʱ-
| Itration            | 43       |
| Real Det Return     | 7.66     |
| Real Sto Return     | 9.98     |
| Reward Loss         | -47.4    |
| Running Env Steps   | 21500    |
| Running Forward KL  | 8.17     |
| Running Reverse KL  | 5.4      |
| Running Update Time | 43       |
----------------------------------
2025-02-18 09:42:35.923194 ׼ʱ-
| Itration            | 44       |
| Real Det Return     | 10.6     |
| Real Sto Return     | 8.42     |
| Reward Loss         | -47      |
| Running Env Steps   | 22000    |
| Running Forward KL  | 7.46     |
| Running Reverse KL  | 5.11     |
| Running Update Time | 44       |
----------------------------------
2025-02-18 09:42:46.592549 ׼ʱ-
| Itration            | 45       |
| Real Det Return     | 8.39     |
| Real Sto Return     | 6.74     |
| Reward Loss         | -49.7    |
| Running Env Steps   | 22500    |
| Running Forward KL  | 7.89     |
| Running Reverse KL  | 4.93     |
| Running Update Time | 45       |
----------------------------------
2025-02-18 09:42:57.371167 ׼ʱ-
| Itration            | 46       |
| Real Det Return     | 6.47     |
| Real Sto Return     | 8.75     |
| Reward Loss         | -48.8    |
| Running Env Steps   | 23000    |
| Running Forward KL  | 7.71     |
| Running Reverse KL  | 5.36     |
| Running Update Time | 46       |
----------------------------------
2025-02-18 09:43:08.103006 ׼ʱ-
| Itration            | 47       |
| Real Det Return     | 8.47     |
| Real Sto Return     | 13.4     |
| Reward Loss         | -53.7    |
| Running Env Steps   | 23500    |
| Running Forward KL  | 7.15     |
| Running Reverse KL  | 5.07     |
| Running Update Time | 47       |
----------------------------------
2025-02-18 09:43:18.756688 ׼ʱ-
| Itration            | 48       |
| Real Det Return     | 8.54     |
| Real Sto Return     | 7.37     |
| Reward Loss         | -51.6    |
| Running Env Steps   | 24000    |
| Running Forward KL  | 7.39     |
| Running Reverse KL  | 5.33     |
| Running Update Time | 48       |
----------------------------------
2025-02-18 09:43:29.535744 ׼ʱ-
| Itration            | 49       |
| Real Det Return     | 7.38     |
| Real Sto Return     | 10.8     |
| Reward Loss         | -52.8    |
| Running Env Steps   | 24500    |
| Running Forward KL  | 7.82     |
| Running Reverse KL  | 5.6      |
| Running Update Time | 49       |
----------------------------------
2025-02-18 09:43:40.158191 ׼ʱ-
| Itration            | 50       |
| Real Det Return     | 7.39     |
| Real Sto Return     | 9.16     |
| Reward Loss         | -52.6    |
| Running Env Steps   | 25000    |
| Running Forward KL  | 7.17     |
| Running Reverse KL  | 5.42     |
| Running Update Time | 50       |
----------------------------------
2025-02-18 09:43:50.811878 ׼ʱ-
| Itration            | 51       |
| Real Det Return     | 7.37     |
| Real Sto Return     | 8.98     |
| Reward Loss         | -50.3    |
| Running Env Steps   | 25500    |
| Running Forward KL  | 6.82     |
| Running Reverse KL  | 5.13     |
| Running Update Time | 51       |
----------------------------------
2025-02-18 09:44:01.668649 ׼ʱ-
| Itration            | 52       |
| Real Det Return     | 8.89     |
| Real Sto Return     | 15.4     |
| Reward Loss         | -52.1    |
| Running Env Steps   | 26000    |
| Running Forward KL  | 6.87     |
| Running Reverse KL  | 5.17     |
| Running Update Time | 52       |
----------------------------------
2025-02-18 09:44:12.337943 ׼ʱ-
| Itration            | 53       |
| Real Det Return     | 6.99     |
| Real Sto Return     | 14.8     |
| Reward Loss         | -56.6    |
| Running Env Steps   | 26500    |
| Running Forward KL  | 7.05     |
| Running Reverse KL  | 5.35     |
| Running Update Time | 53       |
----------------------------------
2025-02-18 09:44:22.960391 ׼ʱ-
| Itration            | 54       |
| Real Det Return     | 7.39     |
| Real Sto Return     | 17.6     |
| Reward Loss         | -55.2    |
| Running Env Steps   | 27000    |
| Running Forward KL  | 6.86     |
| Running Reverse KL  | 5.24     |
| Running Update Time | 54       |
----------------------------------
2025-02-18 09:44:33.993188 ׼ʱ-
| Itration            | 55       |
| Real Det Return     | 8.68     |
| Real Sto Return     | 16       |
| Reward Loss         | -56      |
| Running Env Steps   | 27500    |
| Running Forward KL  | 5.86     |
| Running Reverse KL  | 4.48     |
| Running Update Time | 55       |
----------------------------------
2025-02-18 09:44:44.693715 ׼ʱ-
| Itration            | 56       |
| Real Det Return     | 19.2     |
| Real Sto Return     | 16.4     |
| Reward Loss         | -51.3    |
| Running Env Steps   | 28000    |
| Running Forward KL  | 6.05     |
| Running Reverse KL  | 4.67     |
| Running Update Time | 56       |
----------------------------------
2025-02-18 09:44:55.363060 ׼ʱ-
| Itration            | 57       |
| Real Det Return     | 25.4     |
| Real Sto Return     | 17.4     |
| Reward Loss         | -56.1    |
| Running Env Steps   | 28500    |
| Running Forward KL  | 6.42     |
| Running Reverse KL  | 4.9      |
| Running Update Time | 57       |
----------------------------------
2025-02-18 09:45:06.094840 ׼ʱ-
| Itration            | 58       |
| Real Det Return     | 45.3     |
| Real Sto Return     | 22.8     |
| Reward Loss         | -51.5    |
| Running Env Steps   | 29000    |
| Running Forward KL  | 5.78     |
| Running Reverse KL  | 5.07     |
| Running Update Time | 58       |
----------------------------------
2025-02-18 09:45:16.764154 ׼ʱ-
| Itration            | 59       |
| Real Det Return     | 44.4     |
| Real Sto Return     | 33.4     |
| Reward Loss         | -49.2    |
| Running Env Steps   | 29500    |
| Running Forward KL  | 5.51     |
| Running Reverse KL  | 5.01     |
| Running Update Time | 59       |
----------------------------------
2025-02-18 09:45:27.417851 ׼ʱ-
| Itration            | 60       |
| Real Det Return     | 49.6     |
| Real Sto Return     | 28       |
| Reward Loss         | -55.3    |
| Running Env Steps   | 30000    |
| Running Forward KL  | 5.98     |
| Running Reverse KL  | 4.53     |
| Running Update Time | 60       |
----------------------------------
2025-02-18 09:45:38.024682 ׼ʱ-
| Itration            | 61       |
| Real Det Return     | 40.9     |
| Real Sto Return     | 28.8     |
| Reward Loss         | -50.3    |
| Running Env Steps   | 30500    |
| Running Forward KL  | 5.67     |
| Running Reverse KL  | 4.87     |
| Running Update Time | 61       |
----------------------------------
2025-02-18 09:45:48.678334 ׼ʱ-
| Itration            | 62       |
| Real Det Return     | 59.2     |
| Real Sto Return     | 39       |
| Reward Loss         | -52.3    |
| Running Env Steps   | 31000    |
| Running Forward KL  | 5.16     |
| Running Reverse KL  | 4.45     |
| Running Update Time | 62       |
----------------------------------
2025-02-18 09:45:59.363301 ׼ʱ-
| Itration            | 63       |
| Real Det Return     | 62.6     |
| Real Sto Return     | 34.1     |
| Reward Loss         | -48.2    |
| Running Env Steps   | 31500    |
| Running Forward KL  | 5.27     |
| Running Reverse KL  | 4.5      |
| Running Update Time | 63       |
----------------------------------
2025-02-18 09:46:10.063820 ׼ʱ-
| Itration            | 64       |
| Real Det Return     | 70.7     |
| Real Sto Return     | 36.2     |
| Reward Loss         | -53      |
| Running Env Steps   | 32000    |
| Running Forward KL  | 5.01     |
| Running Reverse KL  | 4.39     |
| Running Update Time | 64       |
----------------------------------
2025-02-18 09:46:20.702698 ׼ʱ-
| Itration            | 65       |
| Real Det Return     | 46.8     |
| Real Sto Return     | 24.7     |
| Reward Loss         | -41.2    |
| Running Env Steps   | 32500    |
| Running Forward KL  | 4.97     |
| Running Reverse KL  | 4.85     |
| Running Update Time | 65       |
----------------------------------
2025-02-18 09:46:31.309526 ׼ʱ-
| Itration            | 66       |
| Real Det Return     | 70.9     |
| Real Sto Return     | 32       |
| Reward Loss         | -44.6    |
| Running Env Steps   | 33000    |
| Running Forward KL  | 4.78     |
| Running Reverse KL  | 4.45     |
| Running Update Time | 66       |
----------------------------------
2025-02-18 09:46:42.366981 ׼ʱ-
| Itration            | 67       |
| Real Det Return     | 61.8     |
| Real Sto Return     | 38.1     |
| Reward Loss         | -52.9    |
| Running Env Steps   | 33500    |
| Running Forward KL  | 5.51     |
| Running Reverse KL  | 4.24     |
| Running Update Time | 67       |
----------------------------------
2025-02-18 09:46:53.036302 ׼ʱ-
| Itration            | 68       |
| Real Det Return     | 64.5     |
| Real Sto Return     | 39.7     |
| Reward Loss         | -46.1    |
| Running Env Steps   | 34000    |
| Running Forward KL  | 5.4      |
| Running Reverse KL  | 5.37     |
| Running Update Time | 68       |
----------------------------------
2025-02-18 09:47:03.736857 ׼ʱ-
| Itration            | 69       |
| Real Det Return     | 72.5     |
| Real Sto Return     | 36.5     |
| Reward Loss         | -40.9    |
| Running Env Steps   | 34500    |
| Running Forward KL  | 4.65     |
| Running Reverse KL  | 4.11     |
| Running Update Time | 69       |
----------------------------------
2025-02-18 09:47:14.406158 ׼ʱ-
| Itration            | 70       |
| Real Det Return     | 74.1     |
| Real Sto Return     | 43.6     |
| Reward Loss         | -41.1    |
| Running Env Steps   | 35000    |
| Running Forward KL  | 3.84     |
| Running Reverse KL  | 4.14     |
| Running Update Time | 70       |
----------------------------------
2025-02-18 09:47:25.091091 ׼ʱ-
| Itration            | 71       |
| Real Det Return     | 68.9     |
| Real Sto Return     | 48.2     |
| Reward Loss         | -42.7    |
| Running Env Steps   | 35500    |
| Running Forward KL  | 4.36     |
| Running Reverse KL  | 4.36     |
| Running Update Time | 71       |
----------------------------------
2025-02-18 09:47:35.760403 ׼ʱ-
| Itration            | 72       |
| Real Det Return     | 56.8     |
| Real Sto Return     | 35.1     |
| Reward Loss         | -54.8    |
| Running Env Steps   | 36000    |
| Running Forward KL  | 4.91     |
| Running Reverse KL  | 4.05     |
| Running Update Time | 72       |
----------------------------------
2025-02-18 09:47:46.414503 ׼ʱ-
| Itration            | 73       |
| Real Det Return     | 69.9     |
| Real Sto Return     | 42.6     |
| Reward Loss         | -44.7    |
| Running Env Steps   | 36500    |
| Running Forward KL  | 4.84     |
| Running Reverse KL  | 4.77     |
| Running Update Time | 73       |
----------------------------------
2025-02-18 09:47:57.021320 ׼ʱ-
| Itration            | 74       |
| Real Det Return     | 72.1     |
| Real Sto Return     | 44.2     |
| Reward Loss         | -50.4    |
| Running Env Steps   | 37000    |
| Running Forward KL  | 4.98     |
| Running Reverse KL  | 4.53     |
| Running Update Time | 74       |
----------------------------------
2025-02-18 09:48:07.659383 ׼ʱ-
| Itration            | 75       |
| Real Det Return     | 80.2     |
| Real Sto Return     | 49.3     |
| Reward Loss         | -44.4    |
| Running Env Steps   | 37500    |
| Running Forward KL  | 4.28     |
| Running Reverse KL  | 4.29     |
| Running Update Time | 75       |
----------------------------------
2025-02-18 09:48:18.297461 ׼ʱ-
| Itration            | 76       |
| Real Det Return     | 91.8     |
| Real Sto Return     | 53       |
| Reward Loss         | -48.8    |
| Running Env Steps   | 38000    |
| Running Forward KL  | 4.76     |
| Running Reverse KL  | 4.36     |
| Running Update Time | 76       |
----------------------------------
2025-02-18 09:48:28.904275 ׼ʱ-
| Itration            | 77       |
| Real Det Return     | 89.8     |
| Real Sto Return     | 53.8     |
| Reward Loss         | -44.3    |
| Running Env Steps   | 38500    |
| Running Forward KL  | 4.61     |
| Running Reverse KL  | 4.15     |
| Running Update Time | 77       |
----------------------------------
2025-02-18 09:48:39.868663 ׼ʱ-
| Itration            | 78       |
| Real Det Return     | 87.5     |
| Real Sto Return     | 47.5     |
| Reward Loss         | -48.4    |
| Running Env Steps   | 39000    |
| Running Forward KL  | 4.26     |
| Running Reverse KL  | 3.74     |
| Running Update Time | 78       |
----------------------------------
2025-02-18 09:48:50.491109 ׼ʱ-
| Itration            | 79       |
| Real Det Return     | 74.8     |
| Real Sto Return     | 49.9     |
| Reward Loss         | -45.3    |
| Running Env Steps   | 39500    |
| Running Forward KL  | 4.87     |
| Running Reverse KL  | 4.31     |
| Running Update Time | 79       |
----------------------------------
2025-02-18 09:49:01.144798 ׼ʱ-
| Itration            | 80       |
| Real Det Return     | 92.7     |
| Real Sto Return     | 56.8     |
| Reward Loss         | -43.1    |
| Running Env Steps   | 40000    |
| Running Forward KL  | 4.33     |
| Running Reverse KL  | 3.73     |
| Running Update Time | 80       |
----------------------------------
2025-02-18 09:49:11.814118 ׼ʱ-
| Itration            | 81       |
| Real Det Return     | 85.8     |
| Real Sto Return     | 53.7     |
| Reward Loss         | -47.8    |
| Running Env Steps   | 40500    |
| Running Forward KL  | 3.89     |
| Running Reverse KL  | 3.94     |
| Running Update Time | 81       |
----------------------------------
2025-02-18 09:49:22.483430 ׼ʱ-
| Itration            | 82       |
| Real Det Return     | 85.7     |
| Real Sto Return     | 53.9     |
| Reward Loss         | -45.9    |
| Running Env Steps   | 41000    |
| Running Forward KL  | 4.59     |
| Running Reverse KL  | 4.44     |
| Running Update Time | 82       |
----------------------------------
2025-02-18 09:49:33.137120 ׼ʱ-
| Itration            | 83       |
| Real Det Return     | 94.5     |
| Real Sto Return     | 51.3     |
| Reward Loss         | -42.4    |
| Running Env Steps   | 41500    |
| Running Forward KL  | 4.45     |
| Running Reverse KL  | 4.42     |
| Running Update Time | 83       |
----------------------------------
2025-02-18 09:49:43.713094 ׼ʱ-
| Itration            | 84       |
| Real Det Return     | 85.4     |
| Real Sto Return     | 58.1     |
| Reward Loss         | -45.1    |
| Running Env Steps   | 42000    |
| Running Forward KL  | 4.01     |
| Running Reverse KL  | 4.37     |
| Running Update Time | 84       |
----------------------------------
2025-02-18 09:49:54.335508 ׼ʱ-
| Itration            | 85       |
| Real Det Return     | 104      |
| Real Sto Return     | 62.6     |
| Reward Loss         | -42.8    |
| Running Env Steps   | 42500    |
| Running Forward KL  | 4.01     |
| Running Reverse KL  | 4.67     |
| Running Update Time | 85       |
----------------------------------
2025-02-18 09:50:05.004821 ׼ʱ-
| Itration            | 86       |
| Real Det Return     | 92.7     |
| Real Sto Return     | 61.6     |
| Reward Loss         | -43.7    |
| Running Env Steps   | 43000    |
| Running Forward KL  | 4.4      |
| Running Reverse KL  | 4.45     |
| Running Update Time | 86       |
----------------------------------
2025-02-18 09:50:15.580430 ׼ʱ-
| Itration            | 87       |
| Real Det Return     | 96.7     |
| Real Sto Return     | 52.2     |
| Reward Loss         | -45.6    |
| Running Env Steps   | 43500    |
| Running Forward KL  | 4.1      |
| Running Reverse KL  | 4.41     |
| Running Update Time | 87       |
----------------------------------
2025-02-18 09:50:26.109150 ׼ʱ-
| Itration            | 88       |
| Real Det Return     | 107      |
| Real Sto Return     | 63.3     |
| Reward Loss         | -43.4    |
| Running Env Steps   | 44000    |
| Running Forward KL  | 4.36     |
| Running Reverse KL  | 4.03     |
| Running Update Time | 88       |
----------------------------------
2025-02-18 09:50:36.778462 ׼ʱ-
| Itration            | 89       |
| Real Det Return     | 101      |
| Real Sto Return     | 69.9     |
| Reward Loss         | -45.1    |
| Running Env Steps   | 44500    |
| Running Forward KL  | 4.45     |
| Running Reverse KL  | 4.31     |
| Running Update Time | 89       |
----------------------------------
2025-02-18 09:50:47.814949 ׼ʱ-
| Itration            | 90       |
| Real Det Return     | 108      |
| Real Sto Return     | 67.3     |
| Reward Loss         | -45.3    |
| Running Env Steps   | 45000    |
| Running Forward KL  | 4.31     |
| Running Reverse KL  | 4.44     |
| Running Update Time | 90       |
----------------------------------
2025-02-18 09:50:58.437409 ׼ʱ-
| Itration            | 91       |
| Real Det Return     | 124      |
| Real Sto Return     | 61.7     |
| Reward Loss         | -48.9    |
| Running Env Steps   | 45500    |
| Running Forward KL  | 4.33     |
| Running Reverse KL  | 3.92     |
| Running Update Time | 91       |
----------------------------------
2025-02-18 09:51:09.231690 ׼ʱ-
| Itration            | 92       |
| Real Det Return     | 112      |
| Real Sto Return     | 71.5     |
| Reward Loss         | -46.1    |
| Running Env Steps   | 46000    |
| Running Forward KL  | 3.71     |
| Running Reverse KL  | 3.9      |
| Running Update Time | 92       |
----------------------------------
2025-02-18 09:51:19.870143 ׼ʱ-
| Itration            | 93       |
| Real Det Return     | 117      |
| Real Sto Return     | 79.3     |
| Reward Loss         | -39.8    |
| Running Env Steps   | 46500    |
| Running Forward KL  | 3.44     |
| Running Reverse KL  | 4.44     |
| Running Update Time | 93       |
----------------------------------
2025-02-18 09:51:30.539445 ׼ʱ-
| Itration            | 94       |
| Real Det Return     | 122      |
| Real Sto Return     | 77.9     |
| Reward Loss         | -45.6    |
| Running Env Steps   | 47000    |
| Running Forward KL  | 4.15     |
| Running Reverse KL  | 4.71     |
| Running Update Time | 94       |
----------------------------------
2025-02-18 09:51:41.177525 ׼ʱ-
| Itration            | 95       |
| Real Det Return     | 96.9     |
| Real Sto Return     | 64.2     |
| Reward Loss         | -47.7    |
| Running Env Steps   | 47500    |
| Running Forward KL  | 3.66     |
| Running Reverse KL  | 4.53     |
| Running Update Time | 95       |
----------------------------------
2025-02-18 09:51:51.784350 ׼ʱ-
| Itration            | 96       |
| Real Det Return     | 120      |
| Real Sto Return     | 80.3     |
| Reward Loss         | -48.7    |
| Running Env Steps   | 48000    |
| Running Forward KL  | 4.04     |
| Running Reverse KL  | 4.36     |
| Running Update Time | 96       |
----------------------------------
2025-02-18 09:52:02.422410 ׼ʱ-
| Itration            | 97       |
| Real Det Return     | 130      |
| Real Sto Return     | 78.9     |
| Reward Loss         | -46.1    |
| Running Env Steps   | 48500    |
| Running Forward KL  | 3.87     |
| Running Reverse KL  | 3.48     |
| Running Update Time | 97       |
----------------------------------
2025-02-18 09:52:13.044868 ׼ʱ-
| Itration            | 98       |
| Real Det Return     | 129      |
| Real Sto Return     | 74.8     |
| Reward Loss         | -42.9    |
| Running Env Steps   | 49000    |
| Running Forward KL  | 3.92     |
| Running Reverse KL  | 4.62     |
| Running Update Time | 98       |
----------------------------------
2025-02-18 09:52:23.651685 ׼ʱ-
| Itration            | 99       |
| Real Det Return     | 124      |
| Real Sto Return     | 89       |
| Reward Loss         | -47      |
| Running Env Steps   | 49500    |
| Running Forward KL  | 3.96     |
| Running Reverse KL  | 4.55     |
| Running Update Time | 99       |
----------------------------------
2025-02-18 09:52:34.289764 ׼ʱ-
| Itration            | 100      |
| Real Det Return     | 122      |
| Real Sto Return     | 76.7     |
| Reward Loss         | -49      |
| Running Env Steps   | 50000    |
| Running Forward KL  | 4.26     |
| Running Reverse KL  | 4.46     |
| Running Update Time | 100      |
----------------------------------
2025-02-18 09:52:45.292973 ׼ʱ-
| Itration            | 101      |
| Real Det Return     | 133      |
| Real Sto Return     | 87.1     |
| Reward Loss         | -42.7    |
| Running Env Steps   | 50500    |
| Running Forward KL  | 3.79     |
| Running Reverse KL  | 3.98     |
| Running Update Time | 101      |
----------------------------------
2025-02-18 09:52:55.915411 ׼ʱ-
| Itration            | 102      |
| Real Det Return     | 146      |
| Real Sto Return     | 99.8     |
| Reward Loss         | -47.8    |
| Running Env Steps   | 51000    |
| Running Forward KL  | 4.03     |
| Running Reverse KL  | 4.27     |
| Running Update Time | 102      |
----------------------------------
2025-02-18 09:53:06.631595 ׼ʱ-
| Itration            | 103      |
| Real Det Return     | 135      |
| Real Sto Return     | 89.8     |
| Reward Loss         | -52.9    |
| Running Env Steps   | 51500    |
| Running Forward KL  | 4.15     |
| Running Reverse KL  | 4.38     |
| Running Update Time | 103      |
----------------------------------
2025-02-18 09:53:17.519596 ׼ʱ-
| Itration            | 104      |
| Real Det Return     | 146      |
| Real Sto Return     | 74.4     |
| Reward Loss         | -45.4    |
| Running Env Steps   | 52000    |
| Running Forward KL  | 3.98     |
| Running Reverse KL  | 4.34     |
| Running Update Time | 104      |
----------------------------------
2025-02-18 09:53:28.220655 ׼ʱ-
| Itration            | 105      |
| Real Det Return     | 146      |
| Real Sto Return     | 84.7     |
| Reward Loss         | -43.4    |
| Running Env Steps   | 52500    |
| Running Forward KL  | 4.07     |
| Running Reverse KL  | 4.55     |
| Running Update Time | 105      |
----------------------------------
2025-02-18 09:53:38.968075 ׼ʱ-
| Itration            | 106      |
| Real Det Return     | 155      |
| Real Sto Return     | 89.8     |
| Reward Loss         | -51.9    |
| Running Env Steps   | 53000    |
| Running Forward KL  | 3.88     |
| Running Reverse KL  | 4.35     |
| Running Update Time | 106      |
----------------------------------
2025-02-18 09:53:49.715482 ׼ʱ-
| Itration            | 107      |
| Real Det Return     | 135      |
| Real Sto Return     | 87.2     |
| Reward Loss         | -47.3    |
| Running Env Steps   | 53500    |
| Running Forward KL  | 4.24     |
| Running Reverse KL  | 4.72     |
| Running Update Time | 107      |
----------------------------------
2025-02-18 09:54:00.509763 ׼ʱ-
| Itration            | 108      |
| Real Det Return     | 143      |
| Real Sto Return     | 86.5     |
| Reward Loss         | -51.3    |
| Running Env Steps   | 54000    |
| Running Forward KL  | 3.53     |
| Running Reverse KL  | 4.17     |
| Running Update Time | 108      |
----------------------------------
2025-02-18 09:54:11.272802 ׼ʱ-
| Itration            | 109      |
| Real Det Return     | 138      |
| Real Sto Return     | 80.3     |
| Reward Loss         | -44.8    |
| Running Env Steps   | 54500    |
| Running Forward KL  | 4.25     |
| Running Reverse KL  | 4.56     |
| Running Update Time | 109      |
----------------------------------
2025-02-18 09:54:22.051472 ׼ʱ-
| Itration            | 110      |
| Real Det Return     | 149      |
| Real Sto Return     | 94.5     |
| Reward Loss         | -48.4    |
| Running Env Steps   | 55000    |
| Running Forward KL  | 4.21     |
| Running Reverse KL  | 4.82     |
| Running Update Time | 110      |
----------------------------------
2025-02-18 09:54:32.784431 ׼ʱ-
| Itration            | 111      |
| Real Det Return     | 141      |
| Real Sto Return     | 94.8     |
| Reward Loss         | -50.5    |
| Running Env Steps   | 55500    |
| Running Forward KL  | 4.23     |
| Running Reverse KL  | 4.85     |
| Running Update Time | 111      |
----------------------------------
2025-02-18 09:54:43.609956 ׼ʱ-
| Itration            | 112      |
| Real Det Return     | 148      |
| Real Sto Return     | 91.7     |
| Reward Loss         | -42.7    |
| Running Env Steps   | 56000    |
| Running Forward KL  | 3.47     |
| Running Reverse KL  | 4.61     |
| Running Update Time | 112      |
----------------------------------
2025-02-18 09:54:54.889463 ׼ʱ-
| Itration            | 113      |
| Real Det Return     | 167      |
| Real Sto Return     | 111      |
| Reward Loss         | -43.1    |
| Running Env Steps   | 56500    |
| Running Forward KL  | 3.34     |
| Running Reverse KL  | 4.11     |
| Running Update Time | 113      |
----------------------------------
2025-02-18 09:55:05.839980 ׼ʱ-
| Itration            | 114      |
| Real Det Return     | 150      |
| Real Sto Return     | 101      |
| Reward Loss         | -44.8    |
| Running Env Steps   | 57000    |
| Running Forward KL  | 3.62     |
| Running Reverse KL  | 4.54     |
| Running Update Time | 114      |
----------------------------------
2025-02-18 09:55:16.712368 ׼ʱ-
| Itration            | 115      |
| Real Det Return     | 154      |
| Real Sto Return     | 98.1     |
| Reward Loss         | -39.9    |
| Running Env Steps   | 57500    |
| Running Forward KL  | 3.83     |
| Running Reverse KL  | 4.97     |
| Running Update Time | 115      |
----------------------------------
2025-02-18 09:55:27.600386 ׼ʱ-
| Itration            | 116      |
| Real Det Return     | 154      |
| Real Sto Return     | 91.5     |
| Reward Loss         | -47.5    |
| Running Env Steps   | 58000    |
| Running Forward KL  | 3.48     |
| Running Reverse KL  | 4.32     |
| Running Update Time | 116      |
----------------------------------
2025-02-18 09:55:38.504017 ׼ʱ-
| Itration            | 117      |
| Real Det Return     | 155      |
| Real Sto Return     | 87.1     |
| Reward Loss         | -44.2    |
| Running Env Steps   | 58500    |
| Running Forward KL  | 4.21     |
| Running Reverse KL  | 4.51     |
| Running Update Time | 117      |
----------------------------------
2025-02-18 09:55:49.376395 ׼ʱ-
| Itration            | 118      |
| Real Det Return     | 148      |
| Real Sto Return     | 98.8     |
| Reward Loss         | -43.1    |
| Running Env Steps   | 59000    |
| Running Forward KL  | 3.15     |
| Running Reverse KL  | 3.99     |
| Running Update Time | 118      |
----------------------------------
2025-02-18 09:56:00.358144 ׼ʱ-
| Itration            | 119      |
| Real Det Return     | 147      |
| Real Sto Return     | 90.2     |
| Reward Loss         | -42.8    |
| Running Env Steps   | 59500    |
| Running Forward KL  | 3.66     |
| Running Reverse KL  | 4.64     |
| Running Update Time | 119      |
----------------------------------
2025-02-18 09:56:11.277384 ׼ʱ-
| Itration            | 120      |
| Real Det Return     | 157      |
| Real Sto Return     | 97.8     |
| Reward Loss         | -43.2    |
| Running Env Steps   | 60000    |
| Running Forward KL  | 3.62     |
| Running Reverse KL  | 5.38     |
| Running Update Time | 120      |
----------------------------------
2025-02-18 09:56:22.181025 ׼ʱ-
| Itration            | 121      |
| Real Det Return     | 161      |
| Real Sto Return     | 103      |
| Reward Loss         | -53.6    |
| Running Env Steps   | 60500    |
| Running Forward KL  | 3.6      |
| Running Reverse KL  | 4.46     |
| Running Update Time | 121      |
----------------------------------
2025-02-18 09:56:33.069022 ׼ʱ-
| Itration            | 122      |
| Real Det Return     | 153      |
| Real Sto Return     | 107      |
| Reward Loss         | -43.1    |
| Running Env Steps   | 61000    |
| Running Forward KL  | 3.53     |
| Running Reverse KL  | 4.66     |
| Running Update Time | 122      |
----------------------------------
2025-02-18 09:56:44.019509 ׼ʱ-
| Itration            | 123      |
| Real Det Return     | 155      |
| Real Sto Return     | 113      |
| Reward Loss         | -48.5    |
| Running Env Steps   | 61500    |
| Running Forward KL  | 3.56     |
| Running Reverse KL  | 4.58     |
| Running Update Time | 123      |
----------------------------------
2025-02-18 09:56:55.360543 ׼ʱ-
| Itration            | 124      |
| Real Det Return     | 150      |
| Real Sto Return     | 85.2     |
| Reward Loss         | -53.1    |
| Running Env Steps   | 62000    |
| Running Forward KL  | 3.09     |
| Running Reverse KL  | 4.64     |
| Running Update Time | 124      |
----------------------------------
2025-02-18 09:57:06.375298 ׼ʱ-
| Itration            | 125      |
| Real Det Return     | 160      |
| Real Sto Return     | 102      |
| Reward Loss         | -48.4    |
| Running Env Steps   | 62500    |
| Running Forward KL  | 3.04     |
| Running Reverse KL  | 4.03     |
| Running Update Time | 125      |
----------------------------------
2025-02-18 09:57:17.325801 ׼ʱ-
| Itration            | 126      |
| Real Det Return     | 162      |
| Real Sto Return     | 109      |
| Reward Loss         | -55.9    |
| Running Env Steps   | 63000    |
| Running Forward KL  | 3.83     |
| Running Reverse KL  | 4.7      |
| Running Update Time | 126      |
----------------------------------
2025-02-18 09:57:28.276286 ׼ʱ-
| Itration            | 127      |
| Real Det Return     | 153      |
| Real Sto Return     | 117      |
| Reward Loss         | -52.5    |
| Running Env Steps   | 63500    |
| Running Forward KL  | 3.38     |
| Running Reverse KL  | 4.6      |
| Running Update Time | 127      |
----------------------------------
2025-02-18 09:57:39.211159 ׼ʱ-
| Itration            | 128      |
| Real Det Return     | 154      |
| Real Sto Return     | 95.7     |
| Reward Loss         | -44.7    |
| Running Env Steps   | 64000    |
| Running Forward KL  | 3.44     |
| Running Reverse KL  | 4.57     |
| Running Update Time | 128      |
----------------------------------
2025-02-18 09:57:50.177284 ׼ʱ-
| Itration            | 129      |
| Real Det Return     | 163      |
| Real Sto Return     | 100      |
| Reward Loss         | -51.5    |
| Running Env Steps   | 64500    |
| Running Forward KL  | 4.07     |
| Running Reverse KL  | 4.9      |
| Running Update Time | 129      |
----------------------------------
2025-02-18 09:58:01.143364 ׼ʱ-
| Itration            | 130      |
| Real Det Return     | 171      |
| Real Sto Return     | 115      |
| Reward Loss         | -46.4    |
| Running Env Steps   | 65000    |
| Running Forward KL  | 3.01     |
| Running Reverse KL  | 4.83     |
| Running Update Time | 130      |
----------------------------------
2025-02-18 09:58:12.140748 ׼ʱ-
| Itration            | 131      |
| Real Det Return     | 171      |
| Real Sto Return     | 109      |
| Reward Loss         | -52.7    |
| Running Env Steps   | 65500    |
| Running Forward KL  | 3.14     |
| Running Reverse KL  | 4.11     |
| Running Update Time | 131      |
----------------------------------
2025-02-18 09:58:23.106848 ׼ʱ-
| Itration            | 132      |
| Real Det Return     | 166      |
| Real Sto Return     | 112      |
| Reward Loss         | -44.1    |
| Running Env Steps   | 66000    |
| Running Forward KL  | 4.17     |
| Running Reverse KL  | 4.94     |
| Running Update Time | 132      |
----------------------------------
2025-02-18 09:58:33.979267 ׼ʱ-
| Itration            | 133      |
| Real Det Return     | 174      |
| Real Sto Return     | 107      |
| Reward Loss         | -50.5    |
| Running Env Steps   | 66500    |
| Running Forward KL  | 3.81     |
| Running Reverse KL  | 5        |
| Running Update Time | 133      |
----------------------------------
2025-02-18 09:58:44.945366 ׼ʱ-
| Itration            | 134      |
| Real Det Return     | 165      |
| Real Sto Return     | 117      |
| Reward Loss         | -51.3    |
| Running Env Steps   | 67000    |
| Running Forward KL  | 3.12     |
| Running Reverse KL  | 4.47     |
| Running Update Time | 134      |
----------------------------------
2025-02-18 09:58:56.333235 ׼ʱ-
| Itration            | 135      |
| Real Det Return     | 174      |
| Real Sto Return     | 112      |
| Reward Loss         | -49.9    |
| Running Env Steps   | 67500    |
| Running Forward KL  | 3.9      |
| Running Reverse KL  | 4.93     |
| Running Update Time | 135      |
----------------------------------
2025-02-18 09:59:07.408720 ׼ʱ-
| Itration            | 136      |
| Real Det Return     | 171      |
| Real Sto Return     | 119      |
| Reward Loss         | -47      |
| Running Env Steps   | 68000    |
| Running Forward KL  | 3.47     |
| Running Reverse KL  | 4.53     |
| Running Update Time | 136      |
----------------------------------
2025-02-18 09:59:18.452940 ׼ʱ-
| Itration            | 137      |
| Real Det Return     | 171      |
| Real Sto Return     | 120      |
| Reward Loss         | -52.1    |
| Running Env Steps   | 68500    |
| Running Forward KL  | 3.51     |
| Running Reverse KL  | 4.49     |
| Running Update Time | 137      |
----------------------------------
2025-02-18 09:59:29.731456 ׼ʱ-
| Itration            | 138      |
| Real Det Return     | 168      |
| Real Sto Return     | 112      |
| Reward Loss         | -44.5    |
| Running Env Steps   | 69000    |
| Running Forward KL  | 3.52     |
| Running Reverse KL  | 4.98     |
| Running Update Time | 138      |
----------------------------------
2025-02-18 09:59:40.853820 ׼ʱ-
| Itration            | 139      |
| Real Det Return     | 172      |
| Real Sto Return     | 106      |
| Reward Loss         | -52.5    |
| Running Env Steps   | 69500    |
| Running Forward KL  | 3.08     |
| Running Reverse KL  | 4.33     |
| Running Update Time | 139      |
----------------------------------
2025-02-18 09:59:51.991757 ׼ʱ-
| Itration            | 140      |
| Real Det Return     | 166      |
| Real Sto Return     | 120      |
| Reward Loss         | -54      |
| Running Env Steps   | 70000    |
| Running Forward KL  | 3.43     |
| Running Reverse KL  | 4.52     |
| Running Update Time | 140      |
----------------------------------
2025-02-18 10:00:03.223436 ׼ʱ-
| Itration            | 141      |
| Real Det Return     | 168      |
| Real Sto Return     | 116      |
| Reward Loss         | -51.1    |
| Running Env Steps   | 70500    |
| Running Forward KL  | 4.21     |
| Running Reverse KL  | 5.2      |
| Running Update Time | 141      |
----------------------------------
2025-02-18 10:00:14.423868 ׼ʱ-
| Itration            | 142      |
| Real Det Return     | 176      |
| Real Sto Return     | 129      |
| Reward Loss         | -43.4    |
| Running Env Steps   | 71000    |
| Running Forward KL  | 3.89     |
| Running Reverse KL  | 5.26     |
| Running Update Time | 142      |
----------------------------------
2025-02-18 10:00:25.686787 ׼ʱ-
| Itration            | 143      |
| Real Det Return     | 164      |
| Real Sto Return     | 128      |
| Reward Loss         | -51      |
| Running Env Steps   | 71500    |
| Running Forward KL  | 3.6      |
| Running Reverse KL  | 4.71     |
| Running Update Time | 143      |
----------------------------------
2025-02-18 10:00:37.262131 ׼ʱ-
| Itration            | 144      |
| Real Det Return     | 182      |
| Real Sto Return     | 124      |
| Reward Loss         | -51.2    |
| Running Env Steps   | 72000    |
| Running Forward KL  | 3.76     |
| Running Reverse KL  | 4.43     |
| Running Update Time | 144      |
----------------------------------
2025-02-18 10:00:48.962421 ׼ʱ-
| Itration            | 145      |
| Real Det Return     | 184      |
| Real Sto Return     | 137      |
| Reward Loss         | -45.6    |
| Running Env Steps   | 72500    |
| Running Forward KL  | 3.83     |
| Running Reverse KL  | 4.81     |
| Running Update Time | 145      |
----------------------------------
2025-02-18 10:01:00.904712 ׼ʱ-
| Itration            | 146      |
| Real Det Return     | 184      |
| Real Sto Return     | 125      |
| Reward Loss         | -53.5    |
| Running Env Steps   | 73000    |
| Running Forward KL  | 3.42     |
| Running Reverse KL  | 4.53     |
| Running Update Time | 146      |
----------------------------------
2025-02-18 10:01:12.526919 ׼ʱ-
| Itration            | 147      |
| Real Det Return     | 170      |
| Real Sto Return     | 124      |
| Reward Loss         | -59.3    |
| Running Env Steps   | 73500    |
| Running Forward KL  | 3.72     |
| Running Reverse KL  | 4.65     |
| Running Update Time | 147      |
----------------------------------
2025-02-18 10:01:24.195981 ׼ʱ-
| Itration            | 148      |
| Real Det Return     | 178      |
| Real Sto Return     | 119      |
| Reward Loss         | -54      |
| Running Env Steps   | 74000    |
| Running Forward KL  | 3.81     |
| Running Reverse KL  | 5.28     |
| Running Update Time | 148      |
----------------------------------
2025-02-18 10:01:35.990036 ׼ʱ-
| Itration            | 149      |
| Real Det Return     | 194      |
| Real Sto Return     | 136      |
| Reward Loss         | -50.2    |
| Running Env Steps   | 74500    |
| Running Forward KL  | 3.46     |
| Running Reverse KL  | 5.08     |
| Running Update Time | 149      |
----------------------------------
2025-02-18 10:01:47.909319 ׼ʱ-
| Itration            | 150      |
| Real Det Return     | 185      |
| Real Sto Return     | 139      |
| Reward Loss         | -46.6    |
| Running Env Steps   | 75000    |
| Running Forward KL  | 4.12     |
| Running Reverse KL  | 4.56     |
| Running Update Time | 150      |
----------------------------------
2025-02-18 10:01:59.594013 ׼ʱ-
| Itration            | 151      |
| Real Det Return     | 170      |
| Real Sto Return     | 131      |
| Reward Loss         | -54.1    |
| Running Env Steps   | 75500    |
| Running Forward KL  | 3.45     |
| Running Reverse KL  | 4.67     |
| Running Update Time | 151      |
----------------------------------
2025-02-18 10:02:11.466159 ׼ʱ-
| Itration            | 152      |
| Real Det Return     | 189      |
| Real Sto Return     | 128      |
| Reward Loss         | -51.8    |
| Running Env Steps   | 76000    |
| Running Forward KL  | 3.27     |
| Running Reverse KL  | 5.15     |
| Running Update Time | 152      |
----------------------------------
2025-02-18 10:02:23.322686 ׼ʱ-
| Itration            | 153      |
| Real Det Return     | 179      |
| Real Sto Return     | 129      |
| Reward Loss         | -57.2    |
| Running Env Steps   | 76500    |
| Running Forward KL  | 4.16     |
| Running Reverse KL  | 5.11     |
| Running Update Time | 153      |
----------------------------------
2025-02-18 10:02:35.288561 ׼ʱ-
| Itration            | 154      |
| Real Det Return     | 181      |
| Real Sto Return     | 131      |
| Reward Loss         | -58.9    |
| Running Env Steps   | 77000    |
| Running Forward KL  | 3.35     |
| Running Reverse KL  | 5.15     |
| Running Update Time | 154      |
----------------------------------
2025-02-18 10:02:47.176347 ׼ʱ-
| Itration            | 155      |
| Real Det Return     | 175      |
| Real Sto Return     | 136      |
| Reward Loss         | -55.5    |
| Running Env Steps   | 77500    |
| Running Forward KL  | 3.69     |
| Running Reverse KL  | 4.62     |
| Running Update Time | 155      |
----------------------------------
2025-02-18 10:02:59.458079 ׼ʱ-
| Itration            | 156      |
| Real Det Return     | 178      |
| Real Sto Return     | 141      |
| Reward Loss         | -45.5    |
| Running Env Steps   | 78000    |
| Running Forward KL  | 3.27     |
| Running Reverse KL  | 4.88     |
| Running Update Time | 156      |
----------------------------------
2025-02-18 10:03:11.439601 ׼ʱ-
| Itration            | 157      |
| Real Det Return     | 173      |
| Real Sto Return     | 131      |
| Reward Loss         | -57.7    |
| Running Env Steps   | 78500    |
| Running Forward KL  | 3.58     |
| Running Reverse KL  | 4.78     |
| Running Update Time | 157      |
----------------------------------
2025-02-18 10:03:23.436718 ׼ʱ-
| Itration            | 158      |
| Real Det Return     | 179      |
| Real Sto Return     | 151      |
| Reward Loss         | -48.9    |
| Running Env Steps   | 79000    |
| Running Forward KL  | 2.88     |
| Running Reverse KL  | 4.88     |
| Running Update Time | 158      |
----------------------------------
2025-02-18 10:03:35.449457 ׼ʱ-
| Itration            | 159      |
| Real Det Return     | 187      |
| Real Sto Return     | 138      |
| Reward Loss         | -51.1    |
| Running Env Steps   | 79500    |
| Running Forward KL  | 3.54     |
| Running Reverse KL  | 5.25     |
| Running Update Time | 159      |
----------------------------------
2025-02-18 10:03:47.462196 ׼ʱ-
| Itration            | 160      |
| Real Det Return     | 199      |
| Real Sto Return     | 135      |
| Reward Loss         | -57.9    |
| Running Env Steps   | 80000    |
| Running Forward KL  | 3.92     |
| Running Reverse KL  | 4.95     |
| Running Update Time | 160      |
----------------------------------
2025-02-18 10:03:59.412464 ׼ʱ-
| Itration            | 161      |
| Real Det Return     | 188      |
| Real Sto Return     | 139      |
| Reward Loss         | -56.4    |
| Running Env Steps   | 80500    |
| Running Forward KL  | 3.88     |
| Running Reverse KL  | 4.89     |
| Running Update Time | 161      |
----------------------------------
2025-02-18 10:04:11.472053 ׼ʱ-
| Itration            | 162      |
| Real Det Return     | 197      |
| Real Sto Return     | 127      |
| Reward Loss         | -58.5    |
| Running Env Steps   | 81000    |
| Running Forward KL  | 3.56     |
| Running Reverse KL  | 4.72     |
| Running Update Time | 162      |
----------------------------------
2025-02-18 10:04:23.500156 ׼ʱ-
| Itration            | 163      |
| Real Det Return     | 218      |
| Real Sto Return     | 134      |
| Reward Loss         | -60.7    |
| Running Env Steps   | 81500    |
| Running Forward KL  | 3.7      |
| Running Reverse KL  | 5.15     |
| Running Update Time | 163      |
----------------------------------
2025-02-18 10:04:35.575356 ׼ʱ-
| Itration            | 164      |
| Real Det Return     | 191      |
| Real Sto Return     | 149      |
| Reward Loss         | -49.8    |
| Running Env Steps   | 82000    |
| Running Forward KL  | 3.42     |
| Running Reverse KL  | 4.51     |
| Running Update Time | 164      |
----------------------------------
2025-02-18 10:04:47.650604 ׼ʱ-
| Itration            | 165      |
| Real Det Return     | 175      |
| Real Sto Return     | 145      |
| Reward Loss         | -55.5    |
| Running Env Steps   | 82500    |
| Running Forward KL  | 3.96     |
| Running Reverse KL  | 5.11     |
| Running Update Time | 165      |
----------------------------------
2025-02-18 10:04:59.757080 ׼ʱ-
| Itration            | 166      |
| Real Det Return     | 181      |
| Real Sto Return     | 161      |
| Reward Loss         | -56.5    |
| Running Env Steps   | 83000    |
| Running Forward KL  | 3.72     |
| Running Reverse KL  | 5.03     |
| Running Update Time | 166      |
----------------------------------
2025-02-18 10:05:12.251764 ׼ʱ-
| Itration            | 167      |
| Real Det Return     | 179      |
| Real Sto Return     | 147      |
| Reward Loss         | -60.4    |
| Running Env Steps   | 83500    |
| Running Forward KL  | 3.36     |
| Running Reverse KL  | 4.46     |
| Running Update Time | 167      |
----------------------------------
2025-02-18 10:05:24.467578 ׼ʱ-
| Itration            | 168      |
| Real Det Return     | 197      |
| Real Sto Return     | 168      |
| Reward Loss         | -60.4    |
| Running Env Steps   | 84000    |
| Running Forward KL  | 3.33     |
| Running Reverse KL  | 4.56     |
| Running Update Time | 168      |
----------------------------------
2025-02-18 10:05:36.667770 ׼ʱ-
| Itration            | 169      |
| Real Det Return     | 202      |
| Real Sto Return     | 162      |
| Reward Loss         | -55.4    |
| Running Env Steps   | 84500    |
| Running Forward KL  | 3.9      |
| Running Reverse KL  | 5.09     |
| Running Update Time | 169      |
----------------------------------
2025-02-18 10:05:48.789858 ׼ʱ-
| Itration            | 170      |
| Real Det Return     | 211      |
| Real Sto Return     | 158      |
| Reward Loss         | -60.5    |
| Running Env Steps   | 85000    |
| Running Forward KL  | 3.03     |
| Running Reverse KL  | 4.71     |
| Running Update Time | 170      |
----------------------------------
2025-02-18 10:06:00.943189 ׼ʱ-
| Itration            | 171      |
| Real Det Return     | 178      |
| Real Sto Return     | 169      |
| Reward Loss         | -54.4    |
| Running Env Steps   | 85500    |
| Running Forward KL  | 3.47     |
| Running Reverse KL  | 4.67     |
| Running Update Time | 171      |
----------------------------------
2025-02-18 10:06:13.080907 ׼ʱ-
| Itration            | 172      |
| Real Det Return     | 166      |
| Real Sto Return     | 158      |
| Reward Loss         | -62.3    |
| Running Env Steps   | 86000    |
| Running Forward KL  | 3.78     |
| Running Reverse KL  | 4.97     |
| Running Update Time | 172      |
----------------------------------
2025-02-18 10:06:25.187570 ׼ʱ-
| Itration            | 173      |
| Real Det Return     | 172      |
| Real Sto Return     | 152      |
| Reward Loss         | -62.7    |
| Running Env Steps   | 86500    |
| Running Forward KL  | 3.74     |
| Running Reverse KL  | 4.88     |
| Running Update Time | 173      |
----------------------------------
2025-02-18 10:06:37.262794 ׼ʱ-
| Itration            | 174      |
| Real Det Return     | 190      |
| Real Sto Return     | 169      |
| Reward Loss         | -61.3    |
| Running Env Steps   | 87000    |
| Running Forward KL  | 3.58     |
| Running Reverse KL  | 4.71     |
| Running Update Time | 174      |
----------------------------------
2025-02-18 10:06:49.369396 ׼ʱ-
| Itration            | 175      |
| Real Det Return     | 201      |
| Real Sto Return     | 168      |
| Reward Loss         | -52.5    |
| Running Env Steps   | 87500    |
| Running Forward KL  | 2.96     |
| Running Reverse KL  | 4.62     |
| Running Update Time | 175      |
----------------------------------
2025-02-18 10:07:01.600841 ׼ʱ-
| Itration            | 176      |
| Real Det Return     | 234      |
| Real Sto Return     | 149      |
| Reward Loss         | -65.9    |
| Running Env Steps   | 88000    |
| Running Forward KL  | 3.41     |
| Running Reverse KL  | 5.15     |
| Running Update Time | 176      |
----------------------------------
2025-02-18 10:07:14.213307 ׼ʱ-
| Itration            | 177      |
| Real Det Return     | 223      |
| Real Sto Return     | 186      |
| Reward Loss         | -49.3    |
| Running Env Steps   | 88500    |
| Running Forward KL  | 3.6      |
| Running Reverse KL  | 4.5      |
| Running Update Time | 177      |
----------------------------------
2025-02-18 10:07:26.307642 ׼ʱ-
| Itration            | 178      |
| Real Det Return     | 209      |
| Real Sto Return     | 164      |
| Reward Loss         | -60.1    |
| Running Env Steps   | 89000    |
| Running Forward KL  | 3.25     |
| Running Reverse KL  | 4.42     |
| Running Update Time | 178      |
----------------------------------
2025-02-18 10:07:38.460982 ׼ʱ-
| Itration            | 179      |
| Real Det Return     | 195      |
| Real Sto Return     | 179      |
| Reward Loss         | -49.4    |
| Running Env Steps   | 89500    |
| Running Forward KL  | 3.07     |
| Running Reverse KL  | 4.78     |
| Running Update Time | 179      |
----------------------------------
2025-02-18 10:07:50.598681 ׼ʱ-
| Itration            | 180      |
| Real Det Return     | 205      |
| Real Sto Return     | 161      |
| Reward Loss         | -50.5    |
| Running Env Steps   | 90000    |
| Running Forward KL  | 3.47     |
| Running Reverse KL  | 4.86     |
| Running Update Time | 180      |
----------------------------------
2025-02-18 10:08:02.736400 ׼ʱ-
| Itration            | 181      |
| Real Det Return     | 190      |
| Real Sto Return     | 178      |
| Reward Loss         | -54.5    |
| Running Env Steps   | 90500    |
| Running Forward KL  | 2.66     |
| Running Reverse KL  | 4.26     |
| Running Update Time | 181      |
----------------------------------
2025-02-18 10:08:15.014666 ׼ʱ-
| Itration            | 182      |
| Real Det Return     | 205      |
| Real Sto Return     | 175      |
| Reward Loss         | -57.8    |
| Running Env Steps   | 91000    |
| Running Forward KL  | 2.92     |
| Running Reverse KL  | 4.83     |
| Running Update Time | 182      |
----------------------------------
2025-02-18 10:08:27.121170 ׼ʱ-
| Itration            | 183      |
| Real Det Return     | 195      |
| Real Sto Return     | 165      |
| Reward Loss         | -57.9    |
| Running Env Steps   | 91500    |
| Running Forward KL  | 3.02     |
| Running Reverse KL  | 4.62     |
| Running Update Time | 183      |
----------------------------------
2025-02-18 10:08:39.258866 ׼ʱ-
| Itration            | 184      |
| Real Det Return     | 185      |
| Real Sto Return     | 163      |
| Reward Loss         | -63.4    |
| Running Env Steps   | 92000    |
| Running Forward KL  | 3.7      |
| Running Reverse KL  | 4.99     |
| Running Update Time | 184      |
----------------------------------
2025-02-18 10:08:51.396984 ׼ʱ-
| Itration            | 185      |
| Real Det Return     | 232      |
| Real Sto Return     | 168      |
| Reward Loss         | -50.8    |
| Running Env Steps   | 92500    |
| Running Forward KL  | 3.14     |
| Running Reverse KL  | 4.72     |
| Running Update Time | 185      |
----------------------------------
2025-02-18 10:09:03.581547 ׼ʱ-
| Itration            | 186      |
| Real Det Return     | 215      |
| Real Sto Return     | 184      |
| Reward Loss         | -49.2    |
| Running Env Steps   | 93000    |
| Running Forward KL  | 2.64     |
| Running Reverse KL  | 5.15     |
| Running Update Time | 186      |
----------------------------------
2025-02-18 10:09:16.100144 ׼ʱ-
| Itration            | 187      |
| Real Det Return     | 197      |
| Real Sto Return     | 178      |
| Reward Loss         | -58.5    |
| Running Env Steps   | 93500    |
| Running Forward KL  | 3.33     |
| Running Reverse KL  | 5.01     |
| Running Update Time | 187      |
----------------------------------
2025-02-18 10:09:28.269100 ׼ʱ-
| Itration            | 188      |
| Real Det Return     | 205      |
| Real Sto Return     | 182      |
| Reward Loss         | -52.5    |
| Running Env Steps   | 94000    |
| Running Forward KL  | 2.94     |
| Running Reverse KL  | 4.62     |
| Running Update Time | 188      |
----------------------------------
2025-02-18 10:09:40.422392 ׼ʱ-
| Itration            | 189      |
| Real Det Return     | 180      |
| Real Sto Return     | 173      |
| Reward Loss         | -46.2    |
| Running Env Steps   | 94500    |
| Running Forward KL  | 3.14     |
| Running Reverse KL  | 4.54     |
| Running Update Time | 189      |
----------------------------------
2025-02-18 10:09:52.576274 ׼ʱ-
| Itration            | 190      |
| Real Det Return     | 183      |
| Real Sto Return     | 185      |
| Reward Loss         | -52.7    |
| Running Env Steps   | 95000    |
| Running Forward KL  | 2.96     |
| Running Reverse KL  | 4.61     |
| Running Update Time | 190      |
----------------------------------
2025-02-18 10:10:04.760839 ׼ʱ-
| Itration            | 191      |
| Real Det Return     | 206      |
| Real Sto Return     | 178      |
| Reward Loss         | -56.1    |
| Running Env Steps   | 95500    |
| Running Forward KL  | 3.19     |
| Running Reverse KL  | 4.66     |
| Running Update Time | 191      |
----------------------------------
2025-02-18 10:10:16.929798 ׼ʱ-
| Itration            | 192      |
| Real Det Return     | 207      |
| Real Sto Return     | 180      |
| Reward Loss         | -62      |
| Running Env Steps   | 96000    |
| Running Forward KL  | 3.2      |
| Running Reverse KL  | 4.74     |
| Running Update Time | 192      |
----------------------------------
2025-02-18 10:10:29.067498 ׼ʱ-
| Itration            | 193      |
| Real Det Return     | 228      |
| Real Sto Return     | 185      |
| Reward Loss         | -53.2    |
| Running Env Steps   | 96500    |
| Running Forward KL  | 3.31     |
| Running Reverse KL  | 4.54     |
| Running Update Time | 193      |
----------------------------------
2025-02-18 10:10:41.220838 ׼ʱ-
| Itration            | 194      |
| Real Det Return     | 219      |
| Real Sto Return     | 184      |
| Reward Loss         | -59.1    |
| Running Env Steps   | 97000    |
| Running Forward KL  | 2.61     |
| Running Reverse KL  | 4.36     |
| Running Update Time | 194      |
----------------------------------
2025-02-18 10:10:53.358537 ׼ʱ-
| Itration            | 195      |
| Real Det Return     | 218      |
| Real Sto Return     | 197      |
| Reward Loss         | -59.4    |
| Running Env Steps   | 97500    |
| Running Forward KL  | 3.17     |
| Running Reverse KL  | 4.95     |
| Running Update Time | 195      |
----------------------------------
2025-02-18 10:11:05.528278 ׼ʱ-
| Itration            | 196      |
| Real Det Return     | 231      |
| Real Sto Return     | 185      |
| Reward Loss         | -60.5    |
| Running Env Steps   | 98000    |
| Running Forward KL  | 3.35     |
| Running Reverse KL  | 4.97     |
| Running Update Time | 196      |
----------------------------------
2025-02-18 10:11:18.097783 ׼ʱ-
| Itration            | 197      |
| Real Det Return     | 204      |
| Real Sto Return     | 187      |
| Reward Loss         | -60.7    |
| Running Env Steps   | 98500    |
| Running Forward KL  | 3.25     |
| Running Reverse KL  | 4.66     |
| Running Update Time | 197      |
----------------------------------
2025-02-18 10:11:30.266722 ׼ʱ-
| Itration            | 198      |
| Real Det Return     | 223      |
| Real Sto Return     | 192      |
| Reward Loss         | -57.4    |
| Running Env Steps   | 99000    |
| Running Forward KL  | 2.83     |
| Running Reverse KL  | 4.73     |
| Running Update Time | 198      |
----------------------------------
2025-02-18 10:11:42.466916 ׼ʱ-
| Itration            | 199      |
| Real Det Return     | 234      |
| Real Sto Return     | 185      |
| Reward Loss         | -62.3    |
| Running Env Steps   | 99500    |
| Running Forward KL  | 2.98     |
| Running Reverse KL  | 4.39     |
| Running Update Time | 199      |
----------------------------------
2025-02-18 10:11:54.667109 ׼ʱ-
| Itration            | 200      |
| Real Det Return     | 211      |
| Real Sto Return     | 200      |
| Reward Loss         | -58.8    |
| Running Env Steps   | 100000   |
| Running Forward KL  | 3.57     |
| Running Reverse KL  | 4.61     |
| Running Update Time | 200      |
----------------------------------
2025-02-18 10:12:06.898546 ׼ʱ-
| Itration            | 201      |
| Real Det Return     | 187      |
| Real Sto Return     | 193      |
| Reward Loss         | -56      |
| Running Env Steps   | 100500   |
| Running Forward KL  | 2.75     |
| Running Reverse KL  | 5.09     |
| Running Update Time | 201      |
----------------------------------
2025-02-18 10:12:19.067507 ׼ʱ-
| Itration            | 202      |
| Real Det Return     | 184      |
| Real Sto Return     | 191      |
| Reward Loss         | -49.6    |
| Running Env Steps   | 101000   |
| Running Forward KL  | 3.01     |
| Running Reverse KL  | 4.51     |
| Running Update Time | 202      |
----------------------------------
2025-02-18 10:12:31.236448 ׼ʱ-
| Itration            | 203      |
| Real Det Return     | 252      |
| Real Sto Return     | 177      |
| Reward Loss         | -59.3    |
| Running Env Steps   | 101500   |
| Running Forward KL  | 2.93     |
| Running Reverse KL  | 4.66     |
| Running Update Time | 203      |
----------------------------------
2025-02-18 10:12:43.389788 ׼ʱ-
| Itration            | 204      |
| Real Det Return     | 210      |
| Real Sto Return     | 191      |
| Reward Loss         | -50.1    |
| Running Env Steps   | 102000   |
| Running Forward KL  | 2.83     |
| Running Reverse KL  | 4.84     |
| Running Update Time | 204      |
----------------------------------
2025-02-18 10:12:55.605594 ׼ʱ-
| Itration            | 205      |
| Real Det Return     | 268      |
| Real Sto Return     | 195      |
| Reward Loss         | -51.2    |
| Running Env Steps   | 102500   |
| Running Forward KL  | 3.01     |
| Running Reverse KL  | 5.02     |
| Running Update Time | 205      |
----------------------------------
2025-02-18 10:13:07.792540 ׼ʱ-
| Itration            | 206      |
| Real Det Return     | 185      |
| Real Sto Return     | 191      |
| Reward Loss         | -69.7    |
| Running Env Steps   | 103000   |
| Running Forward KL  | 3.09     |
| Running Reverse KL  | 4.83     |
| Running Update Time | 206      |
----------------------------------
2025-02-18 10:13:20.352005 ׼ʱ-
| Itration            | 207      |
| Real Det Return     | 232      |
| Real Sto Return     | 209      |
| Reward Loss         | -55.8    |
| Running Env Steps   | 103500   |
| Running Forward KL  | 2.66     |
| Running Reverse KL  | 4.75     |
| Running Update Time | 207      |
----------------------------------
2025-02-18 10:13:32.583611 ׼ʱ-
| Itration            | 208      |
| Real Det Return     | 195      |
| Real Sto Return     | 205      |
| Reward Loss         | -49.4    |
| Running Env Steps   | 104000   |
| Running Forward KL  | 2.82     |
| Running Reverse KL  | 4.6      |
| Running Update Time | 208      |
----------------------------------
2025-02-18 10:13:44.768183 ׼ʱ-
| Itration            | 209      |
| Real Det Return     | 204      |
| Real Sto Return     | 199      |
| Reward Loss         | -54.6    |
| Running Env Steps   | 104500   |
| Running Forward KL  | 3.24     |
| Running Reverse KL  | 4.71     |
| Running Update Time | 209      |
----------------------------------
2025-02-18 10:13:56.952766 ׼ʱ-
| Itration            | 210      |
| Real Det Return     | 230      |
| Real Sto Return     | 213      |
| Reward Loss         | -58.7    |
| Running Env Steps   | 105000   |
| Running Forward KL  | 2.72     |
| Running Reverse KL  | 4.38     |
| Running Update Time | 210      |
----------------------------------
2025-02-18 10:14:09.152950 ׼ʱ-
| Itration            | 211      |
| Real Det Return     | 190      |
| Real Sto Return     | 193      |
| Reward Loss         | -59.8    |
| Running Env Steps   | 105500   |
| Running Forward KL  | 2.68     |
| Running Reverse KL  | 4.18     |
| Running Update Time | 211      |
----------------------------------
2025-02-18 10:14:21.353153 ׼ʱ-
| Itration            | 212      |
| Real Det Return     | 246      |
| Real Sto Return     | 210      |
| Reward Loss         | -54.4    |
| Running Env Steps   | 106000   |
| Running Forward KL  | 3.12     |
| Running Reverse KL  | 4.32     |
| Running Update Time | 212      |
----------------------------------
2025-02-18 10:14:33.537716 ׼ʱ-
| Itration            | 213      |
| Real Det Return     | 240      |
| Real Sto Return     | 207      |
| Reward Loss         | -59.4    |
| Running Env Steps   | 106500   |
| Running Forward KL  | 3.49     |
| Running Reverse KL  | 4.66     |
| Running Update Time | 213      |
----------------------------------
2025-02-18 10:14:45.706667 ׼ʱ-
| Itration            | 214      |
| Real Det Return     | 240      |
| Real Sto Return     | 202      |
| Reward Loss         | -59.2    |
| Running Env Steps   | 107000   |
| Running Forward KL  | 2.51     |
| Running Reverse KL  | 4.83     |
| Running Update Time | 214      |
----------------------------------
2025-02-18 10:14:57.875619 ׼ʱ-
| Itration            | 215      |
| Real Det Return     | 167      |
| Real Sto Return     | 202      |
| Reward Loss         | -63.4    |
| Running Env Steps   | 107500   |
| Running Forward KL  | 2.66     |
| Running Reverse KL  | 4.86     |
| Running Update Time | 215      |
----------------------------------
2025-02-18 10:15:10.091443 ׼ʱ-
| Itration            | 216      |
| Real Det Return     | 195      |
| Real Sto Return     | 202      |
| Reward Loss         | -62.4    |
| Running Env Steps   | 108000   |
| Running Forward KL  | 2.71     |
| Running Reverse KL  | 4.53     |
| Running Update Time | 216      |
----------------------------------
2025-02-18 10:15:22.698976 ׼ʱ-
| Itration            | 217      |
| Real Det Return     | 218      |
| Real Sto Return     | 202      |
| Reward Loss         | -54.5    |
| Running Env Steps   | 108500   |
| Running Forward KL  | 2.88     |
| Running Reverse KL  | 4.99     |
| Running Update Time | 217      |
----------------------------------
2025-02-18 10:15:34.899170 ׼ʱ-
| Itration            | 218      |
| Real Det Return     | 224      |
| Real Sto Return     | 203      |
| Reward Loss         | -59      |
| Running Env Steps   | 109000   |
| Running Forward KL  | 3.12     |
| Running Reverse KL  | 4.69     |
| Running Update Time | 218      |
----------------------------------
2025-02-18 10:15:47.114996 ׼ʱ-
| Itration            | 219      |
| Real Det Return     | 226      |
| Real Sto Return     | 221      |
| Reward Loss         | -54.1    |
| Running Env Steps   | 109500   |
| Running Forward KL  | 2.27     |
| Running Reverse KL  | 4.87     |
| Running Update Time | 219      |
----------------------------------
2025-02-18 10:15:59.346425 ׼ʱ-
| Itration            | 220      |
| Real Det Return     | 217      |
| Real Sto Return     | 212      |
| Reward Loss         | -60.5    |
| Running Env Steps   | 110000   |
| Running Forward KL  | 2.11     |
| Running Reverse KL  | 4.54     |
| Running Update Time | 220      |
----------------------------------
2025-02-18 10:16:11.577867 ׼ʱ-
| Itration            | 221      |
| Real Det Return     | 220      |
| Real Sto Return     | 206      |
| Reward Loss         | -51.9    |
| Running Env Steps   | 110500   |
| Running Forward KL  | 2.37     |
| Running Reverse KL  | 4.54     |
| Running Update Time | 221      |
----------------------------------
2025-02-18 10:16:23.762439 ׼ʱ-
| Itration            | 222      |
| Real Det Return     | 228      |
| Real Sto Return     | 218      |
| Reward Loss         | -56.8    |
| Running Env Steps   | 111000   |
| Running Forward KL  | 2.49     |
| Running Reverse KL  | 4.68     |
| Running Update Time | 222      |
----------------------------------
2025-02-18 10:16:36.087593 ׼ʱ-
| Itration            | 223      |
| Real Det Return     | 188      |
| Real Sto Return     | 211      |
| Reward Loss         | -61.7    |
| Running Env Steps   | 111500   |
| Running Forward KL  | 2.25     |
| Running Reverse KL  | 4.39     |
| Running Update Time | 223      |
----------------------------------
2025-02-18 10:16:48.240937 ׼ʱ-
| Itration            | 224      |
| Real Det Return     | 218      |
| Real Sto Return     | 211      |
| Reward Loss         | -59.2    |
| Running Env Steps   | 112000   |
| Running Forward KL  | 2.6      |
| Running Reverse KL  | 4.22     |
| Running Update Time | 224      |
----------------------------------
2025-02-18 10:17:00.425496 ׼ʱ-
| Itration            | 225      |
| Real Det Return     | 232      |
| Real Sto Return     | 226      |
| Reward Loss         | -61.5    |
| Running Env Steps   | 112500   |
| Running Forward KL  | 3.65     |
| Running Reverse KL  | 5.12     |
| Running Update Time | 225      |
----------------------------------
2025-02-18 10:17:12.610069 ׼ʱ-
| Itration            | 226      |
| Real Det Return     | 282      |
| Real Sto Return     | 229      |
| Reward Loss         | -49.6    |
| Running Env Steps   | 113000   |
| Running Forward KL  | 2        |
| Running Reverse KL  | 4.35     |
| Running Update Time | 226      |
----------------------------------
2025-02-18 10:17:25.208253 ׼ʱ-
| Itration            | 227      |
| Real Det Return     | 246      |
| Real Sto Return     | 234      |
| Reward Loss         | -53.8    |
| Running Env Steps   | 113500   |
| Running Forward KL  | 2.36     |
| Running Reverse KL  | 4.69     |
| Running Update Time | 227      |
----------------------------------
2025-02-18 10:17:37.486553 ׼ʱ-
| Itration            | 228      |
| Real Det Return     | 237      |
| Real Sto Return     | 227      |
| Reward Loss         | -58.2    |
| Running Env Steps   | 114000   |
| Running Forward KL  | 2.78     |
| Running Reverse KL  | 4.88     |
| Running Update Time | 228      |
----------------------------------
2025-02-18 10:17:49.702368 ׼ʱ-
| Itration            | 229      |
| Real Det Return     | 254      |
| Real Sto Return     | 223      |
| Reward Loss         | -59.5    |
| Running Env Steps   | 114500   |
| Running Forward KL  | 2.89     |
| Running Reverse KL  | 4.69     |
| Running Update Time | 229      |
----------------------------------
2025-02-18 10:18:01.918192 ׼ʱ-
| Itration            | 230      |
| Real Det Return     | 286      |
| Real Sto Return     | 210      |
| Reward Loss         | -56.1    |
| Running Env Steps   | 115000   |
| Running Forward KL  | 2.05     |
| Running Reverse KL  | 4.73     |
| Running Update Time | 230      |
----------------------------------
2025-02-18 10:18:14.165250 ׼ʱ-
| Itration            | 231      |
| Real Det Return     | 224      |
| Real Sto Return     | 214      |
| Reward Loss         | -59.9    |
| Running Env Steps   | 115500   |
| Running Forward KL  | 2.93     |
| Running Reverse KL  | 4.77     |
| Running Update Time | 231      |
----------------------------------
2025-02-18 10:18:26.381065 ׼ʱ-
| Itration            | 232      |
| Real Det Return     | 258      |
| Real Sto Return     | 235      |
| Reward Loss         | -63      |
| Running Env Steps   | 116000   |
| Running Forward KL  | 2.24     |
| Running Reverse KL  | 5.01     |
| Running Update Time | 232      |
----------------------------------
2025-02-18 10:18:38.659365 ׼ʱ-
| Itration            | 233      |
| Real Det Return     | 241      |
| Real Sto Return     | 223      |
| Reward Loss         | -52.2    |
| Running Env Steps   | 116500   |
| Running Forward KL  | 1.7      |
| Running Reverse KL  | 4.16     |
| Running Update Time | 233      |
----------------------------------
2025-02-18 10:18:50.812686 ׼ʱ-
| Itration            | 234      |
| Real Det Return     | 268      |
| Real Sto Return     | 232      |
| Reward Loss         | -61.2    |
| Running Env Steps   | 117000   |
| Running Forward KL  | 2.16     |
| Running Reverse KL  | 4.55     |
| Running Update Time | 234      |
----------------------------------
2025-02-18 10:19:02.981651 ׼ʱ-
| Itration            | 235      |
| Real Det Return     | 251      |
| Real Sto Return     | 223      |
| Reward Loss         | -60.2    |
| Running Env Steps   | 117500   |
| Running Forward KL  | 1.87     |
| Running Reverse KL  | 4.77     |
| Running Update Time | 235      |
----------------------------------
2025-02-18 10:19:15.338045 ׼ʱ-
| Itration            | 236      |
| Real Det Return     | 272      |
| Real Sto Return     | 218      |
| Reward Loss         | -55.5    |
| Running Env Steps   | 118000   |
| Running Forward KL  | 2.44     |
| Running Reverse KL  | 4.25     |
| Running Update Time | 236      |
----------------------------------
2025-02-18 10:19:27.863616 ׼ʱ-
| Itration            | 237      |
| Real Det Return     | 246      |
| Real Sto Return     | 221      |
| Reward Loss         | -64.6    |
| Running Env Steps   | 118500   |
| Running Forward KL  | 2.83     |
| Running Reverse KL  | 4.28     |
| Running Update Time | 237      |
----------------------------------
2025-02-18 10:19:40.064191 ׼ʱ-
| Itration            | 238      |
| Real Det Return     | 234      |
| Real Sto Return     | 224      |
| Reward Loss         | -64.1    |
| Running Env Steps   | 119000   |
| Running Forward KL  | 2.24     |
| Running Reverse KL  | 5.06     |
| Running Update Time | 238      |
----------------------------------
2025-02-18 10:19:52.264394 ׼ʱ-
| Itration            | 239      |
| Real Det Return     | 242      |
| Real Sto Return     | 237      |
| Reward Loss         | -48.3    |
| Running Env Steps   | 119500   |
| Running Forward KL  | 3.06     |
| Running Reverse KL  | 4.86     |
| Running Update Time | 239      |
----------------------------------
2025-02-18 10:20:04.511460 ׼ʱ-
| Itration            | 240      |
| Real Det Return     | 207      |
| Real Sto Return     | 219      |
| Reward Loss         | -67.7    |
| Running Env Steps   | 120000   |
| Running Forward KL  | 2.68     |
| Running Reverse KL  | 4.45     |
| Running Update Time | 240      |
----------------------------------
2025-02-18 10:20:16.805363 ׼ʱ-
| Itration            | 241      |
| Real Det Return     | 263      |
| Real Sto Return     | 227      |
| Reward Loss         | -54.4    |
| Running Env Steps   | 120500   |
| Running Forward KL  | 2.35     |
| Running Reverse KL  | 4.65     |
| Running Update Time | 241      |
----------------------------------
2025-02-18 10:20:29.021196 ׼ʱ-
| Itration            | 242      |
| Real Det Return     | 239      |
| Real Sto Return     | 214      |
| Reward Loss         | -63.6    |
| Running Env Steps   | 121000   |
| Running Forward KL  | 2.5      |
| Running Reverse KL  | 4.26     |
| Running Update Time | 242      |
----------------------------------
2025-02-18 10:20:41.252615 ׼ʱ-
| Itration            | 243      |
| Real Det Return     | 247      |
| Real Sto Return     | 217      |
| Reward Loss         | -69.1    |
| Running Env Steps   | 121500   |
| Running Forward KL  | 2.94     |
| Running Reverse KL  | 4.62     |
| Running Update Time | 243      |
----------------------------------
2025-02-18 10:20:53.421584 ׼ʱ-
| Itration            | 244      |
| Real Det Return     | 246      |
| Real Sto Return     | 231      |
| Reward Loss         | -63.2    |
| Running Env Steps   | 122000   |
| Running Forward KL  | 2.59     |
| Running Reverse KL  | 4.6      |
| Running Update Time | 244      |
----------------------------------
2025-02-18 10:21:05.607327 ׼ʱ-
| Itration            | 245      |
| Real Det Return     | 270      |
| Real Sto Return     | 238      |
| Reward Loss         | -57.1    |
| Running Env Steps   | 122500   |
| Running Forward KL  | 2.4      |
| Running Reverse KL  | 4.79     |
| Running Update Time | 245      |
----------------------------------
2025-02-18 10:21:17.791882 ׼ʱ-
| Itration            | 246      |
| Real Det Return     | 221      |
| Real Sto Return     | 230      |
| Reward Loss         | -59.9    |
| Running Env Steps   | 123000   |
| Running Forward KL  | 2.23     |
| Running Reverse KL  | 4.62     |
| Running Update Time | 246      |
----------------------------------
2025-02-18 10:21:30.351735 ׼ʱ-
| Itration            | 247      |
| Real Det Return     | 286      |
| Real Sto Return     | 234      |
| Reward Loss         | -55.9    |
| Running Env Steps   | 123500   |
| Running Forward KL  | 1.85     |
| Running Reverse KL  | 4.81     |
| Running Update Time | 247      |
----------------------------------
2025-02-18 10:21:42.523852 ׼ʱ-
| Itration            | 248      |
| Real Det Return     | 274      |
| Real Sto Return     | 231      |
| Reward Loss         | -51.9    |
| Running Env Steps   | 124000   |
| Running Forward KL  | 2.55     |
| Running Reverse KL  | 4.49     |
| Running Update Time | 248      |
----------------------------------
2025-02-18 10:21:54.724045 ׼ʱ-
| Itration            | 249      |
| Real Det Return     | 285      |
| Real Sto Return     | 226      |
| Reward Loss         | -54.6    |
| Running Env Steps   | 124500   |
| Running Forward KL  | 2.41     |
| Running Reverse KL  | 4.41     |
| Running Update Time | 249      |
----------------------------------
2025-02-18 10:22:06.955502 ׼ʱ-
| Itration            | 250      |
| Real Det Return     | 257      |
| Real Sto Return     | 237      |
| Reward Loss         | -54.4    |
| Running Env Steps   | 125000   |
| Running Forward KL  | 2.47     |
| Running Reverse KL  | 4.2      |
| Running Update Time | 250      |
----------------------------------
2025-02-18 10:22:19.171306 ׼ʱ-
| Itration            | 251      |
| Real Det Return     | 249      |
| Real Sto Return     | 246      |
| Reward Loss         | -58      |
| Running Env Steps   | 125500   |
| Running Forward KL  | 1.98     |
| Running Reverse KL  | 4.17     |
| Running Update Time | 251      |
----------------------------------
2025-02-18 10:22:31.355845 ׼ʱ-
| Itration            | 252      |
| Real Det Return     | 273      |
| Real Sto Return     | 245      |
| Reward Loss         | -61.1    |
| Running Env Steps   | 126000   |
| Running Forward KL  | 2.49     |
| Running Reverse KL  | 4.49     |
| Running Update Time | 252      |
----------------------------------
2025-02-18 10:22:43.602921 ׼ʱ-
| Itration            | 253      |
| Real Det Return     | 254      |
| Real Sto Return     | 231      |
| Reward Loss         | -60.5    |
| Running Env Steps   | 126500   |
| Running Forward KL  | 2.32     |
| Running Reverse KL  | 4.47     |
| Running Update Time | 253      |
----------------------------------
2025-02-18 10:22:55.787499 ׼ʱ-
| Itration            | 254      |
| Real Det Return     | 265      |
| Real Sto Return     | 230      |
| Reward Loss         | -61.4    |
| Running Env Steps   | 127000   |
| Running Forward KL  | 2.66     |
| Running Reverse KL  | 4.8      |
| Running Update Time | 254      |
----------------------------------
2025-02-18 10:23:08.034557 ׼ʱ-
| Itration            | 255      |
| Real Det Return     | 199      |
| Real Sto Return     | 216      |
| Reward Loss         | -72.5    |
| Running Env Steps   | 127500   |
| Running Forward KL  | 3.62     |
| Running Reverse KL  | 5.57     |
| Running Update Time | 255      |
----------------------------------
2025-02-18 10:23:20.406585 ׼ʱ-
| Itration            | 256      |
| Real Det Return     | 267      |
| Real Sto Return     | 239      |
| Reward Loss         | -64.6    |
| Running Env Steps   | 128000   |
| Running Forward KL  | 2.45     |
| Running Reverse KL  | 4.76     |
| Running Update Time | 256      |
----------------------------------
2025-02-18 10:23:33.108457 ׼ʱ-
| Itration            | 257      |
| Real Det Return     | 264      |
| Real Sto Return     | 238      |
| Reward Loss         | -63.5    |
| Running Env Steps   | 128500   |
| Running Forward KL  | 2.21     |
| Running Reverse KL  | 4.46     |
| Running Update Time | 257      |
----------------------------------
2025-02-18 10:23:45.355506 ׼ʱ-
| Itration            | 258      |
| Real Det Return     | 281      |
| Real Sto Return     | 244      |
| Reward Loss         | -56.7    |
| Running Env Steps   | 129000   |
| Running Forward KL  | 2.2      |
| Running Reverse KL  | 4.69     |
| Running Update Time | 258      |
----------------------------------
2025-02-18 10:23:57.586941 ׼ʱ-
| Itration            | 259      |
| Real Det Return     | 265      |
| Real Sto Return     | 239      |
| Reward Loss         | -53.7    |
| Running Env Steps   | 129500   |
| Running Forward KL  | 2.07     |
| Running Reverse KL  | 4.56     |
| Running Update Time | 259      |
----------------------------------
2025-02-18 10:24:09.743818 ׼ʱ-
| Itration            | 260      |
| Real Det Return     | 289      |
| Real Sto Return     | 261      |
| Reward Loss         | -51.2    |
| Running Env Steps   | 130000   |
| Running Forward KL  | 2.31     |
| Running Reverse KL  | 4.32     |
| Running Update Time | 260      |
----------------------------------
2025-02-18 10:24:21.975242 ׼ʱ-
| Itration            | 261      |
| Real Det Return     | 263      |
| Real Sto Return     | 233      |
| Reward Loss         | -59.7    |
| Running Env Steps   | 130500   |
| Running Forward KL  | 2.28     |
| Running Reverse KL  | 4.97     |
| Running Update Time | 261      |
----------------------------------
2025-02-18 10:24:34.284783 ׼ʱ-
| Itration            | 262      |
| Real Det Return     | 285      |
| Real Sto Return     | 247      |
| Reward Loss         | -57      |
| Running Env Steps   | 131000   |
| Running Forward KL  | 1.76     |
| Running Reverse KL  | 4.29     |
| Running Update Time | 262      |
----------------------------------
2025-02-18 10:24:46.484990 ׼ʱ-
| Itration            | 263      |
| Real Det Return     | 265      |
| Real Sto Return     | 251      |
| Reward Loss         | -53.4    |
| Running Env Steps   | 131500   |
| Running Forward KL  | 1.32     |
| Running Reverse KL  | 4.31     |
| Running Update Time | 263      |
----------------------------------
2025-02-18 10:24:58.669550 ׼ʱ-
| Itration            | 264      |
| Real Det Return     | 276      |
| Real Sto Return     | 237      |
| Reward Loss         | -55.5    |
| Running Env Steps   | 132000   |
| Running Forward KL  | 2.72     |
| Running Reverse KL  | 4.88     |
| Running Update Time | 264      |
----------------------------------
2025-02-18 10:25:10.979110 ׼ʱ-
| Itration            | 265      |
| Real Det Return     | 273      |
| Real Sto Return     | 250      |
| Reward Loss         | -71.9    |
| Running Env Steps   | 132500   |
| Running Forward KL  | 3.06     |
| Running Reverse KL  | 4.75     |
| Running Update Time | 265      |
----------------------------------
2025-02-18 10:25:23.163682 ׼ʱ-
| Itration            | 266      |
| Real Det Return     | 268      |
| Real Sto Return     | 260      |
| Reward Loss         | -59.6    |
| Running Env Steps   | 133000   |
| Running Forward KL  | 2.59     |
| Running Reverse KL  | 4.57     |
| Running Update Time | 266      |
----------------------------------
2025-02-18 10:25:35.868380 ׼ʱ-
| Itration            | 267      |
| Real Det Return     | 249      |
| Real Sto Return     | 246      |
| Reward Loss         | -59.2    |
| Running Env Steps   | 133500   |
| Running Forward KL  | 2.37     |
| Running Reverse KL  | 5.01     |
| Running Update Time | 267      |
----------------------------------
2025-02-18 10:25:48.115437 ׼ʱ-
| Itration            | 268      |
| Real Det Return     | 265      |
| Real Sto Return     | 244      |
| Reward Loss         | -60.6    |
| Running Env Steps   | 134000   |
| Running Forward KL  | 2.06     |
| Running Reverse KL  | 4.04     |
| Running Update Time | 268      |
----------------------------------
2025-02-18 10:26:00.378117 ׼ʱ-
| Itration            | 269      |
| Real Det Return     | 291      |
| Real Sto Return     | 263      |
| Reward Loss         | -47.6    |
| Running Env Steps   | 134500   |
| Running Forward KL  | 2.15     |
| Running Reverse KL  | 3.85     |
| Running Update Time | 269      |
----------------------------------
2025-02-18 10:26:12.593932 ׼ʱ-
| Itration            | 270      |
| Real Det Return     | 287      |
| Real Sto Return     | 256      |
| Reward Loss         | -63.3    |
| Running Env Steps   | 135000   |
| Running Forward KL  | 2.57     |
| Running Reverse KL  | 4.7      |
| Running Update Time | 270      |
----------------------------------
2025-02-18 10:26:24.809748 ׼ʱ-
| Itration            | 271      |
| Real Det Return     | 299      |
| Real Sto Return     | 256      |
| Reward Loss         | -57.4    |
| Running Env Steps   | 135500   |
| Running Forward KL  | 2.06     |
| Running Reverse KL  | 4.4      |
| Running Update Time | 271      |
----------------------------------
2025-02-18 10:26:37.025545 ׼ʱ-
| Itration            | 272      |
| Real Det Return     | 305      |
| Real Sto Return     | 261      |
| Reward Loss         | -54.5    |
| Running Env Steps   | 136000   |
| Running Forward KL  | 1.7      |
| Running Reverse KL  | 4.41     |
| Running Update Time | 272      |
----------------------------------
2025-02-18 10:26:49.210135 ׼ʱ-
| Itration            | 273      |
| Real Det Return     | 245      |
| Real Sto Return     | 246      |
| Reward Loss         | -64.3    |
| Running Env Steps   | 136500   |
| Running Forward KL  | 2.19     |
| Running Reverse KL  | 4.81     |
| Running Update Time | 273      |
----------------------------------
2025-02-18 10:27:01.410325 ׼ʱ-
| Itration            | 274      |
| Real Det Return     | 263      |
| Real Sto Return     | 250      |
| Reward Loss         | -49.3    |
| Running Env Steps   | 137000   |
| Running Forward KL  | 1.4      |
| Running Reverse KL  | 4.2      |
| Running Update Time | 274      |
----------------------------------
2025-02-18 10:27:13.626147 ׼ʱ-
| Itration            | 275      |
| Real Det Return     | 308      |
| Real Sto Return     | 268      |
| Reward Loss         | -54.6    |
| Running Env Steps   | 137500   |
| Running Forward KL  | 1.96     |
| Running Reverse KL  | 3.91     |
| Running Update Time | 275      |
----------------------------------
2025-02-18 10:27:25.857537 ׼ʱ-
| Itration            | 276      |
| Real Det Return     | 283      |
| Real Sto Return     | 260      |
| Reward Loss         | -57.9    |
| Running Env Steps   | 138000   |
| Running Forward KL  | 1.94     |
| Running Reverse KL  | 4.53     |
| Running Update Time | 276      |
----------------------------------
2025-02-18 10:27:38.510772 ׼ʱ-
| Itration            | 277      |
| Real Det Return     | 304      |
| Real Sto Return     | 254      |
| Reward Loss         | -53.6    |
| Running Env Steps   | 138500   |
| Running Forward KL  | 1.88     |
| Running Reverse KL  | 4.49     |
| Running Update Time | 277      |
----------------------------------
2025-02-18 10:27:50.773451 ׼ʱ-
| Itration            | 278      |
| Real Det Return     | 280      |
| Real Sto Return     | 246      |
| Reward Loss         | -57.7    |
| Running Env Steps   | 139000   |
| Running Forward KL  | 2.51     |
| Running Reverse KL  | 4.55     |
| Running Update Time | 278      |
----------------------------------
2025-02-18 10:28:03.020521 ׼ʱ-
| Itration            | 279      |
| Real Det Return     | 277      |
| Real Sto Return     | 259      |
| Reward Loss         | -64.6    |
| Running Env Steps   | 139500   |
| Running Forward KL  | 2.49     |
| Running Reverse KL  | 4.5      |
| Running Update Time | 279      |
----------------------------------
2025-02-18 10:28:15.236333 ׼ʱ-
| Itration            | 280      |
| Real Det Return     | 314      |
| Real Sto Return     | 294      |
| Reward Loss         | -52      |
| Running Env Steps   | 140000   |
| Running Forward KL  | 2.3      |
| Running Reverse KL  | 4.48     |
| Running Update Time | 280      |
----------------------------------
2025-02-18 10:28:27.452156 ׼ʱ-
| Itration            | 281      |
| Real Det Return     | 274      |
| Real Sto Return     | 255      |
| Reward Loss         | -68.1    |
| Running Env Steps   | 140500   |
| Running Forward KL  | 2.5      |
| Running Reverse KL  | 4.44     |
| Running Update Time | 281      |
----------------------------------
2025-02-18 10:28:39.683593 ׼ʱ-
| Itration            | 282      |
| Real Det Return     | 273      |
| Real Sto Return     | 253      |
| Reward Loss         | -56.5    |
| Running Env Steps   | 141000   |
| Running Forward KL  | 2.32     |
| Running Reverse KL  | 4.82     |
| Running Update Time | 282      |
----------------------------------
2025-02-18 10:28:51.868165 ׼ʱ-
| Itration            | 283      |
| Real Det Return     | 295      |
| Real Sto Return     | 273      |
| Reward Loss         | -55.2    |
| Running Env Steps   | 141500   |
| Running Forward KL  | 2.84     |
| Running Reverse KL  | 4.67     |
| Running Update Time | 283      |
----------------------------------
2025-02-18 10:29:04.115222 ׼ʱ-
| Itration            | 284      |
| Real Det Return     | 301      |
| Real Sto Return     | 254      |
| Reward Loss         | -65.5    |
| Running Env Steps   | 142000   |
| Running Forward KL  | 1.95     |
| Running Reverse KL  | 4.29     |
| Running Update Time | 284      |
----------------------------------
2025-02-18 10:29:16.331041 ׼ʱ-
| Itration            | 285      |
| Real Det Return     | 305      |
| Real Sto Return     | 276      |
| Reward Loss         | -56.6    |
| Running Env Steps   | 142500   |
| Running Forward KL  | 1.95     |
| Running Reverse KL  | 4.37     |
| Running Update Time | 285      |
----------------------------------
2025-02-18 10:29:28.531232 ׼ʱ-
| Itration            | 286      |
| Real Det Return     | 303      |
| Real Sto Return     | 263      |
| Reward Loss         | -51.3    |
| Running Env Steps   | 143000   |
| Running Forward KL  | 1.9      |
| Running Reverse KL  | 4.4      |
| Running Update Time | 286      |
----------------------------------
2025-02-18 10:29:41.105850 ׼ʱ-
| Itration            | 287      |
| Real Det Return     | 297      |
| Real Sto Return     | 263      |
| Reward Loss         | -52.1    |
| Running Env Steps   | 143500   |
| Running Forward KL  | 1.49     |
| Running Reverse KL  | 4.41     |
| Running Update Time | 287      |
----------------------------------
2025-02-18 10:29:53.368519 ׼ʱ-
| Itration            | 288      |
| Real Det Return     | 294      |
| Real Sto Return     | 262      |
| Reward Loss         | -54.3    |
| Running Env Steps   | 144000   |
| Running Forward KL  | 1.53     |
| Running Reverse KL  | 4.07     |
| Running Update Time | 288      |
----------------------------------
2025-02-18 10:30:05.646819 ׼ʱ-
| Itration            | 289      |
| Real Det Return     | 284      |
| Real Sto Return     | 262      |
| Reward Loss         | -52.7    |
| Running Env Steps   | 144500   |
| Running Forward KL  | 2.19     |
| Running Reverse KL  | 4.16     |
| Running Update Time | 289      |
----------------------------------
2025-02-18 10:30:17.862631 ׼ʱ-
| Itration            | 290      |
| Real Det Return     | 271      |
| Real Sto Return     | 256      |
| Reward Loss         | -68.4    |
| Running Env Steps   | 145000   |
| Running Forward KL  | 2.06     |
| Running Reverse KL  | 4.49     |
| Running Update Time | 290      |
----------------------------------
2025-02-18 10:30:30.078459 ׼ʱ-
| Itration            | 291      |
| Real Det Return     | 312      |
| Real Sto Return     | 276      |
| Reward Loss         | -46.3    |
| Running Env Steps   | 145500   |
| Running Forward KL  | 1.21     |
| Running Reverse KL  | 4.19     |
| Running Update Time | 291      |
----------------------------------
2025-02-18 10:30:42.231793 ׼ʱ-
| Itration            | 292      |
| Real Det Return     | 291      |
| Real Sto Return     | 274      |
| Reward Loss         | -65.9    |
| Running Env Steps   | 146000   |
| Running Forward KL  | 1.75     |
| Running Reverse KL  | 4.24     |
| Running Update Time | 292      |
----------------------------------
2025-02-18 10:30:54.525714 ׼ʱ-
| Itration            | 293      |
| Real Det Return     | 279      |
| Real Sto Return     | 268      |
| Reward Loss         | -63.5    |
| Running Env Steps   | 146500   |
| Running Forward KL  | 2.06     |
| Running Reverse KL  | 4.36     |
| Running Update Time | 293      |
----------------------------------
2025-02-18 10:31:06.772771 ׼ʱ-
| Itration            | 294      |
| Real Det Return     | 298      |
| Real Sto Return     | 269      |
| Reward Loss         | -59.3    |
| Running Env Steps   | 147000   |
| Running Forward KL  | 1.9      |
| Running Reverse KL  | 3.98     |
| Running Update Time | 294      |
----------------------------------
2025-02-18 10:31:19.019829 ׼ʱ-
| Itration            | 295      |
| Real Det Return     | 296      |
| Real Sto Return     | 262      |
| Reward Loss         | -54.4    |
| Running Env Steps   | 147500   |
| Running Forward KL  | 1.25     |
| Running Reverse KL  | 4.14     |
| Running Update Time | 295      |
----------------------------------
2025-02-18 10:31:31.251252 ׼ʱ-
| Itration            | 296      |
| Real Det Return     | 303      |
| Real Sto Return     | 275      |
| Reward Loss         | -49.1    |
| Running Env Steps   | 148000   |
| Running Forward KL  | 1.53     |
| Running Reverse KL  | 3.91     |
| Running Update Time | 296      |
----------------------------------
2025-02-18 10:31:43.826365 ׼ʱ-
| Itration            | 297      |
| Real Det Return     | 276      |
| Real Sto Return     | 260      |
| Reward Loss         | -58.9    |
| Running Env Steps   | 148500   |
| Running Forward KL  | 1.76     |
| Running Reverse KL  | 4.18     |
| Running Update Time | 297      |
----------------------------------
2025-02-18 10:31:56.042171 ׼ʱ-
| Itration            | 298      |
| Real Det Return     | 291      |
| Real Sto Return     | 269      |
| Reward Loss         | -55      |
| Running Env Steps   | 149000   |
| Running Forward KL  | 1.83     |
| Running Reverse KL  | 4.3      |
| Running Update Time | 298      |
----------------------------------
2025-02-18 10:32:08.304849 ׼ʱ-
| Itration            | 299      |
| Real Det Return     | 289      |
| Real Sto Return     | 272      |
| Reward Loss         | -58.6    |
| Running Env Steps   | 149500   |
| Running Forward KL  | 1.77     |
| Running Reverse KL  | 4.32     |
| Running Update Time | 299      |
----------------------------------
2025-02-18 10:32:20.614406 ׼ʱ-
| Itration            | 300      |
| Real Det Return     | 318      |
| Real Sto Return     | 282      |
| Reward Loss         | -50.5    |
| Running Env Steps   | 150000   |
| Running Forward KL  | 1.58     |
| Running Reverse KL  | 3.8      |
| Running Update Time | 300      |
----------------------------------
2025-02-18 10:32:32.908323 ׼ʱ-
| Itration            | 301      |
| Real Det Return     | 306      |
| Real Sto Return     | 284      |
| Reward Loss         | -55.2    |
| Running Env Steps   | 150500   |
| Running Forward KL  | 1.64     |
| Running Reverse KL  | 4.01     |
| Running Update Time | 301      |
----------------------------------
2025-02-18 10:32:45.124142 ׼ʱ-
| Itration            | 302      |
| Real Det Return     | 295      |
| Real Sto Return     | 278      |
| Reward Loss         | -48.5    |
| Running Env Steps   | 151000   |
| Running Forward KL  | 0.869    |
| Running Reverse KL  | 4        |
| Running Update Time | 302      |
----------------------------------
2025-02-18 10:32:57.355565 ׼ʱ-
| Itration            | 303      |
| Real Det Return     | 312      |
| Real Sto Return     | 282      |
| Reward Loss         | -53.2    |
| Running Env Steps   | 151500   |
| Running Forward KL  | 1.33     |
| Running Reverse KL  | 4.04     |
| Running Update Time | 303      |
----------------------------------
2025-02-18 10:33:09.602622 ׼ʱ-
| Itration            | 304      |
| Real Det Return     | 317      |
| Real Sto Return     | 272      |
| Reward Loss         | -49.7    |
| Running Env Steps   | 152000   |
| Running Forward KL  | 1.6      |
| Running Reverse KL  | 4.09     |
| Running Update Time | 304      |
----------------------------------
2025-02-18 10:33:21.802817 ׼ʱ-
| Itration            | 305      |
| Real Det Return     | 296      |
| Real Sto Return     | 281      |
| Reward Loss         | -51.2    |
| Running Env Steps   | 152500   |
| Running Forward KL  | 1.14     |
| Running Reverse KL  | 3.92     |
| Running Update Time | 305      |
----------------------------------
2025-02-18 10:33:34.049874 ׼ʱ-
| Itration            | 306      |
| Real Det Return     | 294      |
| Real Sto Return     | 271      |
| Reward Loss         | -56.4    |
| Running Env Steps   | 153000   |
| Running Forward KL  | 0.935    |
| Running Reverse KL  | 3.82     |
| Running Update Time | 306      |
----------------------------------
2025-02-18 10:33:46.633327 ׼ʱ-
| Itration            | 307      |
| Real Det Return     | 312      |
| Real Sto Return     | 277      |
| Reward Loss         | -50.6    |
| Running Env Steps   | 153500   |
| Running Forward KL  | 1.93     |
| Running Reverse KL  | 4.43     |
| Running Update Time | 307      |
----------------------------------
2025-02-18 10:33:58.896006 ׼ʱ-
| Itration            | 308      |
| Real Det Return     | 314      |
| Real Sto Return     | 287      |
| Reward Loss         | -59.3    |
| Running Env Steps   | 154000   |
| Running Forward KL  | 1.32     |
| Running Reverse KL  | 3.77     |
| Running Update Time | 308      |
----------------------------------
2025-02-18 10:34:11.221160 ׼ʱ-
| Itration            | 309      |
| Real Det Return     | 273      |
| Real Sto Return     | 255      |
| Reward Loss         | -62.9    |
| Running Env Steps   | 154500   |
| Running Forward KL  | 1.72     |
| Running Reverse KL  | 4.25     |
| Running Update Time | 309      |
----------------------------------
2025-02-18 10:34:23.468218 ׼ʱ-
| Itration            | 310      |
| Real Det Return     | 324      |
| Real Sto Return     | 277      |
| Reward Loss         | -53.6    |
| Running Env Steps   | 155000   |
| Running Forward KL  | 2.45     |
| Running Reverse KL  | 4.14     |
| Running Update Time | 310      |
----------------------------------
2025-02-18 10:34:35.730897 ׼ʱ-
| Itration            | 311      |
| Real Det Return     | 290      |
| Real Sto Return     | 268      |
| Reward Loss         | -56.4    |
| Running Env Steps   | 155500   |
| Running Forward KL  | 2.29     |
| Running Reverse KL  | 4.01     |
| Running Update Time | 311      |
----------------------------------
2025-02-18 10:34:47.946699 ׼ʱ-
| Itration            | 312      |
| Real Det Return     | 292      |
| Real Sto Return     | 258      |
| Reward Loss         | -66.3    |
| Running Env Steps   | 156000   |
| Running Forward KL  | 1.5      |
| Running Reverse KL  | 4.13     |
| Running Update Time | 312      |
----------------------------------
2025-02-18 10:35:00.225012 ׼ʱ-
| Itration            | 313      |
| Real Det Return     | 304      |
| Real Sto Return     | 281      |
| Reward Loss         | -55.4    |
| Running Env Steps   | 156500   |
| Running Forward KL  | 1.67     |
| Running Reverse KL  | 3.89     |
| Running Update Time | 313      |
----------------------------------
2025-02-18 10:35:12.472079 ׼ʱ-
| Itration            | 314      |
| Real Det Return     | 301      |
| Real Sto Return     | 279      |
| Reward Loss         | -54.1    |
| Running Env Steps   | 157000   |
| Running Forward KL  | 1.53     |
| Running Reverse KL  | 3.98     |
| Running Update Time | 314      |
----------------------------------
2025-02-18 10:35:24.687894 ׼ʱ-
| Itration            | 315      |
| Real Det Return     | 290      |
| Real Sto Return     | 256      |
| Reward Loss         | -61.8    |
| Running Env Steps   | 157500   |
| Running Forward KL  | 1.78     |
| Running Reverse KL  | 4.18     |
| Running Update Time | 315      |
----------------------------------
2025-02-18 10:35:36.888091 ׼ʱ-
| Itration            | 316      |
| Real Det Return     | 306      |
| Real Sto Return     | 289      |
| Reward Loss         | -51.6    |
| Running Env Steps   | 158000   |
| Running Forward KL  | 1.69     |
| Running Reverse KL  | 3.76     |
| Running Update Time | 316      |
----------------------------------
2025-02-18 10:35:49.493757 ׼ʱ-
| Itration            | 317      |
| Real Det Return     | 323      |
| Real Sto Return     | 275      |
| Reward Loss         | -51.7    |
| Running Env Steps   | 158500   |
| Running Forward KL  | 0.946    |
| Running Reverse KL  | 3.83     |
| Running Update Time | 317      |
----------------------------------
2025-02-18 10:36:01.881383 ׼ʱ-
| Itration            | 318      |
| Real Det Return     | 311      |
| Real Sto Return     | 282      |
| Reward Loss         | -54.5    |
| Running Env Steps   | 159000   |
| Running Forward KL  | 1.19     |
| Running Reverse KL  | 3.92     |
| Running Update Time | 318      |
----------------------------------
2025-02-18 10:36:14.097630 ׼ʱ-
| Itration            | 319      |
| Real Det Return     | 290      |
| Real Sto Return     | 270      |
| Reward Loss         | -61.7    |
| Running Env Steps   | 159500   |
| Running Forward KL  | 1.58     |
| Running Reverse KL  | 3.91     |
| Running Update Time | 319      |
----------------------------------
2025-02-18 10:36:26.344689 ׼ʱ-
| Itration            | 320      |
| Real Det Return     | 309      |
| Real Sto Return     | 278      |
| Reward Loss         | -60.5    |
| Running Env Steps   | 160000   |
| Running Forward KL  | 1.58     |
| Running Reverse KL  | 4.08     |
| Running Update Time | 320      |
----------------------------------
2025-02-18 10:36:38.623001 ׼ʱ-
| Itration            | 321      |
| Real Det Return     | 324      |
| Real Sto Return     | 296      |
| Reward Loss         | -56.3    |
| Running Env Steps   | 160500   |
| Running Forward KL  | 1.19     |
| Running Reverse KL  | 3.89     |
| Running Update Time | 321      |
----------------------------------
2025-02-18 10:36:50.885666 ׼ʱ-
| Itration            | 322      |
| Real Det Return     | 310      |
| Real Sto Return     | 290      |
| Reward Loss         | -52.7    |
| Running Env Steps   | 161000   |
| Running Forward KL  | 1.07     |
| Running Reverse KL  | 3.92     |
| Running Update Time | 322      |
----------------------------------
2025-02-18 10:37:03.117078 ׼ʱ-
| Itration            | 323      |
| Real Det Return     | 284      |
| Real Sto Return     | 266      |
| Reward Loss         | -62.3    |
| Running Env Steps   | 161500   |
| Running Forward KL  | 0.675    |
| Running Reverse KL  | 3.83     |
| Running Update Time | 323      |
----------------------------------
2025-02-18 10:37:15.395404 ׼ʱ-
| Itration            | 324      |
| Real Det Return     | 319      |
| Real Sto Return     | 289      |
| Reward Loss         | -56.6    |
| Running Env Steps   | 162000   |
| Running Forward KL  | 1.33     |
| Running Reverse KL  | 3.34     |
| Running Update Time | 324      |
----------------------------------
2025-02-18 10:37:27.704957 ׼ʱ-
| Itration            | 325      |
| Real Det Return     | 317      |
| Real Sto Return     | 274      |
| Reward Loss         | -42.5    |
| Running Env Steps   | 162500   |
| Running Forward KL  | 0.452    |
| Running Reverse KL  | 3.73     |
| Running Update Time | 325      |
----------------------------------
2025-02-18 10:37:39.905140 ׼ʱ-
| Itration            | 326      |
| Real Det Return     | 335      |
| Real Sto Return     | 285      |
| Reward Loss         | -55.8    |
| Running Env Steps   | 163000   |
| Running Forward KL  | 0.978    |
| Running Reverse KL  | 3.85     |
| Running Update Time | 326      |
----------------------------------
2025-02-18 10:37:52.482644 ׼ʱ-
| Itration            | 327      |
| Real Det Return     | 300      |
| Real Sto Return     | 283      |
| Reward Loss         | -56.6    |
| Running Env Steps   | 163500   |
| Running Forward KL  | 1.35     |
| Running Reverse KL  | 4.13     |
| Running Update Time | 327      |
----------------------------------
2025-02-18 10:38:04.776565 ׼ʱ-
| Itration            | 328      |
| Real Det Return     | 320      |
| Real Sto Return     | 291      |
| Reward Loss         | -59      |
| Running Env Steps   | 164000   |
| Running Forward KL  | 1.39     |
| Running Reverse KL  | 4.32     |
| Running Update Time | 328      |
----------------------------------
2025-02-18 10:38:17.180708 ׼ʱ-
| Itration            | 329      |
| Real Det Return     | 333      |
| Real Sto Return     | 303      |
| Reward Loss         | -51.2    |
| Running Env Steps   | 164500   |
| Running Forward KL  | 0.525    |
| Running Reverse KL  | 3.3      |
| Running Update Time | 329      |
----------------------------------
2025-02-18 10:38:29.365289 ׼ʱ-
| Itration            | 330      |
| Real Det Return     | 332      |
| Real Sto Return     | 293      |
| Reward Loss         | -37.6    |
| Running Env Steps   | 165000   |
| Running Forward KL  | 0.693    |
| Running Reverse KL  | 2.96     |
| Running Update Time | 330      |
----------------------------------
2025-02-18 10:38:41.831034 ׼ʱ-
| Itration            | 331      |
| Real Det Return     | 315      |
| Real Sto Return     | 274      |
| Reward Loss         | -53.6    |
| Running Env Steps   | 165500   |
| Running Forward KL  | 0.589    |
| Running Reverse KL  | 3.95     |
| Running Update Time | 331      |
----------------------------------
2025-02-18 10:38:54.203072 ׼ʱ-
| Itration            | 332      |
| Real Det Return     | 307      |
| Real Sto Return     | 282      |
| Reward Loss         | -55      |
| Running Env Steps   | 166000   |
| Running Forward KL  | 1.69     |
| Running Reverse KL  | 3.92     |
| Running Update Time | 332      |
----------------------------------
2025-02-18 10:39:06.434502 ׼ʱ-
| Itration            | 333      |
| Real Det Return     | 297      |
| Real Sto Return     | 279      |
| Reward Loss         | -54.3    |
| Running Env Steps   | 166500   |
| Running Forward KL  | 1.45     |
| Running Reverse KL  | 3.39     |
| Running Update Time | 333      |
----------------------------------
2025-02-18 10:39:18.634692 ׼ʱ-
| Itration            | 334      |
| Real Det Return     | 330      |
| Real Sto Return     | 300      |
| Reward Loss         | -49.9    |
| Running Env Steps   | 167000   |
| Running Forward KL  | 1.34     |
| Running Reverse KL  | 3.39     |
| Running Update Time | 334      |
----------------------------------
2025-02-18 10:39:30.850506 ׼ʱ-
| Itration            | 335      |
| Real Det Return     | 320      |
| Real Sto Return     | 297      |
| Reward Loss         | -53.2    |
| Running Env Steps   | 167500   |
| Running Forward KL  | 1.2      |
| Running Reverse KL  | 3.99     |
| Running Update Time | 335      |
----------------------------------
2025-02-18 10:39:43.050710 ׼ʱ-
| Itration            | 336      |
| Real Det Return     | 312      |
| Real Sto Return     | 286      |
| Reward Loss         | -57.3    |
| Running Env Steps   | 168000   |
| Running Forward KL  | 1.85     |
| Running Reverse KL  | 3.77     |
| Running Update Time | 336      |
----------------------------------
2025-02-18 10:39:55.773708 ׼ʱ-
| Itration            | 337      |
| Real Det Return     | 317      |
| Real Sto Return     | 284      |
| Reward Loss         | -55.5    |
| Running Env Steps   | 168500   |
| Running Forward KL  | 0.795    |
| Running Reverse KL  | 3.64     |
| Running Update Time | 337      |
----------------------------------
2025-02-18 10:40:08.161356 ׼ʱ-
| Itration            | 338      |
| Real Det Return     | 347      |
| Real Sto Return     | 287      |
| Reward Loss         | -57.3    |
| Running Env Steps   | 169000   |
| Running Forward KL  | 1.05     |
| Running Reverse KL  | 3.99     |
| Running Update Time | 338      |
----------------------------------
2025-02-18 10:40:20.408413 ׼ʱ-
| Itration            | 339      |
| Real Det Return     | 300      |
| Real Sto Return     | 280      |
| Reward Loss         | -54.4    |
| Running Env Steps   | 169500   |
| Running Forward KL  | 1.03     |
| Running Reverse KL  | 3.49     |
| Running Update Time | 339      |
----------------------------------
2025-02-18 10:40:32.671112 ׼ʱ-
| Itration            | 340      |
| Real Det Return     | 326      |
| Real Sto Return     | 298      |
| Reward Loss         | -55.8    |
| Running Env Steps   | 170000   |
| Running Forward KL  | 0.793    |
| Running Reverse KL  | 4.34     |
| Running Update Time | 340      |
----------------------------------
2025-02-18 10:40:44.933773 ׼ʱ-
| Itration            | 341      |
| Real Det Return     | 345      |
| Real Sto Return     | 297      |
| Reward Loss         | -56.2    |
| Running Env Steps   | 170500   |
| Running Forward KL  | 0.916    |
| Running Reverse KL  | 3.96     |
| Running Update Time | 341      |
----------------------------------
2025-02-18 10:40:57.196432 ׼ʱ-
| Itration            | 342      |
| Real Det Return     | 317      |
| Real Sto Return     | 292      |
| Reward Loss         | -50.5    |
| Running Env Steps   | 171000   |
| Running Forward KL  | 0.961    |
| Running Reverse KL  | 4.11     |
| Running Update Time | 342      |
----------------------------------
2025-02-18 10:41:09.459138 ׼ʱ-
| Itration            | 343      |
| Real Det Return     | 341      |
| Real Sto Return     | 309      |
| Reward Loss         | -41.4    |
| Running Env Steps   | 171500   |
| Running Forward KL  | 1.31     |
| Running Reverse KL  | 3.64     |
| Running Update Time | 343      |
----------------------------------
2025-02-18 10:41:21.690785 ׼ʱ-
| Itration            | 344      |
| Real Det Return     | 341      |
| Real Sto Return     | 296      |
| Reward Loss         | -52.6    |
| Running Env Steps   | 172000   |
| Running Forward KL  | 1.56     |
| Running Reverse KL  | 4.42     |
| Running Update Time | 344      |
----------------------------------
2025-02-18 10:41:33.906593 ׼ʱ-
| Itration            | 345      |
| Real Det Return     | 327      |
| Real Sto Return     | 290      |
| Reward Loss         | -54.7    |
| Running Env Steps   | 172500   |
| Running Forward KL  | 0.831    |
| Running Reverse KL  | 3.65     |
| Running Update Time | 345      |
----------------------------------
2025-02-18 10:41:46.122419 ׼ʱ-
| Itration            | 346      |
| Real Det Return     | 347      |
| Real Sto Return     | 302      |
| Reward Loss         | -54.9    |
| Running Env Steps   | 173000   |
| Running Forward KL  | 1.65     |
| Running Reverse KL  | 3.69     |
| Running Update Time | 346      |
----------------------------------
2025-02-18 10:41:58.745203 ׼ʱ-
| Itration            | 347      |
| Real Det Return     | 293      |
| Real Sto Return     | 282      |
| Reward Loss         | -46.7    |
| Running Env Steps   | 173500   |
| Running Forward KL  | 0.241    |
| Running Reverse KL  | 3.57     |
| Running Update Time | 347      |
----------------------------------
2025-02-18 10:42:11.055519 ׼ʱ-
| Itration            | 348      |
| Real Det Return     | 282      |
| Real Sto Return     | 274      |
| Reward Loss         | -67.1    |
| Running Env Steps   | 174000   |
| Running Forward KL  | 1.17     |
| Running Reverse KL  | 3.83     |
| Running Update Time | 348      |
----------------------------------
2025-02-18 10:42:23.302601 ׼ʱ-
| Itration            | 349      |
| Real Det Return     | 310      |
| Real Sto Return     | 283      |
| Reward Loss         | -56      |
| Running Env Steps   | 174500   |
| Running Forward KL  | 1.2      |
| Running Reverse KL  | 3.52     |
| Running Update Time | 349      |
----------------------------------
2025-02-18 10:42:35.549653 ׼ʱ-
| Itration            | 350      |
| Real Det Return     | 319      |
| Real Sto Return     | 290      |
| Reward Loss         | -67.4    |
| Running Env Steps   | 175000   |
| Running Forward KL  | 0.712    |
| Running Reverse KL  | 3.6      |
| Running Update Time | 350      |
----------------------------------
2025-02-18 10:42:47.812352 ׼ʱ-
| Itration            | 351      |
| Real Det Return     | 315      |
| Real Sto Return     | 301      |
| Reward Loss         | -72.6    |
| Running Env Steps   | 175500   |
| Running Forward KL  | 1.21     |
| Running Reverse KL  | 3.72     |
| Running Update Time | 351      |
----------------------------------
2025-02-18 10:43:00.012506 ׼ʱ-
| Itration            | 352      |
| Real Det Return     | 314      |
| Real Sto Return     | 286      |
| Reward Loss         | -53.7    |
| Running Env Steps   | 176000   |
| Running Forward KL  | 1.11     |
| Running Reverse KL  | 4.32     |
| Running Update Time | 352      |
----------------------------------
2025-02-18 10:43:12.259593 ׼ʱ-
| Itration            | 353      |
| Real Det Return     | 314      |
| Real Sto Return     | 286      |
| Reward Loss         | -61.2    |
| Running Env Steps   | 176500   |
| Running Forward KL  | 1.3      |
| Running Reverse KL  | 4.2      |
| Running Update Time | 353      |
----------------------------------
2025-02-18 10:43:24.475433 ׼ʱ-
| Itration            | 354      |
| Real Det Return     | 301      |
| Real Sto Return     | 285      |
| Reward Loss         | -54.4    |
| Running Env Steps   | 177000   |
| Running Forward KL  | 0.389    |
| Running Reverse KL  | 3.96     |
| Running Update Time | 354      |
----------------------------------
2025-02-18 10:43:36.738115 ׼ʱ-
| Itration            | 355      |
| Real Det Return     | 320      |
| Real Sto Return     | 302      |
| Reward Loss         | -53.7    |
| Running Env Steps   | 177500   |
| Running Forward KL  | 0.632    |
| Running Reverse KL  | 3.29     |
| Running Update Time | 355      |
----------------------------------
2025-02-18 10:43:48.953914 ׼ʱ-
| Itration            | 356      |
| Real Det Return     | 340      |
| Real Sto Return     | 306      |
| Reward Loss         | -53.3    |
| Running Env Steps   | 178000   |
| Running Forward KL  | 0.923    |
| Running Reverse KL  | 3.84     |
| Running Update Time | 356      |
----------------------------------
2025-02-18 10:44:01.587427 ׼ʱ-
| Itration            | 357      |
| Real Det Return     | 313      |
| Real Sto Return     | 296      |
| Reward Loss         | -52.3    |
| Running Env Steps   | 178500   |
| Running Forward KL  | 0.355    |
| Running Reverse KL  | 3.31     |
| Running Update Time | 357      |
----------------------------------
2025-02-18 10:44:13.896991 ׼ʱ-
| Itration            | 358      |
| Real Det Return     | 356      |
| Real Sto Return     | 295      |
| Reward Loss         | -49.7    |
| Running Env Steps   | 179000   |
| Running Forward KL  | 0.707    |
| Running Reverse KL  | 3.6      |
| Running Update Time | 358      |
----------------------------------
2025-02-18 10:44:26.128431 ׼ʱ-
| Itration            | 359      |
| Real Det Return     | 339      |
| Real Sto Return     | 302      |
| Reward Loss         | -64.1    |
| Running Env Steps   | 179500   |
| Running Forward KL  | 0.641    |
| Running Reverse KL  | 3.92     |
| Running Update Time | 359      |
----------------------------------
2025-02-18 10:44:38.375475 ׼ʱ-
| Itration            | 360      |
| Real Det Return     | 325      |
| Real Sto Return     | 309      |
| Reward Loss         | -48.1    |
| Running Env Steps   | 180000   |
| Running Forward KL  | 0.857    |
| Running Reverse KL  | 3.38     |
| Running Update Time | 360      |
----------------------------------
2025-02-18 10:44:50.622536 ׼ʱ-
| Itration            | 361      |
| Real Det Return     | 326      |
| Real Sto Return     | 301      |
| Reward Loss         | -56.3    |
| Running Env Steps   | 180500   |
| Running Forward KL  | 1.01     |
| Running Reverse KL  | 3.75     |
| Running Update Time | 361      |
----------------------------------
2025-02-18 10:45:02.932103 ׼ʱ-
| Itration            | 362      |
| Real Det Return     | 342      |
| Real Sto Return     | 303      |
| Reward Loss         | -48.3    |
| Running Env Steps   | 181000   |
| Running Forward KL  | 0.68     |
| Running Reverse KL  | 3.86     |
| Running Update Time | 362      |
----------------------------------
2025-02-18 10:45:15.194765 ׼ʱ-
| Itration            | 363      |
| Real Det Return     | 334      |
| Real Sto Return     | 313      |
| Reward Loss         | -54.4    |
| Running Env Steps   | 181500   |
| Running Forward KL  | 0.377    |
| Running Reverse KL  | 3.58     |
| Running Update Time | 363      |
----------------------------------
2025-02-18 10:45:27.504329 ׼ʱ-
| Itration            | 364      |
| Real Det Return     | 342      |
| Real Sto Return     | 311      |
| Reward Loss         | -53.8    |
| Running Env Steps   | 182000   |
| Running Forward KL  | 0.941    |
| Running Reverse KL  | 3.72     |
| Running Update Time | 364      |
----------------------------------
2025-02-18 10:45:39.782633 ׼ʱ-
| Itration            | 365      |
| Real Det Return     | 338      |
| Real Sto Return     | 302      |
| Reward Loss         | -45.9    |
| Running Env Steps   | 182500   |
| Running Forward KL  | 0.841    |
| Running Reverse KL  | 3.86     |
| Running Update Time | 365      |
----------------------------------
2025-02-18 10:45:52.014057 ׼ʱ-
| Itration            | 366      |
| Real Det Return     | 355      |
| Real Sto Return     | 305      |
| Reward Loss         | -37.7    |
| Running Env Steps   | 183000   |
| Running Forward KL  | 0.485    |
| Running Reverse KL  | 3.71     |
| Running Update Time | 366      |
----------------------------------
2025-02-18 10:46:04.596575 ׼ʱ-
| Itration            | 367      |
| Real Det Return     | 308      |
| Real Sto Return     | 297      |
| Reward Loss         | -82.9    |
| Running Env Steps   | 183500   |
| Running Forward KL  | 0.589    |
| Running Reverse KL  | 3.35     |
| Running Update Time | 367      |
----------------------------------
2025-02-18 10:46:16.952981 ׼ʱ-
| Itration            | 368      |
| Real Det Return     | 306      |
| Real Sto Return     | 289      |
| Reward Loss         | -65.2    |
| Running Env Steps   | 184000   |
| Running Forward KL  | 1.88     |
| Running Reverse KL  | 3.85     |
| Running Update Time | 368      |
----------------------------------
2025-02-18 10:46:29.215646 ׼ʱ-
| Itration            | 369      |
| Real Det Return     | 303      |
| Real Sto Return     | 285      |
| Reward Loss         | -62.7    |
| Running Env Steps   | 184500   |
| Running Forward KL  | -0.0177  |
| Running Reverse KL  | 3.77     |
| Running Update Time | 369      |
----------------------------------
2025-02-18 10:46:41.743909 ׼ʱ-
| Itration            | 370      |
| Real Det Return     | 333      |
| Real Sto Return     | 298      |
| Reward Loss         | -51.6    |
| Running Env Steps   | 185000   |
| Running Forward KL  | 1.31     |
| Running Reverse KL  | 4.17     |
| Running Update Time | 370      |
----------------------------------
2025-02-18 10:46:53.991077 ׼ʱ-
| Itration            | 371      |
| Real Det Return     | 304      |
| Real Sto Return     | 287      |
| Reward Loss         | -56.8    |
| Running Env Steps   | 185500   |
| Running Forward KL  | -0.202   |
| Running Reverse KL  | 3.54     |
| Running Update Time | 371      |
----------------------------------
2025-02-18 10:47:06.284898 ׼ʱ-
| Itration            | 372      |
| Real Det Return     | 306      |
| Real Sto Return     | 295      |
| Reward Loss         | -54.1    |
| Running Env Steps   | 186000   |
| Running Forward KL  | 0.485    |
| Running Reverse KL  | 3.51     |
| Running Update Time | 372      |
----------------------------------
2025-02-18 10:47:18.500703 ׼ʱ-
| Itration            | 373      |
| Real Det Return     | 342      |
| Real Sto Return     | 326      |
| Reward Loss         | -48.3    |
| Running Env Steps   | 186500   |
| Running Forward KL  | 0.298    |
| Running Reverse KL  | 3.9      |
| Running Update Time | 373      |
----------------------------------
2025-02-18 10:47:30.747770 ׼ʱ-
| Itration            | 374      |
| Real Det Return     | 300      |
| Real Sto Return     | 291      |
| Reward Loss         | -62.4    |
| Running Env Steps   | 187000   |
| Running Forward KL  | 0.941    |
| Running Reverse KL  | 4.03     |
| Running Update Time | 374      |
----------------------------------
2025-02-18 10:47:42.963575 ׼ʱ-
| Itration            | 375      |
| Real Det Return     | 325      |
| Real Sto Return     | 297      |
| Reward Loss         | -47.7    |
| Running Env Steps   | 187500   |
| Running Forward KL  | 0.379    |
| Running Reverse KL  | 3.75     |
| Running Update Time | 375      |
----------------------------------
2025-02-18 10:47:55.163783 ׼ʱ-
| Itration            | 376      |
| Real Det Return     | 323      |
| Real Sto Return     | 302      |
| Reward Loss         | -51.8    |
| Running Env Steps   | 188000   |
| Running Forward KL  | 0.858    |
| Running Reverse KL  | 3.66     |
| Running Update Time | 376      |
----------------------------------
2025-02-18 10:48:07.804856 ׼ʱ-
| Itration            | 377      |
| Real Det Return     | 319      |
| Real Sto Return     | 297      |
| Reward Loss         | -48      |
| Running Env Steps   | 188500   |
| Running Forward KL  | 0.683    |
| Running Reverse KL  | 3.39     |
| Running Update Time | 377      |
----------------------------------
2025-02-18 10:48:20.098771 ׼ʱ-
| Itration            | 378      |
| Real Det Return     | 342      |
| Real Sto Return     | 307      |
| Reward Loss         | -47      |
| Running Env Steps   | 189000   |
| Running Forward KL  | 0.252    |
| Running Reverse KL  | 4.02     |
| Running Update Time | 378      |
----------------------------------
2025-02-18 10:48:32.345822 ׼ʱ-
| Itration            | 379      |
| Real Det Return     | 344      |
| Real Sto Return     | 308      |
| Reward Loss         | -41.6    |
| Running Env Steps   | 189500   |
| Running Forward KL  | 0.552    |
| Running Reverse KL  | 3.82     |
| Running Update Time | 379      |
----------------------------------
2025-02-18 10:48:44.655370 ׼ʱ-
| Itration            | 380      |
| Real Det Return     | 328      |
| Real Sto Return     | 306      |
| Reward Loss         | -58.8    |
| Running Env Steps   | 190000   |
| Running Forward KL  | -0.0857  |
| Running Reverse KL  | 3.71     |
| Running Update Time | 380      |
----------------------------------
2025-02-18 10:48:56.964890 ׼ʱ-
| Itration            | 381      |
| Real Det Return     | 326      |
| Real Sto Return     | 302      |
| Reward Loss         | -54.7    |
| Running Env Steps   | 190500   |
| Running Forward KL  | 0.412    |
| Running Reverse KL  | 3.63     |
| Running Update Time | 381      |
----------------------------------
2025-02-18 10:49:09.243218 ׼ʱ-
| Itration            | 382      |
| Real Det Return     | 327      |
| Real Sto Return     | 297      |
| Reward Loss         | -56.5    |
| Running Env Steps   | 191000   |
| Running Forward KL  | 0.859    |
| Running Reverse KL  | 3.81     |
| Running Update Time | 382      |
----------------------------------
2025-02-18 10:49:21.505918 ׼ʱ-
| Itration            | 383      |
| Real Det Return     | 324      |
| Real Sto Return     | 299      |
| Reward Loss         | -56.5    |
| Running Env Steps   | 191500   |
| Running Forward KL  | 0.558    |
| Running Reverse KL  | 3.17     |
| Running Update Time | 383      |
----------------------------------
2025-02-18 10:49:33.737341 ׼ʱ-
| Itration            | 384      |
| Real Det Return     | 331      |
| Real Sto Return     | 308      |
| Reward Loss         | -39      |
| Running Env Steps   | 192000   |
| Running Forward KL  | 0.366    |
| Running Reverse KL  | 3.48     |
| Running Update Time | 384      |
----------------------------------
2025-02-18 10:49:45.984419 ׼ʱ-
| Itration            | 385      |
| Real Det Return     | 336      |
| Real Sto Return     | 311      |
| Reward Loss         | -58.6    |
| Running Env Steps   | 192500   |
| Running Forward KL  | 0.866    |
| Running Reverse KL  | 3.59     |
| Running Update Time | 385      |
----------------------------------
2025-02-18 10:49:58.231463 ׼ʱ-
| Itration            | 386      |
| Real Det Return     | 352      |
| Real Sto Return     | 318      |
| Reward Loss         | -45.9    |
| Running Env Steps   | 193000   |
| Running Forward KL  | 0.19     |
| Running Reverse KL  | 4.05     |
| Running Update Time | 386      |
----------------------------------
2025-02-18 10:50:10.925032 ׼ʱ-
| Itration            | 387      |
| Real Det Return     | 333      |
| Real Sto Return     | 308      |
| Reward Loss         | -54.9    |
| Running Env Steps   | 193500   |
| Running Forward KL  | 0.318    |
| Running Reverse KL  | 3.67     |
| Running Update Time | 387      |
----------------------------------
2025-02-18 10:50:23.218976 ׼ʱ-
| Itration            | 388      |
| Real Det Return     | 350      |
| Real Sto Return     | 314      |
| Reward Loss         | -31.5    |
| Running Env Steps   | 194000   |
| Running Forward KL  | -0.285   |
| Running Reverse KL  | 3.39     |
| Running Update Time | 388      |
----------------------------------
2025-02-18 10:50:35.497262 ׼ʱ-
| Itration            | 389      |
| Real Det Return     | 327      |
| Real Sto Return     | 302      |
| Reward Loss         | -54      |
| Running Env Steps   | 194500   |
| Running Forward KL  | -0.551   |
| Running Reverse KL  | 3.5      |
| Running Update Time | 389      |
----------------------------------
2025-02-18 10:50:47.791186 ׼ʱ-
| Itration            | 390      |
| Real Det Return     | 348      |
| Real Sto Return     | 312      |
| Reward Loss         | -33.9    |
| Running Env Steps   | 195000   |
| Running Forward KL  | 0.4      |
| Running Reverse KL  | 3.47     |
| Running Update Time | 390      |
----------------------------------
2025-02-18 10:51:00.100746 ׼ʱ-
| Itration            | 391      |
| Real Det Return     | 325      |
| Real Sto Return     | 302      |
| Reward Loss         | -47.3    |
| Running Env Steps   | 195500   |
| Running Forward KL  | 0.455    |
| Running Reverse KL  | 3.57     |
| Running Update Time | 391      |
----------------------------------
2025-02-18 10:51:12.332173 ׼ʱ-
| Itration            | 392      |
| Real Det Return     | 335      |
| Real Sto Return     | 314      |
| Reward Loss         | -54.7    |
| Running Env Steps   | 196000   |
| Running Forward KL  | 1.05     |
| Running Reverse KL  | 3.37     |
| Running Update Time | 392      |
----------------------------------
2025-02-18 10:51:24.594873 ׼ʱ-
| Itration            | 393      |
| Real Det Return     | 338      |
| Real Sto Return     | 313      |
| Reward Loss         | -47.9    |
| Running Env Steps   | 196500   |
| Running Forward KL  | 0.254    |
| Running Reverse KL  | 3.24     |
| Running Update Time | 393      |
----------------------------------
2025-02-18 10:51:36.826295 ׼ʱ-
| Itration            | 394      |
| Real Det Return     | 330      |
| Real Sto Return     | 322      |
| Reward Loss         | -47.7    |
| Running Env Steps   | 197000   |
| Running Forward KL  | 0.566    |
| Running Reverse KL  | 3.15     |
| Running Update Time | 394      |
----------------------------------
2025-02-18 10:51:49.073368 ׼ʱ-
| Itration            | 395      |
| Real Det Return     | 338      |
| Real Sto Return     | 314      |
| Reward Loss         | -60.1    |
| Running Env Steps   | 197500   |
| Running Forward KL  | 0.605    |
| Running Reverse KL  | 3.44     |
| Running Update Time | 395      |
----------------------------------
2025-02-18 10:52:01.336038 ׼ʱ-
| Itration            | 396      |
| Real Det Return     | 335      |
| Real Sto Return     | 314      |
| Reward Loss         | -53      |
| Running Env Steps   | 198000   |
| Running Forward KL  | 0.801    |
| Running Reverse KL  | 4.05     |
| Running Update Time | 396      |
----------------------------------
2025-02-18 10:52:14.004849 ׼ʱ-
| Itration            | 397      |
| Real Det Return     | 345      |
| Real Sto Return     | 327      |
| Reward Loss         | -42.5    |
| Running Env Steps   | 198500   |
| Running Forward KL  | 0.403    |
| Running Reverse KL  | 3.64     |
| Running Update Time | 397      |
----------------------------------
2025-02-18 10:52:26.314420 ׼ʱ-
| Itration            | 398      |
| Real Det Return     | 331      |
| Real Sto Return     | 310      |
| Reward Loss         | -53.1    |
| Running Env Steps   | 199000   |
| Running Forward KL  | 0.737    |
| Running Reverse KL  | 3.45     |
| Running Update Time | 398      |
----------------------------------
2025-02-18 10:52:38.670830 ׼ʱ-
| Itration            | 399      |
| Real Det Return     | 331      |
| Real Sto Return     | 314      |
| Reward Loss         | -48.7    |
| Running Env Steps   | 199500   |
| Running Forward KL  | 0.702    |
| Running Reverse KL  | 3.45     |
| Running Update Time | 399      |
----------------------------------
2025-02-18 10:52:50.918444 ׼ʱ-
| Itration            | 400      |
| Real Det Return     | 336      |
| Real Sto Return     | 318      |
| Reward Loss         | -54      |
| Running Env Steps   | 200000   |
| Running Forward KL  | 1.19     |
| Running Reverse KL  | 3.67     |
| Running Update Time | 400      |
----------------------------------
2025-02-18 10:53:03.212366 ׼ʱ-
| Itration            | 401      |
| Real Det Return     | 356      |
| Real Sto Return     | 330      |
| Reward Loss         | -39.6    |
| Running Env Steps   | 200500   |
| Running Forward KL  | 0.455    |
| Running Reverse KL  | 3.76     |
| Running Update Time | 401      |
----------------------------------
2025-02-18 10:53:15.646882 ׼ʱ-
| Itration            | 402      |
| Real Det Return     | 345      |
| Real Sto Return     | 327      |
| Reward Loss         | -33.9    |
| Running Env Steps   | 201000   |
| Running Forward KL  | 0.0272   |
| Running Reverse KL  | 4.15     |
| Running Update Time | 402      |
----------------------------------
2025-02-18 10:53:27.893927 ׼ʱ-
| Itration            | 403      |
| Real Det Return     | 367      |
| Real Sto Return     | 335      |
| Reward Loss         | -35.5    |
| Running Env Steps   | 201500   |
| Running Forward KL  | -0.0525  |
| Running Reverse KL  | 3.1      |
| Running Update Time | 403      |
----------------------------------
2025-02-18 10:53:40.156629 ׼ʱ-
| Itration            | 404      |
| Real Det Return     | 344      |
| Real Sto Return     | 319      |
| Reward Loss         | -45      |
| Running Env Steps   | 202000   |
| Running Forward KL  | 0.258    |
| Running Reverse KL  | 3.63     |
| Running Update Time | 404      |
----------------------------------
2025-02-18 10:53:52.419291 ׼ʱ-
| Itration            | 405      |
| Real Det Return     | 334      |
| Real Sto Return     | 309      |
| Reward Loss         | -45.1    |
| Running Env Steps   | 202500   |
| Running Forward KL  | -0.652   |
| Running Reverse KL  | 3.72     |
| Running Update Time | 405      |
----------------------------------
2025-02-18 10:54:04.728837 ׼ʱ-
| Itration            | 406      |
| Real Det Return     | 354      |
| Real Sto Return     | 317      |
| Reward Loss         | -44.5    |
| Running Env Steps   | 203000   |
| Running Forward KL  | 0.491    |
| Running Reverse KL  | 3.64     |
| Running Update Time | 406      |
----------------------------------
2025-02-18 10:54:17.357799 ׼ʱ-
| Itration            | 407      |
| Real Det Return     | 344      |
| Real Sto Return     | 314      |
| Reward Loss         | -40.9    |
| Running Env Steps   | 203500   |
| Running Forward KL  | -0.0361  |
| Running Reverse KL  | 3.62     |
| Running Update Time | 407      |
----------------------------------
2025-02-18 10:54:29.667336 ׼ʱ-
| Itration            | 408      |
| Real Det Return     | 355      |
| Real Sto Return     | 318      |
| Reward Loss         | -45.6    |
| Running Env Steps   | 204000   |
| Running Forward KL  | 0.473    |
| Running Reverse KL  | 3.74     |
| Running Update Time | 408      |
----------------------------------
2025-02-18 10:54:41.945653 ׼ʱ-
| Itration            | 409      |
| Real Det Return     | 357      |
| Real Sto Return     | 327      |
| Reward Loss         | -72      |
| Running Env Steps   | 204500   |
| Running Forward KL  | 0.998    |
| Running Reverse KL  | 3.23     |
| Running Update Time | 409      |
----------------------------------
2025-02-18 10:54:54.239574 ׼ʱ-
| Itration            | 410      |
| Real Det Return     | 358      |
| Real Sto Return     | 333      |
| Reward Loss         | -31.9    |
| Running Env Steps   | 205000   |
| Running Forward KL  | 0.586    |
| Running Reverse KL  | 3.36     |
| Running Update Time | 410      |
----------------------------------
2025-02-18 10:55:06.627235 ׼ʱ-
| Itration            | 411      |
| Real Det Return     | 350      |
| Real Sto Return     | 320      |
| Reward Loss         | -33.3    |
| Running Env Steps   | 205500   |
| Running Forward KL  | -0.271   |
| Running Reverse KL  | 3.39     |
| Running Update Time | 411      |
----------------------------------
2025-02-18 10:55:18.905521 ׼ʱ-
| Itration            | 412      |
| Real Det Return     | 334      |
| Real Sto Return     | 302      |
| Reward Loss         | -51.8    |
| Running Env Steps   | 206000   |
| Running Forward KL  | -0.196   |
| Running Reverse KL  | 3.67     |
| Running Update Time | 412      |
----------------------------------
2025-02-18 10:55:31.246309 ׼ʱ-
| Itration            | 413      |
| Real Det Return     | 354      |
| Real Sto Return     | 336      |
| Reward Loss         | -38.5    |
| Running Env Steps   | 206500   |
| Running Forward KL  | 0.499    |
| Running Reverse KL  | 3.38     |
| Running Update Time | 413      |
----------------------------------
2025-02-18 10:55:43.477759 ׼ʱ-
| Itration            | 414      |
| Real Det Return     | 359      |
| Real Sto Return     | 323      |
| Reward Loss         | -42      |
| Running Env Steps   | 207000   |
| Running Forward KL  | 0.199    |
| Running Reverse KL  | 3.61     |
| Running Update Time | 414      |
----------------------------------
2025-02-18 10:55:55.709165 ׼ʱ-
| Itration            | 415      |
| Real Det Return     | 343      |
| Real Sto Return     | 317      |
| Reward Loss         | -45.2    |
| Running Env Steps   | 207500   |
| Running Forward KL  | -0.113   |
| Running Reverse KL  | 2.9      |
| Running Update Time | 415      |
----------------------------------
2025-02-18 10:56:08.018736 ׼ʱ-
| Itration            | 416      |
| Real Det Return     | 367      |
| Real Sto Return     | 333      |
| Reward Loss         | -39.5    |
| Running Env Steps   | 208000   |
| Running Forward KL  | 0.468    |
| Running Reverse KL  | 3.54     |
| Running Update Time | 416      |
----------------------------------
2025-02-18 10:56:20.646951 ׼ʱ-
| Itration            | 417      |
| Real Det Return     | 360      |
| Real Sto Return     | 327      |
| Reward Loss         | -40.6    |
| Running Env Steps   | 208500   |
| Running Forward KL  | 0.424    |
| Running Reverse KL  | 3.94     |
| Running Update Time | 417      |
----------------------------------
2025-02-18 10:56:32.987723 ׼ʱ-
| Itration            | 418      |
| Real Det Return     | 347      |
| Real Sto Return     | 327      |
| Reward Loss         | -46.3    |
| Running Env Steps   | 209000   |
| Running Forward KL  | 0.684    |
| Running Reverse KL  | 3.64     |
| Running Update Time | 418      |
----------------------------------
2025-02-18 10:56:45.266026 ׼ʱ-
| Itration            | 419      |
| Real Det Return     | 373      |
| Real Sto Return     | 325      |
| Reward Loss         | -50.3    |
| Running Env Steps   | 209500   |
| Running Forward KL  | 0.778    |
| Running Reverse KL  | 2.89     |
| Running Update Time | 419      |
----------------------------------
2025-02-18 10:56:57.528709 ׼ʱ-
| Itration            | 420      |
| Real Det Return     | 321      |
| Real Sto Return     | 301      |
| Reward Loss         | -52.5    |
| Running Env Steps   | 210000   |
| Running Forward KL  | -0.39    |
| Running Reverse KL  | 3.6      |
| Running Update Time | 420      |
----------------------------------
2025-02-18 10:57:10.092909 ׼ʱ-
| Itration            | 421      |
| Real Det Return     | 330      |
| Real Sto Return     | 315      |
| Reward Loss         | -55.2    |
| Running Env Steps   | 210500   |
| Running Forward KL  | -0.402   |
| Running Reverse KL  | 3.35     |
| Running Update Time | 421      |
----------------------------------
2025-02-18 10:57:22.387246 ׼ʱ-
| Itration            | 422      |
| Real Det Return     | 357      |
| Real Sto Return     | 327      |
| Reward Loss         | -34.6    |
| Running Env Steps   | 211000   |
| Running Forward KL  | 0.313    |
| Running Reverse KL  | 3.67     |
| Running Update Time | 422      |
----------------------------------
2025-02-18 10:57:34.649929 ׼ʱ-
| Itration            | 423      |
| Real Det Return     | 361      |
| Real Sto Return     | 309      |
| Reward Loss         | -51.7    |
| Running Env Steps   | 211500   |
| Running Forward KL  | 0.744    |
| Running Reverse KL  | 4.28     |
| Running Update Time | 423      |
----------------------------------
2025-02-18 10:57:46.912629 ׼ʱ-
| Itration            | 424      |
| Real Det Return     | 351      |
| Real Sto Return     | 319      |
| Reward Loss         | -53.7    |
| Running Env Steps   | 212000   |
| Running Forward KL  | 1.01     |
| Running Reverse KL  | 3.59     |
| Running Update Time | 424      |
----------------------------------
2025-02-18 10:57:59.206557 ׼ʱ-
| Itration            | 425      |
| Real Det Return     | 364      |
| Real Sto Return     | 326      |
| Reward Loss         | -44.1    |
| Running Env Steps   | 212500   |
| Running Forward KL  | 0.492    |
| Running Reverse KL  | 3.49     |
| Running Update Time | 425      |
----------------------------------
2025-02-18 10:58:11.516083 ׼ʱ-
| Itration            | 426      |
| Real Det Return     | 326      |
| Real Sto Return     | 298      |
| Reward Loss         | -56.2    |
| Running Env Steps   | 213000   |
| Running Forward KL  | 0.63     |
| Running Reverse KL  | 3.4      |
| Running Update Time | 426      |
----------------------------------
2025-02-18 10:58:24.146164 ׼ʱ-
| Itration            | 427      |
| Real Det Return     | 361      |
| Real Sto Return     | 327      |
| Reward Loss         | -35.4    |
| Running Env Steps   | 213500   |
| Running Forward KL  | 0.0811   |
| Running Reverse KL  | 3.46     |
| Running Update Time | 427      |
----------------------------------
2025-02-18 10:58:36.346385 ׼ʱ-
| Itration            | 428      |
| Real Det Return     | 346      |
| Real Sto Return     | 334      |
| Reward Loss         | -41.3    |
| Running Env Steps   | 214000   |
| Running Forward KL  | 0.0596   |
| Running Reverse KL  | 3.49     |
| Running Update Time | 428      |
----------------------------------
2025-02-18 10:58:48.640310 ׼ʱ-
| Itration            | 429      |
| Real Det Return     | 358      |
| Real Sto Return     | 330      |
| Reward Loss         | -41.5    |
| Running Env Steps   | 214500   |
| Running Forward KL  | 0.0386   |
| Running Reverse KL  | 3.6      |
| Running Update Time | 429      |
----------------------------------
2025-02-18 10:59:01.231015 ׼ʱ-
| Itration            | 430      |
| Real Det Return     | 350      |
| Real Sto Return     | 327      |
| Reward Loss         | -49.1    |
| Running Env Steps   | 215000   |
| Running Forward KL  | 0.495    |
| Running Reverse KL  | 3.89     |
| Running Update Time | 430      |
----------------------------------
2025-02-18 10:59:13.540586 ׼ʱ-
| Itration            | 431      |
| Real Det Return     | 357      |
| Real Sto Return     | 336      |
| Reward Loss         | -48.5    |
| Running Env Steps   | 215500   |
| Running Forward KL  | 0.0994   |
| Running Reverse KL  | 3.61     |
| Running Update Time | 431      |
----------------------------------
2025-02-18 10:59:25.834521 ׼ʱ-
| Itration            | 432      |
| Real Det Return     | 347      |
| Real Sto Return     | 321      |
| Reward Loss         | -32      |
| Running Env Steps   | 216000   |
| Running Forward KL  | -0.422   |
| Running Reverse KL  | 3.12     |
| Running Update Time | 432      |
----------------------------------
2025-02-18 10:59:38.097203 ׼ʱ-
| Itration            | 433      |
| Real Det Return     | 351      |
| Real Sto Return     | 325      |
| Reward Loss         | -45.6    |
| Running Env Steps   | 216500   |
| Running Forward KL  | 0.144    |
| Running Reverse KL  | 3.61     |
| Running Update Time | 433      |
----------------------------------
2025-02-18 10:59:50.359878 ׼ʱ-
| Itration            | 434      |
| Real Det Return     | 361      |
| Real Sto Return     | 321      |
| Reward Loss         | -37      |
| Running Env Steps   | 217000   |
| Running Forward KL  | 0.482    |
| Running Reverse KL  | 3.37     |
| Running Update Time | 434      |
----------------------------------
2025-02-18 11:00:02.669423 ׼ʱ-
| Itration            | 435      |
| Real Det Return     | 348      |
| Real Sto Return     | 331      |
| Reward Loss         | -46.7    |
| Running Env Steps   | 217500   |
| Running Forward KL  | 0.337    |
| Running Reverse KL  | 3.57     |
| Running Update Time | 435      |
----------------------------------
2025-02-18 11:00:14.932116 ׼ʱ-
| Itration            | 436      |
| Real Det Return     | 351      |
| Real Sto Return     | 308      |
| Reward Loss         | -64.4    |
| Running Env Steps   | 218000   |
| Running Forward KL  | 0.742    |
| Running Reverse KL  | 3.38     |
| Running Update Time | 436      |
----------------------------------
2025-02-18 11:00:27.589911 ׼ʱ-
| Itration            | 437      |
| Real Det Return     | 341      |
| Real Sto Return     | 310      |
| Reward Loss         | -43.2    |
| Running Env Steps   | 218500   |
| Running Forward KL  | 0.259    |
| Running Reverse KL  | 3.57     |
| Running Update Time | 437      |
----------------------------------
2025-02-18 11:00:39.930722 ׼ʱ-
| Itration            | 438      |
| Real Det Return     | 352      |
| Real Sto Return     | 325      |
| Reward Loss         | -68.4    |
| Running Env Steps   | 219000   |
| Running Forward KL  | 1.01     |
| Running Reverse KL  | 3.35     |
| Running Update Time | 438      |
----------------------------------
2025-02-18 11:00:52.302731 ׼ʱ-
| Itration            | 439      |
| Real Det Return     | 372      |
| Real Sto Return     | 328      |
| Reward Loss         | -48.2    |
| Running Env Steps   | 219500   |
| Running Forward KL  | 0.334    |
| Running Reverse KL  | 3.64     |
| Running Update Time | 439      |
----------------------------------
2025-02-18 11:01:04.737257 ׼ʱ-
| Itration            | 440      |
| Real Det Return     | 327      |
| Real Sto Return     | 317      |
| Reward Loss         | -57.5    |
| Running Env Steps   | 220000   |
| Running Forward KL  | 0.302    |
| Running Reverse KL  | 3.42     |
| Running Update Time | 440      |
----------------------------------
2025-02-18 11:01:17.062432 ׼ʱ-
| Itration            | 441      |
| Real Det Return     | 367      |
| Real Sto Return     | 334      |
| Reward Loss         | -34      |
| Running Env Steps   | 220500   |
| Running Forward KL  | -0.441   |
| Running Reverse KL  | 3.51     |
| Running Update Time | 441      |
----------------------------------
2025-02-18 11:01:29.356341 ׼ʱ-
| Itration            | 442      |
| Real Det Return     | 354      |
| Real Sto Return     | 333      |
| Reward Loss         | -36.5    |
| Running Env Steps   | 221000   |
| Running Forward KL  | -0.218   |
| Running Reverse KL  | 3.39     |
| Running Update Time | 442      |
----------------------------------
2025-02-18 11:01:41.681525 ׼ʱ-
| Itration            | 443      |
| Real Det Return     | 352      |
| Real Sto Return     | 332      |
| Reward Loss         | -45.2    |
| Running Env Steps   | 221500   |
| Running Forward KL  | 0.233    |
| Running Reverse KL  | 3.79     |
| Running Update Time | 443      |
----------------------------------
2025-02-18 11:01:53.944203 ׼ʱ-
| Itration            | 444      |
| Real Det Return     | 361      |
| Real Sto Return     | 333      |
| Reward Loss         | -41.5    |
| Running Env Steps   | 222000   |
| Running Forward KL  | 0.11     |
| Running Reverse KL  | 3.48     |
| Running Update Time | 444      |
----------------------------------
2025-02-18 11:02:06.269359 ׼ʱ-
| Itration            | 445      |
| Real Det Return     | 348      |
| Real Sto Return     | 328      |
| Reward Loss         | -46.8    |
| Running Env Steps   | 222500   |
| Running Forward KL  | -0.0384  |
| Running Reverse KL  | 3.49     |
| Running Update Time | 445      |
----------------------------------
2025-02-18 11:02:18.563303 ׼ʱ-
| Itration            | 446      |
| Real Det Return     | 354      |
| Real Sto Return     | 344      |
| Reward Loss         | -39.6    |
| Running Env Steps   | 223000   |
| Running Forward KL  | -0.311   |
| Running Reverse KL  | 3.69     |
| Running Update Time | 446      |
----------------------------------
2025-02-18 11:02:31.264612 ׼ʱ-
| Itration            | 447      |
| Real Det Return     | 330      |
| Real Sto Return     | 315      |
| Reward Loss         | -52.9    |
| Running Env Steps   | 223500   |
| Running Forward KL  | 0.486    |
| Running Reverse KL  | 3.78     |
| Running Update Time | 447      |
----------------------------------
2025-02-18 11:02:43.668301 ׼ʱ-
| Itration            | 448      |
| Real Det Return     | 348      |
| Real Sto Return     | 332      |
| Reward Loss         | -26.4    |
| Running Env Steps   | 224000   |
| Running Forward KL  | 0.177    |
| Running Reverse KL  | 3.55     |
| Running Update Time | 448      |
----------------------------------
2025-02-18 11:02:56.009107 ׼ʱ-
| Itration            | 449      |
| Real Det Return     | 348      |
| Real Sto Return     | 318      |
| Reward Loss         | -36.6    |
| Running Env Steps   | 224500   |
| Running Forward KL  | -0.487   |
| Running Reverse KL  | 2.95     |
| Running Update Time | 449      |
----------------------------------
2025-02-18 11:03:08.365666 ׼ʱ-
| Itration            | 450      |
| Real Det Return     | 363      |
| Real Sto Return     | 347      |
| Reward Loss         | -40.6    |
| Running Env Steps   | 225000   |
| Running Forward KL  | 0.0061   |
| Running Reverse KL  | 3.57     |
| Running Update Time | 450      |
----------------------------------
2025-02-18 11:03:20.659581 ׼ʱ-
| Itration            | 451      |
| Real Det Return     | 367      |
| Real Sto Return     | 332      |
| Reward Loss         | -34.4    |
| Running Env Steps   | 225500   |
| Running Forward KL  | -0.509   |
| Running Reverse KL  | 3.82     |
| Running Update Time | 451      |
----------------------------------
2025-02-18 11:03:32.953527 ׼ʱ-
| Itration            | 452      |
| Real Det Return     | 365      |
| Real Sto Return     | 339      |
| Reward Loss         | -41.2    |
| Running Env Steps   | 226000   |
| Running Forward KL  | 0.126    |
| Running Reverse KL  | 3.65     |
| Running Update Time | 452      |
----------------------------------
2025-02-18 11:03:45.231810 ׼ʱ-
| Itration            | 453      |
| Real Det Return     | 356      |
| Real Sto Return     | 333      |
| Reward Loss         | -43.6    |
| Running Env Steps   | 226500   |
| Running Forward KL  | 0.108    |
| Running Reverse KL  | 3.87     |
| Running Update Time | 453      |
----------------------------------
2025-02-18 11:03:57.525710 ׼ʱ-
| Itration            | 454      |
| Real Det Return     | 354      |
| Real Sto Return     | 336      |
| Reward Loss         | -36.5    |
| Running Env Steps   | 227000   |
| Running Forward KL  | -0.0841  |
| Running Reverse KL  | 3.48     |
| Running Update Time | 454      |
----------------------------------
2025-02-18 11:04:09.835288 ׼ʱ-
| Itration            | 455      |
| Real Det Return     | 357      |
| Real Sto Return     | 338      |
| Reward Loss         | -48.5    |
| Running Env Steps   | 227500   |
| Running Forward KL  | 1.13     |
| Running Reverse KL  | 4.13     |
| Running Update Time | 455      |
----------------------------------
2025-02-18 11:04:22.097940 ׼ʱ-
| Itration            | 456      |
| Real Det Return     | 366      |
| Real Sto Return     | 325      |
| Reward Loss         | -48.3    |
| Running Env Steps   | 228000   |
| Running Forward KL  | -0.425   |
| Running Reverse KL  | 3.8      |
| Running Update Time | 456      |
----------------------------------
2025-02-18 11:04:34.824438 ׼ʱ-
| Itration            | 457      |
| Real Det Return     | 372      |
| Real Sto Return     | 352      |
| Reward Loss         | -43      |
| Running Env Steps   | 228500   |
| Running Forward KL  | 0.227    |
| Running Reverse KL  | 3.23     |
| Running Update Time | 457      |
----------------------------------
2025-02-18 11:04:47.180848 ׼ʱ-
| Itration            | 458      |
| Real Det Return     | 331      |
| Real Sto Return     | 318      |
| Reward Loss         | -41.8    |
| Running Env Steps   | 229000   |
| Running Forward KL  | 0.286    |
| Running Reverse KL  | 3.46     |
| Running Update Time | 458      |
----------------------------------
2025-02-18 11:04:59.521637 ׼ʱ-
| Itration            | 459      |
| Real Det Return     | 337      |
| Real Sto Return     | 328      |
| Reward Loss         | -56.3    |
| Running Env Steps   | 229500   |
| Running Forward KL  | -0.432   |
| Running Reverse KL  | 3.47     |
| Running Update Time | 459      |
----------------------------------
2025-02-18 11:05:11.878049 ׼ʱ-
| Itration            | 460      |
| Real Det Return     | 356      |
| Real Sto Return     | 338      |
| Reward Loss         | -28.9    |
| Running Env Steps   | 230000   |
| Running Forward KL  | -0.603   |
| Running Reverse KL  | 3.74     |
| Running Update Time | 460      |
----------------------------------
2025-02-18 11:05:24.265676 ׼ʱ-
| Itration            | 461      |
| Real Det Return     | 345      |
| Real Sto Return     | 332      |
| Reward Loss         | -43.8    |
| Running Env Steps   | 230500   |
| Running Forward KL  | 0.201    |
| Running Reverse KL  | 4.06     |
| Running Update Time | 461      |
----------------------------------
2025-02-18 11:05:36.606489 ׼ʱ-
| Itration            | 462      |
| Real Det Return     | 375      |
| Real Sto Return     | 348      |
| Reward Loss         | -36.4    |
| Running Env Steps   | 231000   |
| Running Forward KL  | -0.358   |
| Running Reverse KL  | 3.57     |
| Running Update Time | 462      |
----------------------------------
2025-02-18 11:05:48.869170 ׼ʱ-
| Itration            | 463      |
| Real Det Return     | 360      |
| Real Sto Return     | 338      |
| Reward Loss         | -33.7    |
| Running Env Steps   | 231500   |
| Running Forward KL  | -0.606   |
| Running Reverse KL  | 3.47     |
| Running Update Time | 463      |
----------------------------------
2025-02-18 11:06:01.179900 ׼ʱ-
| Itration            | 464      |
| Real Det Return     | 351      |
| Real Sto Return     | 342      |
| Reward Loss         | -30.4    |
| Running Env Steps   | 232000   |
| Running Forward KL  | -0.107   |
| Running Reverse KL  | 3.47     |
| Running Update Time | 464      |
----------------------------------
2025-02-18 11:06:13.474608 ׼ʱ-
| Itration            | 465      |
| Real Det Return     | 336      |
| Real Sto Return     | 313      |
| Reward Loss         | -53.2    |
| Running Env Steps   | 232500   |
| Running Forward KL  | -0.126   |
| Running Reverse KL  | 3.68     |
| Running Update Time | 465      |
----------------------------------
2025-02-18 11:06:25.768542 ׼ʱ-
| Itration            | 466      |
| Real Det Return     | 359      |
| Real Sto Return     | 341      |
| Reward Loss         | -34.1    |
| Running Env Steps   | 233000   |
| Running Forward KL  | 0.383    |
| Running Reverse KL  | 3.94     |
| Running Update Time | 466      |
----------------------------------
2025-02-18 11:06:38.572020 ׼ʱ-
| Itration            | 467      |
| Real Det Return     | 368      |
| Real Sto Return     | 349      |
| Reward Loss         | -40      |
| Running Env Steps   | 233500   |
| Running Forward KL  | -0.198   |
| Running Reverse KL  | 3.3      |
| Running Update Time | 467      |
----------------------------------
2025-02-18 11:06:50.865947 ׼ʱ-
| Itration            | 468      |
| Real Det Return     | 353      |
| Real Sto Return     | 339      |
| Reward Loss         | -33.1    |
| Running Env Steps   | 234000   |
| Running Forward KL  | -0.882   |
| Running Reverse KL  | 3.67     |
| Running Update Time | 468      |
----------------------------------
2025-02-18 11:07:03.206734 ׼ʱ-
| Itration            | 469      |
| Real Det Return     | 366      |
| Real Sto Return     | 347      |
| Reward Loss         | -33.7    |
| Running Env Steps   | 234500   |
| Running Forward KL  | 0.0892   |
| Running Reverse KL  | 3.63     |
| Running Update Time | 469      |
----------------------------------
2025-02-18 11:07:15.516290 ׼ʱ-
| Itration            | 470      |
| Real Det Return     | 372      |
| Real Sto Return     | 348      |
| Reward Loss         | -33.4    |
| Running Env Steps   | 235000   |
| Running Forward KL  | 0.791    |
| Running Reverse KL  | 3.94     |
| Running Update Time | 470      |
----------------------------------
2025-02-18 11:07:27.903942 ׼ʱ-
| Itration            | 471      |
| Real Det Return     | 365      |
| Real Sto Return     | 345      |
| Reward Loss         | -35.9    |
| Running Env Steps   | 235500   |
| Running Forward KL  | -0.133   |
| Running Reverse KL  | 3.84     |
| Running Update Time | 471      |
----------------------------------
2025-02-18 11:07:40.213479 ׼ʱ-
| Itration            | 472      |
| Real Det Return     | 370      |
| Real Sto Return     | 338      |
| Reward Loss         | -23.8    |
| Running Env Steps   | 236000   |
| Running Forward KL  | -0.955   |
| Running Reverse KL  | 3.67     |
| Running Update Time | 472      |
----------------------------------
2025-02-18 11:07:52.476162 ׼ʱ-
| Itration            | 473      |
| Real Det Return     | 343      |
| Real Sto Return     | 333      |
| Reward Loss         | -36      |
| Running Env Steps   | 236500   |
| Running Forward KL  | -0.987   |
| Running Reverse KL  | 3.95     |
| Running Update Time | 473      |
----------------------------------
2025-02-18 11:08:04.785708 ׼ʱ-
| Itration            | 474      |
| Real Det Return     | 362      |
| Real Sto Return     | 336      |
| Reward Loss         | -42.2    |
| Running Env Steps   | 237000   |
| Running Forward KL  | 0.0167   |
| Running Reverse KL  | 3.43     |
| Running Update Time | 474      |
----------------------------------
2025-02-18 11:08:17.267088 ׼ʱ-
| Itration            | 475      |
| Real Det Return     | 373      |
| Real Sto Return     | 339      |
| Reward Loss         | -26.6    |
| Running Env Steps   | 237500   |
| Running Forward KL  | -0.031   |
| Running Reverse KL  | 3.21     |
| Running Update Time | 475      |
----------------------------------
2025-02-18 11:08:29.576644 ׼ʱ-
| Itration            | 476      |
| Real Det Return     | 362      |
| Real Sto Return     | 335      |
| Reward Loss         | -44.4    |
| Running Env Steps   | 238000   |
| Running Forward KL  | 0.172    |
| Running Reverse KL  | 3.43     |
| Running Update Time | 476      |
----------------------------------
2025-02-18 11:08:42.295457 ׼ʱ-
| Itration            | 477      |
| Real Det Return     | 357      |
| Real Sto Return     | 338      |
| Reward Loss         | -40.7    |
| Running Env Steps   | 238500   |
| Running Forward KL  | -0.108   |
| Running Reverse KL  | 3.68     |
| Running Update Time | 477      |
----------------------------------
2025-02-18 11:08:54.636248 ׼ʱ-
| Itration            | 478      |
| Real Det Return     | 359      |
| Real Sto Return     | 350      |
| Reward Loss         | -32.5    |
| Running Env Steps   | 239000   |
| Running Forward KL  | -0.14    |
| Running Reverse KL  | 3.55     |
| Running Update Time | 478      |
----------------------------------
2025-02-18 11:09:07.070801 ׼ʱ-
| Itration            | 479      |
| Real Det Return     | 345      |
| Real Sto Return     | 322      |
| Reward Loss         | -58.6    |
| Running Env Steps   | 239500   |
| Running Forward KL  | 0.293    |
| Running Reverse KL  | 3.21     |
| Running Update Time | 479      |
----------------------------------
2025-02-18 11:09:19.427210 ׼ʱ-
| Itration            | 480      |
| Real Det Return     | 357      |
| Real Sto Return     | 347      |
| Reward Loss         | -30.2    |
| Running Env Steps   | 240000   |
| Running Forward KL  | -0.123   |
| Running Reverse KL  | 3.47     |
| Running Update Time | 480      |
----------------------------------
2025-02-18 11:09:31.752366 ׼ʱ-
| Itration            | 481      |
| Real Det Return     | 374      |
| Real Sto Return     | 345      |
| Reward Loss         | -32.4    |
| Running Env Steps   | 240500   |
| Running Forward KL  | 0.0642   |
| Running Reverse KL  | 4.04     |
| Running Update Time | 481      |
----------------------------------
2025-02-18 11:09:44.061912 ׼ʱ-
| Itration            | 482      |
| Real Det Return     | 356      |
| Real Sto Return     | 341      |
| Reward Loss         | -38.9    |
| Running Env Steps   | 241000   |
| Running Forward KL  | -0.528   |
| Running Reverse KL  | 3.6      |
| Running Update Time | 482      |
----------------------------------
2025-02-18 11:09:56.297265 ׼ʱ-
| Itration            | 483      |
| Real Det Return     | 377      |
| Real Sto Return     | 348      |
| Reward Loss         | -36.6    |
| Running Env Steps   | 241500   |
| Running Forward KL  | 0.107    |
| Running Reverse KL  | 4.19     |
| Running Update Time | 483      |
----------------------------------
2025-02-18 11:10:08.669296 ׼ʱ-
| Itration            | 484      |
| Real Det Return     | 362      |
| Real Sto Return     | 346      |
| Reward Loss         | -31.4    |
| Running Env Steps   | 242000   |
| Running Forward KL  | -0.702   |
| Running Reverse KL  | 3.23     |
| Running Update Time | 484      |
----------------------------------
2025-02-18 11:10:20.947599 ׼ʱ-
| Itration            | 485      |
| Real Det Return     | 372      |
| Real Sto Return     | 349      |
| Reward Loss         | -29.2    |
| Running Env Steps   | 242500   |
| Running Forward KL  | -0.087   |
| Running Reverse KL  | 3.59     |
| Running Update Time | 485      |
----------------------------------
2025-02-18 11:10:33.241538 ׼ʱ-
| Itration            | 486      |
| Real Det Return     | 385      |
| Real Sto Return     | 364      |
| Reward Loss         | -35.5    |
| Running Env Steps   | 243000   |
| Running Forward KL  | -0.0148  |
| Running Reverse KL  | 3.29     |
| Running Update Time | 486      |
----------------------------------
2025-02-18 11:10:45.933156 ׼ʱ-
| Itration            | 487      |
| Real Det Return     | 373      |
| Real Sto Return     | 350      |
| Reward Loss         | -34      |
| Running Env Steps   | 243500   |
| Running Forward KL  | -0.851   |
| Running Reverse KL  | 3.04     |
| Running Update Time | 487      |
----------------------------------
2025-02-18 11:10:58.305188 ׼ʱ-
| Itration            | 488      |
| Real Det Return     | 366      |
| Real Sto Return     | 346      |
| Reward Loss         | -27      |
| Running Env Steps   | 244000   |
| Running Forward KL  | -0.175   |
| Running Reverse KL  | 3.82     |
| Running Update Time | 488      |
----------------------------------
2025-02-18 11:11:10.692809 ׼ʱ-
| Itration            | 489      |
| Real Det Return     | 348      |
| Real Sto Return     | 337      |
| Reward Loss         | -38.3    |
| Running Env Steps   | 244500   |
| Running Forward KL  | 0.199    |
| Running Reverse KL  | 4.16     |
| Running Update Time | 489      |
----------------------------------
2025-02-18 11:11:23.002822 ׼ʱ-
| Itration            | 490      |
| Real Det Return     | 366      |
| Real Sto Return     | 360      |
| Reward Loss         | -34.5    |
| Running Env Steps   | 245000   |
| Running Forward KL  | -0.433   |
| Running Reverse KL  | 3.67     |
| Running Update Time | 490      |
----------------------------------
2025-02-18 11:11:35.312368 ׼ʱ-
| Itration            | 491      |
| Real Det Return     | 355      |
| Real Sto Return     | 341      |
| Reward Loss         | -42.3    |
| Running Env Steps   | 245500   |
| Running Forward KL  | 0.434    |
| Running Reverse KL  | 4.34     |
| Running Update Time | 491      |
----------------------------------
2025-02-18 11:11:47.621914 ׼ʱ-
| Itration            | 492      |
| Real Det Return     | 377      |
| Real Sto Return     | 351      |
| Reward Loss         | -33.2    |
| Running Env Steps   | 246000   |
| Running Forward KL  | -0.265   |
| Running Reverse KL  | 3.41     |
| Running Update Time | 492      |
----------------------------------
2025-02-18 11:11:59.900218 ׼ʱ-
| Itration            | 493      |
| Real Det Return     | 374      |
| Real Sto Return     | 338      |
| Reward Loss         | -37.3    |
| Running Env Steps   | 246500   |
| Running Forward KL  | -0.248   |
| Running Reverse KL  | 3.63     |
| Running Update Time | 493      |
----------------------------------
2025-02-18 11:12:12.287871 ׼ʱ-
| Itration            | 494      |
| Real Det Return     | 381      |
| Real Sto Return     | 339      |
| Reward Loss         | -52.5    |
| Running Env Steps   | 247000   |
| Running Forward KL  | -0.153   |
| Running Reverse KL  | 3.59     |
| Running Update Time | 494      |
----------------------------------
2025-02-18 11:12:24.581796 ׼ʱ-
| Itration            | 495      |
| Real Det Return     | 369      |
| Real Sto Return     | 328      |
| Reward Loss         | -34.4    |
| Running Env Steps   | 247500   |
| Running Forward KL  | -0.269   |
| Running Reverse KL  | 3.62     |
| Running Update Time | 495      |
----------------------------------
2025-02-18 11:12:36.860108 ׼ʱ-
| Itration            | 496      |
| Real Det Return     | 384      |
| Real Sto Return     | 341      |
| Reward Loss         | -62.9    |
| Running Env Steps   | 248000   |
| Running Forward KL  | 0.211    |
| Running Reverse KL  | 3.77     |
| Running Update Time | 496      |
----------------------------------
2025-02-18 11:12:49.553832 ׼ʱ-
| Itration            | 497      |
| Real Det Return     | 365      |
| Real Sto Return     | 346      |
| Reward Loss         | -43.3    |
| Running Env Steps   | 248500   |
| Running Forward KL  | 0.497    |
| Running Reverse KL  | 3.22     |
| Running Update Time | 497      |
----------------------------------
2025-02-18 11:13:01.894621 ׼ʱ-
| Itration            | 498      |
| Real Det Return     | 387      |
| Real Sto Return     | 357      |
| Reward Loss         | -34.4    |
| Running Env Steps   | 249000   |
| Running Forward KL  | 0.0726   |
| Running Reverse KL  | 4.03     |
| Running Update Time | 498      |
----------------------------------
2025-02-18 11:13:14.313515 ׼ʱ-
| Itration            | 499      |
| Real Det Return     | 354      |
| Real Sto Return     | 338      |
| Reward Loss         | -44.2    |
| Running Env Steps   | 249500   |
| Running Forward KL  | -0.137   |
| Running Reverse KL  | 3.82     |
| Running Update Time | 499      |
----------------------------------
2025-02-18 11:13:26.623062 ׼ʱ-
| Itration            | 500      |
| Real Det Return     | 367      |
| Real Sto Return     | 352      |
| Reward Loss         | -31.3    |
| Running Env Steps   | 250000   |
| Running Forward KL  | -0.334   |
| Running Reverse KL  | 3.62     |
| Running Update Time | 500      |
----------------------------------
2025-02-18 11:13:39.057578 ׼ʱ-
| Itration            | 501      |
| Real Det Return     | 370      |
| Real Sto Return     | 341      |
| Reward Loss         | -42.6    |
| Running Env Steps   | 250500   |
| Running Forward KL  | -0.421   |
| Running Reverse KL  | 3.49     |
| Running Update Time | 501      |
----------------------------------
2025-02-18 11:13:51.367136 ׼ʱ-
| Itration            | 502      |
| Real Det Return     | 363      |
| Real Sto Return     | 341      |
| Reward Loss         | -33.9    |
| Running Env Steps   | 251000   |
| Running Forward KL  | -0.607   |
| Running Reverse KL  | 4.09     |
| Running Update Time | 502      |
----------------------------------
2025-02-18 11:14:03.661049 ׼ʱ-
| Itration            | 503      |
| Real Det Return     | 377      |
| Real Sto Return     | 313      |
| Reward Loss         | -27.6    |
| Running Env Steps   | 251500   |
| Running Forward KL  | -0.283   |
| Running Reverse KL  | 3.76     |
| Running Update Time | 503      |
----------------------------------
2025-02-18 11:14:15.939365 ׼ʱ-
| Itration            | 504      |
| Real Det Return     | 359      |
| Real Sto Return     | 345      |
| Reward Loss         | -35.4    |
| Running Env Steps   | 252000   |
| Running Forward KL  | -0.521   |
| Running Reverse KL  | 3.6      |
| Running Update Time | 504      |
----------------------------------
2025-02-18 11:14:28.233290 ׼ʱ-
| Itration            | 505      |
| Real Det Return     | 379      |
| Real Sto Return     | 345      |
| Reward Loss         | -33.5    |
| Running Env Steps   | 252500   |
| Running Forward KL  | 0.159    |
| Running Reverse KL  | 3.53     |
| Running Update Time | 505      |
----------------------------------
2025-02-18 11:14:40.511582 ׼ʱ-
| Itration            | 506      |
| Real Det Return     | 355      |
| Real Sto Return     | 339      |
| Reward Loss         | -33.8    |
| Running Env Steps   | 253000   |
| Running Forward KL  | 0.0353   |
| Running Reverse KL  | 3.4      |
| Running Update Time | 506      |
----------------------------------
2025-02-18 11:14:53.160158 ׼ʱ-
| Itration            | 507      |
| Real Det Return     | 357      |
| Real Sto Return     | 337      |
| Reward Loss         | -39.7    |
| Running Env Steps   | 253500   |
| Running Forward KL  | -0.706   |
| Running Reverse KL  | 3.65     |
| Running Update Time | 507      |
----------------------------------
2025-02-18 11:15:05.500932 ׼ʱ-
| Itration            | 508      |
| Real Det Return     | 356      |
| Real Sto Return     | 333      |
| Reward Loss         | -36.6    |
| Running Env Steps   | 254000   |
| Running Forward KL  | -0.417   |
| Running Reverse KL  | 4.15     |
| Running Update Time | 508      |
----------------------------------
2025-02-18 11:15:17.810483 ׼ʱ-
| Itration            | 509      |
| Real Det Return     | 378      |
| Real Sto Return     | 338      |
| Reward Loss         | -36.9    |
| Running Env Steps   | 254500   |
| Running Forward KL  | -0.0024  |
| Running Reverse KL  | 4.02     |
| Running Update Time | 509      |
----------------------------------
2025-02-18 11:15:30.135659 ׼ʱ-
| Itration            | 510      |
| Real Det Return     | 354      |
| Real Sto Return     | 343      |
| Reward Loss         | -34.4    |
| Running Env Steps   | 255000   |
| Running Forward KL  | -1.05    |
| Running Reverse KL  | 3.41     |
| Running Update Time | 510      |
----------------------------------
2025-02-18 11:15:42.445196 ׼ʱ-
| Itration            | 511      |
| Real Det Return     | 380      |
| Real Sto Return     | 341      |
| Reward Loss         | -63.2    |
| Running Env Steps   | 255500   |
| Running Forward KL  | 0.0548   |
| Running Reverse KL  | 3.21     |
| Running Update Time | 511      |
----------------------------------
2025-02-18 11:15:54.739131 ׼ʱ-
| Itration            | 512      |
| Real Det Return     | 365      |
| Real Sto Return     | 324      |
| Reward Loss         | -30.2    |
| Running Env Steps   | 256000   |
| Running Forward KL  | -0.258   |
| Running Reverse KL  | 3.76     |
| Running Update Time | 512      |
----------------------------------
2025-02-18 11:16:07.189268 ׼ʱ-
| Itration            | 513      |
| Real Det Return     | 368      |
| Real Sto Return     | 345      |
| Reward Loss         | -30.7    |
| Running Env Steps   | 256500   |
| Running Forward KL  | -0.488   |
| Running Reverse KL  | 3.31     |
| Running Update Time | 513      |
----------------------------------
2025-02-18 11:16:19.483184 ׼ʱ-
| Itration            | 514      |
| Real Det Return     | 361      |
| Real Sto Return     | 349      |
| Reward Loss         | -39.5    |
| Running Env Steps   | 257000   |
| Running Forward KL  | -0.364   |
| Running Reverse KL  | 3.58     |
| Running Update Time | 514      |
----------------------------------
2025-02-18 11:16:31.761488 ׼ʱ-
| Itration            | 515      |
| Real Det Return     | 365      |
| Real Sto Return     | 340      |
| Reward Loss         | -34.5    |
| Running Env Steps   | 257500   |
| Running Forward KL  | 0.0893   |
| Running Reverse KL  | 3.8      |
| Running Update Time | 515      |
----------------------------------
2025-02-18 11:16:44.196003 ׼ʱ-
| Itration            | 516      |
| Real Det Return     | 372      |
| Real Sto Return     | 347      |
| Reward Loss         | -43.8    |
| Running Env Steps   | 258000   |
| Running Forward KL  | 0.506    |
| Running Reverse KL  | 3.43     |
| Running Update Time | 516      |
----------------------------------
2025-02-18 11:16:56.929108 ׼ʱ-
| Itration            | 517      |
| Real Det Return     | 331      |
| Real Sto Return     | 327      |
| Reward Loss         | -41      |
| Running Env Steps   | 258500   |
| Running Forward KL  | -0.492   |
| Running Reverse KL  | 3.27     |
| Running Update Time | 517      |
----------------------------------
2025-02-18 11:17:09.285518 ׼ʱ-
| Itration            | 518      |
| Real Det Return     | 373      |
| Real Sto Return     | 359      |
| Reward Loss         | -20.8    |
| Running Env Steps   | 259000   |
| Running Forward KL  | -0.463   |
| Running Reverse KL  | 3.38     |
| Running Update Time | 518      |
----------------------------------
2025-02-18 11:17:21.610676 ׼ʱ-
| Itration            | 519      |
| Real Det Return     | 388      |
| Real Sto Return     | 349      |
| Reward Loss         | -30.5    |
| Running Env Steps   | 259500   |
| Running Forward KL  | -0.321   |
| Running Reverse KL  | 3.85     |
| Running Update Time | 519      |
----------------------------------
2025-02-18 11:17:34.013950 ׼ʱ-
| Itration            | 520      |
| Real Det Return     | 352      |
| Real Sto Return     | 347      |
| Reward Loss         | -39.6    |
| Running Env Steps   | 260000   |
| Running Forward KL  | -0.465   |
| Running Reverse KL  | 3.5      |
| Running Update Time | 520      |
----------------------------------
2025-02-18 11:17:46.323496 ׼ʱ-
| Itration            | 521      |
| Real Det Return     | 376      |
| Real Sto Return     | 353      |
| Reward Loss         | -35.4    |
| Running Env Steps   | 260500   |
| Running Forward KL  | 0.298    |
| Running Reverse KL  | 4.1      |
| Running Update Time | 521      |
----------------------------------
2025-02-18 11:17:58.726770 ׼ʱ-
| Itration            | 522      |
| Real Det Return     | 362      |
| Real Sto Return     | 345      |
| Reward Loss         | -33.5    |
| Running Env Steps   | 261000   |
| Running Forward KL  | -0.65    |
| Running Reverse KL  | 3.61     |
| Running Update Time | 522      |
----------------------------------
2025-02-18 11:18:11.051948 ׼ʱ-
| Itration            | 523      |
| Real Det Return     | 376      |
| Real Sto Return     | 355      |
| Reward Loss         | -27.4    |
| Running Env Steps   | 261500   |
| Running Forward KL  | -0.941   |
| Running Reverse KL  | 3.34     |
| Running Update Time | 523      |
----------------------------------
2025-02-18 11:18:23.345862 ׼ʱ-
| Itration            | 524      |
| Real Det Return     | 348      |
| Real Sto Return     | 335      |
| Reward Loss         | -42.9    |
| Running Env Steps   | 262000   |
| Running Forward KL  | -0.888   |
| Running Reverse KL  | 3.42     |
| Running Update Time | 524      |
----------------------------------
2025-02-18 11:18:35.624166 ׼ʱ-
| Itration            | 525      |
| Real Det Return     | 351      |
| Real Sto Return     | 331      |
| Reward Loss         | -44.7    |
| Running Env Steps   | 262500   |
| Running Forward KL  | -0.461   |
| Running Reverse KL  | 3.46     |
| Running Update Time | 525      |
----------------------------------
2025-02-18 11:18:47.949309 ׼ʱ-
| Itration            | 526      |
| Real Det Return     | 366      |
| Real Sto Return     | 350      |
| Reward Loss         | -33.3    |
| Running Env Steps   | 263000   |
| Running Forward KL  | -0.355   |
| Running Reverse KL  | 3.07     |
| Running Update Time | 526      |
----------------------------------
2025-02-18 11:19:00.588784 ׼ʱ-
| Itration            | 527      |
| Real Det Return     | 353      |
| Real Sto Return     | 340      |
| Reward Loss         | -43      |
| Running Env Steps   | 263500   |
| Running Forward KL  | -0.609   |
| Running Reverse KL  | 3.33     |
| Running Update Time | 527      |
----------------------------------
2025-02-18 11:19:13.101396 ׼ʱ-
| Itration            | 528      |
| Real Det Return     | 383      |
| Real Sto Return     | 353      |
| Reward Loss         | -30.5    |
| Running Env Steps   | 264000   |
| Running Forward KL  | -0.338   |
| Running Reverse KL  | 4.12     |
| Running Update Time | 528      |
----------------------------------
2025-02-18 11:19:25.426565 ׼ʱ-
| Itration            | 529      |
| Real Det Return     | 386      |
| Real Sto Return     | 363      |
| Reward Loss         | -34.2    |
| Running Env Steps   | 264500   |
| Running Forward KL  | -1.19    |
| Running Reverse KL  | 3.92     |
| Running Update Time | 529      |
----------------------------------
2025-02-18 11:19:37.751730 ׼ʱ-
| Itration            | 530      |
| Real Det Return     | 368      |
| Real Sto Return     | 348      |
| Reward Loss         | -34.9    |
| Running Env Steps   | 265000   |
| Running Forward KL  | -0.868   |
| Running Reverse KL  | 3.37     |
| Running Update Time | 530      |
----------------------------------
2025-02-18 11:19:50.061280 ׼ʱ-
| Itration            | 531      |
| Real Det Return     | 379      |
| Real Sto Return     | 361      |
| Reward Loss         | -32.1    |
| Running Env Steps   | 265500   |
| Running Forward KL  | -1.1     |
| Running Reverse KL  | 3.07     |
| Running Update Time | 531      |
----------------------------------
2025-02-18 11:20:02.386454 ׼ʱ-
| Itration            | 532      |
| Real Det Return     | 348      |
| Real Sto Return     | 336      |
| Reward Loss         | -42.8    |
| Running Env Steps   | 266000   |
| Running Forward KL  | -0.674   |
| Running Reverse KL  | 3.36     |
| Running Update Time | 532      |
----------------------------------
2025-02-18 11:20:14.836592 ׼ʱ-
| Itration            | 533      |
| Real Det Return     | 377      |
| Real Sto Return     | 348      |
| Reward Loss         | -33.6    |
| Running Env Steps   | 266500   |
| Running Forward KL  | -0.311   |
| Running Reverse KL  | 3.88     |
| Running Update Time | 533      |
----------------------------------
2025-02-18 11:20:27.130516 ׼ʱ-
| Itration            | 534      |
| Real Det Return     | 343      |
| Real Sto Return     | 327      |
| Reward Loss         | -48.2    |
| Running Env Steps   | 267000   |
| Running Forward KL  | -0.973   |
| Running Reverse KL  | 3.58     |
| Running Update Time | 534      |
----------------------------------
2025-02-18 11:20:39.424432 ׼ʱ-
| Itration            | 535      |
| Real Det Return     | 350      |
| Real Sto Return     | 336      |
| Reward Loss         | -41.1    |
| Running Env Steps   | 267500   |
| Running Forward KL  | -0.007   |
| Running Reverse KL  | 3.7      |
| Running Update Time | 535      |
----------------------------------
2025-02-18 11:20:51.749600 ׼ʱ-
| Itration            | 536      |
| Real Det Return     | 373      |
| Real Sto Return     | 353      |
| Reward Loss         | -33.3    |
| Running Env Steps   | 268000   |
| Running Forward KL  | -0.157   |
| Running Reverse KL  | 4.22     |
| Running Update Time | 536      |
----------------------------------
2025-02-18 11:21:04.521264 ׼ʱ-
| Itration            | 537      |
| Real Det Return     | 365      |
| Real Sto Return     | 345      |
| Reward Loss         | -38.2    |
| Running Env Steps   | 268500   |
| Running Forward KL  | -0.617   |
| Running Reverse KL  | 3.43     |
| Running Update Time | 537      |
----------------------------------
2025-02-18 11:21:16.877674 ׼ʱ-
| Itration            | 538      |
| Real Det Return     | 373      |
| Real Sto Return     | 350      |
| Reward Loss         | -28.4    |
| Running Env Steps   | 269000   |
| Running Forward KL  | -0.693   |
| Running Reverse KL  | 3.68     |
| Running Update Time | 538      |
----------------------------------
2025-02-18 11:21:29.171599 ׼ʱ-
| Itration            | 539      |
| Real Det Return     | 379      |
| Real Sto Return     | 346      |
| Reward Loss         | -34.1    |
| Running Env Steps   | 269500   |
| Running Forward KL  | -0.4     |
| Running Reverse KL  | 4.32     |
| Running Update Time | 539      |
----------------------------------
2025-02-18 11:21:41.496766 ׼ʱ-
| Itration            | 540      |
| Real Det Return     | 370      |
| Real Sto Return     | 347      |
| Reward Loss         | -31      |
| Running Env Steps   | 270000   |
| Running Forward KL  | -0.53    |
| Running Reverse KL  | 3.94     |
| Running Update Time | 540      |
----------------------------------
2025-02-18 11:21:53.884419 ׼ʱ-
| Itration            | 541      |
| Real Det Return     | 361      |
| Real Sto Return     | 356      |
| Reward Loss         | -27.9    |
| Running Env Steps   | 270500   |
| Running Forward KL  | -0.705   |
| Running Reverse KL  | 3.83     |
| Running Update Time | 541      |
----------------------------------
2025-02-18 11:22:06.209595 ׼ʱ-
| Itration            | 542      |
| Real Det Return     | 362      |
| Real Sto Return     | 348      |
| Reward Loss         | -50.3    |
| Running Env Steps   | 271000   |
| Running Forward KL  | -0.684   |
| Running Reverse KL  | 3.63     |
| Running Update Time | 542      |
----------------------------------
2025-02-18 11:22:18.503512 ׼ʱ-
| Itration            | 543      |
| Real Det Return     | 357      |
| Real Sto Return     | 344      |
| Reward Loss         | -40.9    |
| Running Env Steps   | 271500   |
| Running Forward KL  | -0.458   |
| Running Reverse KL  | 3.49     |
| Running Update Time | 543      |
----------------------------------
2025-02-18 11:22:30.813034 ׼ʱ-
| Itration            | 544      |
| Real Det Return     | 367      |
| Real Sto Return     | 346      |
| Reward Loss         | -34.2    |
| Running Env Steps   | 272000   |
| Running Forward KL  | 0.285    |
| Running Reverse KL  | 4.23     |
| Running Update Time | 544      |
----------------------------------
2025-02-18 11:22:43.091372 ׼ʱ-
| Itration            | 545      |
| Real Det Return     | 374      |
| Real Sto Return     | 363      |
| Reward Loss         | -21.4    |
| Running Env Steps   | 272500   |
| Running Forward KL  | -0.828   |
| Running Reverse KL  | 3.56     |
| Running Update Time | 545      |
----------------------------------
2025-02-18 11:22:55.732418 ׼ʱ-
| Itration            | 546      |
| Real Det Return     | 367      |
| Real Sto Return     | 348      |
| Reward Loss         | -46.1    |
| Running Env Steps   | 273000   |
| Running Forward KL  | 0.189    |
| Running Reverse KL  | 3.81     |
| Running Update Time | 546      |
----------------------------------
2025-02-18 11:23:08.292334 ׼ʱ-
| Itration            | 547      |
| Real Det Return     | 371      |
| Real Sto Return     | 341      |
| Reward Loss         | -51.6    |
| Running Env Steps   | 273500   |
| Running Forward KL  | -0.435   |
| Running Reverse KL  | 4.01     |
| Running Update Time | 547      |
----------------------------------
2025-02-18 11:23:20.742468 ׼ʱ-
| Itration            | 548      |
| Real Det Return     | 358      |
| Real Sto Return     | 342      |
| Reward Loss         | -24.6    |
| Running Env Steps   | 274000   |
| Running Forward KL  | -0.545   |
| Running Reverse KL  | 3.7      |
| Running Update Time | 548      |
----------------------------------
2025-02-18 11:23:33.161366 ׼ʱ-
| Itration            | 549      |
| Real Det Return     | 354      |
| Real Sto Return     | 345      |
| Reward Loss         | -35.7    |
| Running Env Steps   | 274500   |
| Running Forward KL  | -1.04    |
| Running Reverse KL  | 3.48     |
| Running Update Time | 549      |
----------------------------------
2025-02-18 11:23:45.470911 ׼ʱ-
| Itration            | 550      |
| Real Det Return     | 386      |
| Real Sto Return     | 355      |
| Reward Loss         | -29.3    |
| Running Env Steps   | 275000   |
| Running Forward KL  | 0.312    |
| Running Reverse KL  | 4.63     |
| Running Update Time | 550      |
----------------------------------
2025-02-18 11:23:57.796067 ׼ʱ-
| Itration            | 551      |
| Real Det Return     | 344      |
| Real Sto Return     | 337      |
| Reward Loss         | -31.6    |
| Running Env Steps   | 275500   |
| Running Forward KL  | -1.01    |
| Running Reverse KL  | 3.51     |
| Running Update Time | 551      |
----------------------------------
2025-02-18 11:24:10.121245 ׼ʱ-
| Itration            | 552      |
| Real Det Return     | 356      |
| Real Sto Return     | 342      |
| Reward Loss         | -28.3    |
| Running Env Steps   | 276000   |
| Running Forward KL  | -0.177   |
| Running Reverse KL  | 3.52     |
| Running Update Time | 552      |
----------------------------------
2025-02-18 11:24:22.399543 ׼ʱ-
| Itration            | 553      |
| Real Det Return     | 359      |
| Real Sto Return     | 349      |
| Reward Loss         | -43.9    |
| Running Env Steps   | 276500   |
| Running Forward KL  | -0.181   |
| Running Reverse KL  | 3.74     |
| Running Update Time | 553      |
----------------------------------
2025-02-18 11:24:34.693463 ׼ʱ-
| Itration            | 554      |
| Real Det Return     | 394      |
| Real Sto Return     | 369      |
| Reward Loss         | -29.9    |
| Running Env Steps   | 277000   |
| Running Forward KL  | -0.559   |
| Running Reverse KL  | 3.45     |
| Running Update Time | 554      |
----------------------------------
2025-02-18 11:24:47.018631 ׼ʱ-
| Itration            | 555      |
| Real Det Return     | 369      |
| Real Sto Return     | 347      |
| Reward Loss         | -40.5    |
| Running Env Steps   | 277500   |
| Running Forward KL  | 0.452    |
| Running Reverse KL  | 4.07     |
| Running Update Time | 555      |
----------------------------------
2025-02-18 11:24:59.687466 ׼ʱ-
| Itration            | 556      |
| Real Det Return     | 368      |
| Real Sto Return     | 339      |
| Reward Loss         | -39.5    |
| Running Env Steps   | 278000   |
| Running Forward KL  | -0.421   |
| Running Reverse KL  | 3.67     |
| Running Update Time | 556      |
----------------------------------
2025-02-18 11:25:12.075128 ׼ʱ-
| Itration            | 557      |
| Real Det Return     | 373      |
| Real Sto Return     | 352      |
| Reward Loss         | -34.3    |
| Running Env Steps   | 278500   |
| Running Forward KL  | -0.336   |
| Running Reverse KL  | 3.84     |
| Running Update Time | 557      |
----------------------------------
2025-02-18 11:25:24.603363 ׼ʱ-
| Itration            | 558      |
| Real Det Return     | 377      |
| Real Sto Return     | 362      |
| Reward Loss         | -36.2    |
| Running Env Steps   | 279000   |
| Running Forward KL  | -0.659   |
| Running Reverse KL  | 2.75     |
| Running Update Time | 558      |
----------------------------------
2025-02-18 11:25:36.959782 ׼ʱ-
| Itration            | 559      |
| Real Det Return     | 387      |
| Real Sto Return     | 357      |
| Reward Loss         | -42.6    |
| Running Env Steps   | 279500   |
| Running Forward KL  | -0.597   |
| Running Reverse KL  | 4.39     |
| Running Update Time | 559      |
----------------------------------
2025-02-18 11:25:49.284940 ׼ʱ-
| Itration            | 560      |
| Real Det Return     | 363      |
| Real Sto Return     | 364      |
| Reward Loss         | -30      |
| Running Env Steps   | 280000   |
| Running Forward KL  | -0.308   |
| Running Reverse KL  | 3.96     |
| Running Update Time | 560      |
----------------------------------
2025-02-18 11:26:01.578865 ׼ʱ-
| Itration            | 561      |
| Real Det Return     | 370      |
| Real Sto Return     | 349      |
| Reward Loss         | -34.3    |
| Running Env Steps   | 280500   |
| Running Forward KL  | -1.27    |
| Running Reverse KL  | 3.34     |
| Running Update Time | 561      |
----------------------------------
2025-02-18 11:26:13.904043 ׼ʱ-
| Itration            | 562      |
| Real Det Return     | 382      |
| Real Sto Return     | 353      |
| Reward Loss         | -44.2    |
| Running Env Steps   | 281000   |
| Running Forward KL  | -0.789   |
| Running Reverse KL  | 3.67     |
| Running Update Time | 562      |
----------------------------------
2025-02-18 11:26:26.229184 ׼ʱ-
| Itration            | 563      |
| Real Det Return     | 375      |
| Real Sto Return     | 356      |
| Reward Loss         | -31.3    |
| Running Env Steps   | 281500   |
| Running Forward KL  | -0.542   |
| Running Reverse KL  | 4.22     |
| Running Update Time | 563      |
----------------------------------
2025-02-18 11:26:38.476271 ׼ʱ-
| Itration            | 564      |
| Real Det Return     | 386      |
| Real Sto Return     | 364      |
| Reward Loss         | -31.1    |
| Running Env Steps   | 282000   |
| Running Forward KL  | -0.765   |
| Running Reverse KL  | 3.71     |
| Running Update Time | 564      |
----------------------------------
2025-02-18 11:26:50.785820 ׼ʱ-
| Itration            | 565      |
| Real Det Return     | 377      |
| Real Sto Return     | 344      |
| Reward Loss         | -43.7    |
| Running Env Steps   | 282500   |
| Running Forward KL  | -0.955   |
| Running Reverse KL  | 3.45     |
| Running Update Time | 565      |
----------------------------------
2025-02-18 11:27:03.386283 ׼ʱ-
| Itration            | 566      |
| Real Det Return     | 364      |
| Real Sto Return     | 356      |
| Reward Loss         | -23.9    |
| Running Env Steps   | 283000   |
| Running Forward KL  | -0.589   |
| Running Reverse KL  | 3.91     |
| Running Update Time | 566      |
----------------------------------
2025-02-18 11:27:15.665762 ׼ʱ-
| Itration            | 567      |
| Real Det Return     | 369      |
| Real Sto Return     | 349      |
| Reward Loss         | -29.5    |
| Running Env Steps   | 283500   |
| Running Forward KL  | -0.965   |
| Running Reverse KL  | 3.55     |
| Running Update Time | 567      |
----------------------------------
2025-02-18 11:27:28.131535 ׼ʱ-
| Itration            | 568      |
| Real Det Return     | 370      |
| Real Sto Return     | 352      |
| Reward Loss         | -39.7    |
| Running Env Steps   | 284000   |
| Running Forward KL  | -0.782   |
| Running Reverse KL  | 3.52     |
| Running Update Time | 568      |
----------------------------------
2025-02-18 11:27:40.412581 ׼ʱ-
| Itration            | 569      |
| Real Det Return     | 361      |
| Real Sto Return     | 347      |
| Reward Loss         | -39.2    |
| Running Env Steps   | 284500   |
| Running Forward KL  | -0.557   |
| Running Reverse KL  | 3.45     |
| Running Update Time | 569      |
----------------------------------
2025-02-18 11:27:52.722127 ׼ʱ-
| Itration            | 570      |
| Real Det Return     | 369      |
| Real Sto Return     | 351      |
| Reward Loss         | -43.2    |
| Running Env Steps   | 285000   |
| Running Forward KL  | -0.834   |
| Running Reverse KL  | 4.22     |
| Running Update Time | 570      |
----------------------------------
2025-02-18 11:28:05.078536 ׼ʱ-
| Itration            | 571      |
| Real Det Return     | 402      |
| Real Sto Return     | 363      |
| Reward Loss         | -20.3    |
| Running Env Steps   | 285500   |
| Running Forward KL  | -0.68    |
| Running Reverse KL  | 4.23     |
| Running Update Time | 571      |
----------------------------------
2025-02-18 11:28:17.419315 ׼ʱ-
| Itration            | 572      |
| Real Det Return     | 357      |
| Real Sto Return     | 339      |
| Reward Loss         | -45.7    |
| Running Env Steps   | 286000   |
| Running Forward KL  | -0.862   |
| Running Reverse KL  | 3.73     |
| Running Update Time | 572      |
----------------------------------
2025-02-18 11:28:29.760104 ׼ʱ-
| Itration            | 573      |
| Real Det Return     | 356      |
| Real Sto Return     | 346      |
| Reward Loss         | -42.8    |
| Running Env Steps   | 286500   |
| Running Forward KL  | -0.845   |
| Running Reverse KL  | 3.22     |
| Running Update Time | 573      |
----------------------------------
2025-02-18 11:28:42.069659 ׼ʱ-
| Itration            | 574      |
| Real Det Return     | 371      |
| Real Sto Return     | 361      |
| Reward Loss         | -22.6    |
| Running Env Steps   | 287000   |
| Running Forward KL  | -1.23    |
| Running Reverse KL  | 3.69     |
| Running Update Time | 574      |
----------------------------------
2025-02-18 11:28:54.410447 ׼ʱ-
| Itration            | 575      |
| Real Det Return     | 381      |
| Real Sto Return     | 357      |
| Reward Loss         | -23.9    |
| Running Env Steps   | 287500   |
| Running Forward KL  | 0.0604   |
| Running Reverse KL  | 4.04     |
| Running Update Time | 575      |
----------------------------------
2025-02-18 11:29:07.121641 ׼ʱ-
| Itration            | 576      |
| Real Det Return     | 367      |
| Real Sto Return     | 342      |
| Reward Loss         | -44.4    |
| Running Env Steps   | 288000   |
| Running Forward KL  | -0.465   |
| Running Reverse KL  | 3.55     |
| Running Update Time | 576      |
----------------------------------
2025-02-18 11:29:19.478041 ׼ʱ-
| Itration            | 577      |
| Real Det Return     | 388      |
| Real Sto Return     | 374      |
| Reward Loss         | -37.5    |
| Running Env Steps   | 288500   |
| Running Forward KL  | 0.246    |
| Running Reverse KL  | 3.36     |
| Running Update Time | 577      |
----------------------------------
2025-02-18 11:29:31.818830 ׼ʱ-
| Itration            | 578      |
| Real Det Return     | 363      |
| Real Sto Return     | 357      |
| Reward Loss         | -32.1    |
| Running Env Steps   | 289000   |
| Running Forward KL  | -0.387   |
| Running Reverse KL  | 3.59     |
| Running Update Time | 578      |
----------------------------------
2025-02-18 11:29:44.159628 ׼ʱ-
| Itration            | 579      |
| Real Det Return     | 386      |
| Real Sto Return     | 375      |
| Reward Loss         | -25      |
| Running Env Steps   | 289500   |
| Running Forward KL  | -0.191   |
| Running Reverse KL  | 4.07     |
| Running Update Time | 579      |
----------------------------------
2025-02-18 11:29:56.516038 ׼ʱ-
| Itration            | 580      |
| Real Det Return     | 360      |
| Real Sto Return     | 345      |
| Reward Loss         | -35.4    |
| Running Env Steps   | 290000   |
| Running Forward KL  | 0.0686   |
| Running Reverse KL  | 4.06     |
| Running Update Time | 580      |
----------------------------------
2025-02-18 11:30:08.903682 ׼ʱ-
| Itration            | 581      |
| Real Det Return     | 364      |
| Real Sto Return     | 351      |
| Reward Loss         | -28.8    |
| Running Env Steps   | 290500   |
| Running Forward KL  | -1.16    |
| Running Reverse KL  | 3.56     |
| Running Update Time | 581      |
----------------------------------
2025-02-18 11:30:21.260092 ׼ʱ-
| Itration            | 582      |
| Real Det Return     | 391      |
| Real Sto Return     | 374      |
| Reward Loss         | -23.4    |
| Running Env Steps   | 291000   |
| Running Forward KL  | -0.189   |
| Running Reverse KL  | 4.12     |
| Running Update Time | 582      |
----------------------------------
2025-02-18 11:30:33.554016 ׼ʱ-
| Itration            | 583      |
| Real Det Return     | 382      |
| Real Sto Return     | 372      |
| Reward Loss         | -32.3    |
| Running Env Steps   | 291500   |
| Running Forward KL  | 0.111    |
| Running Reverse KL  | 4.03     |
| Running Update Time | 583      |
----------------------------------
2025-02-18 11:30:45.832320 ׼ʱ-
| Itration            | 584      |
| Real Det Return     | 370      |
| Real Sto Return     | 348      |
| Reward Loss         | -23      |
| Running Env Steps   | 292000   |
| Running Forward KL  | -0.717   |
| Running Reverse KL  | 3.57     |
| Running Update Time | 584      |
----------------------------------
2025-02-18 11:30:58.251215 ׼ʱ-
| Itration            | 585      |
| Real Det Return     | 346      |
| Real Sto Return     | 331      |
| Reward Loss         | -43.3    |
| Running Env Steps   | 292500   |
| Running Forward KL  | -1.21    |
| Running Reverse KL  | 3.51     |
| Running Update Time | 585      |
----------------------------------
2025-02-18 11:31:10.952433 ׼ʱ-
| Itration            | 586      |
| Real Det Return     | 366      |
| Real Sto Return     | 354      |
| Reward Loss         | -45.5    |
| Running Env Steps   | 293000   |
| Running Forward KL  | -0.742   |
| Running Reverse KL  | 3.51     |
| Running Update Time | 586      |
----------------------------------
2025-02-18 11:31:23.340084 ׼ʱ-
| Itration            | 587      |
| Real Det Return     | 375      |
| Real Sto Return     | 365      |
| Reward Loss         | -27.5    |
| Running Env Steps   | 293500   |
| Running Forward KL  | -0.0984  |
| Running Reverse KL  | 3.74     |
| Running Update Time | 587      |
----------------------------------
2025-02-18 11:31:35.758977 ׼ʱ-
| Itration            | 588      |
| Real Det Return     | 366      |
| Real Sto Return     | 352      |
| Reward Loss         | -29.8    |
| Running Env Steps   | 294000   |
| Running Forward KL  | -0.427   |
| Running Reverse KL  | 3.72     |
| Running Update Time | 588      |
----------------------------------
2025-02-18 11:31:48.084147 ׼ʱ-
| Itration            | 589      |
| Real Det Return     | 371      |
| Real Sto Return     | 360      |
| Reward Loss         | -27.1    |
| Running Env Steps   | 294500   |
| Running Forward KL  | -1.06    |
| Running Reverse KL  | 3.84     |
| Running Update Time | 589      |
----------------------------------
2025-02-18 11:32:00.378061 ׼ʱ-
| Itration            | 590      |
| Real Det Return     | 386      |
| Real Sto Return     | 350      |
| Reward Loss         | -42.1    |
| Running Env Steps   | 295000   |
| Running Forward KL  | 0.0268   |
| Running Reverse KL  | 4.12     |
| Running Update Time | 590      |
----------------------------------
2025-02-18 11:32:12.750093 ׼ʱ-
| Itration            | 591      |
| Real Det Return     | 369      |
| Real Sto Return     | 353      |
| Reward Loss         | -50      |
| Running Env Steps   | 295500   |
| Running Forward KL  | -1.05    |
| Running Reverse KL  | 3.67     |
| Running Update Time | 591      |
----------------------------------
2025-02-18 11:32:25.059650 ׼ʱ-
| Itration            | 592      |
| Real Det Return     | 378      |
| Real Sto Return     | 359      |
| Reward Loss         | -36.8    |
| Running Env Steps   | 296000   |
| Running Forward KL  | -1.02    |
| Running Reverse KL  | 3.15     |
| Running Update Time | 592      |
----------------------------------
2025-02-18 11:32:37.431679 ׼ʱ-
| Itration            | 593      |
| Real Det Return     | 383      |
| Real Sto Return     | 362      |
| Reward Loss         | -26.7    |
| Running Env Steps   | 296500   |
| Running Forward KL  | -0.193   |
| Running Reverse KL  | 3.84     |
| Running Update Time | 593      |
----------------------------------
2025-02-18 11:32:49.772470 ׼ʱ-
| Itration            | 594      |
| Real Det Return     | 392      |
| Real Sto Return     | 368      |
| Reward Loss         | -45      |
| Running Env Steps   | 297000   |
| Running Forward KL  | -0.741   |
| Running Reverse KL  | 3.96     |
| Running Update Time | 594      |
----------------------------------
2025-02-18 11:33:02.097636 ׼ʱ-
| Itration            | 595      |
| Real Det Return     | 351      |
| Real Sto Return     | 349      |
| Reward Loss         | -43.7    |
| Running Env Steps   | 297500   |
| Running Forward KL  | -0.922   |
| Running Reverse KL  | 3.46     |
| Running Update Time | 595      |
----------------------------------
2025-02-18 11:33:14.782525 ׼ʱ-
| Itration            | 596      |
| Real Det Return     | 355      |
| Real Sto Return     | 338      |
| Reward Loss         | -44.8    |
| Running Env Steps   | 298000   |
| Running Forward KL  | -0.944   |
| Running Reverse KL  | 3.16     |
| Running Update Time | 596      |
----------------------------------
2025-02-18 11:33:27.170178 ׼ʱ-
| Itration            | 597      |
| Real Det Return     | 385      |
| Real Sto Return     | 362      |
| Reward Loss         | -28.7    |
| Running Env Steps   | 298500   |
| Running Forward KL  | -0.0768  |
| Running Reverse KL  | 4.25     |
| Running Update Time | 597      |
----------------------------------
2025-02-18 11:33:39.510977 ׼ʱ-
| Itration            | 598      |
| Real Det Return     | 382      |
| Real Sto Return     | 372      |
| Reward Loss         | -21.3    |
| Running Env Steps   | 299000   |
| Running Forward KL  | -0.415   |
| Running Reverse KL  | 3.77     |
| Running Update Time | 598      |
----------------------------------
2025-02-18 11:33:51.851755 ׼ʱ-
| Itration            | 599      |
| Real Det Return     | 371      |
| Real Sto Return     | 358      |
| Reward Loss         | -18.5    |
| Running Env Steps   | 299500   |
| Running Forward KL  | -1.36    |
| Running Reverse KL  | 3.53     |
| Running Update Time | 599      |
----------------------------------
2025-02-18 11:34:04.223786 ׼ʱ-
| Itration            | 600      |
| Real Det Return     | 384      |
| Real Sto Return     | 353      |
| Reward Loss         | -45.5    |
| Running Env Steps   | 300000   |
| Running Forward KL  | -0.478   |
| Running Reverse KL  | 3.26     |
| Running Update Time | 600      |
----------------------------------
2025-02-18 11:34:16.580196 ׼ʱ-
| Itration            | 601      |
| Real Det Return     | 380      |
| Real Sto Return     | 364      |
| Reward Loss         | -23.4    |
| Running Env Steps   | 300500   |
| Running Forward KL  | -0.712   |
| Running Reverse KL  | 3.76     |
| Running Update Time | 601      |
----------------------------------
2025-02-18 11:34:29.077198 ׼ʱ-
| Itration            | 602      |
| Real Det Return     | 360      |
| Real Sto Return     | 322      |
| Reward Loss         | -56.1    |
| Running Env Steps   | 301000   |
| Running Forward KL  | -1.19    |
| Running Reverse KL  | 3.53     |
| Running Update Time | 602      |
----------------------------------
2025-02-18 11:34:41.386744 ׼ʱ-
| Itration            | 603      |
| Real Det Return     | 365      |
| Real Sto Return     | 348      |
| Reward Loss         | -39      |
| Running Env Steps   | 301500   |
| Running Forward KL  | -0.884   |
| Running Reverse KL  | 3.69     |
| Running Update Time | 603      |
----------------------------------
2025-02-18 11:34:53.711912 ׼ʱ-
| Itration            | 604      |
| Real Det Return     | 374      |
| Real Sto Return     | 351      |
| Reward Loss         | -40.4    |
| Running Env Steps   | 302000   |
| Running Forward KL  | -0.81    |
| Running Reverse KL  | 3.34     |
| Running Update Time | 604      |
----------------------------------
2025-02-18 11:35:06.083957 ׼ʱ-
| Itration            | 605      |
| Real Det Return     | 362      |
| Real Sto Return     | 341      |
| Reward Loss         | -36.8    |
| Running Env Steps   | 302500   |
| Running Forward KL  | -1.11    |
| Running Reverse KL  | 3.64     |
| Running Update Time | 605      |
----------------------------------
2025-02-18 11:35:18.813373 ׼ʱ-
| Itration            | 606      |
| Real Det Return     | 360      |
| Real Sto Return     | 344      |
| Reward Loss         | -39.8    |
| Running Env Steps   | 303000   |
| Running Forward KL  | -0.758   |
| Running Reverse KL  | 3.71     |
| Running Update Time | 606      |
----------------------------------
2025-02-18 11:35:31.154170 ׼ʱ-
| Itration            | 607      |
| Real Det Return     | 356      |
| Real Sto Return     | 355      |
| Reward Loss         | -35.3    |
| Running Env Steps   | 303500   |
| Running Forward KL  | -1.02    |
| Running Reverse KL  | 3.97     |
| Running Update Time | 607      |
----------------------------------
2025-02-18 11:35:43.510584 ׼ʱ-
| Itration            | 608      |
| Real Det Return     | 348      |
| Real Sto Return     | 336      |
| Reward Loss         | -46.9    |
| Running Env Steps   | 304000   |
| Running Forward KL  | -0.484   |
| Running Reverse KL  | 3.84     |
| Running Update Time | 608      |
----------------------------------
2025-02-18 11:35:55.898232 ׼ʱ-
| Itration            | 609      |
| Real Det Return     | 380      |
| Real Sto Return     | 345      |
| Reward Loss         | -36.1    |
| Running Env Steps   | 304500   |
| Running Forward KL  | -0.629   |
| Running Reverse KL  | 4.18     |
| Running Update Time | 609      |
----------------------------------
2025-02-18 11:36:08.285885 ׼ʱ-
| Itration            | 610      |
| Real Det Return     | 381      |
| Real Sto Return     | 366      |
| Reward Loss         | -24.5    |
| Running Env Steps   | 305000   |
| Running Forward KL  | -0.833   |
| Running Reverse KL  | 3.23     |
| Running Update Time | 610      |
----------------------------------
2025-02-18 11:36:20.626673 ׼ʱ-
| Itration            | 611      |
| Real Det Return     | 349      |
| Real Sto Return     | 339      |
| Reward Loss         | -40.7    |
| Running Env Steps   | 305500   |
| Running Forward KL  | -0.763   |
| Running Reverse KL  | 3.64     |
| Running Update Time | 611      |
----------------------------------
2025-02-18 11:36:32.951841 ׼ʱ-
| Itration            | 612      |
| Real Det Return     | 359      |
| Real Sto Return     | 343      |
| Reward Loss         | -47.9    |
| Running Env Steps   | 306000   |
| Running Forward KL  | -0.77    |
| Running Reverse KL  | 3.62     |
| Running Update Time | 612      |
----------------------------------
2025-02-18 11:36:45.387512 ׼ʱ-
| Itration            | 613      |
| Real Det Return     | 376      |
| Real Sto Return     | 368      |
| Reward Loss         | -20      |
| Running Env Steps   | 306500   |
| Running Forward KL  | -0.725   |
| Running Reverse KL  | 4.27     |
| Running Update Time | 613      |
----------------------------------
2025-02-18 11:36:57.728301 ׼ʱ-
| Itration            | 614      |
| Real Det Return     | 362      |
| Real Sto Return     | 342      |
| Reward Loss         | -48.5    |
| Running Env Steps   | 307000   |
| Running Forward KL  | -0.177   |
| Running Reverse KL  | 4.23     |
| Running Update Time | 614      |
----------------------------------
2025-02-18 11:37:10.131588 ׼ʱ-
| Itration            | 615      |
| Real Det Return     | 369      |
| Real Sto Return     | 345      |
| Reward Loss         | -27.3    |
| Running Env Steps   | 307500   |
| Running Forward KL  | -1.22    |
| Running Reverse KL  | 3.34     |
| Running Update Time | 615      |
----------------------------------
2025-02-18 11:37:22.847275 ׼ʱ-
| Itration            | 616      |
| Real Det Return     | 350      |
| Real Sto Return     | 341      |
| Reward Loss         | -33.4    |
| Running Env Steps   | 308000   |
| Running Forward KL  | -1.02    |
| Running Reverse KL  | 3.4      |
| Running Update Time | 616      |
----------------------------------
2025-02-18 11:37:35.234927 ׼ʱ-
| Itration            | 617      |
| Real Det Return     | 362      |
| Real Sto Return     | 346      |
| Reward Loss         | -34.7    |
| Running Env Steps   | 308500   |
| Running Forward KL  | -1.24    |
| Running Reverse KL  | 3.76     |
| Running Update Time | 617      |
----------------------------------
2025-02-18 11:37:47.638209 ׼ʱ-
| Itration            | 618      |
| Real Det Return     | 377      |
| Real Sto Return     | 361      |
| Reward Loss         | -26.5    |
| Running Env Steps   | 309000   |
| Running Forward KL  | -0.713   |
| Running Reverse KL  | 3.91     |
| Running Update Time | 618      |
----------------------------------
2025-02-18 11:37:59.947758 ׼ʱ-
| Itration            | 619      |
| Real Det Return     | 355      |
| Real Sto Return     | 336      |
| Reward Loss         | -44      |
| Running Env Steps   | 309500   |
| Running Forward KL  | -0.804   |
| Running Reverse KL  | 3.54     |
| Running Update Time | 619      |
----------------------------------
2025-02-18 11:38:12.335399 ׼ʱ-
| Itration            | 620      |
| Real Det Return     | 378      |
| Real Sto Return     | 363      |
| Reward Loss         | -38.1    |
| Running Env Steps   | 310000   |
| Running Forward KL  | -1.1     |
| Running Reverse KL  | 3.34     |
| Running Update Time | 620      |
----------------------------------
2025-02-18 11:38:24.801167 ׼ʱ-
| Itration            | 621      |
| Real Det Return     | 380      |
| Real Sto Return     | 365      |
| Reward Loss         | -32.3    |
| Running Env Steps   | 310500   |
| Running Forward KL  | -1.17    |
| Running Reverse KL  | 3.56     |
| Running Update Time | 621      |
----------------------------------
2025-02-18 11:38:37.157567 ׼ʱ-
| Itration            | 622      |
| Real Det Return     | 391      |
| Real Sto Return     | 363      |
| Reward Loss         | -33.8    |
| Running Env Steps   | 311000   |
| Running Forward KL  | -0.048   |
| Running Reverse KL  | 3.94     |
| Running Update Time | 622      |
----------------------------------
2025-02-18 11:38:49.889255 ׼ʱ-
| Itration            | 623      |
| Real Det Return     | 386      |
| Real Sto Return     | 359      |
| Reward Loss         | -31.9    |
| Running Env Steps   | 311500   |
| Running Forward KL  | -1.13    |
| Running Reverse KL  | 3.26     |
| Running Update Time | 623      |
----------------------------------
2025-02-18 11:39:02.245691 ׼ʱ-
| Itration            | 624      |
| Real Det Return     | 364      |
| Real Sto Return     | 341      |
| Reward Loss         | -35.7    |
| Running Env Steps   | 312000   |
| Running Forward KL  | -1.03    |
| Running Reverse KL  | 3.87     |
| Running Update Time | 624      |
----------------------------------
2025-02-18 11:39:14.555238 ׼ʱ-
| Itration            | 625      |
| Real Det Return     | 383      |
| Real Sto Return     | 350      |
| Reward Loss         | -29      |
| Running Env Steps   | 312500   |
| Running Forward KL  | -1.12    |
| Running Reverse KL  | 4        |
| Running Update Time | 625      |
----------------------------------
2025-02-18 11:39:27.283899 ׼ʱ-
| Itration            | 626      |
| Real Det Return     | 394      |
| Real Sto Return     | 370      |
| Reward Loss         | -41.2    |
| Running Env Steps   | 313000   |
| Running Forward KL  | -0.96    |
| Running Reverse KL  | 3.69     |
| Running Update Time | 626      |
----------------------------------
2025-02-18 11:39:39.609066 ׼ʱ-
| Itration            | 627      |
| Real Det Return     | 372      |
| Real Sto Return     | 348      |
| Reward Loss         | -36.7    |
| Running Env Steps   | 313500   |
| Running Forward KL  | -0.727   |
| Running Reverse KL  | 3.6      |
| Running Update Time | 627      |
----------------------------------
2025-02-18 11:39:51.996709 ׼ʱ-
| Itration            | 628      |
| Real Det Return     | 386      |
| Real Sto Return     | 368      |
| Reward Loss         | -26      |
| Running Env Steps   | 314000   |
| Running Forward KL  | -1.17    |
| Running Reverse KL  | 3.16     |
| Running Update Time | 628      |
----------------------------------
2025-02-18 11:40:04.337913 ׼ʱ-
| Itration            | 629      |
| Real Det Return     | 380      |
| Real Sto Return     | 362      |
| Reward Loss         | -25.1    |
| Running Env Steps   | 314500   |
| Running Forward KL  | -0.981   |
| Running Reverse KL  | 3.97     |
| Running Update Time | 629      |
----------------------------------
2025-02-18 11:40:16.772461 ׼ʱ-
| Itration            | 630      |
| Real Det Return     | 365      |
| Real Sto Return     | 347      |
| Reward Loss         | -25.8    |
| Running Env Steps   | 315000   |
| Running Forward KL  | -1.32    |
| Running Reverse KL  | 3.56     |
| Running Update Time | 630      |
----------------------------------
2025-02-18 11:40:29.097618 ׼ʱ-
| Itration            | 631      |
| Real Det Return     | 366      |
| Real Sto Return     | 343      |
| Reward Loss         | -27.5    |
| Running Env Steps   | 315500   |
| Running Forward KL  | -0.902   |
| Running Reverse KL  | 4.05     |
| Running Update Time | 631      |
----------------------------------
2025-02-18 11:40:41.438398 ׼ʱ-
| Itration            | 632      |
| Real Det Return     | 354      |
| Real Sto Return     | 341      |
| Reward Loss         | -46.6    |
| Running Env Steps   | 316000   |
| Running Forward KL  | -0.546   |
| Running Reverse KL  | 3.49     |
| Running Update Time | 632      |
----------------------------------
2025-02-18 11:40:53.794823 ׼ʱ-
| Itration            | 633      |
| Real Det Return     | 380      |
| Real Sto Return     | 364      |
| Reward Loss         | -25.1    |
| Running Env Steps   | 316500   |
| Running Forward KL  | -0.867   |
| Running Reverse KL  | 3.23     |
| Running Update Time | 633      |
----------------------------------
2025-02-18 11:41:06.136031 ׼ʱ-
| Itration            | 634      |
| Real Det Return     | 380      |
| Real Sto Return     | 363      |
| Reward Loss         | -28      |
| Running Env Steps   | 317000   |
| Running Forward KL  | -0.682   |
| Running Reverse KL  | 3.06     |
| Running Update Time | 634      |
----------------------------------
2025-02-18 11:41:18.476812 ׼ʱ-
| Itration            | 635      |
| Real Det Return     | 379      |
| Real Sto Return     | 361      |
| Reward Loss         | -47.3    |
| Running Env Steps   | 317500   |
| Running Forward KL  | -0.617   |
| Running Reverse KL  | 3.6      |
| Running Update Time | 635      |
----------------------------------
2025-02-18 11:41:31.246506 ׼ʱ-
| Itration            | 636      |
| Real Det Return     | 369      |
| Real Sto Return     | 358      |
| Reward Loss         | -40.5    |
| Running Env Steps   | 318000   |
| Running Forward KL  | -1.04    |
| Running Reverse KL  | 3.87     |
| Running Update Time | 636      |
----------------------------------
2025-02-18 11:41:43.618540 ׼ʱ-
| Itration            | 637      |
| Real Det Return     | 401      |
| Real Sto Return     | 358      |
| Reward Loss         | -41.7    |
| Running Env Steps   | 318500   |
| Running Forward KL  | -0.833   |
| Running Reverse KL  | 3.25     |
| Running Update Time | 637      |
----------------------------------
2025-02-18 11:41:56.006170 ׼ʱ-
| Itration            | 638      |
| Real Det Return     | 347      |
| Real Sto Return     | 341      |
| Reward Loss         | -45.4    |
| Running Env Steps   | 319000   |
| Running Forward KL  | -0.528   |
| Running Reverse KL  | 3.97     |
| Running Update Time | 638      |
----------------------------------
2025-02-18 11:42:08.456334 ׼ʱ-
| Itration            | 639      |
| Real Det Return     | 374      |
| Real Sto Return     | 365      |
| Reward Loss         | -36.1    |
| Running Env Steps   | 319500   |
| Running Forward KL  | -0.57    |
| Running Reverse KL  | 4.08     |
| Running Update Time | 639      |
----------------------------------
2025-02-18 11:42:20.812760 ׼ʱ-
| Itration            | 640      |
| Real Det Return     | 353      |
| Real Sto Return     | 342      |
| Reward Loss         | -46.8    |
| Running Env Steps   | 320000   |
| Running Forward KL  | -1.03    |
| Running Reverse KL  | 3.72     |
| Running Update Time | 640      |
----------------------------------
2025-02-18 11:42:33.153551 ׼ʱ-
| Itration            | 641      |
| Real Det Return     | 398      |
| Real Sto Return     | 376      |
| Reward Loss         | -45.8    |
| Running Env Steps   | 320500   |
| Running Forward KL  | -0.603   |
| Running Reverse KL  | 4.03     |
| Running Update Time | 641      |
----------------------------------
2025-02-18 11:42:45.447467 ׼ʱ-
| Itration            | 642      |
| Real Det Return     | 380      |
| Real Sto Return     | 370      |
| Reward Loss         | -27      |
| Running Env Steps   | 321000   |
| Running Forward KL  | -1.05    |
| Running Reverse KL  | 4.25     |
| Running Update Time | 642      |
----------------------------------
2025-02-18 11:42:57.741394 ׼ʱ-
| Itration            | 643      |
| Real Det Return     | 375      |
| Real Sto Return     | 364      |
| Reward Loss         | -31.6    |
| Running Env Steps   | 321500   |
| Running Forward KL  | -1.22    |
| Running Reverse KL  | 3.12     |
| Running Update Time | 643      |
----------------------------------
2025-02-18 11:43:10.144683 ׼ʱ-
| Itration            | 644      |
| Real Det Return     | 384      |
| Real Sto Return     | 358      |
| Reward Loss         | -28.5    |
| Running Env Steps   | 322000   |
| Running Forward KL  | -0.726   |
| Running Reverse KL  | 3.42     |
| Running Update Time | 644      |
----------------------------------
2025-02-18 11:43:22.579188 ׼ʱ-
| Itration            | 645      |
| Real Det Return     | 340      |
| Real Sto Return     | 329      |
| Reward Loss         | -46.6    |
| Running Env Steps   | 322500   |
| Running Forward KL  | -1.13    |
| Running Reverse KL  | 3.75     |
| Running Update Time | 645      |
----------------------------------
2025-02-18 11:43:35.310514 ׼ʱ-
| Itration            | 646      |
| Real Det Return     | 353      |
| Real Sto Return     | 327      |
| Reward Loss         | -43.8    |
| Running Env Steps   | 323000   |
| Running Forward KL  | -0.926   |
| Running Reverse KL  | 3.8      |
| Running Update Time | 646      |
----------------------------------
2025-02-18 11:43:47.651301 ׼ʱ-
| Itration            | 647      |
| Real Det Return     | 399      |
| Real Sto Return     | 366      |
| Reward Loss         | -45.7    |
| Running Env Steps   | 323500   |
| Running Forward KL  | -0.333   |
| Running Reverse KL  | 3.58     |
| Running Update Time | 647      |
----------------------------------
2025-02-18 11:44:00.023311 ׼ʱ-
| Itration            | 648      |
| Real Det Return     | 379      |
| Real Sto Return     | 354      |
| Reward Loss         | -19.3    |
| Running Env Steps   | 324000   |
| Running Forward KL  | -1.03    |
| Running Reverse KL  | 3.51     |
| Running Update Time | 648      |
----------------------------------
2025-02-18 11:44:12.349285 ׼ʱ-
| Itration            | 649      |
| Real Det Return     | 368      |
| Real Sto Return     | 356      |
| Reward Loss         | -35.1    |
| Running Env Steps   | 324500   |
| Running Forward KL  | -1.3     |
| Running Reverse KL  | 4.23     |
| Running Update Time | 649      |
----------------------------------
2025-02-18 11:44:24.643222 ׼ʱ-
| Itration            | 650      |
| Real Det Return     | 357      |
| Real Sto Return     | 351      |
| Reward Loss         | -35.8    |
| Running Env Steps   | 325000   |
| Running Forward KL  | -1.12    |
| Running Reverse KL  | 3.33     |
| Running Update Time | 650      |
----------------------------------
2025-02-18 11:44:36.968383 ׼ʱ-
| Itration            | 651      |
| Real Det Return     | 369      |
| Real Sto Return     | 356      |
| Reward Loss         | -39.3    |
| Running Env Steps   | 325500   |
| Running Forward KL  | -1.02    |
| Running Reverse KL  | 3.24     |
| Running Update Time | 651      |
----------------------------------
2025-02-18 11:44:49.293552 ׼ʱ-
| Itration            | 652      |
| Real Det Return     | 371      |
| Real Sto Return     | 336      |
| Reward Loss         | -30.3    |
| Running Env Steps   | 326000   |
| Running Forward KL  | -0.872   |
| Running Reverse KL  | 3.85     |
| Running Update Time | 652      |
----------------------------------
2025-02-18 11:45:01.634344 ׼ʱ-
| Itration            | 653      |
| Real Det Return     | 375      |
| Real Sto Return     | 358      |
| Reward Loss         | -34.4    |
| Running Env Steps   | 326500   |
| Running Forward KL  | -1.14    |
| Running Reverse KL  | 3.5      |
| Running Update Time | 653      |
----------------------------------
2025-02-18 11:45:13.990756 ׼ʱ-
| Itration            | 654      |
| Real Det Return     | 366      |
| Real Sto Return     | 361      |
| Reward Loss         | -33.8    |
| Running Env Steps   | 327000   |
| Running Forward KL  | -0.729   |
| Running Reverse KL  | 3.95     |
| Running Update Time | 654      |
----------------------------------
2025-02-18 11:45:26.362790 ׼ʱ-
| Itration            | 655      |
| Real Det Return     | 378      |
| Real Sto Return     | 348      |
| Reward Loss         | -29.9    |
| Running Env Steps   | 327500   |
| Running Forward KL  | -1.39    |
| Running Reverse KL  | 4.26     |
| Running Update Time | 655      |
----------------------------------
2025-02-18 11:45:39.230557 ׼ʱ-
| Itration            | 656      |
| Real Det Return     | 376      |
| Real Sto Return     | 339      |
| Reward Loss         | -34.3    |
| Running Env Steps   | 328000   |
| Running Forward KL  | -1.18    |
| Running Reverse KL  | 4.07     |
| Running Update Time | 656      |
----------------------------------
2025-02-18 11:45:51.586960 ׼ʱ-
| Itration            | 657      |
| Real Det Return     | 351      |
| Real Sto Return     | 340      |
| Reward Loss         | -38.8    |
| Running Env Steps   | 328500   |
| Running Forward KL  | -1.03    |
| Running Reverse KL  | 3.59     |
| Running Update Time | 657      |
----------------------------------
2025-02-18 11:46:03.990236 ׼ʱ-
| Itration            | 658      |
| Real Det Return     | 375      |
| Real Sto Return     | 348      |
| Reward Loss         | -39      |
| Running Env Steps   | 329000   |
| Running Forward KL  | -0.849   |
| Running Reverse KL  | 3.79     |
| Running Update Time | 658      |
----------------------------------
2025-02-18 11:46:16.424754 ׼ʱ-
| Itration            | 659      |
| Real Det Return     | 387      |
| Real Sto Return     | 374      |
| Reward Loss         | -29      |
| Running Env Steps   | 329500   |
| Running Forward KL  | -0.893   |
| Running Reverse KL  | 3.72     |
| Running Update Time | 659      |
----------------------------------
2025-02-18 11:46:28.749924 ׼ʱ-
| Itration            | 660      |
| Real Det Return     | 391      |
| Real Sto Return     | 364      |
| Reward Loss         | -28.7    |
| Running Env Steps   | 330000   |
| Running Forward KL  | -0.829   |
| Running Reverse KL  | 4.64     |
| Running Update Time | 660      |
----------------------------------
2025-02-18 11:46:41.184443 ׼ʱ-
| Itration            | 661      |
| Real Det Return     | 386      |
| Real Sto Return     | 366      |
| Reward Loss         | -26.3    |
| Running Env Steps   | 330500   |
| Running Forward KL  | -1.13    |
| Running Reverse KL  | 3.55     |
| Running Update Time | 661      |
----------------------------------
2025-02-18 11:46:53.478370 ׼ʱ-
| Itration            | 662      |
| Real Det Return     | 363      |
| Real Sto Return     | 351      |
| Reward Loss         | -30.2    |
| Running Env Steps   | 331000   |
| Running Forward KL  | -0.893   |
| Running Reverse KL  | 3.94     |
| Running Update Time | 662      |
----------------------------------
2025-02-18 11:47:05.834792 ׼ʱ-
| Itration            | 663      |
| Real Det Return     | 381      |
| Real Sto Return     | 360      |
| Reward Loss         | -27.1    |
| Running Env Steps   | 331500   |
| Running Forward KL  | -0.564   |
| Running Reverse KL  | 4.14     |
| Running Update Time | 663      |
----------------------------------
2025-02-18 11:47:18.191205 ׼ʱ-
| Itration            | 664      |
| Real Det Return     | 366      |
| Real Sto Return     | 345      |
| Reward Loss         | -29.4    |
| Running Env Steps   | 332000   |
| Running Forward KL  | -1.27    |
| Running Reverse KL  | 3.59     |
| Running Update Time | 664      |
----------------------------------
2025-02-18 11:47:30.578861 ׼ʱ-
| Itration            | 665      |
| Real Det Return     | 386      |
| Real Sto Return     | 361      |
| Reward Loss         | -30.4    |
| Running Env Steps   | 332500   |
| Running Forward KL  | -0.555   |
| Running Reverse KL  | 3.69     |
| Running Update Time | 665      |
----------------------------------
2025-02-18 11:47:43.334324 ׼ʱ-
| Itration            | 666      |
| Real Det Return     | 365      |
| Real Sto Return     | 356      |
| Reward Loss         | -29.4    |
| Running Env Steps   | 333000   |
| Running Forward KL  | -0.814   |
| Running Reverse KL  | 3.87     |
| Running Update Time | 666      |
----------------------------------
2025-02-18 11:47:55.690737 ׼ʱ-
| Itration            | 667      |
| Real Det Return     | 404      |
| Real Sto Return     | 378      |
| Reward Loss         | -24.1    |
| Running Env Steps   | 333500   |
| Running Forward KL  | -0.305   |
| Running Reverse KL  | 3.94     |
| Running Update Time | 667      |
----------------------------------
2025-02-18 11:48:08.094030 ׼ʱ-
| Itration            | 668      |
| Real Det Return     | 350      |
| Real Sto Return     | 343      |
| Reward Loss         | -34.9    |
| Running Env Steps   | 334000   |
| Running Forward KL  | -1.15    |
| Running Reverse KL  | 4.19     |
| Running Update Time | 668      |
----------------------------------
2025-02-18 11:48:20.434816 ׼ʱ-
| Itration            | 669      |
| Real Det Return     | 345      |
| Real Sto Return     | 329      |
| Reward Loss         | -56.9    |
| Running Env Steps   | 334500   |
| Running Forward KL  | -0.406   |
| Running Reverse KL  | 4.33     |
| Running Update Time | 669      |
----------------------------------
2025-02-18 11:48:32.791226 ׼ʱ-
| Itration            | 670      |
| Real Det Return     | 383      |
| Real Sto Return     | 367      |
| Reward Loss         | -44.2    |
| Running Env Steps   | 335000   |
| Running Forward KL  | -0.847   |
| Running Reverse KL  | 3.35     |
| Running Update Time | 670      |
----------------------------------
2025-02-18 11:48:45.132020 ׼ʱ-
| Itration            | 671      |
| Real Det Return     | 367      |
| Real Sto Return     | 354      |
| Reward Loss         | -22      |
| Running Env Steps   | 335500   |
| Running Forward KL  | -1.76    |
| Running Reverse KL  | 3.89     |
| Running Update Time | 671      |
----------------------------------
2025-02-18 11:48:57.472799 ׼ʱ-
| Itration            | 672      |
| Real Det Return     | 378      |
| Real Sto Return     | 366      |
| Reward Loss         | -19.1    |
| Running Env Steps   | 336000   |
| Running Forward KL  | -0.909   |
| Running Reverse KL  | 4.03     |
| Running Update Time | 672      |
----------------------------------
2025-02-18 11:49:09.969817 ׼ʱ-
| Itration            | 673      |
| Real Det Return     | 407      |
| Real Sto Return     | 374      |
| Reward Loss         | -36.3    |
| Running Env Steps   | 336500   |
| Running Forward KL  | -0.729   |
| Running Reverse KL  | 3.92     |
| Running Update Time | 673      |
----------------------------------
2025-02-18 11:49:22.326215 ׼ʱ-
| Itration            | 674      |
| Real Det Return     | 363      |
| Real Sto Return     | 357      |
| Reward Loss         | -42      |
| Running Env Steps   | 337000   |
| Running Forward KL  | -0.466   |
| Running Reverse KL  | 4.15     |
| Running Update Time | 674      |
----------------------------------
2025-02-18 11:49:34.963785 ׼ʱ-
| Itration            | 675      |
| Real Det Return     | 365      |
| Real Sto Return     | 355      |
| Reward Loss         | -43.1    |
| Running Env Steps   | 337500   |
| Running Forward KL  | -1.35    |
| Running Reverse KL  | 3.97     |
| Running Update Time | 675      |
----------------------------------
2025-02-18 11:49:47.429573 ׼ʱ-
| Itration            | 676      |
| Real Det Return     | 402      |
| Real Sto Return     | 372      |
| Reward Loss         | -35.7    |
| Running Env Steps   | 338000   |
| Running Forward KL  | -0.87    |
| Running Reverse KL  | 3.47     |
| Running Update Time | 676      |
----------------------------------
2025-02-18 11:49:59.785984 ׼ʱ-
| Itration            | 677      |
| Real Det Return     | 392      |
| Real Sto Return     | 355      |
| Reward Loss         | -24.1    |
| Running Env Steps   | 338500   |
| Running Forward KL  | -1.45    |
| Running Reverse KL  | 3.56     |
| Running Update Time | 677      |
----------------------------------
2025-02-18 11:50:12.174034 ׼ʱ-
| Itration            | 678      |
| Real Det Return     | 380      |
| Real Sto Return     | 366      |
| Reward Loss         | -37.8    |
| Running Env Steps   | 339000   |
| Running Forward KL  | -1.31    |
| Running Reverse KL  | 3.49     |
| Running Update Time | 678      |
----------------------------------
2025-02-18 11:50:24.561684 ׼ʱ-
| Itration            | 679      |
| Real Det Return     | 398      |
| Real Sto Return     | 362      |
| Reward Loss         | -13.5    |
| Running Env Steps   | 339500   |
| Running Forward KL  | -1.35    |
| Running Reverse KL  | 3.82     |
| Running Update Time | 679      |
----------------------------------
2025-02-18 11:50:36.918097 ׼ʱ-
| Itration            | 680      |
| Real Det Return     | 374      |
| Real Sto Return     | 359      |
| Reward Loss         | -21.1    |
| Running Env Steps   | 340000   |
| Running Forward KL  | -1.35    |
| Running Reverse KL  | 3.36     |
| Running Update Time | 680      |
----------------------------------
2025-02-18 11:50:49.243275 ׼ʱ-
| Itration            | 681      |
| Real Det Return     | 376      |
| Real Sto Return     | 363      |
| Reward Loss         | -32      |
| Running Env Steps   | 340500   |
| Running Forward KL  | -1.23    |
| Running Reverse KL  | 4.03     |
| Running Update Time | 681      |
----------------------------------
2025-02-18 11:51:01.584070 ׼ʱ-
| Itration            | 682      |
| Real Det Return     | 363      |
| Real Sto Return     | 351      |
| Reward Loss         | -21      |
| Running Env Steps   | 341000   |
| Running Forward KL  | -1.03    |
| Running Reverse KL  | 3.64     |
| Running Update Time | 682      |
----------------------------------
2025-02-18 11:51:13.924848 ׼ʱ-
| Itration            | 683      |
| Real Det Return     | 364      |
| Real Sto Return     | 357      |
| Reward Loss         | -34.3    |
| Running Env Steps   | 341500   |
| Running Forward KL  | -1.02    |
| Running Reverse KL  | 3.49     |
| Running Update Time | 683      |
----------------------------------
2025-02-18 11:51:26.265640 ׼ʱ-
| Itration            | 684      |
| Real Det Return     | 353      |
| Real Sto Return     | 339      |
| Reward Loss         | -31.2    |
| Running Env Steps   | 342000   |
| Running Forward KL  | -1.8     |
| Running Reverse KL  | 3.5      |
| Running Update Time | 684      |
----------------------------------
2025-02-18 11:51:38.908560 ׼ʱ-
| Itration            | 685      |
| Real Det Return     | 380      |
| Real Sto Return     | 369      |
| Reward Loss         | -41.7    |
| Running Env Steps   | 342500   |
| Running Forward KL  | -0.515   |
| Running Reverse KL  | 3.68     |
| Running Update Time | 685      |
----------------------------------
2025-02-18 11:51:51.280594 ׼ʱ-
| Itration            | 686      |
| Real Det Return     | 365      |
| Real Sto Return     | 350      |
| Reward Loss         | -27.1    |
| Running Env Steps   | 343000   |
| Running Forward KL  | -1.42    |
| Running Reverse KL  | 3.05     |
| Running Update Time | 686      |
----------------------------------
2025-02-18 11:52:03.668248 ׼ʱ-
| Itration            | 687      |
| Real Det Return     | 379      |
| Real Sto Return     | 367      |
| Reward Loss         | -8.16    |
| Running Env Steps   | 343500   |
| Running Forward KL  | -1.75    |
| Running Reverse KL  | 3.43     |
| Running Update Time | 687      |
----------------------------------
2025-02-18 11:52:16.040272 ׼ʱ-
| Itration            | 688      |
| Real Det Return     | 357      |
| Real Sto Return     | 347      |
| Reward Loss         | -37.1    |
| Running Env Steps   | 344000   |
| Running Forward KL  | -1.46    |
| Running Reverse KL  | 3.59     |
| Running Update Time | 688      |
----------------------------------
2025-02-18 11:52:28.412306 ׼ʱ-
| Itration            | 689      |
| Real Det Return     | 347      |
| Real Sto Return     | 332      |
| Reward Loss         | -50.2    |
| Running Env Steps   | 344500   |
| Running Forward KL  | -0.719   |
| Running Reverse KL  | 3.78     |
| Running Update Time | 689      |
----------------------------------
2025-02-18 11:52:40.753097 ׼ʱ-
| Itration            | 690      |
| Real Det Return     | 385      |
| Real Sto Return     | 368      |
| Reward Loss         | -25.6    |
| Running Env Steps   | 345000   |
| Running Forward KL  | -1.16    |
| Running Reverse KL  | 3.74     |
| Running Update Time | 690      |
----------------------------------
2025-02-18 11:52:53.125141 ׼ʱ-
| Itration            | 691      |
| Real Det Return     | 364      |
| Real Sto Return     | 357      |
| Reward Loss         | -49.4    |
| Running Env Steps   | 345500   |
| Running Forward KL  | -0.559   |
| Running Reverse KL  | 3.74     |
| Running Update Time | 691      |
----------------------------------
2025-02-18 11:53:05.481544 ׼ʱ-
| Itration            | 692      |
| Real Det Return     | 377      |
| Real Sto Return     | 358      |
| Reward Loss         | -27.6    |
| Running Env Steps   | 346000   |
| Running Forward KL  | -1.39    |
| Running Reverse KL  | 3.45     |
| Running Update Time | 692      |
----------------------------------
2025-02-18 11:53:17.806714 ׼ʱ-
| Itration            | 693      |
| Real Det Return     | 360      |
| Real Sto Return     | 351      |
| Reward Loss         | -29.1    |
| Running Env Steps   | 346500   |
| Running Forward KL  | -1.96    |
| Running Reverse KL  | 3.1      |
| Running Update Time | 693      |
----------------------------------
2025-02-18 11:53:30.319348 ׼ʱ-
| Itration            | 694      |
| Real Det Return     | 396      |
| Real Sto Return     | 349      |
| Reward Loss         | -51.9    |
| Running Env Steps   | 347000   |
| Running Forward KL  | -0.523   |
| Running Reverse KL  | 4.3      |
| Running Update Time | 694      |
----------------------------------
2025-02-18 11:53:43.030965 ׼ʱ-
| Itration            | 695      |
| Real Det Return     | 375      |
| Real Sto Return     | 369      |
| Reward Loss         | -13.5    |
| Running Env Steps   | 347500   |
| Running Forward KL  | -1.26    |
| Running Reverse KL  | 3.65     |
| Running Update Time | 695      |
----------------------------------
2025-02-18 11:53:55.449872 ׼ʱ-
| Itration            | 696      |
| Real Det Return     | 373      |
| Real Sto Return     | 362      |
| Reward Loss         | -29.9    |
| Running Env Steps   | 348000   |
| Running Forward KL  | -0.724   |
| Running Reverse KL  | 4.1      |
| Running Update Time | 696      |
----------------------------------
2025-02-18 11:54:07.900017 ׼ʱ-
| Itration            | 697      |
| Real Det Return     | 362      |
| Real Sto Return     | 354      |
| Reward Loss         | -24.3    |
| Running Env Steps   | 348500   |
| Running Forward KL  | -1       |
| Running Reverse KL  | 3.82     |
| Running Update Time | 697      |
----------------------------------
2025-02-18 11:54:20.256426 ׼ʱ-
| Itration            | 698      |
| Real Det Return     | 364      |
| Real Sto Return     | 359      |
| Reward Loss         | -33.8    |
| Running Env Steps   | 349000   |
| Running Forward KL  | -1.16    |
| Running Reverse KL  | 3.82     |
| Running Update Time | 698      |
----------------------------------
2025-02-18 11:54:32.644070 ׼ʱ-
| Itration            | 699      |
| Real Det Return     | 382      |
| Real Sto Return     | 361      |
| Reward Loss         | -51.8    |
| Running Env Steps   | 349500   |
| Running Forward KL  | -0.804   |
| Running Reverse KL  | 3.73     |
| Running Update Time | 699      |
----------------------------------
2025-02-18 11:54:45.000457 ׼ʱ-
| Itration            | 700      |
| Real Det Return     | 334      |
| Real Sto Return     | 327      |
| Reward Loss         | -57.1    |
| Running Env Steps   | 350000   |
| Running Forward KL  | -0.557   |
| Running Reverse KL  | 3.96     |
| Running Update Time | 700      |
----------------------------------
2025-02-18 11:54:57.325662 ׼ʱ-
| Itration            | 701      |
| Real Det Return     | 365      |
| Real Sto Return     | 350      |
| Reward Loss         | -23.1    |
| Running Env Steps   | 350500   |
| Running Forward KL  | -1.52    |
| Running Reverse KL  | 3.58     |
| Running Update Time | 701      |
----------------------------------
2025-02-18 11:55:09.807436 ׼ʱ-
| Itration            | 702      |
| Real Det Return     | 377      |
| Real Sto Return     | 358      |
| Reward Loss         | -20.3    |
| Running Env Steps   | 351000   |
| Running Forward KL  | -0.88    |
| Running Reverse KL  | 3.53     |
| Running Update Time | 702      |
----------------------------------
2025-02-18 11:55:22.179469 ׼ʱ-
| Itration            | 703      |
| Real Det Return     | 374      |
| Real Sto Return     | 362      |
| Reward Loss         | -42.3    |
| Running Env Steps   | 351500   |
| Running Forward KL  | -0.908   |
| Running Reverse KL  | 4        |
| Running Update Time | 703      |
----------------------------------
2025-02-18 11:55:34.489008 ׼ʱ-
| Itration            | 704      |
| Real Det Return     | 380      |
| Real Sto Return     | 361      |
| Reward Loss         | -42.5    |
| Running Env Steps   | 352000   |
| Running Forward KL  | -1.33    |
| Running Reverse KL  | 3.56     |
| Running Update Time | 704      |
----------------------------------
2025-02-18 11:55:47.219544 ׼ʱ-
| Itration            | 705      |
| Real Det Return     | 380      |
| Real Sto Return     | 360      |
| Reward Loss         | -30      |
| Running Env Steps   | 352500   |
| Running Forward KL  | -1.7     |
| Running Reverse KL  | 3.34     |
| Running Update Time | 705      |
----------------------------------
2025-02-18 11:55:59.607209 ׼ʱ-
| Itration            | 706      |
| Real Det Return     | 382      |
| Real Sto Return     | 376      |
| Reward Loss         | -36.2    |
| Running Env Steps   | 353000   |
| Running Forward KL  | -0.939   |
| Running Reverse KL  | 3.5      |
| Running Update Time | 706      |
----------------------------------
2025-02-18 11:56:12.026108 ׼ʱ-
| Itration            | 707      |
| Real Det Return     | 395      |
| Real Sto Return     | 374      |
| Reward Loss         | -42.3    |
| Running Env Steps   | 353500   |
| Running Forward KL  | -1.01    |
| Running Reverse KL  | 4.05     |
| Running Update Time | 707      |
----------------------------------
2025-02-18 11:56:24.413728 ׼ʱ-
| Itration            | 708      |
| Real Det Return     | 367      |
| Real Sto Return     | 358      |
| Reward Loss         | -31.8    |
| Running Env Steps   | 354000   |
| Running Forward KL  | -1.55    |
| Running Reverse KL  | 3.51     |
| Running Update Time | 708      |
----------------------------------
2025-02-18 11:56:36.770175 ׼ʱ-
| Itration            | 709      |
| Real Det Return     | 375      |
| Real Sto Return     | 364      |
| Reward Loss         | -33.6    |
| Running Env Steps   | 354500   |
| Running Forward KL  | -1.86    |
| Running Reverse KL  | 4.41     |
| Running Update Time | 709      |
----------------------------------
2025-02-18 11:56:49.173450 ׼ʱ-
| Itration            | 710      |
| Real Det Return     | 407      |
| Real Sto Return     | 375      |
| Reward Loss         | -40.5    |
| Running Env Steps   | 355000   |
| Running Forward KL  | -0.748   |
| Running Reverse KL  | 3.69     |
| Running Update Time | 710      |
----------------------------------
2025-02-18 11:57:01.590613 ׼ʱ-
| Itration            | 711      |
| Real Det Return     | 371      |
| Real Sto Return     | 368      |
| Reward Loss         | -21.9    |
| Running Env Steps   | 355500   |
| Running Forward KL  | -1.32    |
| Running Reverse KL  | 3.39     |
| Running Update Time | 711      |
----------------------------------
2025-02-18 11:57:13.947017 ׼ʱ-
| Itration            | 712      |
| Real Det Return     | 361      |
| Real Sto Return     | 349      |
| Reward Loss         | -47.6    |
| Running Env Steps   | 356000   |
| Running Forward KL  | -0.968   |
| Running Reverse KL  | 3.39     |
| Running Update Time | 712      |
----------------------------------
2025-02-18 11:57:26.334671 ׼ʱ-
| Itration            | 713      |
| Real Det Return     | 387      |
| Real Sto Return     | 364      |
| Reward Loss         | -14.7    |
| Running Env Steps   | 356500   |
| Running Forward KL  | -0.803   |
| Running Reverse KL  | 4.05     |
| Running Update Time | 713      |
----------------------------------
2025-02-18 11:57:38.675462 ׼ʱ-
| Itration            | 714      |
| Real Det Return     | 378      |
| Real Sto Return     | 355      |
| Reward Loss         | -26.6    |
| Running Env Steps   | 357000   |
| Running Forward KL  | -1.65    |
| Running Reverse KL  | 3.7      |
| Running Update Time | 714      |
----------------------------------
2025-02-18 11:57:51.436962 ׼ʱ-
| Itration            | 715      |
| Real Det Return     | 403      |
| Real Sto Return     | 370      |
| Reward Loss         | -31.7    |
| Running Env Steps   | 357500   |
| Running Forward KL  | -0.225   |
| Running Reverse KL  | 4.31     |
| Running Update Time | 715      |
----------------------------------
2025-02-18 11:58:03.824611 ׼ʱ-
| Itration            | 716      |
| Real Det Return     | 370      |
| Real Sto Return     | 345      |
| Reward Loss         | -38.7    |
| Running Env Steps   | 358000   |
| Running Forward KL  | -1.14    |
| Running Reverse KL  | 3.76     |
| Running Update Time | 716      |
----------------------------------
2025-02-18 11:58:16.212262 ׼ʱ-
| Itration            | 717      |
| Real Det Return     | 393      |
| Real Sto Return     | 373      |
| Reward Loss         | -26.5    |
| Running Env Steps   | 358500   |
| Running Forward KL  | -0.728   |
| Running Reverse KL  | 3.85     |
| Running Update Time | 717      |
----------------------------------
2025-02-18 11:58:28.678024 ׼ʱ-
| Itration            | 718      |
| Real Det Return     | 376      |
| Real Sto Return     | 366      |
| Reward Loss         | -35.4    |
| Running Env Steps   | 359000   |
| Running Forward KL  | -1.43    |
| Running Reverse KL  | 3.51     |
| Running Update Time | 718      |
----------------------------------
2025-02-18 11:58:41.050058 ׼ʱ-
| Itration            | 719      |
| Real Det Return     | 372      |
| Real Sto Return     | 363      |
| Reward Loss         | -37.1    |
| Running Env Steps   | 359500   |
| Running Forward KL  | -1.16    |
| Running Reverse KL  | 3.71     |
| Running Update Time | 719      |
----------------------------------
2025-02-18 11:58:53.484578 ׼ʱ-
| Itration            | 720      |
| Real Det Return     | 385      |
| Real Sto Return     | 358      |
| Reward Loss         | -33.2    |
| Running Env Steps   | 360000   |
| Running Forward KL  | -0.892   |
| Running Reverse KL  | 3.79     |
| Running Update Time | 720      |
----------------------------------
2025-02-18 11:59:05.856610 ׼ʱ-
| Itration            | 721      |
| Real Det Return     | 383      |
| Real Sto Return     | 373      |
| Reward Loss         | -38.3    |
| Running Env Steps   | 360500   |
| Running Forward KL  | -1.1     |
| Running Reverse KL  | 3.67     |
| Running Update Time | 721      |
----------------------------------
2025-02-18 11:59:18.244265 ׼ʱ-
| Itration            | 722      |
| Real Det Return     | 360      |
| Real Sto Return     | 333      |
| Reward Loss         | -44      |
| Running Env Steps   | 361000   |
| Running Forward KL  | -1.39    |
| Running Reverse KL  | 3.41     |
| Running Update Time | 722      |
----------------------------------
2025-02-18 11:59:30.616309 ׼ʱ-
| Itration            | 723      |
| Real Det Return     | 371      |
| Real Sto Return     | 358      |
| Reward Loss         | -36.7    |
| Running Env Steps   | 361500   |
| Running Forward KL  | -1.27    |
| Running Reverse KL  | 3.38     |
| Running Update Time | 723      |
----------------------------------
2025-02-18 11:59:42.988333 ׼ʱ-
| Itration            | 724      |
| Real Det Return     | 379      |
| Real Sto Return     | 364      |
| Reward Loss         | -34.4    |
| Running Env Steps   | 362000   |
| Running Forward KL  | -1       |
| Running Reverse KL  | 3.27     |
| Running Update Time | 724      |
----------------------------------
2025-02-18 11:59:55.788679 ׼ʱ-
| Itration            | 725      |
| Real Det Return     | 365      |
| Real Sto Return     | 348      |
| Reward Loss         | -36.3    |
| Running Env Steps   | 362500   |
| Running Forward KL  | -1.23    |
| Running Reverse KL  | 3.57     |
| Running Update Time | 725      |
----------------------------------
2025-02-18 12:00:08.301313 ׼ʱ-
| Itration            | 726      |
| Real Det Return     | 376      |
| Real Sto Return     | 365      |
| Reward Loss         | -31.2    |
| Running Env Steps   | 363000   |
| Running Forward KL  | -1.79    |
| Running Reverse KL  | 3.57     |
| Running Update Time | 726      |
----------------------------------
2025-02-18 12:00:20.720200 ׼ʱ-
| Itration            | 727      |
| Real Det Return     | 393      |
| Real Sto Return     | 373      |
| Reward Loss         | -32.6    |
| Running Env Steps   | 363500   |
| Running Forward KL  | -1.04    |
| Running Reverse KL  | 3.77     |
| Running Update Time | 727      |
----------------------------------
2025-02-18 12:00:33.094604 ׼ʱ-
| Itration            | 728      |
| Real Det Return     | 375      |
| Real Sto Return     | 365      |
| Reward Loss         | -20.5    |
| Running Env Steps   | 364000   |
| Running Forward KL  | -1.49    |
| Running Reverse KL  | 3.36     |
| Running Update Time | 728      |
----------------------------------
2025-02-18 12:00:45.497861 ׼ʱ-
| Itration            | 729      |
| Real Det Return     | 370      |
| Real Sto Return     | 360      |
| Reward Loss         | -24.9    |
| Running Env Steps   | 364500   |
| Running Forward KL  | -1.32    |
| Running Reverse KL  | 3.93     |
| Running Update Time | 729      |
----------------------------------
2025-02-18 12:00:57.916758 ׼ʱ-
| Itration            | 730      |
| Real Det Return     | 381      |
| Real Sto Return     | 358      |
| Reward Loss         | -38.7    |
| Running Env Steps   | 365000   |
| Running Forward KL  | -1.3     |
| Running Reverse KL  | 3.27     |
| Running Update Time | 730      |
----------------------------------
2025-02-18 12:01:10.304424 ׼ʱ-
| Itration            | 731      |
| Real Det Return     | 369      |
| Real Sto Return     | 356      |
| Reward Loss         | -31.4    |
| Running Env Steps   | 365500   |
| Running Forward KL  | -1.59    |
| Running Reverse KL  | 3.5      |
| Running Update Time | 731      |
----------------------------------
2025-02-18 12:01:22.676447 ׼ʱ-
| Itration            | 732      |
| Real Det Return     | 404      |
| Real Sto Return     | 366      |
| Reward Loss         | -24.9    |
| Running Env Steps   | 366000   |
| Running Forward KL  | -1.06    |
| Running Reverse KL  | 4.12     |
| Running Update Time | 732      |
----------------------------------
2025-02-18 12:01:35.032860 ׼ʱ-
| Itration            | 733      |
| Real Det Return     | 371      |
| Real Sto Return     | 355      |
| Reward Loss         | -30      |
| Running Env Steps   | 366500   |
| Running Forward KL  | -1.03    |
| Running Reverse KL  | 3.85     |
| Running Update Time | 733      |
----------------------------------
2025-02-18 12:01:47.467382 ׼ʱ-
| Itration            | 734      |
| Real Det Return     | 384      |
| Real Sto Return     | 365      |
| Reward Loss         | -27.8    |
| Running Env Steps   | 367000   |
| Running Forward KL  | -0.84    |
| Running Reverse KL  | 4.45     |
| Running Update Time | 734      |
----------------------------------
2025-02-18 12:02:00.246271 ׼ʱ-
| Itration            | 735      |
| Real Det Return     | 384      |
| Real Sto Return     | 363      |
| Reward Loss         | -36.3    |
| Running Env Steps   | 367500   |
| Running Forward KL  | -1.21    |
| Running Reverse KL  | 4.23     |
| Running Update Time | 735      |
----------------------------------
2025-02-18 12:02:12.805751 ׼ʱ-
| Itration            | 736      |
| Real Det Return     | 380      |
| Real Sto Return     | 365      |
| Reward Loss         | -26      |
| Running Env Steps   | 368000   |
| Running Forward KL  | -1.32    |
| Running Reverse KL  | 3.81     |
| Running Update Time | 736      |
----------------------------------
2025-02-18 12:02:25.099691 ׼ʱ-
| Itration            | 737      |
| Real Det Return     | 389      |
| Real Sto Return     | 376      |
| Reward Loss         | -47.9    |
| Running Env Steps   | 368500   |
| Running Forward KL  | -1.24    |
| Running Reverse KL  | 3.64     |
| Running Update Time | 737      |
----------------------------------
2025-02-18 12:02:37.518576 ׼ʱ-
| Itration            | 738      |
| Real Det Return     | 384      |
| Real Sto Return     | 365      |
| Reward Loss         | -25.3    |
| Running Env Steps   | 369000   |
| Running Forward KL  | -1.07    |
| Running Reverse KL  | 3.57     |
| Running Update Time | 738      |
----------------------------------
2025-02-18 12:02:49.890609 ׼ʱ-
| Itration            | 739      |
| Real Det Return     | 396      |
| Real Sto Return     | 360      |
| Reward Loss         | -28      |
| Running Env Steps   | 369500   |
| Running Forward KL  | -0.727   |
| Running Reverse KL  | 3.63     |
| Running Update Time | 739      |
----------------------------------
2025-02-18 12:03:02.247022 ׼ʱ-
| Itration            | 740      |
| Real Det Return     | 398      |
| Real Sto Return     | 362      |
| Reward Loss         | -33.2    |
| Running Env Steps   | 370000   |
| Running Forward KL  | -0.472   |
| Running Reverse KL  | 4.29     |
| Running Update Time | 740      |
----------------------------------
2025-02-18 12:03:14.619056 ׼ʱ-
| Itration            | 741      |
| Real Det Return     | 369      |
| Real Sto Return     | 367      |
| Reward Loss         | -39.1    |
| Running Env Steps   | 370500   |
| Running Forward KL  | -0.701   |
| Running Reverse KL  | 3.96     |
| Running Update Time | 741      |
----------------------------------
2025-02-18 12:03:26.975469 ׼ʱ-
| Itration            | 742      |
| Real Det Return     | 362      |
| Real Sto Return     | 357      |
| Reward Loss         | -28.8    |
| Running Env Steps   | 371000   |
| Running Forward KL  | -1.73    |
| Running Reverse KL  | 3.73     |
| Running Update Time | 742      |
----------------------------------
2025-02-18 12:03:39.347511 ׼ʱ-
| Itration            | 743      |
| Real Det Return     | 362      |
| Real Sto Return     | 353      |
| Reward Loss         | -27.5    |
| Running Env Steps   | 371500   |
| Running Forward KL  | -1.41    |
| Running Reverse KL  | 3.73     |
| Running Update Time | 743      |
----------------------------------
2025-02-18 12:03:51.688303 ׼ʱ-
| Itration            | 744      |
| Real Det Return     | 368      |
| Real Sto Return     | 356      |
| Reward Loss         | -32.2    |
| Running Env Steps   | 372000   |
| Running Forward KL  | -1.33    |
| Running Reverse KL  | 3.82     |
| Running Update Time | 744      |
----------------------------------
2025-02-18 12:04:04.555845 ׼ʱ-
| Itration            | 745      |
| Real Det Return     | 377      |
| Real Sto Return     | 362      |
| Reward Loss         | -17.9    |
| Running Env Steps   | 372500   |
| Running Forward KL  | -1.21    |
| Running Reverse KL  | 3.49     |
| Running Update Time | 745      |
----------------------------------
2025-02-18 12:04:16.974743 ׼ʱ-
| Itration            | 746      |
| Real Det Return     | 371      |
| Real Sto Return     | 352      |
| Reward Loss         | -35.5    |
| Running Env Steps   | 373000   |
| Running Forward KL  | -0.942   |
| Running Reverse KL  | 4        |
| Running Update Time | 746      |
----------------------------------
2025-02-18 12:04:29.346776 ׼ʱ-
| Itration            | 747      |
| Real Det Return     | 376      |
| Real Sto Return     | 360      |
| Reward Loss         | -32.8    |
| Running Env Steps   | 373500   |
| Running Forward KL  | -1.6     |
| Running Reverse KL  | 3.3      |
| Running Update Time | 747      |
----------------------------------
2025-02-18 12:04:41.719174 ׼ʱ-
| Itration            | 748      |
| Real Det Return     | 378      |
| Real Sto Return     | 365      |
| Reward Loss         | -32.8    |
| Running Env Steps   | 374000   |
| Running Forward KL  | -1.5     |
| Running Reverse KL  | 3.67     |
| Running Update Time | 748      |
----------------------------------
2025-02-18 12:04:54.122494 ׼ʱ-
| Itration            | 749      |
| Real Det Return     | 374      |
| Real Sto Return     | 364      |
| Reward Loss         | -34      |
| Running Env Steps   | 374500   |
| Running Forward KL  | -0.903   |
| Running Reverse KL  | 4.13     |
| Running Update Time | 749      |
----------------------------------
2025-02-18 12:05:06.541387 ׼ʱ-
| Itration            | 750      |
| Real Det Return     | 391      |
| Real Sto Return     | 368      |
| Reward Loss         | -34.9    |
| Running Env Steps   | 375000   |
| Running Forward KL  | -1.86    |
| Running Reverse KL  | 3.24     |
| Running Update Time | 750      |
----------------------------------
2025-02-18 12:05:18.975892 ׼ʱ-
| Itration            | 751      |
| Real Det Return     | 391      |
| Real Sto Return     | 366      |
| Reward Loss         | -36.1    |
| Running Env Steps   | 375500   |
| Running Forward KL  | -1.05    |
| Running Reverse KL  | 3.97     |
| Running Update Time | 751      |
----------------------------------
2025-02-18 12:05:31.472896 ׼ʱ-
| Itration            | 752      |
| Real Det Return     | 376      |
| Real Sto Return     | 374      |
| Reward Loss         | -37.6    |
| Running Env Steps   | 376000   |
| Running Forward KL  | -1.62    |
| Running Reverse KL  | 3.68     |
| Running Update Time | 752      |
----------------------------------
2025-02-18 12:05:43.860551 ׼ʱ-
| Itration            | 753      |
| Real Det Return     | 369      |
| Real Sto Return     | 351      |
| Reward Loss         | -46.5    |
| Running Env Steps   | 376500   |
| Running Forward KL  | -1.03    |
| Running Reverse KL  | 3.62     |
| Running Update Time | 753      |
----------------------------------
2025-02-18 12:05:56.232585 ׼ʱ-
| Itration            | 754      |
| Real Det Return     | 380      |
| Real Sto Return     | 373      |
| Reward Loss         | -34.8    |
| Running Env Steps   | 377000   |
| Running Forward KL  | -1.55    |
| Running Reverse KL  | 3.65     |
| Running Update Time | 754      |
----------------------------------
2025-02-18 12:06:09.052724 ׼ʱ-
| Itration            | 755      |
| Real Det Return     | 386      |
| Real Sto Return     | 362      |
| Reward Loss         | -25.5    |
| Running Env Steps   | 377500   |
| Running Forward KL  | -1.62    |
| Running Reverse KL  | 3.59     |
| Running Update Time | 755      |
----------------------------------
2025-02-18 12:06:21.502863 ׼ʱ-
| Itration            | 756      |
| Real Det Return     | 359      |
| Real Sto Return     | 343      |
| Reward Loss         | -23.2    |
| Running Env Steps   | 378000   |
| Running Forward KL  | -1.47    |
| Running Reverse KL  | 3.26     |
| Running Update Time | 756      |
----------------------------------
2025-02-18 12:06:33.968615 ׼ʱ-
| Itration            | 757      |
| Real Det Return     | 379      |
| Real Sto Return     | 361      |
| Reward Loss         | -28.4    |
| Running Env Steps   | 378500   |
| Running Forward KL  | -1.65    |
| Running Reverse KL  | 3.49     |
| Running Update Time | 757      |
----------------------------------
2025-02-18 12:06:46.371877 ׼ʱ-
| Itration            | 758      |
| Real Det Return     | 344      |
| Real Sto Return     | 339      |
| Reward Loss         | -37.5    |
| Running Env Steps   | 379000   |
| Running Forward KL  | -1.85    |
| Running Reverse KL  | 2.99     |
| Running Update Time | 758      |
----------------------------------
2025-02-18 12:06:58.900148 ׼ʱ-
| Itration            | 759      |
| Real Det Return     | 371      |
| Real Sto Return     | 357      |
| Reward Loss         | -34.9    |
| Running Env Steps   | 379500   |
| Running Forward KL  | -1.55    |
| Running Reverse KL  | 3.77     |
| Running Update Time | 759      |
----------------------------------
2025-02-18 12:07:11.381521 ׼ʱ-
| Itration            | 760      |
| Real Det Return     | 400      |
| Real Sto Return     | 366      |
| Reward Loss         | -27.9    |
| Running Env Steps   | 380000   |
| Running Forward KL  | -1.06    |
| Running Reverse KL  | 3.91     |
| Running Update Time | 760      |
----------------------------------
2025-02-18 12:07:23.847291 ׼ʱ-
| Itration            | 761      |
| Real Det Return     | 384      |
| Real Sto Return     | 364      |
| Reward Loss         | -44.9    |
| Running Env Steps   | 380500   |
| Running Forward KL  | -1.11    |
| Running Reverse KL  | 3.91     |
| Running Update Time | 761      |
----------------------------------
2025-02-18 12:07:36.297423 ׼ʱ-
| Itration            | 762      |
| Real Det Return     | 377      |
| Real Sto Return     | 375      |
| Reward Loss         | -32.9    |
| Running Env Steps   | 381000   |
| Running Forward KL  | -1.7     |
| Running Reverse KL  | 3.85     |
| Running Update Time | 762      |
----------------------------------
2025-02-18 12:07:48.669455 ׼ʱ-
| Itration            | 763      |
| Real Det Return     | 380      |
| Real Sto Return     | 370      |
| Reward Loss         | -31.8    |
| Running Env Steps   | 381500   |
| Running Forward KL  | -1.12    |
| Running Reverse KL  | 3.74     |
| Running Update Time | 763      |
----------------------------------
2025-02-18 12:08:01.378011 ׼ʱ-
| Itration            | 764      |
| Real Det Return     | 387      |
| Real Sto Return     | 378      |
| Reward Loss         | -34.2    |
| Running Env Steps   | 382000   |
| Running Forward KL  | -1.99    |
| Running Reverse KL  | 3.91     |
| Running Update Time | 764      |
----------------------------------
2025-02-18 12:08:14.027910 ׼ʱ-
| Itration            | 765      |
| Real Det Return     | 363      |
| Real Sto Return     | 354      |
| Reward Loss         | -32.8    |
| Running Env Steps   | 382500   |
| Running Forward KL  | -1.29    |
| Running Reverse KL  | 3.94     |
| Running Update Time | 765      |
----------------------------------
2025-02-18 12:08:26.540535 ׼ʱ-
| Itration            | 766      |
| Real Det Return     | 385      |
| Real Sto Return     | 368      |
| Reward Loss         | -29.8    |
| Running Env Steps   | 383000   |
| Running Forward KL  | -1.49    |
| Running Reverse KL  | 2.94     |
| Running Update Time | 766      |
----------------------------------
2025-02-18 12:08:38.959424 ׼ʱ-
| Itration            | 767      |
| Real Det Return     | 361      |
| Real Sto Return     | 348      |
| Reward Loss         | -33.7    |
| Running Env Steps   | 383500   |
| Running Forward KL  | -1.59    |
| Running Reverse KL  | 3.52     |
| Running Update Time | 767      |
----------------------------------
2025-02-18 12:08:51.393942 ׼ʱ-
| Itration            | 768      |
| Real Det Return     | 367      |
| Real Sto Return     | 346      |
| Reward Loss         | -42.6    |
| Running Env Steps   | 384000   |
| Running Forward KL  | -0.866   |
| Running Reverse KL  | 4.4      |
| Running Update Time | 768      |
----------------------------------
2025-02-18 12:09:03.828461 ׼ʱ-
| Itration            | 769      |
| Real Det Return     | 375      |
| Real Sto Return     | 364      |
| Reward Loss         | -29.8    |
| Running Env Steps   | 384500   |
| Running Forward KL  | -1.63    |
| Running Reverse KL  | 3.95     |
| Running Update Time | 769      |
----------------------------------
2025-02-18 12:09:16.387959 ׼ʱ-
| Itration            | 770      |
| Real Det Return     | 377      |
| Real Sto Return     | 361      |
| Reward Loss         | -33.5    |
| Running Env Steps   | 385000   |
| Running Forward KL  | -1.05    |
| Running Reverse KL  | 3.59     |
| Running Update Time | 770      |
----------------------------------
2025-02-18 12:09:28.775604 ׼ʱ-
| Itration            | 771      |
| Real Det Return     | 375      |
| Real Sto Return     | 353      |
| Reward Loss         | -30.1    |
| Running Env Steps   | 385500   |
| Running Forward KL  | -1.94    |
| Running Reverse KL  | 3.35     |
| Running Update Time | 771      |
----------------------------------
2025-02-18 12:09:41.194511 ׼ʱ-
| Itration            | 772      |
| Real Det Return     | 370      |
| Real Sto Return     | 366      |
| Reward Loss         | -35.4    |
| Running Env Steps   | 386000   |
| Running Forward KL  | -1.56    |
| Running Reverse KL  | 3.17     |
| Running Update Time | 772      |
----------------------------------
2025-02-18 12:09:53.597778 ׼ʱ-
| Itration            | 773      |
| Real Det Return     | 371      |
| Real Sto Return     | 367      |
| Reward Loss         | -20.5    |
| Running Env Steps   | 386500   |
| Running Forward KL  | -1.32    |
| Running Reverse KL  | 4.06     |
| Running Update Time | 773      |
----------------------------------
2025-02-18 12:10:06.403122 ׼ʱ-
| Itration            | 774      |
| Real Det Return     | 348      |
| Real Sto Return     | 330      |
| Reward Loss         | -38.3    |
| Running Env Steps   | 387000   |
| Running Forward KL  | -1.04    |
| Running Reverse KL  | 3.77     |
| Running Update Time | 774      |
----------------------------------
2025-02-18 12:10:18.855913 ׼ʱ-
| Itration            | 775      |
| Real Det Return     | 378      |
| Real Sto Return     | 359      |
| Reward Loss         | -30.2    |
| Running Env Steps   | 387500   |
| Running Forward KL  | -1.46    |
| Running Reverse KL  | 3.45     |
| Running Update Time | 775      |
----------------------------------
2025-02-18 12:10:31.274807 ׼ʱ-
| Itration            | 776      |
| Real Det Return     | 374      |
| Real Sto Return     | 364      |
| Reward Loss         | -36.9    |
| Running Env Steps   | 388000   |
| Running Forward KL  | -1.46    |
| Running Reverse KL  | 3.67     |
| Running Update Time | 776      |
----------------------------------
2025-02-18 12:10:43.678077 ׼ʱ-
| Itration            | 777      |
| Real Det Return     | 367      |
| Real Sto Return     | 353      |
| Reward Loss         | -43.6    |
| Running Env Steps   | 388500   |
| Running Forward KL  | -1.75    |
| Running Reverse KL  | 3.27     |
| Running Update Time | 777      |
----------------------------------
2025-02-18 12:10:56.096986 ׼ʱ-
| Itration            | 778      |
| Real Det Return     | 381      |
| Real Sto Return     | 362      |
| Reward Loss         | -31.6    |
| Running Env Steps   | 389000   |
| Running Forward KL  | -1.33    |
| Running Reverse KL  | 3.4      |
| Running Update Time | 778      |
----------------------------------
2025-02-18 12:11:08.515872 ׼ʱ-
| Itration            | 779      |
| Real Det Return     | 366      |
| Real Sto Return     | 358      |
| Reward Loss         | -22.2    |
| Running Env Steps   | 389500   |
| Running Forward KL  | -1.25    |
| Running Reverse KL  | 4.07     |
| Running Update Time | 779      |
----------------------------------
2025-02-18 12:11:20.966012 ׼ʱ-
| Itration            | 780      |
| Real Det Return     | 378      |
| Real Sto Return     | 366      |
| Reward Loss         | -43.9    |
| Running Env Steps   | 390000   |
| Running Forward KL  | -1.19    |
| Running Reverse KL  | 3.99     |
| Running Update Time | 780      |
----------------------------------
2025-02-18 12:11:33.353667 ׼ʱ-
| Itration            | 781      |
| Real Det Return     | 368      |
| Real Sto Return     | 357      |
| Reward Loss         | -37.4    |
| Running Env Steps   | 390500   |
| Running Forward KL  | -1.43    |
| Running Reverse KL  | 3.52     |
| Running Update Time | 781      |
----------------------------------
2025-02-18 12:11:45.725701 ׼ʱ-
| Itration            | 782      |
| Real Det Return     | 373      |
| Real Sto Return     | 366      |
| Reward Loss         | -10.2    |
| Running Env Steps   | 391000   |
| Running Forward KL  | -1.38    |
| Running Reverse KL  | 3.69     |
| Running Update Time | 782      |
----------------------------------
2025-02-18 12:11:58.097744 ׼ʱ-
| Itration            | 783      |
| Real Det Return     | 379      |
| Real Sto Return     | 378      |
| Reward Loss         | -29      |
| Running Env Steps   | 391500   |
| Running Forward KL  | -1.65    |
| Running Reverse KL  | 3.69     |
| Running Update Time | 783      |
----------------------------------
2025-02-18 12:12:10.990616 ׼ʱ-
| Itration            | 784      |
| Real Det Return     | 384      |
| Real Sto Return     | 359      |
| Reward Loss         | -29.8    |
| Running Env Steps   | 392000   |
| Running Forward KL  | -0.922   |
| Running Reverse KL  | 4.33     |
| Running Update Time | 784      |
----------------------------------
2025-02-18 12:12:23.425144 ׼ʱ-
| Itration            | 785      |
| Real Det Return     | 378      |
| Real Sto Return     | 359      |
| Reward Loss         | -29.6    |
| Running Env Steps   | 392500   |
| Running Forward KL  | -1.67    |
| Running Reverse KL  | 3.99     |
| Running Update Time | 785      |
----------------------------------
2025-02-18 12:12:35.859663 ׼ʱ-
| Itration            | 786      |
| Real Det Return     | 378      |
| Real Sto Return     | 365      |
| Reward Loss         | -20.5    |
| Running Env Steps   | 393000   |
| Running Forward KL  | -1.79    |
| Running Reverse KL  | 3.87     |
| Running Update Time | 786      |
----------------------------------
2025-02-18 12:12:48.278551 ׼ʱ-
| Itration            | 787      |
| Real Det Return     | 379      |
| Real Sto Return     | 355      |
| Reward Loss         | -19.3    |
| Running Env Steps   | 393500   |
| Running Forward KL  | -1.65    |
| Running Reverse KL  | 4.33     |
| Running Update Time | 787      |
----------------------------------
2025-02-18 12:13:00.697451 ׼ʱ-
| Itration            | 788      |
| Real Det Return     | 383      |
| Real Sto Return     | 369      |
| Reward Loss         | -24.7    |
| Running Env Steps   | 394000   |
| Running Forward KL  | -1.19    |
| Running Reverse KL  | 3.69     |
| Running Update Time | 788      |
----------------------------------
2025-02-18 12:13:13.178841 ׼ʱ-
| Itration            | 789      |
| Real Det Return     | 376      |
| Real Sto Return     | 359      |
| Reward Loss         | -18.6    |
| Running Env Steps   | 394500   |
| Running Forward KL  | -1.94    |
| Running Reverse KL  | 4.04     |
| Running Update Time | 789      |
----------------------------------
2025-02-18 12:13:25.597728 ׼ʱ-
| Itration            | 790      |
| Real Det Return     | 371      |
| Real Sto Return     | 355      |
| Reward Loss         | -45.7    |
| Running Env Steps   | 395000   |
| Running Forward KL  | -1.66    |
| Running Reverse KL  | 3.82     |
| Running Update Time | 790      |
----------------------------------
2025-02-18 12:13:37.954142 ׼ʱ-
| Itration            | 791      |
| Real Det Return     | 385      |
| Real Sto Return     | 374      |
| Reward Loss         | -24.1    |
| Running Env Steps   | 395500   |
| Running Forward KL  | -1.73    |
| Running Reverse KL  | 3.62     |
| Running Update Time | 791      |
----------------------------------
2025-02-18 12:13:50.341805 ׼ʱ-
| Itration            | 792      |
| Real Det Return     | 402      |
| Real Sto Return     | 367      |
| Reward Loss         | -39.7    |
| Running Env Steps   | 396000   |
| Running Forward KL  | -0.628   |
| Running Reverse KL  | 3.84     |
| Running Update Time | 792      |
----------------------------------
2025-02-18 12:14:02.760703 ׼ʱ-
| Itration            | 793      |
| Real Det Return     | 370      |
| Real Sto Return     | 364      |
| Reward Loss         | -21.7    |
| Running Env Steps   | 396500   |
| Running Forward KL  | -1.41    |
| Running Reverse KL  | 4.02     |
| Running Update Time | 793      |
----------------------------------
2025-02-18 12:14:15.522663 ׼ʱ-
| Itration            | 794      |
| Real Det Return     | 379      |
| Real Sto Return     | 367      |
| Reward Loss         | -27.9    |
| Running Env Steps   | 397000   |
| Running Forward KL  | -1.55    |
| Running Reverse KL  | 3.89     |
| Running Update Time | 794      |
----------------------------------
2025-02-18 12:14:27.941555 ׼ʱ-
| Itration            | 795      |
| Real Det Return     | 376      |
| Real Sto Return     | 363      |
| Reward Loss         | -25.3    |
| Running Env Steps   | 397500   |
| Running Forward KL  | -2.19    |
| Running Reverse KL  | 3.25     |
| Running Update Time | 795      |
----------------------------------
2025-02-18 12:14:40.376552 ׼ʱ-
| Itration            | 796      |
| Real Det Return     | 361      |
| Real Sto Return     | 354      |
| Reward Loss         | -24.5    |
| Running Env Steps   | 398000   |
| Running Forward KL  | -1.13    |
| Running Reverse KL  | 3.66     |
| Running Update Time | 796      |
----------------------------------
2025-02-18 12:14:52.779820 ׼ʱ-
| Itration            | 797      |
| Real Det Return     | 348      |
| Real Sto Return     | 341      |
| Reward Loss         | -42.2    |
| Running Env Steps   | 398500   |
| Running Forward KL  | -1.06    |
| Running Reverse KL  | 3.92     |
| Running Update Time | 797      |
----------------------------------
2025-02-18 12:15:05.229934 ׼ʱ-
| Itration            | 798      |
| Real Det Return     | 386      |
| Real Sto Return     | 364      |
| Reward Loss         | -33.8    |
| Running Env Steps   | 399000   |
| Running Forward KL  | -1.74    |
| Running Reverse KL  | 3.48     |
| Running Update Time | 798      |
----------------------------------
2025-02-18 12:15:17.711354 ׼ʱ-
| Itration            | 799      |
| Real Det Return     | 385      |
| Real Sto Return     | 364      |
| Reward Loss         | -27.1    |
| Running Env Steps   | 399500   |
| Running Forward KL  | -0.885   |
| Running Reverse KL  | 3.83     |
| Running Update Time | 799      |
----------------------------------
2025-02-18 12:15:30.114627 ׼ʱ-
| Itration            | 800      |
| Real Det Return     | 376      |
| Real Sto Return     | 361      |
| Reward Loss         | -17      |
| Running Env Steps   | 400000   |
| Running Forward KL  | -1.32    |
| Running Reverse KL  | 3.92     |
| Running Update Time | 800      |
----------------------------------
2025-02-18 12:15:42.517869 ׼ʱ-
| Itration            | 801      |
| Real Det Return     | 345      |
| Real Sto Return     | 341      |
| Reward Loss         | -38.8    |
| Running Env Steps   | 400500   |
| Running Forward KL  | -1.74    |
| Running Reverse KL  | 3.61     |
| Running Update Time | 801      |
----------------------------------
2025-02-18 12:15:54.889937 ׼ʱ-
| Itration            | 802      |
| Real Det Return     | 349      |
| Real Sto Return     | 350      |
| Reward Loss         | -19.9    |
| Running Env Steps   | 401000   |
| Running Forward KL  | -1.62    |
| Running Reverse KL  | 4.14     |
| Running Update Time | 802      |
----------------------------------
2025-02-18 12:16:07.371310 ׼ʱ-
| Itration            | 803      |
| Real Det Return     | 368      |
| Real Sto Return     | 353      |
| Reward Loss         | -36.2    |
| Running Env Steps   | 401500   |
| Running Forward KL  | -1.6     |
| Running Reverse KL  | 3.72     |
| Running Update Time | 803      |
----------------------------------
2025-02-18 12:16:20.186557 ׼ʱ-
| Itration            | 804      |
| Real Det Return     | 374      |
| Real Sto Return     | 356      |
| Reward Loss         | -53      |
| Running Env Steps   | 402000   |
| Running Forward KL  | -1.7     |
| Running Reverse KL  | 3.32     |
| Running Update Time | 804      |
----------------------------------
2025-02-18 12:16:32.621077 ׼ʱ-
| Itration            | 805      |
| Real Det Return     | 376      |
| Real Sto Return     | 365      |
| Reward Loss         | -33.1    |
| Running Env Steps   | 402500   |
| Running Forward KL  | -1.76    |
| Running Reverse KL  | 3.08     |
| Running Update Time | 805      |
----------------------------------
2025-02-18 12:16:45.258672 ׼ʱ-
| Itration            | 806      |
| Real Det Return     | 378      |
| Real Sto Return     | 363      |
| Reward Loss         | -29.5    |
| Running Env Steps   | 403000   |
| Running Forward KL  | -1.93    |
| Running Reverse KL  | 4        |
| Running Update Time | 806      |
----------------------------------
2025-02-18 12:16:57.818160 ׼ʱ-
| Itration            | 807      |
| Real Det Return     | 394      |
| Real Sto Return     | 364      |
| Reward Loss         | -38.6    |
| Running Env Steps   | 403500   |
| Running Forward KL  | -1.7     |
| Running Reverse KL  | 2.8      |
| Running Update Time | 807      |
----------------------------------
2025-02-18 12:17:10.268313 ׼ʱ-
| Itration            | 808      |
| Real Det Return     | 365      |
| Real Sto Return     | 336      |
| Reward Loss         | -34.4    |
| Running Env Steps   | 404000   |
| Running Forward KL  | -1.85    |
| Running Reverse KL  | 3.53     |
| Running Update Time | 808      |
----------------------------------
2025-02-18 12:17:22.780935 ׼ʱ-
| Itration            | 809      |
| Real Det Return     | 386      |
| Real Sto Return     | 374      |
| Reward Loss         | -52.7    |
| Running Env Steps   | 404500   |
| Running Forward KL  | -1.13    |
| Running Reverse KL  | 3.58     |
| Running Update Time | 809      |
----------------------------------
2025-02-18 12:17:35.246696 ׼ʱ-
| Itration            | 810      |
| Real Det Return     | 365      |
| Real Sto Return     | 358      |
| Reward Loss         | -33.9    |
| Running Env Steps   | 405000   |
| Running Forward KL  | -1.38    |
| Running Reverse KL  | 4.04     |
| Running Update Time | 810      |
----------------------------------
2025-02-18 12:17:48.212337 ׼ʱ-
| Itration            | 811      |
| Real Det Return     | 381      |
| Real Sto Return     | 364      |
| Reward Loss         | -33.8    |
| Running Env Steps   | 405500   |
| Running Forward KL  | -1.39    |
| Running Reverse KL  | 3.93     |
| Running Update Time | 811      |
----------------------------------
2025-02-18 12:18:00.678089 ׼ʱ-
| Itration            | 812      |
| Real Det Return     | 376      |
| Real Sto Return     | 367      |
| Reward Loss         | -25.1    |
| Running Env Steps   | 406000   |
| Running Forward KL  | -2.08    |
| Running Reverse KL  | 3.61     |
| Running Update Time | 812      |
----------------------------------
2025-02-18 12:18:13.097001 ׼ʱ-
| Itration            | 813      |
| Real Det Return     | 362      |
| Real Sto Return     | 358      |
| Reward Loss         | -38.9    |
| Running Env Steps   | 406500   |
| Running Forward KL  | -1.16    |
| Running Reverse KL  | 3.92     |
| Running Update Time | 813      |
----------------------------------
2025-02-18 12:18:25.998069 ׼ʱ-
| Itration            | 814      |
| Real Det Return     | 370      |
| Real Sto Return     | 349      |
| Reward Loss         | -41.1    |
| Running Env Steps   | 407000   |
| Running Forward KL  | -1.53    |
| Running Reverse KL  | 3.47     |
| Running Update Time | 814      |
----------------------------------
2025-02-18 12:18:38.463839 ׼ʱ-
| Itration            | 815      |
| Real Det Return     | 361      |
| Real Sto Return     | 346      |
| Reward Loss         | -40.2    |
| Running Env Steps   | 407500   |
| Running Forward KL  | -1.45    |
| Running Reverse KL  | 3.72     |
| Running Update Time | 815      |
----------------------------------
2025-02-18 12:18:50.929602 ׼ʱ-
| Itration            | 816      |
| Real Det Return     | 376      |
| Real Sto Return     | 367      |
| Reward Loss         | -40.7    |
| Running Env Steps   | 408000   |
| Running Forward KL  | -1.69    |
| Running Reverse KL  | 3.75     |
| Running Update Time | 816      |
----------------------------------
2025-02-18 12:19:03.364119 ׼ʱ-
| Itration            | 817      |
| Real Det Return     | 371      |
| Real Sto Return     | 355      |
| Reward Loss         | -31.9    |
| Running Env Steps   | 408500   |
| Running Forward KL  | -1.76    |
| Running Reverse KL  | 4.18     |
| Running Update Time | 817      |
----------------------------------
2025-02-18 12:19:15.829881 ׼ʱ-
| Itration            | 818      |
| Real Det Return     | 360      |
| Real Sto Return     | 344      |
| Reward Loss         | -38.9    |
| Running Env Steps   | 409000   |
| Running Forward KL  | -2.15    |
| Running Reverse KL  | 3.34     |
| Running Update Time | 818      |
----------------------------------
2025-02-18 12:19:28.295642 ׼ʱ-
| Itration            | 819      |
| Real Det Return     | 357      |
| Real Sto Return     | 362      |
| Reward Loss         | -38.1    |
| Running Env Steps   | 409500   |
| Running Forward KL  | -1.35    |
| Running Reverse KL  | 3.38     |
| Running Update Time | 819      |
----------------------------------
2025-02-18 12:19:40.683300 ׼ʱ-
| Itration            | 820      |
| Real Det Return     | 382      |
| Real Sto Return     | 364      |
| Reward Loss         | -22.2    |
| Running Env Steps   | 410000   |
| Running Forward KL  | -1.72    |
| Running Reverse KL  | 3.7      |
| Running Update Time | 820      |
----------------------------------
2025-02-18 12:19:53.086573 ׼ʱ-
| Itration            | 821      |
| Real Det Return     | 361      |
| Real Sto Return     | 356      |
| Reward Loss         | -36.5    |
| Running Env Steps   | 410500   |
| Running Forward KL  | -2.03    |
| Running Reverse KL  | 3.8      |
| Running Update Time | 821      |
----------------------------------
2025-02-18 12:20:05.521083 ׼ʱ-
| Itration            | 822      |
| Real Det Return     | 384      |
| Real Sto Return     | 354      |
| Reward Loss         | -31.3    |
| Running Env Steps   | 411000   |
| Running Forward KL  | -1.68    |
| Running Reverse KL  | 3.97     |
| Running Update Time | 822      |
----------------------------------
2025-02-18 12:20:18.033717 ׼ʱ-
| Itration            | 823      |
| Real Det Return     | 374      |
| Real Sto Return     | 352      |
| Reward Loss         | -28.3    |
| Running Env Steps   | 411500   |
| Running Forward KL  | -1.79    |
| Running Reverse KL  | 3.41     |
| Running Update Time | 823      |
----------------------------------
2025-02-18 12:20:31.008810 ׼ʱ-
| Itration            | 824      |
| Real Det Return     | 366      |
| Real Sto Return     | 354      |
| Reward Loss         | -50.9    |
| Running Env Steps   | 412000   |
| Running Forward KL  | -1.52    |
| Running Reverse KL  | 3.57     |
| Running Update Time | 824      |
----------------------------------
2025-02-18 12:20:43.365213 ׼ʱ-
| Itration            | 825      |
| Real Det Return     | 382      |
| Real Sto Return     | 368      |
| Reward Loss         | -31.8    |
| Running Env Steps   | 412500   |
| Running Forward KL  | -1.32    |
| Running Reverse KL  | 4.06     |
| Running Update Time | 825      |
----------------------------------
2025-02-18 12:20:55.815354 ׼ʱ-
| Itration            | 826      |
| Real Det Return     | 366      |
| Real Sto Return     | 348      |
| Reward Loss         | -39.6    |
| Running Env Steps   | 413000   |
| Running Forward KL  | -1.89    |
| Running Reverse KL  | 3.26     |
| Running Update Time | 826      |
----------------------------------
2025-02-18 12:21:08.374853 ׼ʱ-
| Itration            | 827      |
| Real Det Return     | 376      |
| Real Sto Return     | 368      |
| Reward Loss         | -26.5    |
| Running Env Steps   | 413500   |
| Running Forward KL  | -1.86    |
| Running Reverse KL  | 3.94     |
| Running Update Time | 827      |
----------------------------------
2025-02-18 12:21:20.871857 ׼ʱ-
| Itration            | 828      |
| Real Det Return     | 378      |
| Real Sto Return     | 374      |
| Reward Loss         | -31.9    |
| Running Env Steps   | 414000   |
| Running Forward KL  | -1.91    |
| Running Reverse KL  | 3.66     |
| Running Update Time | 828      |
----------------------------------
2025-02-18 12:21:33.431335 ׼ʱ-
| Itration            | 829      |
| Real Det Return     | 374      |
| Real Sto Return     | 363      |
| Reward Loss         | -25.5    |
| Running Env Steps   | 414500   |
| Running Forward KL  | -1.5     |
| Running Reverse KL  | 3.62     |
| Running Update Time | 829      |
----------------------------------
2025-02-18 12:21:45.818990 ׼ʱ-
| Itration            | 830      |
| Real Det Return     | 375      |
| Real Sto Return     | 363      |
| Reward Loss         | -20.8    |
| Running Env Steps   | 415000   |
| Running Forward KL  | -0.95    |
| Running Reverse KL  | 3.66     |
| Running Update Time | 830      |
----------------------------------
2025-02-18 12:21:58.237887 ׼ʱ-
| Itration            | 831      |
| Real Det Return     | 356      |
| Real Sto Return     | 349      |
| Reward Loss         | -49      |
| Running Env Steps   | 415500   |
| Running Forward KL  | -1.9     |
| Running Reverse KL  | 3.29     |
| Running Update Time | 831      |
----------------------------------
2025-02-18 12:22:10.672407 ׼ʱ-
| Itration            | 832      |
| Real Det Return     | 370      |
| Real Sto Return     | 357      |
| Reward Loss         | -33      |
| Running Env Steps   | 416000   |
| Running Forward KL  | -2.32    |
| Running Reverse KL  | 4.36     |
| Running Update Time | 832      |
----------------------------------
2025-02-18 12:22:23.449024 ׼ʱ-
| Itration            | 833      |
| Real Det Return     | 375      |
| Real Sto Return     | 362      |
| Reward Loss         | -21.7    |
| Running Env Steps   | 416500   |
| Running Forward KL  | -1.91    |
| Running Reverse KL  | 4.36     |
| Running Update Time | 833      |
----------------------------------
2025-02-18 12:22:35.899164 ׼ʱ-
| Itration            | 834      |
| Real Det Return     | 374      |
| Real Sto Return     | 360      |
| Reward Loss         | -31.2    |
| Running Env Steps   | 417000   |
| Running Forward KL  | -1.71    |
| Running Reverse KL  | 3.39     |
| Running Update Time | 834      |
----------------------------------
2025-02-18 12:22:48.349314 ׼ʱ-
| Itration            | 835      |
| Real Det Return     | 369      |
| Real Sto Return     | 362      |
| Reward Loss         | -25.3    |
| Running Env Steps   | 417500   |
| Running Forward KL  | -1.85    |
| Running Reverse KL  | 3.68     |
| Running Update Time | 835      |
----------------------------------
2025-02-18 12:23:00.830671 ׼ʱ-
| Itration            | 836      |
| Real Det Return     | 366      |
| Real Sto Return     | 359      |
| Reward Loss         | -35.7    |
| Running Env Steps   | 418000   |
| Running Forward KL  | -1.64    |
| Running Reverse KL  | 3.78     |
| Running Update Time | 836      |
----------------------------------
2025-02-18 12:23:13.296459 ׼ʱ-
| Itration            | 837      |
| Real Det Return     | 363      |
| Real Sto Return     | 355      |
| Reward Loss         | -43.6    |
| Running Env Steps   | 418500   |
| Running Forward KL  | -1.67    |
| Running Reverse KL  | 4.14     |
| Running Update Time | 837      |
----------------------------------
2025-02-18 12:23:25.762210 ׼ʱ-
| Itration            | 838      |
| Real Det Return     | 371      |
| Real Sto Return     | 357      |
| Reward Loss         | -31.9    |
| Running Env Steps   | 419000   |
| Running Forward KL  | -2.1     |
| Running Reverse KL  | 3.67     |
| Running Update Time | 838      |
----------------------------------
2025-02-18 12:23:38.322266 ׼ʱ-
| Itration            | 839      |
| Real Det Return     | 378      |
| Real Sto Return     | 367      |
| Reward Loss         | -32.3    |
| Running Env Steps   | 419500   |
| Running Forward KL  | -1.63    |
| Running Reverse KL  | 3.24     |
| Running Update Time | 839      |
----------------------------------
2025-02-18 12:23:50.834900 ׼ʱ-
| Itration            | 840      |
| Real Det Return     | 364      |
| Real Sto Return     | 353      |
| Reward Loss         | -37      |
| Running Env Steps   | 420000   |
| Running Forward KL  | -1.97    |
| Running Reverse KL  | 3.45     |
| Running Update Time | 840      |
----------------------------------
2025-02-18 12:24:03.285030 ׼ʱ-
| Itration            | 841      |
| Real Det Return     | 372      |
| Real Sto Return     | 360      |
| Reward Loss         | -27.1    |
| Running Env Steps   | 420500   |
| Running Forward KL  | -1.94    |
| Running Reverse KL  | 3.69     |
| Running Update Time | 841      |
----------------------------------
2025-02-18 12:24:15.766422 ׼ʱ-
| Itration            | 842      |
| Real Det Return     | 384      |
| Real Sto Return     | 381      |
| Reward Loss         | -35.8    |
| Running Env Steps   | 421000   |
| Running Forward KL  | -1.75    |
| Running Reverse KL  | 3.46     |
| Running Update Time | 842      |
----------------------------------
2025-02-18 12:24:28.572061 ׼ʱ-
| Itration            | 843      |
| Real Det Return     | 361      |
| Real Sto Return     | 349      |
| Reward Loss         | -35.5    |
| Running Env Steps   | 421500   |
| Running Forward KL  | -1.6     |
| Running Reverse KL  | 3.31     |
| Running Update Time | 843      |
----------------------------------
2025-02-18 12:24:41.037823 ׼ʱ-
| Itration            | 844      |
| Real Det Return     | 369      |
| Real Sto Return     | 351      |
| Reward Loss         | -38.1    |
| Running Env Steps   | 422000   |
| Running Forward KL  | -1.5     |
| Running Reverse KL  | 3.77     |
| Running Update Time | 844      |
----------------------------------
2025-02-18 12:24:53.488433 ׼ʱ-
| Itration            | 845      |
| Real Det Return     | 398      |
| Real Sto Return     | 381      |
| Reward Loss         | -20.3    |
| Running Env Steps   | 422500   |
| Running Forward KL  | -1.77    |
| Running Reverse KL  | 3.92     |
| Running Update Time | 845      |
----------------------------------
2025-02-18 12:25:06.032300 ׼ʱ-
| Itration            | 846      |
| Real Det Return     | 364      |
| Real Sto Return     | 352      |
| Reward Loss         | -25.6    |
| Running Env Steps   | 423000   |
| Running Forward KL  | -1.68    |
| Running Reverse KL  | 3.73     |
| Running Update Time | 846      |
----------------------------------
2025-02-18 12:25:18.560546 ׼ʱ-
| Itration            | 847      |
| Real Det Return     | 394      |
| Real Sto Return     | 372      |
| Reward Loss         | -31.9    |
| Running Env Steps   | 423500   |
| Running Forward KL  | -1.46    |
| Running Reverse KL  | 3.38     |
| Running Update Time | 847      |
----------------------------------
2025-02-18 12:25:31.198152 ׼ʱ-
| Itration            | 848      |
| Real Det Return     | 365      |
| Real Sto Return     | 335      |
| Reward Loss         | -63      |
| Running Env Steps   | 424000   |
| Running Forward KL  | -1.44    |
| Running Reverse KL  | 3.88     |
| Running Update Time | 848      |
----------------------------------
2025-02-18 12:25:43.632676 ׼ʱ-
| Itration            | 849      |
| Real Det Return     | 338      |
| Real Sto Return     | 335      |
| Reward Loss         | -48.6    |
| Running Env Steps   | 424500   |
| Running Forward KL  | -1.64    |
| Running Reverse KL  | 4.23     |
| Running Update Time | 849      |
----------------------------------
2025-02-18 12:25:56.051567 ׼ʱ-
| Itration            | 850      |
| Real Det Return     | 377      |
| Real Sto Return     | 360      |
| Reward Loss         | -45.3    |
| Running Env Steps   | 425000   |
| Running Forward KL  | -1.03    |
| Running Reverse KL  | 3.78     |
| Running Update Time | 850      |
----------------------------------
2025-02-18 12:26:08.486087 ׼ʱ-
| Itration            | 851      |
| Real Det Return     | 386      |
| Real Sto Return     | 372      |
| Reward Loss         | -35.6    |
| Running Env Steps   | 425500   |
| Running Forward KL  | -1.59    |
| Running Reverse KL  | 3.82     |
| Running Update Time | 851      |
----------------------------------
2025-02-18 12:26:20.920605 ׼ʱ-
| Itration            | 852      |
| Real Det Return     | 372      |
| Real Sto Return     | 359      |
| Reward Loss         | -25.6    |
| Running Env Steps   | 426000   |
| Running Forward KL  | -2.04    |
| Running Reverse KL  | 3.54     |
| Running Update Time | 852      |
----------------------------------
2025-02-18 12:26:33.729027 ׼ʱ-
| Itration            | 853      |
| Real Det Return     | 379      |
| Real Sto Return     | 360      |
| Reward Loss         | -33.2    |
| Running Env Steps   | 426500   |
| Running Forward KL  | -1.41    |
| Running Reverse KL  | 3.94     |
| Running Update Time | 853      |
----------------------------------
2025-02-18 12:26:46.226030 ׼ʱ-
| Itration            | 854      |
| Real Det Return     | 364      |
| Real Sto Return     | 356      |
| Reward Loss         | -37.2    |
| Running Env Steps   | 427000   |
| Running Forward KL  | -1.58    |
| Running Reverse KL  | 4.03     |
| Running Update Time | 854      |
----------------------------------
2025-02-18 12:26:58.601974 ׼ʱ-
| Itration            | 855      |
| Real Det Return     | 364      |
| Real Sto Return     | 356      |
| Reward Loss         | -40.1    |
| Running Env Steps   | 427500   |
| Running Forward KL  | -1.4     |
| Running Reverse KL  | 3.49     |
| Running Update Time | 855      |
----------------------------------
2025-02-18 12:27:11.083369 ׼ʱ-
| Itration            | 856      |
| Real Det Return     | 356      |
| Real Sto Return     | 353      |
| Reward Loss         | -29.4    |
| Running Env Steps   | 428000   |
| Running Forward KL  | -1.06    |
| Running Reverse KL  | 4.16     |
| Running Update Time | 856      |
----------------------------------
2025-02-18 12:27:23.611579 ׼ʱ-
| Itration            | 857      |
| Real Det Return     | 368      |
| Real Sto Return     | 354      |
| Reward Loss         | -31.5    |
| Running Env Steps   | 428500   |
| Running Forward KL  | -1.37    |
| Running Reverse KL  | 3.71     |
| Running Update Time | 857      |
----------------------------------
2025-02-18 12:27:36.046131 ׼ʱ-
| Itration            | 858      |
| Real Det Return     | 387      |
| Real Sto Return     | 366      |
| Reward Loss         | -33.3    |
| Running Env Steps   | 429000   |
| Running Forward KL  | -0.851   |
| Running Reverse KL  | 4.25     |
| Running Update Time | 858      |
----------------------------------
2025-02-18 12:27:48.511882 ׼ʱ-
| Itration            | 859      |
| Real Det Return     | 384      |
| Real Sto Return     | 357      |
| Reward Loss         | -40.6    |
| Running Env Steps   | 429500   |
| Running Forward KL  | -1.1     |
| Running Reverse KL  | 4.17     |
| Running Update Time | 859      |
----------------------------------
2025-02-18 12:28:00.946415 ׼ʱ-
| Itration            | 860      |
| Real Det Return     | 366      |
| Real Sto Return     | 350      |
| Reward Loss         | -35.1    |
| Running Env Steps   | 430000   |
| Running Forward KL  | -1.87    |
| Running Reverse KL  | 3.18     |
| Running Update Time | 860      |
----------------------------------
2025-02-18 12:28:13.380929 ׼ʱ-
| Itration            | 861      |
| Real Det Return     | 374      |
| Real Sto Return     | 363      |
| Reward Loss         | -36      |
| Running Env Steps   | 430500   |
| Running Forward KL  | -1.09    |
| Running Reverse KL  | 3.98     |
| Running Update Time | 861      |
----------------------------------
2025-02-18 12:28:25.799817 ׼ʱ-
| Itration            | 862      |
| Real Det Return     | 356      |
| Real Sto Return     | 349      |
| Reward Loss         | -53.9    |
| Running Env Steps   | 431000   |
| Running Forward KL  | -1.7     |
| Running Reverse KL  | 3.82     |
| Running Update Time | 862      |
----------------------------------
2025-02-18 12:28:38.630790 ׼ʱ-
| Itration            | 863      |
| Real Det Return     | 401      |
| Real Sto Return     | 370      |
| Reward Loss         | -96.7    |
| Running Env Steps   | 431500   |
| Running Forward KL  | -0.963   |
| Running Reverse KL  | 3.56     |
| Running Update Time | 863      |
----------------------------------
2025-02-18 12:28:51.112181 ׼ʱ-
| Itration            | 864      |
| Real Det Return     | 373      |
| Real Sto Return     | 360      |
| Reward Loss         | -38.1    |
| Running Env Steps   | 432000   |
| Running Forward KL  | -1.7     |
| Running Reverse KL  | 3.55     |
| Running Update Time | 864      |
----------------------------------
2025-02-18 12:29:03.593554 ׼ʱ-
| Itration            | 865      |
| Real Det Return     | 387      |
| Real Sto Return     | 370      |
| Reward Loss         | -24.2    |
| Running Env Steps   | 432500   |
| Running Forward KL  | -1.41    |
| Running Reverse KL  | 4.09     |
| Running Update Time | 865      |
----------------------------------
2025-02-18 12:29:16.059309 ׼ʱ-
| Itration            | 866      |
| Real Det Return     | 385      |
| Real Sto Return     | 369      |
| Reward Loss         | -31.2    |
| Running Env Steps   | 433000   |
| Running Forward KL  | -1.59    |
| Running Reverse KL  | 4.03     |
| Running Update Time | 866      |
----------------------------------
2025-02-18 12:29:28.556322 ׼ʱ-
| Itration            | 867      |
| Real Det Return     | 371      |
| Real Sto Return     | 360      |
| Reward Loss         | -20.2    |
| Running Env Steps   | 433500   |
| Running Forward KL  | -2.32    |
| Running Reverse KL  | 3.72     |
| Running Update Time | 867      |
----------------------------------
2025-02-18 12:29:41.006461 ׼ʱ-
| Itration            | 868      |
| Real Det Return     | 399      |
| Real Sto Return     | 362      |
| Reward Loss         | -43.7    |
| Running Env Steps   | 434000   |
| Running Forward KL  | -1.61    |
| Running Reverse KL  | 3.74     |
| Running Update Time | 868      |
----------------------------------
2025-02-18 12:29:53.456606 ׼ʱ-
| Itration            | 869      |
| Real Det Return     | 381      |
| Real Sto Return     | 381      |
| Reward Loss         | -17.6    |
| Running Env Steps   | 434500   |
| Running Forward KL  | -1.7     |
| Running Reverse KL  | 3.68     |
| Running Update Time | 869      |
----------------------------------
2025-02-18 12:30:05.891093 ׼ʱ-
| Itration            | 870      |
| Real Det Return     | 382      |
| Real Sto Return     | 370      |
| Reward Loss         | -28.7    |
| Running Env Steps   | 435000   |
| Running Forward KL  | -1.46    |
| Running Reverse KL  | 4.13     |
| Running Update Time | 870      |
----------------------------------
2025-02-18 12:30:18.403734 ׼ʱ-
| Itration            | 871      |
| Real Det Return     | 375      |
| Real Sto Return     | 375      |
| Reward Loss         | -18.5    |
| Running Env Steps   | 435500   |
| Running Forward KL  | -2.21    |
| Running Reverse KL  | 3.86     |
| Running Update Time | 871      |
----------------------------------
2025-02-18 12:30:30.838262 ׼ʱ-
| Itration            | 872      |
| Real Det Return     | 361      |
| Real Sto Return     | 352      |
| Reward Loss         | -56.7    |
| Running Env Steps   | 436000   |
| Running Forward KL  | -1.41    |
| Running Reverse KL  | 3.57     |
| Running Update Time | 872      |
----------------------------------
2025-02-18 12:30:43.682367 ׼ʱ-
| Itration            | 873      |
| Real Det Return     | 378      |
| Real Sto Return     | 362      |
| Reward Loss         | -36.5    |
| Running Env Steps   | 436500   |
| Running Forward KL  | -2.05    |
| Running Reverse KL  | 3.82     |
| Running Update Time | 873      |
----------------------------------
2025-02-18 12:30:56.288727 ׼ʱ-
| Itration            | 874      |
| Real Det Return     | 385      |
| Real Sto Return     | 367      |
| Reward Loss         | -42.9    |
| Running Env Steps   | 437000   |
| Running Forward KL  | -1.45    |
| Running Reverse KL  | 3.95     |
| Running Update Time | 874      |
----------------------------------
2025-02-18 12:31:08.816962 ׼ʱ-
| Itration            | 875      |
| Real Det Return     | 352      |
| Real Sto Return     | 346      |
| Reward Loss         | -27.9    |
| Running Env Steps   | 437500   |
| Running Forward KL  | -2.22    |
| Running Reverse KL  | 3.77     |
| Running Update Time | 875      |
----------------------------------
2025-02-18 12:31:21.298345 ׼ʱ-
| Itration            | 876      |
| Real Det Return     | 372      |
| Real Sto Return     | 360      |
| Reward Loss         | -31.4    |
| Running Env Steps   | 438000   |
| Running Forward KL  | -1.79    |
| Running Reverse KL  | 3.26     |
| Running Update Time | 876      |
----------------------------------
2025-02-18 12:31:33.764105 ׼ʱ-
| Itration            | 877      |
| Real Det Return     | 368      |
| Real Sto Return     | 362      |
| Reward Loss         | -41.5    |
| Running Env Steps   | 438500   |
| Running Forward KL  | -1.76    |
| Running Reverse KL  | 3.85     |
| Running Update Time | 877      |
----------------------------------
2025-02-18 12:31:46.292352 ׼ʱ-
| Itration            | 878      |
| Real Det Return     | 376      |
| Real Sto Return     | 363      |
| Reward Loss         | -34.3    |
| Running Env Steps   | 439000   |
| Running Forward KL  | -1.51    |
| Running Reverse KL  | 3.52     |
| Running Update Time | 878      |
----------------------------------
2025-02-18 12:31:58.695628 ׼ʱ-
| Itration            | 879      |
| Real Det Return     | 388      |
| Real Sto Return     | 376      |
| Reward Loss         | -22      |
| Running Env Steps   | 439500   |
| Running Forward KL  | -1.89    |
| Running Reverse KL  | 3.53     |
| Running Update Time | 879      |
----------------------------------
2025-02-18 12:32:11.161390 ׼ʱ-
| Itration            | 880      |
| Real Det Return     | 364      |
| Real Sto Return     | 357      |
| Reward Loss         | -23.3    |
| Running Env Steps   | 440000   |
| Running Forward KL  | -2.12    |
| Running Reverse KL  | 3.43     |
| Running Update Time | 880      |
----------------------------------
2025-02-18 12:32:23.595908 ׼ʱ-
| Itration            | 881      |
| Real Det Return     | 370      |
| Real Sto Return     | 362      |
| Reward Loss         | -32.3    |
| Running Env Steps   | 440500   |
| Running Forward KL  | -1.74    |
| Running Reverse KL  | 3.81     |
| Running Update Time | 881      |
----------------------------------
2025-02-18 12:32:36.137326 ׼ʱ-
| Itration            | 882      |
| Real Det Return     | 380      |
| Real Sto Return     | 372      |
| Reward Loss         | -34.4    |
| Running Env Steps   | 441000   |
| Running Forward KL  | -2.23    |
| Running Reverse KL  | 3.38     |
| Running Update Time | 882      |
----------------------------------
2025-02-18 12:32:49.060740 ׼ʱ-
| Itration            | 883      |
| Real Det Return     | 367      |
| Real Sto Return     | 361      |
| Reward Loss         | -31.4    |
| Running Env Steps   | 441500   |
| Running Forward KL  | -1.98    |
| Running Reverse KL  | 3.83     |
| Running Update Time | 883      |
----------------------------------
2025-02-18 12:33:01.526492 ׼ʱ-
| Itration            | 884      |
| Real Det Return     | 392      |
| Real Sto Return     | 384      |
| Reward Loss         | -19.9    |
| Running Env Steps   | 442000   |
| Running Forward KL  | -1.35    |
| Running Reverse KL  | 4.22     |
| Running Update Time | 884      |
----------------------------------
2025-02-18 12:33:14.054748 ׼ʱ-
| Itration            | 885      |
| Real Det Return     | 392      |
| Real Sto Return     | 365      |
| Reward Loss         | -30      |
| Running Env Steps   | 442500   |
| Running Forward KL  | -1.35    |
| Running Reverse KL  | 4.01     |
| Running Update Time | 885      |
----------------------------------
2025-02-18 12:33:26.614240 ׼ʱ-
| Itration            | 886      |
| Real Det Return     | 368      |
| Real Sto Return     | 362      |
| Reward Loss         | -20.4    |
| Running Env Steps   | 443000   |
| Running Forward KL  | -2.35    |
| Running Reverse KL  | 3.69     |
| Running Update Time | 886      |
----------------------------------
2025-02-18 12:33:39.079999 ׼ʱ-
| Itration            | 887      |
| Real Det Return     | 364      |
| Real Sto Return     | 356      |
| Reward Loss         | -35.2    |
| Running Env Steps   | 443500   |
| Running Forward KL  | -2.2     |
| Running Reverse KL  | 3.69     |
| Running Update Time | 887      |
----------------------------------
2025-02-18 12:33:51.530128 ׼ʱ-
| Itration            | 888      |
| Real Det Return     | 406      |
| Real Sto Return     | 381      |
| Reward Loss         | -37.6    |
| Running Env Steps   | 444000   |
| Running Forward KL  | -1.19    |
| Running Reverse KL  | 4.37     |
| Running Update Time | 888      |
----------------------------------
2025-02-18 12:34:04.042763 ׼ʱ-
| Itration            | 889      |
| Real Det Return     | 371      |
| Real Sto Return     | 366      |
| Reward Loss         | -23      |
| Running Env Steps   | 444500   |
| Running Forward KL  | -1.61    |
| Running Reverse KL  | 4.06     |
| Running Update Time | 889      |
----------------------------------
2025-02-18 12:34:16.508514 ׼ʱ-
| Itration            | 890      |
| Real Det Return     | 370      |
| Real Sto Return     | 354      |
| Reward Loss         | -36.7    |
| Running Env Steps   | 445000   |
| Running Forward KL  | -2.02    |
| Running Reverse KL  | 3.41     |
| Running Update Time | 890      |
----------------------------------
2025-02-18 12:34:28.943033 ׼ʱ-
| Itration            | 891      |
| Real Det Return     | 389      |
| Real Sto Return     | 373      |
| Reward Loss         | -17.6    |
| Running Env Steps   | 445500   |
| Running Forward KL  | -2.19    |
| Running Reverse KL  | 3.87     |
| Running Update Time | 891      |
----------------------------------
2025-02-18 12:34:41.732845 ׼ʱ-
| Itration            | 892      |
| Real Det Return     | 361      |
| Real Sto Return     | 358      |
| Reward Loss         | -47.7    |
| Running Env Steps   | 446000   |
| Running Forward KL  | -1.38    |
| Running Reverse KL  | 3.8      |
| Running Update Time | 892      |
----------------------------------
2025-02-18 12:34:54.229849 ׼ʱ-
| Itration            | 893      |
| Real Det Return     | 382      |
| Real Sto Return     | 366      |
| Reward Loss         | -35.9    |
| Running Env Steps   | 446500   |
| Running Forward KL  | -1.69    |
| Running Reverse KL  | 4.1      |
| Running Update Time | 893      |
----------------------------------
2025-02-18 12:35:06.789328 ׼ʱ-
| Itration            | 894      |
| Real Det Return     | 368      |
| Real Sto Return     | 357      |
| Reward Loss         | -42      |
| Running Env Steps   | 447000   |
| Running Forward KL  | -1.64    |
| Running Reverse KL  | 3.85     |
| Running Update Time | 894      |
----------------------------------
2025-02-18 12:35:19.333196 ׼ʱ-
| Itration            | 895      |
| Real Det Return     | 370      |
| Real Sto Return     | 367      |
| Reward Loss         | -29.6    |
| Running Env Steps   | 447500   |
| Running Forward KL  | -1.74    |
| Running Reverse KL  | 3.62     |
| Running Update Time | 895      |
----------------------------------
2025-02-18 12:35:31.955146 ׼ʱ-
| Itration            | 896      |
| Real Det Return     | 362      |
| Real Sto Return     | 362      |
| Reward Loss         | -26      |
| Running Env Steps   | 448000   |
| Running Forward KL  | -2.4     |
| Running Reverse KL  | 3.45     |
| Running Update Time | 896      |
----------------------------------
2025-02-18 12:35:44.420906 ׼ʱ-
| Itration            | 897      |
| Real Det Return     | 360      |
| Real Sto Return     | 352      |
| Reward Loss         | -31.2    |
| Running Env Steps   | 448500   |
| Running Forward KL  | -2.26    |
| Running Reverse KL  | 3.66     |
| Running Update Time | 897      |
----------------------------------
2025-02-18 12:35:56.886701 ׼ʱ-
| Itration            | 898      |
| Real Det Return     | 362      |
| Real Sto Return     | 349      |
| Reward Loss         | -32.7    |
| Running Env Steps   | 449000   |
| Running Forward KL  | -2.17    |
| Running Reverse KL  | 3.59     |
| Running Update Time | 898      |
----------------------------------
2025-02-18 12:36:09.336841 ׼ʱ-
| Itration            | 899      |
| Real Det Return     | 356      |
| Real Sto Return     | 351      |
| Reward Loss         | -27.1    |
| Running Env Steps   | 449500   |
| Running Forward KL  | -2.18    |
| Running Reverse KL  | 3.42     |
| Running Update Time | 899      |
----------------------------------
2025-02-18 12:36:21.818224 ׼ʱ-
| Itration            | 900      |
| Real Det Return     | 373      |
| Real Sto Return     | 366      |
| Reward Loss         | -34.3    |
| Running Env Steps   | 450000   |
| Running Forward KL  | -1.73    |
| Running Reverse KL  | 3.87     |
| Running Update Time | 900      |
----------------------------------
2025-02-18 12:36:34.268364 ׼ʱ-
| Itration            | 901      |
| Real Det Return     | 359      |
| Real Sto Return     | 352      |
| Reward Loss         | -24.7    |
| Running Env Steps   | 450500   |
| Running Forward KL  | -2.34    |
| Running Reverse KL  | 3.8      |
| Running Update Time | 901      |
----------------------------------
2025-02-18 12:36:47.140365 ׼ʱ-
| Itration            | 902      |
| Real Det Return     | 358      |
| Real Sto Return     | 349      |
| Reward Loss         | -47.9    |
| Running Env Steps   | 451000   |
| Running Forward KL  | -1.81    |
| Running Reverse KL  | 4.25     |
| Running Update Time | 902      |
----------------------------------
2025-02-18 12:36:59.637368 ׼ʱ-
| Itration            | 903      |
| Real Det Return     | 367      |
| Real Sto Return     | 360      |
| Reward Loss         | -42.7    |
| Running Env Steps   | 451500   |
| Running Forward KL  | -1.66    |
| Running Reverse KL  | 3.95     |
| Running Update Time | 903      |
----------------------------------
2025-02-18 12:37:12.212445 ׼ʱ-
| Itration            | 904      |
| Real Det Return     | 378      |
| Real Sto Return     | 351      |
| Reward Loss         | -32.5    |
| Running Env Steps   | 452000   |
| Running Forward KL  | -2.07    |
| Running Reverse KL  | 3.48     |
| Running Update Time | 904      |
----------------------------------
2025-02-18 12:37:24.787554 ׼ʱ-
| Itration            | 905      |
| Real Det Return     | 382      |
| Real Sto Return     | 376      |
| Reward Loss         | -28.4    |
| Running Env Steps   | 452500   |
| Running Forward KL  | -1.72    |
| Running Reverse KL  | 3.96     |
| Running Update Time | 905      |
----------------------------------
2025-02-18 12:37:37.409552 ׼ʱ-
| Itration            | 906      |
| Real Det Return     | 376      |
| Real Sto Return     | 365      |
| Reward Loss         | -22.7    |
| Running Env Steps   | 453000   |
| Running Forward KL  | -1.49    |
| Running Reverse KL  | 3.89     |
| Running Update Time | 906      |
----------------------------------
2025-02-18 12:37:49.875324 ׼ʱ-
| Itration            | 907      |
| Real Det Return     | 388      |
| Real Sto Return     | 376      |
| Reward Loss         | -26.4    |
| Running Env Steps   | 453500   |
| Running Forward KL  | -1.61    |
| Running Reverse KL  | 4.47     |
| Running Update Time | 907      |
----------------------------------
2025-02-18 12:38:02.356706 ׼ʱ-
| Itration            | 908      |
| Real Det Return     | 381      |
| Real Sto Return     | 363      |
| Reward Loss         | -31.8    |
| Running Env Steps   | 454000   |
| Running Forward KL  | -2.19    |
| Running Reverse KL  | 3.62     |
| Running Update Time | 908      |
----------------------------------
2025-02-18 12:38:14.822467 ׼ʱ-
| Itration            | 909      |
| Real Det Return     | 389      |
| Real Sto Return     | 376      |
| Reward Loss         | -27.3    |
| Running Env Steps   | 454500   |
| Running Forward KL  | -1.83    |
| Running Reverse KL  | 4.33     |
| Running Update Time | 909      |
----------------------------------
2025-02-18 12:38:27.256992 ׼ʱ-
| Itration            | 910      |
| Real Det Return     | 353      |
| Real Sto Return     | 341      |
| Reward Loss         | -25.2    |
| Running Env Steps   | 455000   |
| Running Forward KL  | -2.29    |
| Running Reverse KL  | 3.81     |
| Running Update Time | 910      |
----------------------------------
2025-02-18 12:38:39.878950 ׼ʱ-
| Itration            | 911      |
| Real Det Return     | 386      |
| Real Sto Return     | 372      |
| Reward Loss         | -30.6    |
| Running Env Steps   | 455500   |
| Running Forward KL  | -1.68    |
| Running Reverse KL  | 4.07     |
| Running Update Time | 911      |
----------------------------------
2025-02-18 12:38:53.057510 ׼ʱ-
| Itration            | 912      |
| Real Det Return     | 360      |
| Real Sto Return     | 348      |
| Reward Loss         | -36.2    |
| Running Env Steps   | 456000   |
| Running Forward KL  | -2.76    |
| Running Reverse KL  | 3.44     |
| Running Update Time | 912      |
----------------------------------
2025-02-18 12:39:05.632611 ׼ʱ-
| Itration            | 913      |
| Real Det Return     | 369      |
| Real Sto Return     | 361      |
| Reward Loss         | -27.4    |
| Running Env Steps   | 456500   |
| Running Forward KL  | -1.9     |
| Running Reverse KL  | 3.98     |
| Running Update Time | 913      |
----------------------------------
2025-02-18 12:39:18.129625 ׼ʱ-
| Itration            | 914      |
| Real Det Return     | 359      |
| Real Sto Return     | 353      |
| Reward Loss         | -34.4    |
| Running Env Steps   | 457000   |
| Running Forward KL  | -1.89    |
| Running Reverse KL  | 3.81     |
| Running Update Time | 914      |
----------------------------------
2025-02-18 12:39:30.642240 ׼ʱ-
| Itration            | 915      |
| Real Det Return     | 393      |
| Real Sto Return     | 376      |
| Reward Loss         | -32.8    |
| Running Env Steps   | 457500   |
| Running Forward KL  | -1.6     |
| Running Reverse KL  | 3.61     |
| Running Update Time | 915      |
----------------------------------
2025-02-18 12:39:43.154860 ׼ʱ-
| Itration            | 916      |
| Real Det Return     | 385      |
| Real Sto Return     | 373      |
| Reward Loss         | -68.4    |
| Running Env Steps   | 458000   |
| Running Forward KL  | -1.1     |
| Running Reverse KL  | 4.11     |
| Running Update Time | 916      |
----------------------------------
2025-02-18 12:39:55.605005 ׼ʱ-
| Itration            | 917      |
| Real Det Return     | 376      |
| Real Sto Return     | 363      |
| Reward Loss         | -34.9    |
| Running Env Steps   | 458500   |
| Running Forward KL  | -1.66    |
| Running Reverse KL  | 4        |
| Running Update Time | 917      |
----------------------------------
2025-02-18 12:40:08.133261 ׼ʱ-
| Itration            | 918      |
| Real Det Return     | 367      |
| Real Sto Return     | 351      |
| Reward Loss         | -36.9    |
| Running Env Steps   | 459000   |
| Running Forward KL  | -1.88    |
| Running Reverse KL  | 3.64     |
| Running Update Time | 918      |
----------------------------------
2025-02-18 12:40:20.708361 ׼ʱ-
| Itration            | 919      |
| Real Det Return     | 359      |
| Real Sto Return     | 352      |
| Reward Loss         | -35      |
| Running Env Steps   | 459500   |
| Running Forward KL  | -1.84    |
| Running Reverse KL  | 3.32     |
| Running Update Time | 919      |
----------------------------------
2025-02-18 12:40:33.174124 ׼ʱ-
| Itration            | 920      |
| Real Det Return     | 370      |
| Real Sto Return     | 353      |
| Reward Loss         | -27.5    |
| Running Env Steps   | 460000   |
| Running Forward KL  | -2.56    |
| Running Reverse KL  | 3.7      |
| Running Update Time | 920      |
----------------------------------
2025-02-18 12:40:45.671137 ׼ʱ-
| Itration            | 921      |
| Real Det Return     | 348      |
| Real Sto Return     | 346      |
| Reward Loss         | -42.9    |
| Running Env Steps   | 460500   |
| Running Forward KL  | -2.1     |
| Running Reverse KL  | 3.37     |
| Running Update Time | 921      |
----------------------------------
2025-02-18 12:40:58.527439 ׼ʱ-
| Itration            | 922      |
| Real Det Return     | 351      |
| Real Sto Return     | 347      |
| Reward Loss         | -41.4    |
| Running Env Steps   | 461000   |
| Running Forward KL  | -2.55    |
| Running Reverse KL  | 3.85     |
| Running Update Time | 922      |
----------------------------------
2025-02-18 12:41:11.086917 ׼ʱ-
| Itration            | 923      |
| Real Det Return     | 354      |
| Real Sto Return     | 356      |
| Reward Loss         | -34.2    |
| Running Env Steps   | 461500   |
| Running Forward KL  | -2.01    |
| Running Reverse KL  | 4.16     |
| Running Update Time | 923      |
----------------------------------
2025-02-18 12:41:23.630789 ׼ʱ-
| Itration            | 924      |
| Real Det Return     | 364      |
| Real Sto Return     | 359      |
| Reward Loss         | -39.5    |
| Running Env Steps   | 462000   |
| Running Forward KL  | -1.88    |
| Running Reverse KL  | 3.88     |
| Running Update Time | 924      |
----------------------------------
2025-02-18 12:41:36.096546 ׼ʱ-
| Itration            | 925      |
| Real Det Return     | 381      |
| Real Sto Return     | 368      |
| Reward Loss         | -23.9    |
| Running Env Steps   | 462500   |
| Running Forward KL  | -1.94    |
| Running Reverse KL  | 3.95     |
| Running Update Time | 925      |
----------------------------------
2025-02-18 12:41:48.609138 ׼ʱ-
| Itration            | 926      |
| Real Det Return     | 380      |
| Real Sto Return     | 370      |
| Reward Loss         | -39.6    |
| Running Env Steps   | 463000   |
| Running Forward KL  | -1.79    |
| Running Reverse KL  | 3.85     |
| Running Update Time | 926      |
----------------------------------
2025-02-18 12:42:01.074941 ׼ʱ-
| Itration            | 927      |
| Real Det Return     | 365      |
| Real Sto Return     | 360      |
| Reward Loss         | -27      |
| Running Env Steps   | 463500   |
| Running Forward KL  | -1.79    |
| Running Reverse KL  | 3.72     |
| Running Update Time | 927      |
----------------------------------
2025-02-18 12:42:13.587548 ׼ʱ-
| Itration            | 928      |
| Real Det Return     | 364      |
| Real Sto Return     | 355      |
| Reward Loss         | -29.2    |
| Running Env Steps   | 464000   |
| Running Forward KL  | -2.1     |
| Running Reverse KL  | 3.72     |
| Running Update Time | 928      |
----------------------------------
2025-02-18 12:42:26.053319 ׼ʱ-
| Itration            | 929      |
| Real Det Return     | 357      |
| Real Sto Return     | 348      |
| Reward Loss         | -31.8    |
| Running Env Steps   | 464500   |
| Running Forward KL  | -2.3     |
| Running Reverse KL  | 3.65     |
| Running Update Time | 929      |
----------------------------------
2025-02-18 12:42:38.456586 ׼ʱ-
| Itration            | 930      |
| Real Det Return     | 383      |
| Real Sto Return     | 369      |
| Reward Loss         | -33.1    |
| Running Env Steps   | 465000   |
| Running Forward KL  | -1.99    |
| Running Reverse KL  | 3.56     |
| Running Update Time | 930      |
----------------------------------
2025-02-18 12:42:50.926991 ׼ʱ-
| Itration            | 931      |
| Real Det Return     | 361      |
| Real Sto Return     | 346      |
| Reward Loss         | -33.9    |
| Running Env Steps   | 465500   |
| Running Forward KL  | -2.02    |
| Running Reverse KL  | 3.56     |
| Running Update Time | 931      |
----------------------------------
2025-02-18 12:43:03.788708 ׼ʱ-
| Itration            | 932      |
| Real Det Return     | 380      |
| Real Sto Return     | 352      |
| Reward Loss         | -33.8    |
| Running Env Steps   | 466000   |
| Running Forward KL  | -1.78    |
| Running Reverse KL  | 4.43     |
| Running Update Time | 932      |
----------------------------------
2025-02-18 12:43:16.254470 ׼ʱ-
| Itration            | 933      |
| Real Det Return     | 377      |
| Real Sto Return     | 373      |
| Reward Loss         | -19.8    |
| Running Env Steps   | 466500   |
| Running Forward KL  | -2.11    |
| Running Reverse KL  | 3.82     |
| Running Update Time | 933      |
----------------------------------
2025-02-18 12:43:28.767096 ׼ʱ-
| Itration            | 934      |
| Real Det Return     | 352      |
| Real Sto Return     | 354      |
| Reward Loss         | -31.3    |
| Running Env Steps   | 467000   |
| Running Forward KL  | -1.97    |
| Running Reverse KL  | 4.01     |
| Running Update Time | 934      |
----------------------------------
2025-02-18 12:43:41.232856 ׼ʱ-
| Itration            | 935      |
| Real Det Return     | 371      |
| Real Sto Return     | 355      |
| Reward Loss         | -36      |
| Running Env Steps   | 467500   |
| Running Forward KL  | -1.74    |
| Running Reverse KL  | 4.02     |
| Running Update Time | 935      |
----------------------------------
2025-02-18 12:43:53.729861 ׼ʱ-
| Itration            | 936      |
| Real Det Return     | 377      |
| Real Sto Return     | 360      |
| Reward Loss         | -38.1    |
| Running Env Steps   | 468000   |
| Running Forward KL  | -2.74    |
| Running Reverse KL  | 3.53     |
| Running Update Time | 936      |
----------------------------------
2025-02-18 12:44:06.211242 ׼ʱ-
| Itration            | 937      |
| Real Det Return     | 374      |
| Real Sto Return     | 354      |
| Reward Loss         | -39.3    |
| Running Env Steps   | 468500   |
| Running Forward KL  | -1.93    |
| Running Reverse KL  | 4.07     |
| Running Update Time | 937      |
----------------------------------
2025-02-18 12:44:18.677013 ׼ʱ-
| Itration            | 938      |
| Real Det Return     | 377      |
| Real Sto Return     | 371      |
| Reward Loss         | -44.6    |
| Running Env Steps   | 469000   |
| Running Forward KL  | -2.23    |
| Running Reverse KL  | 3.21     |
| Running Update Time | 938      |
----------------------------------
2025-02-18 12:44:31.142778 ׼ʱ-
| Itration            | 939      |
| Real Det Return     | 371      |
| Real Sto Return     | 378      |
| Reward Loss         | -35.7    |
| Running Env Steps   | 469500   |
| Running Forward KL  | -1.46    |
| Running Reverse KL  | 4.52     |
| Running Update Time | 939      |
----------------------------------
2025-02-18 12:44:43.608535 ׼ʱ-
| Itration            | 940      |
| Real Det Return     | 365      |
| Real Sto Return     | 364      |
| Reward Loss         | -38.4    |
| Running Env Steps   | 470000   |
| Running Forward KL  | -1.82    |
| Running Reverse KL  | 3.79     |
| Running Update Time | 940      |
----------------------------------
2025-02-18 12:44:56.472806 ׼ʱ-
| Itration            | 941      |
| Real Det Return     | 386      |
| Real Sto Return     | 367      |
| Reward Loss         | -31.3    |
| Running Env Steps   | 470500   |
| Running Forward KL  | -1.86    |
| Running Reverse KL  | 3.88     |
| Running Update Time | 941      |
----------------------------------
2025-02-18 12:45:09.032294 ׼ʱ-
| Itration            | 942      |
| Real Det Return     | 370      |
| Real Sto Return     | 359      |
| Reward Loss         | -30.9    |
| Running Env Steps   | 471000   |
| Running Forward KL  | -2       |
| Running Reverse KL  | 3.54     |
| Running Update Time | 942      |
----------------------------------
2025-02-18 12:45:21.560533 ׼ʱ-
| Itration            | 943      |
| Real Det Return     | 378      |
| Real Sto Return     | 367      |
| Reward Loss         | -30.1    |
| Running Env Steps   | 471500   |
| Running Forward KL  | -1.95    |
| Running Reverse KL  | 4.15     |
| Running Update Time | 943      |
----------------------------------
2025-02-18 12:45:34.057544 ׼ʱ-
| Itration            | 944      |
| Real Det Return     | 385      |
| Real Sto Return     | 367      |
| Reward Loss         | -32.2    |
| Running Env Steps   | 472000   |
| Running Forward KL  | -1.3     |
| Running Reverse KL  | 3.91     |
| Running Update Time | 944      |
----------------------------------
2025-02-18 12:45:46.554539 ׼ʱ-
| Itration            | 945      |
| Real Det Return     | 385      |
| Real Sto Return     | 366      |
| Reward Loss         | -45.1    |
| Running Env Steps   | 472500   |
| Running Forward KL  | -1.76    |
| Running Reverse KL  | 3.56     |
| Running Update Time | 945      |
----------------------------------
2025-02-18 12:45:59.035921 ׼ʱ-
| Itration            | 946      |
| Real Det Return     | 379      |
| Real Sto Return     | 364      |
| Reward Loss         | -25.3    |
| Running Env Steps   | 473000   |
| Running Forward KL  | -1.92    |
| Running Reverse KL  | 4.23     |
| Running Update Time | 946      |
----------------------------------
2025-02-18 12:46:11.533168 ׼ʱ-
| Itration            | 947      |
| Real Det Return     | 376      |
| Real Sto Return     | 370      |
| Reward Loss         | -27.4    |
| Running Env Steps   | 473500   |
| Running Forward KL  | -2.1     |
| Running Reverse KL  | 3.65     |
| Running Update Time | 947      |
----------------------------------
2025-02-18 12:46:23.998933 ׼ʱ-
| Itration            | 948      |
| Real Det Return     | 376      |
| Real Sto Return     | 367      |
| Reward Loss         | -29      |
| Running Env Steps   | 474000   |
| Running Forward KL  | -2.22    |
| Running Reverse KL  | 3.21     |
| Running Update Time | 948      |
----------------------------------
2025-02-18 12:46:36.433694 ׼ʱ-
| Itration            | 949      |
| Real Det Return     | 365      |
| Real Sto Return     | 369      |
| Reward Loss         | -29.3    |
| Running Env Steps   | 474500   |
| Running Forward KL  | -2.26    |
| Running Reverse KL  | 3.68     |
| Running Update Time | 949      |
----------------------------------
2025-02-18 12:46:48.961938 ׼ʱ-
| Itration            | 950      |
| Real Det Return     | 393      |
| Real Sto Return     | 367      |
| Reward Loss         | -35      |
| Running Env Steps   | 475000   |
| Running Forward KL  | -1.35    |
| Running Reverse KL  | 3.99     |
| Running Update Time | 950      |
----------------------------------
2025-02-18 12:47:01.846710 ׼ʱ-
| Itration            | 951      |
| Real Det Return     | 360      |
| Real Sto Return     | 353      |
| Reward Loss         | -36.2    |
| Running Env Steps   | 475500   |
| Running Forward KL  | -2.03    |
| Running Reverse KL  | 3.74     |
| Running Update Time | 951      |
----------------------------------
2025-02-18 12:47:14.406276 ׼ʱ-
| Itration            | 952      |
| Real Det Return     | 382      |
| Real Sto Return     | 370      |
| Reward Loss         | -30.6    |
| Running Env Steps   | 476000   |
| Running Forward KL  | -1.83    |
| Running Reverse KL  | 3.48     |
| Running Update Time | 952      |
----------------------------------
2025-02-18 12:47:26.950156 ׼ʱ-
| Itration            | 953      |
| Real Det Return     | 355      |
| Real Sto Return     | 344      |
| Reward Loss         | -42.5    |
| Running Env Steps   | 476500   |
| Running Forward KL  | -1.88    |
| Running Reverse KL  | 3.57     |
| Running Update Time | 953      |
----------------------------------
2025-02-18 12:47:39.494013 ׼ʱ-
| Itration            | 954      |
| Real Det Return     | 383      |
| Real Sto Return     | 369      |
| Reward Loss         | -31.4    |
| Running Env Steps   | 477000   |
| Running Forward KL  | -1.79    |
| Running Reverse KL  | 3.42     |
| Running Update Time | 954      |
----------------------------------
2025-02-18 12:47:52.006636 ׼ʱ-
| Itration            | 955      |
| Real Det Return     | 361      |
| Real Sto Return     | 360      |
| Reward Loss         | -29      |
| Running Env Steps   | 477500   |
| Running Forward KL  | -2.1     |
| Running Reverse KL  | 3.54     |
| Running Update Time | 955      |
----------------------------------
2025-02-18 12:48:04.503641 ׼ʱ-
| Itration            | 956      |
| Real Det Return     | 387      |
| Real Sto Return     | 385      |
| Reward Loss         | -36.2    |
| Running Env Steps   | 478000   |
| Running Forward KL  | -1.36    |
| Running Reverse KL  | 4.27     |
| Running Update Time | 956      |
----------------------------------
2025-02-18 12:48:16.969402 ׼ʱ-
| Itration            | 957      |
| Real Det Return     | 379      |
| Real Sto Return     | 366      |
| Reward Loss         | -20.2    |
| Running Env Steps   | 478500   |
| Running Forward KL  | -2.75    |
| Running Reverse KL  | 3.51     |
| Running Update Time | 957      |
----------------------------------
2025-02-18 12:48:29.435138 ׼ʱ-
| Itration            | 958      |
| Real Det Return     | 375      |
| Real Sto Return     | 370      |
| Reward Loss         | -23.2    |
| Running Env Steps   | 479000   |
| Running Forward KL  | -1.97    |
| Running Reverse KL  | 3.26     |
| Running Update Time | 958      |
----------------------------------
2025-02-18 12:48:41.900924 ׼ʱ-
| Itration            | 959      |
| Real Det Return     | 350      |
| Real Sto Return     | 351      |
| Reward Loss         | -34.2    |
| Running Env Steps   | 479500   |
| Running Forward KL  | -2.36    |
| Running Reverse KL  | 3.62     |
| Running Update Time | 959      |
----------------------------------
2025-02-18 12:48:54.491656 ׼ʱ-
| Itration            | 960      |
| Real Det Return     | 378      |
| Real Sto Return     | 365      |
| Reward Loss         | -31.1    |
| Running Env Steps   | 480000   |
| Running Forward KL  | -2.17    |
| Running Reverse KL  | 3.85     |
| Running Update Time | 960      |
----------------------------------
2025-02-18 12:49:07.373218 ׼ʱ-
| Itration            | 961      |
| Real Det Return     | 359      |
| Real Sto Return     | 352      |
| Reward Loss         | -41      |
| Running Env Steps   | 480500   |
| Running Forward KL  | -1.86    |
| Running Reverse KL  | 3.83     |
| Running Update Time | 961      |
----------------------------------
2025-02-18 12:49:19.901474 ׼ʱ-
| Itration            | 962      |
| Real Det Return     | 396      |
| Real Sto Return     | 371      |
| Reward Loss         | -43.8    |
| Running Env Steps   | 481000   |
| Running Forward KL  | -1.67    |
| Running Reverse KL  | 3.91     |
| Running Update Time | 962      |
----------------------------------
2025-02-18 12:49:32.429720 ׼ʱ-
| Itration            | 963      |
| Real Det Return     | 382      |
| Real Sto Return     | 367      |
| Reward Loss         | -31.9    |
| Running Env Steps   | 481500   |
| Running Forward KL  | -1.63    |
| Running Reverse KL  | 4.07     |
| Running Update Time | 963      |
----------------------------------
2025-02-18 12:49:44.957957 ׼ʱ-
| Itration            | 964      |
| Real Det Return     | 378      |
| Real Sto Return     | 366      |
| Reward Loss         | -34.5    |
| Running Env Steps   | 482000   |
| Running Forward KL  | -1.85    |
| Running Reverse KL  | 3.62     |
| Running Update Time | 964      |
----------------------------------
2025-02-18 12:49:57.470582 ׼ʱ-
| Itration            | 965      |
| Real Det Return     | 382      |
| Real Sto Return     | 364      |
| Reward Loss         | -17.6    |
| Running Env Steps   | 482500   |
| Running Forward KL  | -1.65    |
| Running Reverse KL  | 3.96     |
| Running Update Time | 965      |
----------------------------------
2025-02-18 12:50:09.983207 ׼ʱ-
| Itration            | 966      |
| Real Det Return     | 381      |
| Real Sto Return     | 356      |
| Reward Loss         | -27.5    |
| Running Env Steps   | 483000   |
| Running Forward KL  | -1.49    |
| Running Reverse KL  | 3.44     |
| Running Update Time | 966      |
----------------------------------
2025-02-18 12:50:22.527074 ׼ʱ-
| Itration            | 967      |
| Real Det Return     | 370      |
| Real Sto Return     | 364      |
| Reward Loss         | -27.4    |
| Running Env Steps   | 483500   |
| Running Forward KL  | -2.29    |
| Running Reverse KL  | 3.54     |
| Running Update Time | 967      |
----------------------------------
2025-02-18 12:50:35.398964 ׼ʱ-
| Itration            | 968      |
| Real Det Return     | 364      |
| Real Sto Return     | 355      |
| Reward Loss         | -36.5    |
| Running Env Steps   | 484000   |
| Running Forward KL  | -1.8     |
| Running Reverse KL  | 3.41     |
| Running Update Time | 968      |
----------------------------------
2025-02-18 12:50:47.942866 ׼ʱ-
| Itration            | 969      |
| Real Det Return     | 375      |
| Real Sto Return     | 349      |
| Reward Loss         | -27.2    |
| Running Env Steps   | 484500   |
| Running Forward KL  | -2.09    |
| Running Reverse KL  | 3.54     |
| Running Update Time | 969      |
----------------------------------
2025-02-18 12:51:00.439870 ׼ʱ-
| Itration            | 970      |
| Real Det Return     | 388      |
| Real Sto Return     | 371      |
| Reward Loss         | -36.9    |
| Running Env Steps   | 485000   |
| Running Forward KL  | -1.92    |
| Running Reverse KL  | 3.77     |
| Running Update Time | 970      |
----------------------------------
2025-02-18 12:51:13.332037 ׼ʱ-
| Itration            | 971      |
| Real Det Return     | 344      |
| Real Sto Return     | 347      |
| Reward Loss         | -37.3    |
| Running Env Steps   | 485500   |
| Running Forward KL  | -2.07    |
| Running Reverse KL  | 4.27     |
| Running Update Time | 971      |
----------------------------------
2025-02-18 12:51:25.846190 ׼ʱ-
| Itration            | 972      |
| Real Det Return     | 355      |
| Real Sto Return     | 354      |
| Reward Loss         | -50.7    |
| Running Env Steps   | 486000   |
| Running Forward KL  | -1.67    |
| Running Reverse KL  | 3.94     |
| Running Update Time | 972      |
----------------------------------
2025-02-18 12:51:38.358854 ׼ʱ-
| Itration            | 973      |
| Real Det Return     | 374      |
| Real Sto Return     | 360      |
| Reward Loss         | -42.4    |
| Running Env Steps   | 486500   |
| Running Forward KL  | -2.14    |
| Running Reverse KL  | 3.87     |
| Running Update Time | 973      |
----------------------------------
2025-02-18 12:51:50.950045 ׼ʱ-
| Itration            | 974      |
| Real Det Return     | 358      |
| Real Sto Return     | 356      |
| Reward Loss         | -41.9    |
| Running Env Steps   | 487000   |
| Running Forward KL  | -2.06    |
| Running Reverse KL  | 4.01     |
| Running Update Time | 974      |
----------------------------------
2025-02-18 12:52:03.462680 ׼ʱ-
| Itration            | 975      |
| Real Det Return     | 359      |
| Real Sto Return     | 361      |
| Reward Loss         | -27.3    |
| Running Env Steps   | 487500   |
| Running Forward KL  | -1.98    |
| Running Reverse KL  | 3.8      |
| Running Update Time | 975      |
----------------------------------
2025-02-18 12:52:15.990917 ׼ʱ-
| Itration            | 976      |
| Real Det Return     | 337      |
| Real Sto Return     | 337      |
| Reward Loss         | -52.7    |
| Running Env Steps   | 488000   |
| Running Forward KL  | -1.98    |
| Running Reverse KL  | 4.35     |
| Running Update Time | 976      |
----------------------------------
2025-02-18 12:52:28.487930 ׼ʱ-
| Itration            | 977      |
| Real Det Return     | 376      |
| Real Sto Return     | 362      |
| Reward Loss         | -38.3    |
| Running Env Steps   | 488500   |
| Running Forward KL  | -1.86    |
| Running Reverse KL  | 3.7      |
| Running Update Time | 977      |
----------------------------------
2025-02-18 12:52:40.969304 ׼ʱ-
| Itration            | 978      |
| Real Det Return     | 357      |
| Real Sto Return     | 353      |
| Reward Loss         | -39.3    |
| Running Env Steps   | 489000   |
| Running Forward KL  | -2.15    |
| Running Reverse KL  | 3.69     |
| Running Update Time | 978      |
----------------------------------
2025-02-18 12:52:53.450685 ׼ʱ-
| Itration            | 979      |
| Real Det Return     | 370      |
| Real Sto Return     | 360      |
| Reward Loss         | -51.1    |
| Running Env Steps   | 489500   |
| Running Forward KL  | -2.86    |
| Running Reverse KL  | 3.2      |
| Running Update Time | 979      |
----------------------------------
2025-02-18 12:53:05.963314 ׼ʱ-
| Itration            | 980      |
| Real Det Return     | 367      |
| Real Sto Return     | 357      |
| Reward Loss         | -25.2    |
| Running Env Steps   | 490000   |
| Running Forward KL  | -2.35    |
| Running Reverse KL  | 3.79     |
| Running Update Time | 980      |
----------------------------------
2025-02-18 12:53:18.849878 ׼ʱ-
| Itration            | 981      |
| Real Det Return     | 383      |
| Real Sto Return     | 372      |
| Reward Loss         | -35.4    |
| Running Env Steps   | 490500   |
| Running Forward KL  | -1.94    |
| Running Reverse KL  | 4.1      |
| Running Update Time | 981      |
----------------------------------
2025-02-18 12:53:31.362469 ׼ʱ-
| Itration            | 982      |
| Real Det Return     | 352      |
| Real Sto Return     | 344      |
| Reward Loss         | -56      |
| Running Env Steps   | 491000   |
| Running Forward KL  | -1.6     |
| Running Reverse KL  | 3.82     |
| Running Update Time | 982      |
----------------------------------
2025-02-18 12:53:44.031344 ׼ʱ-
| Itration            | 983      |
| Real Det Return     | 381      |
| Real Sto Return     | 363      |
| Reward Loss         | -33      |
| Running Env Steps   | 491500   |
| Running Forward KL  | -1.61    |
| Running Reverse KL  | 3.86     |
| Running Update Time | 983      |
----------------------------------
2025-02-18 12:53:56.559577 ׼ʱ-
| Itration            | 984      |
| Real Det Return     | 354      |
| Real Sto Return     | 347      |
| Reward Loss         | -45.6    |
| Running Env Steps   | 492000   |
| Running Forward KL  | -2.62    |
| Running Reverse KL  | 3.41     |
| Running Update Time | 984      |
----------------------------------
2025-02-18 12:54:09.150309 ׼ʱ-
| Itration            | 985      |
| Real Det Return     | 366      |
| Real Sto Return     | 355      |
| Reward Loss         | -33.8    |
| Running Env Steps   | 492500   |
| Running Forward KL  | -2.36    |
| Running Reverse KL  | 3.85     |
| Running Update Time | 985      |
----------------------------------
2025-02-18 12:54:21.631691 ׼ʱ-
| Itration            | 986      |
| Real Det Return     | 374      |
| Real Sto Return     | 367      |
| Reward Loss         | -47.7    |
| Running Env Steps   | 493000   |
| Running Forward KL  | -2.1     |
| Running Reverse KL  | 3.23     |
| Running Update Time | 986      |
----------------------------------
2025-02-18 12:54:34.081842 ׼ʱ-
| Itration            | 987      |
| Real Det Return     | 368      |
| Real Sto Return     | 365      |
| Reward Loss         | -30.2    |
| Running Env Steps   | 493500   |
| Running Forward KL  | -1.78    |
| Running Reverse KL  | 3.74     |
| Running Update Time | 987      |
----------------------------------
2025-02-18 12:54:46.563214 ׼ʱ-
| Itration            | 988      |
| Real Det Return     | 390      |
| Real Sto Return     | 373      |
| Reward Loss         | -33.7    |
| Running Env Steps   | 494000   |
| Running Forward KL  | -1.67    |
| Running Reverse KL  | 3.73     |
| Running Update Time | 988      |
----------------------------------
2025-02-18 12:54:59.028975 ׼ʱ-
| Itration            | 989      |
| Real Det Return     | 335      |
| Real Sto Return     | 325      |
| Reward Loss         | -46.8    |
| Running Env Steps   | 494500   |
| Running Forward KL  | -1.88    |
| Running Reverse KL  | 3.65     |
| Running Update Time | 989      |
----------------------------------
2025-02-18 12:55:11.969690 ׼ʱ-
| Itration            | 990      |
| Real Det Return     | 388      |
| Real Sto Return     | 372      |
| Reward Loss         | -25.9    |
| Running Env Steps   | 495000   |
| Running Forward KL  | -2.1     |
| Running Reverse KL  | 3.86     |
| Running Update Time | 990      |
----------------------------------
2025-02-18 12:55:24.576076 ׼ʱ-
| Itration            | 991      |
| Real Det Return     | 402      |
| Real Sto Return     | 360      |
| Reward Loss         | -25.5    |
| Running Env Steps   | 495500   |
| Running Forward KL  | -2       |
| Running Reverse KL  | 4.06     |
| Running Update Time | 991      |
----------------------------------
2025-02-18 12:55:37.104322 ׼ʱ-
| Itration            | 992      |
| Real Det Return     | 368      |
| Real Sto Return     | 350      |
| Reward Loss         | -35.3    |
| Running Env Steps   | 496000   |
| Running Forward KL  | -2.37    |
| Running Reverse KL  | 3.54     |
| Running Update Time | 992      |
----------------------------------
2025-02-18 12:55:49.601319 ׼ʱ-
| Itration            | 993      |
| Real Det Return     | 393      |
| Real Sto Return     | 363      |
| Reward Loss         | -23.8    |
| Running Env Steps   | 496500   |
| Running Forward KL  | -2.21    |
| Running Reverse KL  | 3.54     |
| Running Update Time | 993      |
----------------------------------
2025-02-18 12:56:02.176427 ׼ʱ-
| Itration            | 994      |
| Real Det Return     | 367      |
| Real Sto Return     | 357      |
| Reward Loss         | -27.8    |
| Running Env Steps   | 497000   |
| Running Forward KL  | -1.68    |
| Running Reverse KL  | 3.93     |
| Running Update Time | 994      |
----------------------------------
2025-02-18 12:56:14.704673 ׼ʱ-
| Itration            | 995      |
| Real Det Return     | 393      |
| Real Sto Return     | 383      |
| Reward Loss         | -26.8    |
| Running Env Steps   | 497500   |
| Running Forward KL  | -1.77    |
| Running Reverse KL  | 4.07     |
| Running Update Time | 995      |
----------------------------------
2025-02-18 12:56:27.232922 ׼ʱ-
| Itration            | 996      |
| Real Det Return     | 371      |
| Real Sto Return     | 373      |
| Reward Loss         | -24.9    |
| Running Env Steps   | 498000   |
| Running Forward KL  | -2.47    |
| Running Reverse KL  | 3.58     |
| Running Update Time | 996      |
----------------------------------
2025-02-18 12:56:39.714301 ׼ʱ-
| Itration            | 997      |
| Real Det Return     | 378      |
| Real Sto Return     | 374      |
| Reward Loss         | -32.8    |
| Running Env Steps   | 498500   |
| Running Forward KL  | -2.44    |
| Running Reverse KL  | 3.69     |
| Running Update Time | 997      |
----------------------------------
2025-02-18 12:56:52.211315 ׼ʱ-
| Itration            | 998      |
| Real Det Return     | 368      |
| Real Sto Return     | 371      |
| Reward Loss         | -32.5    |
| Running Env Steps   | 499000   |
| Running Forward KL  | -1.95    |
| Running Reverse KL  | 4.26     |
| Running Update Time | 998      |
----------------------------------
2025-02-18 12:57:04.889533 ׼ʱ-
| Itration            | 999      |
| Real Det Return     | 378      |
| Real Sto Return     | 375      |
| Reward Loss         | -38.5    |
| Running Env Steps   | 499500   |
| Running Forward KL  | -1.87    |
| Running Reverse KL  | 4.22     |
| Running Update Time | 999      |
----------------------------------
