/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
=== specification ====================================================
+: rlrd.training:Training
epochs: 10
rounds: 50
steps: 2000
stats_window: 10000
seed: 0
tag: ''
Env:
   +: rlrd.envs:RandomDelayEnv
   seed_val: 0
   id: Hopper-v4
   frame_skip: 0
   min_observation_delay: 0
   sup_observation_delay: 1
   min_action_delay: 0
   sup_action_delay: 1
   real_world_sampler: 4
   action_noise: 0.05
Test:
   +: rlrd.testing:Test
   workers: 1
   number: 1
   device: cpu
Agent:
   +: rlrd.dcac:Agent
   batchsize: 128
   memory_size: 1000000
   lr: 0.0003
   discount: 0.99
   target_update: 0.005
   reward_scale: 5.0
   entropy_scale: 1.0
   start_training: 10000
   device: cpu
   training_steps: 1.0
   loss_alpha: 0.2
   rtac: false
   Model:
      +: rlrd.dcac_models:Mlp
      hidden_units: 256
      num_critics: 2
      act_delay: true
      obs_delay: true
   OutputNorm:
      +: rlrd.nn:PopArt
      beta: 0.0003
      zero_debias: true
      start_pop: 8
__format_version__: '3'
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>

<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
=== epoch 1/10 ===== round 1/50 ======================================
100%|██████████| 2000/2000 [00:01<00:00, 1056.23it/s]
/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
episodes                                  108
episode_length                      18.490741
returns                             14.943102
return_std                          22.091196
average_reward                       0.808236
round_time             0 days 00:00:01.970597
episodes_test                           256.0
episode_length_test                 38.820312
returns_test                        43.172987
return_std_test                     61.152581
average_reward_test                  1.113542
round_time_test        0 days 00:00:09.522069
round_time_total       0 days 00:00:11.348044 

=== epoch 1/10 ===== round 2/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
 84%|████████▍ | 1677/2000 [00:01<00:00, 948.56it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [00:02<00:00, 997.74it/s] 
episodes                                  210
episode_length                      18.957143
returns                             15.756497
return_std                          20.739268
average_reward                       0.832315
round_time             0 days 00:00:02.520378
episodes_test                           271.0
episode_length_test                 36.881919
returns_test                        37.359737
return_std_test                      53.69065
average_reward_test                  1.012932
round_time_test        0 days 00:00:09.409246
round_time_total       0 days 00:00:11.207950 

=== epoch 1/10 ===== round 3/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
 81%|████████  | 1620/2000 [00:01<00:00, 946.10it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [00:01<00:00, 1038.39it/s]
episodes                                  305
episode_length                      19.652459
returns                             17.323105
return_std                          24.449998
average_reward                       0.881513
round_time             0 days 00:00:02.514099
episodes_test                           222.0
episode_length_test                 45.036036
returns_test                        51.506752
return_std_test                     66.271002
average_reward_test                  1.143644
round_time_test        0 days 00:00:09.402323
round_time_total       0 days 00:00:11.203599 

=== epoch 1/10 ===== round 4/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
 84%|████████▍ | 1678/2000 [00:01<00:00, 999.63it/s] /<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [00:01<00:00, 1018.74it/s]
episodes                                  414
episode_length                      19.219807
returns                             16.475443
return_std                          22.697971
average_reward                       0.861254
round_time             0 days 00:00:02.499222
episodes_test                           272.0
episode_length_test                 36.676471
returns_test                        38.992197
return_std_test                      58.36466
average_reward_test                  1.061555
round_time_test        0 days 00:00:09.600585
round_time_total       0 days 00:00:11.351028 

=== epoch 1/10 ===== round 5/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
 85%|████████▌ | 1703/2000 [00:01<00:00, 1001.21it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [00:01<00:00, 1024.96it/s]
episodes                                  523
episode_length                      19.105163
returns                             16.298992
return_std                          22.517558
average_reward                       0.853331
round_time             0 days 00:00:02.561455
episodes_test                           276.0
episode_length_test                 36.086957
returns_test                        38.513301
return_std_test                     54.714346
average_reward_test                  1.069032
round_time_test        0 days 00:00:09.548259
round_time_total       0 days 00:00:11.430114 

=== epoch 1/10 ===== round 6/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 0/2000 [00:00<?, ?it/s]/<ANONYMIZED PATH>/rmst-rlrd/rlrd/nn.py:41: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly.  To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage()
  assert b.storage().data_ptr() == a.storage().data_ptr()
  0%|          | 3/2000 [00:01<16:47,  1.98it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:17<00:00,  2.18it/s]
starting training
episodes                                  488
episode_length                      20.442623
returns                             20.270784
return_std                          24.123589
average_reward                       0.990817
round_time             0 days 00:15:17.692166
episodes_test                           252.0
episode_length_test                 39.563492
returns_test                         41.29177
return_std_test                     58.216081
average_reward_test                  1.041739
round_time_test        0 days 00:00:09.517676
round_time_total       0 days 00:15:17.693290
loss_total                        7339.106532
loss_critic                       9314.652432
loss_actor                        -563.077731
memory_size                           979.703 

=== epoch 1/10 ===== round 7/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:46,  1.87it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:16<00:00,  2.18it/s]
episodes                                  479
episode_length                      20.847599
returns                             22.146975
return_std                          24.727518
average_reward                       1.062279
round_time             0 days 00:15:17.084820
episodes_test                           268.0
episode_length_test                 37.242537
returns_test                        50.080936
return_std_test                     30.513821
average_reward_test                  1.345205
round_time_test        0 days 00:00:09.481040
round_time_total       0 days 00:15:17.086191
loss_total                       35295.447869
loss_critic                      45313.107389
loss_actor                       -4775.193229
memory_size                          1178.993 

=== epoch 1/10 ===== round 8/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:04,  2.21it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:15<00:00,  2.19it/s]
episodes                                  498
episode_length                      20.046185
returns                             21.598517
return_std                          21.341637
average_reward                       1.075958
round_time             0 days 00:15:15.821498
episodes_test                           520.0
episode_length_test                 19.213462
returns_test                        22.205752
return_std_test                     18.022611
average_reward_test                  1.155206
round_time_test        0 days 00:00:09.903565
round_time_total       0 days 00:15:15.822625
loss_total                      717237.884049
loss_critic                     902081.717749
loss_actor                      -22137.511731
memory_size                         1240.1165 

=== epoch 1/10 ===== round 9/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:17,  2.18it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:17<00:00,  2.18it/s]
episodes                                  508
episode_length                      19.655512
returns                             21.946073
return_std                          20.368338
average_reward                       1.116445
round_time             0 days 00:15:17.723380
episodes_test                           561.0
episode_length_test                 17.812834
returns_test                        18.465514
return_std_test                      14.32426
average_reward_test                  1.036409
round_time_test        0 days 00:00:09.778968
round_time_total       0 days 00:15:17.724495
loss_total                    27683108.403719
loss_critic                   34628120.246937
loss_actor                      -96941.538816
memory_size                         1265.6385 

=== epoch 1/10 ===== round 10/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:38,  2.13it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:12<00:00,  2.19it/s]
episodes                                  503
episode_length                      19.805169
returns                             23.191562
return_std                          20.181967
average_reward                       1.171235
round_time             0 days 00:15:12.801351
episodes_test                           574.0
episode_length_test                 17.414634
returns_test                        17.761738
return_std_test                     13.148716
average_reward_test                  1.019917
round_time_test        0 days 00:00:09.982986
round_time_total       0 days 00:15:12.802459
loss_total                     1001716550.554
loss_critic                    1252221239.408
loss_actor                     -302288.709336
memory_size                         1375.5035 

=== epoch 1/10 ===== round 11/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:49,  2.10it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:10<00:00,  2.20it/s]
episodes                                  530
episode_length                      18.624528
returns                             19.817996
return_std                          17.754084
average_reward                       1.064945
round_time             0 days 00:15:10.620029
episodes_test                           521.0
episode_length_test                 19.120921
returns_test                        19.708682
return_std_test                      17.87353
average_reward_test                  1.029721
round_time_test        0 days 00:00:09.889736
round_time_total       0 days 00:15:10.621208
loss_total                       6533359232.0
loss_critic                    8166849454.272
loss_actor                     -602276.127391
memory_size                         1507.9545 

=== epoch 1/10 ===== round 12/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:46,  2.25it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:08<00:00,  2.20it/s]
episodes                                  547
episode_length                       18.23766
returns                             18.023436
return_std                          15.778264
average_reward                       0.988557
round_time             0 days 00:15:08.935314
episodes_test                           501.0
episode_length_test                 19.956088
returns_test                        20.528376
return_std_test                     21.728795
average_reward_test                  1.028667
round_time_test        0 days 00:00:09.916726
round_time_total       0 days 00:15:08.936682
loss_total                 19547708499.200001
loss_critic                24434862921.728001
loss_actor                     -911028.847062
memory_size                         1666.7495 

=== epoch 1/10 ===== round 13/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:30,  2.15it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:05<00:00,  2.21it/s]
episodes                                  598
episode_length                      16.673913
returns                             15.598582
return_std                          14.423359
average_reward                       0.935312
round_time             0 days 00:15:06.385879
episodes_test                           675.0
episode_length_test                 14.807407
returns_test                        13.234137
return_std_test                      6.761498
average_reward_test                  0.893649
round_time_test        0 days 00:00:10.060788
round_time_total       0 days 00:15:06.386985
loss_total                 65909792707.071999
loss_critic                82387633707.007996
loss_actor                    -1576707.871062
memory_size                            1685.0 

=== epoch 1/10 ===== round 14/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:57,  2.39it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:04<00:00,  2.21it/s]
episodes                                  658
episode_length                      15.177812
returns                             13.361283
return_std                          13.262553
average_reward                       0.880264
round_time             0 days 00:15:04.760042
episodes_test                           863.0
episode_length_test                 11.585168
returns_test                         8.289314
return_std_test                      3.980248
average_reward_test                  0.715549
round_time_test        0 days 00:00:10.484942
round_time_total       0 days 00:15:04.761305
loss_total                486511856353.280029
loss_critic               608140687585.280029
loss_actor                      -3512121.1025
memory_size                            1685.0 

=== epoch 1/10 ===== round 15/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:12,  2.34it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:04<00:00,  2.21it/s]
episodes                                  706
episode_length                      14.157224
returns                             11.449086
return_std                             9.4952
average_reward                        0.80872
round_time             0 days 00:15:04.872973
episodes_test                           821.0
episode_length_test                 12.175396
returns_test                         8.951943
return_std_test                      4.707307
average_reward_test                  0.735315
round_time_test        0 days 00:00:10.032205
round_time_total       0 days 00:15:04.874185
loss_total               3357017411944.448242
loss_critic              4196273596628.992188
loss_actor                     -7584054.50425
memory_size                            1685.0 

=== epoch 1/10 ===== round 16/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:36,  2.13it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:06<00:00,  2.21it/s]
episodes                                  754
episode_length                      13.228117
returns                             10.143186
return_std                           6.195541
average_reward                        0.76682
round_time             0 days 00:15:07.144329
episodes_test                           754.0
episode_length_test                 13.255968
returns_test                         9.985479
return_std_test                      5.098117
average_reward_test                  0.753314
round_time_test        0 days 00:00:10.123627
round_time_total       0 days 00:15:07.145429
loss_total              18854636199739.390625
loss_critic              23568298851041.28125
loss_actor                     -15486464.7565
memory_size                            1685.0 

=== epoch 1/10 ===== round 17/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:49,  1.98it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:59<00:00,  2.22it/s]
episodes                                  736
episode_length                      13.561141
returns                             11.643858
return_std                          12.489317
average_reward                         0.8586
round_time             0 days 00:14:59.971829
episodes_test                           727.0
episode_length_test                 13.755158
returns_test                        10.916324
return_std_test                      6.274067
average_reward_test                  0.793617
round_time_test        0 days 00:00:10.003433
round_time_total       0 days 00:14:59.972956
loss_total              110665241298206.71875
loss_critic             138331555241132.03125
loss_actor                      -30939657.692
memory_size                         1779.8035 

=== epoch 1/10 ===== round 18/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:53,  2.39it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:56<00:00,  2.23it/s]
episodes                                  649
episode_length                        15.3698
returns                             15.639398
return_std                          16.719458
average_reward                       1.018832
round_time             0 days 00:14:56.979993
episodes_test                           375.0
episode_length_test                 26.629333
returns_test                        40.816983
return_std_test                     21.376126
average_reward_test                  1.532472
round_time_test        0 days 00:00:09.611525
round_time_total       0 days 00:14:56.981309
loss_total               295901650848055.3125
loss_critic              369877064444018.6875
loss_actor                       -47806378.15
memory_size                          1951.327 

=== epoch 1/10 ===== round 19/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:07,  2.06it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:55<00:00,  2.23it/s]
episodes                                  542
episode_length                      18.424354
returns                             21.842643
return_std                          19.743206
average_reward                       1.184674
round_time             0 days 00:14:56.328368
episodes_test                           384.0
episode_length_test                 25.994792
returns_test                        41.547584
return_std_test                     10.790253
average_reward_test                  1.597721
round_time_test        0 days 00:00:09.601932
round_time_total       0 days 00:14:56.329483
loss_total               514744246771646.4375
loss_critic               643430297806831.625
loss_actor                      -63024194.126
memory_size                         1989.6495 

=== epoch 1/10 ===== round 20/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:50,  2.10it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:10<00:00,  2.20it/s]
episodes                                  451
episode_length                      22.124169
returns                             29.671558
return_std                          22.016217
average_reward                       1.341324
round_time             0 days 00:15:11.475049
episodes_test                           270.0
episode_length_test                 36.985185
returns_test                        54.106754
return_std_test                     21.105052
average_reward_test                  1.461874
round_time_test        0 days 00:00:09.515722
round_time_total       0 days 00:15:11.476158
loss_total                824963019011260.375
loss_critic              1031203757049774.125
loss_actor                      -77478647.778
memory_size                         2153.5535 

=== epoch 1/10 ===== round 21/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:47,  1.98it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:15<00:00,  2.18it/s]
episodes                                  346
episode_length                       28.83815
returns                             41.832375
return_std                          22.071368
average_reward                       1.450597
round_time             0 days 00:15:16.678858
episodes_test                           293.0
episode_length_test                 34.119454
returns_test                        50.781617
return_std_test                     17.892238
average_reward_test                  1.488223
round_time_test        0 days 00:00:09.526661
round_time_total       0 days 00:15:16.680205
loss_total                 768346666892787.75
loss_critic               960433317180604.375
loss_actor                       -73345850.09
memory_size                          2575.736 

=== epoch 1/10 ===== round 22/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:37,  2.00it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:27<00:00,  2.16it/s]
episodes                                  331
episode_length                      30.099698
returns                             42.361551
return_std                          20.909187
average_reward                       1.407991
round_time             0 days 00:15:27.671749
episodes_test                           239.0
episode_length_test                 41.518828
returns_test                        57.979816
return_std_test                     28.038041
average_reward_test                  1.393804
round_time_test        0 days 00:00:09.545210
round_time_total       0 days 00:15:27.672861
loss_total               462576060672770.0625
loss_critic               578220067267805.125
loss_actor                       -57285434.11
memory_size                         3220.8455 

=== epoch 1/10 ===== round 23/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:16,  1.93it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:26<00:00,  2.16it/s]
episodes                                  411
episode_length                      24.313869
returns                             30.892139
return_std                          23.597032
average_reward                        1.27052
round_time             0 days 00:15:26.867311
episodes_test                           805.0
episode_length_test                 12.412422
returns_test                        10.519199
return_std_test                      4.770007
average_reward_test                  0.847594
round_time_test        0 days 00:00:10.186479
round_time_total       0 days 00:15:26.868483
loss_total               457624018372001.8125
loss_critic                572030014237704.25
loss_actor                       -60105689.74
memory_size                            3369.0 

=== epoch 1/10 ===== round 24/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<15:40,  2.12it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:28<00:00,  2.15it/s]
episodes                                  506
episode_length                      19.681818
returns                             22.241529
return_std                          22.051256
average_reward                       1.131842
round_time             0 days 00:15:28.660917
episodes_test                           731.0
episode_length_test                 13.678523
returns_test                        12.694489
return_std_test                      5.627048
average_reward_test                  0.928067
round_time_test        0 days 00:00:10.200727
round_time_total       0 days 00:15:28.662353
loss_total               341315590129975.3125
loss_critic              426644486580338.6875
loss_actor                      -53095709.016
memory_size                         3372.5315 

=== epoch 1/10 ===== round 25/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:14,  2.05it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:33<00:00,  2.14it/s]
episodes                                  608
episode_length                      16.414474
returns                             16.201689
return_std                          17.829593
average_reward                       0.988058
round_time             0 days 00:15:33.729870
episodes_test                           909.0
episode_length_test                 10.994499
returns_test                         9.260116
return_std_test                       3.68892
average_reward_test                  0.842263
round_time_test        0 days 00:00:10.212748
round_time_total       0 days 00:15:33.730979
loss_total                  327988768076202.0
loss_critic              409985959401095.1875
loss_actor                      -54127037.212
memory_size                            3383.0 

=== epoch 1/10 ===== round 26/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:24,  2.16it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:31<00:00,  2.15it/s]
episodes                                  713
episode_length                      13.995792
returns                             12.780129
return_std                          11.211205
average_reward                       0.913917
round_time             0 days 00:15:31.927693
episodes_test                           897.0
episode_length_test                 11.140468
returns_test                         9.002703
return_std_test                      4.055985
average_reward_test                   0.80813
round_time_test        0 days 00:00:10.142804
round_time_total       0 days 00:15:31.928852
loss_total                 328263640157257.75
loss_critic              410329549436354.5625
loss_actor                      -54549087.856
memory_size                            3383.0 

=== epoch 1/10 ===== round 27/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:59,  2.22it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:30<00:00,  2.15it/s]
episodes                                  795
episode_length                      12.563522
returns                             10.908579
return_std                           5.528652
average_reward                       0.868544
round_time             0 days 00:15:31.473168
episodes_test                           810.0
episode_length_test                 12.328395
returns_test                        10.448751
return_std_test                      5.558274
average_reward_test                  0.847249
round_time_test        0 days 00:00:10.168996
round_time_total       0 days 00:15:31.474649
loss_total               358954813758636.0625
loss_critic                 448693514348265.5
loss_actor                      -58446035.698
memory_size                            3383.0 

=== epoch 1/10 ===== round 28/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:40,  2.12it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:29<00:00,  2.15it/s]
episodes                                  798
episode_length                      12.506266
returns                             10.658004
return_std                           5.717715
average_reward                        0.85193
round_time             0 days 00:15:30.420648
episodes_test                           772.0
episode_length_test                 12.949482
returns_test                        10.653044
return_std_test                      5.977964
average_reward_test                  0.822686
round_time_test        0 days 00:00:10.311109
round_time_total       0 days 00:15:30.422136
loss_total                 466416495262433.25
loss_critic               583020610133688.375
loss_actor                      -66972553.282
memory_size                            3383.0 

=== epoch 1/10 ===== round 29/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:33,  2.14it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:36<00:00,  2.13it/s]
episodes                                  791
episode_length                      12.620733
returns                             10.520485
return_std                           5.633659
average_reward                       0.833864
round_time             0 days 00:15:37.450172
episodes_test                           797.0
episode_length_test                 12.539523
returns_test                         9.565948
return_std_test                      6.010615
average_reward_test                  0.762913
round_time_test        0 days 00:00:10.125428
round_time_total       0 days 00:15:37.451293
loss_total                 700396814423031.75
loss_critic                 875496005414420.5
loss_actor                      -80933021.116
memory_size                          3386.646 

=== epoch 1/10 ===== round 30/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:22,  2.16it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:34<00:00,  2.14it/s]
episodes                                  801
episode_length                      12.475655
returns                             10.271445
return_std                           5.726513
average_reward                       0.823456
round_time             0 days 00:15:35.297814
episodes_test                           779.0
episode_length_test                 12.825417
returns_test                        10.201676
return_std_test                      5.878675
average_reward_test                  0.795449
round_time_test        0 days 00:00:10.003699
round_time_total       0 days 00:15:35.298949
loss_total                  924729220427415.5
loss_critic               1155911508266319.75
loss_actor                      -92185799.156
memory_size                            3391.0 

=== epoch 1/10 ===== round 31/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:07,  2.06it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:34<00:00,  2.14it/s]
episodes                                  818
episode_length                      12.209046
returns                              9.578127
return_std                           5.075959
average_reward                       0.784538
round_time             0 days 00:15:35.306643
episodes_test                           847.0
episode_length_test                 11.804014
returns_test                         9.162758
return_std_test                      4.366482
average_reward_test                  0.776256
round_time_test        0 days 00:00:10.297916
round_time_total       0 days 00:15:35.307998
loss_total                1004998834440372.25
loss_critic                1256248522068459.5
loss_actor                      -97610547.164
memory_size                            3391.0 

=== epoch 1/10 ===== round 32/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:09,  1.94it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:38<00:00,  2.13it/s]
episodes                                  807
episode_length                      12.370508
returns                              9.417914
return_std                           4.996924
average_reward                       0.761425
round_time             0 days 00:15:38.953606
episodes_test                           803.0
episode_length_test                 12.439601
returns_test                         9.259083
return_std_test                       5.17398
average_reward_test                  0.744495
round_time_test        0 days 00:00:10.366627
round_time_total       0 days 00:15:38.954717
loss_total                 1093956522578280.5
loss_critic               1367445630523277.25
loss_actor                     -102398632.292
memory_size                            3391.0 

=== epoch 1/10 ===== round 33/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:35,  2.01it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:35<00:00,  2.14it/s]
episodes                                  799
episode_length                       12.51189
returns                              9.292663
return_std                           4.847617
average_reward                       0.742566
round_time             0 days 00:15:36.044415
episodes_test                           734.0
episode_length_test                 13.600817
returns_test                         9.892851
return_std_test                      5.075252
average_reward_test                  0.728054
round_time_test        0 days 00:00:10.113633
round_time_total       0 days 00:15:36.045535
loss_total                1185777623687495.75
loss_critic               1482222003887800.25
loss_actor                     -107652414.684
memory_size                            3391.0 

=== epoch 1/10 ===== round 34/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:21,  1.92it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:33<00:00,  2.14it/s]
episodes                                  780
episode_length                      12.805128
returns                              9.398557
return_std                            4.97841
average_reward                       0.734077
round_time             0 days 00:15:34.173175
episodes_test                           731.0
episode_length_test                 13.677155
returns_test                        10.023672
return_std_test                      5.051564
average_reward_test                  0.732932
round_time_test        0 days 00:00:10.133230
round_time_total       0 days 00:15:34.174270
loss_total                1379428885547974.75
loss_critic                1724286075679015.0
loss_actor                      -116997358.28
memory_size                            3391.0 

=== epoch 1/10 ===== round 35/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:49,  2.10it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:35<00:00,  2.14it/s]
episodes                                  752
episode_length                      13.284574
returns                              9.596848
return_std                           4.928498
average_reward                        0.72255
round_time             0 days 00:15:36.024546
episodes_test                           773.0
episode_length_test                 12.926261
returns_test                         8.848156
return_std_test                      4.492693
average_reward_test                  0.684711
round_time_test        0 days 00:00:10.308031
round_time_total       0 days 00:15:36.025644
loss_total                1780908978218205.25
loss_critic               2226136183883169.75
loss_actor                     -133315959.536
memory_size                          3391.309 

=== epoch 1/10 ===== round 36/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:52,  1.86it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:31<00:00,  2.15it/s]
episodes                                  739
episode_length                      13.515562
returns                              9.616752
return_std                           5.048031
average_reward                        0.71119
round_time             0 days 00:15:31.575173
episodes_test                           750.0
episode_length_test                 13.333333
returns_test                         9.038885
return_std_test                      4.546487
average_reward_test                  0.677916
round_time_test        0 days 00:00:10.166665
round_time_total       0 days 00:15:31.576283
loss_total                 2305972889762922.5
loss_critic                2882466062828306.5
loss_actor                     -151573162.284
memory_size                            3392.0 

=== epoch 1/10 ===== round 37/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:03,  2.21it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:33<00:00,  2.14it/s]
episodes                                  728
episode_length                      13.726648
returns                               9.78805
return_std                           5.294034
average_reward                       0.712829
round_time             0 days 00:15:34.365002
episodes_test                           652.0
episode_length_test                 15.334356
returns_test                        11.786878
return_std_test                      7.041982
average_reward_test                  0.768707
round_time_test        0 days 00:00:09.945853
round_time_total       0 days 00:15:34.366106
loss_total                 2953911172417454.0
loss_critic                3692388903471284.0
loss_actor                     -170110341.256
memory_size                            3392.0 

=== epoch 1/10 ===== round 38/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:03,  1.95it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:33<00:00,  2.14it/s]
episodes                                  707
episode_length                      14.049505
returns                              9.999818
return_std                           5.635791
average_reward                       0.715379
round_time             0 days 00:15:33.897357
episodes_test                           723.0
episode_length_test                 13.817427
returns_test                         9.683719
return_std_test                      5.432035
average_reward_test                  0.700961
round_time_test        0 days 00:00:10.138641
round_time_total       0 days 00:15:33.898444
loss_total                 3728095204415111.0
loss_critic                4660118922253566.0
loss_actor                     -191942331.848
memory_size                          3395.378 

=== epoch 1/10 ===== round 39/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:00,  1.96it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:32<00:00,  2.14it/s]
episodes                                  677
episode_length                      14.747415
returns                             10.954083
return_std                           9.165996
average_reward                       0.742605
round_time             0 days 00:15:33.560472
episodes_test                           562.0
episode_length_test                 17.775801
returns_test                        14.940909
return_std_test                     15.331582
average_reward_test                  0.840195
round_time_test        0 days 00:00:09.915094
round_time_total       0 days 00:15:33.561577
loss_total                 4919380695731667.0
loss_critic                6149225761870971.0
loss_actor                     -216441645.432
memory_size                         3506.4425 

=== epoch 1/10 ===== round 40/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:16,  2.04it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:37<00:00,  2.13it/s]
episodes                                  643
episode_length                      15.508554
returns                             12.196577
return_std                           11.22413
average_reward                       0.786648
round_time             0 days 00:15:37.726762
episodes_test                           573.0
episode_length_test                 17.415358
returns_test                        15.188362
return_std_test                     10.896513
average_reward_test                  0.871568
round_time_test        0 days 00:00:09.812636
round_time_total       0 days 00:15:37.727860
loss_total                 6352610767077900.0
loss_critic                7940763330703000.0
loss_actor                     -242117800.072
memory_size                         3553.4015 

=== epoch 1/10 ===== round 41/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<18:27,  1.80it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:40<00:00,  2.13it/s]
episodes                                  619
episode_length                       16.12601
returns                             13.015682
return_std                          11.847909
average_reward                       0.807312
round_time             0 days 00:15:40.537792
episodes_test                           456.0
episode_length_test                  21.91886
returns_test                        23.685306
return_std_test                     28.642898
average_reward_test                  1.080512
round_time_test        0 days 00:00:09.921264
round_time_total       0 days 00:15:40.538890
loss_total                 7520325409557185.0
loss_critic                9400406608971826.0
loss_actor                     -257076771.256
memory_size                         3654.6495 

=== epoch 1/10 ===== round 42/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:12,  2.19it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:36<00:00,  2.13it/s]
episodes                                  578
episode_length                      17.268166
returns                             14.956431
return_std                          15.680508
average_reward                       0.865913
round_time             0 days 00:15:37.380661
episodes_test                           640.0
episode_length_test                 15.585938
returns_test                        11.851382
return_std_test                      7.299055
average_reward_test                   0.76013
round_time_test        0 days 00:00:10.143338
round_time_total       0 days 00:15:37.382341
loss_total                 8369554591993299.0
loss_critic               10461943054771160.0
loss_actor                     -271056484.832
memory_size                         3708.2755 

=== epoch 1/10 ===== round 43/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:07,  2.20it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:37<00:00,  2.13it/s]
episodes                                  529
episode_length                      18.674858
returns                             17.334295
return_std                          17.750778
average_reward                       0.932671
round_time             0 days 00:15:38.550846
episodes_test                           417.0
episode_length_test                 23.911271
returns_test                        25.462647
return_std_test                     22.685377
average_reward_test                   1.06589
round_time_test        0 days 00:00:09.652669
round_time_total       0 days 00:15:38.552004
loss_total                 9097744723275154.0
loss_critic               11372180710988186.0
loss_actor                     -281028410.568
memory_size                          4038.947 

=== epoch 1/10 ===== round 44/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<18:00,  1.85it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:37<00:00,  2.13it/s]
episodes                                  485
episode_length                      20.501031
returns                             20.110641
return_std                          21.794529
average_reward                       0.983268
round_time             0 days 00:15:38.482909
episodes_test                           379.0
episode_length_test                 26.108179
returns_test                        29.214118
return_std_test                     29.421336
average_reward_test                  1.115838
round_time_test        0 days 00:00:09.753787
round_time_total       0 days 00:15:38.484222
loss_total                 8700838812181332.0
loss_critic               10876048328966012.0
loss_actor                      -278868397.72
memory_size                         4472.3775 

=== epoch 1/10 ===== round 45/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:08,  1.94it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:32<00:00,  2.14it/s]
episodes                                  476
episode_length                      20.970588
returns                             20.470669
return_std                          22.446205
average_reward                       0.975771
round_time             0 days 00:15:33.440882
episodes_test                           542.0
episode_length_test                 18.448339
returns_test                        15.689833
return_std_test                     17.454073
average_reward_test                  0.850483
round_time_test        0 days 00:00:09.837659
round_time_total       0 days 00:15:33.442163
loss_total                 7896163676867002.0
loss_critic                9870204437941714.0
loss_actor                     -263056236.496
memory_size                         4789.4905 

=== epoch 1/10 ===== round 46/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:22,  2.03it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:29<00:00,  2.15it/s]
episodes                                  410
episode_length                      24.363415
returns                              25.05092
return_std                           28.15034
average_reward                       1.028095
round_time             0 days 00:15:30.306214
episodes_test                           402.0
episode_length_test                 24.783582
returns_test                        23.264997
return_std_test                      33.53985
average_reward_test                  0.937083
round_time_test        0 days 00:00:09.696757
round_time_total       0 days 00:15:30.307571
loss_total                 6445595134938579.0
loss_critic                8056993774523384.0
loss_actor                     -241794252.104
memory_size                         5324.3895 

=== epoch 1/10 ===== round 47/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:40,  2.27it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:30<00:00,  2.15it/s]
episodes                                  402
episode_length                      24.825871
returns                             25.307258
return_std                          28.165354
average_reward                       1.019031
round_time             0 days 00:15:31.411446
episodes_test                           346.0
episode_length_test                  28.83526
returns_test                        27.636175
return_std_test                     33.697025
average_reward_test                  0.958836
round_time_test        0 days 00:00:09.574241
round_time_total       0 days 00:15:31.412925
loss_total                 5587491896764137.0
loss_critic                6984364750377320.0
loss_actor                     -226240700.304
memory_size                          5879.778 

=== epoch 1/10 ===== round 48/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:23,  1.91it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:31<00:00,  2.15it/s]
episodes                                  469
episode_length                      21.266525
returns                             20.431518
return_std                          25.301251
average_reward                       0.961325
round_time             0 days 00:15:31.803852
episodes_test                           646.0
episode_length_test                 15.475232
returns_test                        12.859522
return_std_test                     11.542911
average_reward_test                  0.830995
round_time_test        0 days 00:00:10.070532
round_time_total       0 days 00:15:31.804974
loss_total                 5740488705894777.0
loss_critic                7175610760599437.0
loss_actor                     -228665505.808
memory_size                         6026.9945 

=== epoch 1/10 ===== round 49/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:55,  2.23it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:29<00:00,  2.15it/s]
episodes                                  564
episode_length                      17.703901
returns                             15.618369
return_std                          20.660546
average_reward                       0.883126
round_time             0 days 00:15:30.217299
episodes_test                           776.0
episode_length_test                 12.878866
returns_test                         9.343431
return_std_test                      6.597016
average_reward_test                  0.725591
round_time_test        0 days 00:00:10.176248
round_time_total       0 days 00:15:30.218469
loss_total                 5485889965994803.0
loss_critic                6857362333627318.0
loss_actor                       -225816277.8
memory_size                          6043.955 

=== epoch 1/10 ===== round 50/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:55,  1.97it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:28<00:00,  2.16it/s]
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
episodes                                  629
episode_length                      15.879173
returns                             13.518293
return_std                          18.610874
average_reward                       0.851339
round_time             0 days 00:15:28.640001
episodes_test                           837.0
episode_length_test                 11.947431
returns_test                          8.36829
return_std_test                      4.500523
average_reward_test                  0.700426
round_time_test        0 days 00:00:10.172685
round_time_total       0 days 00:15:28.641107
loss_total                 4948867476881408.0
loss_critic                6186084238660469.0
loss_actor                     -215918007.656
memory_size                            6049.0 


<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
=== epoch 2/10 ===== round 1/50 ======================================
  0%|          | 5/2000 [00:02<14:45,  2.25it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:56<00:00,  2.23it/s]
episodes                                  166
episode_length                      12.042169
returns                              8.695107
return_std                           5.505834
average_reward                       0.722214
round_time             0 days 00:14:57.068514
episodes_test                           830.0
episode_length_test                 12.044578
returns_test                         8.623744
return_std_test                      4.945502
average_reward_test                   0.71605
round_time_test        0 days 00:00:10.232285
round_time_total       0 days 00:14:57.069645
loss_total                 4409994021615698.0
loss_critic                5512492428168266.0
loss_actor                      -207423096.88
memory_size                            6049.0 

=== epoch 2/10 ===== round 2/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:40,  2.27it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:53<00:00,  2.24it/s]
episodes                                  326
episode_length                      12.260736
returns                              8.773853
return_std                           5.277721
average_reward                       0.715731
round_time             0 days 00:14:54.354342
episodes_test                           861.0
episode_length_test                 11.603949
returns_test                         7.945771
return_std_test                      3.892225
average_reward_test                   0.68465
round_time_test        0 days 00:00:10.237781
round_time_total       0 days 00:14:54.355435
loss_total                 4264116829649109.0
loss_critic                5330145950155407.0
loss_actor                     -205786473.944
memory_size                            6049.0 

=== epoch 2/10 ===== round 3/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:55,  2.09it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:56<00:00,  2.23it/s]
episodes                                  469
episode_length                      12.793177
returns                              9.088022
return_std                           5.439485
average_reward                        0.71038
round_time             0 days 00:14:57.436878
episodes_test                           741.0
episode_length_test                 13.470985
returns_test                         9.238725
return_std_test                      5.206546
average_reward_test                  0.685702
round_time_test        0 days 00:00:10.249336
round_time_total       0 days 00:14:57.437971
loss_total                 4155359055344304.0
loss_critic                5194198725127307.0
loss_actor                     -203460501.624
memory_size                         6054.6595 

=== epoch 2/10 ===== round 4/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:35,  2.28it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:54<00:00,  2.24it/s]
episodes                                  597
episode_length                       13.39866
returns                              9.774185
return_std                           7.046658
average_reward                       0.729515
round_time             0 days 00:14:55.240379
episodes_test                           712.0
episode_length_test                 14.026685
returns_test                         9.944183
return_std_test                      5.709107
average_reward_test                  0.709312
round_time_test        0 days 00:00:09.829630
round_time_total       0 days 00:14:55.241524
loss_total                 3903351214468759.5
loss_critic                4879188934216647.0
loss_actor                     -197701977.128
memory_size                         6065.0105 

=== epoch 2/10 ===== round 5/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:46,  2.11it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:57<00:00,  2.23it/s]
episodes                                  733
episode_length                      13.626194
returns                              9.972777
return_std                           7.063738
average_reward                       0.732107
round_time             0 days 00:14:58.227686
episodes_test                           676.0
episode_length_test                 14.778107
returns_test                        11.644808
return_std_test                      8.481262
average_reward_test                  0.788108
round_time_test        0 days 00:00:09.925240
round_time_total       0 days 00:14:58.228792
loss_total                 3579736769442087.0
loss_critic                4474670885818597.5
loss_actor                     -191010570.624
memory_size                          6112.029 

=== epoch 2/10 ===== round 6/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:09,  2.20it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:57<00:00,  2.23it/s]
episodes                                  710
episode_length                       14.05493
returns                             10.325171
return_std                           7.328784
average_reward                       0.734348
round_time             0 days 00:14:58.472818
episodes_test                           685.0
episode_length_test                 14.575182
returns_test                        11.101881
return_std_test                      7.537579
average_reward_test                  0.762035
round_time_test        0 days 00:00:10.075550
round_time_total       0 days 00:14:58.473912
loss_total                 3314576266740367.5
loss_critic                4143220261283430.5
loss_actor                     -185018015.072
memory_size                         6117.1865 

=== epoch 2/10 ===== round 7/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:17,  2.33it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:00<00:00,  2.22it/s]
episodes                                  694
episode_length                      14.394813
returns                             10.622854
return_std                           7.510022
average_reward                       0.737834
round_time             0 days 00:15:00.983295
episodes_test                           682.0
episode_length_test                 14.659824
returns_test                         10.11745
return_std_test                      5.277922
average_reward_test                   0.69021
round_time_test        0 days 00:00:10.022948
round_time_total       0 days 00:15:00.984439
loss_total                 3094211050849960.0
loss_critic                3867763749632868.5
loss_actor                     -180028769.696
memory_size                         6122.3015 

=== epoch 2/10 ===== round 8/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:53,  2.23it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:59<00:00,  2.22it/s]
episodes                                  698
episode_length                      14.325215
returns                             10.600786
return_std                           7.501212
average_reward                        0.74004
round_time             0 days 00:14:59.885537
episodes_test                           703.0
episode_length_test                 14.193457
returns_test                        10.209501
return_std_test                        6.1067
average_reward_test                  0.719791
round_time_test        0 days 00:00:09.997842
round_time_total       0 days 00:14:59.886790
loss_total                 2902054770527174.5
loss_critic                3627568400764502.0
loss_actor                     -175097434.376
memory_size                          6132.659 

=== epoch 2/10 ===== round 9/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:58,  2.22it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:58<00:00,  2.23it/s]
episodes                                  726
episode_length                       13.76584
returns                              9.772948
return_std                            6.09249
average_reward                       0.709845
round_time             0 days 00:14:58.859565
episodes_test                           770.0
episode_length_test                 12.987013
returns_test                         8.419528
return_std_test                      3.962528
average_reward_test                  0.648304
round_time_test        0 days 00:00:10.085412
round_time_total       0 days 00:14:58.860659
loss_total                 2556456976368271.5
loss_critic                3195571166739693.5
loss_actor                     -166060180.776
memory_size                            6133.0 

=== epoch 2/10 ===== round 10/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:22,  2.32it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:00<00:00,  2.22it/s]
episodes                                  742
episode_length                      13.467655
returns                              9.344699
return_std                           5.503276
average_reward                       0.694088
round_time             0 days 00:15:01.132639
episodes_test                           775.0
episode_length_test                 12.900645
returns_test                         8.346615
return_std_test                      3.916933
average_reward_test                  0.647066
round_time_test        0 days 00:00:10.027465
round_time_total       0 days 00:15:01.133786
loss_total                 2429424609670463.5
loss_critic                3036780712075198.5
loss_actor                     -163427905.928
memory_size                            6133.0 

=== epoch 2/10 ===== round 11/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:03,  2.37it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:57<00:00,  2.23it/s]
episodes                                  755
episode_length                       13.22649
returns                              9.011636
return_std                           4.883486
average_reward                       0.681199
round_time             0 days 00:14:58.207017
episodes_test                           786.0
episode_length_test                 12.721374
returns_test                         8.218808
return_std_test                      4.041321
average_reward_test                  0.646098
round_time_test        0 days 00:00:10.108955
round_time_total       0 days 00:14:58.208111
loss_total                 2326232912359325.5
loss_critic                2907791088850829.5
loss_actor                     -159139618.368
memory_size                            6133.0 

=== epoch 2/10 ===== round 12/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:53,  2.24it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:00<00:00,  2.22it/s]
episodes                                  770
episode_length                      12.942857
returns                              8.673584
return_std                           4.375544
average_reward                       0.670448
round_time             0 days 00:15:00.685285
episodes_test                           810.0
episode_length_test                 12.344444
returns_test                         8.083792
return_std_test                      3.764654
average_reward_test                  0.654892
round_time_test        0 days 00:00:10.146114
round_time_total       0 days 00:15:00.686396
loss_total                2203005295523790.75
loss_critic                2753756573108011.0
loss_actor                     -155371256.824
memory_size                            6133.0 

=== epoch 2/10 ===== round 13/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:22,  2.16it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:04<00:00,  2.21it/s]
episodes                                  792
episode_length                      12.604798
returns                              8.343757
return_std                           3.917289
average_reward                       0.662393
round_time             0 days 00:15:04.811606
episodes_test                           797.0
episode_length_test                 12.538269
returns_test                         8.236404
return_std_test                      3.930718
average_reward_test                  0.656994
round_time_test        0 days 00:00:10.070373
round_time_total       0 days 00:15:04.812685
loss_total                 2053820059331068.0
loss_critic                2567275028592722.0
loss_actor                     -151725170.976
memory_size                            6133.0 

=== epoch 2/10 ===== round 14/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:53,  2.39it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:04<00:00,  2.21it/s]
episodes                                  790
episode_length                      12.658228
returns                              8.516405
return_std                           4.456507
average_reward                       0.672796
round_time             0 days 00:15:04.510139
episodes_test                           816.0
episode_length_test                     12.25
returns_test                         8.218456
return_std_test                      3.780077
average_reward_test                  0.671036
round_time_test        0 days 00:00:10.086982
round_time_total       0 days 00:15:04.511384
loss_total                1977876670555619.25
loss_critic                2472345795186131.0
loss_actor                     -147690541.616
memory_size                          6152.211 

=== epoch 2/10 ===== round 15/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:18,  1.92it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:02<00:00,  2.22it/s]
episodes                                  797
episode_length                      12.518193
returns                              8.487903
return_std                           4.395316
average_reward                       0.677944
round_time             0 days 00:15:02.874246
episodes_test                           820.0
episode_length_test                 12.184146
returns_test                         8.161076
return_std_test                      3.624601
average_reward_test                  0.669858
round_time_test        0 days 00:00:10.158924
round_time_total       0 days 00:15:02.875585
loss_total                 1729143686408700.0
loss_critic                2161429573105877.0
loss_actor                      -138565944.36
memory_size                            6159.0 

=== epoch 2/10 ===== round 16/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:07,  2.36it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:04<00:00,  2.21it/s]
episodes                                  820
episode_length                      12.193902
returns                               8.29516
return_std                           4.296285
average_reward                         0.6803
round_time             0 days 00:15:05.093636
episodes_test                           852.0
episode_length_test                 11.732394
returns_test                         8.109349
return_std_test                      3.530418
average_reward_test                  0.691282
round_time_test        0 days 00:00:10.214362
round_time_total       0 days 00:15:05.095113
loss_total                 1536672905511829.5
loss_critic                1920841099924996.0
loss_actor                     -131659573.816
memory_size                            6159.0 

=== epoch 2/10 ===== round 17/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:26,  2.16it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:07<00:00,  2.20it/s]
episodes                                  849
episode_length                      11.772674
returns                              8.171332
return_std                           4.088672
average_reward                       0.694006
round_time             0 days 00:15:08.509432
episodes_test                           951.0
episode_length_test                 10.500526
returns_test                         7.570741
return_std_test                      2.834698
average_reward_test                  0.720996
round_time_test        0 days 00:00:10.386500
round_time_total       0 days 00:15:08.510681
loss_total                 1394470774437314.5
loss_critic               1743088438216753.25
loss_actor                     -126383722.448
memory_size                            6159.0 

=== epoch 2/10 ===== round 18/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:09,  2.19it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:05<00:00,  2.21it/s]
episodes                                  864
episode_length                      11.554398
returns                              8.157136
return_std                           3.971531
average_reward                       0.706047
round_time             0 days 00:15:06.105532
episodes_test                           864.0
episode_length_test                 11.569444
returns_test                         8.174261
return_std_test                      3.444223
average_reward_test                  0.706631
round_time_test        0 days 00:00:10.185029
round_time_total       0 days 00:15:06.106677
loss_total                1330309847073161.25
loss_critic                1662887280873832.5
loss_actor                     -124685583.068
memory_size                            6159.0 

=== epoch 2/10 ===== round 19/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:54,  1.86it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:03<00:00,  2.21it/s]
episodes                                  888
episode_length                      11.244369
returns                               7.95407
return_std                             3.2491
average_reward                       0.707841
round_time             0 days 00:15:04.066894
episodes_test                           952.0
episode_length_test                  10.50105
returns_test                         7.781127
return_std_test                      2.893105
average_reward_test                  0.740992
round_time_test        0 days 00:00:10.272556
round_time_total       0 days 00:15:04.068014
loss_total                1263485804936691.75
loss_critic                1579357230107459.5
loss_actor                      -122018640.92
memory_size                            6159.0 

=== epoch 2/10 ===== round 20/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:31,  2.14it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:05<00:00,  2.21it/s]
episodes                                  902
episode_length                      11.078714
returns                              7.985754
return_std                           3.155718
average_reward                       0.720816
round_time             0 days 00:15:05.803132
episodes_test                           808.0
episode_length_test                 12.373762
returns_test                         8.581143
return_std_test                      3.670212
average_reward_test                  0.693546
round_time_test        0 days 00:00:10.137451
round_time_total       0 days 00:15:05.804235
loss_total                1181042335027298.25
loss_critic               1476302895161802.75
loss_actor                     -117203026.308
memory_size                            6159.0 

=== epoch 2/10 ===== round 21/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:54,  1.97it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:31<00:00,  2.15it/s]
episodes                                  904
episode_length                       11.03208
returns                               8.08702
return_std                           3.114091
average_reward                       0.732597
round_time             0 days 00:15:31.875641
episodes_test                           912.0
episode_length_test                 10.955044
returns_test                         8.059115
return_std_test                      3.092349
average_reward_test                  0.735734
round_time_test        0 days 00:00:10.587324
round_time_total       0 days 00:15:31.876893
loss_total               1104522529025818.625
loss_critic               1380653137722867.75
loss_actor                     -114231674.212
memory_size                            6159.0 

=== epoch 2/10 ===== round 22/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:17,  2.33it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:02<00:00,  2.22it/s]
episodes                                  889
episode_length                      11.228346
returns                              8.226813
return_std                           3.309203
average_reward                        0.73313
round_time             0 days 00:15:03.259598
episodes_test                           904.0
episode_length_test                 11.050885
returns_test                         8.038962
return_std_test                      3.761169
average_reward_test                  0.727504
round_time_test        0 days 00:00:10.482428
round_time_total       0 days 00:15:03.260924
loss_total                1028009594284146.75
loss_critic                1285011973120983.0
loss_actor                      -111288691.82
memory_size                            6159.0 

=== epoch 2/10 ===== round 23/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:17,  2.18it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:02<00:00,  2.22it/s]
episodes                                  862
episode_length                      11.587007
returns                              8.466401
return_std                           3.477181
average_reward                        0.73058
round_time             0 days 00:15:03.306462
episodes_test                           846.0
episode_length_test                 11.812057
returns_test                         8.685855
return_std_test                      3.930338
average_reward_test                  0.735439
round_time_test        0 days 00:00:10.044723
round_time_total       0 days 00:15:03.307833
loss_total               1012488020605009.875
loss_critic               1265610005852192.75
loss_actor                       -110615583.9
memory_size                            6159.0 

=== epoch 2/10 ===== round 24/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:17,  2.18it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:07<00:00,  2.20it/s]
episodes                                  847
episode_length                      11.804014
returns                              8.612117
return_std                           3.604944
average_reward                       0.729525
round_time             0 days 00:15:08.122283
episodes_test                           762.0
episode_length_test                 13.120735
returns_test                          9.23279
return_std_test                      4.645532
average_reward_test                  0.703727
round_time_test        0 days 00:00:10.328849
round_time_total       0 days 00:15:08.123528
loss_total                  942134008693653.5
loss_critic                1177667492600873.0
loss_actor                     -107267788.636
memory_size                            6159.0 

=== epoch 2/10 ===== round 25/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:07,  2.20it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:02<00:00,  2.22it/s]
episodes                                  827
episode_length                      12.079807
returns                              8.752541
return_std                           3.866715
average_reward                       0.724706
round_time             0 days 00:15:03.189531
episodes_test                           733.0
episode_length_test                 13.624829
returns_test                         9.524163
return_std_test                      4.202833
average_reward_test                  0.699386
round_time_test        0 days 00:00:10.054953
round_time_total       0 days 00:15:03.190634
loss_total                  903530596146348.0
loss_critic               1129413228795789.25
loss_actor                      -105236871.78
memory_size                            6159.0 

=== epoch 2/10 ===== round 26/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:26,  2.30it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:04<00:00,  2.21it/s]
episodes                                  786
episode_length                      12.704835
returns                              9.146521
return_std                           4.213701
average_reward                       0.719977
round_time             0 days 00:15:04.862595
episodes_test                           721.0
episode_length_test                 13.868239
returns_test                        10.102414
return_std_test                      5.292071
average_reward_test                  0.728475
round_time_test        0 days 00:00:09.998186
round_time_total       0 days 00:15:04.863678
loss_total                  876816444623421.5
loss_critic                1096020541522837.5
loss_actor                     -103814493.512
memory_size                            6159.0 

=== epoch 2/10 ===== round 27/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:05,  2.07it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:06<00:00,  2.21it/s]
episodes                                  755
episode_length                      13.222517
returns                               9.47291
return_std                           4.606083
average_reward                       0.716339
round_time             0 days 00:15:06.576173
episodes_test                           688.0
episode_length_test                 14.530523
returns_test                        10.785031
return_std_test                      6.401827
average_reward_test                  0.742285
round_time_test        0 days 00:00:10.188780
round_time_total       0 days 00:15:06.577301
loss_total                814255247210840.125
loss_critic               1017819046411763.75
loss_actor                       -99706072.16
memory_size                         6164.2395 

=== epoch 2/10 ===== round 28/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:20,  2.17it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:06<00:00,  2.21it/s]
episodes                                  751
episode_length                      13.299601
returns                              9.445124
return_std                           4.706671
average_reward                       0.709739
round_time             0 days 00:15:07.220129
episodes_test                           753.0
episode_length_test                   13.2749
returns_test                         9.503133
return_std_test                       4.17239
average_reward_test                  0.716019
round_time_test        0 days 00:00:10.184405
round_time_total       0 days 00:15:07.221236
loss_total                818269185829240.875
loss_critic                1022836469737193.5
loss_actor                     -100730873.092
memory_size                            6165.0 

=== epoch 2/10 ===== round 29/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:55,  1.86it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:03<00:00,  2.21it/s]
episodes                                  740
episode_length                      13.504054
returns                              9.655017
return_std                           4.751335
average_reward                        0.71498
round_time             0 days 00:15:03.856666
episodes_test                           747.0
episode_length_test                 13.376171
returns_test                         9.592549
return_std_test                      4.234784
average_reward_test                  0.717345
round_time_test        0 days 00:00:10.081786
round_time_total       0 days 00:15:03.857752
loss_total                 811548822701342.75
loss_critic                1014436017022697.5
loss_actor                      -101253617.52
memory_size                            6165.0 

=== epoch 2/10 ===== round 30/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:09,  2.20it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:05<00:00,  2.21it/s]
episodes                                  739
episode_length                      13.493911
returns                              9.695314
return_std                           4.888018
average_reward                       0.718898
round_time             0 days 00:15:06.124173
episodes_test                           817.0
episode_length_test                 12.235006
returns_test                         9.021851
return_std_test                      3.976581
average_reward_test                  0.737473
round_time_test        0 days 00:00:10.094899
round_time_total       0 days 00:15:06.125505
loss_total                 802434788198711.25
loss_critic               1003043473529503.75
loss_actor                     -100773198.104
memory_size                            6165.0 

=== epoch 2/10 ===== round 31/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:49,  2.10it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:05<00:00,  2.21it/s]
episodes                                  748
episode_length                      13.355615
returns                               9.68935
return_std                           4.967519
average_reward                       0.724975
round_time             0 days 00:15:05.721072
episodes_test                           767.0
episode_length_test                 13.028683
returns_test                         9.836771
return_std_test                      5.044523
average_reward_test                  0.755133
round_time_test        0 days 00:00:10.275235
round_time_total       0 days 00:15:05.722189
loss_total                  772357061399806.0
loss_critic               965446316136071.125
loss_actor                     -100152198.824
memory_size                            6165.0 

=== epoch 2/10 ===== round 32/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:13,  1.93it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:09<00:00,  2.20it/s]
episodes                                  760
episode_length                      13.140789
returns                              9.541259
return_std                           4.925207
average_reward                       0.725703
round_time             0 days 00:15:10.200074
episodes_test                           740.0
episode_length_test                 13.491892
returns_test                         10.35154
return_std_test                      6.199839
average_reward_test                   0.76745
round_time_test        0 days 00:00:10.009019
round_time_total       0 days 00:15:10.201364
loss_total                 779005834762911.75
loss_critic               973757284029038.625
loss_actor                     -100226790.012
memory_size                            6165.0 

=== epoch 2/10 ===== round 33/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:50,  2.24it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:02<00:00,  2.22it/s]
episodes                                  763
episode_length                      13.077326
returns                              9.727043
return_std                            5.16122
average_reward                       0.743579
round_time             0 days 00:15:03.003932
episodes_test                           821.0
episode_length_test                 12.175396
returns_test                         9.616686
return_std_test                      5.120335
average_reward_test                  0.789945
round_time_test        0 days 00:00:10.241484
round_time_total       0 days 00:15:03.005053
loss_total                  772019584126419.0
loss_critic               965024470555164.625
loss_actor                     -100088572.056
memory_size                         6165.1735 

=== epoch 2/10 ===== round 34/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:36,  2.28it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:07<00:00,  2.20it/s]
episodes                                  753
episode_length                      13.260292
returns                               9.98537
return_std                           5.635022
average_reward                       0.752931
round_time             0 days 00:15:08.207369
episodes_test                           727.0
episode_length_test                 13.749656
returns_test                        10.317865
return_std_test                      5.711443
average_reward_test                  0.750451
round_time_test        0 days 00:00:10.117289
round_time_total       0 days 00:15:08.208543
loss_total                  780916862752915.5
loss_critic                 976146067881984.0
loss_actor                     -100446919.556
memory_size                          6172.358 

=== epoch 2/10 ===== round 35/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:42,  2.12it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:07<00:00,  2.20it/s]
episodes                                  742
episode_length                      13.454178
returns                             10.188227
return_std                           6.074544
average_reward                       0.757524
round_time             0 days 00:15:07.829688
episodes_test                           793.0
episode_length_test                 12.591425
returns_test                         9.580709
return_std_test                       4.94356
average_reward_test                  0.760757
round_time_test        0 days 00:00:10.122856
round_time_total       0 days 00:15:07.830966
loss_total                771911296416219.125
loss_critic                964889110114205.75
loss_actor                     -100276396.032
memory_size                            6182.0 

=== epoch 2/10 ===== round 36/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:06,  2.07it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:07<00:00,  2.20it/s]
episodes                                  725
episode_length                      13.793103
returns                             10.797118
return_std                           7.892254
average_reward                       0.782791
round_time             0 days 00:15:07.808681
episodes_test                           731.0
episode_length_test                 13.671683
returns_test                        10.621847
return_std_test                      7.421492
average_reward_test                  0.777002
round_time_test        0 days 00:00:10.114150
round_time_total       0 days 00:15:07.809927
loss_total                797678744796921.875
loss_critic                997098418687967.25
loss_actor                       -101236817.3
memory_size                         6201.4425 

=== epoch 2/10 ===== round 37/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<15:16,  2.18it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:04<00:00,  2.21it/s]
episodes                                  700
episode_length                      14.285714
returns                             11.616637
return_std                          10.290392
average_reward                       0.813165
round_time             0 days 00:15:04.633605
episodes_test                           595.0
episode_length_test                 16.798319
returns_test                        16.558748
return_std_test                     23.540164
average_reward_test                  0.985744
round_time_test        0 days 00:00:10.229022
round_time_total       0 days 00:15:04.634871
loss_total                 812663252965130.25
loss_critic                1015829053778690.0
loss_actor                     -100098404.688
memory_size                         6313.9735 

=== epoch 2/10 ===== round 38/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:32,  2.01it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:04<00:00,  2.21it/s]
episodes                                  698
episode_length                      14.313754
returns                             11.817034
return_std                          10.723228
average_reward                        0.82528
round_time             0 days 00:15:04.722268
episodes_test                           766.0
episode_length_test                 13.044386
returns_test                        12.507243
return_std_test                     11.883965
average_reward_test                  0.958623
round_time_test        0 days 00:00:10.246819
round_time_total       0 days 00:15:04.723377
loss_total                  754026814485037.0
loss_critic                 942533508499243.0
loss_actor                      -96184204.448
memory_size                         6372.3045 

=== epoch 2/10 ===== round 39/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:55,  2.23it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:05<00:00,  2.21it/s]
episodes                                  713
episode_length                      14.009818
returns                             11.583184
return_std                          10.649745
average_reward                       0.826184
round_time             0 days 00:15:06.428167
episodes_test                           756.0
episode_length_test                 13.205026
returns_test                        10.769489
return_std_test                     11.440466
average_reward_test                  0.815543
round_time_test        0 days 00:00:10.108934
round_time_total       0 days 00:15:06.429467
loss_total                711529125344444.375
loss_critic               889411400449916.875
loss_actor                      -94775895.028
memory_size                           6391.07 

=== epoch 2/10 ===== round 40/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:02,  1.95it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:03<00:00,  2.21it/s]
episodes                                  721
episode_length                       13.84466
returns                             11.712427
return_std                          10.964505
average_reward                       0.845542
round_time             0 days 00:15:03.893921
episodes_test                           769.0
episode_length_test                 12.993498
returns_test                        11.074173
return_std_test                      9.992894
average_reward_test                  0.852106
round_time_test        0 days 00:00:10.148346
round_time_total       0 days 00:15:03.895073
loss_total                702898794764697.625
loss_critic               878623487386714.125
loss_actor                      -93557263.268
memory_size                         6408.4585 

=== epoch 2/10 ===== round 41/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:57,  2.09it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:03<00:00,  2.21it/s]
episodes                                  738
episode_length                      13.523035
returns                             11.295678
return_std                          10.297943
average_reward                       0.835764
round_time             0 days 00:15:04.208473
episodes_test                           797.0
episode_length_test                 12.537014
returns_test                        10.493604
return_std_test                      6.992564
average_reward_test                  0.836909
round_time_test        0 days 00:00:10.239126
round_time_total       0 days 00:15:04.209591
loss_total                666609715748274.125
loss_critic                 833262143137644.5
loss_actor                      -92644928.164
memory_size                          6428.685 

=== epoch 2/10 ===== round 42/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:50,  1.98it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:07<00:00,  2.20it/s]
episodes                                  765
episode_length                       13.05098
returns                             10.508161
return_std                           7.975543
average_reward                       0.805375
round_time             0 days 00:15:08.189537
episodes_test                           805.0
episode_length_test                 12.413665
returns_test                         9.360624
return_std_test                      4.711696
average_reward_test                  0.754036
round_time_test        0 days 00:00:10.256582
round_time_total       0 days 00:15:08.190754
loss_total                647142169387204.625
loss_critic               808927711853543.375
loss_actor                      -91791093.088
memory_size                         6457.7355 

=== epoch 2/10 ===== round 43/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:57,  1.96it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:10<00:00,  2.20it/s]
episodes                                  761
episode_length                      13.140604
returns                             10.298947
return_std                           7.337558
average_reward                        0.78375
round_time             0 days 00:15:11.091542
episodes_test                           783.0
episode_length_test                 12.763729
returns_test                         9.721287
return_std_test                      5.455033
average_reward_test                  0.761623
round_time_test        0 days 00:00:09.974499
round_time_total       0 days 00:15:11.092636
loss_total                 631364165474189.25
loss_critic               789205208046501.875
loss_actor                      -89927998.556
memory_size                            6473.0 

=== epoch 2/10 ===== round 44/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:46,  2.11it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:10<00:00,  2.20it/s]
episodes                                  751
episode_length                      13.300932
returns                             10.509275
return_std                           7.223874
average_reward                         0.7901
round_time             0 days 00:15:11.412537
episodes_test                           708.0
episode_length_test                 14.118644
returns_test                        11.399385
return_std_test                       7.96571
average_reward_test                  0.807465
round_time_test        0 days 00:00:09.936223
round_time_total       0 days 00:15:11.413622
loss_total                602746140655353.875
loss_critic               753432680862842.875
loss_actor                      -87882765.068
memory_size                            6473.0 

=== epoch 2/10 ===== round 45/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:34,  2.28it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:10<00:00,  2.20it/s]
episodes                                  747
episode_length                      13.360107
returns                             10.341703
return_std                           6.436111
average_reward                       0.774387
round_time             0 days 00:15:10.805685
episodes_test                           759.0
episode_length_test                 13.173913
returns_test                        10.090153
return_std_test                      5.599162
average_reward_test                  0.765945
round_time_test        0 days 00:00:10.173294
round_time_total       0 days 00:15:10.806808
loss_total                  596209960078016.5
loss_critic               745262455206182.875
loss_actor                       -88476584.24
memory_size                          6475.727 

=== epoch 2/10 ===== round 46/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:45,  1.99it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:10<00:00,  2.20it/s]
episodes                                  746
episode_length                      13.387399
returns                             10.236139
return_std                           5.595651
average_reward                       0.764866
round_time             0 days 00:15:11.139567
episodes_test                           738.0
episode_length_test                   13.5271
returns_test                        10.221915
return_std_test                      5.232596
average_reward_test                   0.75627
round_time_test        0 days 00:00:10.169238
round_time_total       0 days 00:15:11.140791
loss_total                571522495761350.625
loss_critic               714403127549231.125
loss_actor                      -87260250.176
memory_size                         6476.0385 

=== epoch 2/10 ===== round 47/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:45,  2.11it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:08<00:00,  2.20it/s]
episodes                                  740
episode_length                      13.509459
returns                             10.560645
return_std                           5.753804
average_reward                       0.781712
round_time             0 days 00:15:08.668237
episodes_test                           748.0
episode_length_test                 13.364973
returns_test                        10.742771
return_std_test                      6.205937
average_reward_test                  0.803867
round_time_test        0 days 00:00:10.047944
round_time_total       0 days 00:15:08.669584
loss_total                574709784238882.875
loss_critic               718387237846253.625
loss_actor                      -87360849.044
memory_size                          6479.123 

=== epoch 2/10 ===== round 48/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:39,  2.00it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:10<00:00,  2.20it/s]
episodes                                  716
episode_length                      13.941341
returns                             11.241262
return_std                           7.222018
average_reward                       0.805787
round_time             0 days 00:15:11.191956
episodes_test                           654.0
episode_length_test                 15.276758
returns_test                         13.11367
return_std_test                     10.871749
average_reward_test                  0.858499
round_time_test        0 days 00:00:10.126953
round_time_total       0 days 00:15:11.193241
loss_total                578624261757861.875
loss_critic                 723280334484930.5
loss_actor                      -87810719.612
memory_size                         6512.8415 

=== epoch 2/10 ===== round 49/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:25,  2.16it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:11<00:00,  2.19it/s]
episodes                                  666
episode_length                      14.977477
returns                             11.898247
return_std                           8.579769
average_reward                       0.793989
round_time             0 days 00:15:11.785792
episodes_test                           565.0
episode_length_test                 17.653097
returns_test                        13.887392
return_std_test                      10.97714
average_reward_test                  0.787545
round_time_test        0 days 00:00:09.946174
round_time_total       0 days 00:15:11.786983
loss_total                582932181198831.625
loss_critic               728665232653680.625
loss_actor                      -86246784.732
memory_size                         6577.8365 

=== epoch 2/10 ===== round 50/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:19,  1.92it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:12<00:00,  2.19it/s]
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
episodes                                  609
episode_length                      16.405583
returns                             13.424488
return_std                          10.623737
average_reward                       0.818196
round_time             0 days 00:15:12.615190
episodes_test                           427.0
episode_length_test                  23.35363
returns_test                        19.994356
return_std_test                     15.801693
average_reward_test                  0.858115
round_time_test        0 days 00:00:09.740394
round_time_total       0 days 00:15:12.616501
loss_total                 594301410292531.25
loss_critic                 742876766900584.5
loss_actor                       -85411668.62
memory_size                          6746.967 


<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
=== epoch 3/10 ===== round 1/50 ======================================
  0%|          | 4/2000 [00:01<15:25,  2.16it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:05<00:00,  2.21it/s]
episodes                                   85
episode_length                      23.423529
returns                             16.954978
return_std                          15.621298
average_reward                       0.724774
round_time             0 days 00:15:05.375797
episodes_test                           413.0
episode_length_test                 24.106538
returns_test                        18.838859
return_std_test                      14.86373
average_reward_test                  0.784391
round_time_test        0 days 00:00:09.636944
round_time_total       0 days 00:15:05.376992
loss_total                  603883563439358.0
loss_critic                 754854455094018.0
loss_actor                      -84283382.464
memory_size                          6913.006 

=== epoch 3/10 ===== round 2/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:54,  2.23it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:06<00:00,  2.21it/s]
episodes                                  207
episode_length                      19.285024
returns                             14.680464
return_std                          12.203145
average_reward                       0.760967
round_time             0 days 00:15:06.749305
episodes_test                           573.0
episode_length_test                  17.43281
returns_test                        15.193901
return_std_test                     12.295514
average_reward_test                  0.871496
round_time_test        0 days 00:00:09.974791
round_time_total       0 days 00:15:06.750473
loss_total                 575297516010995.75
loss_critic               719121891599581.125
loss_actor                      -82405257.604
memory_size                          7064.239 

=== epoch 3/10 ===== round 3/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:43,  2.12it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:06<00:00,  2.21it/s]
episodes                                  337
episode_length                       17.78635
returns                             13.934729
return_std                           10.92399
average_reward                       0.783611
round_time             0 days 00:15:06.928812
episodes_test                           653.0
episode_length_test                 15.300153
returns_test                        11.995043
return_std_test                      7.039281
average_reward_test                  0.784236
round_time_test        0 days 00:00:10.290536
round_time_total       0 days 00:15:06.929938
loss_total               548326368601964.5625
loss_critic               685407952080732.125
loss_actor                      -80515218.936
memory_size                         7077.7755 

=== epoch 3/10 ===== round 4/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:35,  2.28it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:05<00:00,  2.21it/s]
episodes                                  474
episode_length                      16.877637
returns                             13.358735
return_std                          10.040306
average_reward                       0.791505
round_time             0 days 00:15:05.646533
episodes_test                           595.0
episode_length_test                 16.796639
returns_test                        14.219471
return_std_test                      9.932563
average_reward_test                  0.846708
round_time_test        0 days 00:00:09.884628
round_time_total       0 days 00:15:05.647627
loss_total               528002404830937.0625
loss_critic                660002995206881.25
loss_actor                       -78924834.16
memory_size                          7082.179 

=== epoch 3/10 ===== round 5/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:30,  2.29it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:05<00:00,  2.21it/s]
episodes                                  616
episode_length                      16.224026
returns                             12.787338
return_std                           9.365473
average_reward                       0.788152
round_time             0 days 00:15:05.812300
episodes_test                           705.0
episode_length_test                  14.18156
returns_test                        11.541352
return_std_test                      6.641427
average_reward_test                  0.813863
round_time_test        0 days 00:00:09.992248
round_time_total       0 days 00:15:05.813456
loss_total               499363395204546.5625
loss_critic               624204234480418.875
loss_actor                      -78065110.212
memory_size                            7084.0 

=== epoch 3/10 ===== round 6/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:01,  1.95it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:08<00:00,  2.20it/s]
episodes                                  668
episode_length                      14.943114
returns                               11.8172
return_std                           7.378525
average_reward                       0.791646
round_time             0 days 00:15:09.205956
episodes_test                           713.0
episode_length_test                  14.01122
returns_test                        10.665186
return_std_test                      5.633873
average_reward_test                  0.761359
round_time_test        0 days 00:00:10.526638
round_time_total       0 days 00:15:09.207095
loss_total                 481584206091124.75
loss_critic               601980247272849.375
loss_actor                      -76809337.536
memory_size                            7084.0 

=== epoch 3/10 ===== round 7/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:45,  2.25it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:06<00:00,  2.21it/s]
episodes                                  689
episode_length                      14.507983
returns                             11.361305
return_std                           6.811737
average_reward                       0.783103
round_time             0 days 00:15:06.869250
episodes_test                           720.0
episode_length_test                 13.884722
returns_test                        10.774048
return_std_test                      5.572322
average_reward_test                  0.776033
round_time_test        0 days 00:00:10.187947
round_time_total       0 days 00:15:06.870367
loss_total               461367667186466.8125
loss_critic                 576709575118422.0
loss_actor                      -75671529.022
memory_size                            7084.0 

=== epoch 3/10 ===== round 8/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:50,  2.24it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:07<00:00,  2.20it/s]
episodes                                  678
episode_length                      14.719764
returns                               11.5244
return_std                           7.002218
average_reward                       0.783499
round_time             0 days 00:15:08.143300
episodes_test                           669.0
episode_length_test                 14.946188
returns_test                        11.470032
return_std_test                      6.278004
average_reward_test                  0.767442
round_time_test        0 days 00:00:10.104299
round_time_total       0 days 00:15:08.144385
loss_total                448200536278171.625
loss_critic              560250661006999.5625
loss_actor                       -74338613.05
memory_size                         7095.8525 

=== epoch 3/10 ===== round 9/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:39,  1.89it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:07<00:00,  2.20it/s]
episodes                                  662
episode_length                      15.075529
returns                             11.688749
return_std                           7.057583
average_reward                       0.775556
round_time             0 days 00:15:08.222710
episodes_test                           593.0
episode_length_test                 16.826307
returns_test                        14.234205
return_std_test                      9.469393
average_reward_test                  0.846792
round_time_test        0 days 00:00:10.148512
round_time_total       0 days 00:15:08.223809
loss_total                 434219044648779.75
loss_critic              542773798441582.5625
loss_actor                      -74144590.128
memory_size                         7130.2015 

=== epoch 3/10 ===== round 10/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:21,  2.32it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:04<00:00,  2.21it/s]
episodes                                  641
episode_length                      15.570983
returns                              12.22427
return_std                           7.549237
average_reward                       0.784487
round_time             0 days 00:15:05.446091
episodes_test                           618.0
episode_length_test                 16.177994
returns_test                        12.527854
return_std_test                      7.602165
average_reward_test                  0.774427
round_time_test        0 days 00:00:09.939815
round_time_total       0 days 00:15:05.447181
loss_total               440501351546355.6875
loss_critic               550626681002393.625
loss_actor                      -75377615.184
memory_size                         7134.8855 

=== epoch 3/10 ===== round 11/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:46,  2.11it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:07<00:00,  2.20it/s]
episodes                                  633
episode_length                       15.78673
returns                               12.5826
return_std                            7.78782
average_reward                       0.797023
round_time             0 days 00:15:08.010355
episodes_test                           619.0
episode_length_test                 16.132472
returns_test                        13.416457
return_std_test                      8.923477
average_reward_test                  0.831683
round_time_test        0 days 00:00:10.165356
round_time_total       0 days 00:15:08.011526
loss_total               448072620609372.1875
loss_critic                560090768056778.75
loss_actor                      -75823086.392
memory_size                          7136.059 

=== epoch 3/10 ===== round 12/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:29,  2.02it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:07<00:00,  2.20it/s]
episodes                                  625
episode_length                        15.9632
returns                             12.837028
return_std                           7.910789
average_reward                       0.803592
round_time             0 days 00:15:07.609341
episodes_test                           666.0
episode_length_test                 15.009009
returns_test                        12.078181
return_std_test                      7.449387
average_reward_test                  0.804784
round_time_test        0 days 00:00:09.924894
round_time_total       0 days 00:15:07.610443
loss_total                462650985823600.625
loss_critic                 578313723425325.0
loss_actor                       -77358962.14
memory_size                            7137.0 

=== epoch 3/10 ===== round 13/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:36,  2.13it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:06<00:00,  2.21it/s]
episodes                                  641
episode_length                      15.570983
returns                             12.347661
return_std                           7.297851
average_reward                        0.79259
round_time             0 days 00:15:07.351962
episodes_test                           700.0
episode_length_test                 14.274286
returns_test                        10.659025
return_std_test                      5.535887
average_reward_test                  0.746879
round_time_test        0 days 00:00:10.319597
round_time_total       0 days 00:15:07.353257
loss_total                461409287038566.375
loss_critic                 576761599864340.5
loss_actor                      -78068399.072
memory_size                            7137.0 

=== epoch 3/10 ===== round 14/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:00,  2.22it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:06<00:00,  2.21it/s]
episodes                                  651
episode_length                      15.328725
returns                             12.136709
return_std                            7.20517
average_reward                       0.791518
round_time             0 days 00:15:06.678392
episodes_test                           668.0
episode_length_test                  14.95509
returns_test                        11.606211
return_std_test                       6.19588
average_reward_test                  0.776256
round_time_test        0 days 00:00:10.207855
round_time_total       0 days 00:15:06.679636
loss_total               463645399014440.9375
loss_critic               579556739733520.375
loss_actor                       -78391632.84
memory_size                          7137.284 

=== epoch 3/10 ===== round 15/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:12,  2.19it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:06<00:00,  2.21it/s]
episodes                                  665
episode_length                      15.006015
returns                             11.812408
return_std                           6.768138
average_reward                       0.787273
round_time             0 days 00:15:06.598978
episodes_test                           655.0
episode_length_test                 15.259542
returns_test                        12.272965
return_std_test                      7.256532
average_reward_test                   0.80428
round_time_test        0 days 00:00:09.996375
round_time_total       0 days 00:15:06.600310
loss_total               481868750602108.9375
loss_critic                602335931113930.75
loss_actor                      -80299827.064
memory_size                            7138.0 

=== epoch 3/10 ===== round 16/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:46,  2.25it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:08<00:00,  2.20it/s]
episodes                                  675
episode_length                      14.808889
returns                             11.694106
return_std                           6.538282
average_reward                       0.789703
round_time             0 days 00:15:08.929521
episodes_test                           703.0
episode_length_test                 14.211949
returns_test                        10.947897
return_std_test                      5.946146
average_reward_test                  0.770525
round_time_test        0 days 00:00:10.014290
round_time_total       0 days 00:15:08.930764
loss_total                 499374381537951.75
loss_critic                 624217976781930.5
loss_actor                      -82436684.932
memory_size                            7138.0 

=== epoch 3/10 ===== round 17/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:01,  2.08it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:06<00:00,  2.21it/s]
episodes                                  678
episode_length                      14.725664
returns                             11.581582
return_std                           6.299206
average_reward                       0.786392
round_time             0 days 00:15:07.468398
episodes_test                           711.0
episode_length_test                 14.061885
returns_test                         10.68504
return_std_test                      5.167699
average_reward_test                  0.759908
round_time_test        0 days 00:00:09.999585
round_time_total       0 days 00:15:07.469485
loss_total                509687515393818.625
loss_critic               637109402163216.375
loss_actor                      -84061043.844
memory_size                            7138.0 

=== epoch 3/10 ===== round 18/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:10,  2.35it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:08<00:00,  2.20it/s]
episodes                                  690
episode_length                      14.468116
returns                             11.376489
return_std                           6.159888
average_reward                       0.786421
round_time             0 days 00:15:08.820338
episodes_test                           689.0
episode_length_test                 14.509434
returns_test                        11.404193
return_std_test                       6.49693
average_reward_test                  0.785999
round_time_test        0 days 00:00:10.068860
round_time_total       0 days 00:15:08.821415
loss_total               530783855246835.6875
loss_critic                 663479831714857.0
loss_actor                      -85819622.196
memory_size                           7144.75 

=== epoch 3/10 ===== round 19/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:16,  2.33it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:09<00:00,  2.20it/s]
episodes                                  683
episode_length                      14.609078
returns                             11.374164
return_std                           5.948432
average_reward                       0.778135
round_time             0 days 00:15:09.860133
episodes_test                           691.0
episode_length_test                  14.45152
returns_test                        11.233536
return_std_test                       5.77268
average_reward_test                   0.77743
round_time_test        0 days 00:00:10.013643
round_time_total       0 days 00:15:09.861234
loss_total                548320705695973.375
loss_critic                685400893117431.75
loss_actor                      -87168985.456
memory_size                          7148.825 

=== epoch 3/10 ===== round 20/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:18,  2.17it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:06<00:00,  2.21it/s]
episodes                                  675
episode_length                      14.805926
returns                             11.340768
return_std                           6.001376
average_reward                       0.765979
round_time             0 days 00:15:06.833943
episodes_test                           681.0
episode_length_test                 14.674009
returns_test                        10.977795
return_std_test                        6.2454
average_reward_test                  0.748265
round_time_test        0 days 00:00:10.209724
round_time_total       0 days 00:15:06.835040
loss_total                 565782431437684.75
loss_critic                707228049455710.25
loss_actor                       -89151051.96
memory_size                          7162.259 

=== epoch 3/10 ===== round 21/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:55,  1.97it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:08<00:00,  2.20it/s]
episodes                                  656
episode_length                       15.22561
returns                             11.614375
return_std                            6.68744
average_reward                       0.762923
round_time             0 days 00:15:09.225006
episodes_test                           627.0
episode_length_test                  15.91866
returns_test                        12.015116
return_std_test                      7.016034
average_reward_test                  0.754621
round_time_test        0 days 00:00:10.157275
round_time_total       0 days 00:15:09.226118
loss_total                 593342697918431.25
loss_critic                741678378733535.25
loss_actor                        -91058127.7
memory_size                          7171.585 

=== epoch 3/10 ===== round 22/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:50,  2.10it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:12<00:00,  2.19it/s]
episodes                                  654
episode_length                      15.276758
returns                              11.71728
return_std                           6.963556
average_reward                       0.766388
round_time             0 days 00:15:13.170103
episodes_test                           624.0
episode_length_test                 16.004808
returns_test                         12.02093
return_std_test                      7.122122
average_reward_test                  0.751408
round_time_test        0 days 00:00:09.990628
round_time_total       0 days 00:15:13.171189
loss_total                 621731490518007.75
loss_critic                777164365672480.75
loss_actor                       -92637428.34
memory_size                         7204.7255 

=== epoch 3/10 ===== round 23/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<18:03,  1.84it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:12<00:00,  2.19it/s]
episodes                                  644
episode_length                           15.5
returns                              11.99917
return_std                           7.135635
average_reward                       0.774036
round_time             0 days 00:15:13.248582
episodes_test                           660.0
episode_length_test                 15.142424
returns_test                        12.210388
return_std_test                      7.274979
average_reward_test                   0.80642
round_time_test        0 days 00:00:10.040520
round_time_total       0 days 00:15:13.249720
loss_total                 651383580672393.25
loss_critic                814229474898870.25
loss_actor                      -95278014.464
memory_size                         7226.7995 

=== epoch 3/10 ===== round 24/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:03,  2.07it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:10<00:00,  2.20it/s]
episodes                                  658
episode_length                      15.180851
returns                             11.826731
return_std                           7.142005
average_reward                       0.779134
round_time             0 days 00:15:10.756026
episodes_test                           633.0
episode_length_test                 15.797788
returns_test                        12.996498
return_std_test                      7.463733
average_reward_test                  0.822678
round_time_test        0 days 00:00:10.091320
round_time_total       0 days 00:15:10.757130
loss_total                698605576963227.625
loss_critic               873256965562695.625
loss_actor                      -98935009.696
memory_size                         7227.9615 

=== epoch 3/10 ===== round 25/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:39,  2.00it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:13<00:00,  2.19it/s]
episodes                                  667
episode_length                      14.976012
returns                             11.848967
return_std                           7.039706
average_reward                       0.791058
round_time             0 days 00:15:13.642597
episodes_test                           619.0
episode_length_test                 16.140549
returns_test                        12.399782
return_std_test                      7.171584
average_reward_test                  0.768263
round_time_test        0 days 00:00:09.847568
round_time_total       0 days 00:15:13.643713
loss_total                  741969416689811.5
loss_critic               927461761114701.875
loss_actor                     -101156008.032
memory_size                            7230.0 

=== epoch 3/10 ===== round 26/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:27,  2.15it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:10<00:00,  2.20it/s]
episodes                                  670
episode_length                      14.891045
returns                             11.657176
return_std                           6.528411
average_reward                       0.782889
round_time             0 days 00:15:10.536010
episodes_test                           595.0
episode_length_test                 16.783193
returns_test                        13.362614
return_std_test                      7.420576
average_reward_test                  0.796327
round_time_test        0 days 00:00:09.849763
round_time_total       0 days 00:15:10.537445
loss_total                  761674813482729.5
loss_critic               952093507240067.125
loss_actor                     -103131300.304
memory_size                         7234.2915 

=== epoch 3/10 ===== round 27/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:22,  2.17it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:09<00:00,  2.20it/s]
episodes                                  659
episode_length                      15.147193
returns                             11.852047
return_std                           6.558852
average_reward                       0.782883
round_time             0 days 00:15:09.636468
episodes_test                           626.0
episode_length_test                 15.945687
returns_test                        12.891502
return_std_test                      7.728108
average_reward_test                  0.808589
round_time_test        0 days 00:00:10.036984
round_time_total       0 days 00:15:09.637561
loss_total                785595087890415.625
loss_critic               981993849012355.125
loss_actor                      -105571564.88
memory_size                         7240.9775 

=== epoch 3/10 ===== round 28/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:15,  1.93it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:11<00:00,  2.19it/s]
episodes                                  661
episode_length                      15.093797
returns                             11.643185
return_std                           6.320579
average_reward                       0.771779
round_time             0 days 00:15:12.148007
episodes_test                           670.0
episode_length_test                  14.91194
returns_test                        11.913305
return_std_test                      7.596689
average_reward_test                  0.799091
round_time_test        0 days 00:00:10.012088
round_time_total       0 days 00:15:12.149105
loss_total                832143855011758.125
loss_critic              1040179805326147.625
loss_actor                     -109142295.692
memory_size                            7247.0 

=== epoch 3/10 ===== round 29/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:01,  2.08it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:11<00:00,  2.19it/s]
episodes                                  663
episode_length                      15.051282
returns                             11.968659
return_std                           6.754467
average_reward                       0.795219
round_time             0 days 00:15:12.388945
episodes_test                           699.0
episode_length_test                 14.306152
returns_test                        12.071022
return_std_test                      7.600144
average_reward_test                  0.843764
round_time_test        0 days 00:00:09.956966
round_time_total       0 days 00:15:12.390242
loss_total                882205411745202.125
loss_critic               1102756748952862.75
loss_actor                     -111167509.328
memory_size                         7252.4915 

=== epoch 3/10 ===== round 30/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:29,  2.30it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:13<00:00,  2.19it/s]
episodes                                  665
episode_length                      15.037594
returns                             12.008234
return_std                            6.65494
average_reward                       0.798548
round_time             0 days 00:15:13.837709
episodes_test                           699.0
episode_length_test                 14.294707
returns_test                        11.708507
return_std_test                      7.185721
average_reward_test                   0.81923
round_time_test        0 days 00:00:10.018649
round_time_total       0 days 00:15:13.838971
loss_total                 956717078574792.75
loss_critic                1195896328744337.5
loss_actor                      -115962908.08
memory_size                          7258.137 

=== epoch 3/10 ===== round 31/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:25,  1.91it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:11<00:00,  2.20it/s]
episodes                                  698
episode_length                      14.310888
returns                             11.601997
return_std                           6.616221
average_reward                       0.809921
round_time             0 days 00:15:11.685622
episodes_test                           758.0
episode_length_test                  13.16095
returns_test                        10.394435
return_std_test                       5.44182
average_reward_test                   0.78961
round_time_test        0 days 00:00:10.031800
round_time_total       0 days 00:15:11.686713
loss_total                 1008649466523156.5
loss_critic               1260811811632971.75
loss_actor                     -119666673.972
memory_size                         7268.6065 

=== epoch 3/10 ===== round 32/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:46,  2.25it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:15<00:00,  2.18it/s]
episodes                                  709
episode_length                      14.070522
returns                             11.312847
return_std                           6.275847
average_reward                       0.803209
round_time             0 days 00:15:16.207202
episodes_test                           731.0
episode_length_test                 13.671683
returns_test                        10.944995
return_std_test                      5.852955
average_reward_test                  0.800609
round_time_test        0 days 00:00:10.008160
round_time_total       0 days 00:15:16.208492
loss_total                 1079142855282262.0
loss_critic               1348928546541666.25
loss_actor                     -123720625.896
memory_size                          7276.446 

=== epoch 3/10 ===== round 33/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:33,  2.14it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:11<00:00,  2.19it/s]
episodes                                  724
episode_length                       13.79558
returns                             11.205659
return_std                            6.39395
average_reward                       0.812431
round_time             0 days 00:15:12.211391
episodes_test                           750.0
episode_length_test                 13.330667
returns_test                        10.492663
return_std_test                      5.298805
average_reward_test                  0.787146
round_time_test        0 days 00:00:10.254540
round_time_total       0 days 00:15:12.212626
loss_total                 1137156924152742.0
loss_critic                1421446131862208.5
loss_actor                     -127098509.892
memory_size                            7281.0 

=== epoch 3/10 ===== round 34/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:34,  2.28it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:13<00:00,  2.19it/s]
episodes                                  732
episode_length                      13.653005
returns                             10.893185
return_std                           5.940723
average_reward                       0.798012
round_time             0 days 00:15:13.671165
episodes_test                           723.0
episode_length_test                 13.827109
returns_test                         11.56303
return_std_test                      6.787059
average_reward_test                  0.836274
round_time_test        0 days 00:00:10.237147
round_time_total       0 days 00:15:13.672246
loss_total                 1204703101940924.5
loss_critic               1505878851861872.75
loss_actor                     -129909040.172
memory_size                            7281.0 

=== epoch 3/10 ===== round 35/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:18,  2.04it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:14<00:00,  2.19it/s]
episodes                                  742
episode_length                      13.469003
returns                             10.723213
return_std                           6.056927
average_reward                       0.796272
round_time             0 days 00:15:15.075217
episodes_test                           686.0
episode_length_test                 14.556851
returns_test                         11.71241
return_std_test                       7.03279
average_reward_test                  0.804672
round_time_test        0 days 00:00:10.261361
round_time_total       0 days 00:15:15.076319
loss_total                1229221373386162.25
loss_critic                1536526691923394.5
loss_actor                     -132508595.432
memory_size                            7281.0 

=== epoch 3/10 ===== round 36/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:12,  2.19it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:14<00:00,  2.19it/s]
episodes                                  723
episode_length                      13.809129
returns                             10.955567
return_std                           6.222469
average_reward                       0.793884
round_time             0 days 00:15:15.277802
episodes_test                           767.0
episode_length_test                 13.033898
returns_test                        10.333496
return_std_test                      5.583822
average_reward_test                  0.792854
round_time_test        0 days 00:00:10.036099
round_time_total       0 days 00:15:15.278879
loss_total                1284487661716766.75
loss_critic                1605609549685850.0
loss_actor                     -135970339.076
memory_size                           7282.34 

=== epoch 3/10 ===== round 37/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:25,  2.31it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:11<00:00,  2.19it/s]
episodes                                  723
episode_length                      13.828492
returns                             11.246451
return_std                           6.673623
average_reward                       0.813177
round_time             0 days 00:15:11.986119
episodes_test                           701.0
episode_length_test                 14.258203
returns_test                        11.918967
return_std_test                      6.730935
average_reward_test                  0.835976
round_time_test        0 days 00:00:10.152671
round_time_total       0 days 00:15:11.987448
loss_total                1379264001367605.25
loss_critic               1724079971808313.25
loss_actor                      -140438980.84
memory_size                            7286.0 

=== epoch 3/10 ===== round 38/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:31,  2.14it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:11<00:00,  2.19it/s]
episodes                                  721
episode_length                      13.861304
returns                             11.420353
return_std                            7.06015
average_reward                       0.824066
round_time             0 days 00:15:12.186479
episodes_test                           689.0
episode_length_test                 14.486212
returns_test                        11.817551
return_std_test                      6.674643
average_reward_test                  0.815616
round_time_test        0 days 00:00:10.147184
round_time_total       0 days 00:15:12.187575
loss_total                 1460542161035460.5
loss_critic               1825677668545200.25
loss_actor                     -145103553.996
memory_size                          7289.941 

=== epoch 3/10 ===== round 39/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:19,  1.92it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:13<00:00,  2.19it/s]
episodes                                  707
episode_length                      14.137199
returns                             11.660121
return_std                           7.331824
average_reward                       0.824849
round_time             0 days 00:15:13.826555
episodes_test                           670.0
episode_length_test                 14.916418
returns_test                        12.579043
return_std_test                       7.65326
average_reward_test                  0.843146
round_time_test        0 days 00:00:10.040176
round_time_total       0 days 00:15:13.827638
loss_total                 1573006595934126.0
loss_critic                1966258211346448.5
loss_actor                     -150045635.528
memory_size                          7299.383 

=== epoch 3/10 ===== round 40/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:42,  1.88it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:15<00:00,  2.18it/s]
episodes                                  696
episode_length                      14.340517
returns                             11.765352
return_std                           7.197914
average_reward                       0.820917
round_time             0 days 00:15:16.059704
episodes_test                           665.0
episode_length_test                  15.03609
returns_test                        12.550783
return_std_test                      7.688707
average_reward_test                  0.834723
round_time_test        0 days 00:00:09.911480
round_time_total       0 days 00:15:16.060815
loss_total                1661799639965237.25
loss_critic                2077249515613585.5
loss_actor                     -153731569.048
memory_size                          7309.453 

=== epoch 3/10 ===== round 41/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:47,  2.25it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:12<00:00,  2.19it/s]
episodes                                  696
episode_length                      14.350575
returns                              12.07053
return_std                           8.324843
average_reward                       0.841127
round_time             0 days 00:15:13.182319
episodes_test                           633.0
episode_length_test                 15.794629
returns_test                        13.814988
return_std_test                      9.246199
average_reward_test                  0.874674
round_time_test        0 days 00:00:10.053204
round_time_total       0 days 00:15:13.183436
loss_total                 1790709224695660.5
loss_critic               2238386494018420.75
loss_actor                      -157827934.64
memory_size                          7318.692 

=== epoch 3/10 ===== round 42/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:13,  2.34it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:14<00:00,  2.19it/s]
episodes                                  710
episode_length                      14.061972
returns                             11.732439
return_std                           8.015999
average_reward                       0.834859
round_time             0 days 00:15:15.501033
episodes_test                           697.0
episode_length_test                 14.344333
returns_test                         12.73896
return_std_test                      8.622989
average_reward_test                  0.888109
round_time_test        0 days 00:00:10.135567
round_time_total       0 days 00:15:15.502291
loss_total                 1879064481200341.0
loss_critic                2348830565160976.5
loss_actor                      -162993578.56
memory_size                            7342.0 

=== epoch 3/10 ===== round 43/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:53,  2.09it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:15<00:00,  2.18it/s]
episodes                                  698
episode_length                      14.296562
returns                             11.900469
return_std                           7.710011
average_reward                       0.832605
round_time             0 days 00:15:16.190914
episodes_test                           769.0
episode_length_test                 12.980494
returns_test                        10.667634
return_std_test                       5.80739
average_reward_test                  0.822564
round_time_test        0 days 00:00:10.213415
round_time_total       0 days 00:15:16.192013
loss_total                 2005778154949443.5
loss_critic                2507222651341111.5
loss_actor                       -169223876.8
memory_size                            7342.0 

=== epoch 3/10 ===== round 44/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:27,  2.02it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:10<00:00,  2.20it/s]
episodes                                  730
episode_length                      13.684932
returns                              11.34055
return_std                           7.196473
average_reward                       0.828716
round_time             0 days 00:15:11.117894
episodes_test                           727.0
episode_length_test                 13.715268
returns_test                        11.788239
return_std_test                      6.990255
average_reward_test                  0.860768
round_time_test        0 days 00:00:10.260097
round_time_total       0 days 00:15:11.118983
loss_total                 2169198436920852.5
loss_critic                2711498001389453.5
loss_actor                      -176178662.16
memory_size                            7342.0 

=== epoch 3/10 ===== round 45/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:46,  2.11it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:15<00:00,  2.18it/s]
episodes                                  758
episode_length                      13.168865
returns                             10.955516
return_std                           6.981976
average_reward                       0.831688
round_time             0 days 00:15:16.494259
episodes_test                           788.0
episode_length_test                 12.682741
returns_test                        10.299654
return_std_test                      5.686312
average_reward_test                  0.812079
round_time_test        0 days 00:00:10.307096
round_time_total       0 days 00:15:16.495353
loss_total                 2359487282005672.0
loss_critic                2949359049893740.5
loss_actor                     -183527996.168
memory_size                            7342.0 

=== epoch 3/10 ===== round 46/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:23,  2.16it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:18<00:00,  2.18it/s]
episodes                                  775
episode_length                      12.876129
returns                             10.401109
return_std                           5.259609
average_reward                       0.808143
round_time             0 days 00:15:18.714783
episodes_test                           818.0
episode_length_test                 12.207824
returns_test                         9.606994
return_std_test                      4.734793
average_reward_test                  0.787055
round_time_test        0 days 00:00:10.256457
round_time_total       0 days 00:15:18.716103
loss_total                 2570786295521476.5
loss_critic                3213482814766842.0
loss_actor                     -191122224.232
memory_size                         7345.6205 

=== epoch 3/10 ===== round 47/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:45,  2.11it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:13<00:00,  2.19it/s]
episodes                                  782
episode_length                      12.777494
returns                             10.312213
return_std                           5.161335
average_reward                       0.807128
round_time             0 days 00:15:14.469741
episodes_test                           774.0
episode_length_test                 12.914729
returns_test                        10.683757
return_std_test                      5.734699
average_reward_test                  0.827262
round_time_test        0 days 00:00:09.981391
round_time_total       0 days 00:15:14.470890
loss_total                 2758352540402712.5
loss_critic                3447940615373848.5
loss_actor                       -197385024.8
memory_size                            7355.0 

=== epoch 3/10 ===== round 48/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:26,  2.02it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:13<00:00,  2.19it/s]
episodes                                  784
episode_length                      12.725765
returns                             10.187197
return_std                           5.157551
average_reward                       0.801211
round_time             0 days 00:15:14.285638
episodes_test                           745.0
episode_length_test                 13.410738
returns_test                        10.781983
return_std_test                      5.556304
average_reward_test                  0.804168
round_time_test        0 days 00:00:10.129544
round_time_total       0 days 00:15:14.286715
loss_total                 2906895048614347.0
loss_critic                3633618748608348.0
loss_actor                     -201570769.488
memory_size                         7356.0255 

=== epoch 3/10 ===== round 49/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:35,  2.28it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:10<00:00,  2.20it/s]
episodes                                  778
episode_length                      12.838046
returns                             10.359575
return_std                           5.398334
average_reward                       0.807275
round_time             0 days 00:15:11.404826
episodes_test                           780.0
episode_length_test                 12.815385
returns_test                        10.547008
return_std_test                      5.328129
average_reward_test                   0.82307
round_time_test        0 days 00:00:10.268565
round_time_total       0 days 00:15:11.406074
loss_total                 3107770146672869.5
loss_critic                3884712617054306.5
loss_actor                     -208472012.216
memory_size                            7357.0 

=== epoch 3/10 ===== round 50/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:17,  1.92it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:17<00:00,  2.18it/s]
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
episodes                                  761
episode_length                      13.137976
returns                             10.735773
return_std                           5.788562
average_reward                       0.817003
round_time             0 days 00:15:18.189609
episodes_test                           702.0
episode_length_test                 14.242165
returns_test                        12.208592
return_std_test                      7.070637
average_reward_test                  0.857243
round_time_test        0 days 00:00:10.040194
round_time_total       0 days 00:15:18.190727
loss_total                 3282659060704346.0
loss_critic                4103323757832044.5
loss_actor                     -215198626.992
memory_size                            7357.0 


<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
=== epoch 4/10 ===== round 1/50 ======================================
  0%|          | 4/2000 [00:01<14:51,  2.24it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:59<00:00,  2.22it/s]
episodes                                  150
episode_length                           13.3
returns                             11.151379
return_std                           5.768504
average_reward                       0.838752
round_time             0 days 00:14:59.960009
episodes_test                           786.0
episode_length_test                 12.703562
returns_test                        10.667445
return_std_test                      5.805406
average_reward_test                  0.839629
round_time_test        0 days 00:00:10.230746
round_time_total       0 days 00:14:59.961127
loss_total                 3456710297132204.0
loss_critic                4320887797427732.5
loss_actor                     -222145176.344
memory_size                            7357.0 

=== epoch 4/10 ===== round 2/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:33,  2.29it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:04<00:00,  2.21it/s]
episodes                                  295
episode_length                      13.542373
returns                              11.02011
return_std                           5.998007
average_reward                       0.813941
round_time             0 days 00:15:05.053814
episodes_test                           742.0
episode_length_test                 13.469003
returns_test                        10.642927
return_std_test                      5.780208
average_reward_test                  0.790197
round_time_test        0 days 00:00:09.895165
round_time_total       0 days 00:15:05.054912
loss_total                 3646013145501139.0
loss_critic                4557516353090617.0
loss_actor                     -227290799.832
memory_size                          7363.492 

=== epoch 4/10 ===== round 3/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:21,  2.03it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:05<00:00,  2.21it/s]
episodes                                  442
episode_length                      13.540724
returns                             10.923143
return_std                           5.794743
average_reward                       0.806276
round_time             0 days 00:15:05.654639
episodes_test                           816.0
episode_length_test                 12.243873
returns_test                         9.885246
return_std_test                      5.370015
average_reward_test                  0.807501
round_time_test        0 days 00:00:10.340414
round_time_total       0 days 00:15:05.655781
loss_total                 3773696457442328.5
loss_critic                4717120492127912.0
loss_actor                     -230107964.456
memory_size                         7366.3675 

=== epoch 4/10 ===== round 4/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:21,  2.04it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:04<00:00,  2.21it/s]
episodes                                  585
episode_length                      13.651282
returns                             11.123028
return_std                           6.171625
average_reward                       0.814501
round_time             0 days 00:15:05.405483
episodes_test                           718.0
episode_length_test                 13.920613
returns_test                        11.337761
return_std_test                       6.76539
average_reward_test                  0.814519
round_time_test        0 days 00:00:10.250395
round_time_total       0 days 00:15:05.406572
loss_total                 3897063991293247.5
loss_critic                4871329908904690.0
loss_actor                     -234158908.912
memory_size                          7372.827 

=== epoch 4/10 ===== round 5/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:27,  2.30it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:06<00:00,  2.21it/s]
episodes                                  726
episode_length                       13.76584
returns                               11.2981
return_std                           6.383769
average_reward                       0.820792
round_time             0 days 00:15:07.242363
episodes_test                           717.0
episode_length_test                 13.942817
returns_test                        11.708971
return_std_test                      6.862902
average_reward_test                  0.839819
round_time_test        0 days 00:00:10.173288
round_time_total       0 days 00:15:07.243455
loss_total                 4114354770305614.0
loss_critic                5142943369181266.0
loss_actor                     -238330033.408
memory_size                         7381.7165 

=== epoch 4/10 ===== round 6/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:28,  1.91it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:04<00:00,  2.21it/s]
episodes                                  708
episode_length                      14.088983
returns                             11.613812
return_std                           6.974289
average_reward                       0.823706
round_time             0 days 00:15:05.295940
episodes_test                           654.0
episode_length_test                 15.262997
returns_test                        14.465405
return_std_test                     10.147677
average_reward_test                    0.9476
round_time_test        0 days 00:00:09.905263
round_time_total       0 days 00:15:05.297207
loss_total                 4235224527673491.5
loss_critic                5294030569548546.0
loss_actor                     -242891706.384
memory_size                         7390.1845 

=== epoch 4/10 ===== round 7/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<15:27,  2.15it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:07<00:00,  2.20it/s]
episodes                                  687
episode_length                      14.534207
returns                             12.160901
return_std                           7.259715
average_reward                       0.836462
round_time             0 days 00:15:07.999992
episodes_test                           674.0
episode_length_test                 14.832344
returns_test                        12.428545
return_std_test                      7.962018
average_reward_test                  0.837981
round_time_test        0 days 00:00:10.040488
round_time_total       0 days 00:15:08.001110
loss_total                 4358079717895569.5
loss_critic                5447599553551270.0
loss_actor                      -247796915.28
memory_size                           7393.22 

=== epoch 4/10 ===== round 8/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:49,  2.10it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:06<00:00,  2.21it/s]
episodes                                  667
episode_length                      14.935532
returns                             12.841153
return_std                           8.044024
average_reward                       0.859463
round_time             0 days 00:15:06.632296
episodes_test                           671.0
episode_length_test                 14.898659
returns_test                        13.313888
return_std_test                      9.069654
average_reward_test                  0.893682
round_time_test        0 days 00:00:10.059926
round_time_total       0 days 00:15:06.633579
loss_total                 4565623752267661.0
loss_critic                5707029597472686.0
loss_actor                     -253409667.144
memory_size                         7407.7585 

=== epoch 4/10 ===== round 9/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:23,  1.91it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:07<00:00,  2.20it/s]
episodes                                  662
episode_length                      15.067976
returns                             12.916102
return_std                            7.97447
average_reward                       0.857377
round_time             0 days 00:15:08.538629
episodes_test                           739.0
episode_length_test                 13.530447
returns_test                         11.12991
return_std_test                      6.336546
average_reward_test                  0.822601
round_time_test        0 days 00:00:10.129528
round_time_total       0 days 00:15:08.539726
loss_total                 4776077219363553.0
loss_critic                5970096420856791.0
loss_actor                     -258635359.312
memory_size                         7423.9545 

=== epoch 4/10 ===== round 10/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:45,  2.25it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:07<00:00,  2.20it/s]
episodes                                  666
episode_length                      14.945946
returns                             12.719392
return_std                           7.974539
average_reward                       0.851374
round_time             0 days 00:15:08.289995
episodes_test                           704.0
episode_length_test                 14.191761
returns_test                        11.761117
return_std_test                      6.982043
average_reward_test                  0.828834
round_time_test        0 days 00:00:10.137248
round_time_total       0 days 00:15:08.291109
loss_total                 5003005009420354.0
loss_critic                6253756156565520.0
loss_actor                     -264072567.232
memory_size                           7431.31 

=== epoch 4/10 ===== round 11/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:09,  2.06it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:10<00:00,  2.20it/s]
episodes                                  673
episode_length                      14.809807
returns                             12.551674
return_std                           7.656645
average_reward                       0.848109
round_time             0 days 00:15:10.779361
episodes_test                           679.0
episode_length_test                 14.706922
returns_test                        12.260019
return_std_test                      7.306633
average_reward_test                  0.834003
round_time_test        0 days 00:00:10.101451
round_time_total       0 days 00:15:10.780489
loss_total                 5223424634325565.0
loss_critic                6529280682512876.0
loss_actor                     -269413096.504
memory_size                            7442.0 

=== epoch 4/10 ===== round 12/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:38,  2.27it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:07<00:00,  2.20it/s]
episodes                                  680
episode_length                      14.673529
returns                             12.439719
return_std                            8.00469
average_reward                       0.847505
round_time             0 days 00:15:08.237284
episodes_test                           719.0
episode_length_test                 13.908206
returns_test                        11.724228
return_std_test                      6.954994
average_reward_test                  0.842972
round_time_test        0 days 00:00:09.922855
round_time_total       0 days 00:15:08.238382
loss_total                 5494266881751646.0
loss_critic                6867833486443545.0
loss_actor                     -276627500.344
memory_size                         7450.3265 

=== epoch 4/10 ===== round 13/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:08,  2.20it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:08<00:00,  2.20it/s]
episodes                                  704
episode_length                      14.177557
returns                             11.647712
return_std                            7.08681
average_reward                       0.821918
round_time             0 days 00:15:09.490224
episodes_test                           703.0
episode_length_test                 14.209104
returns_test                        11.993564
return_std_test                       7.69484
average_reward_test                  0.844099
round_time_test        0 days 00:00:10.101720
round_time_total       0 days 00:15:09.491329
loss_total                 5766927999307874.0
loss_critic                7208659877080596.0
loss_actor                       -282559420.6
memory_size                            7459.0 

=== epoch 4/10 ===== round 14/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:10,  2.06it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:11<00:00,  2.19it/s]
episodes                                  719
episode_length                      13.891516
returns                             11.242975
return_std                           7.012099
average_reward                       0.809307
round_time             0 days 00:15:11.891070
episodes_test                           769.0
episode_length_test                 13.002601
returns_test                        10.080113
return_std_test                      4.736029
average_reward_test                   0.77526
round_time_test        0 days 00:00:10.291034
round_time_total       0 days 00:15:11.892212
loss_total                 5902037613103022.0
loss_critic                7377546881204748.0
loss_actor                     -287431260.928
memory_size                          7459.876 

=== epoch 4/10 ===== round 15/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:10,  2.06it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:06<00:00,  2.21it/s]
episodes                                  727
episode_length                      13.742779
returns                              11.06163
return_std                           6.517264
average_reward                       0.804991
round_time             0 days 00:15:07.518772
episodes_test                           725.0
episode_length_test                 13.787586
returns_test                         10.74549
return_std_test                      5.588048
average_reward_test                  0.779421
round_time_test        0 days 00:00:10.238629
round_time_total       0 days 00:15:07.520087
loss_total                 6025763408698147.0
loss_critic                7532204131604234.0
loss_actor                     -291184836.976
memory_size                            7462.0 

=== epoch 4/10 ===== round 16/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:42,  2.12it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:07<00:00,  2.21it/s]
episodes                                  744
episode_length                      13.420699
returns                             10.746842
return_std                           6.375508
average_reward                       0.800864
round_time             0 days 00:15:07.578171
episodes_test                           724.0
episode_length_test                 13.790055
returns_test                        11.268338
return_std_test                      6.940748
average_reward_test                  0.817266
round_time_test        0 days 00:00:10.104247
round_time_total       0 days 00:15:07.579261
loss_total                 6362975672737989.0
loss_critic                7953719461201052.0
loss_actor                     -295354645.272
memory_size                          7463.691 

=== epoch 4/10 ===== round 17/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:03,  1.95it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:11<00:00,  2.19it/s]
episodes                                  762
episode_length                      13.102362
returns                             10.370285
return_std                           5.594967
average_reward                       0.791025
round_time             0 days 00:15:12.465216
episodes_test                           800.0
episode_length_test                    12.495
returns_test                         9.909706
return_std_test                      5.031252
average_reward_test                  0.793114
round_time_test        0 days 00:00:10.474987
round_time_total       0 days 00:15:12.466318
loss_total                 6530454513046782.0
loss_critic                8163068002997109.0
loss_actor                     -301381790.032
memory_size                         7469.7945 

=== epoch 4/10 ===== round 18/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:59,  2.22it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:07<00:00,  2.20it/s]
episodes                                  753
episode_length                      13.265604
returns                             10.628913
return_std                           6.100003
average_reward                       0.801328
round_time             0 days 00:15:07.658707
episodes_test                           728.0
episode_length_test                 13.728022
returns_test                        11.666827
return_std_test                      7.992542
average_reward_test                  0.849853
round_time_test        0 days 00:00:10.281349
round_time_total       0 days 00:15:07.660205
loss_total                 6851809466778649.0
loss_critic                8564761690430767.0
loss_actor                     -308200913.536
memory_size                         7476.5735 

=== epoch 4/10 ===== round 19/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:46,  1.98it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:07<00:00,  2.20it/s]
episodes                                  745
episode_length                      13.405369
returns                              10.82506
return_std                           6.370204
average_reward                       0.807535
round_time             0 days 00:15:08.622911
episodes_test                           698.0
episode_length_test                 14.316619
returns_test                        11.979118
return_std_test                      7.946459
average_reward_test                  0.836585
round_time_test        0 days 00:00:10.066526
round_time_total       0 days 00:15:08.624005
loss_total                 7127603024377151.0
loss_critic                8909503631758197.0
loss_actor                     -313826161.248
memory_size                            7479.0 

=== epoch 4/10 ===== round 20/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:10,  2.35it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:11<00:00,  2.19it/s]
episodes                                  745
episode_length                      13.412081
returns                             10.843212
return_std                           6.720376
average_reward                       0.808507
round_time             0 days 00:15:12.195658
episodes_test                           712.0
episode_length_test                 14.016854
returns_test                        11.730005
return_std_test                      7.930633
average_reward_test                  0.837904
round_time_test        0 days 00:00:09.970567
round_time_total       0 days 00:15:12.197110
loss_total                 7442997156878746.0
loss_critic                9303746294969270.0
loss_actor                     -319520244.608
memory_size                          7484.406 

=== epoch 4/10 ===== round 21/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:15,  1.93it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:08<00:00,  2.20it/s]
episodes                                  746
episode_length                      13.396783
returns                             10.816187
return_std                           6.694073
average_reward                       0.807393
round_time             0 days 00:15:09.354417
episodes_test                           758.0
episode_length_test                 13.176781
returns_test                        10.560116
return_std_test                      5.914765
average_reward_test                  0.801779
round_time_test        0 days 00:00:10.160750
round_time_total       0 days 00:15:09.355752
loss_total                 7631790203367064.0
loss_critic                9539737592442912.0
loss_actor                     -323624943.568
memory_size                         7502.6375 

=== epoch 4/10 ===== round 22/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:17,  1.93it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:09<00:00,  2.20it/s]
episodes                                  749
episode_length                      13.308411
returns                              11.00751
return_std                           7.780043
average_reward                        0.82721
round_time             0 days 00:15:10.546911
episodes_test                           804.0
episode_length_test                 12.426617
returns_test                        10.087567
return_std_test                      5.235653
average_reward_test                  0.811816
round_time_test        0 days 00:00:10.008520
round_time_total       0 days 00:15:10.548016
loss_total                 7935798737002037.0
loss_critic                9919748255661424.0
loss_actor                     -329517684.416
memory_size                         7528.2945 

=== epoch 4/10 ===== round 23/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:14,  2.18it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:08<00:00,  2.20it/s]
episodes                                  756
episode_length                      13.223545
returns                             11.063186
return_std                           7.783507
average_reward                       0.836483
round_time             0 days 00:15:09.111169
episodes_test                           789.0
episode_length_test                 12.667934
returns_test                        10.801464
return_std_test                      6.969302
average_reward_test                   0.85266
round_time_test        0 days 00:00:10.079834
round_time_total       0 days 00:15:09.112285
loss_total                 8057262682291569.0
loss_critic               10071578181569086.0
loss_actor                     -334303523.072
memory_size                          7543.658 

=== epoch 4/10 ===== round 24/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:03,  2.21it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:13<00:00,  2.19it/s]
episodes                                  742
episode_length                      13.460916
returns                             11.414149
return_std                           7.988574
average_reward                       0.848042
round_time             0 days 00:15:13.806354
episodes_test                           668.0
episode_length_test                 14.953593
returns_test                        12.678396
return_std_test                      7.912183
average_reward_test                  0.847891
round_time_test        0 days 00:00:10.023744
round_time_total       0 days 00:15:13.807452
loss_total                 8268710476527960.0
loss_critic               10335887920841360.0
loss_actor                     -336380626.976
memory_size                          7557.319 

=== epoch 4/10 ===== round 25/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:04,  2.21it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:10<00:00,  2.20it/s]
episodes                                  716
episode_length                      13.924581
returns                             11.895567
return_std                           8.228495
average_reward                       0.854699
round_time             0 days 00:15:10.839111
episodes_test                           752.0
episode_length_test                 13.276596
returns_test                        11.214817
return_std_test                      6.950971
average_reward_test                  0.845162
round_time_test        0 days 00:00:10.276937
round_time_total       0 days 00:15:10.840222
loss_total                 8358623959414997.0
loss_critic               10448279778644460.0
loss_actor                     -338379360.688
memory_size                         7566.2075 

=== epoch 4/10 ===== round 26/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:12,  2.05it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:12<00:00,  2.19it/s]
episodes                                  681
episode_length                      14.649046
returns                             12.557834
return_std                           8.913694
average_reward                       0.857365
round_time             0 days 00:15:12.557228
episodes_test                           685.0
episode_length_test                 14.578102
returns_test                        12.217466
return_std_test                      7.448042
average_reward_test                  0.837926
round_time_test        0 days 00:00:10.203111
round_time_total       0 days 00:15:12.558547
loss_total                 8642848710687982.0
loss_critic               10803560700119614.0
loss_actor                     -343339282.048
memory_size                         7591.5625 

=== epoch 4/10 ===== round 27/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:50,  1.86it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:13<00:00,  2.19it/s]
episodes                                  653
episode_length                      15.301685
returns                             12.899251
return_std                           8.284802
average_reward                       0.842874
round_time             0 days 00:15:14.470492
episodes_test                           626.0
episode_length_test                 15.974441
returns_test                        13.259835
return_std_test                      9.440345
average_reward_test                  0.830066
round_time_test        0 days 00:00:10.120707
round_time_total       0 days 00:15:14.471805
loss_total                 9015057507025944.0
loss_critic               11268821694602544.0
loss_actor                      -346829636.64
memory_size                         7632.6185 

=== epoch 4/10 ===== round 28/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:06,  2.20it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:12<00:00,  2.19it/s]
episodes                                  644
episode_length                       15.52795
returns                             12.723806
return_std                           8.060942
average_reward                       0.819413
round_time             0 days 00:15:13.445593
episodes_test                           712.0
episode_length_test                 14.032303
returns_test                        11.160544
return_std_test                      6.006315
average_reward_test                   0.79544
round_time_test        0 days 00:00:10.145056
round_time_total       0 days 00:15:13.446682
loss_total                 9233542518337962.0
loss_critic               11541927941764022.0
loss_actor                     -348499550.384
memory_size                         7655.8885 

=== epoch 4/10 ===== round 29/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:15,  2.18it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:14<00:00,  2.19it/s]
episodes                                  649
episode_length                      15.354391
returns                             12.448418
return_std                           7.641885
average_reward                       0.810595
round_time             0 days 00:15:15.511719
episodes_test                           683.0
episode_length_test                 14.628111
returns_test                         11.68945
return_std_test                      6.374749
average_reward_test                  0.799291
round_time_test        0 days 00:00:10.072509
round_time_total       0 days 00:15:15.512871
loss_total                 9392563284248364.0
loss_critic               11740703898581598.0
loss_actor                     -349150132.432
memory_size                           7658.63 

=== epoch 4/10 ===== round 30/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:06,  1.94it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:15<00:00,  2.19it/s]
episodes                                  669
episode_length                      14.928251
returns                             12.011052
return_std                           7.580078
average_reward                       0.804479
round_time             0 days 00:15:15.789010
episodes_test                           699.0
episode_length_test                  14.30329
returns_test                        11.529754
return_std_test                      6.759285
average_reward_test                  0.806128
round_time_test        0 days 00:00:10.147396
round_time_total       0 days 00:15:15.790243
loss_total                 9442211643082670.0
loss_critic               11802764352929398.0
loss_actor                      -352026327.28
memory_size                          7667.898 

=== epoch 4/10 ===== round 31/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:52,  2.10it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:16<00:00,  2.18it/s]
episodes                                  693
episode_length                      14.405483
returns                             11.653093
return_std                           7.402621
average_reward                        0.80883
round_time             0 days 00:15:17.217315
episodes_test                           744.0
episode_length_test                 13.428763
returns_test                        10.482353
return_std_test                      6.613779
average_reward_test                  0.780486
round_time_test        0 days 00:00:10.410661
round_time_total       0 days 00:15:17.218418
loss_total                 9656951978978182.0
loss_critic               12071189762464022.0
loss_actor                      -355713101.84
memory_size                           7686.58 

=== epoch 4/10 ===== round 32/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:57,  2.09it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:12<00:00,  2.19it/s]
episodes                                  721
episode_length                      13.848821
returns                             11.056223
return_std                           6.962351
average_reward                       0.798082
round_time             0 days 00:15:12.635427
episodes_test                           746.0
episode_length_test                 13.391421
returns_test                        10.981706
return_std_test                      6.133609
average_reward_test                   0.82004
round_time_test        0 days 00:00:10.032568
round_time_total       0 days 00:15:12.636504
loss_total                 9872827438222802.0
loss_critic               12341034089204154.0
loss_actor                     -361100624.784
memory_size                            7699.0 

=== epoch 4/10 ===== round 33/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:56,  1.96it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:13<00:00,  2.19it/s]
episodes                                  731
episode_length                      13.675787
returns                             10.980797
return_std                           6.897139
average_reward                       0.802953
round_time             0 days 00:15:14.351075
episodes_test                           813.0
episode_length_test                 12.281673
returns_test                         9.935416
return_std_test                      5.251491
average_reward_test                  0.808962
round_time_test        0 days 00:00:10.277573
round_time_total       0 days 00:15:14.352164
loss_total                10120985917142336.0
loss_critic               12651232167720910.0
loss_actor                      -366328385.36
memory_size                            7699.0 

=== epoch 4/10 ===== round 34/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:34,  2.28it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:14<00:00,  2.19it/s]
episodes                                  728
episode_length                      13.703297
returns                             11.018435
return_std                           7.496616
average_reward                       0.804016
round_time             0 days 00:15:15.445091
episodes_test                           750.0
episode_length_test                    13.328
returns_test                         10.74013
return_std_test                      6.652553
average_reward_test                  0.805887
round_time_test        0 days 00:00:09.920126
round_time_total       0 days 00:15:15.446308
loss_total                10248781175057286.0
loss_critic               12810976250550026.0
loss_actor                      -363321667.76
memory_size                         7705.2195 

=== epoch 4/10 ===== round 35/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:31,  2.01it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:16<00:00,  2.18it/s]
episodes                                  702
episode_length                      14.217949
returns                             11.361915
return_std                           7.921512
average_reward                       0.798523
round_time             0 days 00:15:17.251040
episodes_test                           591.0
episode_length_test                 16.905245
returns_test                        12.862068
return_std_test                      9.492354
average_reward_test                  0.760838
round_time_test        0 days 00:00:09.905747
round_time_total       0 days 00:15:17.252141
loss_total                 9882891709325508.0
loss_critic               12353614416036496.0
loss_actor                     -356686031.104
memory_size                         7748.6085 

=== epoch 4/10 ===== round 36/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:17,  2.18it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:14<00:00,  2.19it/s]
episodes                                  697
episode_length                      14.327116
returns                             11.441519
return_std                           7.853201
average_reward                       0.798518
round_time             0 days 00:15:15.359975
episodes_test                           579.0
episode_length_test                 17.226252
returns_test                        14.376919
return_std_test                     12.720137
average_reward_test                   0.83511
round_time_test        0 days 00:00:09.750047
round_time_total       0 days 00:15:15.361080
loss_total                10000922596658380.0
loss_critic               12501153023088656.0
loss_actor                     -356400667.616
memory_size                          7817.296 

=== epoch 4/10 ===== round 37/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:19,  2.04it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:14<00:00,  2.19it/s]
episodes                                  698
episode_length                      14.287966
returns                             11.458817
return_std                           7.811841
average_reward                       0.802738
round_time             0 days 00:15:14.943659
episodes_test                           651.0
episode_length_test                 15.325653
returns_test                        12.595809
return_std_test                      9.670106
average_reward_test                  0.821548
round_time_test        0 days 00:00:10.073072
round_time_total       0 days 00:15:14.944793
loss_total                10073430201397674.0
loss_critic               12591787535690104.0
loss_actor                     -358990634.816
memory_size                          7831.558 

=== epoch 4/10 ===== round 38/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:14,  1.93it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:07<00:00,  2.20it/s]
episodes                                  705
episode_length                      14.170213
returns                             11.437658
return_std                           7.942621
average_reward                       0.807036
round_time             0 days 00:15:07.744213
episodes_test                           734.0
episode_length_test                 13.613079
returns_test                        11.190096
return_std_test                      7.158008
average_reward_test                   0.82201
round_time_test        0 days 00:00:09.790476
round_time_total       0 days 00:15:07.745337
loss_total                10442410527727550.0
loss_critic               13053012920785436.0
loss_actor                     -363447223.056
memory_size                          7840.336 

=== epoch 4/10 ===== round 39/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:40,  1.88it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:08<00:00,  2.20it/s]
episodes                                  734
episode_length                      13.615804
returns                             10.969335
return_std                           7.163448
average_reward                       0.805391
round_time             0 days 00:15:08.879064
episodes_test                           767.0
episode_length_test                 13.022164
returns_test                        10.631022
return_std_test                      6.469185
average_reward_test                  0.816271
round_time_test        0 days 00:00:10.088314
round_time_total       0 days 00:15:08.880255
loss_total                10651830987073258.0
loss_critic               13314788510167728.0
loss_actor                      -370085619.44
memory_size                         7841.0785 

=== epoch 4/10 ===== round 40/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:24,  2.16it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:11<00:00,  2.19it/s]
episodes                                  765
episode_length                      13.065359
returns                             10.684732
return_std                           6.642262
average_reward                        0.81774
round_time             0 days 00:15:12.587939
episodes_test                           814.0
episode_length_test                 12.280098
returns_test                        10.070149
return_std_test                      5.497713
average_reward_test                  0.820129
round_time_test        0 days 00:00:10.178964
round_time_total       0 days 00:15:12.589040
loss_total                10966837717819720.0
loss_critic               13708546907897332.0
loss_actor                      -377651063.92
memory_size                          7843.518 

=== epoch 4/10 ===== round 41/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:07,  1.94it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:05<00:00,  2.21it/s]
episodes                                  768
episode_length                      13.015625
returns                             10.731562
return_std                           6.726341
average_reward                       0.824559
round_time             0 days 00:15:06.211617
episodes_test                           748.0
episode_length_test                 13.359626
returns_test                         11.27918
return_std_test                      8.934957
average_reward_test                  0.844334
round_time_test        0 days 00:00:10.184461
round_time_total       0 days 00:15:06.212920
loss_total                11372072949050770.0
loss_critic               14215090959988818.0
loss_actor                     -382763539.792
memory_size                         7861.9945 

=== epoch 4/10 ===== round 42/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:06,  2.36it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:08<00:00,  2.20it/s]
episodes                                  753
episode_length                       13.26162
returns                             10.944457
return_std                           7.182861
average_reward                       0.825723
round_time             0 days 00:15:08.951881
episodes_test                           699.0
episode_length_test                 14.281831
returns_test                        11.753231
return_std_test                      7.921607
average_reward_test                  0.822909
round_time_test        0 days 00:00:10.016565
round_time_total       0 days 00:15:08.953230
loss_total                11941901169116316.0
loss_critic               14927376214938092.0
loss_actor                     -387650700.896
memory_size                          7889.179 

=== epoch 4/10 ===== round 43/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:23,  2.16it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:10<00:00,  2.20it/s]
episodes                                  728
episode_length                      13.712912
returns                             11.408385
return_std                           7.920667
average_reward                       0.831785
round_time             0 days 00:15:11.264960
episodes_test                           696.0
episode_length_test                 14.363506
returns_test                        11.660729
return_std_test                      7.883655
average_reward_test                  0.811875
round_time_test        0 days 00:00:09.943520
round_time_total       0 days 00:15:11.266053
loss_total                12359938376080556.0
loss_critic               15449922712268440.0
loss_actor                     -392868275.536
memory_size                         7909.9905 

=== epoch 4/10 ===== round 44/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<15:09,  2.20it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:09<00:00,  2.20it/s]
episodes                                  680
episode_length                      14.652941
returns                             12.028983
return_std                           8.607975
average_reward                       0.820786
round_time             0 days 00:15:10.542195
episodes_test                           588.0
episode_length_test                 17.001701
returns_test                        13.632121
return_std_test                     10.832516
average_reward_test                  0.801844
round_time_test        0 days 00:00:09.814194
round_time_total       0 days 00:15:10.543284
loss_total                12577927886410874.0
loss_critic               15722409591859838.0
loss_actor                     -395320471.744
memory_size                         7972.9835 

=== epoch 4/10 ===== round 45/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:38,  2.13it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:13<00:00,  2.19it/s]
episodes                                  658
episode_length                      15.155015
returns                              12.55998
return_std                           9.223783
average_reward                       0.828888
round_time             0 days 00:15:13.724456
episodes_test                           645.0
episode_length_test                 15.466667
returns_test                        13.127505
return_std_test                     10.351207
average_reward_test                  0.847739
round_time_test        0 days 00:00:09.777670
round_time_total       0 days 00:15:13.725773
loss_total                12811244704796508.0
loss_critic               16014055620479026.0
loss_actor                     -393191508.336
memory_size                         8023.3635 

=== epoch 4/10 ===== round 46/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:27,  2.02it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:11<00:00,  2.19it/s]
episodes                                  638
episode_length                      15.639498
returns                             12.769272
return_std                            9.17889
average_reward                       0.816585
round_time             0 days 00:15:11.938035
episodes_test                           630.0
episode_length_test                 15.873016
returns_test                        12.839233
return_std_test                      7.849672
average_reward_test                  0.808872
round_time_test        0 days 00:00:09.849148
round_time_total       0 days 00:15:11.939206
loss_total                13088567006209246.0
loss_critic               16360708483621848.0
loss_actor                     -392677674.736
memory_size                         8049.9725 

=== epoch 4/10 ===== round 47/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:07,  2.06it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:04<00:00,  2.21it/s]
episodes                                  639
episode_length                      15.633803
returns                             12.807175
return_std                           8.755377
average_reward                       0.819254
round_time             0 days 00:15:05.119090
episodes_test                           600.0
episode_length_test                 16.623333
returns_test                        13.759224
return_std_test                     11.021647
average_reward_test                  0.828879
round_time_test        0 days 00:00:09.850620
round_time_total       0 days 00:15:05.120226
loss_total                13055035269084872.0
loss_critic               16318793816981110.0
loss_actor                     -390368119.424
memory_size                            8061.0 

=== epoch 4/10 ===== round 48/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:50,  2.24it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:25<00:00,  2.31it/s]
episodes                                  631
episode_length                      15.827258
returns                              12.85028
return_std                           8.308233
average_reward                       0.811704
round_time             0 days 00:14:26.152191
episodes_test                           664.0
episode_length_test                 15.057229
returns_test                        11.588706
return_std_test                      6.371907
average_reward_test                  0.769678
round_time_test        0 days 00:00:09.826837
round_time_total       0 days 00:14:26.153275
loss_total                12838222782462428.0
loss_critic               16047778203938324.0
loss_actor                     -389601061.888
memory_size                         8062.2595 

=== epoch 4/10 ===== round 49/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:42,  2.12it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:20<00:00,  2.32it/s]
episodes                                  648
episode_length                      15.408951
returns                             12.647354
return_std                           7.812835
average_reward                       0.820703
round_time             0 days 00:14:21.470782
episodes_test                           580.0
episode_length_test                 17.215517
returns_test                        14.208808
return_std_test                      9.003995
average_reward_test                  0.825732
round_time_test        0 days 00:00:09.713271
round_time_total       0 days 00:14:21.471860
loss_total                12937739593045770.0
loss_critic               16172174216295088.0
loss_actor                     -392625385.552
memory_size                         8072.0865 

=== epoch 4/10 ===== round 50/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:25,  2.31it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:25<00:00,  2.31it/s]
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
episodes                                  636
episode_length                      15.713836
returns                             12.756286
return_std                           7.852255
average_reward                       0.811515
round_time             0 days 00:14:25.883506
episodes_test                           623.0
episode_length_test                 16.036918
returns_test                        13.475329
return_std_test                      9.688569
average_reward_test                  0.840402
round_time_test        0 days 00:00:09.824162
round_time_total       0 days 00:14:25.884582
loss_total                13266100226176844.0
loss_critic               16582624999051886.0
loss_actor                     -394388796.832
memory_size                         8103.7995 


<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
=== epoch 5/10 ===== round 1/50 ======================================
  0%|          | 5/2000 [00:02<14:45,  2.25it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:15<00:00,  2.34it/s]
episodes                                  112
episode_length                      17.767857
returns                              16.26843
return_std                          12.502245
average_reward                       0.915571
round_time             0 days 00:14:15.884938
episodes_test                           596.0
episode_length_test                 16.768456
returns_test                        14.087864
return_std_test                     10.296357
average_reward_test                  0.840185
round_time_test        0 days 00:00:09.817454
round_time_total       0 days 00:14:15.886230
loss_total                13397858973193864.0
loss_critic               16747323426783364.0
loss_actor                     -393090290.896
memory_size                         8190.7895 

=== epoch 5/10 ===== round 2/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:17,  2.18it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  243
episode_length                      16.440329
returns                             14.485744
return_std                          10.792567
average_reward                       0.881198
round_time             0 days 00:14:18.457279
episodes_test                           663.0
episode_length_test                 15.072398
returns_test                        12.849397
return_std_test                      9.456012
average_reward_test                   0.85255
round_time_test        0 days 00:00:09.836276
round_time_total       0 days 00:14:18.458419
loss_total                13415483594025992.0
loss_critic               16769354208930430.0
loss_actor                       -392212969.6
memory_size                         8217.7435 

=== epoch 5/10 ===== round 3/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:03,  2.21it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  367
episode_length                      16.297003
returns                              14.13802
return_std                          10.474578
average_reward                       0.867291
round_time             0 days 00:14:18.105896
episodes_test                           613.0
episode_length_test                 16.303426
returns_test                        13.471582
return_std_test                      9.598582
average_reward_test                  0.826396
round_time_test        0 days 00:00:09.671555
round_time_total       0 days 00:14:18.107103
loss_total                13510428342934832.0
loss_critic               16888035142113690.0
loss_actor                     -392927847.136
memory_size                         8257.6505 

=== epoch 5/10 ===== round 4/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:08,  2.35it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  500
episode_length                          15.97
returns                             13.717269
return_std                          10.515279
average_reward                       0.859141
round_time             0 days 00:14:18.184974
episodes_test                           655.0
episode_length_test                 15.247328
returns_test                         12.61259
return_std_test                      9.093254
average_reward_test                  0.827273
round_time_test        0 days 00:00:09.630202
round_time_total       0 days 00:14:18.186061
loss_total                13518018465243332.0
loss_critic               16897522798690304.0
loss_actor                     -394161709.728
memory_size                          8289.362 

=== epoch 5/10 ===== round 5/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:06,  2.36it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:18<00:00,  2.33it/s]
episodes                                  608
episode_length                      16.393092
returns                             14.361469
return_std                          11.336326
average_reward                        0.87752
round_time             0 days 00:14:19.291656
episodes_test                           668.0
episode_length_test                 14.937126
returns_test                        13.032261
return_std_test                      9.359188
average_reward_test                  0.872489
round_time_test        0 days 00:00:09.675101
round_time_total       0 days 00:14:19.292751
loss_total                13717451504141468.0
loss_critic               17146814104225186.0
loss_actor                     -393773505.056
memory_size                         8348.9285 

=== epoch 5/10 ===== round 6/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:35,  2.28it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:21<00:00,  2.32it/s]
episodes                                  612
episode_length                      16.236928
returns                             14.105949
return_std                          11.481186
average_reward                       0.871201
round_time             0 days 00:14:21.963917
episodes_test                           548.0
episode_length_test                 18.248175
returns_test                         17.63667
return_std_test                     15.278714
average_reward_test                  0.966489
round_time_test        0 days 00:00:09.435427
round_time_total       0 days 00:14:21.965027
loss_total                14018794971646132.0
loss_critic               17523493414983696.0
loss_actor                     -392100381.216
memory_size                         8477.0225 

=== epoch 5/10 ===== round 7/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:22,  2.32it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:20<00:00,  2.32it/s]
episodes                                  610
episode_length                      16.345902
returns                             14.301859
return_std                          11.783903
average_reward                       0.874916
round_time             0 days 00:14:21.158384
episodes_test                           644.0
episode_length_test                 15.521739
returns_test                        13.764342
return_std_test                     11.070367
average_reward_test                  0.886791
round_time_test        0 days 00:00:10.077275
round_time_total       0 days 00:14:21.159754
loss_total                13907727397886624.0
loss_critic               17384658950669992.0
loss_actor                     -389937539.712
memory_size                           8520.83 

=== epoch 5/10 ===== round 8/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:26,  2.30it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:21<00:00,  2.32it/s]
episodes                                  616
episode_length                      16.207792
returns                             14.261016
return_std                          11.650784
average_reward                       0.880062
round_time             0 days 00:14:21.663708
episodes_test                           695.0
episode_length_test                 14.378417
returns_test                        11.995742
return_std_test                      8.456017
average_reward_test                  0.834387
round_time_test        0 days 00:00:09.840710
round_time_total       0 days 00:14:21.664796
loss_total                13611308230109036.0
loss_critic               17014134999135290.0
loss_actor                     -387311140.416
memory_size                         8557.2755 

=== epoch 5/10 ===== round 9/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:46,  2.25it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:23<00:00,  2.32it/s]
episodes                                  614
episode_length                      16.281759
returns                             14.478989
return_std                          11.330966
average_reward                       0.889375
round_time             0 days 00:14:24.432778
episodes_test                           695.0
episode_length_test                 14.379856
returns_test                        12.462391
return_std_test                     10.142439
average_reward_test                  0.866628
round_time_test        0 days 00:00:09.799196
round_time_total       0 days 00:14:24.433849
loss_total                13540680412698772.0
loss_critic               16925850216299496.0
loss_actor                     -385736282.576
memory_size                         8576.8245 

=== epoch 5/10 ===== round 10/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:24,  2.16it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:22<00:00,  2.32it/s]
episodes                                  651
episode_length                      15.353303
returns                             13.252115
return_std                           9.748916
average_reward                       0.863198
round_time             0 days 00:14:22.552762
episodes_test                           667.0
episode_length_test                 14.967016
returns_test                        12.368862
return_std_test                      7.256531
average_reward_test                  0.826272
round_time_test        0 days 00:00:09.742239
round_time_total       0 days 00:14:22.553833
loss_total                13507806068100562.0
loss_critic               16884757312462390.0
loss_actor                       -386734722.4
memory_size                           8583.26 

=== epoch 5/10 ===== round 11/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:40,  2.27it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:20<00:00,  2.32it/s]
episodes                                  687
episode_length                      14.540029
returns                             12.286546
return_std                           7.944254
average_reward                       0.845872
round_time             0 days 00:14:21.215863
episodes_test                           799.0
episode_length_test                  12.50438
returns_test                         9.712002
return_std_test                      4.843431
average_reward_test                  0.776895
round_time_test        0 days 00:00:10.370379
round_time_total       0 days 00:14:21.216962
loss_total                13145331501874806.0
loss_critic               16431664092399272.0
loss_actor                     -383590714.256
memory_size                            8585.0 

=== epoch 5/10 ===== round 12/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:44,  2.26it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:21<00:00,  2.32it/s]
episodes                                  711
episode_length                      14.054852
returns                             11.804167
return_std                           7.592775
average_reward                       0.839701
round_time             0 days 00:14:21.912297
episodes_test                           741.0
episode_length_test                 13.480432
returns_test                        10.619361
return_std_test                      5.714017
average_reward_test                  0.787675
round_time_test        0 days 00:00:09.787527
round_time_total       0 days 00:14:21.913414
loss_total                13023958820345348.0
loss_critic               16279948234917412.0
loss_actor                     -381750391.568
memory_size                         8589.1155 

=== epoch 5/10 ===== round 13/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:33,  2.29it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:22<00:00,  2.32it/s]
episodes                                  726
episode_length                      13.756198
returns                             11.433086
return_std                           7.329493
average_reward                       0.831061
round_time             0 days 00:14:23.498406
episodes_test                           686.0
episode_length_test                 14.571429
returns_test                         12.26129
return_std_test                      7.998821
average_reward_test                  0.841522
round_time_test        0 days 00:00:09.957312
round_time_total       0 days 00:14:23.499484
loss_total                13154201622953328.0
loss_critic               16442751747773956.0
loss_actor                     -380764969.152
memory_size                           8606.37 

=== epoch 5/10 ===== round 14/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:19,  2.32it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:20<00:00,  2.32it/s]
episodes                                  724
episode_length                      13.755525
returns                             11.302433
return_std                           7.183685
average_reward                       0.823647
round_time             0 days 00:14:21.009096
episodes_test                           709.0
episode_length_test                  14.09732
returns_test                        11.705019
return_std_test                      8.668101
average_reward_test                  0.830404
round_time_test        0 days 00:00:10.001856
round_time_total       0 days 00:14:21.010165
loss_total                13065483859632586.0
loss_critic               16331854547582452.0
loss_actor                       -376737384.8
memory_size                         8626.4585 

=== epoch 5/10 ===== round 15/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:07,  2.20it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:21<00:00,  2.32it/s]
episodes                                  716
episode_length                      13.955307
returns                             11.636769
return_std                           7.965891
average_reward                       0.833892
round_time             0 days 00:14:21.987241
episodes_test                           645.0
episode_length_test                 15.458915
returns_test                         13.28116
return_std_test                      9.234955
average_reward_test                  0.860616
round_time_test        0 days 00:00:10.066946
round_time_total       0 days 00:14:21.988342
loss_total                12952481293316128.0
loss_critic               16190601322507010.0
loss_actor                     -376324925.024
memory_size                          8663.174 

=== epoch 5/10 ===== round 16/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:43,  2.26it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:23<00:00,  2.32it/s]
episodes                                  688
episode_length                      14.498547
returns                             12.170667
return_std                           8.581712
average_reward                       0.838365
round_time             0 days 00:14:23.707487
episodes_test                           650.0
episode_length_test                 15.376923
returns_test                        12.542411
return_std_test                      8.119691
average_reward_test                  0.815668
round_time_test        0 days 00:00:09.703900
round_time_total       0 days 00:14:23.708711
loss_total                12669215660182602.0
loss_critic               15836519311624634.0
loss_actor                     -374327286.752
memory_size                         8693.5215 

=== epoch 5/10 ===== round 17/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:31,  2.29it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:24<00:00,  2.31it/s]
episodes                                  667
episode_length                      14.977511
returns                             12.455179
return_std                           8.427819
average_reward                       0.831352
round_time             0 days 00:14:25.478775
episodes_test                           700.0
episode_length_test                 14.271429
returns_test                        11.660365
return_std_test                      6.635869
average_reward_test                  0.817431
round_time_test        0 days 00:00:09.889105
round_time_total       0 days 00:14:25.479940
loss_total                12404847510026190.0
loss_critic               15506059126949020.0
loss_actor                     -372515097.712
memory_size                         8699.0245 

=== epoch 5/10 ===== round 18/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:37,  2.28it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:22<00:00,  2.32it/s]
episodes                                  644
episode_length                      15.512422
returns                              12.78384
return_std                           8.449981
average_reward                        0.82421
round_time             0 days 00:14:23.239775
episodes_test                           689.0
episode_length_test                 14.499274
returns_test                        11.727357
return_std_test                      7.548885
average_reward_test                  0.808729
round_time_test        0 days 00:00:09.918899
round_time_total       0 days 00:14:23.241059
loss_total                12408647074319434.0
loss_critic               15510808584999928.0
loss_actor                      -372954654.08
memory_size                           8710.14 

=== epoch 5/10 ===== round 19/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:39,  2.27it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:22<00:00,  2.32it/s]
episodes                                  636
episode_length                      15.672956
returns                                12.774
return_std                           8.033633
average_reward                       0.816447
round_time             0 days 00:14:23.084588
episodes_test                           619.0
episode_length_test                  16.14378
returns_test                        13.168555
return_std_test                      8.948203
average_reward_test                  0.815706
round_time_test        0 days 00:00:09.666199
round_time_total       0 days 00:14:23.085670
loss_total                12263339385889488.0
loss_critic               15329173973522972.0
loss_actor                     -369664729.728
memory_size                          8743.908 

=== epoch 5/10 ===== round 20/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:15,  2.18it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:20<00:00,  2.32it/s]
episodes                                  626
episode_length                      15.958466
returns                              12.90336
return_std                           8.196722
average_reward                       0.809104
round_time             0 days 00:14:20.993991
episodes_test                           611.0
episode_length_test                 16.346972
returns_test                        13.965279
return_std_test                      8.789345
average_reward_test                  0.854589
round_time_test        0 days 00:00:09.773550
round_time_total       0 days 00:14:20.995287
loss_total                12082585820112880.0
loss_critic               15103232011537482.0
loss_actor                      -365039328.24
memory_size                          8773.819 

=== epoch 5/10 ===== round 21/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:23,  2.16it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:19<00:00,  2.33it/s]
episodes                                  625
episode_length                        15.9312
returns                             13.204974
return_std                           8.446587
average_reward                       0.829912
round_time             0 days 00:14:20.042994
episodes_test                           602.0
episode_length_test                  16.60299
returns_test                        14.498776
return_std_test                      9.545565
average_reward_test                  0.873296
round_time_test        0 days 00:00:09.877391
round_time_total       0 days 00:14:20.044290
loss_total                12010083641662112.0
loss_critic               15012604279481434.0
loss_actor                     -363111177.056
memory_size                           8778.33 

=== epoch 5/10 ===== round 22/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:24,  2.31it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:22<00:00,  2.32it/s]
episodes                                  630
episode_length                      15.844444
returns                             13.444438
return_std                           8.745923
average_reward                        0.84852
round_time             0 days 00:14:22.987477
episodes_test                           676.0
episode_length_test                 14.778107
returns_test                        12.872335
return_std_test                      7.928941
average_reward_test                  0.871026
round_time_test        0 days 00:00:09.817359
round_time_total       0 days 00:14:22.988550
loss_total                11851908452135732.0
loss_critic               14814885300559414.0
loss_actor                     -363185355.488
memory_size                          8789.144 

=== epoch 5/10 ===== round 23/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:21,  2.32it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:22<00:00,  2.32it/s]
episodes                                  625
episode_length                        15.9216
returns                             13.647911
return_std                           8.921852
average_reward                       0.857188
round_time             0 days 00:14:22.869333
episodes_test                           609.0
episode_length_test                 16.387521
returns_test                        14.613434
return_std_test                      9.430447
average_reward_test                  0.891264
round_time_test        0 days 00:00:09.760328
round_time_total       0 days 00:14:22.870430
loss_total                11675029649355702.0
loss_critic               14593786810506150.0
loss_actor                      -363631128.48
memory_size                         8798.6355 

=== epoch 5/10 ===== round 24/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:43,  2.42it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:22<00:00,  2.32it/s]
episodes                                  633
episode_length                      15.778831
returns                             13.523854
return_std                           8.669477
average_reward                       0.857262
round_time             0 days 00:14:22.661352
episodes_test                           609.0
episode_length_test                 16.394089
returns_test                        12.970867
return_std_test                      7.610013
average_reward_test                  0.791093
round_time_test        0 days 00:00:09.989748
round_time_total       0 days 00:14:22.662418
loss_total                11587995027346818.0
loss_critic               14484993526082830.0
loss_actor                     -362199130.144
memory_size                           8839.66 

=== epoch 5/10 ===== round 25/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:14,  2.05it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:23<00:00,  2.32it/s]
episodes                                  631
episode_length                      15.812995
returns                             13.765431
return_std                           8.757223
average_reward                       0.870653
round_time             0 days 00:14:23.715052
episodes_test                           650.0
episode_length_test                 15.370769
returns_test                        12.339319
return_std_test                      6.673602
average_reward_test                  0.802986
round_time_test        0 days 00:00:09.766062
round_time_total       0 days 00:14:23.716121
loss_total                11726083547109262.0
loss_critic               14657604188737896.0
loss_actor                     -361947317.808
memory_size                          8858.701 

=== epoch 5/10 ===== round 26/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:42,  2.26it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:22<00:00,  2.32it/s]
episodes                                  634
episode_length                      15.752366
returns                             13.589148
return_std                           8.850733
average_reward                       0.862932
round_time             0 days 00:14:22.636108
episodes_test                           621.0
episode_length_test                 16.086957
returns_test                        13.597502
return_std_test                       8.62068
average_reward_test                  0.845366
round_time_test        0 days 00:00:09.729011
round_time_total       0 days 00:14:22.637446
loss_total                11931189571280176.0
loss_critic               14913986715059224.0
loss_actor                      -361387952.96
memory_size                          8882.189 

=== epoch 5/10 ===== round 27/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:13,  2.19it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:24<00:00,  2.31it/s]
episodes                                  652
episode_length                      15.319018
returns                               12.9534
return_std                           8.304198
average_reward                       0.845509
round_time             0 days 00:14:24.884953
episodes_test                           648.0
episode_length_test                 15.404321
returns_test                        13.428409
return_std_test                      8.774588
average_reward_test                  0.871731
round_time_test        0 days 00:00:09.747185
round_time_total       0 days 00:14:24.886037
loss_total                11548053494720102.0
loss_critic               14435066628016178.0
loss_actor                     -360619362.336
memory_size                            8900.0 

=== epoch 5/10 ===== round 28/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:34,  2.01it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:24<00:00,  2.31it/s]
episodes                                  664
episode_length                      15.046687
returns                             12.696444
return_std                           7.862724
average_reward                       0.843791
round_time             0 days 00:14:25.481688
episodes_test                           765.0
episode_length_test                 13.070588
returns_test                        10.795058
return_std_test                      5.857829
average_reward_test                  0.825922
round_time_test        0 days 00:00:09.825426
round_time_total       0 days 00:14:25.482770
loss_total                11534524283581628.0
loss_critic               14418155111073186.0
loss_actor                     -360290514.432
memory_size                         8904.3515 

=== epoch 5/10 ===== round 29/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:35,  2.28it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:22<00:00,  2.32it/s]
episodes                                  692
episode_length                      14.433526
returns                             12.131765
return_std                           7.519075
average_reward                        0.84053
round_time             0 days 00:14:23.259130
episodes_test                           789.0
episode_length_test                 12.670469
returns_test                        10.028877
return_std_test                      4.588905
average_reward_test                  0.791538
round_time_test        0 days 00:00:09.830699
round_time_total       0 days 00:14:23.260216
loss_total                11180417288337620.0
loss_critic               13975521366883958.0
loss_actor                     -358392024.192
memory_size                            8910.0 

=== epoch 5/10 ===== round 30/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:35,  2.28it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:22<00:00,  2.32it/s]
episodes                                  733
episode_length                      13.598909
returns                             11.072615
return_std                           6.370427
average_reward                       0.812853
round_time             0 days 00:14:23.444428
episodes_test                           800.0
episode_length_test                   12.4975
returns_test                         9.962384
return_std_test                      4.611155
average_reward_test                  0.797195
round_time_test        0 days 00:00:09.919127
round_time_total       0 days 00:14:23.445509
loss_total                10994930422445506.0
loss_critic               13743662792974532.0
loss_actor                     -354589662.288
memory_size                            8910.0 

=== epoch 5/10 ===== round 31/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:22,  2.16it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:22<00:00,  2.32it/s]
episodes                                  775
episode_length                      12.882581
returns                             10.231277
return_std                           4.727919
average_reward                       0.793962
round_time             0 days 00:14:23.172326
episodes_test                           846.0
episode_length_test                 11.809693
returns_test                         9.254937
return_std_test                       3.95698
average_reward_test                    0.7836
round_time_test        0 days 00:00:09.945881
round_time_total       0 days 00:14:23.173623
loss_total                11017113491784860.0
loss_critic               13771391622870728.0
loss_actor                     -354791373.264
memory_size                            8910.0 

=== epoch 5/10 ===== round 32/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:16,  2.18it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:24<00:00,  2.31it/s]
episodes                                  773
episode_length                      12.891332
returns                             10.066479
return_std                           4.689911
average_reward                       0.781434
round_time             0 days 00:14:24.636159
episodes_test                           852.0
episode_length_test                 11.733568
returns_test                         8.934542
return_std_test                       3.36948
average_reward_test                  0.761499
round_time_test        0 days 00:00:10.021604
round_time_total       0 days 00:14:24.637236
loss_total                10915103624753316.0
loss_critic               13643879306798040.0
loss_actor                     -355314680.688
memory_size                          8911.211 

=== epoch 5/10 ===== round 33/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:43,  2.42it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:21<00:00,  2.32it/s]
episodes                                  803
episode_length                      12.438356
returns                              9.547801
return_std                           3.839133
average_reward                       0.767523
round_time             0 days 00:14:22.359948
episodes_test                           796.0
episode_length_test                 12.537688
returns_test                         9.587881
return_std_test                       4.27628
average_reward_test                  0.764293
round_time_test        0 days 00:00:09.916458
round_time_total       0 days 00:14:22.361021
loss_total                10866435435840668.0
loss_critic               13583044045155860.0
loss_actor                     -355640555.392
memory_size                            8919.0 

=== epoch 5/10 ===== round 34/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:43,  2.26it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:25<00:00,  2.31it/s]
episodes                                  804
episode_length                      12.420398
returns                               9.46241
return_std                            3.75814
average_reward                       0.761751
round_time             0 days 00:14:25.823886
episodes_test                           757.0
episode_length_test                 13.202114
returns_test                         9.995439
return_std_test                      5.151995
average_reward_test                  0.757281
round_time_test        0 days 00:00:09.898267
round_time_total       0 days 00:14:25.825130
loss_total                10842529668809098.0
loss_critic               13553161858243888.0
loss_actor                     -355266218.256
memory_size                            8919.0 

=== epoch 5/10 ===== round 35/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:59,  2.38it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:23<00:00,  2.32it/s]
episodes                                  803
episode_length                      12.444583
returns                              9.502328
return_std                           3.873378
average_reward                       0.763592
round_time             0 days 00:14:24.014245
episodes_test                           751.0
episode_length_test                 13.304927
returns_test                        10.155543
return_std_test                      4.944503
average_reward_test                  0.763361
round_time_test        0 days 00:00:09.853240
round_time_total       0 days 00:14:24.015463
loss_total                10892900821784068.0
loss_critic               13616125779766150.0
loss_actor                     -356482885.056
memory_size                         8919.6975 

=== epoch 5/10 ===== round 36/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:23,  2.31it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:25<00:00,  2.31it/s]
episodes                                  785
episode_length                      12.724841
returns                              9.713254
return_std                            4.64084
average_reward                       0.763401
round_time             0 days 00:14:25.656923
episodes_test                           765.0
episode_length_test                 13.071895
returns_test                         9.812942
return_std_test                      4.829191
average_reward_test                   0.75069
round_time_test        0 days 00:00:09.794922
round_time_total       0 days 00:14:25.658126
loss_total                10971134261637152.0
loss_critic               13713917591091676.0
loss_actor                     -358293890.304
memory_size                          8922.673 

=== epoch 5/10 ===== round 37/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:09,  2.20it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:22<00:00,  2.32it/s]
episodes                                  774
episode_length                      12.909561
returns                             10.085348
return_std                           5.392144
average_reward                       0.781288
round_time             0 days 00:14:23.126693
episodes_test                           762.0
episode_length_test                 13.119423
returns_test                        10.661606
return_std_test                      5.499518
average_reward_test                  0.812687
round_time_test        0 days 00:00:09.990351
round_time_total       0 days 00:14:23.127776
loss_total                11084353081972884.0
loss_critic               13855441115638924.0
loss_actor                     -360795031.888
memory_size                         8936.9425 

=== epoch 5/10 ===== round 38/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:49,  2.41it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:24<00:00,  2.31it/s]
episodes                                  776
episode_length                      12.868557
returns                                10.295
return_std                           5.607572
average_reward                       0.799877
round_time             0 days 00:14:25.414758
episodes_test                           793.0
episode_length_test                 12.591425
returns_test                        10.315829
return_std_test                      5.329449
average_reward_test                  0.819516
round_time_test        0 days 00:00:09.985084
round_time_total       0 days 00:14:25.415818
loss_total                11329412377453002.0
loss_critic               14161765229620364.0
loss_actor                     -365035274.096
memory_size                            8952.0 

=== epoch 5/10 ===== round 39/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:02,  2.37it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:24<00:00,  2.31it/s]
episodes                                  769
episode_length                        12.9987
returns                             10.679385
return_std                           6.886301
average_reward                       0.821644
round_time             0 days 00:14:25.358737
episodes_test                           667.0
episode_length_test                 14.988006
returns_test                        13.828965
return_std_test                     12.434833
average_reward_test                   0.92266
round_time_test        0 days 00:00:09.954446
round_time_total       0 days 00:14:25.360012
loss_total                11592445746799968.0
loss_critic               14490556935734034.0
loss_actor                     -366722690.496
memory_size                          8962.884 

=== epoch 5/10 ===== round 40/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:18,  2.32it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:24<00:00,  2.31it/s]
episodes                                  750
episode_length                      13.318667
returns                             11.107636
return_std                           7.171316
average_reward                       0.833871
round_time             0 days 00:14:25.063967
episodes_test                           740.0
episode_length_test                 13.494595
returns_test                        11.726523
return_std_test                      7.318414
average_reward_test                   0.86947
round_time_test        0 days 00:00:09.894926
round_time_total       0 days 00:14:25.065024
loss_total                11731348578671526.0
loss_critic               14664185477989400.0
loss_actor                     -368321612.976
memory_size                          8991.233 

=== epoch 5/10 ===== round 41/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<15:00,  2.22it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:21<00:00,  2.32it/s]
episodes                                  750
episode_length                      13.330667
returns                             11.231417
return_std                           6.866661
average_reward                       0.842506
round_time             0 days 00:14:22.157076
episodes_test                           734.0
episode_length_test                 13.613079
returns_test                        11.538611
return_std_test                       7.73302
average_reward_test                  0.847698
round_time_test        0 days 00:00:09.848785
round_time_total       0 days 00:14:22.158187
loss_total                11851358311653834.0
loss_critic               14814197628513812.0
loss_actor                     -371525828.096
memory_size                            8993.0 

=== epoch 5/10 ===== round 42/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:58,  2.22it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:24<00:00,  2.31it/s]
episodes                                  777
episode_length                      12.824968
returns                             10.741007
return_std                           6.154599
average_reward                       0.838353
round_time             0 days 00:14:25.409215
episodes_test                           797.0
episode_length_test                 12.547051
returns_test                        10.205042
return_std_test                      4.754455
average_reward_test                  0.813342
round_time_test        0 days 00:00:10.024831
round_time_total       0 days 00:14:25.410292
loss_total                11859953374436786.0
loss_critic               14824941463434952.0
loss_actor                     -373723607.008
memory_size                            8993.0 

=== epoch 5/10 ===== round 43/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:27,  2.30it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:26<00:00,  2.31it/s]
episodes                                  784
episode_length                      12.709184
returns                             10.606809
return_std                            5.98525
average_reward                       0.835939
round_time             0 days 00:14:27.277532
episodes_test                           804.0
episode_length_test                  12.43408
returns_test                        10.209053
return_std_test                      4.874639
average_reward_test                  0.821107
round_time_test        0 days 00:00:09.854770
round_time_total       0 days 00:14:27.278854
loss_total                11834725876853900.0
loss_critic               14793407073471168.0
loss_actor                     -373922231.328
memory_size                            8993.0 

=== epoch 5/10 ===== round 44/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:32,  2.46it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:23<00:00,  2.31it/s]
episodes                                  798
episode_length                      12.522556
returns                             10.258409
return_std                           4.649387
average_reward                       0.819367
round_time             0 days 00:14:24.532390
episodes_test                           830.0
episode_length_test                 12.048193
returns_test                         9.827479
return_std_test                      4.537393
average_reward_test                  0.815681
round_time_test        0 days 00:00:10.190837
round_time_total       0 days 00:14:24.533706
loss_total                11858794519782752.0
loss_critic               14823492899546596.0
loss_actor                     -375369072.928
memory_size                          8995.285 

=== epoch 5/10 ===== round 45/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:10,  2.06it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:24<00:00,  2.31it/s]
episodes                                  815
episode_length                      12.267485
returns                             10.058568
return_std                           4.837125
average_reward                       0.819915
round_time             0 days 00:14:24.878141
episodes_test                           824.0
episode_length_test                 12.128641
returns_test                         9.942227
return_std_test                      5.321378
average_reward_test                  0.819785
round_time_test        0 days 00:00:09.953190
round_time_total       0 days 00:14:24.879229
loss_total                11891177578104356.0
loss_critic               14863971726408024.0
loss_actor                     -374811279.072
memory_size                         8998.8695 

=== epoch 5/10 ===== round 46/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:57,  2.38it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:25<00:00,  2.31it/s]
episodes                                  810
episode_length                      12.309877
returns                             10.163659
return_std                            5.61702
average_reward                       0.825449
round_time             0 days 00:14:25.686076
episodes_test                           715.0
episode_length_test                 13.970629
returns_test                        11.773754
return_std_test                      7.497705
average_reward_test                   0.84276
round_time_test        0 days 00:00:09.948754
round_time_total       0 days 00:14:25.687155
loss_total                11920865874086462.0
loss_critic               14901082080212418.0
loss_actor                     -376559549.632
memory_size                          9022.574 

=== epoch 5/10 ===== round 47/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:24,  2.31it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:22<00:00,  2.32it/s]
episodes                                  799
episode_length                      12.508135
returns                             10.311669
return_std                           5.990996
average_reward                        0.82429
round_time             0 days 00:14:23.484264
episodes_test                           759.0
episode_length_test                 13.166008
returns_test                        11.104941
return_std_test                      6.512941
average_reward_test                  0.843249
round_time_test        0 days 00:00:10.116342
round_time_total       0 days 00:14:23.485352
loss_total                11971071163745960.0
loss_critic               14963838692790108.0
loss_actor                     -378706914.752
memory_size                          9039.308 

=== epoch 5/10 ===== round 48/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:00,  2.22it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:26<00:00,  2.31it/s]
episodes                                  792
episode_length                      12.594697
returns                              10.34441
return_std                           6.027012
average_reward                       0.820392
round_time             0 days 00:14:27.139511
episodes_test                           795.0
episode_length_test                 12.569811
returns_test                        10.184883
return_std_test                      4.802085
average_reward_test                  0.810325
round_time_test        0 days 00:00:09.917324
round_time_total       0 days 00:14:27.140811
loss_total                11923041299181076.0
loss_critic               14903801379163210.0
loss_actor                     -379219915.008
memory_size                         9054.3265 

=== epoch 5/10 ===== round 49/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:30,  2.29it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:26<00:00,  2.31it/s]
episodes                                  795
episode_length                      12.555975
returns                             10.287687
return_std                           6.013852
average_reward                       0.819705
round_time             0 days 00:14:26.577134
episodes_test                           805.0
episode_length_test                 12.416149
returns_test                         9.828183
return_std_test                      4.416394
average_reward_test                  0.791697
round_time_test        0 days 00:00:10.177830
round_time_total       0 days 00:14:26.578431
loss_total                11841980695629004.0
loss_critic               14802475602979848.0
loss_actor                      -381472829.84
memory_size                            9056.0 

=== epoch 5/10 ===== round 50/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:33,  2.28it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:24<00:00,  2.31it/s]
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
episodes                                  794
episode_length                      12.585642
returns                             10.250821
return_std                           5.711092
average_reward                       0.814606
round_time             0 days 00:14:25.290921
episodes_test                           878.0
episode_length_test                 11.388383
returns_test                         9.098108
return_std_test                      3.789744
average_reward_test                  0.798919
round_time_test        0 days 00:00:09.868103
round_time_total       0 days 00:14:25.292031
loss_total                12004748359735706.0
loss_critic               15005935193850642.0
loss_actor                     -383893407.696
memory_size                          9056.126 


<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
=== epoch 6/10 ===== round 1/50 ======================================
  0%|          | 5/2000 [00:02<14:39,  2.27it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:11<00:00,  2.35it/s]
episodes                                  143
episode_length                       13.93007
returns                             11.804919
return_std                           7.132066
average_reward                       0.847687
round_time             0 days 00:14:11.979635
episodes_test                           753.0
episode_length_test                 13.270916
returns_test                        10.949515
return_std_test                      6.211608
average_reward_test                  0.825159
round_time_test        0 days 00:00:09.984645
round_time_total       0 days 00:14:11.980885
loss_total                12260498291061424.0
loss_critic               15325622607336702.0
loss_actor                     -382945434.048
memory_size                         9066.0435 

=== epoch 6/10 ===== round 2/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:41,  2.26it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:12<00:00,  2.35it/s]
episodes                                  301
episode_length                      13.269103
returns                             10.643158
return_std                           5.956596
average_reward                       0.802212
round_time             0 days 00:14:13.038193
episodes_test                           836.0
episode_length_test                 11.961722
returns_test                         9.627358
return_std_test                      4.527302
average_reward_test                  0.804847
round_time_test        0 days 00:00:09.989111
round_time_total       0 days 00:14:13.039547
loss_total                12063308049725522.0
loss_critic               15079134811907948.0
loss_actor                     -381366210.608
memory_size                         9086.3075 

=== epoch 6/10 ===== round 3/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:25,  2.31it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:12<00:00,  2.35it/s]
episodes                                  447
episode_length                      13.400447
returns                             10.567305
return_std                           5.767003
average_reward                       0.788974
round_time             0 days 00:14:13.335591
episodes_test                           784.0
episode_length_test                 12.735969
returns_test                         9.680176
return_std_test                      4.620131
average_reward_test                  0.760137
round_time_test        0 days 00:00:09.837186
round_time_total       0 days 00:14:13.336776
loss_total                11772129922359754.0
loss_critic               14715162147399140.0
loss_actor                     -380072327.792
memory_size                            9087.0 

=== epoch 6/10 ===== round 4/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:40,  2.27it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:12<00:00,  2.35it/s]
episodes                                  613
episode_length                       13.04894
returns                             10.249411
return_std                           5.275589
average_reward                       0.785482
round_time             0 days 00:14:13.381938
episodes_test                           777.0
episode_length_test                  12.85843
returns_test                         9.907033
return_std_test                      4.752747
average_reward_test                  0.770521
round_time_test        0 days 00:00:10.249857
round_time_total       0 days 00:14:13.383452
loss_total                11806026462463524.0
loss_critic               14757532821991982.0
loss_actor                     -381679868.752
memory_size                            9087.0 

=== epoch 6/10 ===== round 5/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:47,  2.25it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:11<00:00,  2.35it/s]
episodes                                  782
episode_length                      12.780051
returns                             10.057302
return_std                           4.955714
average_reward                       0.786911
round_time             0 days 00:14:12.473698
episodes_test                           826.0
episode_length_test                  12.09322
returns_test                          9.42744
return_std_test                      4.035386
average_reward_test                  0.779483
round_time_test        0 days 00:00:10.010061
round_time_total       0 days 00:14:12.475014
loss_total                11522614318063420.0
loss_critic               14403267640418108.0
loss_actor                     -379672919.824
memory_size                            9087.0 

=== epoch 6/10 ===== round 6/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:40,  2.27it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:13<00:00,  2.34it/s]
episodes                                  827
episode_length                      12.077388
returns                              9.290247
return_std                           4.029618
average_reward                       0.768984
round_time             0 days 00:14:13.937723
episodes_test                           879.0
episode_length_test                 11.368601
returns_test                         8.696848
return_std_test                      3.187293
average_reward_test                  0.764942
round_time_test        0 days 00:00:10.011071
round_time_total       0 days 00:14:13.938815
loss_total                11376466241838384.0
loss_critic               14220582549465334.0
loss_actor                     -377983846.384
memory_size                            9087.0 

=== epoch 6/10 ===== round 7/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:12,  2.19it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:13<00:00,  2.34it/s]
episodes                                  827
episode_length                      12.088271
returns                              9.363498
return_std                           4.051635
average_reward                       0.774614
round_time             0 days 00:14:13.881836
episodes_test                           879.0
episode_length_test                 11.368601
returns_test                         8.723554
return_std_test                      3.270583
average_reward_test                  0.767346
round_time_test        0 days 00:00:10.295846
round_time_total       0 days 00:14:13.882933
loss_total                11491454778886586.0
loss_critic               14364318243089286.0
loss_actor                     -379137919.456
memory_size                          9089.316 

=== epoch 6/10 ===== round 8/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:59,  2.22it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:14<00:00,  2.34it/s]
episodes                                  846
episode_length                      11.817967
returns                              9.206817
return_std                           3.821581
average_reward                       0.779023
round_time             0 days 00:14:15.488367
episodes_test                           820.0
episode_length_test                 12.192683
returns_test                         9.744362
return_std_test                      5.330114
average_reward_test                  0.799229
round_time_test        0 days 00:00:09.952401
round_time_total       0 days 00:14:15.489443
loss_total                11484048264819376.0
loss_critic               14355060071178698.0
loss_actor                     -381279686.336
memory_size                            9090.0 

=== epoch 6/10 ===== round 9/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:52,  2.24it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:14<00:00,  2.34it/s]
episodes                                  843
episode_length                      11.835113
returns                               9.33225
return_std                           4.620391
average_reward                       0.788463
round_time             0 days 00:14:14.865435
episodes_test                           830.0
episode_length_test                 12.038554
returns_test                          9.54297
return_std_test                      3.974015
average_reward_test                  0.792808
round_time_test        0 days 00:00:09.944794
round_time_total       0 days 00:14:14.866881
loss_total                11613723732849198.0
loss_critic               14517154422389212.0
loss_actor                     -383767980.544
memory_size                          9096.872 

=== epoch 6/10 ===== round 10/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:54,  2.23it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.34it/s]
episodes                                  821
episode_length                      12.169306
returns                               9.57881
return_std                           5.022383
average_reward                       0.787038
round_time             0 days 00:14:16.711676
episodes_test                           697.0
episode_length_test                 14.340029
returns_test                        11.949466
return_std_test                      6.710297
average_reward_test                  0.833261
round_time_test        0 days 00:00:09.733408
round_time_total       0 days 00:14:16.712933
loss_total                11992077761146520.0
loss_critic               14990096959170150.0
loss_actor                     -383217763.632
memory_size                          9110.573 

=== epoch 6/10 ===== round 11/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:46,  2.42it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:15<00:00,  2.34it/s]
episodes                                  770
episode_length                       12.97013
returns                             10.299443
return_std                           5.506725
average_reward                       0.794342
round_time             0 days 00:14:15.576071
episodes_test                           665.0
episode_length_test                  15.03609
returns_test                        11.841426
return_std_test                      6.373732
average_reward_test                  0.787555
round_time_test        0 days 00:00:09.860302
round_time_total       0 days 00:14:15.577153
loss_total                11968054525685662.0
loss_critic               14960067891892846.0
loss_actor                     -385587508.656
memory_size                            9113.0 

=== epoch 6/10 ===== round 12/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:40,  2.00it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  746
episode_length                      13.382038
returns                             10.660753
return_std                           5.893313
average_reward                       0.796646
round_time             0 days 00:14:17.668068
episodes_test                           702.0
episode_length_test                 14.242165
returns_test                        11.638106
return_std_test                      5.954688
average_reward_test                    0.8172
round_time_test        0 days 00:00:09.817202
round_time_total       0 days 00:14:17.669140
loss_total                12063545233254646.0
loss_critic               15079431298869100.0
loss_actor                     -387459817.184
memory_size                         9126.8415 

=== epoch 6/10 ===== round 13/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:13,  2.34it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.34it/s]
episodes                                  740
episode_length                      13.505405
returns                             10.755433
return_std                           5.964646
average_reward                       0.796532
round_time             0 days 00:14:16.951735
episodes_test                           713.0
episode_length_test                 13.998597
returns_test                        11.215036
return_std_test                      5.501673
average_reward_test                  0.800844
round_time_test        0 days 00:00:09.877803
round_time_total       0 days 00:14:16.952841
loss_total                11927465948451176.0
loss_critic               14909332183033316.0
loss_actor                     -388114365.984
memory_size                            9132.0 

=== epoch 6/10 ===== round 14/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:08,  2.06it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:14<00:00,  2.34it/s]
episodes                                  737
episode_length                      13.557666
returns                             10.647897
return_std                           5.427145
average_reward                       0.785522
round_time             0 days 00:14:15.542127
episodes_test                           803.0
episode_length_test                 12.440847
returns_test                         9.745784
return_std_test                      4.437568
average_reward_test                   0.78343
round_time_test        0 days 00:00:09.949989
round_time_total       0 days 00:14:15.543344
loss_total                11617649821778706.0
loss_critic               14522062026504668.0
loss_actor                      -388439494.72
memory_size                            9132.0 

=== epoch 6/10 ===== round 15/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:02,  2.37it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:15<00:00,  2.34it/s]
episodes                                  759
episode_length                      13.160738
returns                             10.298627
return_std                           5.034074
average_reward                       0.782599
round_time             0 days 00:14:15.748034
episodes_test                           856.0
episode_length_test                  11.67757
returns_test                         8.819716
return_std_test                      3.324087
average_reward_test                  0.755351
round_time_test        0 days 00:00:09.995325
round_time_total       0 days 00:14:15.749124
loss_total                11614719657918858.0
loss_critic               14518399326713020.0
loss_actor                     -386597322.288
memory_size                            9132.0 

=== epoch 6/10 ===== round 16/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:41,  2.12it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:18<00:00,  2.33it/s]
episodes                                  773
episode_length                      12.918499
returns                             10.008704
return_std                           4.648444
average_reward                       0.775014
round_time             0 days 00:14:18.694954
episodes_test                           801.0
episode_length_test                 12.480649
returns_test                         9.640675
return_std_test                      4.668865
average_reward_test                  0.772478
round_time_test        0 days 00:00:10.004655
round_time_total       0 days 00:14:18.696033
loss_total                11629297732014834.0
loss_critic               14536621904166388.0
loss_actor                     -387451505.648
memory_size                            9132.0 

=== epoch 6/10 ===== round 17/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:39,  2.27it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:14<00:00,  2.34it/s]
episodes                                  786
episode_length                      12.704835
returns                               9.86804
return_std                           4.455055
average_reward                       0.776719
round_time             0 days 00:14:15.148165
episodes_test                           810.0
episode_length_test                 12.345679
returns_test                         9.393252
return_std_test                      4.341426
average_reward_test                  0.760853
round_time_test        0 days 00:00:09.852010
round_time_total       0 days 00:14:15.149245
loss_total                11878496162103164.0
loss_critic               14848119970096742.0
loss_actor                     -387696026.048
memory_size                          9133.386 

=== epoch 6/10 ===== round 18/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:49,  2.24it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:15<00:00,  2.34it/s]
episodes                                  759
episode_length                       13.15415
returns                             10.234858
return_std                           5.044385
average_reward                       0.778324
round_time             0 days 00:14:16.174801
episodes_test                           689.0
episode_length_test                 14.512337
returns_test                        11.855959
return_std_test                      7.158991
average_reward_test                  0.816971
round_time_test        0 days 00:00:09.816571
round_time_total       0 days 00:14:16.175890
loss_total                11750940396799132.0
loss_critic               14688675252662174.0
loss_actor                     -389632775.008
memory_size                          9144.187 

=== epoch 6/10 ===== round 19/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:17,  2.33it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  742
episode_length                      13.450135
returns                             10.490333
return_std                           5.422524
average_reward                       0.780066
round_time             0 days 00:14:17.984837
episodes_test                           708.0
episode_length_test                 14.114407
returns_test                        11.340717
return_std_test                      6.991023
average_reward_test                  0.803549
round_time_test        0 days 00:00:09.827702
round_time_total       0 days 00:14:17.985918
loss_total                11793443587776054.0
loss_critic               14741804226015396.0
loss_actor                     -387720203.184
memory_size                          9146.089 

=== epoch 6/10 ===== round 20/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:51,  2.24it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.33it/s]
episodes                                  739
episode_length                      13.518268
returns                             10.477033
return_std                           5.503274
average_reward                       0.774898
round_time             0 days 00:14:17.261772
episodes_test                           770.0
episode_length_test                 12.980519
returns_test                         9.946887
return_std_test                      4.688038
average_reward_test                  0.766442
round_time_test        0 days 00:00:10.093186
round_time_total       0 days 00:14:17.262905
loss_total                11207722896183002.0
loss_critic               14009653388501844.0
loss_actor                     -382245445.984
memory_size                            9150.0 

=== epoch 6/10 ===== round 21/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:39,  2.27it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:15<00:00,  2.34it/s]
episodes                                  768
episode_length                      13.009115
returns                             10.136913
return_std                           5.459283
average_reward                       0.779304
round_time             0 days 00:14:16.079432
episodes_test                           909.0
episode_length_test                   10.9989
returns_test                         8.296456
return_std_test                      3.007901
average_reward_test                  0.754329
round_time_test        0 days 00:00:10.047457
round_time_total       0 days 00:14:16.080512
loss_total                11008819559359578.0
loss_critic               13761024206131168.0
loss_actor                     -381450319.232
memory_size                            9150.0 

=== epoch 6/10 ===== round 22/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:09,  2.35it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  809
episode_length                      12.326329
returns                              9.507426
return_std                           4.958864
average_reward                       0.771124
round_time             0 days 00:14:17.712683
episodes_test                           908.0
episode_length_test                 11.006608
returns_test                         8.387145
return_std_test                      3.071081
average_reward_test                   0.76208
round_time_test        0 days 00:00:10.022636
round_time_total       0 days 00:14:17.713761
loss_total                11112985137048978.0
loss_critic               13891231180658836.0
loss_actor                     -384554784.784
memory_size                            9150.0 

=== epoch 6/10 ===== round 23/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:43,  2.26it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:14<00:00,  2.34it/s]
episodes                                  874
episode_length                      11.429062
returns                               8.70846
return_std                           4.004206
average_reward                       0.762011
round_time             0 days 00:14:15.381660
episodes_test                           951.0
episode_length_test                 10.515247
returns_test                          8.03989
return_std_test                       3.13952
average_reward_test                  0.764594
round_time_test        0 days 00:00:10.128280
round_time_total       0 days 00:14:15.382781
loss_total                11177410552055988.0
loss_critic               13971762943545574.0
loss_actor                     -387341558.544
memory_size                            9150.0 

=== epoch 6/10 ===== round 24/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:47,  2.41it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:14<00:00,  2.34it/s]
episodes                                  924
episode_length                        10.8171
returns                              8.198872
return_std                           3.183236
average_reward                        0.75772
round_time             0 days 00:14:15.576320
episodes_test                           954.0
episode_length_test                 10.474843
returns_test                         7.925996
return_std_test                      2.673071
average_reward_test                  0.756793
round_time_test        0 days 00:00:10.014844
round_time_total       0 days 00:14:15.577395
loss_total                11308854850827060.0
loss_critic               14136068303923184.0
loss_actor                     -391333951.712
memory_size                            9150.0 

=== epoch 6/10 ===== round 25/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:30,  2.29it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.34it/s]
episodes                                  944
episode_length                      10.583686
returns                              8.047437
return_std                           2.966491
average_reward                       0.760454
round_time             0 days 00:14:16.901907
episodes_test                           939.0
episode_length_test                 10.648562
returns_test                         8.171976
return_std_test                      2.826447
average_reward_test                  0.767446
round_time_test        0 days 00:00:10.359494
round_time_total       0 days 00:14:16.902986
loss_total                11641621617624220.0
loss_critic               14552026788726308.0
loss_actor                     -396280174.928
memory_size                            9150.0 

=== epoch 6/10 ===== round 26/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:39,  2.44it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:15<00:00,  2.34it/s]
episodes                                  939
episode_length                      10.631523
returns                              8.080339
return_std                           2.950864
average_reward                        0.75973
round_time             0 days 00:14:16.302411
episodes_test                           942.0
episode_length_test                 10.612527
returns_test                         8.027297
return_std_test                      2.713061
average_reward_test                   0.75646
round_time_test        0 days 00:00:10.163401
round_time_total       0 days 00:14:16.303482
loss_total                12107852481086620.0
loss_critic               15134815351511974.0
loss_actor                      -401975313.52
memory_size                            9150.0 

=== epoch 6/10 ===== round 27/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:47,  2.25it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.34it/s]
episodes                                  930
episode_length                      10.725806
returns                              8.216843
return_std                           3.282157
average_reward                       0.766336
round_time             0 days 00:14:16.754167
episodes_test                           858.0
episode_length_test                  11.65035
returns_test                         9.280832
return_std_test                      4.269477
average_reward_test                  0.796712
round_time_test        0 days 00:00:10.346184
round_time_total       0 days 00:14:16.755462
loss_total                12282023614076682.0
loss_critic               15352529257817440.0
loss_actor                     -406702040.672
memory_size                            9150.0 

=== epoch 6/10 ===== round 28/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:18,  2.17it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:15<00:00,  2.34it/s]
episodes                                  913
episode_length                      10.946331
returns                              8.440045
return_std                           3.480571
average_reward                       0.771134
round_time             0 days 00:14:16.195054
episodes_test                           854.0
episode_length_test                 11.688525
returns_test                         9.282812
return_std_test                      4.516485
average_reward_test                  0.793783
round_time_test        0 days 00:00:10.144288
round_time_total       0 days 00:14:16.196121
loss_total                12498772959042732.0
loss_critic               15623465925871666.0
loss_actor                     -411072704.224
memory_size                         9158.5365 

=== epoch 6/10 ===== round 29/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:06,  2.36it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.33it/s]
episodes                                  877
episode_length                      11.383124
returns                               8.74392
return_std                           3.729227
average_reward                       0.768447
round_time             0 days 00:14:17.190524
episodes_test                           856.0
episode_length_test                 11.682243
returns_test                         9.249463
return_std_test                       3.75411
average_reward_test                  0.791754
round_time_test        0 days 00:00:09.949696
round_time_total       0 days 00:14:17.191599
loss_total                12820085511112622.0
loss_critic               16025106620992192.0
loss_actor                      -415370449.92
memory_size                          9162.735 

=== epoch 6/10 ===== round 30/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:35,  2.28it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:18<00:00,  2.33it/s]
episodes                                  857
episode_length                      11.655776
returns                              8.961899
return_std                           3.900783
average_reward                       0.769046
round_time             0 days 00:14:19.028913
episodes_test                           813.0
episode_length_test                 12.292743
returns_test                         9.598289
return_std_test                      4.595968
average_reward_test                  0.780776
round_time_test        0 days 00:00:10.128452
round_time_total       0 days 00:14:19.030119
loss_total                13050689159197360.0
loss_critic               16313361167340798.0
loss_actor                     -421753154.224
memory_size                            9168.0 

=== epoch 6/10 ===== round 31/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:58,  2.22it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:18<00:00,  2.33it/s]
episodes                                  859
episode_length                      11.613504
returns                              8.965543
return_std                           3.849649
average_reward                       0.772421
round_time             0 days 00:14:18.913067
episodes_test                           836.0
episode_length_test                 11.953349
returns_test                         9.365951
return_std_test                      4.017884
average_reward_test                  0.783539
round_time_test        0 days 00:00:10.203677
round_time_total       0 days 00:14:18.914122
loss_total                13543357418301292.0
loss_critic               16929196487059964.0
loss_actor                     -427632939.248
memory_size                            9168.0 

=== epoch 6/10 ===== round 32/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:05,  2.36it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:14<00:00,  2.34it/s]
episodes                                  865
episode_length                      11.558382
returns                               8.91721
return_std                           3.579828
average_reward                       0.771504
round_time             0 days 00:14:15.432523
episodes_test                           910.0
episode_length_test                 10.984615
returns_test                         8.881835
return_std_test                      3.486238
average_reward_test                  0.808572
round_time_test        0 days 00:00:10.084438
round_time_total       0 days 00:14:15.433727
loss_total                13855333211564934.0
loss_critic               17319166211191210.0
loss_actor                     -432663410.016
memory_size                            9168.0 

=== epoch 6/10 ===== round 33/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:20,  2.32it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:14<00:00,  2.34it/s]
episodes                                  857
episode_length                      11.651109
returns                              9.190958
return_std                           3.765642
average_reward                       0.788639
round_time             0 days 00:14:15.193766
episodes_test                           921.0
episode_length_test                 10.851249
returns_test                         8.610317
return_std_test                      3.611085
average_reward_test                  0.793512
round_time_test        0 days 00:00:10.146800
round_time_total       0 days 00:14:15.195204
loss_total                14389103199321588.0
loss_critic               17986378688840598.0
loss_actor                     -438379594.256
memory_size                         9169.1515 

=== epoch 6/10 ===== round 34/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:39,  2.44it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:15<00:00,  2.34it/s]
episodes                                  873
episode_length                      11.444444
returns                              9.181935
return_std                           3.865098
average_reward                       0.802401
round_time             0 days 00:14:16.014628
episodes_test                           866.0
episode_length_test                 11.542725
returns_test                         9.567047
return_std_test                      4.103436
average_reward_test                  0.828851
round_time_test        0 days 00:00:10.050226
round_time_total       0 days 00:14:16.015835
loss_total                14647342968822824.0
loss_critic               18309178414944224.0
loss_actor                     -444583164.736
memory_size                         9179.9385 

=== epoch 6/10 ===== round 35/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:00,  2.22it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:18<00:00,  2.33it/s]
episodes                                  882
episode_length                      11.318594
returns                              9.226723
return_std                           3.803836
average_reward                        0.81526
round_time             0 days 00:14:18.895872
episodes_test                           939.0
episode_length_test                 10.645367
returns_test                         8.537121
return_std_test                      2.952117
average_reward_test                   0.80201
round_time_test        0 days 00:00:10.195113
round_time_total       0 days 00:14:18.896958
loss_total                15045115328633766.0
loss_critic               18806393860077388.0
loss_actor                     -450262947.072
memory_size                            9182.0 

=== epoch 6/10 ===== round 36/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:49,  2.25it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.34it/s]
episodes                                  885
episode_length                      11.291525
returns                              9.235712
return_std                           3.767046
average_reward                       0.818239
round_time             0 days 00:14:16.668393
episodes_test                           898.0
episode_length_test                 11.124722
returns_test                         9.213817
return_std_test                      3.964367
average_reward_test                  0.828514
round_time_test        0 days 00:00:09.917671
round_time_total       0 days 00:14:16.669452
loss_total                15640768713798452.0
loss_critic               19550960573480960.0
loss_actor                     -460895210.976
memory_size                            9182.0 

=== epoch 6/10 ===== round 37/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:09,  2.20it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  872
episode_length                      11.447248
returns                              9.472416
return_std                            3.98273
average_reward                       0.827316
round_time             0 days 00:14:17.826788
episodes_test                           881.0
episode_length_test                 11.350738
returns_test                         9.153031
return_std_test                      3.777117
average_reward_test                  0.806382
round_time_test        0 days 00:00:10.020889
round_time_total       0 days 00:14:17.827854
loss_total                16482211456742326.0
loss_critic               20602763986927092.0
loss_actor                     -469977235.632
memory_size                            9182.0 

=== epoch 6/10 ===== round 38/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:48,  2.41it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  875
episode_length                      11.412571
returns                              9.316583
return_std                            3.92213
average_reward                       0.816187
round_time             0 days 00:14:18.222808
episodes_test                           822.0
episode_length_test                 12.156934
returns_test                        10.095636
return_std_test                      4.863323
average_reward_test                  0.830408
round_time_test        0 days 00:00:09.905600
round_time_total       0 days 00:14:18.223920
loss_total                17243852470912812.0
loss_critic               21554815222092400.0
loss_actor                     -478159989.968
memory_size                            9182.0 

=== epoch 6/10 ===== round 39/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:34,  2.28it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  873
episode_length                      11.441008
returns                              9.320153
return_std                           3.786395
average_reward                       0.814488
round_time             0 days 00:14:17.660235
episodes_test                           895.0
episode_length_test                 11.168715
returns_test                         9.158412
return_std_test                      3.753766
average_reward_test                  0.819976
round_time_test        0 days 00:00:10.061220
round_time_total       0 days 00:14:17.661294
loss_total                17634683629655294.0
loss_critic               22043354151193148.0
loss_actor                     -485267653.392
memory_size                            9182.0 

=== epoch 6/10 ===== round 40/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:49,  2.24it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  879
episode_length                      11.367463
returns                              9.156011
return_std                           3.738894
average_reward                       0.805411
round_time             0 days 00:14:18.382002
episodes_test                           871.0
episode_length_test                  11.47876
returns_test                          9.02775
return_std_test                      3.678855
average_reward_test                  0.786491
round_time_test        0 days 00:00:10.242126
round_time_total       0 days 00:14:18.383320
loss_total                18078964942089748.0
loss_critic               22598705770328488.0
loss_actor                     -492938763.648
memory_size                            9182.0 

=== epoch 6/10 ===== round 41/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:33,  2.29it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  880
episode_length                      11.348864
returns                              9.085703
return_std                            3.69701
average_reward                       0.800644
round_time             0 days 00:14:17.598059
episodes_test                           881.0
episode_length_test                 11.345062
returns_test                         8.827101
return_std_test                      3.293961
average_reward_test                  0.778055
round_time_test        0 days 00:00:10.132532
round_time_total       0 days 00:14:17.599397
loss_total                18689599452355756.0
loss_critic               23361998900846132.0
loss_actor                      -499692394.08
memory_size                            9182.0 

=== epoch 6/10 ===== round 42/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<15:05,  2.20it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  894
episode_length                      11.174497
returns                              8.845466
return_std                           3.496474
average_reward                       0.791426
round_time             0 days 00:14:18.141002
episodes_test                           903.0
episode_length_test                 11.062016
returns_test                         8.720297
return_std_test                      3.796242
average_reward_test                  0.788733
round_time_test        0 days 00:00:10.271485
round_time_total       0 days 00:14:18.142089
loss_total                19345179937454688.0
loss_critic               24181474506615816.0
loss_actor                      -509644824.24
memory_size                            9182.0 

=== epoch 6/10 ===== round 43/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:51,  2.40it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.33it/s]
episodes                                  905
episode_length                      11.044199
returns                              8.736718
return_std                           3.239659
average_reward                       0.791123
round_time             0 days 00:14:17.352188
episodes_test                           909.0
episode_length_test                 10.982398
returns_test                         8.746413
return_std_test                      3.815922
average_reward_test                  0.797703
round_time_test        0 days 00:00:09.835578
round_time_total       0 days 00:14:17.353267
loss_total                20141683895609328.0
loss_critic               25177104452430068.0
loss_actor                     -519183559.472
memory_size                            9182.0 

=== epoch 6/10 ===== round 44/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:40,  2.43it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.33it/s]
episodes                                  909
episode_length                      10.987899
returns                              8.646243
return_std                           3.041101
average_reward                       0.786968
round_time             0 days 00:14:17.466871
episodes_test                           941.0
episode_length_test                 10.626993
returns_test                         8.379871
return_std_test                       3.03672
average_reward_test                  0.788546
round_time_test        0 days 00:00:10.206688
round_time_total       0 days 00:14:17.467956
loss_total                20921290014681204.0
loss_critic               26151612046509080.0
loss_actor                     -524260080.496
memory_size                            9182.0 

=== epoch 6/10 ===== round 45/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:32,  2.46it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:14<00:00,  2.34it/s]
episodes                                  904
episode_length                      11.048673
returns                              8.732676
return_std                            3.24921
average_reward                       0.790183
round_time             0 days 00:14:15.430397
episodes_test                           881.0
episode_length_test                 11.350738
returns_test                         9.285923
return_std_test                      3.504066
average_reward_test                   0.81809
round_time_test        0 days 00:00:10.355812
round_time_total       0 days 00:14:15.431686
loss_total                21341293514447652.0
loss_critic               26676616412694316.0
loss_actor                      -533402299.52
memory_size                         9183.1055 

=== epoch 6/10 ===== round 46/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:29,  2.30it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.34it/s]
episodes                                  902
episode_length                      11.076497
returns                              8.808134
return_std                           3.434038
average_reward                       0.795139
round_time             0 days 00:14:16.805161
episodes_test                           913.0
episode_length_test                  10.94414
returns_test                         8.751932
return_std_test                      3.580743
average_reward_test                  0.799738
round_time_test        0 days 00:00:10.190461
round_time_total       0 days 00:14:16.806240
loss_total                21846358793998304.0
loss_critic               27307948015756508.0
loss_actor                     -537592314.752
memory_size                            9185.0 

=== epoch 6/10 ===== round 47/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:19,  2.32it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.34it/s]
episodes                                  887
episode_length                      11.259301
returns                              9.125562
return_std                           3.841488
average_reward                       0.810531
round_time             0 days 00:14:16.888749
episodes_test                           846.0
episode_length_test                 11.813239
returns_test                        10.122908
return_std_test                      5.066984
average_reward_test                  0.856913
round_time_test        0 days 00:00:10.110213
round_time_total       0 days 00:14:16.890173
loss_total                22118150460386836.0
loss_critic               27647687576596252.0
loss_actor                     -543230615.248
memory_size                         9185.0975 

=== epoch 6/10 ===== round 48/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:23,  2.16it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  871
episode_length                       11.46039
returns                              9.355346
return_std                           3.985973
average_reward                       0.816188
round_time             0 days 00:14:18.135959
episodes_test                           905.0
episode_length_test                 11.041989
returns_test                         9.042833
return_std_test                      3.730204
average_reward_test                  0.818948
round_time_test        0 days 00:00:10.320987
round_time_total       0 days 00:14:18.137028
loss_total                22802870407998212.0
loss_critic               28503587471784672.0
loss_actor                     -552660773.216
memory_size                            9190.0 

=== epoch 6/10 ===== round 49/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:46,  2.25it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.34it/s]
episodes                                  862
episode_length                      11.574246
returns                              9.580681
return_std                           4.127915
average_reward                       0.828064
round_time             0 days 00:14:16.934471
episodes_test                           855.0
episode_length_test                 11.690058
returns_test                         9.790182
return_std_test                      4.745043
average_reward_test                  0.837537
round_time_test        0 days 00:00:10.327969
round_time_total       0 days 00:14:16.935671
loss_total                23391162585095076.0
loss_critic               29238952715435900.0
loss_actor                     -561012278.272
memory_size                            9190.0 

=== epoch 6/10 ===== round 50/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:43,  2.26it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
episodes                                  853
episode_length                      11.710434
returns                              9.781679
return_std                           4.162757
average_reward                       0.835128
round_time             0 days 00:14:17.563426
episodes_test                           821.0
episode_length_test                  12.17296
returns_test                         10.07204
return_std_test                      4.438261
average_reward_test                  0.827379
round_time_test        0 days 00:00:09.912788
round_time_total       0 days 00:14:17.564701
loss_total                24080318315873960.0
loss_critic               30100397374211884.0
loss_actor                     -568826912.864
memory_size                            9190.0 


<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
=== epoch 7/10 ===== round 1/50 ======================================
  0%|          | 5/2000 [00:02<14:21,  2.32it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:11<00:00,  2.35it/s]
episodes                                  163
episode_length                      12.257669
returns                             10.489196
return_std                           8.022342
average_reward                       0.855838
round_time             0 days 00:14:11.814893
episodes_test                           873.0
episode_length_test                 11.450172
returns_test                          9.37508
return_std_test                      4.324919
average_reward_test                  0.818774
round_time_test        0 days 00:00:10.090939
round_time_total       0 days 00:14:11.815979
loss_total                25154249442705016.0
loss_critic               31442811256444028.0
loss_actor                      -581346992.32
memory_size                          9193.004 

=== epoch 7/10 ===== round 2/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:29,  2.47it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:14<00:00,  2.34it/s]
episodes                                  316
episode_length                      12.591772
returns                             10.698373
return_std                           6.926479
average_reward                       0.848928
round_time             0 days 00:14:15.100835
episodes_test                           828.0
episode_length_test                 12.072464
returns_test                          9.81144
return_std_test                      4.240984
average_reward_test                   0.81273
round_time_test        0 days 00:00:10.012123
round_time_total       0 days 00:14:15.102028
loss_total                26679290989761264.0
loss_critic               33349113193485564.0
loss_actor                     -588949048.784
memory_size                          9226.857 

=== epoch 7/10 ===== round 3/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:56,  2.23it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:12<00:00,  2.35it/s]
episodes                                  458
episode_length                      13.063319
returns                             10.956347
return_std                           6.878198
average_reward                       0.838457
round_time             0 days 00:14:13.330636
episodes_test                           696.0
episode_length_test                 14.353448
returns_test                        12.204599
return_std_test                      8.139139
average_reward_test                  0.850288
round_time_test        0 days 00:00:10.067812
round_time_total       0 days 00:14:13.331945
loss_total                27480266766395900.0
loss_critic               34350332914681512.0
loss_actor                     -591679112.672
memory_size                          9245.111 

=== epoch 7/10 ===== round 4/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:26,  2.30it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:14<00:00,  2.34it/s]
episodes                                  607
episode_length                      13.174629
returns                             10.971874
return_std                           6.757932
average_reward                       0.832881
round_time             0 days 00:14:15.110797
episodes_test                           706.0
episode_length_test                 14.157224
returns_test                        11.742826
return_std_test                      7.552325
average_reward_test                  0.829564
round_time_test        0 days 00:00:09.898327
round_time_total       0 days 00:14:15.111877
loss_total                27843362190813824.0
loss_critic               34804202117491852.0
loss_actor                     -601152689.424
memory_size                           9278.29 

=== epoch 7/10 ===== round 5/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:44,  2.42it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:14<00:00,  2.34it/s]
episodes                                  762
episode_length                       13.11811
returns                             10.881655
return_std                           6.529789
average_reward                       0.829591
round_time             0 days 00:14:15.479434
episodes_test                           755.0
episode_length_test                 13.231788
returns_test                        11.024335
return_std_test                      6.558841
average_reward_test                  0.833096
round_time_test        0 days 00:00:09.849344
round_time_total       0 days 00:14:15.480537
loss_total                29091636277244068.0
loss_critic               36364544763110624.0
loss_actor                     -609599828.832
memory_size                          9293.456 

=== epoch 7/10 ===== round 6/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:37,  2.27it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  761
episode_length                       13.13272
returns                             10.740691
return_std                           5.787349
average_reward                       0.817726
round_time             0 days 00:14:17.976819
episodes_test                           849.0
episode_length_test                 11.770318
returns_test                         9.343445
return_std_test                       4.14995
average_reward_test                  0.793995
round_time_test        0 days 00:00:10.069214
round_time_total       0 days 00:14:17.977900
loss_total                29391975281820960.0
loss_critic               36739968514268336.0
loss_actor                     -619118488.256
memory_size                            9297.0 

=== epoch 7/10 ===== round 7/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:23,  2.31it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:13<00:00,  2.34it/s]
episodes                                  776
episode_length                      12.849227
returns                             10.359273
return_std                           5.442439
average_reward                       0.806583
round_time             0 days 00:14:14.088593
episodes_test                           826.0
episode_length_test                 12.104116
returns_test                         9.375545
return_std_test                      4.308823
average_reward_test                  0.774591
round_time_test        0 days 00:00:09.986491
round_time_total       0 days 00:14:14.090007
loss_total                29709842851628580.0
loss_critic               37137302919753760.0
loss_actor                      -626995686.56
memory_size                            9297.0 

=== epoch 7/10 ===== round 8/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:24,  2.31it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:14<00:00,  2.34it/s]
episodes                                  811
episode_length                      12.313194
returns                              9.810592
return_std                           4.856569
average_reward                       0.796787
round_time             0 days 00:14:15.258262
episodes_test                           846.0
episode_length_test                 11.820331
returns_test                          9.16811
return_std_test                      3.945557
average_reward_test                  0.775622
round_time_test        0 days 00:00:10.069042
round_time_total       0 days 00:14:15.259349
loss_total                30628719364262592.0
loss_critic               38285898580544720.0
loss_actor                      -635246467.36
memory_size                            9297.0 

=== epoch 7/10 ===== round 9/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:16,  2.33it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:14<00:00,  2.34it/s]
episodes                                  839
episode_length                      11.898689
returns                              9.456357
return_std                           4.248413
average_reward                       0.794971
round_time             0 days 00:14:14.771245
episodes_test                           904.0
episode_length_test                 11.051991
returns_test                         8.741024
return_std_test                      3.442878
average_reward_test                  0.791015
round_time_test        0 days 00:00:10.083443
round_time_total       0 days 00:14:14.772536
loss_total                31584699036899212.0
loss_critic               39480873116579656.0
loss_actor                     -643847483.776
memory_size                            9297.0 

=== epoch 7/10 ===== round 10/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:06,  2.36it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.34it/s]
episodes                                  857
episode_length                       11.65811
returns                              9.267841
return_std                           3.843967
average_reward                       0.795223
round_time             0 days 00:14:16.763344
episodes_test                           836.0
episode_length_test                 11.961722
returns_test                         9.646041
return_std_test                      4.103711
average_reward_test                  0.806409
round_time_test        0 days 00:00:10.125001
round_time_total       0 days 00:14:16.764410
loss_total                32450421657585056.0
loss_critic               40563026414985544.0
loss_actor                     -653815681.216
memory_size                            9297.0 

=== epoch 7/10 ===== round 11/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:51,  2.24it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:13<00:00,  2.34it/s]
episodes                                  849
episode_length                      11.767962
returns                              9.381851
return_std                           4.075307
average_reward                       0.797178
round_time             0 days 00:14:14.295998
episodes_test                           883.0
episode_length_test                 11.321631
returns_test                         9.062224
return_std_test                      3.779448
average_reward_test                  0.800492
round_time_test        0 days 00:00:10.256060
round_time_total       0 days 00:14:14.297069
loss_total                34393904259998416.0
loss_critic               42992379546400984.0
loss_actor                      -665136522.88
memory_size                         9307.4445 

=== epoch 7/10 ===== round 12/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:53,  2.23it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.34it/s]
episodes                                  858
episode_length                      11.644522
returns                               9.31561
return_std                           4.157336
average_reward                       0.800087
round_time             0 days 00:14:16.586722
episodes_test                           817.0
episode_length_test                 12.235006
returns_test                         9.994772
return_std_test                      5.221155
average_reward_test                  0.816902
round_time_test        0 days 00:00:10.107733
round_time_total       0 days 00:14:16.588161
loss_total                35561896280324048.0
loss_critic               44452369602543880.0
loss_actor                      -677129485.44
memory_size                         9321.2465 

=== epoch 7/10 ===== round 13/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:15,  2.33it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.34it/s]
episodes                                  856
episode_length                       11.65771
returns                              9.400169
return_std                           4.219642
average_reward                       0.806831
round_time             0 days 00:14:16.796082
episodes_test                           840.0
episode_length_test                 11.892857
returns_test                         9.337896
return_std_test                      4.244412
average_reward_test                  0.785223
round_time_test        0 days 00:00:09.985566
round_time_total       0 days 00:14:16.797326
loss_total                35974870643324748.0
loss_critic               44968587528645904.0
loss_actor                     -685400625.248
memory_size                         9325.9625 

=== epoch 7/10 ===== round 14/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:09,  2.35it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:15<00:00,  2.34it/s]
episodes                                  859
episode_length                      11.636787
returns                              9.351801
return_std                           4.177431
average_reward                       0.803511
round_time             0 days 00:14:15.974619
episodes_test                           870.0
episode_length_test                 11.489655
returns_test                         8.940474
return_std_test                      3.590333
average_reward_test                  0.778236
round_time_test        0 days 00:00:09.939382
round_time_total       0 days 00:14:15.975711
loss_total                37016696237320048.0
loss_critic               46270869455507552.0
loss_actor                     -690863043.488
memory_size                            9326.0 

=== epoch 7/10 ===== round 15/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:49,  2.41it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:15<00:00,  2.34it/s]
episodes                                  850
episode_length                      11.755294
returns                              9.467532
return_std                           4.377166
average_reward                       0.805665
round_time             0 days 00:14:15.867690
episodes_test                           796.0
episode_length_test                 12.559045
returns_test                        10.089777
return_std_test                      5.853173
average_reward_test                  0.803389
round_time_test        0 days 00:00:09.982147
round_time_total       0 days 00:14:15.868763
loss_total                36999253844165656.0
loss_critic               46249066472788720.0
loss_actor                     -693167318.016
memory_size                            9326.0 

=== epoch 7/10 ===== round 16/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:06,  2.36it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.34it/s]
episodes                                  860
episode_length                      11.589535
returns                              9.322804
return_std                           4.220643
average_reward                       0.804413
round_time             0 days 00:14:16.807377
episodes_test                           770.0
episode_length_test                 12.964935
returns_test                        10.576468
return_std_test                      6.397194
average_reward_test                   0.81567
round_time_test        0 days 00:00:09.925678
round_time_total       0 days 00:14:16.808466
loss_total                36890106312181944.0
loss_critic               46112632041300296.0
loss_actor                     -694540121.408
memory_size                         9329.5325 

=== epoch 7/10 ===== round 17/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:48,  2.25it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:15<00:00,  2.34it/s]
episodes                                  848
episode_length                      11.767689
returns                              9.468071
return_std                           4.273292
average_reward                       0.804902
round_time             0 days 00:14:16.291386
episodes_test                           817.0
episode_length_test                 12.231334
returns_test                        10.010018
return_std_test                      5.308916
average_reward_test                   0.81857
round_time_test        0 days 00:00:10.158083
round_time_total       0 days 00:14:16.292733
loss_total                37049064033206928.0
loss_critic               46311329145873760.0
loss_actor                     -700271830.624
memory_size                            9335.0 

=== epoch 7/10 ===== round 18/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:36,  2.28it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.34it/s]
episodes                                  842
episode_length                       11.86342
returns                              9.538438
return_std                           4.491943
average_reward                       0.804238
round_time             0 days 00:14:16.588358
episodes_test                           751.0
episode_length_test                 13.304927
returns_test                        10.728728
return_std_test                        6.6455
average_reward_test                   0.80659
round_time_test        0 days 00:00:09.842267
round_time_total       0 days 00:14:16.589453
loss_total                37301781270945072.0
loss_critic               46627225739619992.0
loss_actor                     -704038924.896
memory_size                         9346.9175 

=== epoch 7/10 ===== round 19/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:22,  2.31it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.33it/s]
episodes                                  828
episode_length                      12.044686
returns                              9.704338
return_std                           4.862334
average_reward                       0.806181
round_time             0 days 00:14:17.109416
episodes_test                           824.0
episode_length_test                 12.135922
returns_test                         9.423626
return_std_test                      4.137963
average_reward_test                  0.776507
round_time_test        0 days 00:00:10.078029
round_time_total       0 days 00:14:17.110498
loss_total                37736261218096648.0
loss_critic               47170325677049120.0
loss_actor                     -706386266.848
memory_size                            9350.0 

=== epoch 7/10 ===== round 20/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:23,  2.31it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:14<00:00,  2.34it/s]
episodes                                  830
episode_length                      12.037349
returns                              9.622778
return_std                            5.13507
average_reward                       0.799649
round_time             0 days 00:14:15.124965
episodes_test                           798.0
episode_length_test                 12.527569
returns_test                         9.947977
return_std_test                      4.832271
average_reward_test                  0.794141
round_time_test        0 days 00:00:10.172051
round_time_total       0 days 00:14:15.126242
loss_total                38484026928368976.0
loss_critic               48105032859852472.0
loss_actor                     -712425403.968
memory_size                         9363.3105 

=== epoch 7/10 ===== round 21/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:33,  2.14it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.33it/s]
episodes                                  832
episode_length                      12.001202
returns                               9.52271
return_std                           4.954904
average_reward                       0.793489
round_time             0 days 00:14:17.465032
episodes_test                           849.0
episode_length_test                 11.776207
returns_test                         9.098437
return_std_test                      4.281315
average_reward_test                  0.772648
round_time_test        0 days 00:00:09.905644
round_time_total       0 days 00:14:17.466354
loss_total                38953469956398776.0
loss_critic               48691836567177656.0
loss_actor                     -720374814.656
memory_size                            9365.0 

=== epoch 7/10 ===== round 22/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:23,  2.31it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:14<00:00,  2.34it/s]
episodes                                  823
episode_length                      12.136087
returns                              9.546413
return_std                           4.866242
average_reward                       0.786807
round_time             0 days 00:14:15.074649
episodes_test                           809.0
episode_length_test                 12.355995
returns_test                         9.391704
return_std_test                      4.367136
average_reward_test                  0.760184
round_time_test        0 days 00:00:10.144560
round_time_total       0 days 00:14:15.075728
loss_total                38653250681014584.0
loss_critic               48316562483819056.0
loss_actor                     -718425876.288
memory_size                            9365.0 

=== epoch 7/10 ===== round 23/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:39,  2.27it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:18<00:00,  2.33it/s]
episodes                                  839
episode_length                      11.908224
returns                              9.231044
return_std                           4.663098
average_reward                       0.775264
round_time             0 days 00:14:18.913142
episodes_test                           866.0
episode_length_test                 11.545035
returns_test                         8.625977
return_std_test                      3.572238
average_reward_test                  0.747193
round_time_test        0 days 00:00:09.958175
round_time_total       0 days 00:14:18.914210
loss_total                38711019065424480.0
loss_critic               48388772962586592.0
loss_actor                      -721814332.16
memory_size                            9365.0 

=== epoch 7/10 ===== round 24/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:37,  2.28it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:14<00:00,  2.34it/s]
episodes                                  847
episode_length                      11.782763
returns                              9.075141
return_std                           4.248322
average_reward                       0.770421
round_time             0 days 00:14:15.363675
episodes_test                           892.0
episode_length_test                 11.209641
returns_test                         8.397967
return_std_test                       3.40153
average_reward_test                  0.749196
round_time_test        0 days 00:00:09.901808
round_time_total       0 days 00:14:15.364764
loss_total                39387262098897632.0
loss_critic               49234076749327760.0
loss_actor                     -730551292.576
memory_size                            9365.0 

=== epoch 7/10 ===== round 25/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<14:35,  2.28it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  845
episode_length                      11.827219
returns                              9.120374
return_std                           3.995804
average_reward                       0.771002
round_time             0 days 00:14:17.835116
episodes_test                           819.0
episode_length_test                 12.199023
returns_test                          9.54129
return_std_test                      4.423425
average_reward_test                  0.782269
round_time_test        0 days 00:00:09.944004
round_time_total       0 days 00:14:17.836242
loss_total                41184175623399016.0
loss_critic               51480218622205360.0
loss_actor                     -735682024.384
memory_size                          9369.023 

=== epoch 7/10 ===== round 26/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:08,  2.20it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:19<00:00,  2.33it/s]
episodes                                  856
episode_length                       11.67757
returns                              9.083542
return_std                           3.895976
average_reward                       0.777799
round_time             0 days 00:14:20.142757
episodes_test                           853.0
episode_length_test                 11.710434
returns_test                         9.175494
return_std_test                      4.465815
average_reward_test                  0.783576
round_time_test        0 days 00:00:09.904481
round_time_total       0 days 00:14:20.143826
loss_total                41515925804186336.0
loss_critic               51894906356108360.0
loss_actor                     -745289514.528
memory_size                            9373.0 

=== epoch 7/10 ===== round 27/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:32,  2.29it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  856
episode_length                      11.640187
returns                              9.147231
return_std                           4.409833
average_reward                       0.786394
round_time             0 days 00:14:17.774416
episodes_test                           830.0
episode_length_test                 12.040964
returns_test                           9.4561
return_std_test                      4.355579
average_reward_test                  0.785359
round_time_test        0 days 00:00:10.051380
round_time_total       0 days 00:14:17.775502
loss_total                42863940223377608.0
loss_critic               53579924378621048.0
loss_actor                      -747095220.16
memory_size                         9373.2425 

=== epoch 7/10 ===== round 28/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:50,  2.24it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:18<00:00,  2.33it/s]
episodes                                  816
episode_length                      12.229167
returns                              9.882427
return_std                           5.913065
average_reward                       0.808068
round_time             0 days 00:14:19.452803
episodes_test                           761.0
episode_length_test                 13.131406
returns_test                        10.974071
return_std_test                      8.594671
average_reward_test                  0.835769
round_time_test        0 days 00:00:09.886096
round_time_total       0 days 00:14:19.453904
loss_total                43181299259930576.0
loss_critic               53976623124114832.0
loss_actor                     -748569857.504
memory_size                          9431.794 

=== epoch 7/10 ===== round 29/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:50,  2.24it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:16<00:00,  2.33it/s]
episodes                                  795
episode_length                      12.573585
returns                             10.388903
return_std                           7.373551
average_reward                       0.826469
round_time             0 days 00:14:17.076008
episodes_test                           754.0
episode_length_test                 13.257294
returns_test                        10.902757
return_std_test                      7.616916
average_reward_test                   0.82247
round_time_test        0 days 00:00:09.685278
round_time_total       0 days 00:14:17.077098
loss_total                44157095409159768.0
loss_critic               55196368301524520.0
loss_actor                     -753643847.968
memory_size                          9480.529 

=== epoch 7/10 ===== round 30/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:03,  2.21it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:18<00:00,  2.33it/s]
episodes                                  794
episode_length                      12.571788
returns                             10.380909
return_std                           7.350721
average_reward                       0.826001
round_time             0 days 00:14:18.908233
episodes_test                           780.0
episode_length_test                 12.815385
returns_test                        10.395133
return_std_test                      6.138801
average_reward_test                  0.811219
round_time_test        0 days 00:00:09.912509
round_time_total       0 days 00:14:18.909319
loss_total                44687755348551928.0
loss_critic               55859693216906344.0
loss_actor                     -763110155.584
memory_size                         9499.0195 

=== epoch 7/10 ===== round 31/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:53,  2.24it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  756
episode_length                      13.218254
returns                             10.950266
return_std                           7.890931
average_reward                       0.828435
round_time             0 days 00:14:18.032730
episodes_test                           760.0
episode_length_test                 13.144737
returns_test                        10.659596
return_std_test                      6.450401
average_reward_test                  0.810928
round_time_test        0 days 00:00:09.657374
round_time_total       0 days 00:14:18.033815
loss_total                45537464587401560.0
loss_critic               56921829791238192.0
loss_actor                     -762687064.128
memory_size                          9505.617 

=== epoch 7/10 ===== round 32/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:59,  2.22it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:18<00:00,  2.33it/s]
episodes                                  741
episode_length                      13.469636
returns                             11.205285
return_std                            7.83061
average_reward                       0.832649
round_time             0 days 00:14:18.551963
episodes_test                           669.0
episode_length_test                 14.893871
returns_test                        12.714834
return_std_test                      8.973631
average_reward_test                  0.853643
round_time_test        0 days 00:00:09.772888
round_time_total       0 days 00:14:18.553044
loss_total                45408849025763904.0
loss_critic               56761060282282800.0
loss_actor                     -766402716.768
memory_size                            9508.0 

=== epoch 7/10 ===== round 33/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:58,  2.22it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:18<00:00,  2.33it/s]
episodes                                  756
episode_length                      13.208995
returns                              10.85614
return_std                           6.929599
average_reward                       0.822147
round_time             0 days 00:14:18.677157
episodes_test                           792.0
episode_length_test                 12.618687
returns_test                         9.988443
return_std_test                      4.875863
average_reward_test                   0.79166
round_time_test        0 days 00:00:10.049800
round_time_total       0 days 00:14:18.678261
loss_total                45961052829276704.0
loss_critic               57451315030231352.0
loss_actor                     -775560425.696
memory_size                          9514.722 

=== epoch 7/10 ===== round 34/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:00,  2.22it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:18<00:00,  2.33it/s]
episodes                                  771
episode_length                      12.950713
returns                             10.403148
return_std                           5.388845
average_reward                       0.803188
round_time             0 days 00:14:19.060122
episodes_test                           814.0
episode_length_test                 12.277641
returns_test                         9.596826
return_std_test                      4.378404
average_reward_test                  0.781747
round_time_test        0 days 00:00:10.123644
round_time_total       0 days 00:14:19.061208
loss_total                46562024940074176.0
loss_critic               58202530114101576.0
loss_actor                     -785365014.784
memory_size                            9516.0 

=== epoch 7/10 ===== round 35/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:53,  2.40it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  775
episode_length                      12.885161
returns                             10.369773
return_std                           5.446112
average_reward                       0.804811
round_time             0 days 00:14:18.400289
episodes_test                           795.0
episode_length_test                 12.577358
returns_test                         9.634938
return_std_test                      4.180526
average_reward_test                  0.766077
round_time_test        0 days 00:00:10.016750
round_time_total       0 days 00:14:18.401412
loss_total                47695416631922528.0
loss_critic               59619269760453184.0
loss_actor                      -792717426.88
memory_size                          9518.934 

=== epoch 7/10 ===== round 36/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:32,  1.90it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:21<00:00,  2.32it/s]
episodes                                  796
episode_length                       12.53392
returns                              9.974715
return_std                           4.946943
average_reward                       0.795526
round_time             0 days 00:14:21.529025
episodes_test                           870.0
episode_length_test                 11.489655
returns_test                         9.074798
return_std_test                      4.071894
average_reward_test                  0.789779
round_time_test        0 days 00:00:10.147317
round_time_total       0 days 00:14:21.530112
loss_total                48648612809269048.0
loss_critic               60810765050318944.0
loss_actor                      -799935562.24
memory_size                          9543.428 

=== epoch 7/10 ===== round 37/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:39,  2.27it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:22<00:00,  2.32it/s]
episodes                                  821
episode_length                      12.155907
returns                              9.536591
return_std                           4.614504
average_reward                       0.784072
round_time             0 days 00:14:22.733839
episodes_test                           872.0
episode_length_test                 11.462156
returns_test                         8.890659
return_std_test                      3.718429
average_reward_test                  0.775741
round_time_test        0 days 00:00:09.839240
round_time_total       0 days 00:14:22.735288
loss_total                49007242827593152.0
loss_critic               61259052515242016.0
loss_actor                     -805107460.064
memory_size                          9553.891 

=== epoch 7/10 ===== round 38/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:07,  2.36it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:17<00:00,  2.33it/s]
episodes                                  827
episode_length                       12.07497
returns                              9.418634
return_std                           4.518662
average_reward                        0.78026
round_time             0 days 00:14:18.311404
episodes_test                           855.0
episode_length_test                 11.677193
returns_test                         9.055912
return_std_test                      3.978411
average_reward_test                  0.775414
round_time_test        0 days 00:00:10.019410
round_time_total       0 days 00:14:18.312486
loss_total                49983090975991400.0
loss_critic               62478862637925928.0
loss_actor                     -813288860.832
memory_size                         9560.9175 

=== epoch 7/10 ===== round 39/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:43,  2.26it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:15<00:00,  2.34it/s]
episodes                                  831
episode_length                      12.024067
returns                              9.368326
return_std                            4.63414
average_reward                       0.779182
round_time             0 days 00:14:15.886014
episodes_test                           837.0
episode_length_test                 11.936679
returns_test                         9.453855
return_std_test                      4.297021
average_reward_test                  0.792026
round_time_test        0 days 00:00:09.985190
round_time_total       0 days 00:14:15.887089
loss_total                51336422843331120.0
loss_critic               64170527477737720.0
loss_actor                     -823834517.792
memory_size                         9564.8515 

=== epoch 7/10 ===== round 40/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:43,  2.26it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:12<00:00,  2.35it/s]
episodes                                  829
episode_length                      12.043426
returns                              9.364613
return_std                           4.527395
average_reward                       0.777669
round_time             0 days 00:14:12.782865
episodes_test                           836.0
episode_length_test                 11.947368
returns_test                         9.326826
return_std_test                      4.660004
average_reward_test                  0.781094
round_time_test        0 days 00:00:10.194729
round_time_total       0 days 00:14:12.784370
loss_total                52443498256407728.0
loss_critic               65554371683953936.0
loss_actor                     -824440600.576
memory_size                            9566.0 

=== epoch 7/10 ===== round 41/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:16,  2.33it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:11<00:00,  2.35it/s]
episodes                                  829
episode_length                       12.04222
returns                              9.471797
return_std                           4.798144
average_reward                       0.786175
round_time             0 days 00:14:11.703517
episodes_test                           804.0
episode_length_test                 12.435323
returns_test                         9.714957
return_std_test                      4.436112
average_reward_test                  0.781271
round_time_test        0 days 00:00:09.950050
round_time_total       0 days 00:14:11.704605
loss_total                52245445006086632.0
loss_critic               65306805162660072.0
loss_actor                     -825745115.424
memory_size                         9567.3495 

=== epoch 7/10 ===== round 42/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:26,  2.31it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [13:47<00:00,  2.42it/s]
episodes                                  819
episode_length                      12.200244
returns                              9.676136
return_std                           5.070679
average_reward                       0.793138
round_time             0 days 00:13:47.725763
episodes_test                           762.0
episode_length_test                 13.106299
returns_test                        10.898057
return_std_test                      7.052405
average_reward_test                  0.831409
round_time_test        0 days 00:00:09.818409
round_time_total       0 days 00:13:47.726825
loss_total                53059592943296312.0
loss_critic               66324490116115992.0
loss_actor                     -831070564.864
memory_size                         9582.5745 

=== epoch 7/10 ===== round 43/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:43,  2.61it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:04<00:00,  2.76it/s]
episodes                                  802
episode_length                      12.452618
returns                             10.105461
return_std                           5.873409
average_reward                        0.81169
round_time             0 days 00:12:04.891474
episodes_test                           750.0
episode_length_test                 13.322667
returns_test                        11.321426
return_std_test                      7.965366
average_reward_test                  0.849661
round_time_test        0 days 00:00:09.369014
round_time_total       0 days 00:12:04.892529
loss_total                54059795752064912.0
loss_critic               67574743561846912.0
loss_actor                     -825686198.464
memory_size                          9591.601 

=== epoch 7/10 ===== round 44/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:24,  2.68it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:01<00:00,  2.77it/s]
episodes                                  771
episode_length                      12.954604
returns                             10.775792
return_std                           6.584566
average_reward                       0.832047
round_time             0 days 00:12:02.178284
episodes_test                           716.0
episode_length_test                 13.948324
returns_test                        12.179815
return_std_test                       8.52807
average_reward_test                   0.87284
round_time_test        0 days 00:00:09.184393
round_time_total       0 days 00:12:02.179335
loss_total                53311991110598392.0
loss_critic               66639987812627120.0
loss_actor                     -827212753.856
memory_size                         9613.6185 

=== epoch 7/10 ===== round 45/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:40,  2.43it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:06<00:00,  2.75it/s]
episodes                                  770
episode_length                      12.963636
returns                              10.86022
return_std                           6.691769
average_reward                       0.838038
round_time             0 days 00:12:07.450300
episodes_test                           772.0
episode_length_test                 12.949482
returns_test                        10.716349
return_std_test                      5.852995
average_reward_test                  0.827594
round_time_test        0 days 00:00:09.445760
round_time_total       0 days 00:12:07.451395
loss_total                53882642549193048.0
loss_critic               67353302064967976.0
loss_actor                     -828285936.128
memory_size                            9621.0 

=== epoch 7/10 ===== round 46/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:57,  2.38it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:04<00:00,  2.76it/s]
episodes                                  760
episode_length                      13.142105
returns                             11.024134
return_std                           6.603218
average_reward                       0.838878
round_time             0 days 00:12:04.796129
episodes_test                           777.0
episode_length_test                 12.866152
returns_test                         10.80487
return_std_test                      5.669807
average_reward_test                  0.839811
round_time_test        0 days 00:00:09.615021
round_time_total       0 days 00:12:04.797185
loss_total                53656858726561216.0
loss_critic               67071072313253296.0
loss_actor                     -834245895.648
memory_size                            9621.0 

=== epoch 7/10 ===== round 47/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:00,  2.56it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:03<00:00,  2.77it/s]
episodes                                  751
episode_length                      13.306258
returns                             11.220137
return_std                           6.558932
average_reward                       0.843161
round_time             0 days 00:12:03.782308
episodes_test                           767.0
episode_length_test                 13.026076
returns_test                        10.930226
return_std_test                      6.448298
average_reward_test                  0.839304
round_time_test        0 days 00:00:09.341269
round_time_total       0 days 00:12:03.783353
loss_total                53978456866844312.0
loss_critic               67473070000418328.0
loss_actor                     -841587402.016
memory_size                          9623.818 

=== epoch 7/10 ===== round 48/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:11,  2.73it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:06<00:00,  2.75it/s]
episodes                                  757
episode_length                      13.199472
returns                             11.026299
return_std                           6.190647
average_reward                       0.835295
round_time             0 days 00:12:07.106963
episodes_test                           737.0
episode_length_test                 13.567164
returns_test                        11.880919
return_std_test                      7.783378
average_reward_test                  0.875722
round_time_test        0 days 00:00:09.277041
round_time_total       0 days 00:12:07.108026
loss_total                54930090188269944.0
loss_critic               68662611528988488.0
loss_actor                     -842349224.448
memory_size                          9630.872 

=== epoch 7/10 ===== round 49/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:38,  2.63it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:04<00:00,  2.76it/s]
episodes                                  776
episode_length                      12.864691
returns                             10.542498
return_std                           5.383844
average_reward                        0.81954
round_time             0 days 00:12:05.322009
episodes_test                           821.0
episode_length_test                 12.163216
returns_test                         9.928373
return_std_test                      4.723363
average_reward_test                  0.816445
round_time_test        0 days 00:00:09.365648
round_time_total       0 days 00:12:05.323060
loss_total                55098207126769632.0
loss_critic               68872757804118576.0
loss_actor                      -850492895.04
memory_size                         9638.7675 

=== epoch 7/10 ===== round 50/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<12:36,  2.64it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:06<00:00,  2.75it/s]
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
episodes                                  782
episode_length                      12.765985
returns                             10.407829
return_std                           5.255196
average_reward                       0.815383
round_time             0 days 00:12:07.315545
episodes_test                           850.0
episode_length_test                 11.763529
returns_test                         9.527018
return_std_test                      4.760577
average_reward_test                  0.809894
round_time_test        0 days 00:00:09.480107
round_time_total       0 days 00:12:07.316602
loss_total                55649417279934824.0
loss_critic               69561770462557504.0
loss_actor                     -860017699.136
memory_size                            9642.0 


<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
=== epoch 8/10 ===== round 1/50 ======================================
  0%|          | 5/2000 [00:01<12:47,  2.60it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:58<00:00,  2.78it/s]
episodes                                  173
episode_length                      11.549133
returns                              9.315612
return_std                           3.607805
average_reward                       0.806811
round_time             0 days 00:11:58.286187
episodes_test                           865.0
episode_length_test                 11.553757
returns_test                         9.100394
return_std_test                      3.627644
average_reward_test                   0.78765
round_time_test        0 days 00:00:09.617487
round_time_total       0 days 00:11:58.287277
loss_total                57039926169440352.0
loss_critic               71299906529610696.0
loss_actor                     -869328145.024
memory_size                            9642.0 

=== epoch 8/10 ===== round 2/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<12:23,  2.69it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [13:41<00:00,  2.43it/s]
episodes                                  350
episode_length                      11.405714
returns                              9.120986
return_std                           4.108112
average_reward                       0.799976
round_time             0 days 00:13:42.079671
episodes_test                           866.0
episode_length_test                  11.54157
returns_test                         9.020116
return_std_test                      3.600219
average_reward_test                  0.781474
round_time_test        0 days 00:00:09.484530
round_time_total       0 days 00:13:42.080729
loss_total                57753663388013032.0
loss_critic               72192078062490224.0
loss_actor                     -881636368.544
memory_size                         9642.6405 

=== epoch 8/10 ===== round 3/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:26,  2.47it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:02<00:00,  2.77it/s]
episodes                                  531
episode_length                      11.263653
returns                              8.909986
return_std                           3.779865
average_reward                        0.79059
round_time             0 days 00:12:03.319488
episodes_test                           891.0
episode_length_test                 11.210999
returns_test                         8.879866
return_std_test                      3.872099
average_reward_test                  0.792172
round_time_test        0 days 00:00:09.602606
round_time_total       0 days 00:12:03.320554
loss_total                59690010278073728.0
loss_critic               74612511548632992.0
loss_actor                     -889827793.184
memory_size                          9644.265 

=== epoch 8/10 ===== round 4/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:42,  2.62it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:26<00:00,  2.31it/s]
episodes                                  706
episode_length                      11.328612
returns                               8.91374
return_std                           3.668463
average_reward                       0.786884
round_time             0 days 00:14:27.121655
episodes_test                           897.0
episode_length_test                 11.140468
returns_test                         8.905944
return_std_test                      4.317567
average_reward_test                  0.799443
round_time_test        0 days 00:00:09.878673
round_time_total       0 days 00:14:27.123020
loss_total                61601074182795296.0
loss_critic               77001341437051136.0
loss_actor                     -901855480.832
memory_size                         9648.4845 

=== epoch 8/10 ===== round 5/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 2/2000 [00:01<20:42,  1.61it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:17<00:00,  2.18it/s]
episodes                                  885
episode_length                      11.284746
returns                              8.844294
return_std                           3.536209
average_reward                       0.784015
round_time             0 days 00:15:18.344380
episodes_test                           909.0
episode_length_test                   10.9967
returns_test                         8.387143
return_std_test                      3.319902
average_reward_test                  0.762779
round_time_test        0 days 00:00:11.497614
round_time_total       0 days 00:15:18.345441
loss_total                61516819929608752.0
loss_critic               76896023560438416.0
loss_actor                     -905021897.088
memory_size                            9649.0 

=== epoch 8/10 ===== round 6/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:26,  2.68it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:59<00:00,  2.78it/s]
episodes                                  886
episode_length                      11.265237
returns                              8.842821
return_std                            3.63063
average_reward                       0.785199
round_time             0 days 00:11:59.481331
episodes_test                           930.0
episode_length_test                 10.750538
returns_test                         8.370773
return_std_test                      2.957591
average_reward_test                  0.778679
round_time_test        0 days 00:00:09.777669
round_time_total       0 days 00:11:59.482393
loss_total                62620099613797912.0
loss_critic               78275123216140736.0
loss_actor                     -906311402.208
memory_size                         9654.8055 

=== epoch 8/10 ===== round 7/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:30,  2.66it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:57<00:00,  2.79it/s]
episodes                                  883
episode_length                      11.309173
returns                              8.843161
return_std                           3.405973
average_reward                       0.781923
round_time             0 days 00:11:58.362515
episodes_test                           836.0
episode_length_test                  11.95933
returns_test                         9.651001
return_std_test                      4.769868
average_reward_test                  0.807007
round_time_test        0 days 00:00:09.539082
round_time_total       0 days 00:11:58.363583
loss_total                65030636512816920.0
loss_critic               81288294210260176.0
loss_actor                     -925526137.216
memory_size                            9666.0 

=== epoch 8/10 ===== round 8/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:35,  2.64it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:57<00:00,  2.79it/s]
episodes                                  868
episode_length                      11.504608
returns                              8.983851
return_std                           3.640654
average_reward                       0.780868
round_time             0 days 00:11:58.291889
episodes_test                           828.0
episode_length_test                 12.070048
returns_test                         9.637828
return_std_test                      4.158245
average_reward_test                  0.798478
round_time_test        0 days 00:00:09.334751
round_time_total       0 days 00:11:58.292953
loss_total                67956136968043104.0
loss_critic               84945169791104064.0
loss_actor                     -941151554.912
memory_size                         9666.2615 

=== epoch 8/10 ===== round 9/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:59,  2.56it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:59<00:00,  2.78it/s]
episodes                                  868
episode_length                      11.504608
returns                              9.002288
return_std                             3.8667
average_reward                        0.78277
round_time             0 days 00:11:59.503387
episodes_test                           825.0
episode_length_test                 12.118788
returns_test                         9.734264
return_std_test                      5.296507
average_reward_test                  0.803241
round_time_test        0 days 00:00:09.516402
round_time_total       0 days 00:11:59.504453
loss_total                70293460314788728.0
loss_critic               87866823805690176.0
loss_actor                     -953523840.832
memory_size                            9667.0 

=== epoch 8/10 ===== round 10/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<12:40,  2.63it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:58<00:00,  2.79it/s]
episodes                                  855
episode_length                      11.688889
returns                               9.23634
return_std                           4.191399
average_reward                       0.790224
round_time             0 days 00:11:58.564561
episodes_test                           869.0
episode_length_test                 11.502877
returns_test                         9.134826
return_std_test                       4.45544
average_reward_test                  0.794158
round_time_test        0 days 00:00:09.711718
round_time_total       0 days 00:11:58.565630
loss_total                71585052762761592.0
loss_critic               89481314422564592.0
loss_actor                     -971107600.864
memory_size                            9667.0 

=== epoch 8/10 ===== round 11/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:35,  2.64it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:56<00:00,  2.79it/s]
episodes                                  849
episode_length                      11.773852
returns                              9.226899
return_std                           4.107932
average_reward                       0.783686
round_time             0 days 00:11:56.961487
episodes_test                           868.0
episode_length_test                 11.519585
returns_test                         9.202495
return_std_test                      4.175868
average_reward_test                  0.798873
round_time_test        0 days 00:00:09.517974
round_time_total       0 days 00:11:56.962544
loss_total                74772078512916400.0
loss_critic               93465096599789104.0
loss_actor                     -985056860.352
memory_size                            9667.0 

=== epoch 8/10 ===== round 12/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:28,  2.67it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:30<00:00,  2.30it/s]
episodes                                  838
episode_length                      11.922434
returns                              9.327746
return_std                           4.260941
average_reward                       0.782013
round_time             0 days 00:14:31.067302
episodes_test                           844.0
episode_length_test                 11.847156
returns_test                         9.475897
return_std_test                      4.375416
average_reward_test                  0.799869
round_time_test        0 days 00:00:09.356664
round_time_total       0 days 00:14:31.068921
loss_total                77089098946884672.0
loss_critic               96361371956492112.0
loss_actor                     -996797938.112
memory_size                            9667.0 

=== epoch 8/10 ===== round 13/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:52,  1.86it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [18:13<00:00,  1.83it/s]
episodes                                  838
episode_length                      11.920048
returns                               9.29449
return_std                           4.345638
average_reward                       0.780129
round_time             0 days 00:18:13.929517
episodes_test                           800.0
episode_length_test                      12.5
returns_test                        10.143747
return_std_test                      5.711308
average_reward_test                    0.8115
round_time_test        0 days 00:00:10.507802
round_time_total       0 days 00:18:13.930789
loss_total                79646666323562336.0
loss_critic               99558331136000128.0
loss_actor                     -993278408.768
memory_size                            9667.0 

=== epoch 8/10 ===== round 14/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<18:43,  1.78it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [18:18<00:00,  1.82it/s]
episodes                                  829
episode_length                      12.048251
returns                              9.444923
return_std                            4.40561
average_reward                       0.784223
round_time             0 days 00:18:19.468316
episodes_test                           851.0
episode_length_test                 11.735605
returns_test                         9.273657
return_std_test                      3.989674
average_reward_test                  0.790263
round_time_test        0 days 00:00:10.601617
round_time_total       0 days 00:18:19.469611
loss_total                79510712147800752.0
loss_critic               99388388499244704.0
loss_actor                     -1008298006.08
memory_size                          9667.179 

=== epoch 8/10 ===== round 15/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<17:38,  1.89it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [18:18<00:00,  1.82it/s]
episodes                                  832
episode_length                      12.003606
returns                               9.39816
return_std                           4.330066
average_reward                       0.782947
round_time             0 days 00:18:19.450649
episodes_test                           839.0
episode_length_test                 11.914184
returns_test                         9.299219
return_std_test                      3.987263
average_reward_test                   0.78062
round_time_test        0 days 00:00:10.540531
round_time_total       0 days 00:18:19.451840
loss_total                81925446912421392.0
loss_critic              102406806825634624.0
loss_actor                    -1026343230.304
memory_size                          9670.412 

=== epoch 8/10 ===== round 16/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 2/2000 [00:01<18:47,  1.77it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [18:20<00:00,  1.82it/s]
episodes                                  821
episode_length                      12.169306
returns                              9.502296
return_std                           4.454001
average_reward                       0.780671
round_time             0 days 00:18:21.451263
episodes_test                           748.0
episode_length_test                 13.367647
returns_test                        10.291315
return_std_test                      5.204908
average_reward_test                  0.769897
round_time_test        0 days 00:00:10.533190
round_time_total       0 days 00:18:21.452445
loss_total                83843904212501008.0
loss_critic              104804878400268272.0
loss_actor                    -1037194165.952
memory_size                          9677.381 

=== epoch 8/10 ===== round 17/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<18:19,  1.82it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [18:13<00:00,  1.83it/s]
episodes                                  840
episode_length                      11.880952
returns                              9.265944
return_std                           4.231075
average_reward                        0.77989
round_time             0 days 00:18:13.983299
episodes_test                           805.0
episode_length_test                 12.412422
returns_test                         9.791739
return_std_test                       4.90994
average_reward_test                  0.788991
round_time_test        0 days 00:00:10.553993
round_time_total       0 days 00:18:13.984549
loss_total                85799979222013312.0
loss_critic              107249972252889840.0
loss_actor                    -1050299146.656
memory_size                            9680.0 

=== epoch 8/10 ===== round 18/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<16:40,  2.00it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [17:59<00:00,  1.85it/s]
episodes                                  844
episode_length                      11.824645
returns                              9.346612
return_std                           4.455117
average_reward                       0.790785
round_time             0 days 00:17:59.624364
episodes_test                           932.0
episode_length_test                 10.724249
returns_test                         8.299934
return_std_test                      3.030969
average_reward_test                     0.774
round_time_test        0 days 00:00:10.616998
round_time_total       0 days 00:17:59.625616
loss_total                88803867212331872.0
loss_critic              111004832144956592.0
loss_actor                    -1061846579.488
memory_size                          9686.087 

=== epoch 8/10 ===== round 19/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 2/2000 [00:01<18:42,  1.78it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [18:04<00:00,  1.84it/s]
episodes                                  843
episode_length                      11.846975
returns                              9.351886
return_std                            4.38446
average_reward                       0.789625
round_time             0 days 00:18:05.259617
episodes_test                           815.0
episode_length_test                 12.265031
returns_test                         9.774159
return_std_test                      4.717434
average_reward_test                  0.797014
round_time_test        0 days 00:00:10.719826
round_time_total       0 days 00:18:05.260803
loss_total                90493657359048512.0
loss_critic              113117069723662544.0
loss_actor                    -1076423619.552
memory_size                            9691.0 

=== epoch 8/10 ===== round 20/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<18:54,  1.76it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [17:57<00:00,  1.86it/s]
episodes                                  830
episode_length                      12.010843
returns                               9.47261
return_std                           4.386701
average_reward                       0.787612
round_time             0 days 00:17:58.496492
episodes_test                           790.0
episode_length_test                 12.632911
returns_test                        10.052069
return_std_test                      4.723904
average_reward_test                  0.795249
round_time_test        0 days 00:00:10.659011
round_time_total       0 days 00:17:58.497815
loss_total                92619141312680032.0
loss_critic              115773924645300864.0
loss_actor                     -1089586792.16
memory_size                            9691.0 

=== epoch 8/10 ===== round 21/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<18:01,  1.85it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [17:53<00:00,  1.86it/s]
episodes                                  836
episode_length                      11.944976
returns                              9.461922
return_std                           4.380184
average_reward                        0.79194
round_time             0 days 00:17:54.029003
episodes_test                           773.0
episode_length_test                 12.931436
returns_test                         10.20466
return_std_test                      5.061024
average_reward_test                  0.789183
round_time_test        0 days 00:00:10.521014
round_time_total       0 days 00:17:54.030058
loss_total                94385851710180432.0
loss_critic              117982312525138496.0
loss_actor                    -1101796792.224
memory_size                          9692.728 

=== epoch 8/10 ===== round 22/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:06,  2.54it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:34<00:00,  2.65it/s]
episodes                                  811
episode_length                      12.309494
returns                              9.770411
return_std                           4.928678
average_reward                       0.793934
round_time             0 days 00:12:35.172637
episodes_test                           800.0
episode_length_test                  12.47125
returns_test                         9.617246
return_std_test                      4.616198
average_reward_test                  0.771469
round_time_test        0 days 00:00:09.398150
round_time_total       0 days 00:12:35.173685
loss_total                97213325404874480.0
loss_critic              121516654655048784.0
loss_actor                     -1112411291.04
memory_size                         9696.4715 

=== epoch 8/10 ===== round 23/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:17,  2.71it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:01<00:00,  2.77it/s]
episodes                                  798
episode_length                      12.497494
returns                              9.833888
return_std                           4.725888
average_reward                       0.786524
round_time             0 days 00:12:01.818165
episodes_test                           772.0
episode_length_test                 12.949482
returns_test                        10.041706
return_std_test                      5.276554
average_reward_test                  0.775464
round_time_test        0 days 00:00:09.493423
round_time_total       0 days 00:12:01.819224
loss_total                98945041133622784.0
loss_critic              123681299278671648.0
loss_actor                    -1122118599.104
memory_size                            9707.0 

=== epoch 8/10 ===== round 24/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:39,  2.63it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:59<00:00,  2.78it/s]
episodes                                  791
episode_length                      12.629583
returns                              9.888085
return_std                           4.872345
average_reward                       0.782891
round_time             0 days 00:11:59.888994
episodes_test                           749.0
episode_length_test                 13.336449
returns_test                        10.091689
return_std_test                      4.884385
average_reward_test                  0.757048
round_time_test        0 days 00:00:09.374960
round_time_total       0 days 00:11:59.890058
loss_total               100088918976850032.0
loss_critic              125111146614381088.0
loss_actor                    -1128593408.608
memory_size                         9711.1025 

=== epoch 8/10 ===== round 25/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:05,  2.75it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:59<00:00,  2.78it/s]
episodes                                  798
episode_length                      12.516291
returns                              9.745193
return_std                           4.863169
average_reward                       0.778737
round_time             0 days 00:12:00.190375
episodes_test                           804.0
episode_length_test                 12.416667
returns_test                         9.595773
return_std_test                      4.495061
average_reward_test                  0.774064
round_time_test        0 days 00:00:09.452788
round_time_total       0 days 00:12:00.191434
loss_total               103148075930257200.0
loss_critic              128935092747621104.0
loss_actor                    -1142288493.248
memory_size                            9713.0 

=== epoch 8/10 ===== round 26/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:32,  2.65it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:58<00:00,  2.78it/s]
episodes                                  801
episode_length                      12.478152
returns                              9.720759
return_std                           4.766802
average_reward                       0.779111
round_time             0 days 00:11:59.406785
episodes_test                           790.0
episode_length_test                 12.656962
returns_test                         9.975532
return_std_test                      4.625026
average_reward_test                  0.788166
round_time_test        0 days 00:00:09.417446
round_time_total       0 days 00:11:59.407839
loss_total               104905814448166400.0
loss_critic              131132265935272928.0
loss_actor                    -1151126140.288
memory_size                            9713.0 

=== epoch 8/10 ===== round 27/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:58,  2.57it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:00<00:00,  2.78it/s]
episodes                                  814
episode_length                      12.262899
returns                              9.599943
return_std                           4.399303
average_reward                       0.783585
round_time             0 days 00:12:00.641119
episodes_test                           801.0
episode_length_test                 12.478152
returns_test                        10.010705
return_std_test                       4.81986
average_reward_test                  0.802182
round_time_test        0 days 00:00:09.444915
round_time_total       0 days 00:12:00.642186
loss_total               106800649187599840.0
loss_critic              133500809237158160.0
loss_actor                    -1160628914.176
memory_size                            9713.0 

=== epoch 8/10 ===== round 28/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:03,  2.55it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:00<00:00,  2.78it/s]
episodes                                  833
episode_length                      11.993998
returns                              9.449415
return_std                           4.491517
average_reward                        0.78781
round_time             0 days 00:12:00.974428
episodes_test                           870.0
episode_length_test                 11.491954
returns_test                         9.166463
return_std_test                      3.999025
average_reward_test                  0.797675
round_time_test        0 days 00:00:09.529006
round_time_total       0 days 00:12:00.975504
loss_total               108581378162933360.0
loss_critic              135726720317275504.0
loss_actor                    -1170289863.872
memory_size                            9713.0 

=== epoch 8/10 ===== round 29/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:48,  2.60it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:01<00:00,  2.77it/s]
episodes                                  849
episode_length                      11.765607
returns                              9.359094
return_std                           4.401729
average_reward                       0.795265
round_time             0 days 00:12:01.639601
episodes_test                           885.0
episode_length_test                 11.292655
returns_test                         9.012011
return_std_test                      4.035742
average_reward_test                  0.798103
round_time_test        0 days 00:00:09.618581
round_time_total       0 days 00:12:01.640653
loss_total               110198247925401776.0
loss_critic              137747807589617376.0
loss_actor                    -1180904819.136
memory_size                         9714.3035 

=== epoch 8/10 ===== round 30/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:55,  2.57it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:08<00:00,  2.75it/s]
episodes                                  866
episode_length                      11.545035
returns                              9.180026
return_std                            4.19896
average_reward                       0.795186
round_time             0 days 00:12:08.842353
episodes_test                           918.0
episode_length_test                 10.891068
returns_test                         8.661485
return_std_test                      3.504853
average_reward_test                  0.795332
round_time_test        0 days 00:00:09.465538
round_time_total       0 days 00:12:08.843410
loss_total               111115109063823728.0
loss_critic              138893884015866016.0
loss_actor                    -1193307228.256
memory_size                            9724.0 

=== epoch 8/10 ===== round 31/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<12:43,  2.62it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:16<00:00,  2.72it/s]
episodes                                  892
episode_length                       11.19843
returns                              8.819782
return_std                           4.087186
average_reward                       0.787893
round_time             0 days 00:12:16.940681
episodes_test                           939.0
episode_length_test                 10.649627
returns_test                         8.277752
return_std_test                      2.866808
average_reward_test                  0.777281
round_time_test        0 days 00:00:09.566479
round_time_total       0 days 00:12:16.941745
loss_total               115428690797476704.0
loss_critic              144285861140519456.0
loss_actor                    -1207571130.432
memory_size                            9724.0 

=== epoch 8/10 ===== round 32/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<12:39,  2.63it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:08<00:00,  2.74it/s]
episodes                                  910
episode_length                      10.971429
returns                              8.605146
return_std                           3.770583
average_reward                       0.784589
round_time             0 days 00:12:09.209279
episodes_test                           924.0
episode_length_test                 10.819264
returns_test                         8.604272
return_std_test                      3.434481
average_reward_test                  0.795294
round_time_test        0 days 00:00:09.672227
round_time_total       0 days 00:12:09.210333
loss_total               118314973925650464.0
loss_critic              147893714923498240.0
loss_actor                    -1218324678.144
memory_size                            9724.0 

=== epoch 8/10 ===== round 33/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:05,  2.54it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:05<00:00,  2.76it/s]
episodes                                  898
episode_length                      11.122494
returns                              8.714802
return_std                           3.677609
average_reward                       0.783364
round_time             0 days 00:12:05.909763
episodes_test                           859.0
episode_length_test                 11.628638
returns_test                         9.037605
return_std_test                       5.58429
average_reward_test                  0.777278
round_time_test        0 days 00:00:09.587224
round_time_total       0 days 00:12:05.910811
loss_total               122373114835163408.0
loss_critic              152966391015292288.0
loss_actor                    -1233536660.512
memory_size                            9724.0 

=== epoch 8/10 ===== round 34/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:22,  2.49it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:03<00:00,  2.77it/s]
episodes                                  873
episode_length                      11.437572
returns                              8.900834
return_std                           4.123231
average_reward                       0.778296
round_time             0 days 00:12:03.722010
episodes_test                           832.0
episode_length_test                 12.018029
returns_test                         9.436681
return_std_test                      4.468609
average_reward_test                  0.785229
round_time_test        0 days 00:00:09.536359
round_time_total       0 days 00:12:03.723084
loss_total               124971454364299296.0
loss_critic              156214315281756992.0
loss_actor                    -1244142548.992
memory_size                           9739.15 

=== epoch 8/10 ===== round 35/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:53,  2.58it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:59<00:00,  2.78it/s]
episodes                                  862
episode_length                      11.587007
returns                              9.099246
return_std                           4.478555
average_reward                         0.7853
round_time             0 days 00:11:59.808459
episodes_test                           784.0
episode_length_test                 12.727041
returns_test                        10.291044
return_std_test                      7.788562
average_reward_test                  0.807855
round_time_test        0 days 00:00:09.476958
round_time_total       0 days 00:11:59.809535
loss_total               126601480870020768.0
loss_critic              158251848454174144.0
loss_actor                     -1251340629.76
memory_size                          9745.246 

=== epoch 8/10 ===== round 36/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:34,  2.65it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:00<00:00,  2.78it/s]
episodes                                  829
episode_length                      12.048251
returns                              9.498504
return_std                           4.742439
average_reward                       0.788642
round_time             0 days 00:12:01.025434
episodes_test                           805.0
episode_length_test                 12.416149
returns_test                          9.83392
return_std_test                      4.999825
average_reward_test                  0.792053
round_time_test        0 days 00:00:09.427080
round_time_total       0 days 00:12:01.026486
loss_total               129147354480975552.0
loss_critic              161434190373915200.0
loss_actor                    -1269059328.512
memory_size                          9750.462 

=== epoch 8/10 ===== round 37/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:18,  2.50it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:00<00:00,  2.77it/s]
episodes                                  811
episode_length                      12.320592
returns                              9.725835
return_std                           4.872428
average_reward                       0.789381
round_time             0 days 00:12:01.182374
episodes_test                           862.0
episode_length_test                 11.596288
returns_test                         9.140964
return_std_test                      3.688779
average_reward_test                  0.788367
round_time_test        0 days 00:00:09.426673
round_time_total       0 days 00:12:01.183437
loss_total               131903216097515536.0
loss_critic              164879017338755616.0
loss_actor                    -1285934710.528
memory_size                         9751.2235 

=== epoch 8/10 ===== round 38/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:32,  2.65it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:00<00:00,  2.78it/s]
episodes                                  829
episode_length                      12.048251
returns                              9.467633
return_std                           4.663555
average_reward                       0.786069
round_time             0 days 00:12:00.584918
episodes_test                           889.0
episode_length_test                 11.239595
returns_test                         8.640051
return_std_test                      3.330387
average_reward_test                  0.768651
round_time_test        0 days 00:00:09.428962
round_time_total       0 days 00:12:00.585977
loss_total               134009738154934800.0
loss_critic              167512169826240960.0
loss_actor                     -1303236565.12
memory_size                            9754.0 

=== epoch 8/10 ===== round 39/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:34,  2.64it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:59<00:00,  2.78it/s]
episodes                                  865
episode_length                      11.543353
returns                              9.038334
return_std                           3.978946
average_reward                       0.782672
round_time             0 days 00:11:59.699283
episodes_test                           933.0
episode_length_test                  10.71597
returns_test                         8.499697
return_std_test                      2.961163
average_reward_test                  0.793223
round_time_test        0 days 00:00:09.400228
round_time_total       0 days 00:11:59.700334
loss_total               138650644734252416.0
loss_critic              173313302756182720.0
loss_actor                    -1315372574.016
memory_size                            9754.0 

=== epoch 8/10 ===== round 40/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:51,  2.59it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:58<00:00,  2.79it/s]
episodes                                  877
episode_length                      11.380844
returns                              8.864113
return_std                           3.579575
average_reward                       0.778743
round_time             0 days 00:11:58.502282
episodes_test                           914.0
episode_length_test                 10.922319
returns_test                         8.636339
return_std_test                      3.113349
average_reward_test                  0.791164
round_time_test        0 days 00:00:09.468422
round_time_total       0 days 00:11:58.503351
loss_total               141338203661977776.0
loss_critic              176672751702528480.0
loss_actor                     -1328417113.92
memory_size                            9754.0 

=== epoch 8/10 ===== round 41/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:04,  2.54it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:58<00:00,  2.78it/s]
episodes                                  906
episode_length                      11.027594
returns                              8.633518
return_std                           3.226257
average_reward                       0.782721
round_time             0 days 00:11:58.953695
episodes_test                           929.0
episode_length_test                 10.756728
returns_test                         8.253049
return_std_test                      3.177648
average_reward_test                  0.767241
round_time_test        0 days 00:00:09.678431
round_time_total       0 days 00:11:58.954738
loss_total               143262576663179824.0
loss_critic              179078217770958048.0
loss_actor                    -1341314661.888
memory_size                            9754.0 

=== epoch 8/10 ===== round 42/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:24,  2.68it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:57<00:00,  2.79it/s]
episodes                                  917
episode_length                      10.897492
returns                              8.562131
return_std                           3.198701
average_reward                       0.785714
round_time             0 days 00:11:58.001864
episodes_test                           933.0
episode_length_test                 10.707395
returns_test                         8.374832
return_std_test                      2.996774
average_reward_test                  0.782451
round_time_test        0 days 00:00:09.609468
round_time_total       0 days 00:11:58.002913
loss_total               148221889629374112.0
loss_critic              185277358925013856.0
loss_actor                    -1355454109.824
memory_size                            9754.0 

=== epoch 8/10 ===== round 43/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:48,  2.60it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:58<00:00,  2.79it/s]
episodes                                  913
episode_length                      10.939759
returns                              8.638234
return_std                           3.486033
average_reward                       0.789602
round_time             0 days 00:11:58.579621
episodes_test                           906.0
episode_length_test                 11.037528
returns_test                          8.76608
return_std_test                      3.425998
average_reward_test                  0.794207
round_time_test        0 days 00:00:09.541046
round_time_total       0 days 00:11:58.580676
loss_total               149822601331885472.0
loss_critic              187278248385649312.0
loss_actor                    -1370161371.648
memory_size                            9754.0 

=== epoch 8/10 ===== round 44/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:51,  2.59it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:58<00:00,  2.79it/s]
episodes                                  903
episode_length                      11.059801
returns                              8.775806
return_std                           3.618511
average_reward                       0.793466
round_time             0 days 00:11:58.476909
episodes_test                           841.0
episode_length_test                 11.888228
returns_test                         9.621818
return_std_test                      5.131416
average_reward_test                  0.809389
round_time_test        0 days 00:00:09.335606
round_time_total       0 days 00:11:58.477963
loss_total               152696395214853504.0
loss_critic              190870490832238016.0
loss_actor                    -1381459909.952
memory_size                            9754.0 

=== epoch 8/10 ===== round 45/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:37,  2.64it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:57<00:00,  2.79it/s]
episodes                                  907
episode_length                      11.012128
returns                               8.72788
return_std                           3.700145
average_reward                       0.792523
round_time             0 days 00:11:58.072515
episodes_test                           920.0
episode_length_test                 10.863043
returns_test                         8.489191
return_std_test                      3.346015
average_reward_test                  0.781486
round_time_test        0 days 00:00:09.507645
round_time_total       0 days 00:11:58.073569
loss_total               154399545602521184.0
loss_critic              192999428467856512.0
loss_actor                    -1399167685.056
memory_size                            9754.0 

=== epoch 8/10 ===== round 46/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:32,  2.65it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:58<00:00,  2.78it/s]
episodes                                  881
episode_length                      11.348468
returns                              8.977183
return_std                           4.167338
average_reward                        0.79109
round_time             0 days 00:11:59.000799
episodes_test                           881.0
episode_length_test                 11.347333
returns_test                         8.892132
return_std_test                      4.041726
average_reward_test                  0.783709
round_time_test        0 days 00:00:09.316968
round_time_total       0 days 00:11:59.001844
loss_total               158043693529893440.0
loss_critic              197554613323921632.0
loss_actor                    -1411652463.232
memory_size                         9758.3815 

=== epoch 8/10 ===== round 47/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:07,  2.74it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:59<00:00,  2.78it/s]
episodes                                  878
episode_length                      11.361048
returns                              8.960503
return_std                           4.082745
average_reward                       0.788836
round_time             0 days 00:11:59.463596
episodes_test                           856.0
episode_length_test                 11.675234
returns_test                         9.374606
return_std_test                      4.294208
average_reward_test                  0.803021
round_time_test        0 days 00:00:09.458209
round_time_total       0 days 00:11:59.464656
loss_total               160555534307473504.0
loss_critic              200694414264758176.0
loss_actor                    -1423242243.456
memory_size                            9777.0 

=== epoch 8/10 ===== round 48/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:54,  2.58it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:00<00:00,  2.78it/s]
episodes                                  880
episode_length                      11.360227
returns                              8.963753
return_std                           3.930358
average_reward                       0.789065
round_time             0 days 00:12:00.782597
episodes_test                           929.0
episode_length_test                 10.763186
returns_test                         8.427664
return_std_test                      3.241108
average_reward_test                  0.783026
round_time_test        0 days 00:00:09.684456
round_time_total       0 days 00:12:00.783653
loss_total               162356003201607520.0
loss_critic              202945000273440928.0
loss_actor                    -1433483658.176
memory_size                         9777.1545 

=== epoch 8/10 ===== round 49/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:35,  2.64it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:59<00:00,  2.78it/s]
episodes                                  891
episode_length                      11.209877
returns                               8.81666
return_std                            3.81861
average_reward                       0.786421
round_time             0 days 00:12:00.286179
episodes_test                           929.0
episode_length_test                 10.752422
returns_test                         8.496074
return_std_test                      3.185316
average_reward_test                  0.790075
round_time_test        0 days 00:00:09.532150
round_time_total       0 days 00:12:00.287244
loss_total               164952083322395168.0
loss_critic              206190100347652928.0
loss_actor                    -1445770373.056
memory_size                            9779.0 

=== epoch 8/10 ===== round 50/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<12:34,  2.65it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:59<00:00,  2.78it/s]
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
episodes                                  891
episode_length                      11.212121
returns                              8.765006
return_std                           3.760926
average_reward                       0.781824
round_time             0 days 00:12:00.153756
episodes_test                           896.0
episode_length_test                 11.158482
returns_test                          8.53648
return_std_test                      3.170788
average_reward_test                  0.765054
round_time_test        0 days 00:00:09.491027
round_time_total       0 days 00:12:00.154806
loss_total               166721599536130688.0
loss_critic              208401995783399808.0
loss_actor                     -1455559367.36
memory_size                            9779.0 


<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
=== epoch 9/10 ===== round 1/50 ======================================
  0%|          | 5/2000 [00:01<13:11,  2.52it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:56<00:00,  2.79it/s]
episodes                                  165
episode_length                      12.066667
returns                              9.229664
return_std                           4.757601
average_reward                       0.766493
round_time             0 days 00:11:56.599174
episodes_test                           882.0
episode_length_test                 11.337868
returns_test                         8.771863
return_std_test                      3.824228
average_reward_test                  0.773678
round_time_test        0 days 00:00:09.473384
round_time_total       0 days 00:11:56.600262
loss_total               169410434769222624.0
loss_critic              211763039633638688.0
loss_actor                     -1453846777.28
memory_size                         9785.3665 

=== epoch 9/10 ===== round 2/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<12:32,  2.65it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:56<00:00,  2.79it/s]
episodes                                  347
episode_length                      11.498559
returns                              8.922289
return_std                           4.061014
average_reward                       0.776473
round_time             0 days 00:11:56.901974
episodes_test                           862.0
episode_length_test                 11.596288
returns_test                         8.870763
return_std_test                      3.526079
average_reward_test                  0.765059
round_time_test        0 days 00:00:09.497478
round_time_total       0 days 00:11:56.903032
loss_total               167496691311714496.0
loss_critic              209370860540460544.0
loss_actor                      -1453286020.8
memory_size                            9787.0 

=== epoch 9/10 ===== round 3/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:54,  2.58it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:55<00:00,  2.79it/s]
episodes                                  527
episode_length                      11.381404
returns                              8.922179
return_std                           4.065273
average_reward                       0.783977
round_time             0 days 00:11:56.083166
episodes_test                           917.0
episode_length_test                 10.904035
returns_test                         8.605707
return_std_test                      3.191232
average_reward_test                  0.789242
round_time_test        0 days 00:00:09.489442
round_time_total       0 days 00:11:56.084224
loss_total               168020318670582464.0
loss_critic              210025394615565152.0
loss_actor                     -1466493963.84
memory_size                            9787.0 

=== epoch 9/10 ===== round 4/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:48,  2.60it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:55<00:00,  2.80it/s]
episodes                                  699
episode_length                      11.443491
returns                              9.008873
return_std                           4.084776
average_reward                       0.787268
round_time             0 days 00:11:55.672929
episodes_test                           893.0
episode_length_test                 11.183651
returns_test                          8.89361
return_std_test                      3.825998
average_reward_test                  0.795582
round_time_test        0 days 00:00:09.475849
round_time_total       0 days 00:11:55.673988
loss_total               172682852523359328.0
loss_critic              215853561791949824.0
loss_actor                    -1473789278.336
memory_size                            9787.0 

=== epoch 9/10 ===== round 5/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:37,  2.63it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:56<00:00,  2.79it/s]
episodes                                  880
episode_length                      11.357955
returns                              8.948626
return_std                           3.962174
average_reward                       0.787865
round_time             0 days 00:11:56.627790
episodes_test                           885.0
episode_length_test                 11.289266
returns_test                          8.94787
return_std_test                      3.837793
average_reward_test                  0.792728
round_time_test        0 days 00:00:09.353627
round_time_total       0 days 00:11:56.628848
loss_total               174988470360322592.0
loss_critic              218735584039835520.0
loss_actor                    -1485251595.648
memory_size                            9787.0 

=== epoch 9/10 ===== round 6/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<12:22,  2.69it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:55<00:00,  2.79it/s]
episodes                                  884
episode_length                      11.307692
returns                              8.992647
return_std                            3.80853
average_reward                       0.795355
round_time             0 days 00:11:56.193676
episodes_test                           864.0
episode_length_test                 11.570602
returns_test                         9.212503
return_std_test                      4.209647
average_reward_test                  0.796268
round_time_test        0 days 00:00:09.602683
round_time_total       0 days 00:11:56.194739
loss_total               178396332442169376.0
loss_critic              222995411704421024.0
loss_actor                     -1503570327.36
memory_size                            9787.0 

=== epoch 9/10 ===== round 7/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<12:37,  2.63it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:56<00:00,  2.79it/s]
episodes                                  871
episode_length                      11.469575
returns                              9.187459
return_std                           4.215373
average_reward                       0.800966
round_time             0 days 00:11:57.328320
episodes_test                           833.0
episode_length_test                 12.003601
returns_test                         9.240323
return_std_test                      4.238828
average_reward_test                  0.769818
round_time_test        0 days 00:00:09.360070
round_time_total       0 days 00:11:57.329395
loss_total               182402157188273408.0
loss_critic              228002692531824352.0
loss_actor                    -1525790939.968
memory_size                         9788.6875 

=== epoch 9/10 ===== round 8/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<12:21,  2.69it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:56<00:00,  2.79it/s]
episodes                                  861
episode_length                      11.608595
returns                              9.307375
return_std                           4.151855
average_reward                       0.801624
round_time             0 days 00:11:57.083551
episodes_test                           827.0
episode_length_test                 12.088271
returns_test                         9.430835
return_std_test                      4.048108
average_reward_test                  0.780185
round_time_test        0 days 00:00:09.398833
round_time_total       0 days 00:11:57.084594
loss_total               189168359975317152.0
loss_critic              236460445880337568.0
loss_actor                    -1546438141.888
memory_size                            9789.0 

=== epoch 9/10 ===== round 9/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:36,  2.64it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:00<00:00,  2.78it/s]
episodes                                  864
episode_length                      11.560185
returns                              9.156916
return_std                           3.995066
average_reward                       0.791993
round_time             0 days 00:12:00.856421
episodes_test                           873.0
episode_length_test                 11.446735
returns_test                         8.904949
return_std_test                      4.094904
average_reward_test                  0.778031
round_time_test        0 days 00:00:09.638823
round_time_total       0 days 00:12:00.857483
loss_total               194315321387671104.0
loss_critic              242894147374660192.0
loss_actor                    -1560816585.216
memory_size                            9789.0 

=== epoch 9/10 ===== round 10/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:39,  2.63it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:56<00:00,  2.79it/s]
episodes                                  855
episode_length                      11.687719
returns                              9.150956
return_std                           4.059246
average_reward                       0.782879
round_time             0 days 00:11:56.963630
episodes_test                           858.0
episode_length_test                 11.651515
returns_test                         8.947659
return_std_test                      3.478148
average_reward_test                  0.768002
round_time_test        0 days 00:00:09.582877
round_time_total       0 days 00:11:56.964714
loss_total               195152683686466432.0
loss_critic              243940850489746272.0
loss_actor                    -1573566103.104
memory_size                            9789.0 

=== epoch 9/10 ===== round 11/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:53,  2.58it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:02<00:00,  2.77it/s]
episodes                                  860
episode_length                      11.618605
returns                              9.017766
return_std                           3.934919
average_reward                        0.77619
round_time             0 days 00:12:03.010926
episodes_test                           862.0
episode_length_test                 11.590487
returns_test                         8.886437
return_std_test                      3.865161
average_reward_test                  0.766494
round_time_test        0 days 00:00:09.403499
round_time_total       0 days 00:12:03.011994
loss_total               196797931229867424.0
loss_critic              245997409735924512.0
loss_actor                     -1585289231.68
memory_size                            9789.0 

=== epoch 9/10 ===== round 12/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:47,  2.60it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:01<00:00,  2.77it/s]
episodes                                  868
episode_length                      11.510369
returns                                8.7874
return_std                           3.469657
average_reward                       0.763596
round_time             0 days 00:12:01.831054
episodes_test                           889.0
episode_length_test                 11.248594
returns_test                         8.706284
return_std_test                      3.914024
average_reward_test                  0.773989
round_time_test        0 days 00:00:09.630163
round_time_total       0 days 00:12:01.832118
loss_total               198124143034096416.0
loss_critic              247655174302232224.0
loss_actor                    -1597604827.904
memory_size                            9789.0 

=== epoch 9/10 ===== round 13/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:35,  2.64it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:57<00:00,  2.79it/s]
episodes                                  873
episode_length                      11.453608
returns                              8.631942
return_std                           3.410258
average_reward                        0.75366
round_time             0 days 00:11:58.107695
episodes_test                           886.0
episode_length_test                 11.278781
returns_test                         8.557882
return_std_test                      3.350541
average_reward_test                  0.758869
round_time_test        0 days 00:00:09.428986
round_time_total       0 days 00:11:58.108764
loss_total               201752868204207680.0
loss_critic              252191081150344608.0
loss_actor                     -1612365561.28
memory_size                            9789.0 

=== epoch 9/10 ===== round 14/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:06,  2.54it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:57<00:00,  2.79it/s]
episodes                                  853
episode_length                      11.705744
returns                              8.969412
return_std                           3.949019
average_reward                       0.766165
round_time             0 days 00:11:57.768806
episodes_test                           845.0
episode_length_test                 11.833136
returns_test                         9.293156
return_std_test                      4.475719
average_reward_test                  0.785368
round_time_test        0 days 00:00:09.489270
round_time_total       0 days 00:11:57.769872
loss_total               210163761909038304.0
loss_critic              262704698076298208.0
loss_actor                    -1631891016.192
memory_size                            9789.0 

=== epoch 9/10 ===== round 15/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:43,  2.61it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:56<00:00,  2.79it/s]
episodes                                  843
episode_length                      11.850534
returns                              9.161242
return_std                           4.046801
average_reward                       0.773066
round_time             0 days 00:11:56.877242
episodes_test                           766.0
episode_length_test                 13.053525
returns_test                        10.911093
return_std_test                      6.147716
average_reward_test                  0.835882
round_time_test        0 days 00:00:09.417362
round_time_total       0 days 00:11:56.878289
loss_total               214469083838613024.0
loss_critic              268086350441021952.0
loss_actor                     -1647269917.12
memory_size                            9789.0 

=== epoch 9/10 ===== round 16/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:48,  2.60it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:56<00:00,  2.79it/s]
episodes                                  829
episode_length                      12.043426
returns                              9.302617
return_std                           4.191527
average_reward                       0.772339
round_time             0 days 00:11:56.952010
episodes_test                           788.0
episode_length_test                 12.658629
returns_test                        10.036046
return_std_test                       4.97253
average_reward_test                  0.792452
round_time_test        0 days 00:00:09.331706
round_time_total       0 days 00:11:56.953066
loss_total               218799742050849792.0
loss_critic              273499672855204320.0
loss_actor                     -1667008794.88
memory_size                            9789.0 

=== epoch 9/10 ===== round 17/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:41,  2.62it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:55<00:00,  2.79it/s]
episodes                                  808
episode_length                      12.347772
returns                              9.649158
return_std                           4.748129
average_reward                       0.781383
round_time             0 days 00:11:56.265233
episodes_test                           826.0
episode_length_test                 12.102906
returns_test                         9.236761
return_std_test                      4.600251
average_reward_test                  0.763236
round_time_test        0 days 00:00:09.374110
round_time_total       0 days 00:11:56.266296
loss_total               227110835241300800.0
loss_critic              283888538908402656.0
loss_actor                    -1688341035.776
memory_size                         9790.9255 

=== epoch 9/10 ===== round 18/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:50,  2.59it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:56<00:00,  2.79it/s]
episodes                                  801
episode_length                       12.47191
returns                              9.877453
return_std                            5.05406
average_reward                       0.791851
round_time             0 days 00:11:56.826080
episodes_test                           838.0
episode_length_test                 11.912888
returns_test                         9.561733
return_std_test                      5.376028
average_reward_test                  0.803017
round_time_test        0 days 00:00:09.577649
round_time_total       0 days 00:11:56.827143
loss_total               234027602676751008.0
loss_critic              292534498436791168.0
loss_actor                    -1709722473.152
memory_size                            9791.0 

=== epoch 9/10 ===== round 19/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<12:39,  2.63it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:56<00:00,  2.79it/s]
episodes                                  804
episode_length                      12.427861
returns                              9.835878
return_std                           4.896114
average_reward                       0.791422
round_time             0 days 00:11:57.183187
episodes_test                           815.0
episode_length_test                  12.26135
returns_test                         9.657856
return_std_test                      4.819614
average_reward_test                  0.787881
round_time_test        0 days 00:00:09.411140
round_time_total       0 days 00:11:57.184248
loss_total               241660925988961248.0
loss_critic              302076152014413248.0
loss_actor                    -1733144176.256
memory_size                            9791.0 

=== epoch 9/10 ===== round 20/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:52,  2.58it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:59<00:00,  2.78it/s]
episodes                                  788
episode_length                      12.678934
returns                             10.222501
return_std                           5.954896
average_reward                       0.805957
round_time             0 days 00:11:59.643247
episodes_test                           745.0
episode_length_test                 13.422819
returns_test                        10.894158
return_std_test                       5.57521
average_reward_test                  0.811615
round_time_test        0 days 00:00:09.466286
round_time_total       0 days 00:11:59.644360
loss_total               248782213831402208.0
loss_critic              310977761826054336.0
loss_actor                      -1754369728.0
memory_size                          9805.592 

=== epoch 9/10 ===== round 21/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:59,  2.38it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [13:59<00:00,  2.38it/s]
episodes                                  783
episode_length                      12.758621
returns                             10.362722
return_std                            6.20178
average_reward                       0.812132
round_time             0 days 00:13:59.759306
episodes_test                           775.0
episode_length_test                 12.892903
returns_test                        10.289509
return_std_test                      5.161516
average_reward_test                  0.798281
round_time_test        0 days 00:00:09.577996
round_time_total       0 days 00:13:59.760458
loss_total               253590852674768608.0
loss_critic              316988560288994304.0
loss_actor                    -1779165502.656
memory_size                            9810.0 

=== epoch 9/10 ===== round 22/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:16,  2.33it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:02<00:00,  2.37it/s]
episodes                                  779
episode_length                      12.818999
returns                             10.420618
return_std                           6.043967
average_reward                       0.812978
round_time             0 days 00:14:02.899451
episodes_test                           808.0
episode_length_test                 12.363861
returns_test                           9.7775
return_std_test                       5.43097
average_reward_test                  0.790919
round_time_test        0 days 00:00:09.647608
round_time_total       0 days 00:14:02.900597
loss_total               260528405814901216.0
loss_critic              325660501599269696.0
loss_actor                    -1803695465.024
memory_size                            9810.0 

=== epoch 9/10 ===== round 23/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:47,  2.41it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [13:52<00:00,  2.40it/s]
episodes                                  772
episode_length                      12.917098
returns                             10.447223
return_std                           6.035206
average_reward                       0.808474
round_time             0 days 00:13:52.917037
episodes_test                           772.0
episode_length_test                  12.94171
returns_test                        10.297625
return_std_test                      5.934717
average_reward_test                  0.795789
round_time_test        0 days 00:00:09.667383
round_time_total       0 days 00:13:52.918216
loss_total               267744247572816992.0
loss_critic              334680303761230912.0
loss_actor                    -1817079134.976
memory_size                         9811.4705 

=== epoch 9/10 ===== round 24/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:47,  2.41it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [13:56<00:00,  2.39it/s]
episodes                                  776
episode_length                      12.876289
returns                             10.361073
return_std                           6.190145
average_reward                        0.80473
round_time             0 days 00:13:57.447925
episodes_test                           791.0
episode_length_test                 12.639697
returns_test                         9.871321
return_std_test                      6.000918
average_reward_test                  0.781022
round_time_test        0 days 00:00:09.783097
round_time_total       0 days 00:13:57.449144
loss_total               272580272794110016.0
loss_critic              340725335312543232.0
loss_actor                     -1834116044.48
memory_size                         9812.3535 

=== epoch 9/10 ===== round 25/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:32,  2.46it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:13<00:00,  2.73it/s]
episodes                                  779
episode_length                      12.826701
returns                             10.118465
return_std                           5.443968
average_reward                       0.788605
round_time             0 days 00:12:13.698549
episodes_test                           818.0
episode_length_test                 12.218826
returns_test                         9.587488
return_std_test                      4.495808
average_reward_test                  0.784692
round_time_test        0 days 00:00:09.882333
round_time_total       0 days 00:12:13.699611
loss_total               274519277110359488.0
loss_critic              343149090842072832.0
loss_actor                    -1832526345.728
memory_size                            9813.0 

=== epoch 9/10 ===== round 26/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:59,  2.56it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:57<00:00,  2.79it/s]
episodes                                  755
episode_length                      13.234437
returns                             10.583547
return_std                           6.435996
average_reward                       0.799573
round_time             0 days 00:11:57.899831
episodes_test                           704.0
episode_length_test                 14.166193
returns_test                        11.387965
return_std_test                      7.543603
average_reward_test                  0.804865
round_time_test        0 days 00:00:09.369412
round_time_total       0 days 00:11:57.900884
loss_total               273160632586444224.0
loss_critic              341450784975651584.0
loss_actor                    -1836861374.272
memory_size                         9827.7925 

=== epoch 9/10 ===== round 27/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:32,  2.65it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:58<00:00,  2.79it/s]
episodes                                  751
episode_length                      13.275632
returns                             10.694548
return_std                           6.866979
average_reward                       0.806063
round_time             0 days 00:11:58.521265
episodes_test                           672.0
episode_length_test                 14.873512
returns_test                        12.448894
return_std_test                     10.146629
average_reward_test                  0.837037
round_time_test        0 days 00:00:09.280865
round_time_total       0 days 00:11:58.522306
loss_total               277602034224010880.0
loss_critic              347002536603850624.0
loss_actor                    -1838610157.184
memory_size                         9866.9705 

=== epoch 9/10 ===== round 28/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<12:43,  2.62it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:57<00:00,  2.79it/s]
episodes                                  734
episode_length                      13.564033
returns                             10.951613
return_std                           7.020119
average_reward                       0.806168
round_time             0 days 00:11:58.437506
episodes_test                           699.0
episode_length_test                 14.257511
returns_test                        11.745683
return_std_test                      8.653163
average_reward_test                  0.823905
round_time_test        0 days 00:00:09.311317
round_time_total       0 days 00:11:58.438546
loss_total               281674165675957952.0
loss_critic              352092700898383360.0
loss_actor                     -1843481954.56
memory_size                         9870.4125 

=== epoch 9/10 ===== round 29/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:23,  2.49it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:59<00:00,  2.78it/s]
episodes                                  720
episode_length                      13.854167
returns                             11.340042
return_std                            7.49817
average_reward                       0.817724
round_time             0 days 00:11:59.660061
episodes_test                           751.0
episode_length_test                  13.28229
returns_test                        10.771147
return_std_test                      6.627717
average_reward_test                  0.810709
round_time_test        0 days 00:00:09.440631
round_time_total       0 days 00:11:59.661109
loss_total               281760472210547424.0
loss_critic              352200584180436800.0
loss_actor                    -1855885870.016
memory_size                          9897.249 

=== epoch 9/10 ===== round 30/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:28,  2.67it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:59<00:00,  2.78it/s]
episodes                                  725
episode_length                      13.787586
returns                             11.545945
return_std                           7.813628
average_reward                       0.837353
round_time             0 days 00:12:00.145763
episodes_test                           705.0
episode_length_test                 14.165957
returns_test                        12.098023
return_std_test                      7.373156
average_reward_test                  0.853878
round_time_test        0 days 00:00:09.331196
round_time_total       0 days 00:12:00.146830
loss_total               282582934486108864.0
loss_critic              353228661809066560.0
loss_actor                    -1862740193.664
memory_size                          9936.173 

=== epoch 9/10 ===== round 31/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:33,  2.65it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:00<00:00,  2.78it/s]
episodes                                  758
episode_length                      13.170185
returns                             10.847746
return_std                           6.752115
average_reward                       0.823664
round_time             0 days 00:12:00.652274
episodes_test                           827.0
episode_length_test                  12.08948
returns_test                         9.626841
return_std_test                      4.851375
average_reward_test                  0.796314
round_time_test        0 days 00:00:09.403042
round_time_total       0 days 00:12:00.653323
loss_total               286741372580019584.0
loss_critic              358426709682005504.0
loss_actor                    -1869636305.728
memory_size                         9952.5135 

=== epoch 9/10 ===== round 32/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:38,  2.63it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:59<00:00,  2.78it/s]
episodes                                  769
episode_length                      12.988296
returns                             10.559465
return_std                           6.213356
average_reward                       0.812996
round_time             0 days 00:11:59.510751
episodes_test                           774.0
episode_length_test                 12.913437
returns_test                        10.645804
return_std_test                      5.965366
average_reward_test                  0.824438
round_time_test        0 days 00:00:09.300303
round_time_total       0 days 00:11:59.511822
loss_total               288721504734296384.0
loss_critic              360901874578498752.0
loss_actor                    -1883392156.992
memory_size                          9960.418 

=== epoch 9/10 ===== round 33/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:16,  2.51it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:59<00:00,  2.78it/s]
episodes                                  777
episode_length                      12.842986
returns                              10.53123
return_std                           6.355498
average_reward                       0.820436
round_time             0 days 00:11:59.734318
episodes_test                           782.0
episode_length_test                 12.787724
returns_test                        10.109981
return_std_test                      4.843105
average_reward_test                  0.790601
round_time_test        0 days 00:00:09.319824
round_time_total       0 days 00:11:59.735375
loss_total               295035119844966016.0
loss_critic              368793893176925504.0
loss_actor                    -1901175530.944
memory_size                         9970.7555 

=== epoch 9/10 ===== round 34/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:34,  2.65it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:59<00:00,  2.78it/s]
episodes                                  768
episode_length                      13.005208
returns                             10.708068
return_std                           6.864999
average_reward                        0.82343
round_time             0 days 00:12:00.019033
episodes_test                           742.0
episode_length_test                  13.47035
returns_test                        10.783814
return_std_test                      5.927672
average_reward_test                  0.800556
round_time_test        0 days 00:00:09.366204
round_time_total       0 days 00:12:00.020086
loss_total               300425140609868608.0
loss_critic              375531419249017856.0
loss_actor                     -1909317153.92
memory_size                          9989.264 

=== epoch 9/10 ===== round 35/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:41,  2.62it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:00<00:00,  2.78it/s]
episodes                                  751
episode_length                      13.302264
returns                             10.897671
return_std                           6.817692
average_reward                       0.819221
round_time             0 days 00:12:01.206234
episodes_test                           754.0
episode_length_test                 13.245358
returns_test                        11.025433
return_std_test                      6.890221
average_reward_test                  0.832187
round_time_test        0 days 00:00:09.282413
round_time_total       0 days 00:12:01.207287
loss_total               306264207051745920.0
loss_critic              382830252346461632.0
loss_actor                    -1922721797.952
memory_size                         10022.948 

=== epoch 9/10 ===== round 36/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:47,  2.60it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:00<00:00,  2.77it/s]
episodes                                  722
episode_length                      13.828255
returns                             11.452415
return_std                           7.493948
average_reward                       0.827866
round_time             0 days 00:12:01.359056
episodes_test                           735.0
episode_length_test                 13.586395
returns_test                        11.806482
return_std_test                      8.281967
average_reward_test                  0.869293
round_time_test        0 days 00:00:09.236917
round_time_total       0 days 00:12:01.360114
loss_total               307100530101599616.0
loss_critic              383875655873163456.0
loss_actor                    -1933686189.312
memory_size                         10039.075 

=== epoch 9/10 ===== round 37/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:17,  2.50it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:01<00:00,  2.77it/s]
episodes                                  719
episode_length                      13.899861
returns                             11.575956
return_std                           7.484445
average_reward                       0.832737
round_time             0 days 00:12:01.778766
episodes_test                           739.0
episode_length_test                 13.525034
returns_test                        10.821264
return_std_test                      5.587576
average_reward_test                  0.800205
round_time_test        0 days 00:00:09.258460
round_time_total       0 days 00:12:01.779818
loss_total               307052914917335104.0
loss_critic              383816136740361472.0
loss_actor                    -1935350659.584
memory_size                          10053.55 

=== epoch 9/10 ===== round 38/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:54,  2.58it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:01<00:00,  2.77it/s]
episodes                                  732
episode_length                      13.648907
returns                             11.281978
return_std                           7.046794
average_reward                       0.826594
round_time             0 days 00:12:01.828075
episodes_test                           776.0
episode_length_test                 12.872423
returns_test                        10.536273
return_std_test                      6.618421
average_reward_test                  0.818562
round_time_test        0 days 00:00:09.291727
round_time_total       0 days 00:12:01.829154
loss_total               310590244291489024.0
loss_critic              388237798579386688.0
loss_actor                    -1940673929.984
memory_size                        10056.4085 

=== epoch 9/10 ===== round 39/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:51,  2.59it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:01<00:00,  2.77it/s]
episodes                                  760
episode_length                      13.138158
returns                             10.699341
return_std                           5.805782
average_reward                       0.814436
round_time             0 days 00:12:01.477282
episodes_test                           859.0
episode_length_test                  11.62631
returns_test                          9.18825
return_std_test                      4.219756
average_reward_test                  0.790686
round_time_test        0 days 00:00:09.536086
round_time_total       0 days 00:12:01.478341
loss_total               312694765269958016.0
loss_critic              390868449778850624.0
loss_actor                     -1948337410.88
memory_size                           10057.0 

=== epoch 9/10 ===== round 40/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:08,  2.74it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:01<00:00,  2.77it/s]
episodes                                  793
episode_length                      12.604035
returns                             10.159655
return_std                           5.421869
average_reward                       0.806002
round_time             0 days 00:12:01.920095
episodes_test                           850.0
episode_length_test                 11.761176
returns_test                         9.276204
return_std_test                      4.355471
average_reward_test                  0.788766
round_time_test        0 days 00:00:09.657343
round_time_total       0 days 00:12:01.921159
loss_total               312866632689864640.0
loss_critic              391083283948507264.0
loss_actor                    -1953174417.216
memory_size                         10057.526 

=== epoch 9/10 ===== round 41/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:42,  2.62it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:01<00:00,  2.77it/s]
episodes                                  825
episode_length                      12.109091
returns                              9.723711
return_std                           4.925116
average_reward                       0.802895
round_time             0 days 00:12:01.515059
episodes_test                           841.0
episode_length_test                 11.883472
returns_test                         9.216299
return_std_test                      4.151782
average_reward_test                   0.77554
round_time_test        0 days 00:00:09.443476
round_time_total       0 days 00:12:01.516121
loss_total               315489345299411904.0
loss_critic              394361674670712832.0
loss_actor                    -1961621854.528
memory_size                         10058.817 

=== epoch 9/10 ===== round 42/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:43,  2.62it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:01<00:00,  2.77it/s]
episodes                                  818
episode_length                      12.206601
returns                              9.815233
return_std                           5.375267
average_reward                       0.803891
round_time             0 days 00:12:01.606884
episodes_test                           770.0
episode_length_test                 12.972727
returns_test                        10.349623
return_std_test                      5.426861
average_reward_test                  0.798122
round_time_test        0 days 00:00:09.472586
round_time_total       0 days 00:12:01.607935
loss_total               321001888334374528.0
loss_critic              401252353401065280.0
loss_actor                    -1970893183.936
memory_size                        10070.9935 

=== epoch 9/10 ===== round 43/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<12:18,  2.70it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:01<00:00,  2.77it/s]
episodes                                  822
episode_length                      12.154501
returns                              9.803547
return_std                           5.592699
average_reward                       0.806516
round_time             0 days 00:12:01.846860
episodes_test                           796.0
episode_length_test                 12.556533
returns_test                        10.327988
return_std_test                      5.477664
average_reward_test                  0.822571
round_time_test        0 days 00:00:09.266541
round_time_total       0 days 00:12:01.847908
loss_total               321438879734661376.0
loss_critic              401798593054077120.0
loss_actor                      -1986239529.6
memory_size                        10090.2375 

=== epoch 9/10 ===== round 44/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:36,  2.64it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:01<00:00,  2.77it/s]
episodes                                  792
episode_length                      12.593434
returns                             10.333962
return_std                           6.519747
average_reward                       0.821465
round_time             0 days 00:12:02.215603
episodes_test                           793.0
episode_length_test                 12.606557
returns_test                        10.321193
return_std_test                      6.206005
average_reward_test                  0.818761
round_time_test        0 days 00:00:09.296384
round_time_total       0 days 00:12:02.216647
loss_total               332458795600265088.0
loss_critic              415573487267606400.0
loss_actor                    -2003184392.192
memory_size                        10098.3135 

=== epoch 9/10 ===== round 45/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:48,  2.60it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:01<00:00,  2.77it/s]
episodes                                  756
episode_length                      13.220899
returns                             11.124336
return_std                           8.095798
average_reward                       0.841413
round_time             0 days 00:12:01.955228
episodes_test                           673.0
episode_length_test                 14.854383
returns_test                        13.169975
return_std_test                     10.118282
average_reward_test                  0.886615
round_time_test        0 days 00:00:09.367164
round_time_total       0 days 00:12:01.956276
loss_total               340353603857259968.0
loss_critic              425441997640389632.0
loss_actor                     -2011255076.16
memory_size                        10142.6765 

=== epoch 9/10 ===== round 46/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:47,  2.60it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:03<00:00,  2.76it/s]
episodes                                  718
episode_length                      13.909471
returns                              11.90169
return_std                           9.282393
average_reward                       0.855619
round_time             0 days 00:12:04.203514
episodes_test                           668.0
episode_length_test                 14.956587
returns_test                        13.474772
return_std_test                     14.627891
average_reward_test                  0.901065
round_time_test        0 days 00:00:09.124344
round_time_total       0 days 00:12:04.204565
loss_total               350075614235606400.0
loss_critic              437594510074304256.0
loss_actor                    -2018285851.968
memory_size                         10255.075 

=== epoch 9/10 ===== round 47/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:47,  2.60it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:04<00:00,  2.76it/s]
episodes                                  694
episode_length                      14.384726
returns                             12.479041
return_std                          10.477903
average_reward                       0.867494
round_time             0 days 00:12:04.968458
episodes_test                           719.0
episode_length_test                 13.877608
returns_test                        11.784127
return_std_test                      9.468492
average_reward_test                  0.848986
round_time_test        0 days 00:00:09.478724
round_time_total       0 days 00:12:04.969512
loss_total               356299244515794880.0
loss_critic              445374047842935488.0
loss_actor                    -2022704980.608
memory_size                         10336.182 

=== epoch 9/10 ===== round 48/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:51,  2.59it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:05<00:00,  2.76it/s]
episodes                                  680
episode_length                      14.680882
returns                             12.756052
return_std                          10.945314
average_reward                       0.868817
round_time             0 days 00:12:05.861318
episodes_test                           710.0
episode_length_test                 14.067606
returns_test                        11.933901
return_std_test                      7.404064
average_reward_test                   0.84861
round_time_test        0 days 00:00:09.224402
round_time_total       0 days 00:12:05.862395
loss_total               351346639549782528.0
loss_critic              439183291998344832.0
loss_actor                    -2024665158.656
memory_size                        10387.1165 

=== epoch 9/10 ===== round 49/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<12:39,  2.63it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:05<00:00,  2.76it/s]
episodes                                  716
episode_length                      13.939944
returns                             11.888341
return_std                          10.381454
average_reward                       0.853569
round_time             0 days 00:12:05.919757
episodes_test                           788.0
episode_length_test                  12.68401
returns_test                        10.191148
return_std_test                      6.206607
average_reward_test                  0.803473
round_time_test        0 days 00:00:09.395455
round_time_total       0 days 00:12:05.920816
loss_total               358844957617379328.0
loss_critic              448556189181261376.0
loss_actor                    -2039493617.024
memory_size                        10425.0615 

=== epoch 9/10 ===== round 50/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:55,  2.57it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:05<00:00,  2.75it/s]
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
episodes                                  763
episode_length                      13.083879
returns                             10.869319
return_std                           8.993921
average_reward                       0.830851
round_time             0 days 00:12:06.453331
episodes_test                           837.0
episode_length_test                 11.941458
returns_test                         9.595509
return_std_test                      4.800071
average_reward_test                  0.803517
round_time_test        0 days 00:00:09.432716
round_time_total       0 days 00:12:06.454379
loss_total               357272768586522304.0
loss_critic              446590953330776704.0
loss_actor                     -2041601615.68
memory_size                           10426.0 


<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
=== epoch 10/10 ==== round 1/50 ======================================
  0%|          | 4/2000 [00:01<14:45,  2.25it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:57<00:00,  2.79it/s]
episodes                                  174
episode_length                      11.465517
returns                              8.810413
return_std                           3.365186
average_reward                       0.768416
round_time             0 days 00:11:57.662716
episodes_test                           869.0
episode_length_test                 11.506329
returns_test                         9.134011
return_std_test                      4.315531
average_reward_test                  0.793842
round_time_test        0 days 00:00:09.489002
round_time_total       0 days 00:11:57.663800
loss_total               359494102298801472.0
loss_critic              449367619837618048.0
loss_actor                    -2042836961.344
memory_size                           10426.0 

=== epoch 10/10 ==== round 2/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:21,  2.69it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:58<00:00,  2.79it/s]
episodes                                  361
episode_length                      11.077562
returns                              8.679473
return_std                           3.799854
average_reward                       0.783566
round_time             0 days 00:11:58.494674
episodes_test                           933.0
episode_length_test                  10.71597
returns_test                         8.312783
return_std_test                      3.271527
average_reward_test                  0.775771
round_time_test        0 days 00:00:09.464599
round_time_total       0 days 00:11:58.495739
loss_total               356454443816165824.0
loss_critic              445568046920080832.0
loss_actor                    -2053381566.528
memory_size                           10426.0 

=== epoch 10/10 ==== round 3/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:57,  2.57it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:58<00:00,  2.78it/s]
episodes                                  548
episode_length                      10.941606
returns                              8.561109
return_std                           3.722779
average_reward                       0.782526
round_time             0 days 00:11:58.803159
episodes_test                           941.0
episode_length_test                 10.617428
returns_test                         8.240252
return_std_test                      3.341769
average_reward_test                  0.775798
round_time_test        0 days 00:00:09.585881
round_time_total       0 days 00:11:58.804216
loss_total               364656689057728832.0
loss_critic              455820853657791872.0
loss_actor                     -2067333736.64
memory_size                           10426.0 

=== epoch 10/10 ==== round 4/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<11:53,  2.80it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:57<00:00,  2.79it/s]
episodes                                  737
episode_length                       10.85346
returns                              8.518001
return_std                           3.614893
average_reward                       0.784843
round_time             0 days 00:11:57.573021
episodes_test                           934.0
episode_length_test                 10.701285
returns_test                         8.317789
return_std_test                      3.360002
average_reward_test                   0.77742
round_time_test        0 days 00:00:09.645430
round_time_total       0 days 00:11:57.574086
loss_total               367816626952732672.0
loss_critic              459770775702276672.0
loss_actor                    -2082548492.032
memory_size                           10426.0 

=== epoch 10/10 ==== round 5/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:48,  2.60it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:58<00:00,  2.78it/s]
episodes                                  915
episode_length                      10.928962
returns                              8.606931
return_std                           4.071038
average_reward                       0.787534
round_time             0 days 00:11:58.642631
episodes_test                           938.0
episode_length_test                 10.653518
returns_test                          8.36818
return_std_test                      3.269606
average_reward_test                  0.785604
round_time_test        0 days 00:00:09.545250
round_time_total       0 days 00:11:58.643693
loss_total               376302967285740480.0
loss_critic              470378700489323712.0
loss_actor                    -2108461972.096
memory_size                         10430.482 

=== epoch 10/10 ==== round 6/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:47,  2.60it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [11:59<00:00,  2.78it/s]
episodes                                  905
episode_length                      11.038674
returns                              8.777871
return_std                           4.588503
average_reward                       0.795197
round_time             0 days 00:12:00.174325
episodes_test                           825.0
episode_length_test                 12.115152
returns_test                         9.913786
return_std_test                      6.304208
average_reward_test                  0.818285
round_time_test        0 days 00:00:09.275949
round_time_total       0 days 00:12:00.175384
loss_total               384241689049306240.0
loss_critic              480302103198439552.0
loss_actor                    -2116504815.424
memory_size                         10436.051 

=== epoch 10/10 ==== round 7/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:25,  2.68it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:03<00:00,  2.76it/s]
episodes                                  897
episode_length                      11.132664
returns                              8.728749
return_std                           4.531909
average_reward                       0.784221
round_time             0 days 00:12:04.016978
episodes_test                           880.0
episode_length_test                 11.356818
returns_test                         8.461597
return_std_test                      3.822431
average_reward_test                  0.745028
round_time_test        0 days 00:00:09.447478
round_time_total       0 days 00:12:04.018042
loss_total               387004176516188736.0
loss_critic              483755212176634176.0
loss_actor                    -2125182364.032
memory_size                           10438.0 

=== epoch 10/10 ==== round 8/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:09,  2.73it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:02<00:00,  2.77it/s]
episodes                                  884
episode_length                      11.298643
returns                              8.825749
return_std                           4.628731
average_reward                       0.781231
round_time             0 days 00:12:03.217921
episodes_test                           834.0
episode_length_test                 11.959233
returns_test                         9.543178
return_std_test                      6.504257
average_reward_test                  0.798222
round_time_test        0 days 00:00:09.536386
round_time_total       0 days 00:12:03.218977
loss_total               390128315390628992.0
loss_critic              487660385910344640.0
loss_actor                    -2135533211.904
memory_size                        10438.1125 

=== epoch 10/10 ==== round 9/50 ======================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:46,  2.60it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:02<00:00,  2.77it/s]
episodes                                  852
episode_length                      11.711268
returns                              9.295713
return_std                           6.372807
average_reward                       0.793537
round_time             0 days 00:12:03.131215
episodes_test                           789.0
episode_length_test                 12.665399
returns_test                        10.875491
return_std_test                     12.833977
average_reward_test                  0.858722
round_time_test        0 days 00:00:09.364515
round_time_total       0 days 00:12:03.132276
loss_total               396211981242215680.0
loss_critic              495264967971424960.0
loss_actor                      -2155668910.4
memory_size                        10467.9245 

=== epoch 10/10 ==== round 10/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:32,  2.65it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:02<00:00,  2.77it/s]
episodes                                  814
episode_length                      12.275184
returns                              9.936118
return_std                           7.254666
average_reward                        0.80945
round_time             0 days 00:12:03.324389
episodes_test                           787.0
episode_length_test                 12.695044
returns_test                        10.563418
return_std_test                      8.625335
average_reward_test                  0.832283
round_time_test        0 days 00:00:09.620540
round_time_total       0 days 00:12:03.325452
loss_total               401791222769938048.0
loss_critic              502239020409358912.0
loss_actor                    -2138878222.336
memory_size                        10501.4135 

=== epoch 10/10 ==== round 11/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:07,  2.53it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:00<00:00,  2.78it/s]
episodes                                  792
episode_length                      12.606061
returns                             10.370818
return_std                            8.24086
average_reward                       0.823071
round_time             0 days 00:12:01.036215
episodes_test                           663.0
episode_length_test                 15.072398
returns_test                        13.433617
return_std_test                     13.140985
average_reward_test                  0.891068
round_time_test        0 days 00:00:09.154156
round_time_total       0 days 00:12:01.037280
loss_total               405558136842055872.0
loss_critic              506947662539944640.0
loss_actor                    -2139202108.096
memory_size                        10562.8575 

=== epoch 10/10 ==== round 12/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:27,  2.67it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:00<00:00,  2.77it/s]
episodes                                  763
episode_length                      13.087811
returns                             10.977222
return_std                           8.774605
average_reward                       0.838812
round_time             0 days 00:12:01.397948
episodes_test                           727.0
episode_length_test                 13.749656
returns_test                        11.762874
return_std_test                       9.38448
average_reward_test                  0.855573
round_time_test        0 days 00:00:09.292949
round_time_total       0 days 00:12:01.399007
loss_total               402735836342054272.0
loss_critic              503419786204125568.0
loss_actor                     -2151890787.52
memory_size                         10606.666 

=== epoch 10/10 ==== round 13/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:29,  2.66it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:01<00:00,  2.77it/s]
episodes                                  763
episode_length                      13.098296
returns                             11.034053
return_std                           8.712949
average_reward                       0.842238
round_time             0 days 00:12:02.360190
episodes_test                           761.0
episode_length_test                 13.136662
returns_test                        10.450712
return_std_test                      5.857251
average_reward_test                  0.795566
round_time_test        0 days 00:00:09.489015
round_time_total       0 days 00:12:02.361249
loss_total               404901822657625856.0
loss_critic              506127269850209344.0
loss_actor                    -2171416196.096
memory_size                           10628.0 

=== epoch 10/10 ==== round 14/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:32,  2.65it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:03<00:00,  2.77it/s]
episodes                                  761
episode_length                      13.118265
returns                             10.945349
return_std                           7.733355
average_reward                       0.833875
round_time             0 days 00:12:03.470943
episodes_test                           848.0
episode_length_test                 11.785377
returns_test                         9.449496
return_std_test                      5.174562
average_reward_test                   0.80184
round_time_test        0 days 00:00:09.499688
round_time_total       0 days 00:12:03.472001
loss_total               410560498969832576.0
loss_critic              513200614939820032.0
loss_actor                    -2187327401.472
memory_size                         10628.276 

=== epoch 10/10 ==== round 15/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:44,  2.61it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:05<00:00,  2.76it/s]
episodes                                  804
episode_length                      12.427861
returns                             10.153674
return_std                           6.634121
average_reward                       0.817015
round_time             0 days 00:12:05.844151
episodes_test                           820.0
episode_length_test                 12.189024
returns_test                         9.934943
return_std_test                      4.914902
average_reward_test                  0.815089
round_time_test        0 days 00:00:09.323304
round_time_total       0 days 00:12:05.845212
loss_total               414671907738787776.0
loss_critic              518339876555996544.0
loss_actor                    -2191819110.976
memory_size                           10629.0 

=== epoch 10/10 ==== round 16/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:38,  2.63it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:00<00:00,  2.77it/s]
episodes                                  821
episode_length                      12.170524
returns                              9.799519
return_std                           5.321762
average_reward                       0.805074
round_time             0 days 00:12:01.285834
episodes_test                           780.0
episode_length_test                 12.814103
returns_test                        10.521559
return_std_test                      6.091265
average_reward_test                  0.821156
round_time_test        0 days 00:00:09.421829
round_time_total       0 days 00:12:01.286884
loss_total               416075171196177472.0
loss_critic              520093955175506496.0
loss_actor                    -2207041622.528
memory_size                         10630.404 

=== epoch 10/10 ==== round 17/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:48,  2.60it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:01<00:00,  2.77it/s]
episodes                                  828
episode_length                      12.062802
returns                              9.615353
return_std                           4.718051
average_reward                       0.797057
round_time             0 days 00:12:01.710284
episodes_test                           829.0
episode_length_test                 12.053076
returns_test                         9.617394
return_std_test                      4.577686
average_reward_test                  0.798071
round_time_test        0 days 00:00:09.456044
round_time_total       0 days 00:12:01.711335
loss_total               423446255066698240.0
loss_critic              529307809959970368.0
loss_actor                    -2232022133.632
memory_size                        10639.0705 

=== epoch 10/10 ==== round 18/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<12:35,  2.64it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:01<00:00,  2.77it/s]
episodes                                  807
episode_length                      12.375465
returns                              9.964109
return_std                           5.253878
average_reward                       0.804725
round_time             0 days 00:12:01.798055
episodes_test                           759.0
episode_length_test                 13.146245
returns_test                        10.589738
return_std_test                      5.871327
average_reward_test                  0.805091
round_time_test        0 days 00:00:09.312331
round_time_total       0 days 00:12:01.799140
loss_total               439089783267456448.0
loss_critic              548862219820076096.0
loss_actor                    -2244815318.272
memory_size                         10651.937 

=== epoch 10/10 ==== round 19/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:01,  2.56it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:02<00:00,  2.77it/s]
episodes                                  800
episode_length                       12.47625
returns                             10.127093
return_std                           5.757109
average_reward                       0.811259
round_time             0 days 00:12:02.675902
episodes_test                           747.0
episode_length_test                 13.362784
returns_test                        11.028303
return_std_test                      6.414099
average_reward_test                  0.825524
round_time_test        0 days 00:00:09.301110
round_time_total       0 days 00:12:02.676961
loss_total               444795903841409152.0
loss_critic              555994870204657024.0
loss_actor                    -2269070793.856
memory_size                         10663.761 

=== epoch 10/10 ==== round 20/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:50,  2.59it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:05<00:00,  2.76it/s]
episodes                                  774
episode_length                      12.908269
returns                             10.579637
return_std                           6.107867
average_reward                       0.819877
round_time             0 days 00:12:06.142658
episodes_test                           725.0
episode_length_test                 13.786207
returns_test                        11.692699
return_std_test                      7.738133
average_reward_test                  0.848157
round_time_test        0 days 00:00:09.406495
round_time_total       0 days 00:12:06.143705
loss_total               454506888016504576.0
loss_critic              568133600586735040.0
loss_actor                    -2289519513.344
memory_size                           10674.0 

=== epoch 10/10 ==== round 21/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:46,  2.60it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:02<00:00,  2.77it/s]
episodes                                  767
episode_length                      13.011734
returns                             10.667315
return_std                           6.182778
average_reward                       0.819411
round_time             0 days 00:12:02.689172
episodes_test                           731.0
episode_length_test                 13.674419
returns_test                         11.65322
return_std_test                      7.561895
average_reward_test                  0.852173
round_time_test        0 days 00:00:09.356454
round_time_total       0 days 00:12:02.690231
loss_total               458837421189358400.0
loss_critic              573546766518078912.0
loss_actor                    -2310600054.016
memory_size                         10674.916 

=== epoch 10/10 ==== round 22/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:40,  2.62it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:01<00:00,  2.77it/s]
episodes                                  752
episode_length                      13.269947
returns                             11.103672
return_std                           6.537446
average_reward                       0.836427
round_time             0 days 00:12:01.882096
episodes_test                           677.0
episode_length_test                  14.76514
returns_test                        12.533375
return_std_test                      9.119422
average_reward_test                  0.848869
round_time_test        0 days 00:00:09.168239
round_time_total       0 days 00:12:01.883137
loss_total               463204661111228992.0
loss_critic              579005816109032064.0
loss_actor                     -2331768448.64
memory_size                         10676.434 

=== epoch 10/10 ==== round 23/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:02,  2.55it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:09<00:00,  2.74it/s]
episodes                                  736
episode_length                      13.570652
returns                             11.491065
return_std                           6.848074
average_reward                       0.846729
round_time             0 days 00:12:10.351324
episodes_test                           722.0
episode_length_test                  13.83518
returns_test                        11.350845
return_std_test                      6.686851
average_reward_test                  0.820479
round_time_test        0 days 00:00:09.163756
round_time_total       0 days 00:12:10.352410
loss_total               472495694593986112.0
loss_critic              590619608381237760.0
loss_actor                    -2343731385.152
memory_size                         10684.773 

=== epoch 10/10 ==== round 24/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:08,  2.53it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:09<00:00,  2.74it/s]
episodes                                  733
episode_length                      13.638472
returns                             11.487786
return_std                           6.717621
average_reward                       0.842218
round_time             0 days 00:12:09.931699
episodes_test                           728.0
episode_length_test                 13.736264
returns_test                         10.86069
return_std_test                      6.927966
average_reward_test                  0.790658
round_time_test        0 days 00:00:09.363003
round_time_total       0 days 00:12:09.932744
loss_total               474919457927471296.0
loss_critic              593649312834783232.0
loss_actor                    -2356842968.768
memory_size                         10704.731 

=== epoch 10/10 ==== round 25/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:39,  2.63it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:12<00:00,  2.73it/s]
episodes                                  712
episode_length                      14.018258
returns                             12.026728
return_std                           7.410864
average_reward                       0.857741
round_time             0 days 00:12:13.342370
episodes_test                           754.0
episode_length_test                 13.253316
returns_test                        10.778209
return_std_test                      7.148197
average_reward_test                  0.813158
round_time_test        0 days 00:00:09.357575
round_time_total       0 days 00:12:13.343438
loss_total               491964058890305280.0
loss_critic              614955063556215680.0
loss_actor                    -2365003608.768
memory_size                         10731.311 

=== epoch 10/10 ==== round 26/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:10,  2.73it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [13:57<00:00,  2.39it/s]
episodes                                  695
episode_length                      14.381295
returns                             12.426632
return_std                           8.060989
average_reward                       0.864031
round_time             0 days 00:13:58.413102
episodes_test                           698.0
episode_length_test                 14.297994
returns_test                        11.940649
return_std_test                      8.856795
average_reward_test                  0.834986
round_time_test        0 days 00:00:09.442504
round_time_total       0 days 00:13:58.414308
loss_total               494479289414989120.0
loss_critic              618099101705628032.0
loss_actor                    -2372565650.432
memory_size                          10742.33 

=== epoch 10/10 ==== round 27/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:49,  2.10it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:09<00:00,  2.35it/s]
episodes                                  688
episode_length                      14.520349
returns                             12.343118
return_std                           8.348985
average_reward                       0.849878
round_time             0 days 00:14:09.803083
episodes_test                           654.0
episode_length_test                 15.279817
returns_test                        12.824646
return_std_test                       8.06555
average_reward_test                  0.839205
round_time_test        0 days 00:00:09.712779
round_time_total       0 days 00:14:09.804947
loss_total               497844481976002688.0
loss_critic              622305591532869120.0
loss_actor                     -2385924435.84
memory_size                         10773.654 

=== epoch 10/10 ==== round 28/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:27,  2.47it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:05<00:00,  2.37it/s]
episodes                                  700
episode_length                      14.235714
returns                             12.008533
return_std                           8.244054
average_reward                        0.84477
round_time             0 days 00:14:05.892109
episodes_test                           690.0
episode_length_test                 14.481159
returns_test                        11.604248
return_std_test                      8.048066
average_reward_test                  0.801493
round_time_test        0 days 00:00:09.701204
round_time_total       0 days 00:14:05.893368
loss_total               501279190481077504.0
loss_critic              626598977679608832.0
loss_actor                    -2404109764.544
memory_size                         10792.297 

=== epoch 10/10 ==== round 29/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:37,  2.13it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [13:02<00:00,  2.56it/s]
episodes                                  699
episode_length                      14.264664
returns                             12.012805
return_std                           8.382233
average_reward                       0.841931
round_time             0 days 00:13:03.205694
episodes_test                           709.0
episode_length_test                 14.087447
returns_test                        11.236632
return_std_test                      7.080697
average_reward_test                  0.797309
round_time_test        0 days 00:00:09.826549
round_time_total       0 days 00:13:03.206759
loss_total               506810420639572160.0
loss_critic              633513014254593152.0
loss_actor                    -2414863981.952
memory_size                         10802.588 

=== epoch 10/10 ==== round 30/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<12:04,  2.76it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:03<00:00,  2.76it/s]
episodes                                  717
episode_length                      13.933054
returns                              11.38897
return_std                           7.758738
average_reward                        0.81728
round_time             0 days 00:12:04.187180
episodes_test                           749.0
episode_length_test                 13.336449
returns_test                        10.715171
return_std_test                       6.40469
average_reward_test                   0.80349
round_time_test        0 days 00:00:09.223159
round_time_total       0 days 00:12:04.188234
loss_total               510955309554772992.0
loss_critic              638694125929022592.0
loss_actor                    -2427376436.096
memory_size                           10810.0 

=== epoch 10/10 ==== round 31/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:01,  2.55it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:03<00:00,  2.77it/s]
episodes                                  721
episode_length                      13.862691
returns                             11.221978
return_std                           7.246885
average_reward                       0.809461
round_time             0 days 00:12:03.634536
episodes_test                           721.0
episode_length_test                 13.854369
returns_test                        10.784275
return_std_test                      6.910655
average_reward_test                  0.778255
round_time_test        0 days 00:00:09.402306
round_time_total       0 days 00:12:03.635587
loss_total               522314111714559232.0
loss_critic              652892628549298560.0
loss_actor                    -2433314364.416
memory_size                         10814.445 

=== epoch 10/10 ==== round 32/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:00,  2.56it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:03<00:00,  2.76it/s]
episodes                                  729
episode_length                      13.683128
returns                             11.109297
return_std                           7.002404
average_reward                       0.812327
round_time             0 days 00:12:04.033395
episodes_test                           706.0
episode_length_test                 14.131728
returns_test                        11.554548
return_std_test                      6.696701
average_reward_test                  0.817062
round_time_test        0 days 00:00:09.373706
round_time_total       0 days 00:12:04.034453
loss_total               520923019979738048.0
loss_critic              651153764026800896.0
loss_actor                    -2443040622.976
memory_size                           10815.0 

=== epoch 10/10 ==== round 33/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<12:33,  2.65it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [13:45<00:00,  2.42it/s]
episodes                                  705
episode_length                      14.148936
returns                             11.732415
return_std                           8.062667
average_reward                       0.829051
round_time             0 days 00:13:45.522923
episodes_test                           607.0
episode_length_test                 16.462932
returns_test                        15.085688
return_std_test                     15.042568
average_reward_test                  0.916371
round_time_test        0 days 00:00:09.088226
round_time_total       0 days 00:13:45.524052
loss_total               528765533754318912.0
loss_critic              660956905796202880.0
loss_actor                    -2444190549.504
memory_size                        10866.0565 

=== epoch 10/10 ==== round 34/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:03,  2.21it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:15<00:00,  2.34it/s]
episodes                                  689
episode_length                      14.502177
returns                             12.315113
return_std                           8.453473
average_reward                       0.849287
round_time             0 days 00:14:16.431313
episodes_test                           631.0
episode_length_test                 15.822504
returns_test                          13.7883
return_std_test                     10.131747
average_reward_test                  0.870837
round_time_test        0 days 00:00:09.356134
round_time_total       0 days 00:14:16.432566
loss_total               529327478539364096.0
loss_critic              661659337234923392.0
loss_actor                     -2401517773.76
memory_size                         10905.974 

=== epoch 10/10 ==== round 35/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:05,  2.20it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [14:15<00:00,  2.34it/s]
episodes                                  669
episode_length                      14.919283
returns                             12.706249
return_std                           8.700958
average_reward                       0.851092
round_time             0 days 00:14:15.586323
episodes_test                           626.0
episode_length_test                 15.960064
returns_test                          14.2022
return_std_test                     10.835487
average_reward_test                  0.889873
round_time_test        0 days 00:00:09.433616
round_time_total       0 days 00:14:15.587785
loss_total               517534563230149504.0
loss_critic              646918192829969664.0
loss_actor                    -2408827674.432
memory_size                         10949.153 

=== epoch 10/10 ==== round 36/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:29,  2.47it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [13:16<00:00,  2.51it/s]
episodes                                  665
episode_length                      15.037594
returns                             12.921579
return_std                           9.211771
average_reward                       0.859285
round_time             0 days 00:13:16.898533
episodes_test                           685.0
episode_length_test                 14.583942
returns_test                        12.032061
return_std_test                      9.190597
average_reward_test                  0.825111
round_time_test        0 days 00:00:09.607679
round_time_total       0 days 00:13:16.899581
loss_total               520291893261648256.0
loss_critic              650364856067275392.0
loss_actor                    -2411792349.376
memory_size                         10980.426 

=== epoch 10/10 ==== round 37/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:39,  2.63it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [17:11<00:00,  1.94it/s]
episodes                                  658
episode_length                      15.161094
returns                             13.066556
return_std                           9.307523
average_reward                       0.861676
round_time             0 days 00:17:11.585289
episodes_test                           674.0
episode_length_test                 14.835312
returns_test                         12.36812
return_std_test                      9.324927
average_reward_test                  0.833711
round_time_test        0 days 00:00:09.350768
round_time_total       0 days 00:17:11.586536
loss_total               525439422878848128.0
loss_critic              656799267863289344.0
loss_actor                    -2415783834.688
memory_size                         11008.081 

=== epoch 10/10 ==== round 38/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 2/2000 [00:01<18:52,  1.76it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [20:44<00:00,  1.61it/s]
episodes                                  680
episode_length                      14.673529
returns                             12.235857
return_std                           8.439615
average_reward                       0.834266
round_time             0 days 00:20:45.347627
episodes_test                           727.0
episode_length_test                 13.737276
returns_test                        11.130832
return_std_test                      7.238186
average_reward_test                  0.810414
round_time_test        0 days 00:00:10.410556
round_time_total       0 days 00:20:45.348953
loss_total               525236129629913216.0
loss_critic              656545150608483584.0
loss_actor                    -2426479121.344
memory_size                        11030.6965 

=== epoch 10/10 ==== round 39/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 2/2000 [00:01<23:21,  1.43it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [23:08<00:00,  1.44it/s]
episodes                                  693
episode_length                      14.388167
returns                             11.747291
return_std                           8.080959
average_reward                        0.81755
round_time             0 days 00:23:09.396211
episodes_test                           708.0
episode_length_test                 14.115819
returns_test                        11.635253
return_std_test                      7.429992
average_reward_test                  0.824326
round_time_test        0 days 00:00:11.772556
round_time_total       0 days 00:23:09.397530
loss_total               535154680005237120.0
loss_critic              668943338435904512.0
loss_actor                    -2428442040.256
memory_size                           11035.0 

=== epoch 10/10 ==== round 40/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 2/2000 [00:01<22:36,  1.47it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [22:35<00:00,  1.48it/s]
episodes                                  711
episode_length                      14.045007
returns                             11.389407
return_std                           7.858636
average_reward                       0.811169
round_time             0 days 00:22:36.214756
episodes_test                           750.0
episode_length_test                 13.325333
returns_test                        10.410266
return_std_test                      5.863336
average_reward_test                   0.78114
round_time_test        0 days 00:00:11.577362
round_time_total       0 days 00:22:36.216133
loss_total               528609559156516480.0
loss_critic              660761937405068416.0
loss_actor                    -2434165502.912
memory_size                         11035.442 

=== epoch 10/10 ==== round 41/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 2/2000 [00:01<23:18,  1.43it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [21:12<00:00,  1.57it/s]
episodes                                  717
episode_length                      13.944212
returns                             11.303378
return_std                           7.234135
average_reward                       0.810645
round_time             0 days 00:21:13.401510
episodes_test                           735.0
episode_length_test                 13.598639
returns_test                        11.183738
return_std_test                      7.344159
average_reward_test                  0.822514
round_time_test        0 days 00:00:11.538626
round_time_total       0 days 00:21:13.402765
loss_total               532845856426158976.0
loss_critic              666057307999984128.0
loss_actor                    -2439186998.592
memory_size                        11043.9685 

=== epoch 10/10 ==== round 42/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<19:00,  1.75it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [18:43<00:00,  1.78it/s]
episodes                                  710
episode_length                       14.06338
returns                             11.344346
return_std                           7.212643
average_reward                         0.8061
round_time             0 days 00:18:43.762366
episodes_test                           663.0
episode_length_test                 15.072398
returns_test                        12.641005
return_std_test                      9.051867
average_reward_test                  0.838796
round_time_test        0 days 00:00:10.495677
round_time_total       0 days 00:18:43.763573
loss_total               531874902515401088.0
loss_critic              664843616728228352.0
loss_actor                    -2447831718.784
memory_size                           11045.0 

=== epoch 10/10 ==== round 43/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<19:05,  1.74it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [20:31<00:00,  1.62it/s]
episodes                                  702
episode_length                      14.230769
returns                             11.459868
return_std                           7.118573
average_reward                       0.805432
round_time             0 days 00:20:32.202651
episodes_test                           676.0
episode_length_test                 14.779586
returns_test                        11.798418
return_std_test                      9.413866
average_reward_test                  0.798362
round_time_test        0 days 00:00:10.608239
round_time_total       0 days 00:20:32.204155
loss_total               535943542395159680.0
loss_critic              669929416489879680.0
loss_actor                    -2448804505.088
memory_size                           11054.7 

=== epoch 10/10 ==== round 44/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 2/2000 [00:01<23:27,  1.42it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [22:34<00:00,  1.48it/s]
episodes                                  694
episode_length                      14.376081
returns                              11.65648
return_std                           7.814853
average_reward                       0.811086
round_time             0 days 00:22:35.105705
episodes_test                           679.0
episode_length_test                 14.702504
returns_test                         11.67412
return_std_test                      8.185471
average_reward_test                  0.793847
round_time_test        0 days 00:00:11.340684
round_time_total       0 days 00:22:35.107033
loss_total               529016534787013184.0
loss_critic              661270656421350912.0
loss_actor                    -2455804255.616
memory_size                         11091.051 

=== epoch 10/10 ==== round 45/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 2/2000 [00:01<23:08,  1.44it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [15:11<00:00,  2.19it/s]
episodes                                  678
episode_length                      14.733038
returns                              12.12772
return_std                           8.236302
average_reward                       0.823073
round_time             0 days 00:15:12.173584
episodes_test                           680.0
episode_length_test                 14.704412
returns_test                        12.040466
return_std_test                      7.745815
average_reward_test                  0.818856
round_time_test        0 days 00:00:11.427946
round_time_total       0 days 00:15:12.174770
loss_total               543775134523173376.0
loss_critic              679718906327774208.0
loss_actor                    -2468549016.064
memory_size                         11132.516 

=== epoch 10/10 ==== round 46/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<14:23,  2.31it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:47<00:00,  2.61it/s]
episodes                                  660
episode_length                      15.121212
returns                             12.491106
return_std                           8.929507
average_reward                       0.824971
round_time             0 days 00:12:47.582239
episodes_test                           659.0
episode_length_test                 15.168437
returns_test                        12.151841
return_std_test                      8.276836
average_reward_test                  0.801225
round_time_test        0 days 00:00:09.711060
round_time_total       0 days 00:12:47.583296
loss_total               558074392317389696.0
loss_critic              697592978257012096.0
loss_actor                    -2473000001.152
memory_size                        11196.0515 

=== epoch 10/10 ==== round 47/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<13:02,  2.55it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:12<00:00,  2.73it/s]
episodes                                  669
episode_length                      14.944694
returns                             12.298957
return_std                           8.928766
average_reward                       0.822935
round_time             0 days 00:12:12.664379
episodes_test                           687.0
episode_length_test                  14.54294
returns_test                        11.876789
return_std_test                      9.503834
average_reward_test                  0.816485
round_time_test        0 days 00:00:09.326368
round_time_total       0 days 00:12:12.665428
loss_total               567602265174614976.0
loss_critic              709502819627043968.0
loss_actor                    -2477222032.896
memory_size                        11218.8295 

=== epoch 10/10 ==== round 48/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 3/2000 [00:01<15:29,  2.15it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:13<00:00,  2.73it/s]
episodes                                  665
episode_length                       15.02406
returns                             12.450883
return_std                           8.917039
average_reward                       0.828613
round_time             0 days 00:12:14.029219
episodes_test                           698.0
episode_length_test                 14.316619
returns_test                         10.87803
return_std_test                      6.622684
average_reward_test                  0.760021
round_time_test        0 days 00:00:09.322716
round_time_total       0 days 00:12:14.030275
loss_total               559504474220590528.0
loss_critic              699380580462066944.0
loss_actor                     -2488883460.48
memory_size                        11228.5585 

=== epoch 10/10 ==== round 49/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<13:19,  2.50it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:12<00:00,  2.73it/s]
episodes                                  671
episode_length                      14.891207
returns                             12.119068
return_std                           8.472066
average_reward                       0.813716
round_time             0 days 00:12:13.429096
episodes_test                           732.0
episode_length_test                 13.654372
returns_test                        10.928484
return_std_test                       6.89683
average_reward_test                  0.800413
round_time_test        0 days 00:00:09.381580
round_time_total       0 days 00:12:13.430149
loss_total               566177381496102336.0
loss_critic              707721714659535872.0
loss_actor                    -2492198322.304
memory_size                         11245.189 

=== epoch 10/10 ==== round 50/50 =====================================
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
  0%|          | 4/2000 [00:01<12:57,  2.57it/s]/<ANONYMIZED PATH>/python3.12/site-packages/gymnasium/envs/registration.py:519: DeprecationWarning: [33mWARN: The environment Hopper-v4 is out of date. You should consider upgrading to version `v5`.[0m
  logger.deprecation(
100%|██████████| 2000/2000 [12:13<00:00,  2.73it/s]
<GE432_Delay<NormalizeActionWrapper<Float64ToFloat32<CompatWrapper<NoisyActionWrapper<TimeLimit<OrderEnforcing<PassiveEnvChecker<HopperEnv<Hopper-v4>>>>>>>>>>
episodes                                  669
episode_length                      14.928251
returns                             11.954701
return_std                            8.55688
average_reward                       0.800897
round_time             0 days 00:12:14.044048
episodes_test                           645.0
episode_length_test                 15.471318
returns_test                        12.285635
return_std_test                      9.309845
average_reward_test                  0.793393
round_time_test        0 days 00:00:09.158372
round_time_total       0 days 00:12:14.045105
loss_total               570352643165890048.0
loss_critic              712940791242111872.0
loss_actor                    -2489930890.496
memory_size                         11267.223 


