2025-09-16 14:58:54,434 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1108 [DEBUG]: logdir: _logs/noise-eval-v2/humanoid/bpql-noise_0.025-delay_24
2025-09-16 14:58:54,434 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1109 [DEBUG]: trainer_prefix: noise-eval-v2/humanoid/bpql-noise_0.025-delay_24
2025-09-16 14:58:54,434 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1110 [DEBUG]: args.trainer_eval_latencies: {'24': <latency_env.delayed_mdp.ConstantDelay object at 0x14f97d164890>}
2025-09-16 14:58:54,434 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1111 [DEBUG]: using device: cuda
2025-09-16 14:58:54,440 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1133 [INFO]: Creating new trainer
2025-09-16 14:58:54,459 baseline-bpql-noisepromille25-humanoid:113 [DEBUG]: pi network:
NNGaussianPolicy(
  (common_head): Sequential(
    (0): Flatten(start_dim=1, end_dim=-1)
    (1): Linear(in_features=784, out_features=256, bias=True)
    (2): ReLU()
    (3): Linear(in_features=256, out_features=256, bias=True)
    (4): ReLU()
  )
  (mu_head): Sequential(
    (0): Linear(in_features=256, out_features=17, bias=True)
    (1): Unflatten(dim=1, unflattened_size=(17,))
  )
  (log_std_head): Sequential(
    (0): Linear(in_features=256, out_features=17, bias=True)
    (1): Unflatten(dim=1, unflattened_size=(17,))
  )
  (tanh_refit): NNTanhRefit(
    scale: tensor([[0.8000, 0.8000, 0.8000, 0.8000, 0.8000, 0.8000, 0.8000, 0.8000, 0.8000,
             0.8000, 0.8000, 0.8000, 0.8000, 0.8000, 0.8000, 0.8000, 0.8000]]), shift: tensor([[-0.4000, -0.4000, -0.4000, -0.4000, -0.4000, -0.4000, -0.4000, -0.4000,
             -0.4000, -0.4000, -0.4000, -0.4000, -0.4000, -0.4000, -0.4000, -0.4000,
             -0.4000]])
  )
)
2025-09-16 14:58:54,459 baseline-bpql-noisepromille25-humanoid:114 [DEBUG]: q network:
NNLayerConcat2(
  dim: -1
  (next): Sequential(
    (0): Linear(in_features=393, out_features=256, bias=True)
    (1): ReLU()
    (2): Linear(in_features=256, out_features=256, bias=True)
    (3): ReLU()
    (4): Linear(in_features=256, out_features=1, bias=True)
    (5): NNLayerSqueeze(dim: -1)
  )
  (init_left): Flatten(start_dim=1, end_dim=-1)
  (init_right): Flatten(start_dim=1, end_dim=-1)
)
2025-09-16 14:58:56,330 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1194 [DEBUG]: Starting training session...
2025-09-16 14:58:56,330 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 1/100
2025-09-16 15:00:50,236 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:00:51,809 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 471.57550 ± 50.822
2025-09-16 15:00:51,809 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [572.88245, 485.0741, 446.99673, 445.15698, 533.1023, 392.98865, 469.65598, 420.09378, 448.0322, 501.7722]
2025-09-16 15:00:51,809 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [109.0, 92.0, 85.0, 88.0, 103.0, 74.0, 95.0, 87.0, 100.0, 96.0]
2025-09-16 15:00:51,809 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1226 [INFO]: New best (471.58) for latency 24
2025-09-16 15:00:51,817 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 2/100 (estimated time remaining: 3 hours, 10 minutes, 33 seconds)
2025-09-16 15:02:54,773 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:02:56,047 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 402.98111 ± 83.869
2025-09-16 15:02:56,048 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [519.32025, 378.96863, 249.86842, 427.1897, 421.65768, 317.58453, 494.40872, 508.69534, 373.66602, 338.452]
2025-09-16 15:02:56,048 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [95.0, 72.0, 54.0, 80.0, 80.0, 64.0, 94.0, 105.0, 75.0, 65.0]
2025-09-16 15:02:56,059 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 3/100 (estimated time remaining: 3 hours, 15 minutes, 46 seconds)
2025-09-16 15:04:56,295 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:04:57,846 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 476.12402 ± 115.962
2025-09-16 15:04:57,846 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [372.80008, 365.39252, 420.4176, 488.77, 790.1299, 505.48444, 425.43726, 489.16348, 402.37415, 501.2708]
2025-09-16 15:04:57,846 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [73.0, 69.0, 83.0, 96.0, 160.0, 107.0, 85.0, 93.0, 77.0, 96.0]
2025-09-16 15:04:57,846 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1226 [INFO]: New best (476.12) for latency 24
2025-09-16 15:04:57,851 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 4/100 (estimated time remaining: 3 hours, 14 minutes, 49 seconds)
2025-09-16 15:06:57,528 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:06:58,939 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 440.24933 ± 105.124
2025-09-16 15:06:58,939 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [448.33212, 541.46497, 388.60532, 206.89645, 470.01996, 354.7114, 608.7848, 502.77747, 404.65393, 476.24716]
2025-09-16 15:06:58,940 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [86.0, 101.0, 74.0, 40.0, 88.0, 69.0, 113.0, 104.0, 78.0, 89.0]
2025-09-16 15:06:58,948 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 5/100 (estimated time remaining: 3 hours, 13 minutes, 2 seconds)
2025-09-16 15:08:58,996 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:09:00,181 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 373.98486 ± 19.788
2025-09-16 15:09:00,181 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [324.55444, 368.83206, 366.71063, 385.22232, 385.36774, 385.9277, 395.69452, 358.01627, 380.54404, 388.97888]
2025-09-16 15:09:00,181 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [65.0, 69.0, 69.0, 73.0, 72.0, 72.0, 74.0, 69.0, 71.0, 72.0]
2025-09-16 15:09:00,184 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 6/100 (estimated time remaining: 3 hours, 11 minutes, 13 seconds)
2025-09-16 15:11:00,871 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:11:02,130 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 372.87286 ± 111.144
2025-09-16 15:11:02,130 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [562.8359, 375.13956, 163.2412, 425.4824, 382.41165, 414.18097, 370.93542, 431.86264, 413.5788, 189.06012]
2025-09-16 15:11:02,130 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [115.0, 70.0, 31.0, 79.0, 81.0, 77.0, 76.0, 82.0, 83.0, 36.0]
2025-09-16 15:11:02,137 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 7/100 (estimated time remaining: 3 hours, 11 minutes, 14 seconds)
2025-09-16 15:13:01,892 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:13:03,296 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 402.63147 ± 99.454
2025-09-16 15:13:03,296 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [403.45346, 548.17145, 285.04742, 298.6366, 386.85593, 422.48492, 403.00696, 313.55145, 608.5188, 356.58783]
2025-09-16 15:13:03,296 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [78.0, 110.0, 58.0, 62.0, 80.0, 91.0, 83.0, 67.0, 129.0, 74.0]
2025-09-16 15:13:03,301 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 8/100 (estimated time remaining: 3 hours, 8 minutes, 14 seconds)
2025-09-16 15:15:04,767 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:15:06,061 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 379.26160 ± 37.823
2025-09-16 15:15:06,061 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [375.5874, 369.72064, 426.04434, 418.96725, 369.46246, 335.1695, 453.23312, 344.76767, 348.79205, 350.87167]
2025-09-16 15:15:06,061 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [74.0, 70.0, 80.0, 83.0, 72.0, 66.0, 88.0, 68.0, 66.0, 67.0]
2025-09-16 15:15:06,069 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 9/100 (estimated time remaining: 3 hours, 6 minutes, 31 seconds)
2025-09-16 15:17:07,579 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:17:08,603 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 321.45862 ± 88.506
2025-09-16 15:17:08,603 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [170.25027, 274.78564, 406.27484, 297.201, 175.34575, 377.58038, 358.03003, 392.1678, 320.36404, 442.58636]
2025-09-16 15:17:08,603 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [33.0, 54.0, 78.0, 57.0, 34.0, 70.0, 69.0, 75.0, 61.0, 84.0]
2025-09-16 15:17:08,608 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 10/100 (estimated time remaining: 3 hours, 4 minutes, 55 seconds)
2025-09-16 15:19:08,498 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:19:09,650 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 359.49704 ± 62.096
2025-09-16 15:19:09,650 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [306.42783, 254.13173, 363.90866, 389.9312, 393.00702, 260.1886, 405.96948, 357.44238, 427.6351, 436.3286]
2025-09-16 15:19:09,650 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [59.0, 51.0, 68.0, 73.0, 71.0, 51.0, 75.0, 66.0, 77.0, 83.0]
2025-09-16 15:19:09,654 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 11/100 (estimated time remaining: 3 hours, 2 minutes, 50 seconds)
2025-09-16 15:21:10,848 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:21:12,284 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 436.33002 ± 72.986
2025-09-16 15:21:12,284 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [464.9129, 526.6857, 458.07635, 318.06302, 438.474, 466.22778, 423.03333, 552.47205, 395.70593, 319.64893]
2025-09-16 15:21:12,284 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [87.0, 109.0, 85.0, 61.0, 81.0, 87.0, 77.0, 103.0, 76.0, 61.0]
2025-09-16 15:21:12,296 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 12/100 (estimated time remaining: 3 hours, 1 minute)
2025-09-16 15:23:13,130 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:23:14,517 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 399.70840 ± 41.828
2025-09-16 15:23:14,517 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [328.49393, 443.18695, 363.3033, 453.41776, 452.67676, 407.27563, 423.3164, 367.85724, 401.2881, 356.26804]
2025-09-16 15:23:14,517 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [64.0, 87.0, 72.0, 84.0, 94.0, 86.0, 89.0, 76.0, 86.0, 75.0]
2025-09-16 15:23:14,523 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 13/100 (estimated time remaining: 2 hours, 59 minutes, 17 seconds)
2025-09-16 15:25:15,045 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:25:16,783 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 519.76929 ± 93.572
2025-09-16 15:25:16,783 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [490.71707, 556.503, 468.0236, 587.88025, 425.021, 750.0176, 483.2964, 540.76794, 491.92584, 403.54013]
2025-09-16 15:25:16,783 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [90.0, 110.0, 87.0, 113.0, 79.0, 152.0, 90.0, 103.0, 93.0, 74.0]
2025-09-16 15:25:16,783 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1226 [INFO]: New best (519.77) for latency 24
2025-09-16 15:25:16,789 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 14/100 (estimated time remaining: 2 hours, 57 minutes, 6 seconds)
2025-09-16 15:27:18,730 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:27:20,435 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 502.30313 ± 158.447
2025-09-16 15:27:20,435 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [472.416, 184.11331, 443.34387, 786.2047, 507.8229, 412.65817, 713.77014, 460.47015, 451.8431, 590.3894]
2025-09-16 15:27:20,435 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [88.0, 35.0, 91.0, 154.0, 95.0, 78.0, 139.0, 87.0, 88.0, 112.0]
2025-09-16 15:27:20,440 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 15/100 (estimated time remaining: 2 hours, 55 minutes, 23 seconds)
2025-09-16 15:29:20,478 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:29:22,193 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 513.30865 ± 75.087
2025-09-16 15:29:22,193 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [493.02197, 474.7055, 520.1437, 530.8125, 453.87537, 555.8697, 372.78705, 488.71954, 571.63586, 671.51514]
2025-09-16 15:29:22,193 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [103.0, 92.0, 105.0, 101.0, 84.0, 111.0, 71.0, 95.0, 108.0, 129.0]
2025-09-16 15:29:22,196 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 16/100 (estimated time remaining: 2 hours, 53 minutes, 33 seconds)
2025-09-16 15:31:23,953 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:31:25,463 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 457.06830 ± 127.225
2025-09-16 15:31:25,463 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [631.0808, 535.38275, 472.09616, 356.73575, 151.25484, 447.32428, 469.47925, 554.9625, 401.783, 550.5836]
2025-09-16 15:31:25,463 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [131.0, 115.0, 88.0, 69.0, 29.0, 85.0, 86.0, 103.0, 78.0, 113.0]
2025-09-16 15:31:25,483 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 17/100 (estimated time remaining: 2 hours, 51 minutes, 41 seconds)
2025-09-16 15:33:26,730 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:33:28,567 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 536.08423 ± 136.956
2025-09-16 15:33:28,567 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [492.4198, 539.90753, 555.4544, 427.08527, 708.64, 610.2784, 587.3574, 571.07166, 196.04355, 672.5838]
2025-09-16 15:33:28,567 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [91.0, 113.0, 114.0, 84.0, 140.0, 123.0, 111.0, 109.0, 38.0, 138.0]
2025-09-16 15:33:28,568 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1226 [INFO]: New best (536.08) for latency 24
2025-09-16 15:33:28,573 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 18/100 (estimated time remaining: 2 hours, 49 minutes, 53 seconds)
2025-09-16 15:35:30,154 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:35:31,562 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 416.70404 ± 137.121
2025-09-16 15:35:31,562 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [448.18347, 471.08398, 555.0663, 415.98502, 463.82758, 493.27698, 534.6383, 150.8133, 478.9319, 155.23343]
2025-09-16 15:35:31,562 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [89.0, 97.0, 104.0, 80.0, 95.0, 102.0, 102.0, 29.0, 101.0, 30.0]
2025-09-16 15:35:31,566 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 19/100 (estimated time remaining: 2 hours, 48 minutes, 2 seconds)
2025-09-16 15:37:35,568 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:37:37,072 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 463.22696 ± 148.923
2025-09-16 15:37:37,072 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [477.63657, 504.23257, 566.17584, 181.30894, 493.93546, 543.3723, 486.36984, 187.90723, 521.39105, 669.93933]
2025-09-16 15:37:37,072 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [90.0, 95.0, 113.0, 35.0, 94.0, 103.0, 94.0, 36.0, 99.0, 125.0]
2025-09-16 15:37:37,079 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 20/100 (estimated time remaining: 2 hours, 46 minutes, 29 seconds)
2025-09-16 15:39:40,478 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:39:42,292 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 529.42444 ± 82.232
2025-09-16 15:39:42,292 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [527.91956, 531.61426, 572.0502, 665.9523, 465.69568, 429.7612, 513.4491, 412.76065, 508.31482, 666.72723]
2025-09-16 15:39:42,292 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [112.0, 115.0, 110.0, 128.0, 98.0, 86.0, 99.0, 81.0, 106.0, 127.0]
2025-09-16 15:39:42,297 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 21/100 (estimated time remaining: 2 hours, 45 minutes, 21 seconds)
2025-09-16 15:41:47,521 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:41:49,163 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 493.76007 ± 78.922
2025-09-16 15:41:49,163 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [531.32776, 507.84384, 455.70416, 480.30188, 587.02826, 531.8142, 602.4179, 335.4819, 386.91174, 518.76904]
2025-09-16 15:41:49,163 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [97.0, 104.0, 86.0, 92.0, 117.0, 98.0, 117.0, 65.0, 81.0, 102.0]
2025-09-16 15:41:49,169 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 22/100 (estimated time remaining: 2 hours, 44 minutes, 14 seconds)
2025-09-16 15:43:52,628 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:43:54,376 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 521.66779 ± 162.669
2025-09-16 15:43:54,376 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [470.7025, 486.73587, 582.1586, 526.5418, 656.0971, 442.1233, 832.9507, 606.45013, 440.6195, 172.29842]
2025-09-16 15:43:54,376 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [88.0, 96.0, 114.0, 105.0, 123.0, 87.0, 167.0, 115.0, 82.0, 33.0]
2025-09-16 15:43:54,380 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 23/100 (estimated time remaining: 2 hours, 42 minutes, 42 seconds)
2025-09-16 15:45:57,486 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:45:59,134 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 494.38458 ± 127.615
2025-09-16 15:45:59,134 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [477.24582, 532.6778, 462.1955, 422.9616, 499.64618, 632.05084, 607.3252, 172.74928, 502.20926, 634.784]
2025-09-16 15:45:59,134 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [94.0, 100.0, 86.0, 78.0, 96.0, 125.0, 112.0, 33.0, 106.0, 128.0]
2025-09-16 15:45:59,159 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 24/100 (estimated time remaining: 2 hours, 41 minutes, 4 seconds)
2025-09-16 15:47:59,883 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:48:01,603 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 528.40778 ± 125.585
2025-09-16 15:48:01,603 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [547.906, 565.50635, 663.8557, 498.90088, 563.4522, 558.95264, 553.6669, 655.0518, 489.54428, 187.24068]
2025-09-16 15:48:01,603 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [101.0, 109.0, 134.0, 92.0, 113.0, 106.0, 101.0, 122.0, 94.0, 36.0]
2025-09-16 15:48:01,607 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 25/100 (estimated time remaining: 2 hours, 38 minutes, 12 seconds)
2025-09-16 15:50:02,189 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:50:03,779 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 494.94574 ± 147.279
2025-09-16 15:50:03,779 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [606.94244, 483.38004, 617.6448, 519.41284, 533.913, 762.02185, 194.02048, 425.64166, 361.08667, 445.39386]
2025-09-16 15:50:03,779 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [113.0, 90.0, 117.0, 94.0, 98.0, 145.0, 37.0, 91.0, 70.0, 86.0]
2025-09-16 15:50:03,800 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 26/100 (estimated time remaining: 2 hours, 35 minutes, 22 seconds)
2025-09-16 15:52:04,403 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:52:06,269 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 560.93152 ± 163.156
2025-09-16 15:52:06,269 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [464.36426, 161.90234, 703.8101, 687.0223, 540.7138, 652.97595, 669.5492, 484.9481, 739.1045, 504.925]
2025-09-16 15:52:06,269 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [90.0, 31.0, 134.0, 128.0, 109.0, 123.0, 127.0, 103.0, 148.0, 98.0]
2025-09-16 15:52:06,269 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1226 [INFO]: New best (560.93) for latency 24
2025-09-16 15:52:06,273 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 27/100 (estimated time remaining: 2 hours, 32 minutes, 13 seconds)
2025-09-16 15:54:08,320 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:54:10,201 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 566.35138 ± 54.036
2025-09-16 15:54:10,201 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [524.6152, 563.4229, 609.32336, 533.5956, 619.8132, 549.4755, 692.0343, 515.3955, 523.4744, 532.36346]
2025-09-16 15:54:10,201 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [102.0, 105.0, 124.0, 100.0, 114.0, 103.0, 137.0, 98.0, 96.0, 100.0]
2025-09-16 15:54:10,201 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1226 [INFO]: New best (566.35) for latency 24
2025-09-16 15:54:10,205 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 28/100 (estimated time remaining: 2 hours, 29 minutes, 51 seconds)
2025-09-16 15:56:10,070 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:56:11,629 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 484.01727 ± 170.183
2025-09-16 15:56:11,629 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [178.05975, 701.3988, 550.07196, 467.80734, 537.2709, 616.25366, 644.19025, 170.9843, 478.5153, 495.6208]
2025-09-16 15:56:11,629 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [34.0, 133.0, 103.0, 86.0, 98.0, 113.0, 132.0, 33.0, 88.0, 94.0]
2025-09-16 15:56:11,637 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 29/100 (estimated time remaining: 2 hours, 26 minutes, 59 seconds)
2025-09-16 15:58:13,356 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 15:58:15,156 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 532.44891 ± 187.147
2025-09-16 15:58:15,156 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [588.85297, 374.08124, 532.56665, 562.25, 485.72693, 160.19849, 942.1142, 620.226, 480.3285, 578.1442]
2025-09-16 15:58:15,156 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [111.0, 81.0, 98.0, 105.0, 90.0, 31.0, 186.0, 119.0, 105.0, 123.0]
2025-09-16 15:58:15,161 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 30/100 (estimated time remaining: 2 hours, 25 minutes, 12 seconds)
2025-09-16 16:00:16,109 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:00:17,727 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 489.93561 ± 262.745
2025-09-16 16:00:17,727 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [585.68976, 175.79903, 495.769, 178.2144, 466.0234, 1079.8711, 506.42938, 705.8748, 514.40656, 191.27855]
2025-09-16 16:00:17,727 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [108.0, 34.0, 91.0, 34.0, 86.0, 212.0, 94.0, 142.0, 104.0, 37.0]
2025-09-16 16:00:17,734 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 31/100 (estimated time remaining: 2 hours, 23 minutes, 15 seconds)
2025-09-16 16:02:18,423 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:02:19,869 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 452.71231 ± 168.899
2025-09-16 16:02:19,869 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [721.3609, 586.22516, 587.848, 449.30704, 349.10992, 199.46964, 356.3098, 180.76265, 565.4364, 531.2932]
2025-09-16 16:02:19,869 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [140.0, 113.0, 108.0, 86.0, 67.0, 38.0, 69.0, 35.0, 111.0, 97.0]
2025-09-16 16:02:19,874 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 32/100 (estimated time remaining: 2 hours, 21 minutes, 7 seconds)
2025-09-16 16:04:20,325 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:04:21,825 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 469.03458 ± 158.167
2025-09-16 16:04:21,825 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [589.0773, 527.8877, 167.24605, 572.0187, 514.9171, 641.1799, 420.58188, 176.4236, 559.0307, 521.98285]
2025-09-16 16:04:21,825 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [111.0, 96.0, 32.0, 110.0, 94.0, 122.0, 79.0, 34.0, 111.0, 96.0]
2025-09-16 16:04:21,831 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 33/100 (estimated time remaining: 2 hours, 18 minutes, 38 seconds)
2025-09-16 16:06:23,585 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:06:25,458 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 571.33795 ± 91.622
2025-09-16 16:06:25,458 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [614.6586, 596.3988, 642.06586, 554.69116, 511.24124, 366.23117, 729.70966, 532.1632, 540.75507, 625.4649]
2025-09-16 16:06:25,458 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [117.0, 110.0, 119.0, 109.0, 97.0, 71.0, 141.0, 101.0, 112.0, 135.0]
2025-09-16 16:06:25,458 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1226 [INFO]: New best (571.34) for latency 24
2025-09-16 16:06:25,463 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 34/100 (estimated time remaining: 2 hours, 17 minutes, 5 seconds)
2025-09-16 16:08:27,086 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:08:28,836 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 537.48962 ± 151.448
2025-09-16 16:08:28,836 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [570.62177, 512.391, 689.5813, 150.45444, 575.0502, 586.6921, 719.46405, 512.6503, 621.1982, 436.79364]
2025-09-16 16:08:28,836 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [109.0, 99.0, 133.0, 29.0, 116.0, 110.0, 132.0, 94.0, 117.0, 85.0]
2025-09-16 16:08:28,870 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 35/100 (estimated time remaining: 2 hours, 15 minutes)
2025-09-16 16:10:28,982 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:10:30,649 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 526.07922 ± 108.129
2025-09-16 16:10:30,649 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [416.28793, 585.5696, 487.3199, 465.8384, 558.3425, 447.71814, 485.90964, 673.2609, 394.4453, 746.09985]
2025-09-16 16:10:30,650 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [78.0, 109.0, 90.0, 86.0, 101.0, 82.0, 91.0, 127.0, 74.0, 142.0]
2025-09-16 16:10:30,658 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 36/100 (estimated time remaining: 2 hours, 12 minutes, 48 seconds)
2025-09-16 16:12:31,410 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:12:33,073 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 511.86197 ± 124.870
2025-09-16 16:12:33,074 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [617.328, 546.46045, 417.5115, 566.3767, 631.53955, 188.7808, 510.94406, 483.99652, 535.75226, 619.9296]
2025-09-16 16:12:33,074 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [114.0, 100.0, 89.0, 105.0, 121.0, 37.0, 93.0, 101.0, 102.0, 117.0]
2025-09-16 16:12:33,078 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 37/100 (estimated time remaining: 2 hours, 10 minutes, 49 seconds)
2025-09-16 16:14:34,428 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:14:36,156 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 512.05853 ± 199.321
2025-09-16 16:14:36,156 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [515.71735, 552.49066, 603.6643, 697.25354, 160.8016, 411.44678, 811.16455, 187.18555, 668.3932, 512.4676]
2025-09-16 16:14:36,156 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [96.0, 107.0, 119.0, 134.0, 31.0, 79.0, 157.0, 36.0, 139.0, 96.0]
2025-09-16 16:14:36,164 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 38/100 (estimated time remaining: 2 hours, 9 minutes)
2025-09-16 16:16:37,994 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:16:39,725 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 541.47546 ± 96.400
2025-09-16 16:16:39,725 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [426.97733, 464.14368, 717.8865, 594.31433, 467.1289, 708.738, 469.98022, 527.35364, 511.65457, 526.57733]
2025-09-16 16:16:39,726 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [79.0, 88.0, 138.0, 116.0, 86.0, 136.0, 89.0, 99.0, 93.0, 101.0]
2025-09-16 16:16:39,730 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 39/100 (estimated time remaining: 2 hours, 6 minutes, 56 seconds)
2025-09-16 16:18:37,810 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:18:39,551 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 543.17712 ± 160.739
2025-09-16 16:18:39,551 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [525.26025, 644.3692, 461.3509, 501.82935, 759.4221, 161.13501, 477.30548, 596.77234, 740.8172, 563.5091]
2025-09-16 16:18:39,551 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [101.0, 119.0, 88.0, 98.0, 152.0, 31.0, 89.0, 116.0, 142.0, 105.0]
2025-09-16 16:18:39,579 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 40/100 (estimated time remaining: 2 hours, 4 minutes, 10 seconds)
2025-09-16 16:20:38,290 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:20:40,040 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 546.43976 ± 87.396
2025-09-16 16:20:40,040 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [551.9524, 438.46014, 584.7982, 511.67413, 611.86957, 477.66006, 650.43225, 566.5437, 391.38385, 679.62305]
2025-09-16 16:20:40,040 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [101.0, 84.0, 113.0, 96.0, 116.0, 93.0, 121.0, 107.0, 74.0, 125.0]
2025-09-16 16:20:40,076 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 41/100 (estimated time remaining: 2 hours, 1 minute, 53 seconds)
2025-09-16 16:22:37,704 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:22:39,322 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 508.51959 ± 155.918
2025-09-16 16:22:39,322 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [328.6268, 506.87436, 450.23087, 552.9971, 630.2906, 606.29535, 489.72586, 166.45386, 617.927, 735.774]
2025-09-16 16:22:39,322 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [64.0, 98.0, 81.0, 105.0, 115.0, 120.0, 92.0, 32.0, 117.0, 139.0]
2025-09-16 16:22:39,327 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 42/100 (estimated time remaining: 1 hour, 59 minutes, 13 seconds)
2025-09-16 16:24:37,678 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:24:39,512 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 571.06384 ± 157.713
2025-09-16 16:24:39,513 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [574.60974, 457.98584, 162.36884, 532.7347, 692.4015, 735.5269, 689.1246, 671.94464, 607.1113, 586.83044]
2025-09-16 16:24:39,513 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [109.0, 96.0, 31.0, 98.0, 128.0, 140.0, 132.0, 126.0, 113.0, 110.0]
2025-09-16 16:24:39,519 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 43/100 (estimated time remaining: 1 hour, 56 minutes, 38 seconds)
2025-09-16 16:26:36,771 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:26:38,614 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 553.93433 ± 202.899
2025-09-16 16:26:38,614 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [563.3285, 730.6812, 711.4018, 645.54333, 689.81195, 559.7457, 188.08952, 695.24493, 615.2054, 140.2908]
2025-09-16 16:26:38,614 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [107.0, 147.0, 137.0, 128.0, 130.0, 109.0, 36.0, 132.0, 119.0, 27.0]
2025-09-16 16:26:38,620 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 44/100 (estimated time remaining: 1 hour, 53 minutes, 47 seconds)
2025-09-16 16:28:36,828 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:28:38,871 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 625.35272 ± 104.878
2025-09-16 16:28:38,872 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [721.2935, 647.66583, 620.7126, 690.26337, 644.7935, 611.86304, 576.2899, 367.7464, 588.312, 784.5873]
2025-09-16 16:28:38,872 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [138.0, 125.0, 119.0, 131.0, 135.0, 116.0, 115.0, 70.0, 112.0, 144.0]
2025-09-16 16:28:38,872 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1226 [INFO]: New best (625.35) for latency 24
2025-09-16 16:28:38,881 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 45/100 (estimated time remaining: 1 hour, 51 minutes, 52 seconds)
2025-09-16 16:30:37,243 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:30:39,120 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 584.70013 ± 123.234
2025-09-16 16:30:39,120 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [782.8839, 806.2221, 400.9993, 533.4238, 578.36975, 476.05472, 576.55066, 477.97296, 569.6878, 644.836]
2025-09-16 16:30:39,120 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [150.0, 157.0, 76.0, 99.0, 105.0, 87.0, 111.0, 91.0, 108.0, 125.0]
2025-09-16 16:30:39,133 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 46/100 (estimated time remaining: 1 hour, 49 minutes, 49 seconds)
2025-09-16 16:32:36,798 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:32:38,814 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 578.39368 ± 102.588
2025-09-16 16:32:38,814 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [573.9223, 621.92194, 560.48236, 554.4756, 518.0368, 859.11725, 510.1765, 497.45822, 487.42474, 600.9209]
2025-09-16 16:32:38,814 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [106.0, 120.0, 105.0, 116.0, 99.0, 179.0, 96.0, 91.0, 88.0, 114.0]
2025-09-16 16:32:38,823 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 47/100 (estimated time remaining: 1 hour, 47 minutes, 54 seconds)
2025-09-16 16:34:38,108 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:34:39,967 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 531.02893 ± 190.474
2025-09-16 16:34:39,967 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [556.3619, 236.32112, 431.5513, 662.2934, 681.68744, 640.791, 533.7306, 842.00775, 536.12604, 189.41891]
2025-09-16 16:34:39,967 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [108.0, 46.0, 82.0, 124.0, 128.0, 121.0, 100.0, 172.0, 103.0, 36.0]
2025-09-16 16:34:40,000 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 48/100 (estimated time remaining: 1 hour, 46 minutes, 5 seconds)
2025-09-16 16:36:53,717 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:36:55,615 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 559.99036 ± 149.759
2025-09-16 16:36:55,615 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [524.0215, 499.31653, 633.6409, 515.1359, 203.49178, 641.9554, 787.2028, 483.6183, 622.19574, 689.3251]
2025-09-16 16:36:55,615 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [94.0, 96.0, 131.0, 95.0, 39.0, 130.0, 146.0, 89.0, 120.0, 127.0]
2025-09-16 16:36:55,619 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 49/100 (estimated time remaining: 1 hour, 46 minutes, 56 seconds)
2025-09-16 16:39:14,678 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:39:16,659 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 586.77411 ± 140.621
2025-09-16 16:39:16,659 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [544.89795, 601.43207, 661.0797, 669.735, 628.501, 614.52966, 506.88235, 728.8757, 210.9262, 700.88135]
2025-09-16 16:39:16,659 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [102.0, 115.0, 124.0, 128.0, 118.0, 115.0, 95.0, 137.0, 41.0, 133.0]
2025-09-16 16:39:16,666 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 50/100 (estimated time remaining: 1 hour, 48 minutes, 25 seconds)
2025-09-16 16:41:31,567 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:41:33,755 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 621.09460 ± 92.702
2025-09-16 16:41:33,755 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [592.23047, 513.68555, 540.4334, 497.00854, 599.28577, 673.8196, 721.41364, 594.6661, 809.0138, 669.38965]
2025-09-16 16:41:33,755 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [111.0, 96.0, 100.0, 98.0, 115.0, 125.0, 139.0, 110.0, 162.0, 134.0]
2025-09-16 16:41:33,763 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 51/100 (estimated time remaining: 1 hour, 49 minutes, 6 seconds)
2025-09-16 16:43:54,543 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:43:56,612 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 574.30817 ± 166.756
2025-09-16 16:43:56,612 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [536.25696, 700.71265, 483.2218, 801.66235, 687.71716, 563.5841, 551.089, 475.4015, 192.15007, 751.28595]
2025-09-16 16:43:56,613 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [102.0, 148.0, 92.0, 168.0, 129.0, 107.0, 115.0, 90.0, 37.0, 151.0]
2025-09-16 16:43:56,633 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 52/100 (estimated time remaining: 1 hour, 50 minutes, 42 seconds)
2025-09-16 16:46:12,976 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:46:15,272 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 612.69470 ± 121.694
2025-09-16 16:46:15,272 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [895.43335, 659.3513, 578.7023, 530.0759, 595.658, 570.01556, 416.3349, 667.6927, 522.48126, 691.201]
2025-09-16 16:46:15,272 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [181.0, 128.0, 109.0, 99.0, 112.0, 106.0, 86.0, 126.0, 94.0, 133.0]
2025-09-16 16:46:15,280 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 53/100 (estimated time remaining: 1 hour, 51 minutes, 14 seconds)
2025-09-16 16:48:33,113 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:48:35,207 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 604.48730 ± 189.363
2025-09-16 16:48:35,207 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [192.05763, 778.2954, 824.6772, 438.87338, 586.5833, 869.24243, 646.6485, 633.5112, 524.19464, 550.78937]
2025-09-16 16:48:35,207 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [37.0, 158.0, 167.0, 81.0, 107.0, 173.0, 120.0, 117.0, 94.0, 100.0]
2025-09-16 16:48:35,213 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 54/100 (estimated time remaining: 1 hour, 49 minutes, 36 seconds)
2025-09-16 16:50:54,738 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:50:56,868 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 584.35541 ± 145.794
2025-09-16 16:50:56,868 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [716.36176, 672.1231, 562.669, 700.0738, 553.4742, 214.0912, 712.37946, 679.8773, 497.15457, 535.3494]
2025-09-16 16:50:56,868 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [135.0, 128.0, 110.0, 137.0, 108.0, 42.0, 135.0, 126.0, 96.0, 104.0]
2025-09-16 16:50:56,874 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 55/100 (estimated time remaining: 1 hour, 47 minutes, 21 seconds)
2025-09-16 16:53:15,408 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:53:17,101 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 478.44305 ± 145.263
2025-09-16 16:53:17,102 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [151.09743, 466.2047, 613.6055, 554.516, 506.47388, 416.97928, 498.71274, 313.87927, 612.03345, 650.9287]
2025-09-16 16:53:17,102 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [29.0, 89.0, 113.0, 104.0, 95.0, 84.0, 104.0, 61.0, 121.0, 128.0]
2025-09-16 16:53:17,113 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 56/100 (estimated time remaining: 1 hour, 45 minutes, 30 seconds)
2025-09-16 16:55:37,149 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:55:39,035 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 537.71082 ± 144.027
2025-09-16 16:55:39,035 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [156.8941, 547.5337, 557.7887, 562.26886, 440.60922, 625.70465, 701.84216, 545.99896, 663.0621, 575.4063]
2025-09-16 16:55:39,035 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [30.0, 102.0, 100.0, 110.0, 86.0, 117.0, 137.0, 102.0, 125.0, 109.0]
2025-09-16 16:55:39,043 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 57/100 (estimated time remaining: 1 hour, 43 minutes, 1 second)
2025-09-16 16:57:57,624 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 16:57:59,545 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 585.00854 ± 95.240
2025-09-16 16:57:59,546 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [395.99652, 563.56146, 740.03467, 693.15735, 598.30304, 578.9393, 652.4651, 582.38153, 466.7814, 578.46515]
2025-09-16 16:57:59,546 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [74.0, 103.0, 138.0, 136.0, 110.0, 112.0, 118.0, 107.0, 86.0, 108.0]
2025-09-16 16:57:59,554 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 58/100 (estimated time remaining: 1 hour, 40 minutes, 56 seconds)
2025-09-16 17:00:18,455 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:00:20,356 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 554.91162 ± 168.084
2025-09-16 17:00:20,356 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [449.12515, 584.39233, 453.01138, 778.1669, 192.62401, 727.16656, 528.15405, 624.938, 466.9891, 744.54895]
2025-09-16 17:00:20,356 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [87.0, 109.0, 85.0, 145.0, 37.0, 136.0, 100.0, 117.0, 87.0, 142.0]
2025-09-16 17:00:20,362 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 59/100 (estimated time remaining: 1 hour, 38 minutes, 43 seconds)
2025-09-16 17:02:40,643 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:02:42,258 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 465.49081 ± 200.414
2025-09-16 17:02:42,259 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [586.66296, 645.33984, 648.9196, 585.98755, 604.37744, 155.47812, 436.25037, 193.20715, 630.99115, 167.69368]
2025-09-16 17:02:42,259 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [110.0, 131.0, 119.0, 109.0, 118.0, 30.0, 82.0, 37.0, 115.0, 32.0]
2025-09-16 17:02:42,265 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 60/100 (estimated time remaining: 1 hour, 36 minutes, 24 seconds)
2025-09-16 17:04:58,544 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:05:00,544 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 566.80676 ± 126.580
2025-09-16 17:05:00,544 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [601.80505, 619.68085, 637.1212, 452.28424, 597.5801, 709.37946, 663.71515, 260.08185, 481.44037, 644.9793]
2025-09-16 17:05:00,544 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [111.0, 126.0, 127.0, 84.0, 118.0, 134.0, 136.0, 49.0, 91.0, 120.0]
2025-09-16 17:05:00,562 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 61/100 (estimated time remaining: 1 hour, 33 minutes, 47 seconds)
2025-09-16 17:07:20,709 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:07:22,789 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 597.21667 ± 299.540
2025-09-16 17:07:22,789 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [611.827, 693.41254, 553.24066, 612.0668, 1332.4711, 177.97176, 642.7091, 618.6686, 193.4639, 536.33594]
2025-09-16 17:07:22,789 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [111.0, 128.0, 102.0, 111.0, 263.0, 34.0, 123.0, 112.0, 37.0, 97.0]
2025-09-16 17:07:22,798 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 62/100 (estimated time remaining: 1 hour, 31 minutes, 29 seconds)
2025-09-16 17:09:41,526 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:09:43,678 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 614.75897 ± 50.858
2025-09-16 17:09:43,678 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [633.9821, 556.2895, 556.8357, 558.14575, 554.773, 647.8664, 701.9733, 645.7566, 633.61774, 658.35]
2025-09-16 17:09:43,678 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [117.0, 102.0, 106.0, 119.0, 101.0, 120.0, 130.0, 120.0, 118.0, 122.0]
2025-09-16 17:09:43,687 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 63/100 (estimated time remaining: 1 hour, 29 minutes, 11 seconds)
2025-09-16 17:12:01,881 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:12:03,708 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 546.29211 ± 165.960
2025-09-16 17:12:03,708 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [683.18774, 675.04626, 592.23944, 516.49835, 155.91899, 540.88354, 807.62476, 542.0522, 419.3411, 530.12836]
2025-09-16 17:12:03,708 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [127.0, 128.0, 111.0, 94.0, 30.0, 103.0, 151.0, 109.0, 79.0, 98.0]
2025-09-16 17:12:03,739 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 64/100 (estimated time remaining: 1 hour, 26 minutes, 44 seconds)
2025-09-16 17:14:24,229 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:14:26,267 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 547.89819 ± 97.589
2025-09-16 17:14:26,267 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [399.95004, 624.7357, 662.49084, 630.7445, 483.93372, 686.5837, 399.1542, 528.2992, 554.7685, 508.32162]
2025-09-16 17:14:26,267 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [77.0, 118.0, 124.0, 130.0, 91.0, 124.0, 74.0, 104.0, 102.0, 95.0]
2025-09-16 17:14:26,276 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 65/100 (estimated time remaining: 1 hour, 24 minutes, 28 seconds)
2025-09-16 17:16:42,119 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:16:44,187 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 590.68982 ± 153.006
2025-09-16 17:16:44,187 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [171.9849, 648.29596, 728.2981, 683.8816, 644.32227, 729.82623, 522.2532, 575.88995, 585.2544, 616.8916]
2025-09-16 17:16:44,187 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [33.0, 130.0, 140.0, 129.0, 124.0, 136.0, 93.0, 110.0, 116.0, 127.0]
2025-09-16 17:16:44,193 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 66/100 (estimated time remaining: 1 hour, 22 minutes, 5 seconds)
2025-09-16 17:19:06,974 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:19:08,915 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 551.31665 ± 153.776
2025-09-16 17:19:08,916 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [743.3087, 499.95178, 670.09033, 523.35236, 168.17043, 476.4632, 672.26886, 655.40485, 506.17816, 597.97766]
2025-09-16 17:19:08,916 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [146.0, 93.0, 122.0, 99.0, 32.0, 89.0, 129.0, 128.0, 103.0, 111.0]
2025-09-16 17:19:08,926 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 67/100 (estimated time remaining: 1 hour, 20 minutes, 1 second)
2025-09-16 17:21:25,066 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:21:27,228 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 570.96527 ± 145.150
2025-09-16 17:21:27,228 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [175.56514, 590.14526, 701.15027, 676.5748, 614.82605, 685.4258, 593.6898, 566.7373, 622.241, 483.29742]
2025-09-16 17:21:27,228 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [34.0, 117.0, 136.0, 124.0, 113.0, 127.0, 108.0, 111.0, 118.0, 90.0]
2025-09-16 17:21:27,242 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 68/100 (estimated time remaining: 1 hour, 17 minutes, 23 seconds)
2025-09-16 17:23:49,250 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:23:51,380 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 625.14679 ± 166.260
2025-09-16 17:23:51,381 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [758.4103, 206.07321, 749.5849, 602.0036, 740.09924, 623.4654, 478.49487, 640.52094, 650.4024, 802.41315]
2025-09-16 17:23:51,381 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [144.0, 40.0, 144.0, 112.0, 136.0, 115.0, 90.0, 129.0, 119.0, 153.0]
2025-09-16 17:23:51,395 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 69/100 (estimated time remaining: 1 hour, 15 minutes, 29 seconds)
2025-09-16 17:26:09,792 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:26:11,876 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 573.49268 ± 220.630
2025-09-16 17:26:11,876 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [187.311, 541.0275, 701.7482, 806.43933, 584.887, 157.13914, 816.8695, 585.55334, 600.8363, 753.1158]
2025-09-16 17:26:11,877 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [36.0, 98.0, 148.0, 158.0, 109.0, 30.0, 152.0, 112.0, 113.0, 141.0]
2025-09-16 17:26:11,905 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 70/100 (estimated time remaining: 1 hour, 12 minutes, 54 seconds)
2025-09-16 17:28:32,111 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:28:34,068 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 573.89270 ± 143.011
2025-09-16 17:28:34,068 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [555.14435, 701.3989, 178.53947, 623.7096, 609.9665, 493.75354, 643.0968, 648.1054, 613.7775, 671.4357]
2025-09-16 17:28:34,069 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [116.0, 132.0, 34.0, 116.0, 111.0, 88.0, 122.0, 127.0, 113.0, 128.0]
2025-09-16 17:28:34,077 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 71/100 (estimated time remaining: 1 hour, 10 minutes, 59 seconds)
2025-09-16 17:30:52,298 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:30:54,562 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 635.86707 ± 177.963
2025-09-16 17:30:54,563 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [577.8113, 717.0975, 468.3263, 817.2196, 557.5352, 535.90533, 374.79178, 633.61316, 638.65906, 1037.7117]
2025-09-16 17:30:54,563 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [105.0, 137.0, 84.0, 154.0, 104.0, 101.0, 75.0, 117.0, 120.0, 195.0]
2025-09-16 17:30:54,563 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1226 [INFO]: New best (635.87) for latency 24
2025-09-16 17:30:54,574 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 72/100 (estimated time remaining: 1 hour, 8 minutes, 12 seconds)
2025-09-16 17:33:15,676 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:33:17,645 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 566.65515 ± 143.093
2025-09-16 17:33:17,645 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [635.8138, 634.6764, 632.37775, 610.80304, 473.4586, 755.8985, 188.79306, 552.57306, 605.3694, 576.78827]
2025-09-16 17:33:17,645 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [121.0, 116.0, 117.0, 112.0, 87.0, 144.0, 36.0, 104.0, 112.0, 108.0]
2025-09-16 17:33:17,653 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 73/100 (estimated time remaining: 1 hour, 6 minutes, 18 seconds)
2025-09-16 17:35:36,345 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:35:38,436 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 590.41846 ± 171.122
2025-09-16 17:35:38,436 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [515.7811, 183.01346, 802.65424, 755.01434, 697.7777, 686.0424, 463.46088, 545.7622, 689.1228, 565.5554]
2025-09-16 17:35:38,436 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [102.0, 35.0, 161.0, 156.0, 132.0, 133.0, 87.0, 102.0, 128.0, 107.0]
2025-09-16 17:35:38,449 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 74/100 (estimated time remaining: 1 hour, 3 minutes, 38 seconds)
2025-09-16 17:37:58,968 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:38:00,797 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 554.84393 ± 142.324
2025-09-16 17:38:00,797 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [615.70917, 156.84991, 629.055, 592.8635, 649.0399, 554.8095, 621.065, 464.5689, 639.89154, 624.58704]
2025-09-16 17:38:00,797 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [116.0, 30.0, 119.0, 110.0, 119.0, 103.0, 114.0, 89.0, 120.0, 112.0]
2025-09-16 17:38:00,806 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 75/100 (estimated time remaining: 1 hour, 1 minute, 26 seconds)
2025-09-16 17:40:19,848 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:40:22,309 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 681.93597 ± 122.207
2025-09-16 17:40:22,309 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [644.7005, 861.48663, 848.5782, 611.9117, 799.77673, 610.2894, 537.2503, 501.02365, 633.08234, 771.2602]
2025-09-16 17:40:22,309 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [118.0, 171.0, 163.0, 122.0, 156.0, 115.0, 111.0, 93.0, 120.0, 151.0]
2025-09-16 17:40:22,309 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1226 [INFO]: New best (681.94) for latency 24
2025-09-16 17:40:22,317 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 76/100 (estimated time remaining: 59 minutes, 1 second)
2025-09-16 17:42:42,293 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:42:44,228 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 571.65393 ± 158.128
2025-09-16 17:42:44,228 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [198.30719, 646.95245, 639.65765, 504.7468, 673.78656, 604.8328, 710.76697, 733.40857, 622.75305, 381.32703]
2025-09-16 17:42:44,228 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [38.0, 119.0, 124.0, 96.0, 128.0, 113.0, 135.0, 136.0, 111.0, 72.0]
2025-09-16 17:42:44,239 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 77/100 (estimated time remaining: 56 minutes, 46 seconds)
2025-09-16 17:45:03,184 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:45:05,259 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 618.17242 ± 179.131
2025-09-16 17:45:05,260 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [701.3624, 753.0735, 185.90103, 610.5501, 560.0892, 429.9884, 739.70337, 757.17456, 636.9993, 806.88165]
2025-09-16 17:45:05,260 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [128.0, 139.0, 36.0, 111.0, 102.0, 78.0, 139.0, 141.0, 114.0, 149.0]
2025-09-16 17:45:05,287 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 78/100 (estimated time remaining: 54 minutes, 15 seconds)
2025-09-16 17:47:23,196 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:47:25,340 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 601.81384 ± 154.659
2025-09-16 17:47:25,340 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [576.53424, 599.17523, 192.20168, 643.94305, 720.7073, 553.20807, 740.8737, 597.3206, 783.63293, 610.5413]
2025-09-16 17:47:25,340 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [117.0, 110.0, 37.0, 118.0, 146.0, 113.0, 142.0, 110.0, 149.0, 120.0]
2025-09-16 17:47:25,352 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 79/100 (estimated time remaining: 51 minutes, 50 seconds)
2025-09-16 17:49:45,193 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:49:47,252 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 605.01819 ± 243.861
2025-09-16 17:49:47,252 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [750.3111, 539.1794, 734.4664, 622.17883, 233.92755, 596.2802, 594.5424, 657.11334, 210.93181, 1111.2507]
2025-09-16 17:49:47,252 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [139.0, 101.0, 135.0, 114.0, 45.0, 111.0, 114.0, 121.0, 40.0, 225.0]
2025-09-16 17:49:47,266 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 80/100 (estimated time remaining: 49 minutes, 27 seconds)
2025-09-16 17:52:06,386 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:52:08,573 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 607.08539 ± 265.734
2025-09-16 17:52:08,573 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [640.24207, 162.02634, 605.7459, 492.13876, 703.3124, 1042.1456, 940.5166, 205.59933, 741.3984, 537.7284]
2025-09-16 17:52:08,573 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [125.0, 31.0, 119.0, 91.0, 136.0, 211.0, 191.0, 39.0, 145.0, 101.0]
2025-09-16 17:52:08,612 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 81/100 (estimated time remaining: 47 minutes, 5 seconds)
2025-09-16 17:54:26,727 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:54:29,241 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 714.14221 ± 127.076
2025-09-16 17:54:29,241 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [722.5608, 727.8928, 612.28577, 601.69403, 568.6938, 635.6882, 652.20105, 958.98645, 930.5389, 730.8799]
2025-09-16 17:54:29,241 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [138.0, 146.0, 112.0, 123.0, 113.0, 118.0, 123.0, 191.0, 180.0, 145.0]
2025-09-16 17:54:29,241 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1226 [INFO]: New best (714.14) for latency 24
2025-09-16 17:54:29,252 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 82/100 (estimated time remaining: 44 minutes, 39 seconds)
2025-09-16 17:56:50,957 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:56:53,170 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 598.72809 ± 186.551
2025-09-16 17:56:53,170 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [653.21796, 788.7326, 574.2846, 160.8362, 884.31213, 526.0643, 696.68005, 570.4124, 659.285, 473.45575]
2025-09-16 17:56:53,170 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [118.0, 149.0, 105.0, 31.0, 176.0, 105.0, 130.0, 118.0, 124.0, 99.0]
2025-09-16 17:56:53,182 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 83/100 (estimated time remaining: 42 minutes, 28 seconds)
2025-09-16 17:59:10,818 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 17:59:12,963 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 648.92853 ± 136.991
2025-09-16 17:59:12,963 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [604.9528, 695.0219, 803.7424, 419.74246, 581.01733, 904.6551, 528.165, 670.39636, 536.08356, 745.5082]
2025-09-16 17:59:12,963 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [115.0, 129.0, 151.0, 78.0, 108.0, 167.0, 102.0, 128.0, 100.0, 136.0]
2025-09-16 17:59:12,972 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 84/100 (estimated time remaining: 40 minutes, 5 seconds)
2025-09-16 18:01:32,503 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 18:01:34,967 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 669.30438 ± 118.623
2025-09-16 18:01:34,967 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [668.8041, 686.8865, 555.74567, 747.39484, 547.0253, 980.3476, 634.93036, 657.36865, 625.86597, 588.675]
2025-09-16 18:01:34,967 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [135.0, 130.0, 109.0, 155.0, 98.0, 185.0, 116.0, 123.0, 122.0, 111.0]
2025-09-16 18:01:34,975 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 85/100 (estimated time remaining: 37 minutes, 44 seconds)
2025-09-16 18:03:52,664 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 18:03:54,588 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 551.36658 ± 166.839
2025-09-16 18:03:54,588 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [553.9516, 201.1917, 647.2523, 488.02127, 319.43134, 779.4447, 564.2486, 594.0871, 687.84033, 678.1972]
2025-09-16 18:03:54,588 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [102.0, 39.0, 131.0, 92.0, 63.0, 145.0, 110.0, 122.0, 134.0, 127.0]
2025-09-16 18:03:54,599 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 86/100 (estimated time remaining: 35 minutes, 17 seconds)
2025-09-16 18:06:14,670 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 18:06:17,249 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 698.33032 ± 101.295
2025-09-16 18:06:17,249 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [743.27325, 574.13715, 771.1628, 673.08685, 906.07135, 548.7912, 605.72845, 676.6666, 722.069, 762.3164]
2025-09-16 18:06:17,249 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [140.0, 114.0, 144.0, 126.0, 171.0, 101.0, 115.0, 126.0, 134.0, 149.0]
2025-09-16 18:06:17,280 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 87/100 (estimated time remaining: 33 minutes, 2 seconds)
2025-09-16 18:08:35,509 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 18:08:37,644 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 625.21082 ± 271.268
2025-09-16 18:08:37,644 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [560.95074, 569.74, 955.073, 905.52655, 647.83795, 640.0802, 985.8207, 172.79247, 171.86946, 642.4169]
2025-09-16 18:08:37,644 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [104.0, 104.0, 193.0, 171.0, 120.0, 118.0, 187.0, 33.0, 33.0, 124.0]
2025-09-16 18:08:37,655 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 88/100 (estimated time remaining: 30 minutes, 31 seconds)
2025-09-16 18:10:58,209 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 18:11:00,607 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 690.62860 ± 87.255
2025-09-16 18:11:00,607 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [656.43207, 470.35217, 800.6814, 701.4356, 715.16254, 704.7332, 669.75433, 787.30096, 741.74207, 658.6912]
2025-09-16 18:11:00,607 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [129.0, 92.0, 148.0, 130.0, 133.0, 132.0, 128.0, 149.0, 139.0, 125.0]
2025-09-16 18:11:00,617 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 89/100 (estimated time remaining: 28 minutes, 18 seconds)
2025-09-16 18:13:18,058 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 18:13:20,310 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 623.18787 ± 237.084
2025-09-16 18:13:20,310 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [609.8038, 1163.2214, 836.63934, 498.75394, 589.39197, 529.6029, 585.44464, 627.0554, 613.51794, 178.44753]
2025-09-16 18:13:20,310 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [113.0, 220.0, 158.0, 90.0, 107.0, 97.0, 106.0, 112.0, 114.0, 34.0]
2025-09-16 18:13:20,322 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 90/100 (estimated time remaining: 25 minutes, 51 seconds)
2025-09-16 18:15:41,854 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 18:15:44,439 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 739.62164 ± 198.243
2025-09-16 18:15:44,439 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [794.46387, 1003.95294, 583.12317, 845.23193, 801.68677, 625.39404, 817.68146, 1023.85986, 532.29474, 368.52725]
2025-09-16 18:15:44,439 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [150.0, 192.0, 106.0, 167.0, 155.0, 115.0, 154.0, 198.0, 97.0, 72.0]
2025-09-16 18:15:44,439 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1226 [INFO]: New best (739.62) for latency 24
2025-09-16 18:15:44,451 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 91/100 (estimated time remaining: 23 minutes, 39 seconds)
2025-09-16 18:18:02,178 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 18:18:04,221 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 575.35571 ± 158.022
2025-09-16 18:18:04,221 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [631.64575, 638.131, 586.15497, 847.3508, 693.3173, 509.12985, 234.8289, 647.04913, 405.40375, 560.54553]
2025-09-16 18:18:04,221 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [129.0, 118.0, 108.0, 159.0, 126.0, 92.0, 44.0, 120.0, 76.0, 109.0]
2025-09-16 18:18:04,231 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 92/100 (estimated time remaining: 21 minutes, 12 seconds)
2025-09-16 18:20:24,180 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 18:20:26,387 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 649.06830 ± 181.029
2025-09-16 18:20:26,387 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [621.08594, 807.49677, 215.83723, 948.7012, 690.05566, 750.7377, 605.849, 684.82855, 567.5358, 598.55554]
2025-09-16 18:20:26,387 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [119.0, 153.0, 42.0, 180.0, 129.0, 136.0, 111.0, 131.0, 112.0, 111.0]
2025-09-16 18:20:26,405 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 93/100 (estimated time remaining: 18 minutes, 54 seconds)
2025-09-16 18:22:45,488 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 18:22:47,687 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 618.79462 ± 125.002
2025-09-16 18:22:47,687 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [756.09296, 454.371, 528.6082, 691.6946, 426.70078, 687.8201, 524.32684, 711.88336, 595.03625, 811.4124]
2025-09-16 18:22:47,687 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [139.0, 84.0, 98.0, 127.0, 82.0, 142.0, 98.0, 136.0, 108.0, 156.0]
2025-09-16 18:22:47,707 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 94/100 (estimated time remaining: 16 minutes, 29 seconds)
2025-09-16 18:25:09,525 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 18:25:11,751 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 635.46326 ± 110.193
2025-09-16 18:25:11,751 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [736.6305, 675.3174, 698.03, 574.8303, 664.6992, 758.2981, 775.44727, 525.0452, 444.89066, 501.44415]
2025-09-16 18:25:11,751 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [139.0, 129.0, 130.0, 111.0, 126.0, 157.0, 141.0, 102.0, 86.0, 98.0]
2025-09-16 18:25:11,761 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 95/100 (estimated time remaining: 14 minutes, 13 seconds)
2025-09-16 18:27:34,734 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 18:27:36,986 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 617.16284 ± 71.514
2025-09-16 18:27:36,987 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [518.83185, 721.5936, 520.47266, 716.7667, 577.2769, 649.80255, 623.7168, 538.9207, 648.09296, 656.1539]
2025-09-16 18:27:36,987 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [104.0, 132.0, 103.0, 145.0, 116.0, 118.0, 128.0, 103.0, 126.0, 131.0]
2025-09-16 18:27:37,007 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 96/100 (estimated time remaining: 11 minutes, 52 seconds)
2025-09-16 18:29:55,844 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 18:29:58,263 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 665.01086 ± 241.216
2025-09-16 18:29:58,263 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [573.3509, 625.15295, 728.0924, 201.52437, 584.7038, 778.918, 640.9966, 1222.368, 751.9032, 543.09845]
2025-09-16 18:29:58,263 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [104.0, 116.0, 139.0, 39.0, 109.0, 159.0, 127.0, 249.0, 141.0, 108.0]
2025-09-16 18:29:58,275 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 97/100 (estimated time remaining: 9 minutes, 31 seconds)
2025-09-16 18:32:21,099 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 18:32:23,167 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 541.90057 ± 236.807
2025-09-16 18:32:23,167 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [166.6805, 570.8528, 565.92163, 623.4514, 500.87396, 917.6897, 688.5802, 151.13402, 821.3006, 412.52118]
2025-09-16 18:32:23,167 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [32.0, 104.0, 106.0, 125.0, 97.0, 171.0, 126.0, 29.0, 165.0, 79.0]
2025-09-16 18:32:23,178 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 98/100 (estimated time remaining: 7 minutes, 10 seconds)
2025-09-16 18:34:42,939 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 18:34:45,332 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 654.25146 ± 105.731
2025-09-16 18:34:45,332 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [734.34625, 543.664, 753.7495, 710.54266, 689.45306, 556.2829, 680.3292, 416.0909, 710.91943, 747.13617]
2025-09-16 18:34:45,332 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [140.0, 100.0, 138.0, 135.0, 136.0, 112.0, 137.0, 83.0, 135.0, 137.0]
2025-09-16 18:34:45,372 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 99/100 (estimated time remaining: 4 minutes, 47 seconds)
2025-09-16 18:37:04,818 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 18:37:06,995 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 632.69592 ± 211.713
2025-09-16 18:37:06,995 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [619.2326, 614.1452, 1022.2994, 623.7153, 447.9218, 740.6517, 155.85614, 643.2419, 772.5366, 687.3591]
2025-09-16 18:37:06,995 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [116.0, 114.0, 196.0, 113.0, 88.0, 135.0, 30.0, 117.0, 145.0, 125.0]
2025-09-16 18:37:07,004 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1199 [INFO]: Iteration 100/100 (estimated time remaining: 2 minutes, 23 seconds)
2025-09-16 18:39:27,614 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1214 [DEBUG]: Evaluating for latency 24...
2025-09-16 18:39:29,993 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1221 [DEBUG]: Total Reward: 678.77576 ± 165.865
2025-09-16 18:39:29,994 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1222 [DEBUG]: All rewards: [473.77975, 1096.1351, 733.2643, 540.4211, 641.2432, 659.38336, 745.26056, 717.459, 508.3386, 672.4729]
2025-09-16 18:39:29,994 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1223 [DEBUG]: All trajectory lengths: [90.0, 217.0, 141.0, 98.0, 118.0, 123.0, 137.0, 131.0, 101.0, 123.0]
2025-09-16 18:39:30,003 latency_env.delayed_mdp:training_loop(baseline-bpql-noisepromille25-humanoid):1251 [DEBUG]: Training session finished
