2025-09-16 12:10:42,960 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1108 [DEBUG]: logdir: _logs/noise-eval-v2/humanoid/bpql-noise_0.000-delay_12
2025-09-16 12:10:42,961 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1109 [DEBUG]: trainer_prefix: noise-eval-v2/humanoid/bpql-noise_0.000-delay_12
2025-09-16 12:10:42,961 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1110 [DEBUG]: args.trainer_eval_latencies: {'12': <latency_env.delayed_mdp.ConstantDelay object at 0x147bc257c9d0>}
2025-09-16 12:10:42,961 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1111 [DEBUG]: using device: cuda
2025-09-16 12:10:42,965 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1133 [INFO]: Creating new trainer
2025-09-16 12:10:42,984 baseline-bpql-humanoid:113 [DEBUG]: pi network:
NNGaussianPolicy(
  (common_head): Sequential(
    (0): Flatten(start_dim=1, end_dim=-1)
    (1): Linear(in_features=580, out_features=256, bias=True)
    (2): ReLU()
    (3): Linear(in_features=256, out_features=256, bias=True)
    (4): ReLU()
  )
  (mu_head): Sequential(
    (0): Linear(in_features=256, out_features=17, bias=True)
    (1): Unflatten(dim=1, unflattened_size=(17,))
  )
  (log_std_head): Sequential(
    (0): Linear(in_features=256, out_features=17, bias=True)
    (1): Unflatten(dim=1, unflattened_size=(17,))
  )
  (tanh_refit): NNTanhRefit(
    scale: tensor([[0.8000, 0.8000, 0.8000, 0.8000, 0.8000, 0.8000, 0.8000, 0.8000, 0.8000,
             0.8000, 0.8000, 0.8000, 0.8000, 0.8000, 0.8000, 0.8000, 0.8000]]), shift: tensor([[-0.4000, -0.4000, -0.4000, -0.4000, -0.4000, -0.4000, -0.4000, -0.4000,
             -0.4000, -0.4000, -0.4000, -0.4000, -0.4000, -0.4000, -0.4000, -0.4000,
             -0.4000]])
  )
)
2025-09-16 12:10:42,985 baseline-bpql-humanoid:114 [DEBUG]: q network:
NNLayerConcat2(
  dim: -1
  (next): Sequential(
    (0): Linear(in_features=393, out_features=256, bias=True)
    (1): ReLU()
    (2): Linear(in_features=256, out_features=256, bias=True)
    (3): ReLU()
    (4): Linear(in_features=256, out_features=1, bias=True)
    (5): NNLayerSqueeze(dim: -1)
  )
  (init_left): Flatten(start_dim=1, end_dim=-1)
  (init_right): Flatten(start_dim=1, end_dim=-1)
)
2025-09-16 12:10:45,242 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1194 [DEBUG]: Starting training session...
2025-09-16 12:10:45,242 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 1/100
2025-09-16 12:12:35,482 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:12:36,301 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 302.54401 ± 53.571
2025-09-16 12:12:36,301 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [331.76935, 393.497, 242.88846, 236.18141, 276.70413, 264.1138, 387.5421, 329.55972, 263.82138, 299.3627]
2025-09-16 12:12:36,302 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [66.0, 76.0, 48.0, 47.0, 55.0, 53.0, 75.0, 64.0, 53.0, 59.0]
2025-09-16 12:12:36,302 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (302.54) for latency 12
2025-09-16 12:12:36,310 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 2/100 (estimated time remaining: 3 hours, 3 minutes, 15 seconds)
2025-09-16 12:14:35,151 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:14:36,378 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 457.45547 ± 62.933
2025-09-16 12:14:36,378 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [407.57394, 532.50305, 495.5196, 517.4115, 371.8603, 536.54297, 472.71686, 438.5493, 455.1663, 346.71103]
2025-09-16 12:14:36,378 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [85.0, 116.0, 102.0, 105.0, 80.0, 109.0, 93.0, 89.0, 90.0, 70.0]
2025-09-16 12:14:36,378 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (457.46) for latency 12
2025-09-16 12:14:36,381 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 3/100 (estimated time remaining: 3 hours, 8 minutes, 45 seconds)
2025-09-16 12:16:34,819 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:16:35,934 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 418.40308 ± 66.218
2025-09-16 12:16:35,934 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [446.1217, 384.9709, 587.22, 343.20233, 381.7696, 348.1281, 400.605, 411.34955, 450.31888, 430.34464]
2025-09-16 12:16:35,934 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [86.0, 78.0, 116.0, 70.0, 82.0, 76.0, 80.0, 87.0, 90.0, 90.0]
2025-09-16 12:16:35,943 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 4/100 (estimated time remaining: 3 hours, 8 minutes, 59 seconds)
2025-09-16 12:18:34,626 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:18:35,553 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 378.28333 ± 28.803
2025-09-16 12:18:35,553 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [376.8834, 375.82172, 355.93088, 372.41388, 346.47897, 398.08694, 446.21048, 396.39825, 341.0563, 373.55228]
2025-09-16 12:18:35,553 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [71.0, 72.0, 67.0, 71.0, 66.0, 75.0, 89.0, 76.0, 64.0, 71.0]
2025-09-16 12:18:35,560 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 5/100 (estimated time remaining: 3 hours, 8 minutes, 7 seconds)
2025-09-16 12:20:33,859 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:20:35,182 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 531.65759 ± 120.997
2025-09-16 12:20:35,183 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [500.5113, 379.4667, 815.7137, 582.0715, 580.34485, 538.0109, 385.26566, 472.90543, 454.5019, 607.7844]
2025-09-16 12:20:35,183 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [95.0, 72.0, 158.0, 113.0, 110.0, 101.0, 74.0, 89.0, 90.0, 115.0]
2025-09-16 12:20:35,183 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (531.66) for latency 12
2025-09-16 12:20:35,190 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 6/100 (estimated time remaining: 3 hours, 6 minutes, 49 seconds)
2025-09-16 12:22:34,420 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:22:35,711 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 471.12469 ± 83.210
2025-09-16 12:22:35,711 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [500.21924, 436.1695, 540.3254, 477.9458, 315.83182, 520.48206, 595.67645, 543.5897, 422.27866, 358.72827]
2025-09-16 12:22:35,711 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [109.0, 99.0, 116.0, 92.0, 69.0, 102.0, 115.0, 119.0, 80.0, 70.0]
2025-09-16 12:22:35,714 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 7/100 (estimated time remaining: 3 hours, 7 minutes, 48 seconds)
2025-09-16 12:24:36,186 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:24:37,233 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 416.74057 ± 73.954
2025-09-16 12:24:37,233 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [512.9905, 366.7446, 370.67523, 349.74677, 321.76044, 532.2771, 363.9365, 518.3552, 435.8386, 395.08087]
2025-09-16 12:24:37,233 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [102.0, 72.0, 71.0, 68.0, 63.0, 99.0, 68.0, 100.0, 84.0, 78.0]
2025-09-16 12:24:37,237 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 8/100 (estimated time remaining: 3 hours, 6 minutes, 15 seconds)
2025-09-16 12:26:36,453 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:26:37,782 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 512.96289 ± 65.172
2025-09-16 12:26:37,782 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [557.7296, 502.49686, 422.14856, 426.61343, 481.622, 505.85492, 572.1686, 653.5308, 494.0024, 513.46204]
2025-09-16 12:26:37,782 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [113.0, 103.0, 89.0, 87.0, 107.0, 91.0, 103.0, 128.0, 91.0, 104.0]
2025-09-16 12:26:37,787 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 9/100 (estimated time remaining: 3 hours, 4 minutes, 33 seconds)
2025-09-16 12:28:37,648 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:28:39,165 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 560.37305 ± 129.152
2025-09-16 12:28:39,165 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [463.85355, 522.34845, 550.73846, 414.1808, 581.6189, 859.75665, 717.8781, 519.1675, 547.2945, 426.8933]
2025-09-16 12:28:39,165 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [99.0, 107.0, 103.0, 87.0, 119.0, 166.0, 146.0, 110.0, 103.0, 91.0]
2025-09-16 12:28:39,165 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (560.37) for latency 12
2025-09-16 12:28:39,174 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 10/100 (estimated time remaining: 3 hours, 3 minutes, 5 seconds)
2025-09-16 12:30:38,670 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:30:40,305 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 624.26453 ± 124.267
2025-09-16 12:30:40,305 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [456.26526, 502.597, 774.44324, 620.57135, 641.69995, 485.14838, 512.3344, 671.11255, 792.11597, 786.3575]
2025-09-16 12:30:40,305 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [85.0, 108.0, 155.0, 131.0, 122.0, 91.0, 95.0, 127.0, 162.0, 153.0]
2025-09-16 12:30:40,305 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (624.26) for latency 12
2025-09-16 12:30:40,308 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 11/100 (estimated time remaining: 3 hours, 1 minute, 32 seconds)
2025-09-16 12:32:39,632 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:32:40,963 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 520.41876 ± 114.568
2025-09-16 12:32:40,963 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [468.04385, 507.9733, 440.2679, 482.01086, 497.73886, 768.86926, 608.2326, 401.79892, 379.7766, 649.47534]
2025-09-16 12:32:40,963 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [92.0, 94.0, 82.0, 95.0, 104.0, 148.0, 120.0, 85.0, 75.0, 125.0]
2025-09-16 12:32:40,968 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 12/100 (estimated time remaining: 2 hours, 59 minutes, 33 seconds)
2025-09-16 12:34:40,421 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:34:41,821 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 499.55316 ± 83.741
2025-09-16 12:34:41,821 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [441.0596, 574.7059, 580.0139, 432.2581, 419.95135, 509.97748, 516.4156, 671.76215, 389.6219, 459.7655]
2025-09-16 12:34:41,821 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [98.0, 114.0, 126.0, 93.0, 89.0, 109.0, 110.0, 128.0, 83.0, 100.0]
2025-09-16 12:34:41,826 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 13/100 (estimated time remaining: 2 hours, 57 minutes, 20 seconds)
2025-09-16 12:36:42,611 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:36:44,409 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 653.34448 ± 99.779
2025-09-16 12:36:44,409 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [546.56915, 600.08984, 635.80164, 571.8174, 736.6328, 560.9589, 588.29236, 858.6766, 652.80505, 781.8008]
2025-09-16 12:36:44,409 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [106.0, 116.0, 122.0, 111.0, 155.0, 111.0, 121.0, 171.0, 134.0, 152.0]
2025-09-16 12:36:44,409 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (653.34) for latency 12
2025-09-16 12:36:44,416 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 14/100 (estimated time remaining: 2 hours, 55 minutes, 55 seconds)
2025-09-16 12:38:45,703 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:38:47,493 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 665.52362 ± 168.060
2025-09-16 12:38:47,493 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [653.03735, 445.69073, 589.54193, 596.94336, 574.6812, 890.33203, 1042.8499, 520.0785, 694.50165, 647.5799]
2025-09-16 12:38:47,493 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [135.0, 97.0, 109.0, 128.0, 112.0, 178.0, 205.0, 103.0, 132.0, 132.0]
2025-09-16 12:38:47,493 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (665.52) for latency 12
2025-09-16 12:38:47,497 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 15/100 (estimated time remaining: 2 hours, 54 minutes, 23 seconds)
2025-09-16 12:40:47,849 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:40:49,650 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 651.30121 ± 106.394
2025-09-16 12:40:49,650 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [587.28485, 470.4739, 589.14246, 743.6005, 737.9868, 789.13574, 797.2087, 535.8211, 663.3485, 599.00946]
2025-09-16 12:40:49,650 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [120.0, 108.0, 129.0, 159.0, 152.0, 154.0, 166.0, 109.0, 128.0, 131.0]
2025-09-16 12:40:49,656 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 16/100 (estimated time remaining: 2 hours, 52 minutes, 38 seconds)
2025-09-16 12:42:49,549 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:42:51,214 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 625.81757 ± 124.996
2025-09-16 12:42:51,214 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [609.01373, 777.05554, 393.21356, 600.7468, 597.1676, 634.45276, 571.5225, 509.17694, 858.8932, 706.93304]
2025-09-16 12:42:51,214 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [116.0, 152.0, 87.0, 113.0, 128.0, 128.0, 107.0, 93.0, 170.0, 140.0]
2025-09-16 12:42:51,221 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 17/100 (estimated time remaining: 2 hours, 50 minutes, 52 seconds)
2025-09-16 12:44:52,238 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:44:53,781 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 618.39050 ± 140.885
2025-09-16 12:44:53,782 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [591.86005, 577.70276, 595.0963, 600.01587, 490.28455, 531.48413, 673.7123, 482.8651, 1005.11127, 635.77295]
2025-09-16 12:44:53,782 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [111.0, 107.0, 112.0, 112.0, 94.0, 98.0, 126.0, 90.0, 194.0, 120.0]
2025-09-16 12:44:53,787 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 18/100 (estimated time remaining: 2 hours, 49 minutes, 18 seconds)
2025-09-16 12:46:54,327 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:46:55,999 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 665.17310 ± 105.107
2025-09-16 12:46:55,999 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [589.93384, 670.30396, 635.56433, 505.4099, 554.4237, 595.523, 740.558, 785.0089, 712.34314, 862.6623]
2025-09-16 12:46:55,999 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [118.0, 125.0, 117.0, 94.0, 101.0, 111.0, 139.0, 149.0, 134.0, 166.0]
2025-09-16 12:46:56,002 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 19/100 (estimated time remaining: 2 hours, 47 minutes, 10 seconds)
2025-09-16 12:48:55,846 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:48:57,661 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 652.41760 ± 125.651
2025-09-16 12:48:57,661 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [558.0227, 947.68195, 483.3907, 585.61896, 662.7831, 668.8308, 515.4776, 661.3288, 732.20306, 708.8382]
2025-09-16 12:48:57,661 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [104.0, 202.0, 97.0, 126.0, 138.0, 128.0, 106.0, 126.0, 158.0, 148.0]
2025-09-16 12:48:57,693 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 20/100 (estimated time remaining: 2 hours, 44 minutes, 45 seconds)
2025-09-16 12:50:58,316 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:50:59,796 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 593.07709 ± 156.760
2025-09-16 12:50:59,796 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [524.0132, 528.2149, 564.0625, 610.8242, 491.70825, 539.5855, 509.7623, 462.88705, 667.23157, 1032.4818]
2025-09-16 12:50:59,796 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [96.0, 100.0, 104.0, 113.0, 92.0, 100.0, 95.0, 85.0, 125.0, 209.0]
2025-09-16 12:50:59,799 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 21/100 (estimated time remaining: 2 hours, 42 minutes, 42 seconds)
2025-09-16 12:53:00,033 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:53:01,889 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 712.35254 ± 129.209
2025-09-16 12:53:01,889 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [478.20917, 696.42175, 730.8549, 708.4813, 846.4094, 599.4288, 982.79205, 712.1379, 629.20856, 739.5817]
2025-09-16 12:53:01,889 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [90.0, 131.0, 145.0, 145.0, 166.0, 111.0, 193.0, 132.0, 124.0, 138.0]
2025-09-16 12:53:01,889 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (712.35) for latency 12
2025-09-16 12:53:01,896 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 22/100 (estimated time remaining: 2 hours, 40 minutes, 48 seconds)
2025-09-16 12:55:03,068 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:55:05,023 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 732.96832 ± 126.460
2025-09-16 12:55:05,023 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [683.5632, 642.72906, 606.67914, 720.6773, 583.882, 753.58264, 982.3237, 640.61896, 923.78796, 791.83954]
2025-09-16 12:55:05,024 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [129.0, 118.0, 122.0, 154.0, 109.0, 141.0, 185.0, 139.0, 186.0, 156.0]
2025-09-16 12:55:05,024 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (732.97) for latency 12
2025-09-16 12:55:05,040 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 23/100 (estimated time remaining: 2 hours, 38 minutes, 55 seconds)
2025-09-16 12:57:05,291 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:57:07,355 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 781.75757 ± 208.066
2025-09-16 12:57:07,356 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [753.67596, 892.50214, 957.1982, 551.51874, 712.1159, 665.8594, 1297.1786, 727.31555, 669.9232, 590.2881]
2025-09-16 12:57:07,356 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [144.0, 178.0, 184.0, 103.0, 146.0, 126.0, 246.0, 136.0, 128.0, 112.0]
2025-09-16 12:57:07,356 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (781.76) for latency 12
2025-09-16 12:57:07,388 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 24/100 (estimated time remaining: 2 hours, 36 minutes, 55 seconds)
2025-09-16 12:59:07,606 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 12:59:09,024 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 567.68506 ± 70.513
2025-09-16 12:59:09,025 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [506.5055, 594.53186, 589.6734, 554.30176, 470.2217, 653.37634, 668.4805, 650.6581, 496.94525, 492.1565]
2025-09-16 12:59:09,025 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [95.0, 110.0, 107.0, 102.0, 89.0, 134.0, 124.0, 121.0, 93.0, 92.0]
2025-09-16 12:59:09,031 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 25/100 (estimated time remaining: 2 hours, 34 minutes, 52 seconds)
2025-09-16 13:01:10,486 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:01:12,157 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 641.63983 ± 111.380
2025-09-16 13:01:12,157 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [644.1454, 631.4182, 469.6945, 748.3541, 529.4007, 592.7846, 594.7745, 610.3719, 887.4664, 707.9881]
2025-09-16 13:01:12,157 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [121.0, 117.0, 96.0, 144.0, 101.0, 114.0, 114.0, 140.0, 177.0, 131.0]
2025-09-16 13:01:12,161 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 26/100 (estimated time remaining: 2 hours, 33 minutes, 5 seconds)
2025-09-16 13:03:12,898 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:03:14,804 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 688.62073 ± 90.453
2025-09-16 13:03:14,804 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [605.4944, 850.9013, 648.3832, 664.37915, 628.7769, 713.44226, 785.626, 787.804, 661.7761, 539.6232]
2025-09-16 13:03:14,804 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [129.0, 180.0, 136.0, 131.0, 117.0, 149.0, 171.0, 160.0, 127.0, 121.0]
2025-09-16 13:03:14,807 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 27/100 (estimated time remaining: 2 hours, 31 minutes, 11 seconds)
2025-09-16 13:05:15,555 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:05:17,789 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 802.67480 ± 185.026
2025-09-16 13:05:17,790 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [827.67944, 1285.4067, 903.70514, 761.4039, 799.7443, 660.1854, 587.8157, 779.2142, 791.0165, 630.57654]
2025-09-16 13:05:17,790 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [167.0, 254.0, 193.0, 168.0, 172.0, 124.0, 116.0, 148.0, 155.0, 139.0]
2025-09-16 13:05:17,790 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (802.67) for latency 12
2025-09-16 13:05:17,794 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 28/100 (estimated time remaining: 2 hours, 29 minutes, 6 seconds)
2025-09-16 13:07:18,499 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:07:20,689 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 798.98285 ± 210.092
2025-09-16 13:07:20,689 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [800.8677, 616.7098, 692.364, 845.4493, 723.7445, 1361.3186, 546.24207, 729.9078, 811.429, 861.7961]
2025-09-16 13:07:20,689 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [168.0, 135.0, 131.0, 175.0, 150.0, 282.0, 117.0, 139.0, 154.0, 164.0]
2025-09-16 13:07:20,696 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 29/100 (estimated time remaining: 2 hours, 27 minutes, 11 seconds)
2025-09-16 13:09:21,762 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:09:24,005 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 818.77930 ± 162.109
2025-09-16 13:09:24,005 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [637.3852, 720.2403, 1002.5887, 742.7082, 945.9215, 937.7241, 791.56256, 1118.0258, 636.53815, 655.09845]
2025-09-16 13:09:24,005 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [130.0, 147.0, 197.0, 153.0, 202.0, 178.0, 152.0, 217.0, 136.0, 139.0]
2025-09-16 13:09:24,005 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (818.78) for latency 12
2025-09-16 13:09:24,011 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 30/100 (estimated time remaining: 2 hours, 25 minutes, 32 seconds)
2025-09-16 13:11:23,703 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:11:25,368 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 636.63416 ± 105.193
2025-09-16 13:11:25,368 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [521.4202, 608.19556, 660.3542, 906.6788, 706.90784, 577.73126, 526.2138, 651.0433, 595.6997, 612.09686]
2025-09-16 13:11:25,368 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [98.0, 116.0, 126.0, 186.0, 138.0, 111.0, 106.0, 125.0, 112.0, 114.0]
2025-09-16 13:11:25,381 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 31/100 (estimated time remaining: 2 hours, 23 minutes, 5 seconds)
2025-09-16 13:13:26,834 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:13:28,851 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 733.75714 ± 116.788
2025-09-16 13:13:28,851 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [805.5179, 642.4608, 646.2886, 924.66, 733.573, 783.04865, 654.88226, 929.68744, 592.7404, 624.7123]
2025-09-16 13:13:28,851 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [152.0, 123.0, 146.0, 181.0, 139.0, 149.0, 155.0, 196.0, 128.0, 138.0]
2025-09-16 13:13:28,865 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 32/100 (estimated time remaining: 2 hours, 21 minutes, 13 seconds)
2025-09-16 13:15:29,729 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:15:31,797 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 792.03015 ± 200.125
2025-09-16 13:15:31,797 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1032.5397, 541.53186, 662.3432, 891.76086, 893.89984, 581.5609, 1158.2461, 888.9662, 582.4525, 687.00006]
2025-09-16 13:15:31,797 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [205.0, 100.0, 120.0, 180.0, 171.0, 107.0, 224.0, 174.0, 105.0, 146.0]
2025-09-16 13:15:31,811 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 33/100 (estimated time remaining: 2 hours, 19 minutes, 10 seconds)
2025-09-16 13:17:32,504 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:17:35,447 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1056.34570 ± 248.687
2025-09-16 13:17:35,447 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [740.06433, 908.9152, 1381.2174, 1055.9684, 1508.3619, 628.6428, 1098.0366, 1075.6946, 1070.4974, 1096.0591]
2025-09-16 13:17:35,447 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [158.0, 186.0, 279.0, 225.0, 314.0, 135.0, 226.0, 211.0, 212.0, 222.0]
2025-09-16 13:17:35,447 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (1056.35) for latency 12
2025-09-16 13:17:35,454 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 34/100 (estimated time remaining: 2 hours, 17 minutes, 17 seconds)
2025-09-16 13:19:36,135 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:19:38,379 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 848.76172 ± 186.000
2025-09-16 13:19:38,379 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [636.0133, 898.22687, 727.3773, 948.55505, 1327.4827, 703.3757, 802.7063, 922.0253, 748.0943, 773.75995]
2025-09-16 13:19:38,379 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [118.0, 182.0, 140.0, 183.0, 264.0, 132.0, 152.0, 177.0, 146.0, 147.0]
2025-09-16 13:19:38,385 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 35/100 (estimated time remaining: 2 hours, 15 minutes, 9 seconds)
2025-09-16 13:21:40,421 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:21:42,765 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 876.00867 ± 225.021
2025-09-16 13:21:42,765 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [946.9264, 722.3859, 790.8854, 1282.891, 843.2179, 1041.0598, 571.93823, 671.248, 687.1278, 1202.4065]
2025-09-16 13:21:42,765 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [185.0, 142.0, 153.0, 265.0, 163.0, 218.0, 109.0, 128.0, 145.0, 239.0]
2025-09-16 13:21:42,772 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 36/100 (estimated time remaining: 2 hours, 13 minutes, 46 seconds)
2025-09-16 13:23:42,518 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:23:44,580 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 756.47076 ± 160.551
2025-09-16 13:23:44,580 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [749.07855, 667.6524, 675.728, 991.2364, 621.4842, 593.32263, 653.3013, 646.1303, 1077.0581, 889.716]
2025-09-16 13:23:44,580 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [148.0, 141.0, 149.0, 218.0, 120.0, 129.0, 127.0, 127.0, 218.0, 179.0]
2025-09-16 13:23:44,598 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 37/100 (estimated time remaining: 2 hours, 11 minutes, 21 seconds)
2025-09-16 13:25:45,898 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:25:47,859 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 745.67773 ± 181.832
2025-09-16 13:25:47,859 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [931.8514, 695.8822, 660.22986, 594.0723, 807.878, 593.8463, 662.1715, 699.60364, 608.95496, 1202.287]
2025-09-16 13:25:47,859 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [196.0, 132.0, 128.0, 127.0, 152.0, 117.0, 126.0, 134.0, 116.0, 234.0]
2025-09-16 13:25:47,865 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 38/100 (estimated time remaining: 2 hours, 9 minutes, 22 seconds)
2025-09-16 13:27:48,989 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:27:51,350 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 897.04944 ± 173.916
2025-09-16 13:27:51,351 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [911.97406, 907.7966, 1208.0751, 1125.3535, 815.853, 694.37195, 969.0594, 779.90875, 950.57886, 607.5222]
2025-09-16 13:27:51,351 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [175.0, 181.0, 238.0, 226.0, 154.0, 132.0, 186.0, 148.0, 194.0, 118.0]
2025-09-16 13:27:51,356 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 39/100 (estimated time remaining: 2 hours, 7 minutes, 17 seconds)
2025-09-16 13:29:52,234 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:29:54,558 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 842.49036 ± 233.013
2025-09-16 13:29:54,558 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [775.77716, 965.97473, 698.978, 730.34467, 973.05695, 833.1444, 735.1735, 713.1003, 1444.2393, 555.114]
2025-09-16 13:29:54,558 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [151.0, 186.0, 132.0, 146.0, 209.0, 182.0, 140.0, 138.0, 322.0, 126.0]
2025-09-16 13:29:54,565 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 40/100 (estimated time remaining: 2 hours, 5 minutes, 17 seconds)
2025-09-16 13:31:56,010 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:31:58,336 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 862.92395 ± 146.791
2025-09-16 13:31:58,337 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [747.0332, 1085.7572, 842.7533, 939.9812, 792.8387, 635.6007, 857.99274, 1113.6377, 706.1185, 907.52606]
2025-09-16 13:31:58,337 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [154.0, 211.0, 183.0, 191.0, 156.0, 129.0, 169.0, 214.0, 134.0, 173.0]
2025-09-16 13:31:58,344 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 41/100 (estimated time remaining: 2 hours, 3 minutes, 6 seconds)
2025-09-16 13:34:00,614 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:34:02,987 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 887.34473 ± 278.485
2025-09-16 13:34:02,987 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [575.04724, 661.6979, 1428.9387, 642.53406, 1066.6282, 1262.8071, 662.1305, 713.1593, 1019.6339, 840.8708]
2025-09-16 13:34:02,987 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [106.0, 123.0, 280.0, 127.0, 217.0, 264.0, 125.0, 145.0, 194.0, 157.0]
2025-09-16 13:34:02,996 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 42/100 (estimated time remaining: 2 hours, 1 minute, 37 seconds)
2025-09-16 13:36:03,310 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:36:06,464 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1118.74597 ± 443.802
2025-09-16 13:36:06,464 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1014.6157, 1261.9934, 1054.9696, 1744.0878, 609.0277, 815.52795, 817.426, 797.34265, 2105.744, 966.726]
2025-09-16 13:36:06,464 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [197.0, 253.0, 217.0, 350.0, 117.0, 158.0, 171.0, 168.0, 428.0, 193.0]
2025-09-16 13:36:06,464 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (1118.75) for latency 12
2025-09-16 13:36:06,504 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 43/100 (estimated time remaining: 1 hour, 59 minutes, 36 seconds)
2025-09-16 13:38:07,531 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:38:09,660 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 791.55237 ± 256.117
2025-09-16 13:38:09,661 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1175.6992, 775.7429, 853.62854, 635.7264, 1168.651, 369.77783, 592.8085, 1036.5131, 759.0357, 547.9398]
2025-09-16 13:38:09,661 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [233.0, 149.0, 180.0, 121.0, 229.0, 73.0, 113.0, 198.0, 145.0, 106.0]
2025-09-16 13:38:09,667 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 44/100 (estimated time remaining: 1 hour, 57 minutes, 28 seconds)
2025-09-16 13:40:09,628 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:40:12,075 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 888.52313 ± 205.006
2025-09-16 13:40:12,075 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [884.98975, 1386.3262, 776.5993, 706.96106, 847.7944, 764.1626, 927.1989, 826.9494, 1110.6726, 653.5768]
2025-09-16 13:40:12,075 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [188.0, 312.0, 150.0, 144.0, 166.0, 143.0, 174.0, 175.0, 223.0, 128.0]
2025-09-16 13:40:12,099 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 45/100 (estimated time remaining: 1 hour, 55 minutes, 16 seconds)
2025-09-16 13:42:12,317 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:42:15,117 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1048.64966 ± 362.366
2025-09-16 13:42:15,117 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [764.612, 582.20123, 1329.6426, 1911.7057, 776.3739, 811.72565, 1140.9257, 894.4908, 1217.1456, 1057.6732]
2025-09-16 13:42:15,117 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [167.0, 114.0, 266.0, 377.0, 146.0, 151.0, 231.0, 178.0, 239.0, 219.0]
2025-09-16 13:42:15,125 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 46/100 (estimated time remaining: 1 hour, 53 minutes, 4 seconds)
2025-09-16 13:44:17,462 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:44:20,033 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 947.15381 ± 303.988
2025-09-16 13:44:20,033 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [825.81415, 1475.5632, 1471.7634, 747.05853, 895.4092, 787.962, 875.73413, 984.5904, 988.3854, 419.25766]
2025-09-16 13:44:20,033 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [153.0, 288.0, 301.0, 163.0, 174.0, 150.0, 187.0, 203.0, 203.0, 83.0]
2025-09-16 13:44:20,040 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 47/100 (estimated time remaining: 1 hour, 51 minutes, 4 seconds)
2025-09-16 13:46:20,781 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:46:23,806 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1085.70215 ± 406.359
2025-09-16 13:46:23,806 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1282.1599, 871.4921, 813.02014, 635.37384, 958.0057, 794.80505, 1324.9138, 2116.0674, 852.02905, 1209.1539]
2025-09-16 13:46:23,806 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [273.0, 176.0, 167.0, 140.0, 208.0, 158.0, 261.0, 424.0, 170.0, 247.0]
2025-09-16 13:46:23,816 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 48/100 (estimated time remaining: 1 hour, 49 minutes, 3 seconds)
2025-09-16 13:48:25,628 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:48:28,406 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1018.90118 ± 463.320
2025-09-16 13:48:28,406 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [651.3055, 889.7965, 938.67664, 827.6102, 576.0466, 1449.7737, 803.8637, 821.2818, 993.5101, 2237.1467]
2025-09-16 13:48:28,406 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [119.0, 179.0, 195.0, 157.0, 111.0, 289.0, 147.0, 153.0, 208.0, 486.0]
2025-09-16 13:48:28,415 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 49/100 (estimated time remaining: 1 hour, 47 minutes, 14 seconds)
2025-09-16 13:50:28,321 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:50:31,351 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1058.69397 ± 237.106
2025-09-16 13:50:31,351 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1159.7236, 964.7957, 816.69904, 1574.3704, 1167.5049, 1128.9504, 1125.0938, 860.77905, 666.01843, 1123.0035]
2025-09-16 13:50:31,351 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [252.0, 207.0, 172.0, 325.0, 237.0, 224.0, 217.0, 194.0, 144.0, 230.0]
2025-09-16 13:50:31,357 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 50/100 (estimated time remaining: 1 hour, 45 minutes, 16 seconds)
2025-09-16 13:52:32,348 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:52:35,760 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1254.35852 ± 444.695
2025-09-16 13:52:35,760 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1204.1279, 701.8889, 619.2779, 1341.2521, 1534.6075, 1128.8202, 1407.8972, 2311.6882, 1142.0503, 1151.9739]
2025-09-16 13:52:35,760 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [240.0, 153.0, 132.0, 265.0, 305.0, 232.0, 271.0, 462.0, 251.0, 223.0]
2025-09-16 13:52:35,760 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (1254.36) for latency 12
2025-09-16 13:52:35,769 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 51/100 (estimated time remaining: 1 hour, 43 minutes, 26 seconds)
2025-09-16 13:54:39,221 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:54:42,253 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1127.86255 ± 278.856
2025-09-16 13:54:42,253 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [882.0317, 902.469, 596.04517, 1430.8198, 1144.3136, 1480.7195, 1161.6516, 1335.8707, 928.8211, 1415.883]
2025-09-16 13:54:42,253 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [171.0, 195.0, 120.0, 281.0, 218.0, 294.0, 226.0, 260.0, 187.0, 274.0]
2025-09-16 13:54:42,261 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 52/100 (estimated time remaining: 1 hour, 41 minutes, 37 seconds)
2025-09-16 13:56:41,295 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:56:44,293 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1117.14563 ± 362.321
2025-09-16 13:56:44,293 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [930.51355, 679.14685, 1198.1847, 1719.4858, 798.38165, 1288.6515, 743.9024, 1233.94, 1721.6193, 857.6303]
2025-09-16 13:56:44,293 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [180.0, 139.0, 243.0, 332.0, 168.0, 249.0, 147.0, 251.0, 342.0, 165.0]
2025-09-16 13:56:44,301 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 53/100 (estimated time remaining: 1 hour, 39 minutes, 16 seconds)
2025-09-16 13:58:46,103 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 13:58:50,465 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1514.88452 ± 490.782
2025-09-16 13:58:50,465 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1083.9563, 980.03613, 1559.6786, 1309.0593, 2038.1644, 1328.7412, 1987.3378, 2319.9307, 726.1022, 1815.8376]
2025-09-16 13:58:50,465 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [221.0, 199.0, 310.0, 278.0, 425.0, 260.0, 419.0, 466.0, 162.0, 373.0]
2025-09-16 13:58:50,465 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (1514.88) for latency 12
2025-09-16 13:58:50,498 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 54/100 (estimated time remaining: 1 hour, 37 minutes, 27 seconds)
2025-09-16 14:00:52,606 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:00:55,779 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1179.78052 ± 255.266
2025-09-16 14:00:55,779 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1078.518, 769.5716, 1123.2415, 1648.6401, 1225.2163, 1041.921, 1489.5587, 1358.6781, 1199.8773, 862.5831]
2025-09-16 14:00:55,779 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [208.0, 150.0, 214.0, 315.0, 249.0, 211.0, 299.0, 263.0, 229.0, 189.0]
2025-09-16 14:00:55,788 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 55/100 (estimated time remaining: 1 hour, 35 minutes, 44 seconds)
2025-09-16 14:02:59,206 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:03:01,968 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1056.76953 ± 280.251
2025-09-16 14:03:01,968 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1695.9271, 1090.0853, 824.60913, 808.5758, 732.91675, 990.84015, 1203.0437, 1065.0798, 824.6827, 1331.9344]
2025-09-16 14:03:01,968 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [325.0, 217.0, 157.0, 150.0, 135.0, 185.0, 231.0, 208.0, 156.0, 284.0]
2025-09-16 14:03:01,999 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 56/100 (estimated time remaining: 1 hour, 33 minutes, 56 seconds)
2025-09-16 14:05:03,594 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:05:06,583 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1169.09143 ± 332.523
2025-09-16 14:05:06,583 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [934.8626, 781.5462, 1067.8971, 1344.9764, 776.66486, 801.8927, 1300.798, 1735.6844, 1319.6752, 1626.9174]
2025-09-16 14:05:06,583 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [178.0, 146.0, 198.0, 254.0, 147.0, 153.0, 245.0, 327.0, 247.0, 313.0]
2025-09-16 14:05:06,591 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 57/100 (estimated time remaining: 1 hour, 31 minutes, 34 seconds)
2025-09-16 14:07:06,187 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:07:09,184 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1113.27588 ± 275.667
2025-09-16 14:07:09,184 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [734.79767, 856.5605, 1232.7711, 1570.9996, 1007.90173, 721.4478, 1337.1327, 1131.9534, 1092.0857, 1447.108]
2025-09-16 14:07:09,184 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [154.0, 162.0, 260.0, 306.0, 193.0, 135.0, 253.0, 217.0, 208.0, 288.0]
2025-09-16 14:07:09,200 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 58/100 (estimated time remaining: 1 hour, 29 minutes, 34 seconds)
2025-09-16 14:09:09,168 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:09:12,292 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1129.32642 ± 255.621
2025-09-16 14:09:12,292 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1022.34595, 868.99713, 1070.1002, 807.101, 1048.156, 1293.18, 1271.7773, 1526.2952, 840.85095, 1544.4604]
2025-09-16 14:09:12,292 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [194.0, 167.0, 203.0, 153.0, 206.0, 255.0, 274.0, 310.0, 158.0, 320.0]
2025-09-16 14:09:12,329 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 59/100 (estimated time remaining: 1 hour, 27 minutes, 3 seconds)
2025-09-16 14:11:15,938 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:11:18,525 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 923.56378 ± 255.655
2025-09-16 14:11:18,525 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [804.1906, 1070.6907, 761.42645, 1140.8457, 699.6697, 765.8962, 900.2097, 752.23254, 771.7296, 1568.7458]
2025-09-16 14:11:18,525 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [155.0, 221.0, 165.0, 228.0, 155.0, 154.0, 197.0, 160.0, 171.0, 303.0]
2025-09-16 14:11:18,535 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 60/100 (estimated time remaining: 1 hour, 25 minutes, 6 seconds)
2025-09-16 14:13:18,883 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:13:22,726 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1396.06079 ± 418.659
2025-09-16 14:13:22,726 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1690.9645, 1845.3572, 776.3235, 1215.9401, 2254.628, 984.0301, 1465.8759, 1049.9742, 1270.6461, 1406.8685]
2025-09-16 14:13:22,726 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [328.0, 365.0, 164.0, 242.0, 450.0, 189.0, 285.0, 217.0, 250.0, 281.0]
2025-09-16 14:13:22,733 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 61/100 (estimated time remaining: 1 hour, 22 minutes, 45 seconds)
2025-09-16 14:15:24,659 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:15:28,662 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1416.00195 ± 364.173
2025-09-16 14:15:28,662 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1823.7932, 1578.9623, 1451.7809, 970.647, 988.9983, 1193.0367, 1975.0364, 1864.3389, 992.8233, 1320.6027]
2025-09-16 14:15:28,662 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [385.0, 313.0, 286.0, 204.0, 189.0, 225.0, 426.0, 385.0, 189.0, 263.0]
2025-09-16 14:15:28,671 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 62/100 (estimated time remaining: 1 hour, 20 minutes, 52 seconds)
2025-09-16 14:17:31,841 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:17:35,781 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1402.83765 ± 743.276
2025-09-16 14:17:35,781 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [941.8837, 3207.5444, 862.3595, 1617.9221, 646.96326, 1186.633, 1940.8718, 823.25903, 1886.925, 914.0147]
2025-09-16 14:17:35,781 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [180.0, 657.0, 169.0, 329.0, 125.0, 241.0, 392.0, 156.0, 373.0, 196.0]
2025-09-16 14:17:35,791 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 63/100 (estimated time remaining: 1 hour, 19 minutes, 22 seconds)
2025-09-16 14:19:36,230 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:19:40,438 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1553.56250 ± 418.933
2025-09-16 14:19:40,438 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1148.3566, 1251.9955, 1808.8839, 1812.1278, 2258.1423, 946.7319, 1483.4248, 1150.4417, 2132.9165, 1542.6038]
2025-09-16 14:19:40,438 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [222.0, 242.0, 356.0, 382.0, 460.0, 184.0, 279.0, 238.0, 409.0, 297.0]
2025-09-16 14:19:40,438 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (1553.56) for latency 12
2025-09-16 14:19:40,453 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 64/100 (estimated time remaining: 1 hour, 17 minutes, 28 seconds)
2025-09-16 14:21:40,372 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:21:43,787 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1241.32288 ± 300.736
2025-09-16 14:21:43,787 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1400.2249, 897.5941, 1764.5889, 888.4541, 1002.44305, 1147.3304, 1309.3002, 1608.2302, 920.2903, 1474.7723]
2025-09-16 14:21:43,787 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [270.0, 170.0, 338.0, 172.0, 188.0, 240.0, 253.0, 360.0, 176.0, 280.0]
2025-09-16 14:21:43,794 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 65/100 (estimated time remaining: 1 hour, 15 minutes, 1 second)
2025-09-16 14:23:51,755 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:23:56,301 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1666.98657 ± 871.850
2025-09-16 14:23:56,302 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1569.2952, 1461.1504, 1130.2545, 598.2648, 2578.063, 1419.2023, 2202.529, 996.4529, 1027.278, 3687.3745]
2025-09-16 14:23:56,302 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [296.0, 277.0, 226.0, 127.0, 528.0, 281.0, 429.0, 192.0, 198.0, 724.0]
2025-09-16 14:23:56,302 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (1666.99) for latency 12
2025-09-16 14:23:56,316 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 66/100 (estimated time remaining: 1 hour, 13 minutes, 55 seconds)
2025-09-16 14:25:52,976 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:25:56,046 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1127.41382 ± 227.640
2025-09-16 14:25:56,046 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1472.1261, 1361.0815, 826.7941, 1096.258, 1407.0505, 1222.8998, 1048.5007, 837.9518, 852.3998, 1149.077]
2025-09-16 14:25:56,046 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [286.0, 264.0, 159.0, 214.0, 285.0, 239.0, 202.0, 172.0, 189.0, 239.0]
2025-09-16 14:25:56,071 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 67/100 (estimated time remaining: 1 hour, 11 minutes, 6 seconds)
2025-09-16 14:27:58,060 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:28:02,884 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1786.86743 ± 875.478
2025-09-16 14:28:02,884 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [3867.6013, 1600.039, 1020.7826, 1270.6132, 2019.3414, 1624.1902, 2253.2593, 1074.293, 689.9696, 2448.5845]
2025-09-16 14:28:02,884 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [757.0, 299.0, 197.0, 243.0, 421.0, 311.0, 453.0, 213.0, 133.0, 508.0]
2025-09-16 14:28:02,884 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (1786.87) for latency 12
2025-09-16 14:28:02,893 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 68/100 (estimated time remaining: 1 hour, 8 minutes, 58 seconds)
2025-09-16 14:30:06,625 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:30:11,716 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1878.83789 ± 598.301
2025-09-16 14:30:11,716 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [966.9573, 3003.016, 1765.3596, 2610.067, 1258.1849, 2257.6914, 1581.367, 1912.959, 2080.799, 1351.9769]
2025-09-16 14:30:11,716 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [183.0, 618.0, 338.0, 506.0, 247.0, 446.0, 316.0, 364.0, 394.0, 256.0]
2025-09-16 14:30:11,716 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (1878.84) for latency 12
2025-09-16 14:30:11,725 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 69/100 (estimated time remaining: 1 hour, 7 minutes, 20 seconds)
2025-09-16 14:32:14,042 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:32:20,148 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 2231.96387 ± 1137.321
2025-09-16 14:32:20,149 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1242.1115, 4208.546, 2106.1777, 1336.026, 1513.7562, 4627.2524, 2068.5227, 2122.941, 1545.1523, 1549.1531]
2025-09-16 14:32:20,149 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [232.0, 816.0, 408.0, 256.0, 287.0, 908.0, 393.0, 407.0, 293.0, 291.0]
2025-09-16 14:32:20,149 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (2231.96) for latency 12
2025-09-16 14:32:20,157 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 70/100 (estimated time remaining: 1 hour, 5 minutes, 45 seconds)
2025-09-16 14:34:20,649 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:34:27,059 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 2402.91064 ± 804.457
2025-09-16 14:34:27,059 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1758.5354, 1946.0676, 3715.8325, 1758.2245, 2718.5127, 3939.7732, 1340.7682, 2084.025, 2473.3318, 2294.0347]
2025-09-16 14:34:27,059 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [339.0, 366.0, 721.0, 330.0, 515.0, 783.0, 250.0, 407.0, 467.0, 437.0]
2025-09-16 14:34:27,059 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (2402.91) for latency 12
2025-09-16 14:34:27,067 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 71/100 (estimated time remaining: 1 hour, 3 minutes, 4 seconds)
2025-09-16 14:36:30,991 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:36:35,515 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1658.06665 ± 407.582
2025-09-16 14:36:35,516 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [2245.3955, 1274.0356, 1458.5754, 1479.3116, 2089.1401, 1300.2804, 2416.1458, 1459.7787, 1608.2554, 1249.7477]
2025-09-16 14:36:35,516 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [424.0, 241.0, 289.0, 283.0, 406.0, 260.0, 457.0, 312.0, 322.0, 240.0]
2025-09-16 14:36:35,528 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 72/100 (estimated time remaining: 1 hour, 1 minute, 48 seconds)
2025-09-16 14:38:39,002 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:38:45,405 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 2284.74780 ± 1074.805
2025-09-16 14:38:45,405 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1174.5122, 5109.9097, 2487.0962, 2029.8148, 1747.2012, 2907.708, 1820.1241, 1753.5442, 1286.6206, 2530.9465]
2025-09-16 14:38:45,405 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [219.0, 1000.0, 502.0, 389.0, 354.0, 557.0, 344.0, 339.0, 254.0, 491.0]
2025-09-16 14:38:45,414 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 73/100 (estimated time remaining: 59 minutes, 58 seconds)
2025-09-16 14:40:47,729 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:40:51,833 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 1532.44373 ± 539.683
2025-09-16 14:40:51,834 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [777.53125, 1366.845, 2656.7698, 1660.0057, 1691.7527, 867.1149, 1261.4563, 2149.6545, 1667.7094, 1225.599]
2025-09-16 14:40:51,834 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [152.0, 268.0, 522.0, 310.0, 317.0, 160.0, 246.0, 395.0, 314.0, 234.0]
2025-09-16 14:40:51,842 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 74/100 (estimated time remaining: 57 minutes, 36 seconds)
2025-09-16 14:42:51,785 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:42:58,487 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 2483.76538 ± 1245.781
2025-09-16 14:42:58,487 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1579.694, 1682.6667, 4460.023, 4860.1284, 1897.3655, 1198.5466, 2519.969, 1197.9163, 3331.1135, 2110.2324]
2025-09-16 14:42:58,487 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [296.0, 323.0, 868.0, 941.0, 366.0, 225.0, 489.0, 237.0, 635.0, 419.0]
2025-09-16 14:42:58,487 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (2483.77) for latency 12
2025-09-16 14:42:58,503 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 75/100 (estimated time remaining: 55 minutes, 19 seconds)
2025-09-16 14:45:03,064 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:45:11,458 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 2835.57886 ± 1681.620
2025-09-16 14:45:11,458 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1304.5576, 3283.421, 1377.5493, 5098.18, 692.42084, 2392.68, 961.82336, 5029.807, 3073.9128, 5141.438]
2025-09-16 14:45:11,458 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [269.0, 653.0, 299.0, 1000.0, 158.0, 478.0, 216.0, 1000.0, 601.0, 1000.0]
2025-09-16 14:45:11,458 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (2835.58) for latency 12
2025-09-16 14:45:11,485 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 76/100 (estimated time remaining: 53 minutes, 42 seconds)
2025-09-16 14:47:12,312 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:47:21,409 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 3178.74512 ± 1287.634
2025-09-16 14:47:21,409 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [5064.36, 3603.784, 3440.139, 3820.2126, 2548.3623, 2923.232, 1524.697, 4983.508, 3130.6323, 748.5262]
2025-09-16 14:47:21,409 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [1000.0, 705.0, 724.0, 747.0, 496.0, 566.0, 303.0, 1000.0, 606.0, 157.0]
2025-09-16 14:47:21,409 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (3178.75) for latency 12
2025-09-16 14:47:21,443 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 77/100 (estimated time remaining: 51 minutes, 40 seconds)
2025-09-16 14:49:27,774 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:49:34,797 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 2610.30566 ± 1783.710
2025-09-16 14:49:34,797 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [5221.4204, 1415.5747, 1480.5233, 1680.9105, 3014.9053, 1090.9432, 5154.862, 756.5748, 1084.7236, 5202.6187]
2025-09-16 14:49:34,797 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [1000.0, 275.0, 285.0, 337.0, 573.0, 198.0, 1000.0, 144.0, 206.0, 1000.0]
2025-09-16 14:49:34,807 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 78/100 (estimated time remaining: 49 minutes, 47 seconds)
2025-09-16 14:51:38,268 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:51:46,354 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 2931.74463 ± 1717.711
2025-09-16 14:51:46,354 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [1223.6494, 1081.3453, 1939.0066, 1154.1378, 5201.42, 5259.0894, 4092.426, 3004.392, 5048.295, 1313.6857]
2025-09-16 14:51:46,354 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [224.0, 214.0, 359.0, 222.0, 1000.0, 1000.0, 785.0, 579.0, 948.0, 271.0]
2025-09-16 14:51:46,399 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 79/100 (estimated time remaining: 48 minutes)
2025-09-16 14:53:55,739 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:54:06,630 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 3814.26440 ± 1316.404
2025-09-16 14:54:06,630 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [3711.1438, 3478.705, 1857.477, 2822.2686, 5208.665, 1545.1587, 5076.4443, 4128.3555, 5135.836, 5178.5894]
2025-09-16 14:54:06,630 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [710.0, 674.0, 356.0, 541.0, 1000.0, 300.0, 1000.0, 792.0, 1000.0, 1000.0]
2025-09-16 14:54:06,630 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (3814.26) for latency 12
2025-09-16 14:54:06,641 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 80/100 (estimated time remaining: 46 minutes, 46 seconds)
2025-09-16 14:56:05,341 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:56:17,032 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 4046.99365 ± 1299.884
2025-09-16 14:56:17,032 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [2859.6587, 5202.9893, 5144.544, 4154.2695, 1776.4719, 3523.4548, 2186.2705, 5233.698, 5227.88, 5160.703]
2025-09-16 14:56:17,032 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [544.0, 1000.0, 1000.0, 839.0, 366.0, 720.0, 422.0, 1000.0, 1000.0, 1000.0]
2025-09-16 14:56:17,032 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (4046.99) for latency 12
2025-09-16 14:56:17,075 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 81/100 (estimated time remaining: 44 minutes, 22 seconds)
2025-09-16 14:58:18,172 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 14:58:28,006 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 3359.04614 ± 1775.927
2025-09-16 14:58:28,007 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [978.9048, 1677.3915, 1656.1202, 5103.9478, 4891.352, 2494.1267, 5199.9287, 1300.1307, 5103.365, 5185.1924]
2025-09-16 14:58:28,007 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [205.0, 353.0, 362.0, 1000.0, 1000.0, 555.0, 1000.0, 257.0, 1000.0, 1000.0]
2025-09-16 14:58:28,036 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 82/100 (estimated time remaining: 42 minutes, 13 seconds)
2025-09-16 15:00:34,970 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:00:45,395 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 3617.88721 ± 1535.027
2025-09-16 15:00:45,396 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [3112.4688, 4987.41, 2345.63, 4188.1646, 1736.6592, 5188.7104, 5144.3813, 657.5406, 5162.706, 3655.1995]
2025-09-16 15:00:45,396 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [605.0, 1000.0, 452.0, 845.0, 330.0, 1000.0, 1000.0, 131.0, 1000.0, 700.0]
2025-09-16 15:00:45,412 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 83/100 (estimated time remaining: 40 minutes, 14 seconds)
2025-09-16 15:02:40,634 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:02:50,957 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 3545.71802 ± 1820.945
2025-09-16 15:02:50,958 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [966.7535, 1268.1581, 5218.2407, 5288.0874, 5109.384, 3494.5703, 2919.7598, 5152.7246, 5200.535, 838.96747]
2025-09-16 15:02:50,958 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [207.0, 257.0, 1000.0, 1000.0, 1000.0, 692.0, 558.0, 1000.0, 1000.0, 161.0]
2025-09-16 15:02:50,969 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 84/100 (estimated time remaining: 37 minutes, 39 seconds)
2025-09-16 15:04:55,194 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:05:00,450 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 2000.14673 ± 776.819
2025-09-16 15:05:00,450 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [2389.6697, 1399.7444, 2194.4067, 1367.0107, 935.2961, 1366.9194, 2309.4766, 3512.2388, 2980.3333, 1546.371]
2025-09-16 15:05:00,451 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [463.0, 257.0, 417.0, 254.0, 177.0, 259.0, 444.0, 691.0, 556.0, 288.0]
2025-09-16 15:05:00,460 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 85/100 (estimated time remaining: 34 minutes, 52 seconds)
2025-09-16 15:07:04,888 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:07:15,148 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 3646.45386 ± 1346.388
2025-09-16 15:07:15,149 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [2621.889, 5256.965, 5177.425, 5128.2275, 2252.5195, 2351.87, 3854.155, 1446.3129, 4841.8735, 3533.2993]
2025-09-16 15:07:15,149 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [498.0, 1000.0, 1000.0, 1000.0, 448.0, 466.0, 733.0, 273.0, 925.0, 679.0]
2025-09-16 15:07:15,175 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 86/100 (estimated time remaining: 32 minutes, 54 seconds)
2025-09-16 15:09:26,536 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:09:34,133 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 2799.70093 ± 736.423
2025-09-16 15:09:34,133 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [2841.837, 2740.7761, 2984.5962, 2420.6104, 2441.7205, 2393.255, 2920.9653, 4038.8357, 3896.085, 1318.3256]
2025-09-16 15:09:34,133 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [535.0, 513.0, 560.0, 453.0, 481.0, 451.0, 546.0, 752.0, 724.0, 244.0]
2025-09-16 15:09:34,148 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 87/100 (estimated time remaining: 31 minutes, 5 seconds)
2025-09-16 15:11:28,789 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:11:41,308 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 4440.16992 ± 878.663
2025-09-16 15:11:41,308 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [5276.024, 5248.4395, 5227.348, 3851.7483, 4170.0283, 3092.127, 4219.7593, 2919.1616, 5189.146, 5207.922]
2025-09-16 15:11:41,308 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 729.0, 797.0, 606.0, 817.0, 553.0, 1000.0, 1000.0]
2025-09-16 15:11:41,309 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (4440.17) for latency 12
2025-09-16 15:11:41,323 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 88/100 (estimated time remaining: 28 minutes, 25 seconds)
2025-09-16 15:13:53,840 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:14:07,768 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 4661.59131 ± 1057.035
2025-09-16 15:14:07,768 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [5168.0615, 5190.785, 1714.9249, 4838.562, 3863.6326, 5186.2505, 5149.354, 5124.1577, 5189.984, 5190.205]
2025-09-16 15:14:07,768 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 323.0, 1000.0, 760.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-09-16 15:14:07,768 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (4661.59) for latency 12
2025-09-16 15:14:07,778 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 89/100 (estimated time remaining: 27 minutes, 4 seconds)
2025-09-16 15:16:01,734 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:16:12,475 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 3883.82422 ± 1420.969
2025-09-16 15:16:12,475 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [2674.6287, 5313.682, 5189.95, 5253.1997, 5201.9175, 1869.2827, 2874.2505, 3215.2102, 5312.0967, 1934.0233]
2025-09-16 15:16:12,475 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [508.0, 1000.0, 1000.0, 1000.0, 1000.0, 368.0, 556.0, 630.0, 1000.0, 380.0]
2025-09-16 15:16:12,484 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 90/100 (estimated time remaining: 24 minutes, 38 seconds)
2025-09-16 15:18:21,100 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:18:31,809 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 3816.72852 ± 1745.354
2025-09-16 15:18:31,809 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [5355.2007, 4110.4565, 589.61676, 1250.9603, 5208.8706, 5374.059, 5290.1323, 3695.6409, 5130.242, 2162.105]
2025-09-16 15:18:31,809 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [1000.0, 813.0, 119.0, 255.0, 1000.0, 1000.0, 1000.0, 695.0, 1000.0, 438.0]
2025-09-16 15:18:31,818 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 91/100 (estimated time remaining: 22 minutes, 33 seconds)
2025-09-16 15:20:37,658 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:20:52,423 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 5283.45410 ± 34.020
2025-09-16 15:20:52,423 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [5283.2744, 5264.815, 5281.663, 5272.6294, 5296.7773, 5322.815, 5196.9546, 5293.7773, 5299.042, 5322.787]
2025-09-16 15:20:52,423 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-09-16 15:20:52,423 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1226 [INFO]: New best (5283.45) for latency 12
2025-09-16 15:20:52,434 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 92/100 (estimated time remaining: 20 minutes, 20 seconds)
2025-09-16 15:22:50,104 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:23:04,548 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 5018.39551 ± 660.592
2025-09-16 15:23:04,548 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [5235.6787, 5220.8574, 5231.342, 5231.8, 5199.752, 5301.739, 5233.317, 3038.3506, 5273.6377, 5217.4844]
2025-09-16 15:23:04,548 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 580.0, 1000.0, 1000.0]
2025-09-16 15:23:04,556 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 93/100 (estimated time remaining: 18 minutes, 13 seconds)
2025-09-16 15:25:11,312 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:25:26,640 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 5099.13867 ± 48.384
2025-09-16 15:25:26,640 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [5054.62, 5001.8135, 5139.7812, 5131.1567, 5096.8604, 5092.9116, 5059.1934, 5183.253, 5117.109, 5114.688]
2025-09-16 15:25:26,640 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-09-16 15:25:26,676 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 94/100 (estimated time remaining: 15 minutes, 50 seconds)
2025-09-16 15:27:33,150 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:27:46,392 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 4630.67432 ± 1159.976
2025-09-16 15:27:46,392 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [5210.9595, 5173.7236, 5186.663, 5204.6763, 5172.2773, 5228.444, 1795.4775, 5134.3257, 2942.6157, 5257.5767]
2025-09-16 15:27:46,392 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 333.0, 1000.0, 560.0, 1000.0]
2025-09-16 15:27:46,404 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 95/100 (estimated time remaining: 13 minutes, 52 seconds)
2025-09-16 15:29:52,348 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:30:06,634 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 4942.35840 ± 809.281
2025-09-16 15:30:06,634 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [5183.2964, 2515.4438, 5188.6606, 5198.2207, 5193.0, 5240.287, 5221.2427, 5258.7944, 5210.002, 5214.6396]
2025-09-16 15:30:06,634 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [1000.0, 477.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-09-16 15:30:06,653 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 96/100 (estimated time remaining: 11 minutes, 34 seconds)
2025-09-16 15:32:04,187 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:32:19,049 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 5021.40186 ± 37.986
2025-09-16 15:32:19,049 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [5038.88, 4945.365, 5015.7646, 5013.1523, 4956.34, 5043.8164, 5049.931, 5053.6675, 5057.9756, 5039.13]
2025-09-16 15:32:19,049 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-09-16 15:32:19,057 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 97/100 (estimated time remaining: 9 minutes, 9 seconds)
2025-09-16 15:34:19,216 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:34:33,798 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 5067.17383 ± 648.686
2025-09-16 15:34:33,798 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [5289.1255, 3121.9912, 5257.029, 5297.514, 5277.2905, 5245.255, 5298.9243, 5311.2275, 5299.477, 5273.904]
2025-09-16 15:34:33,798 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [1000.0, 568.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-09-16 15:34:33,809 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 98/100 (estimated time remaining: 6 minutes, 53 seconds)
2025-09-16 15:36:40,826 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:36:55,599 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 5279.88281 ± 29.751
2025-09-16 15:36:55,600 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [5280.0234, 5212.371, 5265.635, 5290.214, 5281.0312, 5286.7017, 5293.4556, 5339.6543, 5282.9004, 5266.8423]
2025-09-16 15:36:55,600 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-09-16 15:36:55,610 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 99/100 (estimated time remaining: 4 minutes, 35 seconds)
2025-09-16 15:38:54,656 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:39:09,729 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 5275.46826 ± 36.365
2025-09-16 15:39:09,729 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [5325.5767, 5272.313, 5278.224, 5267.3535, 5284.643, 5307.152, 5318.108, 5244.844, 5194.15, 5262.321]
2025-09-16 15:39:09,730 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-09-16 15:39:09,738 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1199 [INFO]: Iteration 100/100 (estimated time remaining: 2 minutes, 16 seconds)
2025-09-16 15:41:16,606 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1214 [DEBUG]: Evaluating for latency 12...
2025-09-16 15:41:30,645 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1221 [DEBUG]: Total Reward: 5001.66895 ± 575.570
2025-09-16 15:41:30,645 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1222 [DEBUG]: All rewards: [5295.14, 5029.932, 5225.112, 5291.8315, 5265.1875, 4865.1177, 5233.1, 5256.6523, 3319.263, 5235.359]
2025-09-16 15:41:30,645 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1223 [DEBUG]: All trajectory lengths: [1000.0, 945.0, 1000.0, 1000.0, 1000.0, 914.0, 1000.0, 1000.0, 624.0, 1000.0]
2025-09-16 15:41:30,655 latency_env.delayed_mdp:training_loop(baseline-bpql-humanoid):1251 [DEBUG]: Training session finished
