2025-08-07 00:47:48,546 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1108 [DEBUG]: logdir: _logs/benchmark-v3-tc7/noiseperc0-halfcheetah/ExtremeSparseL4U32-bpql-mem32
2025-08-07 00:47:48,546 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1109 [DEBUG]: trainer_prefix: benchmark-v3-tc7/noiseperc0-halfcheetah/ExtremeSparseL4U32-bpql-mem32
2025-08-07 00:47:48,546 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1110 [DEBUG]: args.trainer_eval_latencies: {'ExtremeSparseL4U32': <latency_env.delayed_mdp.HiddenMarkovianDelay object at 0x151b761dc550>}
2025-08-07 00:47:48,546 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1111 [DEBUG]: using device: cuda
2025-08-07 00:47:48,550 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1133 [INFO]: Creating new trainer
2025-08-07 00:47:48,556 baseline-bpql-noiseperc0-halfcheetah:113 [DEBUG]: pi network:
NNGaussianPolicy(
  (common_head): Sequential(
    (0): Flatten(start_dim=1, end_dim=-1)
    (1): Linear(in_features=209, out_features=256, bias=True)
    (2): ReLU()
    (3): Linear(in_features=256, out_features=256, bias=True)
    (4): ReLU()
  )
  (mu_head): Sequential(
    (0): Linear(in_features=256, out_features=6, bias=True)
    (1): Unflatten(dim=1, unflattened_size=(6,))
  )
  (log_std_head): Sequential(
    (0): Linear(in_features=256, out_features=6, bias=True)
    (1): Unflatten(dim=1, unflattened_size=(6,))
  )
  (tanh_refit): NNTanhRefit(scale: tensor([[2., 2., 2., 2., 2., 2.]]), shift: tensor([[-1., -1., -1., -1., -1., -1.]]))
)
2025-08-07 00:47:48,556 baseline-bpql-noiseperc0-halfcheetah:114 [DEBUG]: q network:
NNLayerConcat2(
  dim: -1
  (next): Sequential(
    (0): Linear(in_features=23, out_features=256, bias=True)
    (1): ReLU()
    (2): Linear(in_features=256, out_features=256, bias=True)
    (3): ReLU()
    (4): Linear(in_features=256, out_features=1, bias=True)
    (5): NNLayerSqueeze(dim: -1)
  )
  (init_left): Flatten(start_dim=1, end_dim=-1)
  (init_right): Flatten(start_dim=1, end_dim=-1)
)
2025-08-07 00:47:49,493 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1194 [DEBUG]: Starting training session...
2025-08-07 00:47:49,493 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 1/100
2025-08-07 00:49:28,142 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 00:49:43,698 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: -396.32486 ± 124.122
2025-08-07 00:49:43,703 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [-534.1701, -249.02234, -442.2378, -474.8864, -521.69, -355.9061, -378.00095, -317.14743, -539.8763, -150.31128]
2025-08-07 00:49:43,703 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 00:49:43,703 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (-396.32) for latency ExtremeSparseL4U32
2025-08-07 00:49:43,720 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 2/100 (estimated time remaining: 3 hours, 8 minutes, 28 seconds)
2025-08-07 00:51:26,973 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 00:51:42,664 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: -214.92093 ± 36.747
2025-08-07 00:51:42,664 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [-234.89925, -224.35466, -185.83928, -227.6744, -180.65462, -137.73195, -247.22408, -267.26083, -244.1167, -199.45338]
2025-08-07 00:51:42,664 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 00:51:42,664 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (-214.92) for latency ExtremeSparseL4U32
2025-08-07 00:51:42,671 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 3/100 (estimated time remaining: 3 hours, 10 minutes, 25 seconds)
2025-08-07 00:53:25,935 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 00:53:41,683 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: -168.20259 ± 66.594
2025-08-07 00:53:41,683 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [-88.706795, -106.81459, -208.81493, -330.1442, -179.77304, -96.01137, -176.97743, -147.92978, -157.66428, -189.1894]
2025-08-07 00:53:41,683 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 00:53:41,683 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (-168.20) for latency ExtremeSparseL4U32
2025-08-07 00:53:41,687 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 4/100 (estimated time remaining: 3 hours, 9 minutes, 47 seconds)
2025-08-07 00:55:24,880 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 00:55:40,494 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2.76209 ± 104.861
2025-08-07 00:55:40,494 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [85.72259, 162.5378, -128.60188, -163.7683, -87.0979, 110.7898, 55.047577, 64.127975, -76.65464, 5.5178757]
2025-08-07 00:55:40,494 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 00:55:40,495 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (2.76) for latency ExtremeSparseL4U32
2025-08-07 00:55:40,497 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 5/100 (estimated time remaining: 3 hours, 8 minutes, 24 seconds)
2025-08-07 00:57:23,767 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 00:57:39,538 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 165.88138 ± 218.313
2025-08-07 00:57:39,539 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [-45.793934, 70.14398, 484.50912, 39.01941, 540.07245, 334.25424, 47.19037, -50.40368, -69.23614, 309.05783]
2025-08-07 00:57:39,539 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 00:57:39,539 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (165.88) for latency ExtremeSparseL4U32
2025-08-07 00:57:39,547 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 6/100 (estimated time remaining: 3 hours, 6 minutes, 51 seconds)
2025-08-07 00:59:22,640 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 00:59:38,263 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 232.28484 ± 167.507
2025-08-07 00:59:38,263 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [404.11865, 191.95758, 502.53186, 366.2451, 205.04323, 358.34137, 75.163086, 194.37718, -85.23209, 110.302444]
2025-08-07 00:59:38,264 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 00:59:38,264 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (232.28) for latency ExtremeSparseL4U32
2025-08-07 00:59:38,275 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 7/100 (estimated time remaining: 3 hours, 6 minutes, 17 seconds)
2025-08-07 01:01:21,454 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:01:37,098 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 417.80316 ± 323.617
2025-08-07 01:01:37,098 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [735.3204, 254.568, 70.96082, 730.71875, 198.03227, 285.02368, 913.09735, 44.14587, 123.34912, 822.8153]
2025-08-07 01:01:37,098 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:01:37,099 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (417.80) for latency ExtremeSparseL4U32
2025-08-07 01:01:37,106 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 8/100 (estimated time remaining: 3 hours, 4 minutes, 16 seconds)
2025-08-07 01:03:20,300 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:03:36,102 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 330.01929 ± 137.454
2025-08-07 01:03:36,103 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [104.428116, 335.80148, 265.63406, 417.1915, 649.2966, 254.31384, 213.62175, 323.8898, 400.60767, 335.40787]
2025-08-07 01:03:36,103 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:03:36,106 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 9/100 (estimated time remaining: 3 hours, 2 minutes, 17 seconds)
2025-08-07 01:05:19,245 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:05:35,025 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 734.10675 ± 185.221
2025-08-07 01:05:35,026 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1099.3542, 699.2454, 790.71436, 980.0028, 777.88403, 448.6199, 631.8054, 514.9113, 713.7076, 684.8223]
2025-08-07 01:05:35,026 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:05:35,026 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (734.11) for latency ExtremeSparseL4U32
2025-08-07 01:05:35,029 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 10/100 (estimated time remaining: 3 hours, 20 seconds)
2025-08-07 01:07:18,153 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:07:33,743 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 946.79230 ± 230.353
2025-08-07 01:07:33,743 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [906.81885, 748.2387, 798.14233, 1226.6158, 594.6484, 916.9784, 1404.3308, 1148.2079, 864.28827, 859.65314]
2025-08-07 01:07:33,743 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:07:33,743 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (946.79) for latency ExtremeSparseL4U32
2025-08-07 01:07:33,763 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 11/100 (estimated time remaining: 2 hours, 58 minutes, 15 seconds)
2025-08-07 01:09:16,821 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:09:32,552 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1048.54138 ± 89.567
2025-08-07 01:09:32,552 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1090.1909, 1063.212, 1020.1503, 1041.0273, 1014.1206, 1002.16364, 1280.7152, 968.6228, 933.4609, 1071.7498]
2025-08-07 01:09:32,552 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:09:32,552 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (1048.54) for latency ExtremeSparseL4U32
2025-08-07 01:09:32,559 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 12/100 (estimated time remaining: 2 hours, 56 minutes, 18 seconds)
2025-08-07 01:11:15,662 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:11:31,413 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1110.82104 ± 169.959
2025-08-07 01:11:31,413 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1201.2925, 1057.2191, 1317.7285, 690.0686, 1069.6339, 1077.9236, 1113.8314, 1154.1107, 1086.051, 1340.351]
2025-08-07 01:11:31,413 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:11:31,413 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (1110.82) for latency ExtremeSparseL4U32
2025-08-07 01:11:31,439 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 13/100 (estimated time remaining: 2 hours, 54 minutes, 20 seconds)
2025-08-07 01:13:14,548 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:13:30,183 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1095.63818 ± 102.103
2025-08-07 01:13:30,184 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1053.0438, 1006.24713, 1079.1542, 1119.5592, 1230.3336, 1052.832, 1106.8793, 1004.1302, 1323.4932, 980.7086]
2025-08-07 01:13:30,184 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:13:30,189 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 14/100 (estimated time remaining: 2 hours, 52 minutes, 17 seconds)
2025-08-07 01:15:13,251 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:15:28,992 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1199.15479 ± 271.594
2025-08-07 01:15:28,992 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1225.2457, 903.5751, 1572.2761, 993.3316, 1024.5634, 1078.6829, 1117.9832, 1834.5728, 1133.7015, 1107.6161]
2025-08-07 01:15:28,992 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:15:28,992 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (1199.15) for latency ExtremeSparseL4U32
2025-08-07 01:15:29,002 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 15/100 (estimated time remaining: 2 hours, 50 minutes, 16 seconds)
2025-08-07 01:17:12,117 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:17:27,708 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1120.44666 ± 184.055
2025-08-07 01:17:27,709 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1102.8682, 998.44366, 970.47644, 1002.1291, 1151.4438, 1023.19385, 1275.8022, 999.0166, 1075.132, 1605.9614]
2025-08-07 01:17:27,709 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:17:27,732 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 16/100 (estimated time remaining: 2 hours, 48 minutes, 17 seconds)
2025-08-07 01:19:10,920 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:19:26,506 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 980.69470 ± 272.661
2025-08-07 01:19:26,506 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [715.27924, 1043.0015, 1155.7557, 1097.7882, 1008.4554, 1069.9464, 1146.5746, 263.03516, 1070.7804, 1236.3304]
2025-08-07 01:19:26,506 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:19:26,512 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 17/100 (estimated time remaining: 2 hours, 46 minutes, 18 seconds)
2025-08-07 01:21:09,613 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:21:25,192 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1345.06958 ± 190.261
2025-08-07 01:21:25,192 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1664.1565, 1303.2617, 1064.0565, 1383.2772, 1239.7163, 1143.4641, 1576.2036, 1578.3353, 1250.7434, 1247.4812]
2025-08-07 01:21:25,192 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:21:25,192 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (1345.07) for latency ExtremeSparseL4U32
2025-08-07 01:21:25,199 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 18/100 (estimated time remaining: 2 hours, 44 minutes, 16 seconds)
2025-08-07 01:23:08,350 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:23:23,967 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1252.09253 ± 151.996
2025-08-07 01:23:23,967 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1066.1595, 1385.6138, 1230.1719, 1338.1156, 1130.7958, 1259.3173, 1351.373, 975.8067, 1267.7617, 1515.81]
2025-08-07 01:23:23,967 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:23:23,974 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 19/100 (estimated time remaining: 2 hours, 42 minutes, 18 seconds)
2025-08-07 01:25:07,122 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:25:22,848 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1326.77954 ± 150.777
2025-08-07 01:25:22,849 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1176.0286, 1451.8097, 1114.7651, 1665.0499, 1233.5675, 1287.0631, 1426.2822, 1317.1729, 1360.0356, 1236.0195]
2025-08-07 01:25:22,849 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:25:22,861 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 20/100 (estimated time remaining: 2 hours, 40 minutes, 20 seconds)
2025-08-07 01:27:06,017 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:27:21,610 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1261.56201 ± 165.916
2025-08-07 01:27:21,610 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1299.8612, 1527.5195, 1343.1508, 1150.4442, 1079.8964, 1551.9894, 1116.9369, 1102.4923, 1128.5922, 1314.7369]
2025-08-07 01:27:21,610 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:27:21,614 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 21/100 (estimated time remaining: 2 hours, 38 minutes, 22 seconds)
2025-08-07 01:29:04,824 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:29:20,425 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1296.03003 ± 127.012
2025-08-07 01:29:20,425 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1282.3772, 1235.8287, 1254.4172, 1209.0353, 1313.6813, 1211.1866, 1581.8079, 1114.7703, 1299.413, 1457.7825]
2025-08-07 01:29:20,425 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:29:20,430 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 22/100 (estimated time remaining: 2 hours, 36 minutes, 23 seconds)
2025-08-07 01:31:03,680 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:31:19,220 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1329.05823 ± 444.429
2025-08-07 01:31:19,220 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [2223.8135, 1454.5289, 1309.5524, 330.67847, 1140.8604, 1540.6342, 1377.0333, 1399.5048, 1078.2969, 1435.6799]
2025-08-07 01:31:19,220 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:31:19,227 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 23/100 (estimated time remaining: 2 hours, 34 minutes, 26 seconds)
2025-08-07 01:33:02,366 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:33:17,963 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1305.10632 ± 204.555
2025-08-07 01:33:17,963 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1240.2977, 1588.7587, 1353.5483, 1299.4456, 1249.3372, 912.4059, 1695.1649, 1302.1155, 1235.5519, 1174.4371]
2025-08-07 01:33:17,963 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:33:17,969 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 24/100 (estimated time remaining: 2 hours, 32 minutes, 27 seconds)
2025-08-07 01:35:01,072 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:35:16,833 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1321.53870 ± 182.823
2025-08-07 01:35:16,833 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1197.7123, 1251.0818, 1124.8798, 1136.8617, 1330.1039, 1779.8918, 1239.679, 1436.0583, 1423.9741, 1295.1444]
2025-08-07 01:35:16,833 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:35:16,842 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 25/100 (estimated time remaining: 2 hours, 30 minutes, 28 seconds)
2025-08-07 01:36:59,928 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:37:15,531 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1146.26685 ± 359.332
2025-08-07 01:37:15,531 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1215.6779, 1488.1771, 1509.578, 540.28906, 1329.6217, 1222.7598, 413.1478, 1095.7737, 1206.0604, 1441.5818]
2025-08-07 01:37:15,531 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:37:15,537 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 26/100 (estimated time remaining: 2 hours, 28 minutes, 28 seconds)
2025-08-07 01:38:58,619 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:39:14,332 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1527.06079 ± 342.252
2025-08-07 01:39:14,333 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1638.7714, 1234.9528, 1394.9631, 1065.8851, 1928.7518, 1109.1289, 1536.9789, 1730.4579, 1428.2516, 2202.466]
2025-08-07 01:39:14,333 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:39:14,333 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (1527.06) for latency ExtremeSparseL4U32
2025-08-07 01:39:14,340 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 27/100 (estimated time remaining: 2 hours, 26 minutes, 29 seconds)
2025-08-07 01:40:57,575 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:41:13,297 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1524.34314 ± 314.705
2025-08-07 01:41:13,297 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1255.8862, 1343.2036, 1520.1757, 1269.2454, 1216.2092, 1577.2654, 1923.7325, 1864.8988, 1177.0234, 2095.7913]
2025-08-07 01:41:13,297 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:41:13,302 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 28/100 (estimated time remaining: 2 hours, 24 minutes, 33 seconds)
2025-08-07 01:42:56,644 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:43:12,367 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1272.52478 ± 367.507
2025-08-07 01:43:12,367 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [2040.2091, 1177.7338, 467.8515, 1329.937, 1274.6388, 1238.0045, 1271.4142, 1241.5458, 1130.1869, 1553.7261]
2025-08-07 01:43:12,367 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:43:12,377 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 29/100 (estimated time remaining: 2 hours, 22 minutes, 39 seconds)
2025-08-07 01:44:55,486 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:45:11,087 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1409.56567 ± 214.113
2025-08-07 01:45:11,087 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1336.7584, 1244.3127, 1237.1799, 1366.4642, 1372.624, 1684.2834, 1378.9857, 1265.9203, 1936.0817, 1273.0444]
2025-08-07 01:45:11,087 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:45:11,099 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 30/100 (estimated time remaining: 2 hours, 20 minutes, 38 seconds)
2025-08-07 01:46:54,160 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:47:09,733 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1412.37769 ± 247.536
2025-08-07 01:47:09,733 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1153.4478, 1614.7017, 1290.2875, 1244.9272, 1784.9333, 1128.9896, 1886.3011, 1316.4825, 1379.9803, 1323.7256]
2025-08-07 01:47:09,733 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:47:09,737 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 31/100 (estimated time remaining: 2 hours, 18 minutes, 38 seconds)
2025-08-07 01:48:52,994 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:49:08,750 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1739.87378 ± 390.808
2025-08-07 01:49:08,750 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1284.6321, 2217.1692, 1603.7528, 1178.959, 1826.0428, 2246.5505, 2352.5774, 1681.6008, 1455.646, 1551.8071]
2025-08-07 01:49:08,750 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:49:08,750 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (1739.87) for latency ExtremeSparseL4U32
2025-08-07 01:49:08,754 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 32/100 (estimated time remaining: 2 hours, 16 minutes, 42 seconds)
2025-08-07 01:50:51,936 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:51:07,521 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1378.14124 ± 226.597
2025-08-07 01:51:07,522 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1414.1528, 1646.5985, 1111.7139, 1519.9172, 1343.2261, 1329.5084, 1853.4152, 1105.0499, 1243.5571, 1214.2738]
2025-08-07 01:51:07,522 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:51:07,529 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 33/100 (estimated time remaining: 2 hours, 14 minutes, 41 seconds)
2025-08-07 01:52:50,735 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:53:06,498 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1720.96423 ± 380.549
2025-08-07 01:53:06,498 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1388.9512, 1303.479, 1999.5234, 1387.433, 1918.4397, 1381.6594, 2524.8264, 2098.4668, 1650.099, 1556.7642]
2025-08-07 01:53:06,498 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:53:06,503 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 34/100 (estimated time remaining: 2 hours, 12 minutes, 41 seconds)
2025-08-07 01:54:49,665 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:55:05,346 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1678.86328 ± 446.191
2025-08-07 01:55:05,347 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1290.363, 1819.0851, 1883.4836, 1482.1223, 1559.0271, 1419.0278, 2830.9214, 1300.7137, 1305.5077, 1898.3805]
2025-08-07 01:55:05,347 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:55:05,356 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 35/100 (estimated time remaining: 2 hours, 10 minutes, 44 seconds)
2025-08-07 01:56:48,520 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:57:04,242 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1410.78894 ± 289.913
2025-08-07 01:57:04,242 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1193.4664, 2129.6406, 1512.1201, 1681.4048, 1244.041, 1413.7413, 1173.1964, 1403.9489, 1162.6547, 1193.6759]
2025-08-07 01:57:04,242 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:57:04,247 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 36/100 (estimated time remaining: 2 hours, 8 minutes, 48 seconds)
2025-08-07 01:58:47,356 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 01:59:02,945 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1712.94592 ± 285.216
2025-08-07 01:59:02,945 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1553.2448, 1768.0624, 1413.0659, 1875.1926, 1627.1796, 2139.5525, 1382.8369, 1495.9635, 1603.4707, 2270.8901]
2025-08-07 01:59:02,945 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 01:59:02,955 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 37/100 (estimated time remaining: 2 hours, 6 minutes, 45 seconds)
2025-08-07 02:00:46,128 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:01:01,870 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1541.04041 ± 162.237
2025-08-07 02:01:01,870 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1521.6295, 1513.2141, 1391.6215, 1688.6199, 1663.4431, 1316.9357, 1887.6115, 1586.7555, 1446.5681, 1394.0048]
2025-08-07 02:01:01,870 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:01:01,885 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 38/100 (estimated time remaining: 2 hours, 4 minutes, 48 seconds)
2025-08-07 02:02:45,024 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:03:00,632 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1440.84497 ± 256.793
2025-08-07 02:03:00,632 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1828.5981, 1169.9445, 1311.3766, 1213.8717, 1322.2606, 2010.7948, 1433.0227, 1465.0864, 1296.6012, 1356.8937]
2025-08-07 02:03:00,632 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:03:00,637 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 39/100 (estimated time remaining: 2 hours, 2 minutes, 47 seconds)
2025-08-07 02:04:43,811 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:04:59,425 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1860.93750 ± 455.425
2025-08-07 02:04:59,426 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [2343.375, 1257.2788, 1971.4075, 2076.6917, 2362.602, 2630.5872, 1486.0187, 1462.3746, 1391.6656, 1627.374]
2025-08-07 02:04:59,426 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:04:59,426 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (1860.94) for latency ExtremeSparseL4U32
2025-08-07 02:04:59,430 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 40/100 (estimated time remaining: 2 hours, 47 seconds)
2025-08-07 02:06:42,489 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:06:58,091 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1739.58887 ± 483.554
2025-08-07 02:06:58,091 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [2864.0205, 1695.3015, 1298.4916, 2160.9355, 2060.7356, 1246.2885, 1323.0437, 1412.76, 1490.3319, 1843.9789]
2025-08-07 02:06:58,091 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:06:58,096 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 41/100 (estimated time remaining: 1 hour, 58 minutes, 46 seconds)
2025-08-07 02:08:41,232 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:08:56,940 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1451.63843 ± 226.252
2025-08-07 02:08:56,940 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [2034.0911, 1504.3866, 1212.3516, 1553.5408, 1264.0807, 1222.5576, 1420.9891, 1363.2052, 1420.1415, 1521.0396]
2025-08-07 02:08:56,940 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:08:56,951 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 42/100 (estimated time remaining: 1 hour, 56 minutes, 49 seconds)
2025-08-07 02:10:40,121 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:10:55,695 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1470.99890 ± 189.128
2025-08-07 02:10:55,695 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1502.7076, 1371.2577, 1317.9844, 1491.7247, 1279.4906, 1941.159, 1233.1538, 1528.7488, 1528.4429, 1515.3192]
2025-08-07 02:10:55,695 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:10:55,717 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 43/100 (estimated time remaining: 1 hour, 54 minutes, 48 seconds)
2025-08-07 02:12:37,986 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:12:53,425 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1793.58167 ± 422.145
2025-08-07 02:12:53,425 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1228.1385, 1712.846, 1723.8463, 1464.4305, 2184.8655, 2530.814, 1430.5331, 1318.4479, 2213.579, 2128.316]
2025-08-07 02:12:53,425 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:12:53,441 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 44/100 (estimated time remaining: 1 hour, 52 minutes, 37 seconds)
2025-08-07 02:14:35,204 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:14:50,605 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1474.58533 ± 218.934
2025-08-07 02:14:50,605 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1278.2701, 1755.11, 1369.1935, 1491.5004, 1733.8911, 1232.8096, 1174.4479, 1836.1511, 1463.6661, 1410.814]
2025-08-07 02:14:50,605 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:14:50,627 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 45/100 (estimated time remaining: 1 hour, 50 minutes, 21 seconds)
2025-08-07 02:16:32,299 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:16:47,732 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1585.66821 ± 486.284
2025-08-07 02:16:47,732 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [747.75, 1356.4918, 1962.3568, 1612.3933, 1404.747, 1439.5417, 1441.6447, 1676.7831, 2755.4717, 1459.5021]
2025-08-07 02:16:47,732 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:16:47,741 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 46/100 (estimated time remaining: 1 hour, 48 minutes, 6 seconds)
2025-08-07 02:18:28,774 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:18:44,154 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1937.03357 ± 619.846
2025-08-07 02:18:44,154 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [2238.109, 1955.7715, 3099.8252, 1283.185, 1257.9248, 1301.2026, 1510.3087, 1629.8563, 2340.5957, 2753.5576]
2025-08-07 02:18:44,154 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:18:44,154 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (1937.03) for latency ExtremeSparseL4U32
2025-08-07 02:18:44,167 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 47/100 (estimated time remaining: 1 hour, 45 minutes, 41 seconds)
2025-08-07 02:20:24,971 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:20:40,328 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1609.55591 ± 311.029
2025-08-07 02:20:40,329 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1456.2783, 2125.5488, 1349.5394, 1334.8097, 1464.4382, 1316.7307, 1349.4583, 1746.9844, 2166.6917, 1785.08]
2025-08-07 02:20:40,329 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:20:40,338 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 48/100 (estimated time remaining: 1 hour, 43 minutes, 16 seconds)
2025-08-07 02:22:21,163 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:22:36,489 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1891.15405 ± 429.267
2025-08-07 02:22:36,489 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1874.3646, 1415.4773, 1517.7582, 1545.052, 2977.155, 1654.34, 1742.2792, 2066.8948, 2136.5518, 1981.67]
2025-08-07 02:22:36,489 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:22:36,496 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 49/100 (estimated time remaining: 1 hour, 41 minutes, 3 seconds)
2025-08-07 02:24:17,403 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:24:32,911 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1962.62402 ± 719.874
2025-08-07 02:24:32,911 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1441.0802, 1404.859, 1407.4609, 1514.0364, 2709.9133, 1295.3264, 2230.9016, 3005.705, 1390.1396, 3226.8176]
2025-08-07 02:24:32,911 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:24:32,911 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (1962.62) for latency ExtremeSparseL4U32
2025-08-07 02:24:32,935 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 50/100 (estimated time remaining: 1 hour, 38 minutes, 59 seconds)
2025-08-07 02:26:13,837 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:26:29,294 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1536.78662 ± 613.066
2025-08-07 02:26:29,294 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1593.8103, 1695.3203, 1571.5674, -180.13249, 2144.259, 1530.1755, 2052.3145, 1850.2856, 1401.3478, 1708.9187]
2025-08-07 02:26:29,294 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:26:29,306 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 51/100 (estimated time remaining: 1 hour, 36 minutes, 55 seconds)
2025-08-07 02:28:10,227 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:28:25,693 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1697.03442 ± 284.641
2025-08-07 02:28:25,693 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1454.1957, 1595.821, 1624.8806, 1628.2736, 1349.6731, 1696.2842, 1691.1178, 1486.8591, 2310.5186, 2132.7195]
2025-08-07 02:28:25,693 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:28:25,704 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 52/100 (estimated time remaining: 1 hour, 34 minutes, 59 seconds)
2025-08-07 02:30:06,651 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:30:22,012 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2153.79150 ± 557.820
2025-08-07 02:30:22,012 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [2074.2073, 1914.0386, 1291.6748, 1485.3723, 2064.6724, 2841.8894, 2816.3132, 1677.3041, 2954.0154, 2418.4268]
2025-08-07 02:30:22,012 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:30:22,012 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (2153.79) for latency ExtremeSparseL4U32
2025-08-07 02:30:22,031 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 53/100 (estimated time remaining: 1 hour, 33 minutes, 4 seconds)
2025-08-07 02:32:02,929 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:32:18,440 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1764.40198 ± 497.344
2025-08-07 02:32:18,441 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [2058.015, 1620.0992, 1087.1334, 1620.6603, 1538.7705, 2942.7693, 1594.1672, 1507.7117, 2250.9631, 1423.73]
2025-08-07 02:32:18,441 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:32:18,449 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 54/100 (estimated time remaining: 1 hour, 31 minutes, 10 seconds)
2025-08-07 02:33:59,290 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:34:14,638 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1781.14099 ± 518.634
2025-08-07 02:34:14,638 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1453.5642, 1553.0475, 2483.2136, 1462.1885, 1555.4998, 2305.2903, 2688.9973, 1951.6324, 1053.0023, 1304.9744]
2025-08-07 02:34:14,638 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:34:14,651 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 55/100 (estimated time remaining: 1 hour, 29 minutes, 11 seconds)
2025-08-07 02:35:55,595 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:36:10,991 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1849.85156 ± 423.812
2025-08-07 02:36:10,991 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1972.2819, 2631.542, 2239.8418, 1548.0626, 1486.3903, 1390.3608, 2302.7136, 1427.2034, 1449.9799, 2050.1396]
2025-08-07 02:36:10,991 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:36:10,999 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 56/100 (estimated time remaining: 1 hour, 27 minutes, 15 seconds)
2025-08-07 02:37:51,914 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:38:07,287 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2214.92041 ± 1015.580
2025-08-07 02:38:07,287 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1344.4165, 3639.8154, 1378.2386, 1816.103, 3603.0376, 1362.191, 1529.2821, 1954.1198, 1561.3538, 3960.6443]
2025-08-07 02:38:07,287 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:38:07,287 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (2214.92) for latency ExtremeSparseL4U32
2025-08-07 02:38:07,293 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 57/100 (estimated time remaining: 1 hour, 25 minutes, 17 seconds)
2025-08-07 02:39:48,105 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:40:03,359 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1480.78149 ± 170.282
2025-08-07 02:40:03,359 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1825.4558, 1387.0385, 1436.2311, 1446.6194, 1360.5477, 1447.3732, 1353.7932, 1785.5154, 1294.9113, 1470.3296]
2025-08-07 02:40:03,359 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:40:03,365 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 58/100 (estimated time remaining: 1 hour, 23 minutes, 19 seconds)
2025-08-07 02:41:43,799 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:41:59,084 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2117.15479 ± 651.013
2025-08-07 02:41:59,084 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1627.306, 1707.0961, 2641.1082, 1829.7634, 2014.3085, 1714.2942, 2869.884, 1658.5509, 3589.1262, 1520.1117]
2025-08-07 02:41:59,084 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:41:59,118 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 59/100 (estimated time remaining: 1 hour, 21 minutes, 17 seconds)
2025-08-07 02:43:39,473 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:43:54,737 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2650.33057 ± 751.464
2025-08-07 02:43:54,738 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1872.915, 2452.5212, 2918.5881, 3603.1594, 3135.7017, 2456.547, 1602.8893, 3905.3716, 1645.0786, 2910.5356]
2025-08-07 02:43:54,738 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:43:54,738 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (2650.33) for latency ExtremeSparseL4U32
2025-08-07 02:43:54,743 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 60/100 (estimated time remaining: 1 hour, 19 minutes, 16 seconds)
2025-08-07 02:45:35,166 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:45:50,439 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2462.57959 ± 827.492
2025-08-07 02:45:50,439 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [2452.4297, 1488.9081, 1760.3043, 2860.4727, 2306.413, 3729.609, 1984.2017, 1404.8463, 2685.8914, 3952.72]
2025-08-07 02:45:50,439 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:45:50,444 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 61/100 (estimated time remaining: 1 hour, 17 minutes, 15 seconds)
2025-08-07 02:47:30,736 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:47:46,030 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2573.05396 ± 775.632
2025-08-07 02:47:46,030 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [3176.408, 2410.9392, 2057.9639, 2694.9834, 4014.4727, 2539.5083, 1670.3141, 3564.7197, 1429.7539, 2171.4763]
2025-08-07 02:47:46,030 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:47:46,038 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 62/100 (estimated time remaining: 1 hour, 15 minutes, 14 seconds)
2025-08-07 02:49:26,366 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:49:41,762 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2064.77661 ± 439.339
2025-08-07 02:49:41,762 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [2030.8245, 1794.3848, 2959.133, 2502.1836, 1503.8545, 1554.4479, 2412.5884, 1757.3561, 2259.065, 1873.9288]
2025-08-07 02:49:41,762 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:49:41,771 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 63/100 (estimated time remaining: 1 hour, 13 minutes, 15 seconds)
2025-08-07 02:51:22,104 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:51:37,529 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2721.25000 ± 744.034
2025-08-07 02:51:37,529 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1780.3479, 2587.426, 2020.0413, 2647.83, 3764.1692, 3717.798, 1929.7845, 3827.7278, 2664.2673, 2273.1072]
2025-08-07 02:51:37,529 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:51:37,529 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (2721.25) for latency ExtremeSparseL4U32
2025-08-07 02:51:37,538 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 64/100 (estimated time remaining: 1 hour, 11 minutes, 20 seconds)
2025-08-07 02:53:17,827 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:53:33,218 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2127.67041 ± 567.106
2025-08-07 02:53:33,219 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1465.209, 2488.1833, 1837.329, 2079.865, 3412.3704, 1571.0676, 2064.345, 1489.6123, 2458.6123, 2410.1094]
2025-08-07 02:53:33,219 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:53:33,230 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 65/100 (estimated time remaining: 1 hour, 9 minutes, 25 seconds)
2025-08-07 02:55:13,632 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:55:29,022 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1854.88867 ± 212.097
2025-08-07 02:55:29,023 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [2418.9387, 1764.916, 1742.1049, 1874.2899, 1635.1521, 1823.7861, 1920.7062, 1651.2809, 1771.0027, 1946.7115]
2025-08-07 02:55:29,023 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:55:29,035 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 66/100 (estimated time remaining: 1 hour, 7 minutes, 30 seconds)
2025-08-07 02:57:09,274 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:57:24,563 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1982.10327 ± 600.636
2025-08-07 02:57:24,563 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [2321.417, 2135.4802, 1472.0735, 1429.5668, 2006.9929, 3582.9028, 1756.9652, 1696.2122, 1537.1525, 1882.272]
2025-08-07 02:57:24,563 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:57:24,569 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 67/100 (estimated time remaining: 1 hour, 5 minutes, 34 seconds)
2025-08-07 02:59:04,933 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 02:59:20,239 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2187.06079 ± 597.955
2025-08-07 02:59:20,239 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [2306.9695, 2475.2402, 2070.8442, 1640.6526, 1729.0133, 2301.1377, 1548.6058, 2275.5942, 3727.7827, 1794.7655]
2025-08-07 02:59:20,239 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 02:59:20,247 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 68/100 (estimated time remaining: 1 hour, 3 minutes, 37 seconds)
2025-08-07 03:01:00,584 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:01:15,829 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2108.40601 ± 685.098
2025-08-07 03:01:15,829 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1452.7949, 1686.8427, 2600.7468, 1521.7133, 1448.8318, 1529.3595, 3248.6267, 2758.9407, 3056.0645, 1780.1392]
2025-08-07 03:01:15,829 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:01:15,846 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 69/100 (estimated time remaining: 1 hour, 1 minute, 41 seconds)
2025-08-07 03:02:56,260 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:03:11,527 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1695.88049 ± 184.184
2025-08-07 03:03:11,527 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1561.2861, 1448.0232, 1659.5583, 1687.2983, 1794.7288, 1528.5557, 2140.6213, 1768.181, 1592.3187, 1778.2336]
2025-08-07 03:03:11,527 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:03:11,533 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 70/100 (estimated time remaining: 59 minutes, 45 seconds)
2025-08-07 03:04:51,998 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:05:07,253 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1706.00256 ± 606.504
2025-08-07 03:05:07,254 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1399.5955, 1485.6923, 1694.23, 1495.4015, 1367.7513, 1637.0807, 1397.0566, 3493.0767, 1419.5413, 1670.6002]
2025-08-07 03:05:07,254 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:05:07,261 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 71/100 (estimated time remaining: 57 minutes, 49 seconds)
2025-08-07 03:06:47,601 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:07:03,008 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2036.33423 ± 552.049
2025-08-07 03:07:03,008 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [2766.3298, 1547.132, 2748.3489, 1850.4712, 1268.7012, 1692.1594, 2726.6067, 1479.0862, 1813.0847, 2471.4226]
2025-08-07 03:07:03,008 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:07:03,014 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 72/100 (estimated time remaining: 55 minutes, 54 seconds)
2025-08-07 03:08:43,423 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:08:58,841 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1893.35706 ± 489.176
2025-08-07 03:08:58,842 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1865.5109, 1553.0807, 1852.088, 2776.6548, 2880.3064, 1549.3478, 1483.6357, 1865.5796, 1590.009, 1517.3575]
2025-08-07 03:08:58,842 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:08:58,850 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 73/100 (estimated time remaining: 54 minutes)
2025-08-07 03:10:39,185 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:10:54,602 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1798.33276 ± 287.616
2025-08-07 03:10:54,602 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1990.014, 2050.6636, 2404.3345, 1319.7373, 1734.9159, 1578.5065, 1526.8495, 1812.168, 1826.7583, 1739.3804]
2025-08-07 03:10:54,602 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:10:54,642 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 74/100 (estimated time remaining: 52 minutes, 5 seconds)
2025-08-07 03:12:34,968 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:12:50,344 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 3049.19165 ± 953.471
2025-08-07 03:12:50,344 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [4125.0674, 3996.8083, 1599.2885, 4021.0664, 3322.8867, 2894.3242, 2211.1018, 2315.3171, 4152.9624, 1853.0941]
2025-08-07 03:12:50,344 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:12:50,344 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (3049.19) for latency ExtremeSparseL4U32
2025-08-07 03:12:50,350 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 75/100 (estimated time remaining: 50 minutes, 9 seconds)
2025-08-07 03:14:30,808 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:14:46,082 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2680.13965 ± 786.534
2025-08-07 03:14:46,082 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [3089.9653, 3899.3098, 3184.5547, 2469.9912, 2837.1782, 1552.7162, 3703.036, 1478.0581, 2564.4658, 2022.1238]
2025-08-07 03:14:46,082 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:14:46,109 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 76/100 (estimated time remaining: 48 minutes, 14 seconds)
2025-08-07 03:16:26,426 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:16:41,692 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1843.13159 ± 262.525
2025-08-07 03:16:41,692 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [2088.558, 1599.2458, 2105.5352, 1713.3087, 1643.3674, 1780.681, 1766.5962, 2440.0515, 1626.3925, 1667.5804]
2025-08-07 03:16:41,692 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:16:41,698 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 77/100 (estimated time remaining: 46 minutes, 17 seconds)
2025-08-07 03:18:22,115 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:18:37,504 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2643.32886 ± 916.710
2025-08-07 03:18:37,504 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [2274.5708, 3754.248, 2631.7195, 1390.0337, 3619.3242, 3714.4702, 1677.7856, 2142.3652, 1570.8975, 3657.8748]
2025-08-07 03:18:37,504 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:18:37,514 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 78/100 (estimated time remaining: 44 minutes, 21 seconds)
2025-08-07 03:20:17,888 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:20:33,317 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2455.36401 ± 768.567
2025-08-07 03:20:33,317 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1925.395, 1557.0354, 2360.6675, 3992.0232, 2981.1714, 1860.3733, 2930.5256, 1435.1669, 3186.574, 2324.708]
2025-08-07 03:20:33,317 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:20:33,327 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 79/100 (estimated time remaining: 42 minutes, 26 seconds)
2025-08-07 03:22:13,757 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:22:29,078 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2317.55322 ± 887.212
2025-08-07 03:22:29,078 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1078.9679, 2390.0107, 1688.0991, 2211.314, 3646.4827, 3926.0583, 2592.1697, 2664.153, 1529.0293, 1449.2487]
2025-08-07 03:22:29,078 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:22:29,087 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 80/100 (estimated time remaining: 40 minutes, 30 seconds)
2025-08-07 03:24:09,479 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:24:24,773 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 1769.17834 ± 281.447
2025-08-07 03:24:24,774 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1569.6012, 2313.725, 1432.2146, 1868.2242, 1471.2727, 1653.6332, 1885.4922, 2126.4116, 1879.5057, 1491.7031]
2025-08-07 03:24:24,774 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:24:24,785 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 81/100 (estimated time remaining: 38 minutes, 34 seconds)
2025-08-07 03:26:05,221 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:26:20,670 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2220.38086 ± 775.780
2025-08-07 03:26:20,670 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [3671.0903, 2698.752, 1719.855, 2086.3218, 2911.8452, 1543.8838, 3128.392, 1403.8629, 1456.0442, 1583.7601]
2025-08-07 03:26:20,670 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:26:20,677 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 82/100 (estimated time remaining: 36 minutes, 40 seconds)
2025-08-07 03:28:01,149 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:28:16,602 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2605.59863 ± 828.337
2025-08-07 03:28:16,602 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [2618.3906, 1716.3622, 1519.8091, 3300.9412, 3248.6636, 2543.0354, 4133.223, 3210.722, 1532.5336, 2232.3052]
2025-08-07 03:28:16,602 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:28:16,610 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 83/100 (estimated time remaining: 34 minutes, 44 seconds)
2025-08-07 03:29:57,095 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:30:12,525 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 3567.03394 ± 1006.574
2025-08-07 03:30:12,525 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1652.5463, 4062.633, 4063.5217, 4125.319, 4145.6216, 3894.6008, 4007.1418, 1469.2173, 4080.7178, 4169.0186]
2025-08-07 03:30:12,526 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:30:12,526 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (3567.03) for latency ExtremeSparseL4U32
2025-08-07 03:30:12,537 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 84/100 (estimated time remaining: 32 minutes, 49 seconds)
2025-08-07 03:31:52,975 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:32:08,257 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2714.86841 ± 990.939
2025-08-07 03:32:08,257 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [4243.354, 2286.2957, 2239.8154, 1513.6702, 2728.9302, 4047.0564, 1609.8339, 1793.765, 4049.2397, 2636.7244]
2025-08-07 03:32:08,258 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:32:08,268 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 85/100 (estimated time remaining: 30 minutes, 53 seconds)
2025-08-07 03:33:48,653 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:34:04,077 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2864.58447 ± 981.393
2025-08-07 03:34:04,077 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1995.0864, 2833.1875, 1894.431, 1453.4595, 3100.0444, 3937.8384, 3079.0557, 1890.6787, 4177.7676, 4284.296]
2025-08-07 03:34:04,077 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:34:04,095 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 86/100 (estimated time remaining: 28 minutes, 57 seconds)
2025-08-07 03:35:44,512 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:35:59,823 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 3107.80249 ± 1108.947
2025-08-07 03:35:59,823 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [4243.8657, 1897.7441, 4156.8325, 4203.263, 1584.7812, 2927.4607, 4059.7844, 4125.63, 1609.7509, 2268.9133]
2025-08-07 03:35:59,823 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:35:59,832 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 87/100 (estimated time remaining: 27 minutes, 1 second)
2025-08-07 03:37:40,221 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:37:55,674 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2152.64722 ± 1036.696
2025-08-07 03:37:55,674 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [4194.7476, 1508.972, 1682.5308, 4178.309, 1659.7831, 1584.9525, 1528.3307, 1491.5068, 2210.405, 1486.936]
2025-08-07 03:37:55,675 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:37:55,681 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 88/100 (estimated time remaining: 25 minutes, 5 seconds)
2025-08-07 03:39:36,120 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:39:51,398 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2953.97290 ± 1175.492
2025-08-07 03:39:51,398 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [4534.3447, 1959.1416, 4053.3337, 3128.7314, 4019.896, 4451.8257, 2355.5957, 1432.9719, 1362.7238, 2241.164]
2025-08-07 03:39:51,398 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:39:51,409 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 89/100 (estimated time remaining: 23 minutes, 9 seconds)
2025-08-07 03:41:31,713 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:41:47,000 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 2174.36597 ± 529.033
2025-08-07 03:41:47,000 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1487.828, 1780.0502, 1932.1475, 3176.7927, 3030.8464, 1959.318, 2085.0676, 2297.4004, 1648.7843, 2345.423]
2025-08-07 03:41:47,000 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:41:47,017 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 90/100 (estimated time remaining: 21 minutes, 13 seconds)
2025-08-07 03:43:27,447 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:43:42,868 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 4201.22119 ± 606.503
2025-08-07 03:43:42,868 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [4548.579, 4086.2947, 4508.429, 2440.0845, 4430.868, 4428.3315, 4479.0024, 4531.3726, 4128.237, 4431.012]
2025-08-07 03:43:42,868 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:43:42,868 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (4201.22) for latency ExtremeSparseL4U32
2025-08-07 03:43:42,875 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 91/100 (estimated time remaining: 19 minutes, 17 seconds)
2025-08-07 03:45:23,555 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:45:38,886 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 3409.41162 ± 1133.710
2025-08-07 03:45:38,886 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [4581.985, 2627.416, 4582.8413, 1587.7708, 4275.804, 2433.3833, 4494.2856, 1825.2954, 4293.315, 3392.0215]
2025-08-07 03:45:38,886 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:45:38,912 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 92/100 (estimated time remaining: 17 minutes, 22 seconds)
2025-08-07 03:47:19,294 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:47:34,601 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 3289.74756 ± 1184.263
2025-08-07 03:47:34,601 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [3085.6423, 2496.6353, 4488.092, 1534.4485, 3929.0586, 4592.972, 2260.9697, 1584.9912, 4374.572, 4550.0947]
2025-08-07 03:47:34,601 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:47:34,609 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 93/100 (estimated time remaining: 15 minutes, 26 seconds)
2025-08-07 03:49:15,042 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:49:30,438 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 3560.05029 ± 1296.212
2025-08-07 03:49:30,438 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [4840.3276, 1570.276, 4426.3926, 3444.0996, 4878.9175, 1599.6377, 1937.7703, 4211.459, 4877.6743, 3813.951]
2025-08-07 03:49:30,438 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:49:30,460 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 94/100 (estimated time remaining: 13 minutes, 30 seconds)
2025-08-07 03:51:10,930 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:51:26,447 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 4196.98242 ± 1300.905
2025-08-07 03:51:26,448 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [4825.473, 4897.7544, 4883.569, 4941.3804, 4823.635, 1717.1678, 4653.1304, 4872.487, 4869.828, 1485.4031]
2025-08-07 03:51:26,448 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:51:26,471 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 95/100 (estimated time remaining: 11 minutes, 35 seconds)
2025-08-07 03:53:07,103 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:53:22,428 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 3548.80005 ± 1138.685
2025-08-07 03:53:22,428 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [4522.619, 2698.961, 4496.8325, 4399.201, 2626.5142, 4502.096, 4438.0645, 1757.4591, 1726.6326, 4319.619]
2025-08-07 03:53:22,428 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:53:22,460 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 96/100 (estimated time remaining: 9 minutes, 39 seconds)
2025-08-07 03:55:02,965 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:55:18,298 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 4204.27832 ± 777.518
2025-08-07 03:55:18,299 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [4417.471, 1880.8732, 4493.806, 4538.255, 4492.39, 4569.24, 4469.3643, 4472.5347, 4317.1084, 4391.7373]
2025-08-07 03:55:18,299 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:55:18,299 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (4204.28) for latency ExtremeSparseL4U32
2025-08-07 03:55:18,314 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 97/100 (estimated time remaining: 7 minutes, 43 seconds)
2025-08-07 03:56:58,808 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:57:14,096 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 4141.91748 ± 1289.912
2025-08-07 03:57:14,097 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [4748.496, 4686.333, 4921.087, 4944.408, 1492.3375, 4850.6016, 4761.1, 4410.5386, 1668.9198, 4935.356]
2025-08-07 03:57:14,097 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:57:14,112 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 98/100 (estimated time remaining: 5 minutes, 47 seconds)
2025-08-07 03:58:54,638 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 03:59:10,061 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 4106.61914 ± 1238.365
2025-08-07 03:59:10,061 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [4726.8228, 1899.3724, 4696.1167, 1385.1989, 4733.3745, 4628.5635, 4818.0396, 4756.642, 4729.9756, 4692.0854]
2025-08-07 03:59:10,061 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 03:59:10,071 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 99/100 (estimated time remaining: 3 minutes, 51 seconds)
2025-08-07 04:00:50,457 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 04:01:05,803 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 4292.88916 ± 1295.640
2025-08-07 04:01:05,803 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [1886.1711, 4858.449, 4930.3325, 4965.097, 1530.037, 5000.1426, 4907.0576, 4914.597, 5024.5444, 4912.4634]
2025-08-07 04:01:05,803 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 04:01:05,803 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (4292.89) for latency ExtremeSparseL4U32
2025-08-07 04:01:05,822 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1199 [INFO]: Iteration 100/100 (estimated time remaining: 1 minute, 55 seconds)
2025-08-07 04:02:46,400 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1214 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-08-07 04:03:01,868 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1221 [DEBUG]: Total Reward: 4894.07910 ± 99.197
2025-08-07 04:03:01,868 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1222 [DEBUG]: All rewards: [4626.5234, 4896.3193, 4921.893, 4904.634, 4958.428, 4912.229, 5020.393, 4852.1567, 4892.9766, 4955.2354]
2025-08-07 04:03:01,868 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1223 [DEBUG]: All trajectory lengths: [1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0, 1000.0]
2025-08-07 04:03:01,868 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1226 [INFO]: New best (4894.08) for latency ExtremeSparseL4U32
2025-08-07 04:03:01,895 latency_env.delayed_mdp:training_loop(baseline-bpql-noiseperc0-halfcheetah):1251 [DEBUG]: Training session finished
