2025-05-08 07:04:36,700 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1006 [DEBUG]: logdir: _logs/benchmark-v3-tc7/noisy-walker2d/ExtremeSparseL4U32-sac
2025-05-08 07:04:36,700 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1007 [DEBUG]: trainer_prefix: benchmark-v3-tc7/noisy-walker2d/ExtremeSparseL4U32-sac
2025-05-08 07:04:36,700 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1008 [DEBUG]: args.trainer_eval_latencies: {'ExtremeSparseL4U32': <latency_env.delayed_mdp.HiddenMarkovianDelay object at 0x7f35fe7c3f10>}
2025-05-08 07:04:36,700 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1009 [DEBUG]: using device: cpu
2025-05-08 07:04:36,703 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1031 [INFO]: Creating new trainer
2025-05-08 07:04:36,709 baseline-sac-noisy-walker2d:111 [DEBUG]: pi network:
NNGaussianPolicy(
  (common_head): Sequential(
    (0): Flatten(start_dim=1, end_dim=-1)
    (1): Linear(in_features=17, out_features=256, bias=True)
    (2): ReLU()
    (3): Linear(in_features=256, out_features=256, bias=True)
    (4): ReLU()
  )
  (mu_head): Sequential(
    (0): Linear(in_features=256, out_features=6, bias=True)
    (1): Unflatten(dim=1, unflattened_size=(6,))
  )
  (log_std_head): Sequential(
    (0): Linear(in_features=256, out_features=6, bias=True)
    (1): Unflatten(dim=1, unflattened_size=(6,))
  )
  (tanh_refit): NNTanhRefit(scale: tensor([[2., 2., 2., 2., 2., 2.]]), shift: tensor([[-1., -1., -1., -1., -1., -1.]]))
)
2025-05-08 07:04:36,709 baseline-sac-noisy-walker2d:112 [DEBUG]: q network:
NNLayerConcat2(
  dim: -1
  (next): Sequential(
    (0): Linear(in_features=23, out_features=256, bias=True)
    (1): ReLU()
    (2): Linear(in_features=256, out_features=256, bias=True)
    (3): ReLU()
    (4): Linear(in_features=256, out_features=1, bias=True)
    (5): NNLayerSqueeze(dim: -1)
  )
  (init_left): Flatten(start_dim=1, end_dim=-1)
  (init_right): Flatten(start_dim=1, end_dim=-1)
)
2025-05-08 07:04:36,864 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1092 [DEBUG]: Starting training session...
2025-05-08 07:04:36,865 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 1/100
2025-05-08 07:06:55,964 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:06:56,191 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 0.96869 ± 4.218
2025-05-08 07:06:56,191 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [-1.8908607, -0.4153703, 0.12888817, -3.2029996, -0.26675585, 11.580572, 0.61416256, -2.7275243, 0.28262913, 5.5841928]
2025-05-08 07:06:56,191 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [18.0, 18.0, 16.0, 16.0, 16.0, 62.0, 25.0, 21.0, 15.0, 17.0]
2025-05-08 07:06:56,191 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1124 [INFO]: New best (0.97) for latency ExtremeSparseL4U32
2025-05-08 07:06:56,191 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1127 [INFO]: saving network
2025-05-08 07:06:56,195 latency_env.training.utils:544 [DEBUG]: Saving evalcopy of SAC to _logs/benchmark-v3-tc7/noisy-walker2d/ExtremeSparseL4U32-sac/checkpoints/best_ExtremeSparseL4U32.pkl
2025-05-08 07:06:56,199 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 2/100 (estimated time remaining: 3 hours, 49 minutes, 54 seconds)
2025-05-08 07:09:24,471 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:09:24,818 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 1.60525 ± 10.018
2025-05-08 07:09:24,818 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [-5.6818137, -9.269128, -1.6335248, -4.6074743, -2.2596996, 21.193705, 9.147357, -5.4661317, 17.62277, -2.9935431]
2025-05-08 07:09:24,818 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [19.0, 34.0, 31.0, 26.0, 21.0, 46.0, 28.0, 38.0, 55.0, 30.0]
2025-05-08 07:09:24,818 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1124 [INFO]: New best (1.61) for latency ExtremeSparseL4U32
2025-05-08 07:09:24,818 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1127 [INFO]: saving network
2025-05-08 07:09:24,821 latency_env.training.utils:544 [DEBUG]: Saving evalcopy of SAC to _logs/benchmark-v3-tc7/noisy-walker2d/ExtremeSparseL4U32-sac/checkpoints/best_ExtremeSparseL4U32.pkl
2025-05-08 07:09:24,826 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 3/100 (estimated time remaining: 3 hours, 55 minutes, 10 seconds)
2025-05-08 07:11:52,997 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:11:53,266 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 5.05798 ± 7.143
2025-05-08 07:11:53,266 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [12.728415, 4.400428, 1.9582804, 3.1985826, 8.589516, 7.598653, 1.730537, 4.304298, 17.16153, -11.090437]
2025-05-08 07:11:53,266 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [36.0, 18.0, 26.0, 21.0, 24.0, 21.0, 14.0, 19.0, 34.0, 43.0]
2025-05-08 07:11:53,267 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1124 [INFO]: New best (5.06) for latency ExtremeSparseL4U32
2025-05-08 07:11:53,267 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1127 [INFO]: saving network
2025-05-08 07:11:53,270 latency_env.training.utils:544 [DEBUG]: Saving evalcopy of SAC to _logs/benchmark-v3-tc7/noisy-walker2d/ExtremeSparseL4U32-sac/checkpoints/best_ExtremeSparseL4U32.pkl
2025-05-08 07:11:53,275 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 4/100 (estimated time remaining: 3 hours, 55 minutes, 10 seconds)
2025-05-08 07:14:22,140 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:14:22,399 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 4.66754 ± 4.910
2025-05-08 07:14:22,400 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [5.798472, 15.630292, 0.91520953, 1.4083757, 2.6917455, 1.6566749, 10.680099, 2.0011227, -1.0998688, 6.993287]
2025-05-08 07:14:22,400 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [18.0, 31.0, 19.0, 26.0, 21.0, 26.0, 31.0, 27.0, 24.0, 22.0]
2025-05-08 07:14:22,401 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 5/100 (estimated time remaining: 3 hours, 54 minutes, 12 seconds)
2025-05-08 07:16:50,263 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:16:50,550 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 8.52131 ± 6.429
2025-05-08 07:16:50,550 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [9.217864, 13.386108, 4.067981, 4.2604575, -4.808882, 13.799196, 3.3629181, 9.523552, 16.125378, 16.278496]
2025-05-08 07:16:50,551 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [35.0, 37.0, 21.0, 20.0, 21.0, 25.0, 26.0, 20.0, 30.0, 44.0]
2025-05-08 07:16:50,551 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1124 [INFO]: New best (8.52) for latency ExtremeSparseL4U32
2025-05-08 07:16:50,551 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1127 [INFO]: saving network
2025-05-08 07:16:50,554 latency_env.training.utils:544 [DEBUG]: Saving evalcopy of SAC to _logs/benchmark-v3-tc7/noisy-walker2d/ExtremeSparseL4U32-sac/checkpoints/best_ExtremeSparseL4U32.pkl
2025-05-08 07:16:50,559 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 6/100 (estimated time remaining: 3 hours, 52 minutes, 20 seconds)
2025-05-08 07:19:18,229 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:19:18,499 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 8.27771 ± 7.609
2025-05-08 07:19:18,499 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [18.22786, 4.0086284, 15.419087, 5.771821, 5.6566577, -5.2673054, 16.058275, 4.3215923, 17.5351, 1.0454254]
2025-05-08 07:19:18,499 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [33.0, 15.0, 30.0, 28.0, 32.0, 21.0, 32.0, 24.0, 32.0, 14.0]
2025-05-08 07:19:18,500 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 7/100 (estimated time remaining: 3 hours, 52 minutes, 35 seconds)
2025-05-08 07:21:47,768 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:21:48,113 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 2.90120 ± 9.216
2025-05-08 07:21:48,113 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [7.0218825, 6.8580136, -23.55884, 7.4344797, 0.9631573, 8.505441, 9.176191, 3.8463786, 1.5344231, 7.2308245]
2025-05-08 07:21:48,113 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [20.0, 29.0, 65.0, 34.0, 14.0, 36.0, 38.0, 38.0, 24.0, 34.0]
2025-05-08 07:21:48,115 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 8/100 (estimated time remaining: 3 hours, 50 minutes, 25 seconds)
2025-05-08 07:24:18,351 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:24:18,637 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 8.05181 ± 5.322
2025-05-08 07:24:18,637 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [9.463675, 9.232482, 9.767985, -2.775399, 2.5478988, 3.9558012, 8.194475, 13.844447, 16.828712, 9.458002]
2025-05-08 07:24:18,637 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [21.0, 18.0, 31.0, 20.0, 29.0, 28.0, 34.0, 42.0, 28.0, 21.0]
2025-05-08 07:24:18,639 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 9/100 (estimated time remaining: 3 hours, 48 minutes, 34 seconds)
2025-05-08 07:26:48,680 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:26:49,135 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 16.58915 ± 16.138
2025-05-08 07:26:49,135 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [2.820163, 8.455323, 8.97338, 25.193974, 30.262949, 37.722965, 3.172984, 36.02476, -13.700791, 26.965746]
2025-05-08 07:26:49,135 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [24.0, 41.0, 42.0, 43.0, 53.0, 60.0, 22.0, 60.0, 46.0, 35.0]
2025-05-08 07:26:49,135 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1124 [INFO]: New best (16.59) for latency ExtremeSparseL4U32
2025-05-08 07:26:49,135 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1127 [INFO]: saving network
2025-05-08 07:26:49,139 latency_env.training.utils:544 [DEBUG]: Saving evalcopy of SAC to _logs/benchmark-v3-tc7/noisy-walker2d/ExtremeSparseL4U32-sac/checkpoints/best_ExtremeSparseL4U32.pkl
2025-05-08 07:26:49,144 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 10/100 (estimated time remaining: 3 hours, 46 minutes, 30 seconds)
2025-05-08 07:29:19,970 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:29:20,288 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 8.12060 ± 9.702
2025-05-08 07:29:20,288 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [10.317787, 7.5641837, -7.44459, 10.0859375, 1.2165288, 19.240974, 8.521087, 2.0476305, 28.821348, 0.83512765]
2025-05-08 07:29:20,288 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [26.0, 23.0, 39.0, 34.0, 26.0, 37.0, 27.0, 11.0, 59.0, 28.0]
2025-05-08 07:29:20,290 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 11/100 (estimated time remaining: 3 hours, 44 minutes, 55 seconds)
2025-05-08 07:31:50,544 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:31:50,900 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 3.18423 ± 8.660
2025-05-08 07:31:50,900 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [-2.574899, -9.190531, 10.609313, -2.5699372, 17.368853, 8.971993, 5.557681, 11.896351, 1.0150915, -9.241568]
2025-05-08 07:31:50,900 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [25.0, 29.0, 39.0, 31.0, 51.0, 48.0, 19.0, 34.0, 23.0, 39.0]
2025-05-08 07:31:50,902 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 12/100 (estimated time remaining: 3 hours, 43 minutes, 12 seconds)
2025-05-08 07:34:20,106 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:34:20,507 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 15.39422 ± 17.577
2025-05-08 07:34:20,507 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [3.5133305, 2.315186, 0.46234304, 17.563974, 1.8011211, 54.23765, 38.79996, 3.1772735, 7.142114, 24.929213]
2025-05-08 07:34:20,507 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [26.0, 34.0, 26.0, 47.0, 19.0, 81.0, 63.0, 15.0, 23.0, 45.0]
2025-05-08 07:34:20,509 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 13/100 (estimated time remaining: 3 hours, 40 minutes, 42 seconds)
2025-05-08 07:36:48,745 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:36:49,042 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 8.02119 ± 10.377
2025-05-08 07:36:49,042 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [7.611014, 7.613666, 2.7891624, 5.1977286, 4.929935, 38.5596, 0.98029447, 5.6701303, 2.4828825, 4.377526]
2025-05-08 07:36:49,042 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [23.0, 21.0, 14.0, 24.0, 30.0, 55.0, 24.0, 34.0, 41.0, 22.0]
2025-05-08 07:36:49,044 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 14/100 (estimated time remaining: 3 hours, 37 minutes, 37 seconds)
2025-05-08 07:39:17,549 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:39:17,825 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 2.58212 ± 6.014
2025-05-08 07:39:17,825 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [0.2147236, 6.6393104, 4.6247807, -3.838971, 15.7745495, 2.7238357, -0.21223758, 1.9021238, 5.561836, -7.5687623]
2025-05-08 07:39:17,826 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [20.0, 25.0, 20.0, 22.0, 39.0, 32.0, 25.0, 20.0, 35.0, 29.0]
2025-05-08 07:39:17,828 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 15/100 (estimated time remaining: 3 hours, 34 minutes, 37 seconds)
2025-05-08 07:41:47,577 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:41:47,929 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 7.34943 ± 13.331
2025-05-08 07:41:47,929 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [3.726547, 1.5116982, -8.072017, -4.2599764, -5.5993958, 31.362768, 26.493876, 21.791395, 4.7997484, 1.7396427]
2025-05-08 07:41:47,929 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [32.0, 26.0, 40.0, 34.0, 25.0, 43.0, 38.0, 53.0, 18.0, 26.0]
2025-05-08 07:41:47,931 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 16/100 (estimated time remaining: 3 hours, 31 minutes, 49 seconds)
2025-05-08 07:44:17,612 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:44:17,893 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 0.96165 ± 5.141
2025-05-08 07:44:17,893 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [-1.2026324, -11.962865, 2.566201, 8.100608, 5.9157495, 2.2119563, -0.7160397, 0.59376216, 0.113657005, 3.9960847]
2025-05-08 07:44:17,893 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [25.0, 27.0, 22.0, 26.0, 23.0, 29.0, 28.0, 28.0, 35.0, 20.0]
2025-05-08 07:44:17,895 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 17/100 (estimated time remaining: 3 hours, 29 minutes, 9 seconds)
2025-05-08 07:46:49,004 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:46:49,318 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 10.65815 ± 11.503
2025-05-08 07:46:49,318 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [8.148186, -4.537983, 0.63084674, 32.89735, 11.444076, 19.03266, 27.073742, 6.184436, 4.958325, 0.74981976]
2025-05-08 07:46:49,318 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [17.0, 27.0, 21.0, 63.0, 22.0, 30.0, 40.0, 19.0, 35.0, 26.0]
2025-05-08 07:46:49,321 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 18/100 (estimated time remaining: 3 hours, 27 minutes, 10 seconds)
2025-05-08 07:49:17,576 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:49:17,778 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: -0.39062 ± 1.500
2025-05-08 07:49:17,778 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [0.70952094, 0.75606334, 0.4900401, -2.7946727, -0.8889908, 0.7966833, -1.5802944, -1.3150263, 2.110718, -2.190253]
2025-05-08 07:49:17,778 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [29.0, 14.0, 15.0, 14.0, 26.0, 25.0, 18.0, 13.0, 20.0, 20.0]
2025-05-08 07:49:17,780 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 19/100 (estimated time remaining: 3 hours, 24 minutes, 39 seconds)
2025-05-08 07:51:46,851 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:51:47,298 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 30.24439 ± 53.419
2025-05-08 07:51:47,298 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [7.616404, 59.743317, 7.568694, 3.8747973, 5.006305, 9.574735, 3.9380338, 181.68457, -5.1257696, 28.562798]
2025-05-08 07:51:47,298 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [17.0, 89.0, 18.0, 16.0, 24.0, 28.0, 31.0, 126.0, 44.0, 52.0]
2025-05-08 07:51:47,298 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1124 [INFO]: New best (30.24) for latency ExtremeSparseL4U32
2025-05-08 07:51:47,298 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1127 [INFO]: saving network
2025-05-08 07:51:47,302 latency_env.training.utils:544 [DEBUG]: Saving evalcopy of SAC to _logs/benchmark-v3-tc7/noisy-walker2d/ExtremeSparseL4U32-sac/checkpoints/best_ExtremeSparseL4U32.pkl
2025-05-08 07:51:47,309 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 20/100 (estimated time remaining: 3 hours, 22 minutes, 21 seconds)
2025-05-08 07:54:16,004 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:54:16,176 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: -1.64510 ± 4.877
2025-05-08 07:54:16,176 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [1.0155933, -6.9106417, -3.594605, -5.5892115, 9.471281, -3.7276435, 0.8242933, -1.2862229, -8.010429, 1.3566302]
2025-05-08 07:54:16,177 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [19.0, 17.0, 17.0, 17.0, 19.0, 17.0, 14.0, 18.0, 18.0, 20.0]
2025-05-08 07:54:16,179 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 21/100 (estimated time remaining: 3 hours, 19 minutes, 31 seconds)
2025-05-08 07:56:44,710 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:56:45,026 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 10.54615 ± 11.057
2025-05-08 07:56:45,026 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [34.72932, 9.7279625, 5.891482, 28.663115, 2.6686242, -0.7789731, 8.573322, 3.2393649, 4.825308, 7.9220047]
2025-05-08 07:56:45,026 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [55.0, 38.0, 21.0, 45.0, 16.0, 47.0, 26.0, 21.0, 17.0, 17.0]
2025-05-08 07:56:45,029 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 22/100 (estimated time remaining: 3 hours, 16 minutes, 44 seconds)
2025-05-08 07:59:14,415 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 07:59:14,673 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 6.79054 ± 7.185
2025-05-08 07:59:14,673 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [2.5531094, 13.288014, -1.8629178, 4.325202, 5.794072, 20.428423, 1.4927753, 17.592323, 2.5176306, 1.7767284]
2025-05-08 07:59:14,673 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [17.0, 32.0, 27.0, 13.0, 30.0, 44.0, 15.0, 37.0, 17.0, 14.0]
2025-05-08 07:59:14,676 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 23/100 (estimated time remaining: 3 hours, 13 minutes, 47 seconds)
2025-05-08 08:01:43,714 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:01:44,019 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 7.54860 ± 5.746
2025-05-08 08:01:44,019 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [15.672676, 15.807234, 10.906882, -1.0729845, 1.593353, 8.629125, 1.2235445, 5.33457, 12.3137245, 5.077896]
2025-05-08 08:01:44,019 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [47.0, 33.0, 24.0, 17.0, 22.0, 33.0, 26.0, 30.0, 30.0, 33.0]
2025-05-08 08:01:44,022 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 24/100 (estimated time remaining: 3 hours, 11 minutes, 32 seconds)
2025-05-08 08:04:12,682 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:04:12,965 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 7.36226 ± 10.592
2025-05-08 08:04:12,965 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [1.0117934, -1.4339473, 0.8577542, 4.9056344, 28.849215, 17.372505, 22.403618, 0.06655233, -0.18992993, -0.22057547]
2025-05-08 08:04:12,965 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [13.0, 19.0, 20.0, 28.0, 45.0, 36.0, 45.0, 17.0, 27.0, 31.0]
2025-05-08 08:04:12,968 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 25/100 (estimated time remaining: 3 hours, 8 minutes, 54 seconds)
2025-05-08 08:06:41,687 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:06:42,107 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 8.19349 ± 10.784
2025-05-08 08:06:42,107 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [-1.0674628, 0.20986202, 2.3100545, 17.220678, 13.605388, 4.5329475, 4.7828503, 6.77314, -1.8356503, 35.403057]
2025-05-08 08:06:42,108 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [67.0, 28.0, 32.0, 32.0, 26.0, 31.0, 23.0, 70.0, 31.0, 62.0]
2025-05-08 08:06:42,111 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 26/100 (estimated time remaining: 3 hours, 6 minutes, 28 seconds)
2025-05-08 08:09:12,135 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:09:12,551 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 6.29986 ± 6.687
2025-05-08 08:09:12,551 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [1.4800695, 4.179281, 1.3462834, 11.788094, 11.388359, 3.33619, 3.6009047, 11.074709, -4.794807, 19.599487]
2025-05-08 08:09:12,551 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [40.0, 33.0, 33.0, 46.0, 36.0, 26.0, 23.0, 40.0, 33.0, 88.0]
2025-05-08 08:09:12,555 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 27/100 (estimated time remaining: 3 hours, 4 minutes, 23 seconds)
2025-05-08 08:11:41,622 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:11:41,901 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 5.88021 ± 6.255
2025-05-08 08:11:41,901 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [11.342668, 13.33144, 11.240836, -0.843513, -0.33591655, -4.558961, 13.296813, 3.2260487, 2.716312, 9.386362]
2025-05-08 08:11:41,901 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [49.0, 39.0, 27.0, 23.0, 15.0, 21.0, 33.0, 20.0, 23.0, 24.0]
2025-05-08 08:11:41,904 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 28/100 (estimated time remaining: 3 hours, 1 minute, 49 seconds)
2025-05-08 08:14:11,076 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:14:11,338 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 1.49008 ± 2.706
2025-05-08 08:14:11,338 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [0.2639474, 3.3876212, -0.40661648, 3.6874506, 5.258945, -3.4041216, -1.3062499, 2.657182, 4.7021666, 0.060436193]
2025-05-08 08:14:11,338 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [21.0, 30.0, 24.0, 29.0, 31.0, 29.0, 19.0, 14.0, 20.0, 34.0]
2025-05-08 08:14:11,341 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 29/100 (estimated time remaining: 2 hours, 59 minutes, 21 seconds)
2025-05-08 08:16:40,580 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:16:40,864 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 10.66906 ± 10.034
2025-05-08 08:16:40,864 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [5.6523256, 16.08684, 7.1637006, 10.622364, 1.9363937, 5.226936, 38.6976, 4.762703, 9.294232, 7.2475376]
2025-05-08 08:16:40,864 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [28.0, 35.0, 18.0, 27.0, 13.0, 25.0, 49.0, 23.0, 30.0, 19.0]
2025-05-08 08:16:40,867 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 30/100 (estimated time remaining: 2 hours, 57 minutes)
2025-05-08 08:19:10,217 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:19:10,609 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 14.89903 ± 15.856
2025-05-08 08:19:10,609 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [4.0546813, 13.908164, 8.836472, 12.435352, 7.0046954, 60.34853, 5.0301123, 8.505198, 7.8791447, 20.98794]
2025-05-08 08:19:10,609 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [17.0, 47.0, 36.0, 29.0, 24.0, 100.0, 35.0, 31.0, 22.0, 36.0]
2025-05-08 08:19:10,612 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 31/100 (estimated time remaining: 2 hours, 54 minutes, 39 seconds)
2025-05-08 08:21:39,682 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:21:39,984 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 11.50896 ± 6.828
2025-05-08 08:21:39,984 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [12.071427, 6.1310434, 0.9995595, 11.022057, 15.369233, 12.696171, 26.004374, 10.33381, 3.3319786, 17.129995]
2025-05-08 08:21:39,984 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [27.0, 16.0, 19.0, 46.0, 30.0, 32.0, 46.0, 31.0, 26.0, 27.0]
2025-05-08 08:21:39,988 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 32/100 (estimated time remaining: 2 hours, 51 minutes, 54 seconds)
2025-05-08 08:24:08,433 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:24:08,676 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 3.88426 ± 9.329
2025-05-08 08:24:08,676 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [-3.681944, 0.88623214, -5.7681217, 1.9320695, -6.741161, 0.026344763, 1.1458327, 22.945593, 13.087461, 15.010258]
2025-05-08 08:24:08,676 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [22.0, 17.0, 18.0, 22.0, 19.0, 28.0, 16.0, 42.0, 23.0, 27.0]
2025-05-08 08:24:08,679 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 33/100 (estimated time remaining: 2 hours, 49 minutes, 16 seconds)
2025-05-08 08:26:36,769 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:26:37,018 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 2.63291 ± 8.166
2025-05-08 08:26:37,018 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [-3.026452, 5.203161, 2.6499262, 0.638859, -0.7371194, 1.3719268, 25.897173, -2.5988157, 0.4504208, -3.5199327]
2025-05-08 08:26:37,018 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [16.0, 15.0, 24.0, 28.0, 17.0, 17.0, 52.0, 30.0, 19.0, 20.0]
2025-05-08 08:26:37,021 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 34/100 (estimated time remaining: 2 hours, 46 minutes, 32 seconds)
2025-05-08 08:29:05,548 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:29:05,825 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 5.62596 ± 13.527
2025-05-08 08:29:05,825 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [39.96281, 1.9584593, 0.7408128, 3.832913, 1.36707, -13.418219, 18.517462, 1.6441236, 1.6414384, 0.012761205]
2025-05-08 08:29:05,826 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [73.0, 14.0, 16.0, 18.0, 28.0, 36.0, 36.0, 18.0, 15.0, 18.0]
2025-05-08 08:29:05,829 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 35/100 (estimated time remaining: 2 hours, 43 minutes, 53 seconds)
2025-05-08 08:31:34,630 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:31:34,951 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 10.42808 ± 8.236
2025-05-08 08:31:34,952 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [3.955565, 20.358164, 6.7964816, 22.312908, 10.543986, 6.5639515, 21.920475, 1.6491807, 12.239481, -2.0593665]
2025-05-08 08:31:34,952 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [16.0, 37.0, 17.0, 39.0, 29.0, 20.0, 36.0, 51.0, 20.0, 43.0]
2025-05-08 08:31:34,956 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 36/100 (estimated time remaining: 2 hours, 41 minutes, 16 seconds)
2025-05-08 08:34:02,333 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:34:02,735 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 13.96878 ± 21.665
2025-05-08 08:34:02,735 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [4.7157135, 8.16483, 11.767171, 8.479313, -2.8064318, 15.399896, -1.0183572, 11.3636875, 6.638097, 76.98387]
2025-05-08 08:34:02,735 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [17.0, 16.0, 35.0, 38.0, 26.0, 38.0, 15.0, 44.0, 32.0, 126.0]
2025-05-08 08:34:02,739 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 37/100 (estimated time remaining: 2 hours, 38 minutes, 27 seconds)
2025-05-08 08:36:30,875 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:36:31,182 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 5.26381 ± 4.354
2025-05-08 08:36:31,182 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [11.2486315, 2.8399818, 9.062081, 4.257352, 0.22800446, 9.944115, 1.0330863, 3.839965, 10.802089, -0.6171595]
2025-05-08 08:36:31,182 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [22.0, 29.0, 32.0, 18.0, 29.0, 32.0, 30.0, 27.0, 38.0, 35.0]
2025-05-08 08:36:31,186 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 38/100 (estimated time remaining: 2 hours, 35 minutes, 55 seconds)
2025-05-08 08:38:59,937 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:39:00,246 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 8.22390 ± 8.325
2025-05-08 08:39:00,246 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [4.8314295, 1.3772119, 12.03578, 2.6011992, 3.0194864, 14.441468, 12.125739, 4.4950542, -1.0860707, 28.39767]
2025-05-08 08:39:00,246 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [27.0, 29.0, 35.0, 27.0, 16.0, 34.0, 38.0, 17.0, 16.0, 59.0]
2025-05-08 08:39:00,250 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 39/100 (estimated time remaining: 2 hours, 33 minutes, 36 seconds)
2025-05-08 08:41:30,145 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:41:30,413 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 5.92401 ± 7.971
2025-05-08 08:41:30,413 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [3.7498512, 7.0962887, 15.252872, 22.798542, 4.547818, 0.31119317, -0.5062486, -3.4406793, 11.500033, -2.0695608]
2025-05-08 08:41:30,413 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [13.0, 32.0, 29.0, 45.0, 22.0, 23.0, 20.0, 21.0, 25.0, 26.0]
2025-05-08 08:41:30,418 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 40/100 (estimated time remaining: 2 hours, 31 minutes, 23 seconds)
2025-05-08 08:43:57,315 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:43:57,574 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 7.75329 ± 7.689
2025-05-08 08:43:57,574 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [17.475813, 16.401133, 3.5777977, 12.43205, 2.4816263, 4.11684, 1.085934, 0.72032183, -1.348075, 20.589424]
2025-05-08 08:43:57,574 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [42.0, 23.0, 18.0, 31.0, 15.0, 23.0, 16.0, 16.0, 20.0, 45.0]
2025-05-08 08:43:57,579 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 41/100 (estimated time remaining: 2 hours, 28 minutes, 31 seconds)
2025-05-08 08:46:25,664 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:46:25,903 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 6.40271 ± 8.392
2025-05-08 08:46:25,903 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [0.76670575, -0.9375698, 7.6807766, 24.793509, 18.929272, 0.9196048, 1.5122993, 7.490086, -1.5062245, 4.378596]
2025-05-08 08:46:25,903 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [17.0, 14.0, 35.0, 38.0, 38.0, 15.0, 17.0, 17.0, 15.0, 31.0]
2025-05-08 08:46:25,908 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 42/100 (estimated time remaining: 2 hours, 26 minutes, 9 seconds)
2025-05-08 08:48:53,214 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:48:53,446 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 6.97649 ± 5.465
2025-05-08 08:48:53,446 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [20.826578, 6.523967, 2.591817, 5.0885415, 1.9049399, 6.5636353, 5.0395036, 4.706481, 13.042039, 3.4774234]
2025-05-08 08:48:53,446 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [33.0, 24.0, 15.0, 18.0, 15.0, 29.0, 18.0, 17.0, 37.0, 17.0]
2025-05-08 08:48:53,451 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 43/100 (estimated time remaining: 2 hours, 23 minutes, 30 seconds)
2025-05-08 08:51:21,258 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:51:21,624 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 10.19168 ± 15.299
2025-05-08 08:51:21,624 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [14.709416, 8.803274, 2.4783156, 5.6237645, -0.4453673, 1.2223861, 54.395565, 3.4425926, 3.9637842, 7.7230897]
2025-05-08 08:51:21,624 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [32.0, 22.0, 28.0, 25.0, 21.0, 20.0, 128.0, 21.0, 36.0, 19.0]
2025-05-08 08:51:21,630 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 44/100 (estimated time remaining: 2 hours, 20 minutes, 51 seconds)
2025-05-08 08:53:49,217 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:53:49,536 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 12.17424 ± 12.761
2025-05-08 08:53:49,536 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [6.691014, 16.933754, 8.897791, 7.9893217, -0.03246361, 28.42783, 9.66182, 11.59207, -7.6784887, 39.25978]
2025-05-08 08:53:49,536 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [30.0, 38.0, 21.0, 19.0, 21.0, 48.0, 19.0, 25.0, 18.0, 66.0]
2025-05-08 08:53:49,541 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 45/100 (estimated time remaining: 2 hours, 17 minutes, 58 seconds)
2025-05-08 08:56:17,771 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:56:18,097 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 12.72506 ± 9.523
2025-05-08 08:56:18,097 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [20.306719, 3.4488912, 7.220876, 13.555575, 7.1879606, 22.08473, 7.4768615, -3.088839, 29.906195, 19.15166]
2025-05-08 08:56:18,097 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [41.0, 16.0, 17.0, 33.0, 21.0, 41.0, 17.0, 38.0, 46.0, 42.0]
2025-05-08 08:56:18,102 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 46/100 (estimated time remaining: 2 hours, 15 minutes, 45 seconds)
2025-05-08 08:58:45,531 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 08:58:45,852 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 11.76008 ± 11.711
2025-05-08 08:58:45,853 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [15.076053, -9.266506, 19.816414, 36.76641, 18.645449, 2.4464521, 10.584021, 8.584377, 2.694083, 12.254007]
2025-05-08 08:58:45,853 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [38.0, 17.0, 30.0, 62.0, 35.0, 16.0, 32.0, 31.0, 18.0, 32.0]
2025-05-08 08:58:45,858 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 47/100 (estimated time remaining: 2 hours, 13 minutes, 11 seconds)
2025-05-08 09:01:13,083 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:01:13,296 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 7.52546 ± 10.996
2025-05-08 09:01:13,296 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [3.8904986, 3.0228086, 3.047526, 40.24531, 2.1030238, 3.6611793, 3.198472, 3.4714224, 5.172606, 7.4417276]
2025-05-08 09:01:13,296 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [18.0, 16.0, 18.0, 56.0, 16.0, 16.0, 16.0, 16.0, 16.0, 18.0]
2025-05-08 09:01:13,301 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 48/100 (estimated time remaining: 2 hours, 10 minutes, 42 seconds)
2025-05-08 09:03:41,575 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:03:41,814 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 1.88458 ± 2.649
2025-05-08 09:03:41,814 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [3.8657815, 1.0878567, 4.676861, 1.5270929, 1.088075, 0.64401716, -0.58488935, 7.833047, -1.4279711, 0.1359112]
2025-05-08 09:03:41,814 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [33.0, 18.0, 17.0, 24.0, 17.0, 28.0, 32.0, 23.0, 18.0, 18.0]
2025-05-08 09:03:41,819 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 49/100 (estimated time remaining: 2 hours, 8 minutes, 17 seconds)
2025-05-08 09:06:12,071 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:06:12,395 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 6.50116 ± 9.098
2025-05-08 09:06:12,396 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [-3.9576712, 6.70154, -7.0612445, 21.584904, 20.911917, 13.133227, 1.8995459, 0.8996058, 4.99561, 5.9041686]
2025-05-08 09:06:12,396 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [29.0, 31.0, 13.0, 35.0, 39.0, 65.0, 24.0, 32.0, 17.0, 18.0]
2025-05-08 09:06:12,401 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 50/100 (estimated time remaining: 2 hours, 6 minutes, 17 seconds)
2025-05-08 09:08:41,596 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:08:41,986 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 19.58304 ± 54.956
2025-05-08 09:08:41,986 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [3.514338, 184.15277, -7.243801, 2.161111, -0.1656395, 1.037261, 2.2678993, 5.0066385, 4.8649426, 0.23486924]
2025-05-08 09:08:41,986 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [28.0, 148.0, 34.0, 18.0, 28.0, 21.0, 18.0, 29.0, 26.0, 18.0]
2025-05-08 09:08:41,991 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 51/100 (estimated time remaining: 2 hours, 3 minutes, 58 seconds)
2025-05-08 09:11:11,930 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:11:12,377 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 27.15671 ± 50.948
2025-05-08 09:11:12,377 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [2.862531, 1.8139925, 2.145507, -7.157202, 162.6381, 79.88835, 2.897094, 3.4723206, 20.058693, 2.947731]
2025-05-08 09:11:12,377 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [33.0, 17.0, 17.0, 21.0, 167.0, 81.0, 15.0, 15.0, 40.0, 21.0]
2025-05-08 09:11:12,383 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 52/100 (estimated time remaining: 2 hours, 1 minute, 55 seconds)
2025-05-08 09:13:42,112 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:13:42,374 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: -0.99229 ± 4.276
2025-05-08 09:13:42,374 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [-0.28341445, -0.22326231, -4.715635, 10.213267, -4.432435, -0.8332341, -1.11133, -5.396924, -3.8437757, 0.70382255]
2025-05-08 09:13:42,374 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [25.0, 18.0, 29.0, 39.0, 30.0, 18.0, 27.0, 27.0, 19.0, 19.0]
2025-05-08 09:13:42,379 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 53/100 (estimated time remaining: 1 hour, 59 minutes, 51 seconds)
2025-05-08 09:16:11,013 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:16:11,306 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 0.57319 ± 2.964
2025-05-08 09:16:11,306 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [1.8267908, -3.4651918, 1.9896421, 0.4333668, -3.982375, -0.11083773, 6.5147247, 3.4116309, -1.2510941, 0.3652234]
2025-05-08 09:16:11,306 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [24.0, 31.0, 31.0, 28.0, 27.0, 25.0, 27.0, 26.0, 47.0, 17.0]
2025-05-08 09:16:11,312 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 54/100 (estimated time remaining: 1 hour, 57 minutes, 25 seconds)
2025-05-08 09:18:39,934 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:18:40,125 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: -0.88158 ± 1.679
2025-05-08 09:18:40,126 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [-2.2382603, -0.7353493, 0.96057063, -1.3156797, -1.421501, 0.12897377, 2.524685, -0.83860487, -3.7660646, -2.1145666]
2025-05-08 09:18:40,126 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [16.0, 24.0, 15.0, 17.0, 18.0, 26.0, 19.0, 18.0, 14.0, 15.0]
2025-05-08 09:18:40,131 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 55/100 (estimated time remaining: 1 hour, 54 minutes, 39 seconds)
2025-05-08 09:21:08,559 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:21:08,877 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 3.99048 ± 8.006
2025-05-08 09:21:08,877 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [5.0003905, 4.396567, -4.269074, -0.2245008, 8.556951, -0.19190471, -10.192629, 19.060417, 13.319313, 4.449273]
2025-05-08 09:21:08,878 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [24.0, 21.0, 26.0, 17.0, 29.0, 25.0, 41.0, 48.0, 41.0, 26.0]
2025-05-08 09:21:08,883 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 56/100 (estimated time remaining: 1 hour, 52 minutes, 2 seconds)
2025-05-08 09:23:38,054 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:23:38,365 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 7.62829 ± 7.760
2025-05-08 09:23:38,365 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [6.103211, 3.778737, 11.777234, 4.111302, 4.83898, 0.8368558, 28.076414, 12.459938, 1.9931766, 2.307005]
2025-05-08 09:23:38,365 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [33.0, 16.0, 55.0, 15.0, 16.0, 24.0, 58.0, 30.0, 26.0, 25.0]
2025-05-08 09:23:38,371 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 57/100 (estimated time remaining: 1 hour, 49 minutes, 24 seconds)
2025-05-08 09:26:07,395 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:26:07,661 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 2.45506 ± 9.770
2025-05-08 09:26:07,661 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [0.32013673, 2.2534204, -2.6088548, 30.709047, -0.3833442, -3.1329446, 5.0759363, -0.9496437, -3.8679278, -2.865186]
2025-05-08 09:26:07,661 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [16.0, 17.0, 22.0, 60.0, 24.0, 16.0, 23.0, 32.0, 24.0, 19.0]
2025-05-08 09:26:07,667 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 58/100 (estimated time remaining: 1 hour, 46 minutes, 49 seconds)
2025-05-08 09:28:36,790 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:28:37,039 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 4.62581 ± 9.792
2025-05-08 09:28:37,039 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [23.816597, -4.422702, -3.7633326, 2.6895268, 2.9951468, -4.9135594, 0.27551112, 2.0242455, 22.373005, 5.1836605]
2025-05-08 09:28:37,039 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [52.0, 19.0, 17.0, 16.0, 21.0, 17.0, 19.0, 14.0, 33.0, 26.0]
2025-05-08 09:28:37,045 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 59/100 (estimated time remaining: 1 hour, 44 minutes, 24 seconds)
2025-05-08 09:31:07,440 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:31:07,881 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 24.10621 ± 22.558
2025-05-08 09:31:07,881 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [11.040238, 4.060942, 18.150131, 30.041014, 33.88649, 26.980646, 84.67652, 17.386349, 13.373738, 1.4660627]
2025-05-08 09:31:07,881 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [32.0, 18.0, 46.0, 73.0, 48.0, 47.0, 70.0, 31.0, 29.0, 27.0]
2025-05-08 09:31:07,887 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 60/100 (estimated time remaining: 1 hour, 42 minutes, 11 seconds)
2025-05-08 09:33:37,005 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:33:37,291 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 10.26697 ± 8.826
2025-05-08 09:33:37,291 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [6.631704, -1.3552269, -0.7604047, 6.136004, 0.8831948, 14.161808, 20.471941, 25.317776, 16.41775, 14.765179]
2025-05-08 09:33:37,291 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [16.0, 29.0, 26.0, 26.0, 19.0, 28.0, 33.0, 36.0, 29.0, 36.0]
2025-05-08 09:33:37,297 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 61/100 (estimated time remaining: 1 hour, 39 minutes, 47 seconds)
2025-05-08 09:36:06,732 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:36:07,084 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 24.01119 ± 49.790
2025-05-08 09:36:07,084 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [2.593107, 170.6522, 3.470729, 34.329952, 0.07031641, 6.1421027, 6.302813, -0.18754263, 5.2749715, 11.463258]
2025-05-08 09:36:07,084 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [19.0, 98.0, 18.0, 59.0, 17.0, 20.0, 28.0, 20.0, 25.0, 32.0]
2025-05-08 09:36:07,090 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 62/100 (estimated time remaining: 1 hour, 37 minutes, 20 seconds)
2025-05-08 09:38:35,195 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:38:35,594 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 17.55487 ± 17.830
2025-05-08 09:38:35,595 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [9.465702, 7.5555453, 20.437357, 7.37532, 6.909646, 2.6001105, 15.069567, 41.786404, 59.95993, 4.3891077]
2025-05-08 09:38:35,595 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [43.0, 16.0, 38.0, 19.0, 22.0, 30.0, 31.0, 66.0, 100.0, 18.0]
2025-05-08 09:38:35,601 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 63/100 (estimated time remaining: 1 hour, 34 minutes, 44 seconds)
2025-05-08 09:41:04,723 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:41:05,033 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 15.83753 ± 30.412
2025-05-08 09:41:05,033 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [7.8988223, 0.6264917, 6.464387, -0.32296327, 13.327749, 104.70059, 21.149721, 2.2259736, -4.206349, 6.5108786]
2025-05-08 09:41:05,034 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [31.0, 16.0, 20.0, 19.0, 37.0, 78.0, 43.0, 13.0, 23.0, 22.0]
2025-05-08 09:41:05,040 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 64/100 (estimated time remaining: 1 hour, 32 minutes, 15 seconds)
2025-05-08 09:43:32,195 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:43:32,510 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 14.93954 ± 18.115
2025-05-08 09:43:32,510 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [31.363369, 16.011467, 53.10006, 29.357838, -2.876992, 23.836246, 1.9378917, 1.1462895, -2.6865456, -1.7942679]
2025-05-08 09:43:32,511 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [45.0, 46.0, 63.0, 38.0, 11.0, 44.0, 19.0, 18.0, 12.0, 10.0]
2025-05-08 09:43:32,518 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 65/100 (estimated time remaining: 1 hour, 29 minutes, 21 seconds)
2025-05-08 09:45:59,334 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:45:59,587 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 15.44235 ± 53.892
2025-05-08 09:45:59,587 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [-2.8286028, -2.6542811, -3.1274958, -2.8699071, -2.7849464, 1.3993086, -3.6767967, -3.283675, 177.06778, -2.8179007]
2025-05-08 09:45:59,588 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [11.0, 10.0, 10.0, 12.0, 11.0, 18.0, 10.0, 10.0, 138.0, 10.0]
2025-05-08 09:45:59,594 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 66/100 (estimated time remaining: 1 hour, 26 minutes, 36 seconds)
2025-05-08 09:48:27,005 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:48:27,378 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 10.45646 ± 18.609
2025-05-08 09:48:27,378 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [4.75158, -4.8596463, 11.971062, 2.959708, 64.489006, 12.369433, 2.482242, 4.6591854, 1.9464346, 3.7956324]
2025-05-08 09:48:27,378 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [18.0, 25.0, 33.0, 13.0, 130.0, 25.0, 15.0, 19.0, 14.0, 64.0]
2025-05-08 09:48:27,385 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 67/100 (estimated time remaining: 1 hour, 23 minutes, 54 seconds)
2025-05-08 09:50:54,580 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:50:54,805 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: -1.17503 ± 3.745
2025-05-08 09:50:54,805 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [2.0433416, 4.9423366, 1.0121356, -2.1251943, 1.4623466, -5.843035, 0.8653451, -4.611645, -1.8698597, -7.6260376]
2025-05-08 09:50:54,805 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [15.0, 17.0, 18.0, 18.0, 18.0, 22.0, 17.0, 38.0, 18.0, 35.0]
2025-05-08 09:50:54,812 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 68/100 (estimated time remaining: 1 hour, 21 minutes, 18 seconds)
2025-05-08 09:53:21,883 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:53:22,149 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 6.84755 ± 8.139
2025-05-08 09:53:22,149 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [2.4086354, 5.138342, 2.7808917, 2.5298564, 3.6815763, 1.8601516, 27.883482, -1.1678902, 8.823742, 14.536689]
2025-05-08 09:53:22,149 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [16.0, 18.0, 24.0, 17.0, 16.0, 16.0, 75.0, 26.0, 17.0, 31.0]
2025-05-08 09:53:22,156 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 69/100 (estimated time remaining: 1 hour, 18 minutes, 37 seconds)
2025-05-08 09:55:50,597 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:55:51,128 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 60.85812 ± 75.592
2025-05-08 09:55:51,128 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [192.11613, 160.58826, 31.495474, 2.550275, -1.6522523, 19.559217, 16.730677, 17.596046, -2.167986, 171.76538]
2025-05-08 09:55:51,128 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [122.0, 87.0, 42.0, 15.0, 23.0, 41.0, 39.0, 30.0, 16.0, 93.0]
2025-05-08 09:55:51,129 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1124 [INFO]: New best (60.86) for latency ExtremeSparseL4U32
2025-05-08 09:55:51,129 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1127 [INFO]: saving network
2025-05-08 09:55:51,132 latency_env.training.utils:544 [DEBUG]: Saving evalcopy of SAC to _logs/benchmark-v3-tc7/noisy-walker2d/ExtremeSparseL4U32-sac/checkpoints/best_ExtremeSparseL4U32.pkl
2025-05-08 09:55:51,142 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 70/100 (estimated time remaining: 1 hour, 16 minutes, 19 seconds)
2025-05-08 09:58:19,338 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 09:58:19,724 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 21.90026 ± 56.947
2025-05-08 09:58:19,724 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [190.36821, -0.73577017, -0.92221177, 1.7174866, 0.086663485, 1.5280061, -2.7042756, 31.15737, -0.30025223, -1.1926091]
2025-05-08 09:58:19,725 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [133.0, 14.0, 23.0, 25.0, 15.0, 15.0, 14.0, 101.0, 15.0, 14.0]
2025-05-08 09:58:19,731 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 71/100 (estimated time remaining: 1 hour, 14 minutes)
2025-05-08 10:00:48,409 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:00:48,688 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 7.85400 ± 7.846
2025-05-08 10:00:48,689 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [9.119801, 4.7592316, -2.8947613, 6.8159823, 8.424904, 18.181356, -2.7710207, 3.1998005, 10.357175, 23.347548]
2025-05-08 10:00:48,689 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [28.0, 16.0, 23.0, 37.0, 17.0, 43.0, 34.0, 21.0, 21.0, 38.0]
2025-05-08 10:00:48,696 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 72/100 (estimated time remaining: 1 hour, 11 minutes, 39 seconds)
2025-05-08 10:03:15,695 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:03:16,268 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 23.24053 ± 26.076
2025-05-08 10:03:16,268 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [27.471745, 37.42268, 5.343426, 7.939351, 19.225847, -2.23322, 22.811016, 16.21182, 4.535209, 93.67746]
2025-05-08 10:03:16,268 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [63.0, 76.0, 25.0, 29.0, 37.0, 38.0, 81.0, 51.0, 22.0, 120.0]
2025-05-08 10:03:16,275 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 73/100 (estimated time remaining: 1 hour, 9 minutes, 12 seconds)
2025-05-08 10:05:46,549 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:05:47,127 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 32.00600 ± 43.574
2025-05-08 10:05:47,127 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [0.17606741, 123.36393, 46.849365, 8.276819, 87.50729, -19.835989, 26.762102, -3.2488484, 54.34881, -4.139531]
2025-05-08 10:05:47,127 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [34.0, 115.0, 81.0, 31.0, 99.0, 35.0, 42.0, 30.0, 73.0, 30.0]
2025-05-08 10:05:47,138 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 74/100 (estimated time remaining: 1 hour, 7 minutes, 2 seconds)
2025-05-08 10:08:16,266 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:08:16,449 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: -3.58146 ± 2.809
2025-05-08 10:08:16,449 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [-2.1007583, -2.000811, -8.118632, -0.19004549, -5.5747423, 1.4935479, -4.357969, -6.6831017, -5.016274, -3.265843]
2025-05-08 10:08:16,449 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [15.0, 18.0, 17.0, 16.0, 19.0, 25.0, 18.0, 17.0, 17.0, 15.0]
2025-05-08 10:08:16,456 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 75/100 (estimated time remaining: 1 hour, 4 minutes, 35 seconds)
2025-05-08 10:10:45,392 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:10:45,833 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 18.07643 ± 11.289
2025-05-08 10:10:45,833 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [29.414589, 12.294041, 29.650852, 5.7049966, 15.351556, 34.114563, 3.276574, 7.0175886, 31.692411, 12.247086]
2025-05-08 10:10:45,834 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [60.0, 30.0, 46.0, 36.0, 35.0, 44.0, 37.0, 32.0, 71.0, 29.0]
2025-05-08 10:10:45,841 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 76/100 (estimated time remaining: 1 hour, 2 minutes, 10 seconds)
2025-05-08 10:13:15,906 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:13:16,327 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 18.03289 ± 42.082
2025-05-08 10:13:16,327 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [22.20319, 18.750763, -6.8549376, -2.0983694, -8.680794, 6.2944183, 13.658639, 2.5025725, -5.883546, 140.43695]
2025-05-08 10:13:16,327 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [33.0, 52.0, 20.0, 33.0, 19.0, 32.0, 32.0, 30.0, 20.0, 140.0]
2025-05-08 10:13:16,334 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 77/100 (estimated time remaining: 59 minutes, 48 seconds)
2025-05-08 10:15:44,937 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:15:45,472 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 28.28300 ± 51.622
2025-05-08 10:15:45,472 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [168.10268, 77.59865, 13.981132, 6.0460477, 7.566485, 4.5793834, 1.5512748, -4.623621, 4.951516, 3.0764327]
2025-05-08 10:15:45,472 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [160.0, 62.0, 32.0, 34.0, 41.0, 25.0, 43.0, 20.0, 53.0, 38.0]
2025-05-08 10:15:45,480 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 78/100 (estimated time remaining: 57 minutes, 26 seconds)
2025-05-08 10:18:15,280 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:18:15,638 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 8.61547 ± 20.496
2025-05-08 10:18:15,638 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [19.141844, -6.277061, -6.8520064, -17.007875, 22.63748, 59.783527, 8.638529, 0.069576964, 6.301633, -0.28093562]
2025-05-08 10:18:15,638 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [45.0, 23.0, 20.0, 16.0, 50.0, 82.0, 34.0, 23.0, 31.0, 26.0]
2025-05-08 10:18:15,646 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 79/100 (estimated time remaining: 54 minutes, 53 seconds)
2025-05-08 10:20:46,253 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:20:46,623 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 9.12453 ± 9.187
2025-05-08 10:20:46,624 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [1.1722999, 11.600239, 30.3985, 2.4289184, 6.9828978, 12.240366, 14.186973, -1.4125835, -0.7793711, 14.427078]
2025-05-08 10:20:46,624 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [20.0, 46.0, 60.0, 27.0, 28.0, 24.0, 31.0, 32.0, 52.0, 31.0]
2025-05-08 10:20:46,631 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 80/100 (estimated time remaining: 52 minutes, 30 seconds)
2025-05-08 10:23:15,420 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:23:15,823 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 17.84721 ± 15.292
2025-05-08 10:23:15,823 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [6.591268, 1.0855056, 43.340683, 18.568262, 13.32535, 7.7783732, -0.026439574, 43.05119, 13.360395, 31.397476]
2025-05-08 10:23:15,823 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [22.0, 26.0, 56.0, 41.0, 51.0, 38.0, 25.0, 46.0, 47.0, 49.0]
2025-05-08 10:23:15,831 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 81/100 (estimated time remaining: 49 minutes, 59 seconds)
2025-05-08 10:25:44,909 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:25:45,362 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 41.41674 ± 65.847
2025-05-08 10:25:45,363 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [220.59535, 1.7968653, 41.88802, 2.545011, 2.5732927, 7.360579, 95.684456, 10.913031, 3.690464, 27.120333]
2025-05-08 10:25:45,363 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [139.0, 13.0, 67.0, 16.0, 15.0, 24.0, 91.0, 22.0, 19.0, 36.0]
2025-05-08 10:25:45,370 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 82/100 (estimated time remaining: 47 minutes, 26 seconds)
2025-05-08 10:28:15,851 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:28:16,351 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 27.35986 ± 30.607
2025-05-08 10:28:16,351 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [10.93458, 1.6971639, 2.2001424, 39.31724, 1.840167, 88.21249, 29.262583, 79.216, 5.6993194, 15.21892]
2025-05-08 10:28:16,351 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [33.0, 25.0, 19.0, 51.0, 13.0, 134.0, 54.0, 71.0, 26.0, 55.0]
2025-05-08 10:28:16,359 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 83/100 (estimated time remaining: 45 minutes, 3 seconds)
2025-05-08 10:30:45,731 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:30:46,031 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 8.57003 ± 8.322
2025-05-08 10:30:46,031 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [3.332346, 6.6857815, 2.3346128, 8.642964, 6.522169, 32.630093, 8.583885, 7.2339544, 7.155852, 2.5786023]
2025-05-08 10:30:46,031 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [34.0, 26.0, 16.0, 21.0, 25.0, 71.0, 28.0, 22.0, 24.0, 20.0]
2025-05-08 10:30:46,039 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 84/100 (estimated time remaining: 42 minutes, 31 seconds)
2025-05-08 10:33:15,229 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:33:15,441 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 3.73506 ± 1.927
2025-05-08 10:33:15,441 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [4.328664, 1.6081877, 4.091484, 2.0525043, 7.33056, 2.358607, 6.4029617, 1.2095991, 3.3336363, 4.6343517]
2025-05-08 10:33:15,442 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [17.0, 15.0, 22.0, 19.0, 21.0, 23.0, 33.0, 16.0, 15.0, 22.0]
2025-05-08 10:33:15,449 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 85/100 (estimated time remaining: 39 minutes, 56 seconds)
2025-05-08 10:35:45,152 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:35:45,502 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 16.10076 ± 40.634
2025-05-08 10:35:45,502 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [-1.0228962, 0.5079297, 6.632537, -2.8195152, 4.265688, 0.7773973, 0.8658946, 137.26112, 13.780158, 0.75927544]
2025-05-08 10:35:45,502 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [31.0, 19.0, 23.0, 35.0, 22.0, 21.0, 22.0, 95.0, 36.0, 27.0]
2025-05-08 10:35:45,510 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 86/100 (estimated time remaining: 37 minutes, 29 seconds)
2025-05-08 10:38:16,796 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:38:17,239 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 15.57984 ± 22.518
2025-05-08 10:38:17,239 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [-0.9658993, 6.3799214, 6.634714, 2.300918, -1.6083119, 56.22251, 6.7289596, 5.276602, 11.236118, 63.592815]
2025-05-08 10:38:17,239 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [26.0, 48.0, 24.0, 16.0, 32.0, 109.0, 21.0, 23.0, 33.0, 86.0]
2025-05-08 10:38:17,249 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 87/100 (estimated time remaining: 35 minutes, 5 seconds)
2025-05-08 10:40:55,096 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:40:55,424 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 17.26385 ± 38.900
2025-05-08 10:40:55,424 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [5.942796, -1.8909518, 2.123165, 4.9888535, 11.10888, 3.286066, 4.031315, 133.45454, 9.133487, 0.46031857]
2025-05-08 10:40:55,424 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [25.0, 25.0, 25.0, 24.0, 26.0, 24.0, 25.0, 105.0, 24.0, 13.0]
2025-05-08 10:40:55,432 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 88/100 (estimated time remaining: 32 minutes, 53 seconds)
2025-05-08 10:43:24,387 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:43:24,670 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 15.47795 ± 30.952
2025-05-08 10:43:24,670 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [22.119608, 0.6260391, 2.0484078, 8.154626, 2.6677706, 106.3391, -3.168502, 6.082502, 3.4764369, 6.4334955]
2025-05-08 10:43:24,670 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [46.0, 23.0, 15.0, 22.0, 19.0, 81.0, 18.0, 25.0, 18.0, 19.0]
2025-05-08 10:43:24,678 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 89/100 (estimated time remaining: 30 minutes, 20 seconds)
2025-05-08 10:45:53,939 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:45:54,414 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 39.94922 ± 75.395
2025-05-08 10:45:54,414 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [56.271317, 6.8641024, 3.8389184, 4.982257, 11.719074, 11.45454, 13.933522, 11.81228, 262.05704, 16.559177]
2025-05-08 10:45:54,414 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [68.0, 24.0, 23.0, 25.0, 23.0, 29.0, 27.0, 26.0, 161.0, 46.0]
2025-05-08 10:45:54,423 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 90/100 (estimated time remaining: 27 minutes, 49 seconds)
2025-05-08 10:48:23,820 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:48:24,241 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 15.89488 ± 10.945
2025-05-08 10:48:24,241 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [11.652177, 6.4711695, 2.896545, 6.7931094, 28.936365, 32.29688, 24.897804, 17.876335, 25.901192, 1.2271748]
2025-05-08 10:48:24,241 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [31.0, 22.0, 22.0, 23.0, 38.0, 60.0, 62.0, 69.0, 53.0, 26.0]
2025-05-08 10:48:24,250 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 91/100 (estimated time remaining: 25 minutes, 17 seconds)
2025-05-08 10:50:51,197 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:50:51,512 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 10.24907 ± 7.418
2025-05-08 10:50:51,512 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [10.475655, 18.475727, 12.524558, 6.559692, -1.0593873, 19.50083, 10.068011, 1.180362, 21.296066, 3.4691854]
2025-05-08 10:50:51,512 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [27.0, 30.0, 41.0, 29.0, 29.0, 33.0, 25.0, 27.0, 41.0, 20.0]
2025-05-08 10:50:51,521 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 92/100 (estimated time remaining: 22 minutes, 37 seconds)
2025-05-08 10:53:21,639 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:53:22,202 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 30.51498 ± 35.410
2025-05-08 10:53:22,202 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [8.053965, 118.50991, 14.684886, 5.660746, 7.971049, 10.917435, 15.39005, 74.52035, 12.505415, 36.936054]
2025-05-08 10:53:22,202 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [24.0, 91.0, 52.0, 26.0, 26.0, 53.0, 43.0, 91.0, 89.0, 45.0]
2025-05-08 10:53:22,212 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 93/100 (estimated time remaining: 19 minutes, 54 seconds)
2025-05-08 10:55:50,454 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:55:50,897 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 32.09931 ± 39.986
2025-05-08 10:55:50,898 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [46.56835, 5.4446516, 20.939178, 137.93355, 2.5597332, 11.3903, 3.065528, 19.022074, 63.29562, 10.774127]
2025-05-08 10:55:50,898 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [62.0, 22.0, 31.0, 106.0, 15.0, 35.0, 18.0, 32.0, 67.0, 40.0]
2025-05-08 10:55:50,908 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 94/100 (estimated time remaining: 17 minutes, 24 seconds)
2025-05-08 10:58:21,879 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 10:58:22,288 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 18.58181 ± 25.476
2025-05-08 10:58:22,288 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [93.18644, 3.8645282, 10.227683, 9.377132, 4.4068913, 13.270703, 5.5184965, 13.687426, 8.464795, 23.813992]
2025-05-08 10:58:22,288 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [113.0, 17.0, 39.0, 24.0, 35.0, 36.0, 39.0, 35.0, 19.0, 41.0]
2025-05-08 10:58:22,297 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 95/100 (estimated time remaining: 14 minutes, 57 seconds)
2025-05-08 11:00:51,056 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 11:00:51,556 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 33.94453 ± 64.043
2025-05-08 11:00:51,557 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [221.88934, 4.940666, 27.30787, -3.9684582, 45.79717, 11.222114, 3.4333982, 9.243416, 11.339594, 8.240107]
2025-05-08 11:00:51,557 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [154.0, 26.0, 46.0, 44.0, 66.0, 26.0, 22.0, 27.0, 47.0, 44.0]
2025-05-08 11:00:51,567 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 96/100 (estimated time remaining: 12 minutes, 27 seconds)
2025-05-08 11:03:23,302 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 11:03:23,675 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 16.80230 ± 19.750
2025-05-08 11:03:23,675 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [72.14738, 8.299762, 17.408697, 28.31277, 6.7168083, 5.7968297, 13.195065, 5.8140635, 3.5830898, 6.7485366]
2025-05-08 11:03:23,675 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [97.0, 23.0, 31.0, 49.0, 19.0, 24.0, 47.0, 21.0, 23.0, 25.0]
2025-05-08 11:03:23,684 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 97/100 (estimated time remaining: 10 minutes, 1 second)
2025-05-08 11:05:53,042 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 11:05:53,566 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 33.42586 ± 45.152
2025-05-08 11:05:53,566 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [80.08857, 9.286684, 57.658596, 5.8757296, 146.16328, 8.277883, 10.211758, -0.1760837, 5.160173, 11.711971]
2025-05-08 11:05:53,566 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [85.0, 24.0, 99.0, 22.0, 101.0, 42.0, 53.0, 34.0, 22.0, 25.0]
2025-05-08 11:05:53,577 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 98/100 (estimated time remaining: 7 minutes, 30 seconds)
2025-05-08 11:08:24,191 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 11:08:24,554 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 14.12753 ± 13.377
2025-05-08 11:08:24,554 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [18.14695, 9.144506, 11.259986, 11.061916, 4.5603337, 13.581824, 52.420868, 5.86229, 4.4919252, 10.744743]
2025-05-08 11:08:24,554 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [26.0, 28.0, 26.0, 24.0, 22.0, 25.0, 73.0, 22.0, 24.0, 80.0]
2025-05-08 11:08:24,565 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 99/100 (estimated time remaining: 5 minutes, 1 second)
2025-05-08 11:10:55,382 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 11:10:55,742 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 13.75847 ± 19.528
2025-05-08 11:10:55,742 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [10.894896, 8.401351, 3.31314, 5.95039, 71.21537, 12.756657, 8.979058, 9.37917, -1.4246709, 8.119318]
2025-05-08 11:10:55,742 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [23.0, 23.0, 23.0, 27.0, 72.0, 39.0, 17.0, 36.0, 61.0, 26.0]
2025-05-08 11:10:55,753 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1097 [INFO]: Iteration 100/100 (estimated time remaining: 2 minutes, 30 seconds)
2025-05-08 11:13:26,288 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1112 [DEBUG]: Evaluating for latency ExtremeSparseL4U32...
2025-05-08 11:13:26,636 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1119 [DEBUG]: Total Reward: 15.09500 ± 6.980
2025-05-08 11:13:26,636 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1120 [DEBUG]: All rewards: [23.82418, 10.837882, 26.937805, 24.831226, 11.004024, 9.71519, 13.188666, 14.244602, 10.65687, 5.7095885]
2025-05-08 11:13:26,636 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1121 [DEBUG]: All trajectory lengths: [32.0, 30.0, 37.0, 45.0, 44.0, 30.0, 42.0, 29.0, 23.0, 27.0]
2025-05-08 11:13:26,647 latency_env.delayed_mdp:training_loop(baseline-sac-noisy-walker2d):1149 [DEBUG]: Training session finished
