=== ONLINE SNN TRAINING ===
Starting SNN Online Training for 20 epochs on cuda:0...
Evaluation every 500 steps, reset states every never steps
Warm-starting RMS EMAs with 50 steps...
RMS EMA warm-start complete.
Epoch [1/20], Step 500, Train Loss: 1.2200, Val Avg Corr: 0.2338
  >>> New best validation model saved with Avg Corr: 0.2338 <<<
Epoch [1/20], Step 1000, Train Loss: 1.1186, Val Avg Corr: 0.3613
  >>> New best validation model saved with Avg Corr: 0.3613 <<<
Epoch [1/20], Step 1500, Train Loss: 0.7590, Val Avg Corr: 0.4035
  >>> New best validation model saved with Avg Corr: 0.4035 <<<
Epoch [1/20], Step 2000, Train Loss: 0.7529, Val Avg Corr: 0.5242
  >>> New best validation model saved with Avg Corr: 0.5242 <<<
Epoch [1/20], Step 2500, Train Loss: 0.6440, Val Avg Corr: 0.5915
  >>> New best validation model saved with Avg Corr: 0.5915 <<<
Epoch [1/20], Step 3000, Train Loss: 0.6130, Val Avg Corr: 0.6124
  >>> New best validation model saved with Avg Corr: 0.6124 <<<
Epoch [1/20], Step 3500, Train Loss: 0.5470, Val Avg Corr: 0.6067
Epoch [1/20], Step 4000, Train Loss: 0.5113, Val Avg Corr: 0.6521
  >>> New best validation model saved with Avg Corr: 0.6521 <<<
Epoch [1/20], Step 4500, Train Loss: 0.6324, Val Avg Corr: 0.6269
Epoch [1/20], Step 5000, Train Loss: 0.5830, Val Avg Corr: 0.6202
Epoch [1/20], Step 5500, Train Loss: 0.5238, Val Avg Corr: 0.6411
Epoch [1/20], Step 6000, Train Loss: 0.6275, Val Avg Corr: 0.6336
Epoch [1/20], Step 6500, Train Loss: 0.5966, Val Avg Corr: 0.6833
  >>> New best validation model saved with Avg Corr: 0.6833 <<<
Epoch [1/20], Step 7000, Train Loss: 0.5103, Val Avg Corr: 0.6883
  >>> New best validation model saved with Avg Corr: 0.6883 <<<
Epoch [1/20], Step 7500, Train Loss: 0.5051, Val Avg Corr: 0.6830
Epoch [1/20], Step 8000, Train Loss: 0.4366, Val Avg Corr: 0.6696
Epoch [1/20], Step 8500, Train Loss: 0.4800, Val Avg Corr: 0.6729
Epoch [1/20], Step 9000, Train Loss: 0.5756, Val Avg Corr: 0.6917
  >>> New best validation model saved with Avg Corr: 0.6917 <<<
Epoch [1/20], Step 9500, Train Loss: 0.4325, Val Avg Corr: 0.6694
Epoch [1/20], Step 10000, Train Loss: 0.4566, Val Avg Corr: 0.6706
Epoch [1/20], Step 10500, Train Loss: 0.4293, Val Avg Corr: 0.6690
Epoch [1/20], Step 11000, Train Loss: 0.5332, Val Avg Corr: 0.6802
Epoch [1/20], Step 11500, Train Loss: 0.4452, Val Avg Corr: 0.6763
Epoch [1/20], Step 12000, Train Loss: 0.4476, Val Avg Corr: 0.6727
Epoch [1/20], Step 12500, Train Loss: 0.3712, Val Avg Corr: 0.6573
Epoch [1/20], Step 13000, Train Loss: 0.4608, Val Avg Corr: 0.6792
Epoch [1/20], Step 13500, Train Loss: 0.5204, Val Avg Corr: 0.6906
Epoch [1/20], Step 14000, Train Loss: 0.5444, Val Avg Corr: 0.7038
  >>> New best validation model saved with Avg Corr: 0.7038 <<<
Epoch [1/20], Step 14500, Train Loss: 0.5441, Val Avg Corr: 0.6952
Epoch [1/20], Step 15000, Train Loss: 0.4394, Val Avg Corr: 0.7287
  >>> New best validation model saved with Avg Corr: 0.7287 <<<
Epoch [1/20], Step 15500, Train Loss: 0.5834, Val Avg Corr: 0.7270
Epoch [1/20], Step 16000, Train Loss: 0.5309, Val Avg Corr: 0.7221
Epoch [1/20], Step 16500, Train Loss: 0.4264, Val Avg Corr: 0.7284
Epoch [1/20], Step 17000, Train Loss: 0.5485, Val Avg Corr: 0.7364
  >>> New best validation model saved with Avg Corr: 0.7364 <<<
Epoch [1/20], Step 17500, Train Loss: 0.5696, Val Avg Corr: 0.7164
Epoch [1/20], Step 18000, Train Loss: 0.4534, Val Avg Corr: 0.7160
Epoch [1/20], Step 18500, Train Loss: 0.5478, Val Avg Corr: 0.7442
  >>> New best validation model saved with Avg Corr: 0.7442 <<<
Epoch [1/20], Step 19000, Train Loss: 0.3699, Val Avg Corr: 0.7356
Epoch [1/20], Step 19500, Train Loss: 0.3708, Val Avg Corr: 0.7324
Epoch [1/20], Step 20000, Train Loss: 0.4105, Val Avg Corr: 0.7110
Epoch [1/20], Step 20500, Train Loss: 0.4220, Val Avg Corr: 0.7233
Trial change detected: 712 -> 714, resetting states
Epoch [1/20], Step 21000, Train Loss: 0.4602, Val Avg Corr: 0.7317
Epoch [1/20], Step 21500, Train Loss: 0.3810, Val Avg Corr: 0.6713
Epoch [1/20], Step 22000, Train Loss: 0.4421, Val Avg Corr: 0.7058
Epoch [1/20], Step 22500, Train Loss: 0.3809, Val Avg Corr: 0.6620
Epoch [1/20], Step 23000, Train Loss: 0.6434, Val Avg Corr: 0.7364
Epoch [1/20], Step 23500, Train Loss: 0.3895, Val Avg Corr: 0.7077
Epoch [1/20], Step 24000, Train Loss: 0.4642, Val Avg Corr: 0.7338
Epoch [1/20], Step 24500, Train Loss: 0.4682, Val Avg Corr: 0.7365
Epoch [1/20], Step 25000, Train Loss: 0.5422, Val Avg Corr: 0.7211
Epoch [1/20], Step 25500, Train Loss: 0.3642, Val Avg Corr: 0.7139
Epoch [1/20], Step 26000, Train Loss: 0.3497, Val Avg Corr: 0.7081
Epoch [1/20], Step 26500, Train Loss: 0.4461, Val Avg Corr: 0.7162
Epoch [1/20], Step 27000, Train Loss: 0.4887, Val Avg Corr: 0.7244
Epoch [1/20], Step 27500, Train Loss: 0.4245, Val Avg Corr: 0.7419
Epoch [1/20], Step 28000, Train Loss: 0.4307, Val Avg Corr: 0.7450
  >>> New best validation model saved with Avg Corr: 0.7450 <<<
Epoch [1/20], Step 28500, Train Loss: 0.4830, Val Avg Corr: 0.7297
Epoch [1/20], Step 29000, Train Loss: 0.4013, Val Avg Corr: 0.7242
Epoch [1/20], Step 29500, Train Loss: 0.4373, Val Avg Corr: 0.7203
Epoch [1/20], Step 30000, Train Loss: 0.4723, Val Avg Corr: 0.7291
Epoch [1/20], Step 30500, Train Loss: 0.4220, Val Avg Corr: 0.7133
Epoch [1/20], Step 31000, Train Loss: 0.4425, Val Avg Corr: 0.7279
Epoch [1/20], Step 31500, Train Loss: 0.3278, Val Avg Corr: 0.7391
Epoch [1/20], Step 32000, Train Loss: 0.3336, Val Avg Corr: 0.7592
  >>> New best validation model saved with Avg Corr: 0.7592 <<<
Epoch [1/20], Step 32500, Train Loss: 0.4353, Val Avg Corr: 0.7614
  >>> New best validation model saved with Avg Corr: 0.7614 <<<
Epoch [1/20], Step 33000, Train Loss: 0.4586, Val Avg Corr: 0.7555
Epoch [1/20], Step 33500, Train Loss: 0.4127, Val Avg Corr: 0.7625
  >>> New best validation model saved with Avg Corr: 0.7625 <<<
Epoch [1/20], Step 34000, Train Loss: 0.4226, Val Avg Corr: 0.7142
Epoch [1/20], Step 34500, Train Loss: 0.4012, Val Avg Corr: 0.7460
Epoch [1/20], Step 35000, Train Loss: 0.4958, Val Avg Corr: 0.7454
Epoch [1/20], Step 35500, Train Loss: 0.3374, Val Avg Corr: 0.7372
Epoch [1/20], Step 36000, Train Loss: 0.4147, Val Avg Corr: 0.7153
Epoch [1/20], Step 36500, Train Loss: 0.5081, Val Avg Corr: 0.7693
  >>> New best validation model saved with Avg Corr: 0.7693 <<<
Epoch [1/20], Step 37000, Train Loss: 0.3366, Val Avg Corr: 0.7611
Epoch [1/20], Step 37500, Train Loss: 0.4505, Val Avg Corr: 0.7695
  >>> New best validation model saved with Avg Corr: 0.7695 <<<
Epoch [1/20], Step 38000, Train Loss: 0.4054, Val Avg Corr: 0.7461
Epoch [1/20], Step 38500, Train Loss: 0.3981, Val Avg Corr: 0.7245
Epoch [1/20], Step 39000, Train Loss: 0.4357, Val Avg Corr: 0.7537
Epoch [1/20], Step 39500, Train Loss: 0.4365, Val Avg Corr: 0.7737
  >>> New best validation model saved with Avg Corr: 0.7737 <<<
Epoch [1/20], Step 40000, Train Loss: 0.3698, Val Avg Corr: 0.7653
Epoch [1/20], Step 40500, Train Loss: 0.4502, Val Avg Corr: 0.7461
Epoch [1/20], Step 41000, Train Loss: 0.4371, Val Avg Corr: 0.7465
Trial change detected: 1419 -> 1422, resetting states
Epoch [1/20], Step 41500, Train Loss: 0.3823, Val Avg Corr: 0.7577
Epoch [1/20], Step 42000, Train Loss: 0.3507, Val Avg Corr: 0.7367
Epoch [1/20], Step 42500, Train Loss: 0.3516, Val Avg Corr: 0.7463
Epoch [1/20], Step 43000, Train Loss: 0.4316, Val Avg Corr: 0.7454
Epoch [1/20], Step 43500, Train Loss: 0.3871, Val Avg Corr: 0.7699
Epoch [1/20], Step 44000, Train Loss: 0.3811, Val Avg Corr: 0.7425
Epoch [1/20], Step 44500, Train Loss: 0.3239, Val Avg Corr: 0.7561
Epoch [1/20], Step 45000, Train Loss: 0.4667, Val Avg Corr: 0.7616
Epoch [1/20], Step 45500, Train Loss: 0.3448, Val Avg Corr: 0.7249
Epoch [1/20], Step 46000, Train Loss: 0.3450, Val Avg Corr: 0.7533
Epoch [1/20], Step 46500, Train Loss: 0.4495, Val Avg Corr: 0.7412
Epoch [1/20], Step 47000, Train Loss: 0.4387, Val Avg Corr: 0.7116
Epoch [1/20], Step 47500, Train Loss: 0.4241, Val Avg Corr: 0.7426
Epoch [1/20], Step 48000, Train Loss: 0.3513, Val Avg Corr: 0.7446
Epoch [1/20], Step 48500, Train Loss: 0.3422, Val Avg Corr: 0.7383
Epoch [1/20], Step 49000, Train Loss: 0.4737, Val Avg Corr: 0.7595
Epoch [1/20], Step 49500, Train Loss: 0.4468, Val Avg Corr: 0.7545
Epoch [1/20], Step 50000, Train Loss: 0.3379, Val Avg Corr: 0.7458
Epoch [1/20], Step 50500, Train Loss: 0.4463, Val Avg Corr: 0.7536
Epoch [1/20], Step 51000, Train Loss: 0.3331, Val Avg Corr: 0.7556
Epoch [1/20], Step 51500, Train Loss: 0.3337, Val Avg Corr: 0.7418
Epoch [1/20], Step 52000, Train Loss: 0.3398, Val Avg Corr: 0.7466
Epoch [1/20], Step 52500, Train Loss: 0.4395, Val Avg Corr: 0.7674
Epoch [1/20], Step 53000, Train Loss: 0.3505, Val Avg Corr: 0.7503
Epoch [1/20], Step 53500, Train Loss: 0.4103, Val Avg Corr: 0.7777
  >>> New best validation model saved with Avg Corr: 0.7777 <<<
Epoch [1/20], Step 54000, Train Loss: 0.3921, Val Avg Corr: 0.7199
Epoch [1/20], Step 54500, Train Loss: 0.4764, Val Avg Corr: 0.7424
Epoch [1/20], Step 55000, Train Loss: 0.3104, Val Avg Corr: 0.7743
Epoch [1/20], Step 55500, Train Loss: 0.3230, Val Avg Corr: 0.7752
Epoch [1/20], Step 56000, Train Loss: 0.4527, Val Avg Corr: 0.7604
Epoch [1/20], Step 56500, Train Loss: 0.3452, Val Avg Corr: 0.7759
Epoch [1/20], Step 57000, Train Loss: 0.3711, Val Avg Corr: 0.7773
Epoch [1/20], Step 57500, Train Loss: 0.4209, Val Avg Corr: 0.7464
Epoch [1/20], Step 58000, Train Loss: 0.3672, Val Avg Corr: 0.7667
Epoch [1/20], Step 58500, Train Loss: 0.4704, Val Avg Corr: 0.7537
Epoch [1/20], Step 59000, Train Loss: 0.4254, Val Avg Corr: 0.7784
  >>> New best validation model saved with Avg Corr: 0.7784 <<<
Epoch [1/20], Step 59500, Train Loss: 0.4084, Val Avg Corr: 0.7755
Epoch [1/20], Step 60000, Train Loss: 0.2495, Val Avg Corr: 0.7694
Epoch [1/20], Step 60500, Train Loss: 0.4112, Val Avg Corr: 0.7668
Epoch [1/20], Step 61000, Train Loss: 0.4019, Val Avg Corr: 0.7824
  >>> New best validation model saved with Avg Corr: 0.7824 <<<
Epoch [1/20], Step 61500, Train Loss: 0.3805, Val Avg Corr: 0.7677
Trial change detected: 2135 -> 2137, resetting states
Epoch [1/20], Step 62000, Train Loss: 0.4924, Val Avg Corr: 0.7823
Epoch [1/20], Step 62500, Train Loss: 0.3596, Val Avg Corr: 0.7815
Epoch [1/20], Step 63000, Train Loss: 0.3213, Val Avg Corr: 0.7823
Epoch [1/20], Step 63500, Train Loss: 0.3981, Val Avg Corr: 0.7661
Epoch [1/20], Step 64000, Train Loss: 0.3215, Val Avg Corr: 0.7771
Epoch [1/20], Step 64500, Train Loss: 0.4263, Val Avg Corr: 0.7839
  >>> New best validation model saved with Avg Corr: 0.7839 <<<
Epoch [1/20], Step 65000, Train Loss: 0.3487, Val Avg Corr: 0.7383
Epoch [1/20], Step 65500, Train Loss: 0.3486, Val Avg Corr: 0.7378
Epoch [2/20], Step 500, Train Loss: 0.4277, Val Avg Corr: 0.7752
Epoch [2/20], Step 1000, Train Loss: 0.5008, Val Avg Corr: 0.7278
Epoch [2/20], Step 1500, Train Loss: 0.4831, Val Avg Corr: 0.7642
Epoch [2/20], Step 2000, Train Loss: 0.3772, Val Avg Corr: 0.7763
Epoch [2/20], Step 2500, Train Loss: 0.3255, Val Avg Corr: 0.7958
  >>> New best validation model saved with Avg Corr: 0.7958 <<<
Epoch [2/20], Step 3000, Train Loss: 0.3140, Val Avg Corr: 0.7905
Epoch [2/20], Step 3500, Train Loss: 0.2862, Val Avg Corr: 0.7763
Epoch [2/20], Step 4000, Train Loss: 0.2645, Val Avg Corr: 0.7800
Epoch [2/20], Step 4500, Train Loss: 0.3842, Val Avg Corr: 0.7777
Epoch [2/20], Step 5000, Train Loss: 0.4233, Val Avg Corr: 0.7712
Epoch [2/20], Step 5500, Train Loss: 0.3684, Val Avg Corr: 0.7821
Epoch [2/20], Step 6000, Train Loss: 0.3586, Val Avg Corr: 0.7708
Epoch [2/20], Step 6500, Train Loss: 0.3718, Val Avg Corr: 0.8058
  >>> New best validation model saved with Avg Corr: 0.8058 <<<
Epoch [2/20], Step 7000, Train Loss: 0.2488, Val Avg Corr: 0.7823
Epoch [2/20], Step 7500, Train Loss: 0.4135, Val Avg Corr: 0.7909
Epoch [2/20], Step 8000, Train Loss: 0.3238, Val Avg Corr: 0.7838
Epoch [2/20], Step 8500, Train Loss: 0.3407, Val Avg Corr: 0.7720
Epoch [2/20], Step 9000, Train Loss: 0.4514, Val Avg Corr: 0.7770
Epoch [2/20], Step 9500, Train Loss: 0.3172, Val Avg Corr: 0.7712
Epoch [2/20], Step 10000, Train Loss: 0.3441, Val Avg Corr: 0.7751
Epoch [2/20], Step 10500, Train Loss: 0.3300, Val Avg Corr: 0.7708
Epoch [2/20], Step 11000, Train Loss: 0.3077, Val Avg Corr: 0.7661
Epoch [2/20], Step 11500, Train Loss: 0.3252, Val Avg Corr: 0.7626
Epoch [2/20], Step 12000, Train Loss: 0.3396, Val Avg Corr: 0.7891
Epoch [2/20], Step 12500, Train Loss: 0.2261, Val Avg Corr: 0.7716
Epoch [2/20], Step 13000, Train Loss: 0.3406, Val Avg Corr: 0.7799
Epoch [2/20], Step 13500, Train Loss: 0.3490, Val Avg Corr: 0.7795
Epoch [2/20], Step 14000, Train Loss: 0.3337, Val Avg Corr: 0.7980
Epoch [2/20], Step 14500, Train Loss: 0.3696, Val Avg Corr: 0.7737
Epoch [2/20], Step 15000, Train Loss: 0.3011, Val Avg Corr: 0.7894
Epoch [2/20], Step 15500, Train Loss: 0.4009, Val Avg Corr: 0.8016
Epoch [2/20], Step 16000, Train Loss: 0.4334, Val Avg Corr: 0.7840
Epoch [2/20], Step 16500, Train Loss: 0.2983, Val Avg Corr: 0.8022
Epoch [2/20], Step 17000, Train Loss: 0.3421, Val Avg Corr: 0.7968
Epoch [2/20], Step 17500, Train Loss: 0.3117, Val Avg Corr: 0.8032
Epoch [2/20], Step 18000, Train Loss: 0.3357, Val Avg Corr: 0.7931
Epoch [2/20], Step 18500, Train Loss: 0.4020, Val Avg Corr: 0.8105
  >>> New best validation model saved with Avg Corr: 0.8105 <<<
Epoch [2/20], Step 19000, Train Loss: 0.2532, Val Avg Corr: 0.7840
Epoch [2/20], Step 19500, Train Loss: 0.2749, Val Avg Corr: 0.7781
Epoch [2/20], Step 20000, Train Loss: 0.3344, Val Avg Corr: 0.7755
Epoch [2/20], Step 20500, Train Loss: 0.3250, Val Avg Corr: 0.8090
Trial change detected: 712 -> 714, resetting states
Epoch [2/20], Step 21000, Train Loss: 0.2857, Val Avg Corr: 0.8026
Epoch [2/20], Step 21500, Train Loss: 0.3193, Val Avg Corr: 0.7815
Epoch [2/20], Step 22000, Train Loss: 0.3451, Val Avg Corr: 0.7882
Epoch [2/20], Step 22500, Train Loss: 0.2752, Val Avg Corr: 0.7745
Epoch [2/20], Step 23000, Train Loss: 0.5039, Val Avg Corr: 0.8011
Epoch [2/20], Step 23500, Train Loss: 0.2681, Val Avg Corr: 0.7922
Epoch [2/20], Step 24000, Train Loss: 0.3268, Val Avg Corr: 0.7949
Epoch [2/20], Step 24500, Train Loss: 0.3339, Val Avg Corr: 0.7878
Epoch [2/20], Step 25000, Train Loss: 0.3534, Val Avg Corr: 0.8023
Epoch [2/20], Step 25500, Train Loss: 0.2831, Val Avg Corr: 0.8008
Epoch [2/20], Step 26000, Train Loss: 0.2530, Val Avg Corr: 0.7864
Epoch [2/20], Step 26500, Train Loss: 0.3245, Val Avg Corr: 0.7724
Epoch [2/20], Step 27000, Train Loss: 0.3741, Val Avg Corr: 0.7902
Epoch [2/20], Step 27500, Train Loss: 0.2902, Val Avg Corr: 0.7948
Epoch [2/20], Step 28000, Train Loss: 0.3261, Val Avg Corr: 0.7903
Epoch [2/20], Step 28500, Train Loss: 0.3661, Val Avg Corr: 0.7932
Epoch [2/20], Step 29000, Train Loss: 0.2803, Val Avg Corr: 0.7845
Epoch [2/20], Step 29500, Train Loss: 0.3440, Val Avg Corr: 0.7995
Epoch [2/20], Step 30000, Train Loss: 0.3757, Val Avg Corr: 0.8008
Epoch [2/20], Step 30500, Train Loss: 0.3051, Val Avg Corr: 0.7917
Epoch [2/20], Step 31000, Train Loss: 0.3327, Val Avg Corr: 0.7945
Epoch [2/20], Step 31500, Train Loss: 0.2466, Val Avg Corr: 0.7846
Epoch [2/20], Step 32000, Train Loss: 0.2473, Val Avg Corr: 0.7946
Epoch [2/20], Step 32500, Train Loss: 0.3022, Val Avg Corr: 0.7978
Epoch [2/20], Step 33000, Train Loss: 0.3605, Val Avg Corr: 0.7884
Epoch [2/20], Step 33500, Train Loss: 0.2724, Val Avg Corr: 0.7997
Epoch [2/20], Step 34000, Train Loss: 0.3322, Val Avg Corr: 0.7793
Epoch [2/20], Step 34500, Train Loss: 0.2920, Val Avg Corr: 0.7874
Epoch [2/20], Step 35000, Train Loss: 0.3735, Val Avg Corr: 0.7918
Epoch [2/20], Step 35500, Train Loss: 0.2658, Val Avg Corr: 0.7853
Epoch [2/20], Step 36000, Train Loss: 0.3565, Val Avg Corr: 0.7819
Epoch [2/20], Step 36500, Train Loss: 0.3980, Val Avg Corr: 0.8076
Epoch [2/20], Step 37000, Train Loss: 0.2739, Val Avg Corr: 0.8051
Epoch [2/20], Step 37500, Train Loss: 0.4022, Val Avg Corr: 0.8019
Epoch [2/20], Step 38000, Train Loss: 0.3538, Val Avg Corr: 0.8100
Epoch [2/20], Step 38500, Train Loss: 0.3111, Val Avg Corr: 0.7827
Epoch [2/20], Step 39000, Train Loss: 0.3955, Val Avg Corr: 0.7992
Epoch [2/20], Step 39500, Train Loss: 0.4036, Val Avg Corr: 0.8315
  >>> New best validation model saved with Avg Corr: 0.8315 <<<
Epoch [2/20], Step 40000, Train Loss: 0.2669, Val Avg Corr: 0.8067
Epoch [2/20], Step 40500, Train Loss: 0.3149, Val Avg Corr: 0.8005
Epoch [2/20], Step 41000, Train Loss: 0.3223, Val Avg Corr: 0.7901
Trial change detected: 1419 -> 1422, resetting states
Epoch [2/20], Step 41500, Train Loss: 0.2929, Val Avg Corr: 0.7865
Epoch [2/20], Step 42000, Train Loss: 0.2601, Val Avg Corr: 0.7847
Epoch [2/20], Step 42500, Train Loss: 0.2938, Val Avg Corr: 0.7920
Epoch [2/20], Step 43000, Train Loss: 0.3250, Val Avg Corr: 0.7942
Epoch [2/20], Step 43500, Train Loss: 0.2697, Val Avg Corr: 0.8038
Epoch [2/20], Step 44000, Train Loss: 0.3544, Val Avg Corr: 0.7909
Epoch [2/20], Step 44500, Train Loss: 0.2611, Val Avg Corr: 0.8088
Epoch [2/20], Step 45000, Train Loss: 0.3225, Val Avg Corr: 0.8005
Epoch [2/20], Step 45500, Train Loss: 0.2837, Val Avg Corr: 0.7772
Epoch [2/20], Step 46000, Train Loss: 0.2544, Val Avg Corr: 0.7950
Epoch [2/20], Step 46500, Train Loss: 0.3579, Val Avg Corr: 0.7732
Epoch [2/20], Step 47000, Train Loss: 0.3360, Val Avg Corr: 0.7294
Epoch [2/20], Step 47500, Train Loss: 0.3603, Val Avg Corr: 0.7832
Epoch [2/20], Step 48000, Train Loss: 0.2677, Val Avg Corr: 0.7820
Epoch [2/20], Step 48500, Train Loss: 0.2542, Val Avg Corr: 0.7791
Epoch [2/20], Step 49000, Train Loss: 0.3992, Val Avg Corr: 0.7895
Epoch [2/20], Step 49500, Train Loss: 0.3526, Val Avg Corr: 0.7702
Epoch [2/20], Step 50000, Train Loss: 0.2876, Val Avg Corr: 0.7792
Epoch [2/20], Step 50500, Train Loss: 0.3538, Val Avg Corr: 0.7809
Epoch [2/20], Step 51000, Train Loss: 0.3052, Val Avg Corr: 0.7882
Epoch [2/20], Step 51500, Train Loss: 0.2877, Val Avg Corr: 0.7973
Epoch [2/20], Step 52000, Train Loss: 0.2748, Val Avg Corr: 0.7885
Epoch [2/20], Step 52500, Train Loss: 0.3647, Val Avg Corr: 0.7944
Epoch [2/20], Step 53000, Train Loss: 0.2845, Val Avg Corr: 0.7806
Epoch [2/20], Step 53500, Train Loss: 0.2657, Val Avg Corr: 0.7852
Epoch [2/20], Step 54000, Train Loss: 0.3449, Val Avg Corr: 0.7700
Epoch [2/20], Step 54500, Train Loss: 0.4090, Val Avg Corr: 0.7813
Epoch [2/20], Step 55000, Train Loss: 0.2684, Val Avg Corr: 0.8078
Epoch [2/20], Step 55500, Train Loss: 0.2729, Val Avg Corr: 0.8030
Epoch [2/20], Step 56000, Train Loss: 0.3661, Val Avg Corr: 0.8063
Epoch [2/20], Step 56500, Train Loss: 0.2847, Val Avg Corr: 0.7980
Epoch [2/20], Step 57000, Train Loss: 0.3164, Val Avg Corr: 0.7871
Epoch [2/20], Step 57500, Train Loss: 0.3063, Val Avg Corr: 0.7792
Epoch [2/20], Step 58000, Train Loss: 0.3001, Val Avg Corr: 0.7942
Epoch [2/20], Step 58500, Train Loss: 0.3780, Val Avg Corr: 0.7835
Epoch [2/20], Step 59000, Train Loss: 0.3355, Val Avg Corr: 0.8083
Epoch [2/20], Step 59500, Train Loss: 0.3360, Val Avg Corr: 0.8153
Epoch [2/20], Step 60000, Train Loss: 0.2017, Val Avg Corr: 0.7893
Epoch [2/20], Step 60500, Train Loss: 0.3186, Val Avg Corr: 0.8162
Epoch [2/20], Step 61000, Train Loss: 0.3416, Val Avg Corr: 0.8320
  >>> New best validation model saved with Avg Corr: 0.8320 <<<
Epoch [2/20], Step 61500, Train Loss: 0.2850, Val Avg Corr: 0.8204
Trial change detected: 2135 -> 2137, resetting states
Epoch [2/20], Step 62000, Train Loss: 0.3599, Val Avg Corr: 0.8213
Epoch [2/20], Step 62500, Train Loss: 0.3095, Val Avg Corr: 0.8115
Epoch [2/20], Step 63000, Train Loss: 0.2741, Val Avg Corr: 0.8201
Epoch [2/20], Step 63500, Train Loss: 0.3516, Val Avg Corr: 0.7925
Epoch [2/20], Step 64000, Train Loss: 0.2500, Val Avg Corr: 0.8096
Epoch [2/20], Step 64500, Train Loss: 0.3356, Val Avg Corr: 0.8161
Epoch [2/20], Step 65000, Train Loss: 0.2999, Val Avg Corr: 0.7847
Epoch [2/20], Step 65500, Train Loss: 0.2798, Val Avg Corr: 0.7619
Epoch [3/20], Step 500, Train Loss: 0.3462, Val Avg Corr: 0.7883
Epoch [3/20], Step 1000, Train Loss: 0.4067, Val Avg Corr: 0.7463
Epoch [3/20], Step 1500, Train Loss: 0.4091, Val Avg Corr: 0.7812
Epoch [3/20], Step 2000, Train Loss: 0.3129, Val Avg Corr: 0.8014
Epoch [3/20], Step 2500, Train Loss: 0.2444, Val Avg Corr: 0.8145
Epoch [3/20], Step 3000, Train Loss: 0.2703, Val Avg Corr: 0.8009
Epoch [3/20], Step 3500, Train Loss: 0.2656, Val Avg Corr: 0.7798
Epoch [3/20], Step 4000, Train Loss: 0.2227, Val Avg Corr: 0.7931
Epoch [3/20], Step 4500, Train Loss: 0.2956, Val Avg Corr: 0.7866
Epoch [3/20], Step 5000, Train Loss: 0.3971, Val Avg Corr: 0.7912
Epoch [3/20], Step 5500, Train Loss: 0.3234, Val Avg Corr: 0.7894
Epoch [3/20], Step 6000, Train Loss: 0.2812, Val Avg Corr: 0.7878
Epoch [3/20], Step 6500, Train Loss: 0.3298, Val Avg Corr: 0.8174
Epoch [3/20], Step 7000, Train Loss: 0.2152, Val Avg Corr: 0.8082
Epoch [3/20], Step 7500, Train Loss: 0.3785, Val Avg Corr: 0.8000
Epoch [3/20], Step 8000, Train Loss: 0.2900, Val Avg Corr: 0.8027
Epoch [3/20], Step 8500, Train Loss: 0.2954, Val Avg Corr: 0.7968
Epoch [3/20], Step 9000, Train Loss: 0.3671, Val Avg Corr: 0.8063
Epoch [3/20], Step 9500, Train Loss: 0.2788, Val Avg Corr: 0.7989
Epoch [3/20], Step 10000, Train Loss: 0.2827, Val Avg Corr: 0.7972
Epoch [3/20], Step 10500, Train Loss: 0.2809, Val Avg Corr: 0.7824
Epoch [3/20], Step 11000, Train Loss: 0.2566, Val Avg Corr: 0.7943
Epoch [3/20], Step 11500, Train Loss: 0.2740, Val Avg Corr: 0.7825
Epoch [3/20], Step 12000, Train Loss: 0.2992, Val Avg Corr: 0.8034
Epoch [3/20], Step 12500, Train Loss: 0.2199, Val Avg Corr: 0.7967
Epoch [3/20], Step 13000, Train Loss: 0.2864, Val Avg Corr: 0.7981
Epoch [3/20], Step 13500, Train Loss: 0.3629, Val Avg Corr: 0.7969
Epoch [3/20], Step 14000, Train Loss: 0.2910, Val Avg Corr: 0.8104
Epoch [3/20], Step 14500, Train Loss: 0.3121, Val Avg Corr: 0.8061
Epoch [3/20], Step 15000, Train Loss: 0.2804, Val Avg Corr: 0.8185
Epoch [3/20], Step 15500, Train Loss: 0.3453, Val Avg Corr: 0.8337
  >>> New best validation model saved with Avg Corr: 0.8337 <<<
Epoch [3/20], Step 16000, Train Loss: 0.3192, Val Avg Corr: 0.8135
Epoch [3/20], Step 16500, Train Loss: 0.2387, Val Avg Corr: 0.8334
Epoch [3/20], Step 17000, Train Loss: 0.2857, Val Avg Corr: 0.8270
Epoch [3/20], Step 17500, Train Loss: 0.2739, Val Avg Corr: 0.8306
Epoch [3/20], Step 18000, Train Loss: 0.2865, Val Avg Corr: 0.8096
Epoch [3/20], Step 18500, Train Loss: 0.3426, Val Avg Corr: 0.8340
  >>> New best validation model saved with Avg Corr: 0.8340 <<<
Epoch [3/20], Step 19000, Train Loss: 0.2274, Val Avg Corr: 0.8118
Epoch [3/20], Step 19500, Train Loss: 0.2441, Val Avg Corr: 0.8093
Epoch [3/20], Step 20000, Train Loss: 0.2778, Val Avg Corr: 0.8092
Epoch [3/20], Step 20500, Train Loss: 0.2596, Val Avg Corr: 0.8175
Trial change detected: 712 -> 714, resetting states
Epoch [3/20], Step 21000, Train Loss: 0.2727, Val Avg Corr: 0.8209
Epoch [3/20], Step 21500, Train Loss: 0.2475, Val Avg Corr: 0.8083
Epoch [3/20], Step 22000, Train Loss: 0.2832, Val Avg Corr: 0.8156
Epoch [3/20], Step 22500, Train Loss: 0.2705, Val Avg Corr: 0.7959
Epoch [3/20], Step 23000, Train Loss: 0.4157, Val Avg Corr: 0.8234
Epoch [3/20], Step 23500, Train Loss: 0.2465, Val Avg Corr: 0.8238
Epoch [3/20], Step 24000, Train Loss: 0.2616, Val Avg Corr: 0.8116
Epoch [3/20], Step 24500, Train Loss: 0.2992, Val Avg Corr: 0.8191
Epoch [3/20], Step 25000, Train Loss: 0.3037, Val Avg Corr: 0.8123
Epoch [3/20], Step 25500, Train Loss: 0.2519, Val Avg Corr: 0.8183
Epoch [3/20], Step 26000, Train Loss: 0.2292, Val Avg Corr: 0.8050
Epoch [3/20], Step 26500, Train Loss: 0.3037, Val Avg Corr: 0.8039
Epoch [3/20], Step 27000, Train Loss: 0.3398, Val Avg Corr: 0.8180
Epoch [3/20], Step 27500, Train Loss: 0.2487, Val Avg Corr: 0.8164
Epoch [3/20], Step 28000, Train Loss: 0.2889, Val Avg Corr: 0.8064
Epoch [3/20], Step 28500, Train Loss: 0.3187, Val Avg Corr: 0.8069
Epoch [3/20], Step 29000, Train Loss: 0.2347, Val Avg Corr: 0.8052
Epoch [3/20], Step 29500, Train Loss: 0.3156, Val Avg Corr: 0.8229
Epoch [3/20], Step 30000, Train Loss: 0.3197, Val Avg Corr: 0.8216
Epoch [3/20], Step 30500, Train Loss: 0.2746, Val Avg Corr: 0.8209
Epoch [3/20], Step 31000, Train Loss: 0.2787, Val Avg Corr: 0.8093
Epoch [3/20], Step 31500, Train Loss: 0.1974, Val Avg Corr: 0.8091
Epoch [3/20], Step 32000, Train Loss: 0.2210, Val Avg Corr: 0.8103
Epoch [3/20], Step 32500, Train Loss: 0.2420, Val Avg Corr: 0.8228
Epoch [3/20], Step 33000, Train Loss: 0.3027, Val Avg Corr: 0.8153
Epoch [3/20], Step 33500, Train Loss: 0.2446, Val Avg Corr: 0.8157
Epoch [3/20], Step 34000, Train Loss: 0.2972, Val Avg Corr: 0.8003
Epoch [3/20], Step 34500, Train Loss: 0.2195, Val Avg Corr: 0.8020
Epoch [3/20], Step 35000, Train Loss: 0.3244, Val Avg Corr: 0.7948
Epoch [3/20], Step 35500, Train Loss: 0.2536, Val Avg Corr: 0.7932
Epoch [3/20], Step 36000, Train Loss: 0.2967, Val Avg Corr: 0.7971
Epoch [3/20], Step 36500, Train Loss: 0.3071, Val Avg Corr: 0.8167
Epoch [3/20], Step 37000, Train Loss: 0.2326, Val Avg Corr: 0.8025
Epoch [3/20], Step 37500, Train Loss: 0.3388, Val Avg Corr: 0.8130
Epoch [3/20], Step 38000, Train Loss: 0.3175, Val Avg Corr: 0.8068
Epoch [3/20], Step 38500, Train Loss: 0.2804, Val Avg Corr: 0.8057
Epoch [3/20], Step 39000, Train Loss: 0.3099, Val Avg Corr: 0.8159
Epoch [3/20], Step 39500, Train Loss: 0.2897, Val Avg Corr: 0.8337
Epoch [3/20], Step 40000, Train Loss: 0.2524, Val Avg Corr: 0.8050
Epoch [3/20], Step 40500, Train Loss: 0.2701, Val Avg Corr: 0.8179
Epoch [3/20], Step 41000, Train Loss: 0.3110, Val Avg Corr: 0.7930
Trial change detected: 1419 -> 1422, resetting states
Epoch [3/20], Step 41500, Train Loss: 0.2843, Val Avg Corr: 0.8044
Epoch [3/20], Step 42000, Train Loss: 0.2480, Val Avg Corr: 0.8147
Epoch [3/20], Step 42500, Train Loss: 0.2463, Val Avg Corr: 0.8079
Epoch [3/20], Step 43000, Train Loss: 0.2517, Val Avg Corr: 0.8009
Epoch [3/20], Step 43500, Train Loss: 0.2201, Val Avg Corr: 0.8185
Early stopping triggered after 43500 steps in epoch 3.
  (Patience: 50 eval intervals = 25000 steps)
Loaded best model with validation Corr: 0.8340
Online SNN - X-Corr: 0.8647, Y-Corr: 0.7667