MLP_eco_Sep3_5
log/EGOAL-eco-2025-09-04-07:28:10.538015.txt
random seed: 514
train shape: torch.Size([434, 1514]), test shape: torch.Size([72, 1514])
cuda availability: True
/home/u-xiangyf/anaconda3/envs/egoal/lib/python3.13/site-packages/torch/nn/modules/loss.py:608: UserWarning: Using a target size (torch.Size([1514])) that is different to the input size (torch.Size([4639, 1514])). This will likely lead to incorrect results due to broadcasting. Please ensure they have the same size.
  return F.mse_loss(input, target, reduction=self.reduction)
Epoch 0, Loss: 0.2183
Epoch 100, Loss: 0.2103
Epoch 200, Loss: 0.2026
Epoch 300, Loss: 0.1951
Epoch 400, Loss: 0.1878
Epoch 500, Loss: 0.1808
Epoch 600, Loss: 0.1740
Epoch 700, Loss: 0.1674
Epoch 800, Loss: 0.1611
Epoch 900, Loss: 0.1549
Final loss: 0.1490613967180252
Achieved outputs: tensor([[0.4152, 0.4143, 0.3966,  ..., 0.3866, 0.4395, 0.4161],
        [0.4153, 0.4142, 0.3966,  ..., 0.3863, 0.4392, 0.4165],
        [0.4155, 0.4145, 0.3970,  ..., 0.3868, 0.4396, 0.4165],
        ...,
        [0.4152, 0.4144, 0.3965,  ..., 0.3865, 0.4393, 0.4162],
        [0.4154, 0.4142, 0.3966,  ..., 0.3863, 0.4394, 0.4165],
        [0.4152, 0.4142, 0.3969,  ..., 0.3864, 0.4394, 0.4163]],
       device='cuda:7')
Eval weight w_data: 0.4246200244007528
Before pretrain: integrated f1 0.2368
Epoch 100, Total loss: 18670780.0000, CE loss: 7.1670, RL loss: 1867077.2500, Reward: -124845.5254
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 14304, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 200, Total loss: 6979632.5000, CE loss: 6.8254, RL loss: 697962.5625, Reward: -124042.8340
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 10798, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 300, Total loss: 5171548.0000, CE loss: 6.6540, RL loss: 517154.1562, Reward: -122369.7930
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 13304, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 400, Total loss: -442622.0938, CE loss: 6.5800, RL loss: -44262.8672, Reward: -120032.7373
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 10425, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 500, Total loss: 10923397.0000, CE loss: 6.5246, RL loss: 1092339.0000, Reward: -114429.9502
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 10861, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
------ Before ABL ------
--- eval ---
prediction result:
f1 on test:    0.3308
f1 on test:    0.6633 (micro)
f1 on KB:      0.3364
integrated f1: 0.3340, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3607
f1 on test:    0.6728 (micro)
f1 on KB:      0.5244
integrated f1: 0.4549, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3340

Epoch 100, Total loss: 163703200.0000, CE loss: 4.3996, RL loss: 1637032.0000, Reward: -77664.3447
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 7268, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 200, Total loss: 14194722.0000, CE loss: 4.3065, RL loss: 141947.2188, Reward: -76725.6240
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 7136, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 300, Total loss: 227881456.0000, CE loss: 4.1874, RL loss: 2278814.5000, Reward: -72465.6309
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 9240, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 400, Total loss: 113612264.0000, CE loss: 4.0025, RL loss: 1136122.6250, Reward: -65401.2998
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 7152, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 500, Total loss: 31025568.0000, CE loss: 3.8619, RL loss: 310255.6875, Reward: -59460.1758
    full cols: 160, non-full cols: 1
   r - labels: 0, labels - r: 0
    violated: 11316, weighted: 0.1807689666748047, len: 0.0, nonzero: 0.10616537928581238
Epoch 600, Total loss: 68934336.0000, CE loss: 3.7788, RL loss: 689343.3750, Reward: -57626.5439
    full cols: 160, non-full cols: 1
   r - labels: 0, labels - r: 0
    violated: 8907, weighted: 0.6380081176757812, len: 0.0, nonzero: 0.1057216003537178
Epoch 700, Total loss: -143829888.0000, CE loss: 3.7361, RL loss: -1438298.8750, Reward: -56991.1416
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 6002, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 800, Total loss: -50871956.0000, CE loss: 3.6881, RL loss: -508719.5625, Reward: -55922.8496
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 8316, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 900, Total loss: -16735675.0000, CE loss: 3.6579, RL loss: -167356.7500, Reward: -55198.5732
    full cols: 160, non-full cols: 1
   r - labels: 0, labels - r: 0
    violated: 9323, weighted: 0.010633468627929688, len: 0.0, nonzero: 0.1063304990530014
Epoch 1000, Total loss: 63653076.0000, CE loss: 3.6242, RL loss: 636530.7500, Reward: -54536.8848
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 8030, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 1100, Total loss: -76385360.0000, CE loss: 3.5913, RL loss: -763853.5625, Reward: -54381.0811
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 9306, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 1200, Total loss: -784134.6875, CE loss: 3.5748, RL loss: -7841.3467, Reward: -53445.0195
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 9589, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 1300, Total loss: -22366190.0000, CE loss: 3.5474, RL loss: -223661.8906, Reward: -53128.4951
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 9433, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 1400, Total loss: -51668144.0000, CE loss: 3.5342, RL loss: -516681.4375, Reward: -52933.1768
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 9083, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 1500, Total loss: 40307008.0000, CE loss: 3.5026, RL loss: 403070.0625, Reward: -52520.2090
    full cols: 160, non-full cols: 1
   r - labels: 0, labels - r: 0
    violated: 8628, weighted: 0.6699085235595703, len: 0.0, nonzero: 0.10569064319133759
Epoch 1600, Total loss: -49462528.0000, CE loss: 3.4933, RL loss: -494625.2812, Reward: -52513.1230
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 6957, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 1700, Total loss: 21459496.0000, CE loss: 3.4791, RL loss: 214594.9531, Reward: -52076.1660
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 9076, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 1800, Total loss: -46895052.0000, CE loss: 3.4570, RL loss: -468950.5312, Reward: -52226.7979
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 9953, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 1900, Total loss: 21402378.0000, CE loss: 3.4479, RL loss: 214023.7812, Reward: -51764.7959
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 8899, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
--- eval ---
prediction result:
f1 on test:    0.3704
f1 on test:    0.6597 (micro)
f1 on KB:      0.3688
integrated f1: 0.3693, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3609
f1 on test:    0.6726 (micro)
f1 on KB:      0.5237
integrated f1: 0.4749, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: -50715608.0000, CE loss: 3.4354, RL loss: -507156.0625, Reward: -51791.0723
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 8841, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 2100, Total loss: 40219428.0000, CE loss: 3.4207, RL loss: 402194.2812, Reward: -51456.8154
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 8903, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 2200, Total loss: 50518100.0000, CE loss: 3.4029, RL loss: 505181.0000, Reward: -51277.4111
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 7618, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 2300, Total loss: -3669030.0000, CE loss: 3.3810, RL loss: -36690.3008, Reward: -51263.8652
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 7056, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 2400, Total loss: -23618218.0000, CE loss: 3.3669, RL loss: -236182.1875, Reward: -51317.7354
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 12155, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 2500, Total loss: 65432848.0000, CE loss: 3.3502, RL loss: 654328.5000, Reward: -50999.7637
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 9839, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 2600, Total loss: 79793416.0000, CE loss: 3.3160, RL loss: 797934.1250, Reward: -50923.5195
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 9182, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 2700, Total loss: 139610528.0000, CE loss: 3.3034, RL loss: 1396105.2500, Reward: -50832.8418
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 9407, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 2800, Total loss: -12797927.0000, CE loss: 3.2786, RL loss: -127979.2734, Reward: -51247.2168
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 9806, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 2900, Total loss: 3691365.2500, CE loss: 3.2604, RL loss: 36913.6523, Reward: -51259.9951
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 7873, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 3000, Total loss: -62977232.0000, CE loss: 3.2420, RL loss: -629772.3125, Reward: -51583.7139
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 10254, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 3100, Total loss: 65013444.0000, CE loss: 3.2238, RL loss: 650134.4375, Reward: -51291.1611
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 7953, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 3200, Total loss: 99736880.0000, CE loss: 3.2072, RL loss: 997368.8125, Reward: -51097.4414
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 8721, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 3300, Total loss: -37402604.0000, CE loss: 3.1905, RL loss: -374026.0312, Reward: -51454.2979
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 9659, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 3400, Total loss: -56452420.0000, CE loss: 3.1768, RL loss: -564524.1875, Reward: -51714.9668
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 6766, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 3500, Total loss: -57058724.0000, CE loss: 3.1622, RL loss: -570587.2500, Reward: -51837.5000
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 9199, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 3600, Total loss: -26853868.0000, CE loss: 3.1519, RL loss: -268538.6875, Reward: -51742.6582
    full cols: 160, non-full cols: 1
   r - labels: 0, labels - r: 0
    violated: 8557, weighted: 0.6273746490478516, len: 0.0, nonzero: 0.10573191940784454
Epoch 3700, Total loss: 93736408.0000, CE loss: 3.1417, RL loss: 937364.0625, Reward: -51502.6113
    full cols: 161, non-full cols: 0
   r - labels: 1, labels - r: 1
    violated: 8058, weighted: 3.7647056579589844, len: 0.0, nonzero: 0.10634082555770874
Epoch 3800, Total loss: -41823208.0000, CE loss: 3.1291, RL loss: -418232.0625, Reward: -51996.6455
    full cols: 161, non-full cols: 1
   r - labels: 2, labels - r: 1
    violated: 7756, weighted: 4.79570198059082, len: 0.0, nonzero: 0.10684651881456375
Epoch 3900, Total loss: -133484184.0000, CE loss: 3.1228, RL loss: -1334841.8750, Reward: -52276.1025
    full cols: 162, non-full cols: 0
   r - labels: 2, labels - r: 1
    violated: 7599, weighted: 5.1113128662109375, len: 0.0, nonzero: 0.10700132697820663
--- eval ---
prediction result:
f1 on test:    0.3871
f1 on test:    0.6441 (micro)
f1 on KB:      0.3698
integrated f1: 0.3748, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3612
f1 on test:    0.6725 (micro)
f1 on KB:      0.5245
integrated f1: 0.4755, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: -22145666.0000, CE loss: 3.1189, RL loss: -221456.6562, Reward: -52071.2617
    full cols: 162, non-full cols: 0
   r - labels: 2, labels - r: 1
    violated: 7621, weighted: 5.1113128662109375, len: 0.0, nonzero: 0.10700132697820663
Epoch 4100, Total loss: 86343840.0000, CE loss: 3.1150, RL loss: 863438.3750, Reward: -51984.6113
    full cols: 162, non-full cols: 0
   r - labels: 2, labels - r: 1
    violated: 9383, weighted: 5.1113128662109375, len: 0.0, nonzero: 0.10700132697820663
Epoch 4200, Total loss: -133857352.0000, CE loss: 3.1123, RL loss: -1338573.5000, Reward: -52574.3242
    full cols: 162, non-full cols: 1
   r - labels: 3, labels - r: 1
    violated: 8381, weighted: 5.457919120788574, len: 0.0, nonzero: 0.10704260319471359
Epoch 4300, Total loss: 30003724.0000, CE loss: 3.1093, RL loss: 300037.2500, Reward: -52162.1543
    full cols: 162, non-full cols: 1
   r - labels: 2, labels - r: 0
    violated: 10250, weighted: 5.090045928955078, len: 0.0, nonzero: 0.10702196508646011
Epoch 4400, Total loss: -51231836.0000, CE loss: 3.1079, RL loss: -512318.3438, Reward: -52421.0840
    full cols: 164, non-full cols: 1
   r - labels: 4, labels - r: 0
    violated: 8375, weighted: 10.970136642456055, len: 0.0, nonzero: 0.10857001692056656
Epoch 4500, Total loss: -18321212.0000, CE loss: 3.1080, RL loss: -183212.1250, Reward: -52329.7412
    full cols: 164, non-full cols: 0
   r - labels: 3, labels - r: 0
    violated: 8619, weighted: 9.976470947265625, len: 0.0, nonzero: 0.10832232981920242
Epoch 4600, Total loss: -73020264.0000, CE loss: 3.1044, RL loss: -730202.6250, Reward: -52569.2012
    full cols: 164, non-full cols: 1
   r - labels: 4, labels - r: 0
    violated: 6449, weighted: 13.279411315917969, len: 0.0, nonzero: 0.10845649242401123
Epoch 4700, Total loss: -36031820.0000, CE loss: 3.1018, RL loss: -360318.2188, Reward: -52537.5762
    full cols: 167, non-full cols: 0
   r - labels: 6, labels - r: 0
    violated: 8467, weighted: 35.4461555480957, len: 0.0, nonzero: 0.1103038340806961
Epoch 4800, Total loss: 83054912.0000, CE loss: 3.1025, RL loss: 830549.1250, Reward: -52240.1582
    full cols: 166, non-full cols: 1
   r - labels: 6, labels - r: 0
    violated: 9567, weighted: 20.709957122802734, len: 0.0, nonzero: 0.10970525443553925
Epoch 4900, Total loss: -88562624.0000, CE loss: 3.1017, RL loss: -885626.2500, Reward: -52775.9512
    full cols: 166, non-full cols: 1
   r - labels: 6, labels - r: 0
    violated: 7165, weighted: 19.10452651977539, len: 0.0, nonzero: 0.11020062863826752
Epoch 5000, Total loss: -27595050.0000, CE loss: 3.0992, RL loss: -275950.5000, Reward: -52593.3281
    full cols: 166, non-full cols: 2
   r - labels: 7, labels - r: 0
    violated: 7382, weighted: 23.663803100585938, len: 0.0, nonzero: 0.11044831573963165
Epoch 5100, Total loss: -112157872.0000, CE loss: 3.0993, RL loss: -1121578.7500, Reward: -52866.6035
    full cols: 164, non-full cols: 0
   r - labels: 3, labels - r: 0
    violated: 10308, weighted: 10.990047454833984, len: 0.0, nonzero: 0.10832232981920242
Epoch 5200, Total loss: -15437072.0000, CE loss: 3.1008, RL loss: -154370.7188, Reward: -52613.6406
    full cols: 163, non-full cols: 1
   r - labels: 3, labels - r: 0
    violated: 8902, weighted: 10.893667221069336, len: 0.0, nonzero: 0.10830168426036835
Epoch 5300, Total loss: 53355352.0000, CE loss: 3.0965, RL loss: 533553.5000, Reward: -52529.4658
    full cols: 164, non-full cols: 2
   r - labels: 6, labels - r: 1
    violated: 10641, weighted: 32.8873291015625, len: 0.0, nonzero: 0.10885898768901825
Epoch 5400, Total loss: -97147792.0000, CE loss: 3.0952, RL loss: -971477.9375, Reward: -52909.3721
    full cols: 164, non-full cols: 3
   r - labels: 6, labels - r: 0
    violated: 7895, weighted: 61.75294494628906, len: 0.0, nonzero: 0.11005614697933197
Epoch 5500, Total loss: 54380644.0000, CE loss: 3.0985, RL loss: 543806.4375, Reward: -52591.0684
    full cols: 164, non-full cols: 2
   r - labels: 6, labels - r: 1
    violated: 7491, weighted: 65.55723571777344, len: 0.0, nonzero: 0.10907571017742157
Epoch 5600, Total loss: 6022736.0000, CE loss: 3.0966, RL loss: 60227.3594, Reward: -52757.3516
    full cols: 163, non-full cols: 1
   r - labels: 6, labels - r: 3
    violated: 8582, weighted: 83.20791625976562, len: 0.0, nonzero: 0.10816752165555954
Epoch 5700, Total loss: -153799040.0000, CE loss: 3.0968, RL loss: -1537990.3750, Reward: -53185.2080
    full cols: 162, non-full cols: 1
   r - labels: 5, labels - r: 3
    violated: 8023, weighted: 58.394344329833984, len: 0.0, nonzero: 0.10701164603233337
Epoch 5800, Total loss: 19585814.0000, CE loss: 3.0970, RL loss: 195858.1406, Reward: -52813.2744
    full cols: 165, non-full cols: 2
   r - labels: 8, labels - r: 2
    violated: 6240, weighted: 80.51290130615234, len: 0.0, nonzero: 0.10936468094587326
Epoch 5900, Total loss: 58433756.0000, CE loss: 3.0956, RL loss: 584337.5625, Reward: -52719.4463
    full cols: 165, non-full cols: 0
   r - labels: 6, labels - r: 2
    violated: 7044, weighted: 60.65520477294922, len: 0.0, nonzero: 0.10898283123970032
--- eval ---
prediction result:
f1 on test:    0.3873
f1 on test:    0.6441 (micro)
f1 on KB:      0.3702
integrated f1: 0.3751, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3600
f1 on test:    0.6720 (micro)
f1 on KB:      0.5257
integrated f1: 0.4760, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: 69364752.0000, CE loss: 3.0955, RL loss: 693647.5000, Reward: -52710.1250
    full cols: 167, non-full cols: 0
   r - labels: 8, labels - r: 2
    violated: 8586, weighted: 121.51312255859375, len: 0.0, nonzero: 0.1103038340806961
Epoch 6100, Total loss: 77403744.0000, CE loss: 3.0952, RL loss: 774037.4375, Reward: -52746.6699
    full cols: 166, non-full cols: 0
   r - labels: 7, labels - r: 2
    violated: 7902, weighted: 89.51312255859375, len: 0.0, nonzero: 0.10964333266019821
Epoch 6200, Total loss: -18684518.0000, CE loss: 3.0956, RL loss: -186845.1719, Reward: -53003.2178
    full cols: 169, non-full cols: 0
   r - labels: 10, labels - r: 2
    violated: 8656, weighted: 129.56381225585938, len: 0.0, nonzero: 0.1116248369216919
Epoch 6300, Total loss: 151315504.0000, CE loss: 3.0932, RL loss: 1513155.0000, Reward: -52655.6289
    full cols: 169, non-full cols: 1
   r - labels: 11, labels - r: 2
    violated: 9177, weighted: 137.2676544189453, len: 0.0, nonzero: 0.11180028319358826
Epoch 6400, Total loss: -62911864.0000, CE loss: 3.0930, RL loss: -629118.6250, Reward: -53155.5986
    full cols: 166, non-full cols: 3
   r - labels: 10, labels - r: 2
    violated: 8415, weighted: 134.20700073242188, len: 0.0, nonzero: 0.11132554709911346
Epoch 6500, Total loss: -94869960.0000, CE loss: 3.0936, RL loss: -948699.6250, Reward: -53257.4492
    full cols: 169, non-full cols: 0
   r - labels: 10, labels - r: 2
    violated: 7028, weighted: 144.76742553710938, len: 0.0, nonzero: 0.1116248369216919
Epoch 6600, Total loss: 97334736.0000, CE loss: 3.0937, RL loss: 973347.3750, Reward: -52825.7041
    full cols: 168, non-full cols: 1
   r - labels: 10, labels - r: 2
    violated: 8727, weighted: 128.0839385986328, len: 0.0, nonzero: 0.11124298721551895
Epoch 6700, Total loss: -13139500.0000, CE loss: 3.0936, RL loss: -131395.0000, Reward: -53149.7744
    full cols: 165, non-full cols: 1
   r - labels: 7, labels - r: 2
    violated: 9459, weighted: 91.88371276855469, len: 0.0, nonzero: 0.10938532650470734
Epoch 6800, Total loss: -7999878.0000, CE loss: 3.0943, RL loss: -79998.7812, Reward: -53075.7812
    full cols: 166, non-full cols: 2
   r - labels: 8, labels - r: 1
    violated: 10568, weighted: 82.86199188232422, len: 0.0, nonzero: 0.11061344295740128
Epoch 6900, Total loss: 3509995.2500, CE loss: 3.0902, RL loss: 35099.9531, Reward: -53072.2920
    full cols: 166, non-full cols: 1
   r - labels: 9, labels - r: 3
    violated: 8495, weighted: 92.50338745117188, len: 0.0, nonzero: 0.11025223135948181
Epoch 7000, Total loss: 16955354.0000, CE loss: 3.0943, RL loss: 169553.5312, Reward: -53080.7109
    full cols: 166, non-full cols: 1
   r - labels: 9, labels - r: 3
    violated: 8038, weighted: 89.78439331054688, len: 0.0, nonzero: 0.11019030958414078
Epoch 7100, Total loss: -130783328.0000, CE loss: 3.0927, RL loss: -1307833.2500, Reward: -53469.4844
    full cols: 166, non-full cols: 2
   r - labels: 9, labels - r: 2
    violated: 9387, weighted: 86.37850952148438, len: 0.0, nonzero: 0.11052056401968002
Epoch 7200, Total loss: -57212208.0000, CE loss: 3.0931, RL loss: -572122.0625, Reward: -53297.3711
    full cols: 167, non-full cols: 3
   r - labels: 11, labels - r: 2
    violated: 9181, weighted: 128.00225830078125, len: 0.0, nonzero: 0.11153195798397064
Epoch 7300, Total loss: 957913.6875, CE loss: 3.0911, RL loss: 9579.1367, Reward: -53184.3877
    full cols: 168, non-full cols: 1
   r - labels: 10, labels - r: 2
    violated: 8891, weighted: 79.77262878417969, len: 0.0, nonzero: 0.11097465455532074
Epoch 7400, Total loss: -45310708.0000, CE loss: 3.0903, RL loss: -453107.0625, Reward: -53270.7188
    full cols: 167, non-full cols: 2
   r - labels: 10, labels - r: 2
    violated: 9346, weighted: 104.88800811767578, len: 0.0, nonzero: 0.11142875254154205
Epoch 7500, Total loss: -70157112.0000, CE loss: 3.0929, RL loss: -701571.1250, Reward: -53350.9023
    full cols: 166, non-full cols: 1
   r - labels: 8, labels - r: 2
    violated: 7861, weighted: 86.65022277832031, len: 0.0, nonzero: 0.110118068754673
Epoch 7600, Total loss: 136879248.0000, CE loss: 3.0911, RL loss: 1368792.5000, Reward: -52764.3105
    full cols: 168, non-full cols: 0
   r - labels: 9, labels - r: 2
    violated: 8246, weighted: 98.09954833984375, len: 0.0, nonzero: 0.110964335501194
Epoch 7700, Total loss: 31140822.0000, CE loss: 3.0911, RL loss: 311408.2188, Reward: -53101.9375
    full cols: 169, non-full cols: 0
   r - labels: 10, labels - r: 2
    violated: 8002, weighted: 92.82894897460938, len: 0.0, nonzero: 0.1116248369216919
Epoch 7800, Total loss: -9988397.0000, CE loss: 3.0907, RL loss: -99883.9688, Reward: -53152.8643
    full cols: 169, non-full cols: 2
   r - labels: 12, labels - r: 2
    violated: 7721, weighted: 146.93597412109375, len: 0.0, nonzero: 0.11202733218669891
Epoch 7900, Total loss: -34351976.0000, CE loss: 3.0902, RL loss: -343519.7500, Reward: -53192.2881
    full cols: 171, non-full cols: 2
   r - labels: 14, labels - r: 2
    violated: 10022, weighted: 169.29910278320312, len: 0.0, nonzero: 0.11383339017629623
--- eval ---
prediction result:
f1 on test:    0.3873
f1 on test:    0.6441 (micro)
f1 on KB:      0.3702
integrated f1: 0.3751, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3615
f1 on test:    0.6716 (micro)
f1 on KB:      0.5305
integrated f1: 0.4798, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: 65314392.0000, CE loss: 3.0884, RL loss: 653143.9375, Reward: -52928.9209
    full cols: 170, non-full cols: 2
   r - labels: 14, labels - r: 3
    violated: 10504, weighted: 170.25430297851562, len: 0.0, nonzero: 0.11306968331336975
------ ABL Loop 0 ------
--- eval ---
prediction result:
f1 on test:    0.3873
f1 on test:    0.6441 (micro)
f1 on KB:      0.3702
integrated f1: 0.3772, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3615
f1 on test:    0.6716 (micro)
f1 on KB:      0.5305
integrated f1: 0.4587, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3772
Iteration 0: Loss = 129532.179688
|Xk-Y|_F:  129532.179688, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 113484, f1 =  0.314404, approx slack: 1001
rounded before pow |X_k-Y|_0 = 113484, f1 =  0.314404

Iteration 20: Loss = 129052.398438
|Xk-Y|_F:  128108.703125, |X-X0|:  943.698059
rounded |X_k-Y|_0 = 113097, f1 =  0.316907, approx slack: 239
rounded before pow |X_k-Y|_0 = 113146, f1 =  0.316592

Iteration 40: Loss = 127272.632812
|Xk-Y|_F:  127035.359375, |X-X0|:  237.272629
rounded |X_k-Y|_0 = 113090, f1 =  0.316952, approx slack: 218
rounded before pow |X_k-Y|_0 = 113099, f1 =  0.316900

Iteration 60: Loss = 125944.960938
|Xk-Y|_F:  125827.187500, |X-X0|:  117.772675
rounded |X_k-Y|_0 = 113097, f1 =  0.316907, approx slack: 143
rounded before pow |X_k-Y|_0 = 113100, f1 =  0.316893

Iteration 80: Loss = 124534.546875
|Xk-Y|_F:  124430.773438, |X-X0|:  103.774780
rounded |X_k-Y|_0 = 113097, f1 =  0.316907, approx slack: 147
rounded before pow |X_k-Y|_0 = 113102, f1 =  0.316881

Iteration 100: Loss = 122936.187500
|Xk-Y|_F:  122831.984375, |X-X0|:  104.201012
rounded |X_k-Y|_0 = 113048, f1 =  0.317028, approx slack: 304
rounded before pow |X_k-Y|_0 = 112967, f1 =  0.317748

Iteration 120: Loss = 121112.023438
|Xk-Y|_F:  121005.359375, |X-X0|:  106.663506
rounded |X_k-Y|_0 = 103336, f1 =  0.324079, approx slack: 12585
rounded before pow |X_k-Y|_0 = 112967, f1 =  0.317748

Iteration 140: Loss = 119009.421875
|Xk-Y|_F:  118902.585938, |X-X0|:  106.837814
rounded |X_k-Y|_0 = 103332, f1 =  0.324089, approx slack: 24019
rounded before pow |X_k-Y|_0 = 112967, f1 =  0.317748

Iteration 160: Loss = 116565.109375
|Xk-Y|_F:  116457.687500, |X-X0|:  107.421021
rounded |X_k-Y|_0 = 103337, f1 =  0.324060, approx slack: 25230
rounded before pow |X_k-Y|_0 = 112967, f1 =  0.317748

Iteration 180: Loss = 113687.632812
|Xk-Y|_F:  113580.351562, |X-X0|:  107.277924
rounded |X_k-Y|_0 = 102457, f1 =  0.324627, approx slack: 27628
rounded before pow |X_k-Y|_0 = 112964, f1 =  0.317767

Iteration 200: Loss = 110265.765625
|Xk-Y|_F:  110158.984375, |X-X0|:  106.780884
rounded |X_k-Y|_0 = 97828, f1 =  0.328191, approx slack: 34330
rounded before pow |X_k-Y|_0 = 113376, f1 =  0.317737

Iteration 220: Loss = 106167.179688
|Xk-Y|_F:  106059.367188, |X-X0|:  107.812592
rounded |X_k-Y|_0 = 95662, f1 =  0.329934, approx slack: 41342
rounded before pow |X_k-Y|_0 = 113376, f1 =  0.317737

Iteration 240: Loss = 101199.906250
|Xk-Y|_F:  101089.492188, |X-X0|:  110.413292
rounded |X_k-Y|_0 = 92090, f1 =  0.332727, approx slack: 50117
rounded before pow |X_k-Y|_0 = 113730, f1 =  0.317621

Iteration 260: Loss = 95071.234375
|Xk-Y|_F:  94957.148438, |X-X0|:  114.088654
rounded |X_k-Y|_0 = 87148, f1 =  0.336852, approx slack: 60904
rounded before pow |X_k-Y|_0 = 113959, f1 =  0.317589

Iteration 280: Loss = 87480.765625
|Xk-Y|_F:  87361.500000, |X-X0|:  119.267609
rounded |X_k-Y|_0 = 80967, f1 =  0.342224, approx slack: 79920
rounded before pow |X_k-Y|_0 = 115697, f1 =  0.317236

Iteration 300: Loss = 78438.882812
|Xk-Y|_F:  78316.062500, |X-X0|:  122.822250
rounded |X_k-Y|_0 = 73669, f1 =  0.349269, approx slack: 99417
rounded before pow |X_k-Y|_0 = 116159, f1 =  0.317215

Iteration 320: Loss = 68556.250000
|Xk-Y|_F:  68431.117188, |X-X0|:  125.135597
rounded |X_k-Y|_0 = 64456, f1 =  0.359167, approx slack: 120174
rounded before pow |X_k-Y|_0 = 116390, f1 =  0.317171

Iteration 340: Loss = 58771.718750
|Xk-Y|_F:  58639.761719, |X-X0|:  131.957321
rounded |X_k-Y|_0 = 54785, f1 =  0.371271, approx slack: 144346
rounded before pow |X_k-Y|_0 = 116619, f1 =  0.317134

Iteration 360: Loss = 49903.089844
|Xk-Y|_F:  49762.128906, |X-X0|:  140.960815
rounded |X_k-Y|_0 = 46154, f1 =  0.384790, approx slack: 168790
rounded before pow |X_k-Y|_0 = 116889, f1 =  0.317289

Iteration 380: Loss = 42700.710938
|Xk-Y|_F:  42548.566406, |X-X0|:  152.144730
rounded |X_k-Y|_0 = 39177, f1 =  0.400964, approx slack: 208369
rounded before pow |X_k-Y|_0 = 124361, f1 =  0.312607

Iteration 400: Loss = 37564.496094
|Xk-Y|_F:  37397.539062, |X-X0|:  166.956055
rounded |X_k-Y|_0 = 34003, f1 =  0.418541, approx slack: 237689
rounded before pow |X_k-Y|_0 = 128151, f1 =  0.310581

Iteration 420: Loss = 34283.515625
|Xk-Y|_F:  34095.726562, |X-X0|:  187.787537
rounded |X_k-Y|_0 = 30995, f1 =  0.434537, approx slack: 322831
rounded before pow |X_k-Y|_0 = 156095, f1 =  0.293550

Iteration 440: Loss = 32264.492188
|Xk-Y|_F:  32045.943359, |X-X0|:  218.548767
rounded |X_k-Y|_0 = 29502, f1 =  0.446633, approx slack: 355057
rounded before pow |X_k-Y|_0 = 161400, f1 =  0.291148

Iteration 460: Loss = 30963.136719
|Xk-Y|_F:  30711.925781, |X-X0|:  251.211868
rounded |X_k-Y|_0 = 28847, f1 =  0.456467, approx slack: 371725
rounded before pow |X_k-Y|_0 = 164996, f1 =  0.289335

Iteration 480: Loss = 30084.242188
|Xk-Y|_F:  29810.322266, |X-X0|:  273.920319
rounded |X_k-Y|_0 = 28289, f1 =  0.471868, approx slack: 388720
rounded before pow |X_k-Y|_0 = 169535, f1 =  0.286904

Iteration 500: Loss = 29461.498047
|Xk-Y|_F:  29162.529297, |X-X0|:  298.968536
rounded |X_k-Y|_0 = 27968, f1 =  0.481632, approx slack: 427308
rounded before pow |X_k-Y|_0 = 183080, f1 =  0.278764

Iteration 520: Loss = 28964.929688
|Xk-Y|_F:  28631.066406, |X-X0|:  333.863342
rounded |X_k-Y|_0 = 27649, f1 =  0.496173, approx slack: 492584
rounded before pow |X_k-Y|_0 = 206928, f1 =  0.263768

Iteration 540: Loss = 28501.324219
|Xk-Y|_F:  28118.083984, |X-X0|:  383.239258
rounded |X_k-Y|_0 = 27434, f1 =  0.507943, approx slack: 568968
rounded before pow |X_k-Y|_0 = 232508, f1 =  0.247101

Iteration 560: Loss = 28072.474609
|Xk-Y|_F:  27664.851562, |X-X0|:  407.622162
rounded |X_k-Y|_0 = 26970, f1 =  0.531023, approx slack: 577812
rounded before pow |X_k-Y|_0 = 235211, f1 =  0.245266

Iteration 580: Loss = 27783.306641
|Xk-Y|_F:  27381.724609, |X-X0|:  401.581451
rounded |X_k-Y|_0 = 26650, f1 =  0.545544, approx slack: 572091
rounded before pow |X_k-Y|_0 = 234142, f1 =  0.246015

Iteration 600: Loss = 27584.183594
|Xk-Y|_F:  27182.306641, |X-X0|:  401.877167
rounded |X_k-Y|_0 = 26496, f1 =  0.551767, approx slack: 560566
rounded before pow |X_k-Y|_0 = 229506, f1 =  0.249194

Iteration 620: Loss = 27423.701172
|Xk-Y|_F:  27027.458984, |X-X0|:  396.241455
rounded |X_k-Y|_0 = 26389, f1 =  0.555829, approx slack: 550908
rounded before pow |X_k-Y|_0 = 227388, f1 =  0.250722

Iteration 640: Loss = 27309.839844
|Xk-Y|_F:  26914.085938, |X-X0|:  395.753967
rounded |X_k-Y|_0 = 26370, f1 =  0.556567, approx slack: 541697
rounded before pow |X_k-Y|_0 = 223519, f1 =  0.253396

Iteration 660: Loss = 27217.253906
|Xk-Y|_F:  26822.148438, |X-X0|:  395.104736
rounded |X_k-Y|_0 = 26359, f1 =  0.556829, approx slack: 536189
rounded before pow |X_k-Y|_0 = 221369, f1 =  0.254875

Iteration 680: Loss = 27140.636719
|Xk-Y|_F:  26743.892578, |X-X0|:  396.743927
rounded |X_k-Y|_0 = 26343, f1 =  0.557235, approx slack: 525137
rounded before pow |X_k-Y|_0 = 216812, f1 =  0.257996

Iteration 700: Loss = 27073.667969
|Xk-Y|_F:  26676.654297, |X-X0|:  397.014221
rounded |X_k-Y|_0 = 26330, f1 =  0.557676, approx slack: 519291
rounded before pow |X_k-Y|_0 = 214360, f1 =  0.259672

Iteration 720: Loss = 27015.636719
|Xk-Y|_F:  26614.863281, |X-X0|:  400.774292
rounded |X_k-Y|_0 = 26321, f1 =  0.558021, approx slack: 517380
rounded before pow |X_k-Y|_0 = 213480, f1 =  0.260270

Iteration 740: Loss = 26963.406250
|Xk-Y|_F:  26557.814453, |X-X0|:  405.592163
rounded |X_k-Y|_0 = 26302, f1 =  0.558607, approx slack: 514930
rounded before pow |X_k-Y|_0 = 212403, f1 =  0.261002

Iteration 760: Loss = 26916.201172
|Xk-Y|_F:  26505.609375, |X-X0|:  410.590851
rounded |X_k-Y|_0 = 26291, f1 =  0.558887, approx slack: 515398
rounded before pow |X_k-Y|_0 = 212532, f1 =  0.260913

Iteration 780: Loss = 26871.898438
|Xk-Y|_F:  26458.410156, |X-X0|:  413.487915
rounded |X_k-Y|_0 = 26282, f1 =  0.559158, approx slack: 512991
rounded before pow |X_k-Y|_0 = 211457, f1 =  0.261643

Iteration 800: Loss = 26830.437500
|Xk-Y|_F:  26414.060547, |X-X0|:  416.376801
rounded |X_k-Y|_0 = 26256, f1 =  0.559847, approx slack: 511784
rounded before pow |X_k-Y|_0 = 210929, f1 =  0.262002

Iteration 820: Loss = 26790.167969
|Xk-Y|_F:  26373.742188, |X-X0|:  416.426697
rounded |X_k-Y|_0 = 26244, f1 =  0.560208, approx slack: 505824
rounded before pow |X_k-Y|_0 = 209560, f1 =  0.262932

Iteration 840: Loss = 26752.873047
|Xk-Y|_F:  26334.451172, |X-X0|:  418.421326
rounded |X_k-Y|_0 = 26237, f1 =  0.560418, approx slack: 505621
rounded before pow |X_k-Y|_0 = 209433, f1 =  0.263017

Iteration 860: Loss = 26719.851562
|Xk-Y|_F:  26297.826172, |X-X0|:  422.024475
rounded |X_k-Y|_0 = 26213, f1 =  0.561247, approx slack: 506021
rounded before pow |X_k-Y|_0 = 209618, f1 =  0.262890

Iteration 880: Loss = 26687.867188
|Xk-Y|_F:  26262.419922, |X-X0|:  425.448242
rounded |X_k-Y|_0 = 26186, f1 =  0.562029, approx slack: 506347
rounded before pow |X_k-Y|_0 = 209738, f1 =  0.262807

Iteration 900: Loss = 26655.888672
|Xk-Y|_F:  26227.919922, |X-X0|:  427.968201
rounded |X_k-Y|_0 = 26160, f1 =  0.562812, approx slack: 505917
rounded before pow |X_k-Y|_0 = 209544, f1 =  0.262938

Iteration 920: Loss = 26624.449219
|Xk-Y|_F:  26193.671875, |X-X0|:  430.777191
rounded |X_k-Y|_0 = 26143, f1 =  0.563318, approx slack: 497928
rounded before pow |X_k-Y|_0 = 206432, f1 =  0.265043

Iteration 940: Loss = 26594.167969
|Xk-Y|_F:  26161.621094, |X-X0|:  432.547363
rounded |X_k-Y|_0 = 26136, f1 =  0.563511, approx slack: 497992
rounded before pow |X_k-Y|_0 = 206432, f1 =  0.265043

Iteration 960: Loss = 26565.771484
|Xk-Y|_F:  26129.748047, |X-X0|:  436.023987
rounded |X_k-Y|_0 = 26123, f1 =  0.563905, approx slack: 498326
rounded before pow |X_k-Y|_0 = 206580, f1 =  0.264941

Iteration 980: Loss = 26537.748047
|Xk-Y|_F:  26097.017578, |X-X0|:  440.730652
rounded |X_k-Y|_0 = 26104, f1 =  0.564456, approx slack: 490981
rounded before pow |X_k-Y|_0 = 203753, f1 =  0.266850

Iteration 1000: Loss = 26509.830078
|Xk-Y|_F:  26063.632812, |X-X0|:  446.196472
rounded |X_k-Y|_0 = 26091, f1 =  0.564855, approx slack: 491177
rounded before pow |X_k-Y|_0 = 203869, f1 =  0.266771

Iteration 1020: Loss = 26480.751953
|Xk-Y|_F:  26029.589844, |X-X0|:  451.162720
rounded |X_k-Y|_0 = 26077, f1 =  0.565355, approx slack: 503207
rounded before pow |X_k-Y|_0 = 204167, f1 =  0.266566

Iteration 1040: Loss = 26450.359375
|Xk-Y|_F:  25993.142578, |X-X0|:  457.217529
rounded |X_k-Y|_0 = 26059, f1 =  0.566037, approx slack: 506687
rounded before pow |X_k-Y|_0 = 204708, f1 =  0.266194

Iteration 1060: Loss = 26417.591797
|Xk-Y|_F:  25954.853516, |X-X0|:  462.739075
rounded |X_k-Y|_0 = 26044, f1 =  0.566532, approx slack: 520502
rounded before pow |X_k-Y|_0 = 205652, f1 =  0.265555

Iteration 1080: Loss = 26380.212891
|Xk-Y|_F:  25914.691406, |X-X0|:  465.520996
rounded |X_k-Y|_0 = 26025, f1 =  0.567268, approx slack: 523753
rounded before pow |X_k-Y|_0 = 206044, f1 =  0.265286

Iteration 1100: Loss = 26344.826172
|Xk-Y|_F:  25873.716797, |X-X0|:  471.109924
rounded |X_k-Y|_0 = 26001, f1 =  0.568216, approx slack: 523461
rounded before pow |X_k-Y|_0 = 206100, f1 =  0.265247

Iteration 1120: Loss = 26306.486328
|Xk-Y|_F:  25833.046875, |X-X0|:  473.440247
rounded |X_k-Y|_0 = 25970, f1 =  0.569282, approx slack: 524059
rounded before pow |X_k-Y|_0 = 206323, f1 =  0.265094

Iteration 1140: Loss = 26267.814453
|Xk-Y|_F:  25790.132812, |X-X0|:  477.680725
rounded |X_k-Y|_0 = 25930, f1 =  0.570831, approx slack: 522806
rounded before pow |X_k-Y|_0 = 205930, f1 =  0.265359

Iteration 1160: Loss = 26226.277344
|Xk-Y|_F:  25747.492188, |X-X0|:  478.785889
rounded |X_k-Y|_0 = 25876, f1 =  0.573002, approx slack: 522493
rounded before pow |X_k-Y|_0 = 205913, f1 =  0.265370

Iteration 1180: Loss = 26186.246094
|Xk-Y|_F:  25705.400391, |X-X0|:  480.845276
rounded |X_k-Y|_0 = 25824, f1 =  0.574819, approx slack: 522180
rounded before pow |X_k-Y|_0 = 205913, f1 =  0.265370

Iteration 1200: Loss = 26149.447266
|Xk-Y|_F:  25666.052734, |X-X0|:  483.395203
rounded |X_k-Y|_0 = 25778, f1 =  0.576730, approx slack: 522226
rounded before pow |X_k-Y|_0 = 206061, f1 =  0.265269

Iteration 1220: Loss = 26113.810547
|Xk-Y|_F:  25627.976562, |X-X0|:  485.834412
rounded |X_k-Y|_0 = 25749, f1 =  0.577857, approx slack: 522120
rounded before pow |X_k-Y|_0 = 206061, f1 =  0.265269

Iteration 1240: Loss = 26078.640625
|Xk-Y|_F:  25590.625000, |X-X0|:  488.014709
rounded |X_k-Y|_0 = 25698, f1 =  0.579814, approx slack: 523583
rounded before pow |X_k-Y|_0 = 207251, f1 =  0.264449

Iteration 1260: Loss = 26043.070312
|Xk-Y|_F:  25554.335938, |X-X0|:  488.733612
rounded |X_k-Y|_0 = 25655, f1 =  0.581472, approx slack: 530783
rounded before pow |X_k-Y|_0 = 209542, f1 =  0.262868

Iteration 1280: Loss = 26009.712891
|Xk-Y|_F:  25521.222656, |X-X0|:  488.489380
rounded |X_k-Y|_0 = 25619, f1 =  0.582878, approx slack: 530666
rounded before pow |X_k-Y|_0 = 209542, f1 =  0.262868

Iteration 1300: Loss = 25978.406250
|Xk-Y|_F:  25489.216797, |X-X0|:  489.189148
rounded |X_k-Y|_0 = 25579, f1 =  0.584323, approx slack: 530478
rounded before pow |X_k-Y|_0 = 209422, f1 =  0.262951

Iteration 1320: Loss = 25947.267578
|Xk-Y|_F:  25459.630859, |X-X0|:  487.636292
rounded |X_k-Y|_0 = 25541, f1 =  0.585757, approx slack: 530221
rounded before pow |X_k-Y|_0 = 209274, f1 =  0.263053

Iteration 1340: Loss = 25919.265625
|Xk-Y|_F:  25431.324219, |X-X0|:  487.941284
rounded |X_k-Y|_0 = 25512, f1 =  0.586883, approx slack: 530201
rounded before pow |X_k-Y|_0 = 209274, f1 =  0.263053

Iteration 1360: Loss = 25891.150391
|Xk-Y|_F:  25405.181641, |X-X0|:  485.968933
rounded |X_k-Y|_0 = 25481, f1 =  0.588015, approx slack: 530096
rounded before pow |X_k-Y|_0 = 209274, f1 =  0.263053

Iteration 1380: Loss = 25865.486328
|Xk-Y|_F:  25378.916016, |X-X0|:  486.570618
rounded |X_k-Y|_0 = 25457, f1 =  0.588877, approx slack: 523530
rounded before pow |X_k-Y|_0 = 209173, f1 =  0.263026

Iteration 1400: Loss = 25838.777344
|Xk-Y|_F:  25353.560547, |X-X0|:  485.216431
rounded |X_k-Y|_0 = 25419, f1 =  0.590257, approx slack: 522492
rounded before pow |X_k-Y|_0 = 208683, f1 =  0.263364

Iteration 1420: Loss = 25812.330078
|Xk-Y|_F:  25329.765625, |X-X0|:  482.564392
rounded |X_k-Y|_0 = 25401, f1 =  0.590932, approx slack: 522679
rounded before pow |X_k-Y|_0 = 208800, f1 =  0.263284

Iteration 1440: Loss = 25787.546875
|Xk-Y|_F:  25306.175781, |X-X0|:  481.370728
rounded |X_k-Y|_0 = 25376, f1 =  0.591783, approx slack: 522625
rounded before pow |X_k-Y|_0 = 208683, f1 =  0.263364

Iteration 1460: Loss = 25762.667969
|Xk-Y|_F:  25284.242188, |X-X0|:  478.425110
rounded |X_k-Y|_0 = 25352, f1 =  0.592641, approx slack: 510490
rounded before pow |X_k-Y|_0 = 208270, f1 =  0.263649

Iteration 1480: Loss = 25737.205078
|Xk-Y|_F:  25260.919922, |X-X0|:  476.286041
rounded |X_k-Y|_0 = 25327, f1 =  0.593575, approx slack: 510089
rounded before pow |X_k-Y|_0 = 208012, f1 =  0.263827

Iteration 1500: Loss = 25714.412109
|Xk-Y|_F:  25238.560547, |X-X0|:  475.851440
rounded |X_k-Y|_0 = 25294, f1 =  0.594740, approx slack: 510148
rounded before pow |X_k-Y|_0 = 207926, f1 =  0.263886

Iteration 1520: Loss = 25690.751953
|Xk-Y|_F:  25215.220703, |X-X0|:  475.531433
rounded |X_k-Y|_0 = 25271, f1 =  0.595582, approx slack: 510053
rounded before pow |X_k-Y|_0 = 207793, f1 =  0.263978

Iteration 1540: Loss = 25667.994141
|Xk-Y|_F:  25192.218750, |X-X0|:  475.774963
rounded |X_k-Y|_0 = 25242, f1 =  0.596572, approx slack: 510093
rounded before pow |X_k-Y|_0 = 207846, f1 =  0.263941

Iteration 1560: Loss = 25646.615234
|Xk-Y|_F:  25171.722656, |X-X0|:  474.892639
rounded |X_k-Y|_0 = 25210, f1 =  0.597706, approx slack: 510090
rounded before pow |X_k-Y|_0 = 207846, f1 =  0.263941

Iteration 1580: Loss = 25628.187500
|Xk-Y|_F:  25151.949219, |X-X0|:  476.237793
rounded |X_k-Y|_0 = 25185, f1 =  0.598585, approx slack: 508916
rounded before pow |X_k-Y|_0 = 207332, f1 =  0.264278

Iteration 1600: Loss = 25609.902344
|Xk-Y|_F:  25134.164062, |X-X0|:  475.738434
rounded |X_k-Y|_0 = 25161, f1 =  0.599380, approx slack: 506633
rounded before pow |X_k-Y|_0 = 206854, f1 =  0.264483

Iteration 1620: Loss = 25594.257812
|Xk-Y|_F:  25117.224609, |X-X0|:  477.033783
rounded |X_k-Y|_0 = 25135, f1 =  0.600295, approx slack: 506429
rounded before pow |X_k-Y|_0 = 206709, f1 =  0.264583

Iteration 1640: Loss = 25577.083984
|Xk-Y|_F:  25102.074219, |X-X0|:  475.009460
rounded |X_k-Y|_0 = 25129, f1 =  0.600517, approx slack: 506109
rounded before pow |X_k-Y|_0 = 206473, f1 =  0.264745

Iteration 1660: Loss = 25561.562500
|Xk-Y|_F:  25086.314453, |X-X0|:  475.247070
rounded |X_k-Y|_0 = 25106, f1 =  0.601322, approx slack: 506141
rounded before pow |X_k-Y|_0 = 206473, f1 =  0.264745

Iteration 1680: Loss = 25545.347656
|Xk-Y|_F:  25071.322266, |X-X0|:  474.025146
rounded |X_k-Y|_0 = 25096, f1 =  0.601644, approx slack: 506143
rounded before pow |X_k-Y|_0 = 206401, f1 =  0.264794

Iteration 1700: Loss = 25530.425781
|Xk-Y|_F:  25056.369141, |X-X0|:  474.055969
rounded |X_k-Y|_0 = 25076, f1 =  0.602343, approx slack: 523780
rounded before pow |X_k-Y|_0 = 213470, f1 =  0.260098

Iteration 1720: Loss = 25515.363281
|Xk-Y|_F:  25042.757812, |X-X0|:  472.604492
rounded |X_k-Y|_0 = 25056, f1 =  0.603030, approx slack: 655666
rounded before pow |X_k-Y|_0 = 257389, f1 =  0.229359

Iteration 1740: Loss = 25502.003906
|Xk-Y|_F:  25029.710938, |X-X0|:  472.292114
rounded |X_k-Y|_0 = 25019, f1 =  0.604268, approx slack: 655698
rounded before pow |X_k-Y|_0 = 257389, f1 =  0.229359

Iteration 1760: Loss = 25488.464844
|Xk-Y|_F:  25017.275391, |X-X0|:  471.188812
rounded |X_k-Y|_0 = 25004, f1 =  0.604791, approx slack: 655749
rounded before pow |X_k-Y|_0 = 257392, f1 =  0.229357

Iteration 1780: Loss = 25475.333984
|Xk-Y|_F:  25003.679688, |X-X0|:  471.655182
rounded |X_k-Y|_0 = 24981, f1 =  0.605584, approx slack: 655848
rounded before pow |X_k-Y|_0 = 257392, f1 =  0.229357

Iteration 1800: Loss = 25461.666016
|Xk-Y|_F:  24991.650391, |X-X0|:  470.015625
rounded |X_k-Y|_0 = 24965, f1 =  0.606152, approx slack: 654099
rounded before pow |X_k-Y|_0 = 256690, f1 =  0.229866

Iteration 1820: Loss = 25448.707031
|Xk-Y|_F:  24979.697266, |X-X0|:  469.009705
rounded |X_k-Y|_0 = 24953, f1 =  0.606570, approx slack: 651279
rounded before pow |X_k-Y|_0 = 255547, f1 =  0.230700

Iteration 1840: Loss = 25436.462891
|Xk-Y|_F:  24968.431641, |X-X0|:  468.030975
rounded |X_k-Y|_0 = 24935, f1 =  0.607149, approx slack: 651284
rounded before pow |X_k-Y|_0 = 255536, f1 =  0.230708

Iteration 1860: Loss = 25425.021484
|Xk-Y|_F:  24958.392578, |X-X0|:  466.629639
rounded |X_k-Y|_0 = 24924, f1 =  0.607532, approx slack: 651283
rounded before pow |X_k-Y|_0 = 255536, f1 =  0.230708

Iteration 1880: Loss = 25413.943359
|Xk-Y|_F:  24947.878906, |X-X0|:  466.065094
rounded |X_k-Y|_0 = 24914, f1 =  0.607873, approx slack: 651262
rounded before pow |X_k-Y|_0 = 255479, f1 =  0.230750

Iteration 1900: Loss = 25403.832031
|Xk-Y|_F:  24937.685547, |X-X0|:  466.146057
rounded |X_k-Y|_0 = 24891, f1 =  0.608634, approx slack: 655170
rounded before pow |X_k-Y|_0 = 257002, f1 =  0.229634

Iteration 1920: Loss = 25393.445312
|Xk-Y|_F:  24927.984375, |X-X0|:  465.461060
rounded |X_k-Y|_0 = 24882, f1 =  0.608973, approx slack: 652268
rounded before pow |X_k-Y|_0 = 255938, f1 =  0.230389

Iteration 1940: Loss = 25383.333984
|Xk-Y|_F:  24919.341797, |X-X0|:  463.991760
rounded |X_k-Y|_0 = 24878, f1 =  0.609093, approx slack: 651958
rounded before pow |X_k-Y|_0 = 255807, f1 =  0.230485

Iteration 1960: Loss = 25373.572266
|Xk-Y|_F:  24910.054688, |X-X0|:  463.517700
rounded |X_k-Y|_0 = 24876, f1 =  0.609182, approx slack: 652034
rounded before pow |X_k-Y|_0 = 255862, f1 =  0.230445

Iteration 1980: Loss = 25364.554688
|Xk-Y|_F:  24901.568359, |X-X0|:  462.985413
rounded |X_k-Y|_0 = 24858, f1 =  0.609682, approx slack: 651147
rounded before pow |X_k-Y|_0 = 255547, f1 =  0.230677

Iteration 2000: Loss = 25355.750000
|Xk-Y|_F:  24893.535156, |X-X0|:  462.214111
rounded |X_k-Y|_0 = 24849, f1 =  0.609978, approx slack: 651208
rounded before pow |X_k-Y|_0 = 255547, f1 =  0.230677

Iteration 2020: Loss = 25347.144531
|Xk-Y|_F:  24885.447266, |X-X0|:  461.696289
rounded |X_k-Y|_0 = 24841, f1 =  0.610242, approx slack: 651236
rounded before pow |X_k-Y|_0 = 255547, f1 =  0.230677

Iteration 2040: Loss = 25339.591797
|Xk-Y|_F:  24877.398438, |X-X0|:  462.192688
rounded |X_k-Y|_0 = 24831, f1 =  0.610554, approx slack: 651231
rounded before pow |X_k-Y|_0 = 255547, f1 =  0.230677

Iteration 2060: Loss = 25330.675781
|Xk-Y|_F:  24871.031250, |X-X0|:  459.645294
rounded |X_k-Y|_0 = 24831, f1 =  0.610562, approx slack: 651260
rounded before pow |X_k-Y|_0 = 255547, f1 =  0.230677

Iteration 2080: Loss = 25322.732422
|Xk-Y|_F:  24863.552734, |X-X0|:  459.178864
rounded |X_k-Y|_0 = 24834, f1 =  0.610474, approx slack: 651368
rounded before pow |X_k-Y|_0 = 255665, f1 =  0.230590

Iteration 2100: Loss = 25314.230469
|Xk-Y|_F:  24855.886719, |X-X0|:  458.344086
rounded |X_k-Y|_0 = 24825, f1 =  0.610753, approx slack: 651450
rounded before pow |X_k-Y|_0 = 255728, f1 =  0.230544

Iteration 2120: Loss = 25306.632812
|Xk-Y|_F:  24848.642578, |X-X0|:  457.989990
rounded |X_k-Y|_0 = 24817, f1 =  0.611016, approx slack: 649617
rounded before pow |X_k-Y|_0 = 254862, f1 =  0.231173

Iteration 2140: Loss = 25297.908203
|Xk-Y|_F:  24841.369141, |X-X0|:  456.539154
rounded |X_k-Y|_0 = 24812, f1 =  0.611167, approx slack: 649794
rounded before pow |X_k-Y|_0 = 255029, f1 =  0.231050

Iteration 2160: Loss = 25291.044922
|Xk-Y|_F:  24834.380859, |X-X0|:  456.664734
rounded |X_k-Y|_0 = 24817, f1 =  0.611023, approx slack: 649880
rounded before pow |X_k-Y|_0 = 255083, f1 =  0.231010

Iteration 2180: Loss = 25283.978516
|Xk-Y|_F:  24827.335938, |X-X0|:  456.643280
rounded |X_k-Y|_0 = 24812, f1 =  0.611198, approx slack: 649915
rounded before pow |X_k-Y|_0 = 255084, f1 =  0.231009

Converged at iteration 2186
------ ABL 0 after refine ------
--- eval ---
prediction result:
f1 on test:    0.3873
f1 on test:    0.6441 (micro)
f1 on KB:      0.3844
integrated f1: 0.3856, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3510
f1 on test:    0.6722 (micro)
f1 on KB:      0.5944
integrated f1: 0.4910, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3856
Epoch 100, Total loss: -63382176.0000, CE loss: 2.9656, RL loss: -633821.7500, Reward: -47936.4990
    full cols: 172, non-full cols: 0
   r - labels: 14, labels - r: 3
    violated: 4408, weighted: 197.84976196289062, len: 0.0, nonzero: 0.11360634118318558
Epoch 200, Total loss: 51441444.0000, CE loss: 2.9581, RL loss: 514414.4375, Reward: -47718.6641
    full cols: 172, non-full cols: 0
   r - labels: 14, labels - r: 3
    violated: 4416, weighted: 197.84976196289062, len: 0.0, nonzero: 0.11360634118318558
Epoch 300, Total loss: -23097740.0000, CE loss: 2.9524, RL loss: -230977.4062, Reward: -47786.5137
    full cols: 172, non-full cols: 0
   r - labels: 14, labels - r: 3
    violated: 4413, weighted: 197.84976196289062, len: 0.0, nonzero: 0.11360634118318558
Epoch 400, Total loss: -22002350.0000, CE loss: 2.9463, RL loss: -220023.5000, Reward: -47791.9629
    full cols: 171, non-full cols: 2
   r - labels: 14, labels - r: 2
    violated: 4411, weighted: 196.83912658691406, len: 0.0, nonzero: 0.11359602212905884
Epoch 500, Total loss: 59970132.0000, CE loss: 2.9438, RL loss: 599701.3125, Reward: -47660.1934
    full cols: 172, non-full cols: 1
   r - labels: 15, labels - r: 3
    violated: 4411, weighted: 202.9794158935547, len: 0.0, nonzero: 0.11402948200702667
Epoch 600, Total loss: 47113632.0000, CE loss: 2.9397, RL loss: 471136.3125, Reward: -47548.0186
    full cols: 172, non-full cols: 2
   r - labels: 15, labels - r: 2
    violated: 4410, weighted: 202.70791625976562, len: 0.0, nonzero: 0.11402948200702667
Epoch 700, Total loss: -34103092.0000, CE loss: 2.9365, RL loss: -341030.9375, Reward: -47747.8809
    full cols: 172, non-full cols: 0
   r - labels: 14, labels - r: 3
    violated: 4418, weighted: 197.84976196289062, len: 0.0, nonzero: 0.11360634118318558
Epoch 800, Total loss: -20726116.0000, CE loss: 2.9342, RL loss: -207261.1562, Reward: -47698.3252
    full cols: 171, non-full cols: 2
   r - labels: 14, labels - r: 2
    violated: 4413, weighted: 196.89207458496094, len: 0.0, nonzero: 0.11359602212905884
Epoch 900, Total loss: 45411156.0000, CE loss: 2.9322, RL loss: 454111.5625, Reward: -47549.8418
    full cols: 172, non-full cols: 1
   r - labels: 14, labels - r: 2
    violated: 4415, weighted: 197.83912658691406, len: 0.0, nonzero: 0.11361666768789291
Epoch 1000, Total loss: -32193524.0000, CE loss: 2.9306, RL loss: -321935.2500, Reward: -47758.1543
    full cols: 172, non-full cols: 1
   r - labels: 14, labels - r: 2
    violated: 4412, weighted: 197.81787109375, len: 0.0, nonzero: 0.11363730579614639
Epoch 1100, Total loss: -24024704.0000, CE loss: 2.9286, RL loss: -240247.0469, Reward: -47749.7051
    full cols: 170, non-full cols: 2
   r - labels: 14, labels - r: 3
    violated: 4416, weighted: 191.5085906982422, len: 0.0, nonzero: 0.11347217857837677
Epoch 1200, Total loss: 54185256.0000, CE loss: 2.9266, RL loss: 541852.5625, Reward: -47598.3496
    full cols: 170, non-full cols: 2
   r - labels: 14, labels - r: 3
    violated: 4419, weighted: 192.0085906982422, len: 0.0, nonzero: 0.11348249763250351
Epoch 1300, Total loss: 12804395.0000, CE loss: 2.9243, RL loss: 128043.9531, Reward: -47625.4053
    full cols: 170, non-full cols: 3
   r - labels: 14, labels - r: 2
    violated: 4408, weighted: 182.92149353027344, len: 0.0, nonzero: 0.11329673230648041
Epoch 1400, Total loss: -84762600.0000, CE loss: 2.9226, RL loss: -847626.0000, Reward: -47854.2158
    full cols: 170, non-full cols: 2
   r - labels: 14, labels - r: 3
    violated: 4414, weighted: 171.75271606445312, len: 0.0, nonzero: 0.11303872615098953
Epoch 1500, Total loss: -30009978.0000, CE loss: 2.9198, RL loss: -300099.7812, Reward: -47678.5625
    full cols: 170, non-full cols: 2
   r - labels: 13, labels - r: 2
    violated: 4408, weighted: 159.4269256591797, len: 0.0, nonzero: 0.11289423704147339
Epoch 1600, Total loss: 99929808.0000, CE loss: 2.9173, RL loss: 999298.0625, Reward: -47375.4688
    full cols: 170, non-full cols: 2
   r - labels: 13, labels - r: 2
    violated: 4387, weighted: 159.75677490234375, len: 0.0, nonzero: 0.11306968331336975
Epoch 1700, Total loss: 104814608.0000, CE loss: 2.9155, RL loss: 1048146.0625, Reward: -47346.2021
    full cols: 171, non-full cols: 2
   r - labels: 14, labels - r: 2
    violated: 4398, weighted: 176.34954833984375, len: 0.0, nonzero: 0.11332769691944122
Epoch 1800, Total loss: 106318872.0000, CE loss: 2.9141, RL loss: 1063188.7500, Reward: -47333.5518
    full cols: 171, non-full cols: 2
   r - labels: 14, labels - r: 2
    violated: 4403, weighted: 186.31494140625, len: 0.0, nonzero: 0.11352378129959106
Epoch 1900, Total loss: -33650164.0000, CE loss: 2.9126, RL loss: -336501.6562, Reward: -47645.9668
    full cols: 171, non-full cols: 2
   r - labels: 14, labels - r: 2
    violated: 4410, weighted: 178.3925323486328, len: 0.0, nonzero: 0.11322449147701263
--- eval ---
prediction result:
f1 on test:    0.3807
f1 on test:    0.6485 (micro)
f1 on KB:      0.4015
integrated f1: 0.3949, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3506
f1 on test:    0.6721 (micro)
f1 on KB:      0.5953
integrated f1: 0.5219, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: -64300924.0000, CE loss: 2.9119, RL loss: -643009.2500, Reward: -47767.5078
    full cols: 171, non-full cols: 2
   r - labels: 14, labels - r: 2
    violated: 4412, weighted: 186.89479064941406, len: 0.0, nonzero: 0.11343089491128922
Epoch 2100, Total loss: 58269688.0000, CE loss: 2.9107, RL loss: 582696.8750, Reward: -47458.0176
    full cols: 170, non-full cols: 3
   r - labels: 14, labels - r: 2
    violated: 4387, weighted: 174.17962646484375, len: 0.0, nonzero: 0.113399937748909
Epoch 2200, Total loss: -10820549.0000, CE loss: 2.9101, RL loss: -108205.4922, Reward: -47665.7881
    full cols: 170, non-full cols: 3
   r - labels: 14, labels - r: 2
    violated: 4411, weighted: 155.484619140625, len: 0.0, nonzero: 0.11282199621200562
Epoch 2300, Total loss: -89119416.0000, CE loss: 2.9094, RL loss: -891194.1250, Reward: -47758.3896
    full cols: 170, non-full cols: 2
   r - labels: 13, labels - r: 2
    violated: 4402, weighted: 163.84930419921875, len: 0.0, nonzero: 0.11300776153802872
Epoch 2400, Total loss: 16082153.0000, CE loss: 2.9079, RL loss: 160821.5312, Reward: -47434.3174
    full cols: 170, non-full cols: 1
   r - labels: 13, labels - r: 3
    violated: 4422, weighted: 162.0615234375, len: 0.0, nonzero: 0.11286327987909317
Epoch 2500, Total loss: -90819952.0000, CE loss: 2.9077, RL loss: -908199.5000, Reward: -47785.1084
    full cols: 169, non-full cols: 1
   r - labels: 12, labels - r: 3
    violated: 4417, weighted: 143.0771484375, len: 0.0, nonzero: 0.11217181384563446
Epoch 2600, Total loss: 53049376.0000, CE loss: 2.9076, RL loss: 530493.7500, Reward: -47455.4482
    full cols: 167, non-full cols: 2
   r - labels: 11, labels - r: 3
    violated: 4413, weighted: 89.20950317382812, len: 0.0, nonzero: 0.11084049195051193
Epoch 2700, Total loss: -38207800.0000, CE loss: 2.9071, RL loss: -382078.0000, Reward: -47619.7881
    full cols: 169, non-full cols: 0
   r - labels: 11, labels - r: 3
    violated: 4412, weighted: 130.57736206054688, len: 0.0, nonzero: 0.1116248369216919
Epoch 2800, Total loss: -95690984.0000, CE loss: 2.9071, RL loss: -956909.8750, Reward: -47734.9912
    full cols: 167, non-full cols: 1
   r - labels: 10, labels - r: 3
    violated: 4416, weighted: 103.18415832519531, len: 0.0, nonzero: 0.11090241372585297
Epoch 2900, Total loss: -41740224.0000, CE loss: 2.9067, RL loss: -417402.2500, Reward: -47630.8535
    full cols: 166, non-full cols: 2
   r - labels: 10, labels - r: 3
    violated: 4413, weighted: 106.96674346923828, len: 0.0, nonzero: 0.11024191230535507
Epoch 3000, Total loss: 58605580.0000, CE loss: 2.9070, RL loss: 586055.8125, Reward: -47482.8926
    full cols: 166, non-full cols: 2
   r - labels: 10, labels - r: 3
    violated: 4415, weighted: 113.03665161132812, len: 0.0, nonzero: 0.11086113005876541
Epoch 3100, Total loss: 27803116.0000, CE loss: 2.9069, RL loss: 278031.1562, Reward: -47500.0225
    full cols: 167, non-full cols: 2
   r - labels: 11, labels - r: 3
    violated: 4413, weighted: 113.22443389892578, len: 0.0, nonzero: 0.11117074638605118
Epoch 3200, Total loss: 101390216.0000, CE loss: 2.9063, RL loss: 1013902.1250, Reward: -47277.7617
    full cols: 167, non-full cols: 1
   r - labels: 10, labels - r: 3
    violated: 4414, weighted: 111.22307586669922, len: 0.0, nonzero: 0.11094369739294052
Epoch 3300, Total loss: 60916632.0000, CE loss: 2.9065, RL loss: 609166.3125, Reward: -47327.5771
    full cols: 168, non-full cols: 0
   r - labels: 10, labels - r: 3
    violated: 4415, weighted: 111.3194580078125, len: 0.0, nonzero: 0.110964335501194
Epoch 3400, Total loss: -50526308.0000, CE loss: 2.9067, RL loss: -505263.0625, Reward: -47675.3105
    full cols: 167, non-full cols: 0
   r - labels: 9, labels - r: 3
    violated: 4411, weighted: 97.52035522460938, len: 0.0, nonzero: 0.1103038340806961
Epoch 3500, Total loss: 52735164.0000, CE loss: 2.9062, RL loss: 527351.6250, Reward: -47518.1250
    full cols: 167, non-full cols: 0
   r - labels: 9, labels - r: 3
    violated: 4411, weighted: 97.52035522460938, len: 0.0, nonzero: 0.1103038340806961
Epoch 3600, Total loss: 66519264.0000, CE loss: 2.9061, RL loss: 665192.6250, Reward: -47411.2949
    full cols: 167, non-full cols: 1
   r - labels: 10, labels - r: 3
    violated: 4418, weighted: 101.55564880371094, len: 0.0, nonzero: 0.11084049195051193
Epoch 3700, Total loss: 51045936.0000, CE loss: 2.9063, RL loss: 510459.3750, Reward: -47390.7881
    full cols: 168, non-full cols: 0
   r - labels: 10, labels - r: 3
    violated: 4413, weighted: 102.48687744140625, len: 0.0, nonzero: 0.110964335501194
Epoch 3800, Total loss: 50205872.0000, CE loss: 2.9059, RL loss: 502058.7188, Reward: -47507.9834
    full cols: 168, non-full cols: 1
   r - labels: 11, labels - r: 3
    violated: 4411, weighted: 103.88189697265625, len: 0.0, nonzero: 0.11160419881343842
Epoch 3900, Total loss: -15996558.0000, CE loss: 2.9060, RL loss: -159965.5781, Reward: -47567.1875
    full cols: 169, non-full cols: 0
   r - labels: 11, labels - r: 3
    violated: 4416, weighted: 103.978271484375, len: 0.0, nonzero: 0.1116248369216919
--- eval ---
prediction result:
f1 on test:    0.3792
f1 on test:    0.6497 (micro)
f1 on KB:      0.4050
integrated f1: 0.3967, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3510
f1 on test:    0.6722 (micro)
f1 on KB:      0.5944
integrated f1: 0.5214, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: -92890288.0000, CE loss: 2.9061, RL loss: -928902.8750, Reward: -47841.9658
    full cols: 167, non-full cols: 1
   r - labels: 10, labels - r: 3
    violated: 4410, weighted: 67.08937072753906, len: 0.0, nonzero: 0.11031415313482285
Epoch 4100, Total loss: -17217852.0000, CE loss: 2.9061, RL loss: -172178.5156, Reward: -47570.1611
    full cols: 166, non-full cols: 2
   r - labels: 9, labels - r: 2
    violated: 4412, weighted: 60.90135955810547, len: 0.0, nonzero: 0.11024191230535507
Epoch 4200, Total loss: -38237044.0000, CE loss: 2.9062, RL loss: -382370.4375, Reward: -47606.8047
    full cols: 166, non-full cols: 2
   r - labels: 10, labels - r: 3
    violated: 4413, weighted: 73.83009338378906, len: 0.0, nonzero: 0.11080953478813171
Epoch 4300, Total loss: -59176068.0000, CE loss: 2.9056, RL loss: -591760.6875, Reward: -47754.3232
    full cols: 166, non-full cols: 2
   r - labels: 10, labels - r: 3
    violated: 4412, weighted: 64.41923522949219, len: 0.0, nonzero: 0.11037607491016388
Epoch 4400, Total loss: 101377000.0000, CE loss: 2.9058, RL loss: 1013770.0000, Reward: -47374.6855
    full cols: 165, non-full cols: 3
   r - labels: 9, labels - r: 2
    violated: 4366, weighted: 33.19705581665039, len: 0.0, nonzero: 0.11002518236637115
Epoch 4500, Total loss: 31721488.0000, CE loss: 2.9062, RL loss: 317214.8750, Reward: -47496.9482
    full cols: 165, non-full cols: 2
   r - labels: 8, labels - r: 2
    violated: 4388, weighted: 52.299095153808594, len: 0.0, nonzero: 0.10978781431913376
Epoch 4600, Total loss: -1411631.1250, CE loss: 2.9065, RL loss: -14116.3115, Reward: -47592.1035
    full cols: 165, non-full cols: 1
   r - labels: 8, labels - r: 3
    violated: 4413, weighted: 57.69253158569336, len: 0.0, nonzero: 0.10909635573625565
Epoch 4700, Total loss: 82886008.0000, CE loss: 2.9058, RL loss: 828860.0625, Reward: -47364.8389
    full cols: 167, non-full cols: 0
   r - labels: 9, labels - r: 3
    violated: 4405, weighted: 67.01176452636719, len: 0.0, nonzero: 0.1103038340806961
Epoch 4800, Total loss: -17354332.0000, CE loss: 2.9058, RL loss: -173543.3125, Reward: -47660.2031
    full cols: 166, non-full cols: 0
   r - labels: 8, labels - r: 3
    violated: 4416, weighted: 59.00452423095703, len: 0.0, nonzero: 0.10964333266019821
Epoch 4900, Total loss: 37848888.0000, CE loss: 2.9057, RL loss: 378488.8750, Reward: -47470.7266
    full cols: 166, non-full cols: 1
   r - labels: 8, labels - r: 2
    violated: 4388, weighted: 58.706787109375, len: 0.0, nonzero: 0.1099323034286499
Epoch 5000, Total loss: 23699782.0000, CE loss: 2.9058, RL loss: 236997.8125, Reward: -47534.7607
    full cols: 167, non-full cols: 2
   r - labels: 10, labels - r: 2
    violated: 4354, weighted: 59.61425018310547, len: 0.0, nonzero: 0.11062376201152802
Epoch 5100, Total loss: -4376315.5000, CE loss: 2.9057, RL loss: -43763.1562, Reward: -47649.3633
    full cols: 165, non-full cols: 2
   r - labels: 9, labels - r: 3
    violated: 4350, weighted: 62.74932098388672, len: 0.0, nonzero: 0.10989101976156235
Epoch 5200, Total loss: -4695983.0000, CE loss: 2.9058, RL loss: -46959.8281, Reward: -47687.5400
    full cols: 167, non-full cols: 1
   r - labels: 10, labels - r: 3
    violated: 4287, weighted: 74.71900177001953, len: 0.0, nonzero: 0.11094369739294052
Epoch 5300, Total loss: -24186946.0000, CE loss: 2.9059, RL loss: -241869.4531, Reward: -47769.5283
    full cols: 168, non-full cols: 1
   r - labels: 10, labels - r: 2
    violated: 4285, weighted: 72.91085815429688, len: 0.0, nonzero: 0.11131522804498672
Epoch 5400, Total loss: -58314248.0000, CE loss: 2.9061, RL loss: -583142.5000, Reward: -47900.3672
    full cols: 165, non-full cols: 2
   r - labels: 8, labels - r: 2
    violated: 4343, weighted: 43.060630798339844, len: 0.0, nonzero: 0.10960204899311066
Epoch 5500, Total loss: -12291929.0000, CE loss: 2.9058, RL loss: -122919.2891, Reward: -47721.7402
    full cols: 165, non-full cols: 1
   r - labels: 7, labels - r: 2
    violated: 4344, weighted: 35.76356887817383, len: 0.0, nonzero: 0.10907571017742157
Epoch 5600, Total loss: -50874924.0000, CE loss: 2.9056, RL loss: -508749.2500, Reward: -47851.6650
    full cols: 165, non-full cols: 1
   r - labels: 8, labels - r: 3
    violated: 4352, weighted: 53.76787567138672, len: 0.0, nonzero: 0.1090034693479538
Epoch 5700, Total loss: -97536776.0000, CE loss: 2.9054, RL loss: -975367.7500, Reward: -47938.7480
    full cols: 165, non-full cols: 2
   r - labels: 9, labels - r: 3
    violated: 4339, weighted: 64.23936462402344, len: 0.0, nonzero: 0.10970525443553925
Epoch 5800, Total loss: 99822784.0000, CE loss: 2.9052, RL loss: 998227.8125, Reward: -47495.1787
    full cols: 166, non-full cols: 1
   r - labels: 9, labels - r: 3
    violated: 4288, weighted: 81.94773864746094, len: 0.0, nonzero: 0.10977749526500702
Epoch 5900, Total loss: 29200084.0000, CE loss: 2.9054, RL loss: 292000.8438, Reward: -47676.2070
    full cols: 166, non-full cols: 0
   r - labels: 9, labels - r: 4
    violated: 4285, weighted: 85.79185485839844, len: 0.0, nonzero: 0.10964333266019821
--- eval ---
prediction result:
f1 on test:    0.3791
f1 on test:    0.6494 (micro)
f1 on KB:      0.4045
integrated f1: 0.3964, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3494
f1 on test:    0.6726 (micro)
f1 on KB:      0.6029
integrated f1: 0.5268, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: -52054936.0000, CE loss: 2.9058, RL loss: -520549.3750, Reward: -47804.8848
    full cols: 166, non-full cols: 1
   r - labels: 9, labels - r: 3
    violated: 4292, weighted: 84.01763916015625, len: 0.0, nonzero: 0.10970525443553925
Epoch 6100, Total loss: -25167890.0000, CE loss: 2.9055, RL loss: -251678.9062, Reward: -47813.6406
    full cols: 166, non-full cols: 1
   r - labels: 9, labels - r: 3
    violated: 4288, weighted: 81.65565490722656, len: 0.0, nonzero: 0.10970525443553925
Epoch 6200, Total loss: -5540290.0000, CE loss: 2.9053, RL loss: -55402.9023, Reward: -47737.5625
    full cols: 163, non-full cols: 2
   r - labels: 8, labels - r: 4
    violated: 4352, weighted: 61.0275993347168, len: 0.0, nonzero: 0.1083429679274559
Epoch 6300, Total loss: -91373272.0000, CE loss: 2.9057, RL loss: -913732.6875, Reward: -47995.6191
    full cols: 163, non-full cols: 0
   r - labels: 7, labels - r: 5
    violated: 4349, weighted: 78.27693176269531, len: 0.0, nonzero: 0.10766182839870453
Epoch 6400, Total loss: 56930420.0000, CE loss: 2.9056, RL loss: 569304.1875, Reward: -47649.3525
    full cols: 162, non-full cols: 3
   r - labels: 7, labels - r: 3
    violated: 4312, weighted: 73.76900482177734, len: 0.0, nonzero: 0.1079198345541954
Epoch 6500, Total loss: -34717504.0000, CE loss: 2.9051, RL loss: -347175.0312, Reward: -47908.9395
    full cols: 161, non-full cols: 3
   r - labels: 6, labels - r: 3
    violated: 4448, weighted: 61.505653381347656, len: 0.0, nonzero: 0.1068052351474762
Epoch 6600, Total loss: -894470.8125, CE loss: 2.9051, RL loss: -8944.7080, Reward: -47765.1191
    full cols: 163, non-full cols: 1
   r - labels: 6, labels - r: 3
    violated: 4354, weighted: 55.39547348022461, len: 0.0, nonzero: 0.1081572026014328
Epoch 6700, Total loss: 50339648.0000, CE loss: 2.9053, RL loss: 503396.4688, Reward: -47639.5605
    full cols: 163, non-full cols: 1
   r - labels: 6, labels - r: 3
    violated: 4355, weighted: 48.218772888183594, len: 0.0, nonzero: 0.10798175632953644
Epoch 6800, Total loss: 97898944.0000, CE loss: 2.9051, RL loss: 978989.4375, Reward: -47576.8652
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 4351, weighted: 39.804527282714844, len: 0.0, nonzero: 0.10832232981920242
Epoch 6900, Total loss: 22832624.0000, CE loss: 2.9061, RL loss: 228326.2344, Reward: -47821.3467
    full cols: 162, non-full cols: 1
   r - labels: 5, labels - r: 3
    violated: 4378, weighted: 41.84298324584961, len: 0.0, nonzero: 0.10739349573850632
Epoch 7000, Total loss: -68186080.0000, CE loss: 2.9050, RL loss: -681860.8125, Reward: -47989.9912
    full cols: 163, non-full cols: 2
   r - labels: 7, labels - r: 3
    violated: 4378, weighted: 62.71855163574219, len: 0.0, nonzero: 0.10844617336988449
Epoch 7100, Total loss: -43810848.0000, CE loss: 2.9053, RL loss: -438108.4688, Reward: -48031.4785
    full cols: 163, non-full cols: 0
   r - labels: 7, labels - r: 5
    violated: 4475, weighted: 68.86515808105469, len: 0.0, nonzero: 0.10766182839870453
Epoch 7200, Total loss: 99713256.0000, CE loss: 2.9050, RL loss: 997132.5625, Reward: -47665.6123
    full cols: 161, non-full cols: 4
   r - labels: 8, labels - r: 4
    violated: 4522, weighted: 93.00656127929688, len: 0.0, nonzero: 0.10733157396316528
Epoch 7300, Total loss: 10748475.0000, CE loss: 2.9049, RL loss: 107484.7500, Reward: -47859.0723
    full cols: 165, non-full cols: 0
   r - labels: 8, labels - r: 4
    violated: 4415, weighted: 65.33212280273438, len: 0.0, nonzero: 0.10898283123970032
Epoch 7400, Total loss: 111227336.0000, CE loss: 2.9051, RL loss: 1112273.3750, Reward: -47572.4023
    full cols: 164, non-full cols: 0
   r - labels: 7, labels - r: 4
    violated: 4415, weighted: 43.858821868896484, len: 0.0, nonzero: 0.10832232981920242
Epoch 7500, Total loss: -54184388.0000, CE loss: 2.9050, RL loss: -541843.8750, Reward: -47990.9150
    full cols: 163, non-full cols: 1
   r - labels: 7, labels - r: 4
    violated: 4436, weighted: 54.35882568359375, len: 0.0, nonzero: 0.1081055998802185
Epoch 7600, Total loss: 56431264.0000, CE loss: 2.9053, RL loss: 564312.6250, Reward: -47767.9512
    full cols: 163, non-full cols: 0
   r - labels: 7, labels - r: 5
    violated: 4474, weighted: 55.39909362792969, len: 0.0, nonzero: 0.10766182839870453
Epoch 7700, Total loss: 52553292.0000, CE loss: 2.9049, RL loss: 525532.9375, Reward: -47797.8066
    full cols: 162, non-full cols: 3
   r - labels: 8, labels - r: 4
    violated: 4423, weighted: 83.76945495605469, len: 0.0, nonzero: 0.1082088053226471
Epoch 7800, Total loss: 79568816.0000, CE loss: 2.9050, RL loss: 795688.1250, Reward: -47774.1758
    full cols: 167, non-full cols: 1
   r - labels: 10, labels - r: 3
    violated: 4352, weighted: 67.38868713378906, len: 0.0, nonzero: 0.11073728650808334
Epoch 7900, Total loss: -86040168.0000, CE loss: 2.9049, RL loss: -860401.6875, Reward: -48158.1533
    full cols: 165, non-full cols: 0
   r - labels: 9, labels - r: 5
    violated: 4417, weighted: 107.36651611328125, len: 0.0, nonzero: 0.10898283123970032
--- eval ---
prediction result:
f1 on test:    0.3790
f1 on test:    0.6494 (micro)
f1 on KB:      0.4045
integrated f1: 0.3963, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3514
f1 on test:    0.6722 (micro)
f1 on KB:      0.5896
integrated f1: 0.5182, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: -14150644.0000, CE loss: 2.9055, RL loss: -141506.4375, Reward: -48052.9404
    full cols: 163, non-full cols: 1
   r - labels: 9, labels - r: 6
    violated: 4413, weighted: 91.72374725341797, len: 0.0, nonzero: 0.10767214745283127
------ ABL Loop 1 ------
--- eval ---
prediction result:
f1 on test:    0.3790
f1 on test:    0.6494 (micro)
f1 on KB:      0.4045
integrated f1: 0.3931, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3514
f1 on test:    0.6722 (micro)
f1 on KB:      0.5896
integrated f1: 0.4885, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3931
Iteration 0: Loss = 26923.955078
|Xk-Y|_F:  26923.955078, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 26934, f1 =  0.345540, approx slack: 25512
rounded before pow |X_k-Y|_0 = 26934, f1 =  0.345540

Iteration 20: Loss = 24876.164062
|Xk-Y|_F:  23768.205078, |X-X0|:  1107.959473
rounded |X_k-Y|_0 = 24627, f1 =  0.517031, approx slack: 554211
rounded before pow |X_k-Y|_0 = 59754, f1 =  0.391390

Iteration 40: Loss = 23353.585938
|Xk-Y|_F:  22362.748047, |X-X0|:  990.837402
rounded |X_k-Y|_0 = 23515, f1 =  0.569649, approx slack: 585233
rounded before pow |X_k-Y|_0 = 64103, f1 =  0.384190

Iteration 60: Loss = 22517.771484
|Xk-Y|_F:  21663.693359, |X-X0|:  854.078613
rounded |X_k-Y|_0 = 21557, f1 =  0.637892, approx slack: 552969
rounded before pow |X_k-Y|_0 = 62846, f1 =  0.386394

Iteration 80: Loss = 22291.814453
|Xk-Y|_F:  21477.708984, |X-X0|:  814.105347
rounded |X_k-Y|_0 = 21451, f1 =  0.641049, approx slack: 497008
rounded before pow |X_k-Y|_0 = 62676, f1 =  0.386787

Iteration 100: Loss = 22180.384766
|Xk-Y|_F:  21392.195312, |X-X0|:  788.190002
rounded |X_k-Y|_0 = 21424, f1 =  0.641886, approx slack: 484920
rounded before pow |X_k-Y|_0 = 62106, f1 =  0.387797

Iteration 120: Loss = 22103.357422
|Xk-Y|_F:  21337.326172, |X-X0|:  766.031494
rounded |X_k-Y|_0 = 21292, f1 =  0.645608, approx slack: 466256
rounded before pow |X_k-Y|_0 = 60761, f1 =  0.390337

Iteration 140: Loss = 22035.628906
|Xk-Y|_F:  21295.089844, |X-X0|:  740.538330
rounded |X_k-Y|_0 = 21304, f1 =  0.645308, approx slack: 375911
rounded before pow |X_k-Y|_0 = 61882, f1 =  0.388251

Iteration 160: Loss = 21992.447266
|Xk-Y|_F:  21260.986328, |X-X0|:  731.460693
rounded |X_k-Y|_0 = 21236, f1 =  0.647210, approx slack: 371665
rounded before pow |X_k-Y|_0 = 61426, f1 =  0.389106

Iteration 180: Loss = 21959.050781
|Xk-Y|_F:  21234.607422, |X-X0|:  724.442505
rounded |X_k-Y|_0 = 21211, f1 =  0.647880, approx slack: 366171
rounded before pow |X_k-Y|_0 = 60727, f1 =  0.390421

Iteration 200: Loss = 21930.433594
|Xk-Y|_F:  21213.097656, |X-X0|:  717.336304
rounded |X_k-Y|_0 = 21193, f1 =  0.648378, approx slack: 360901
rounded before pow |X_k-Y|_0 = 60405, f1 =  0.391045

Iteration 220: Loss = 21909.660156
|Xk-Y|_F:  21195.833984, |X-X0|:  713.825500
rounded |X_k-Y|_0 = 21186, f1 =  0.648570, approx slack: 359805
rounded before pow |X_k-Y|_0 = 60400, f1 =  0.391055

Iteration 240: Loss = 21888.957031
|Xk-Y|_F:  21180.925781, |X-X0|:  708.031189
rounded |X_k-Y|_0 = 21180, f1 =  0.648727, approx slack: 349178
rounded before pow |X_k-Y|_0 = 59699, f1 =  0.392434

Iteration 260: Loss = 21872.171875
|Xk-Y|_F:  21168.056641, |X-X0|:  704.114990
rounded |X_k-Y|_0 = 21175, f1 =  0.648863, approx slack: 348780
rounded before pow |X_k-Y|_0 = 59668, f1 =  0.392496

Iteration 280: Loss = 21857.730469
|Xk-Y|_F:  21157.023438, |X-X0|:  700.706665
rounded |X_k-Y|_0 = 21159, f1 =  0.649287, approx slack: 344750
rounded before pow |X_k-Y|_0 = 58616, f1 =  0.394536

Iteration 300: Loss = 21844.609375
|Xk-Y|_F:  21146.474609, |X-X0|:  698.135559
rounded |X_k-Y|_0 = 21144, f1 =  0.649690, approx slack: 340623
rounded before pow |X_k-Y|_0 = 58234, f1 =  0.395315

Iteration 320: Loss = 21831.636719
|Xk-Y|_F:  21137.240234, |X-X0|:  694.395752
rounded |X_k-Y|_0 = 21141, f1 =  0.649770, approx slack: 340681
rounded before pow |X_k-Y|_0 = 59022, f1 =  0.393785

Iteration 340: Loss = 21820.363281
|Xk-Y|_F:  21127.861328, |X-X0|:  692.500977
rounded |X_k-Y|_0 = 21136, f1 =  0.649906, approx slack: 339664
rounded before pow |X_k-Y|_0 = 58879, f1 =  0.394076

Iteration 360: Loss = 21810.626953
|Xk-Y|_F:  21119.257812, |X-X0|:  691.368408
rounded |X_k-Y|_0 = 21122, f1 =  0.650271, approx slack: 338637
rounded before pow |X_k-Y|_0 = 58741, f1 =  0.394358

Iteration 380: Loss = 21800.376953
|Xk-Y|_F:  21111.367188, |X-X0|:  689.009888
rounded |X_k-Y|_0 = 21120, f1 =  0.650325, approx slack: 336806
rounded before pow |X_k-Y|_0 = 58510, f1 =  0.394833

Iteration 400: Loss = 21790.101562
|Xk-Y|_F:  21103.861328, |X-X0|:  686.240112
rounded |X_k-Y|_0 = 21119, f1 =  0.650352, approx slack: 333578
rounded before pow |X_k-Y|_0 = 58373, f1 =  0.395116

Iteration 420: Loss = 21780.746094
|Xk-Y|_F:  21096.843750, |X-X0|:  683.902893
rounded |X_k-Y|_0 = 21112, f1 =  0.650536, approx slack: 333515
rounded before pow |X_k-Y|_0 = 58373, f1 =  0.395116

Iteration 440: Loss = 21770.154297
|Xk-Y|_F:  21090.009766, |X-X0|:  680.144409
rounded |X_k-Y|_0 = 21102, f1 =  0.650800, approx slack: 332573
rounded before pow |X_k-Y|_0 = 58267, f1 =  0.395336

Iteration 460: Loss = 21762.091797
|Xk-Y|_F:  21084.062500, |X-X0|:  678.029602
rounded |X_k-Y|_0 = 21095, f1 =  0.650975, approx slack: 332479
rounded before pow |X_k-Y|_0 = 58267, f1 =  0.395336

Iteration 480: Loss = 21752.822266
|Xk-Y|_F:  21078.519531, |X-X0|:  674.302673
rounded |X_k-Y|_0 = 21093, f1 =  0.651026, approx slack: 331080
rounded before pow |X_k-Y|_0 = 58120, f1 =  0.395642

Iteration 500: Loss = 21745.859375
|Xk-Y|_F:  21072.839844, |X-X0|:  673.018982
rounded |X_k-Y|_0 = 21088, f1 =  0.651157, approx slack: 333435
rounded before pow |X_k-Y|_0 = 58228, f1 =  0.395417

Iteration 520: Loss = 21739.597656
|Xk-Y|_F:  21067.333984, |X-X0|:  672.262695
rounded |X_k-Y|_0 = 21079, f1 =  0.651393, approx slack: 328983
rounded before pow |X_k-Y|_0 = 57098, f1 =  0.397722

Iteration 540: Loss = 21733.623047
|Xk-Y|_F:  21062.253906, |X-X0|:  671.368286
rounded |X_k-Y|_0 = 21070, f1 =  0.651630, approx slack: 326914
rounded before pow |X_k-Y|_0 = 56884, f1 =  0.398185

Iteration 560: Loss = 21728.662109
|Xk-Y|_F:  21057.625000, |X-X0|:  671.036194
rounded |X_k-Y|_0 = 21060, f1 =  0.651892, approx slack: 326884
rounded before pow |X_k-Y|_0 = 56884, f1 =  0.398185

Iteration 580: Loss = 21722.548828
|Xk-Y|_F:  21053.005859, |X-X0|:  669.543457
rounded |X_k-Y|_0 = 21049, f1 =  0.652183, approx slack: 326091
rounded before pow |X_k-Y|_0 = 56884, f1 =  0.398185

Iteration 600: Loss = 21717.746094
|Xk-Y|_F:  21048.791016, |X-X0|:  668.954773
rounded |X_k-Y|_0 = 21044, f1 =  0.652319, approx slack: 325014
rounded before pow |X_k-Y|_0 = 56777, f1 =  0.398418

Iteration 620: Loss = 21711.396484
|Xk-Y|_F:  21045.330078, |X-X0|:  666.066650
rounded |X_k-Y|_0 = 21039, f1 =  0.652453, approx slack: 323174
rounded before pow |X_k-Y|_0 = 56773, f1 =  0.398427

Iteration 640: Loss = 21706.148438
|Xk-Y|_F:  21040.933594, |X-X0|:  665.214294
rounded |X_k-Y|_0 = 21043, f1 =  0.652343, approx slack: 323274
rounded before pow |X_k-Y|_0 = 56773, f1 =  0.398427

Iteration 660: Loss = 21701.056641
|Xk-Y|_F:  21037.001953, |X-X0|:  664.055054
rounded |X_k-Y|_0 = 21047, f1 =  0.652233, approx slack: 323142
rounded before pow |X_k-Y|_0 = 56768, f1 =  0.398438

Iteration 680: Loss = 21695.740234
|Xk-Y|_F:  21033.439453, |X-X0|:  662.301086
rounded |X_k-Y|_0 = 21043, f1 =  0.652342, approx slack: 321309
rounded before pow |X_k-Y|_0 = 56531, f1 =  0.398957

Converged at iteration 683
------ ABL 1 after refine ------
--- eval ---
prediction result:
f1 on test:    0.3790
f1 on test:    0.6494 (micro)
f1 on KB:      0.4083
integrated f1: 0.3951, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3512
f1 on test:    0.6721 (micro)
f1 on KB:      0.5961
integrated f1: 0.4921, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3951
