MLP_norman_Sep20_5
log/EGOAL-hsa-2025-09-20-20:55:16.933072.txt
random seed: 6666
test perts: ["['MAML2', 'ctrl']", "['MAP2K6', 'SPI1']", "['MAP2K6', 'IKZF3']", "['MAP2K3', 'SLC38A2']", "['RREB1', 'ctrl']", "['UBASH3B', 'ctrl']", "['MIDN', 'ctrl']", "['CBFA2T3', 'ctrl']", "['KLF1', 'BAK1']", "['POU3F2', 'ctrl']", "['ctrl', 'CNN1']", "['ZC3HAV1', 'CEBPE']", "['CDKN1A', 'ctrl']", "['ctrl', 'MEIS1']", "['MAPK1', 'PRTG']", "['RUNX1T1', 'ctrl']", "['KLF1', 'COL2A1']", "['TMSB4X', 'BAK1']", "['BPGM', 'SAMD1']", "['ETS2', 'CEBPE']", "['HOXB9', 'ctrl']", "['ETS2', 'ctrl']", "['KIF18B', 'KIF2C']", "['PTPN12', 'UBASH3A']", "['PRTG', 'ctrl']", "['LYL1', 'ctrl']", "['SGK1', 'ctrl']", "['MAP2K6', 'ctrl']", "['PTPN12', 'PTPN9']", "['BCL2L11', 'BAK1']", "['KLF1', 'CEBPA']", "['KIF2C', 'ctrl']", "['ctrl', 'CLDN6']", "['MAP2K3', 'ELMSAN1']", "['CSRNP1', 'ctrl']", "['ctrl', 'UBASH3A']", "['FOXF1', 'HOXB9']", "['UBASH3B', 'CNN1']", "['CEBPB', 'PTPN12']", "['ETS2', 'MAPK1']", "['SNAI1', 'UBASH3B']", "['CEBPA', 'ctrl']", "['FOXA1', 'HOXB9']", "['SAMD1', 'TGFBR2']", "['SAMD1', 'ctrl']", "['ELMSAN1', 'ctrl']", "['CBL', 'TGFBR2']", "['ETS2', 'MAP7D1']", "['KLF1', 'TGFBR2']", "['ctrl', 'SLC38A2']", "['PRDM1', 'ctrl']", "['ctrl', 'IGDCC3']", "['JUN', 'CEBPB']", "['BPGM', 'ZBTB1']", "['ctrl', 'TGFBR2']", "['CDKN1C', 'CDKN1B']"]
train: torch.Size([73215, 5045])
unlabel: torch.Size([2854, 5045])
cuda availability: True
/home/u-xiangyf/anaconda3/envs/egoal/lib/python3.13/site-packages/torch/nn/modules/loss.py:608: UserWarning: Using a target size (torch.Size([5045])) that is different to the input size (torch.Size([5045, 5045])). This will likely lead to incorrect results due to broadcasting. Please ensure they have the same size.
  return F.mse_loss(input, target, reduction=self.reduction)
Epoch 0, Loss: 0.1387
Epoch 100, Loss: 0.1340
Epoch 200, Loss: 0.1294
Epoch 300, Loss: 0.1249
Epoch 400, Loss: 0.1206
Epoch 500, Loss: 0.1163
Epoch 600, Loss: 0.1122
Epoch 700, Loss: 0.1083
Epoch 800, Loss: 0.1044
Epoch 900, Loss: 0.1007
Final loss: 0.09707175195217133
Achieved outputs: tensor([[0.4470, 0.4275, 0.4629,  ..., 0.4476, 0.4475, 0.4474],
        [0.4470, 0.4274, 0.4631,  ..., 0.4477, 0.4477, 0.4476],
        [0.4472, 0.4273, 0.4630,  ..., 0.4479, 0.4478, 0.4477],
        ...,
        [0.4472, 0.4275, 0.4628,  ..., 0.4476, 0.4474, 0.4475],
        [0.4476, 0.4275, 0.4627,  ..., 0.4476, 0.4475, 0.4474],
        [0.4474, 0.4274, 0.4631,  ..., 0.4478, 0.4478, 0.4476]],
       device='cuda:4')
Eval weight w_data: 0.3229558870411629
Before pretrain: integrated f1 0.2632
Epoch 100, Total loss: 24031700992.0000, CE loss: 1118.7725, RL loss: 2403169792.0000, Reward: -313979881.3750
    full cols: 354, non-full cols: 1
   r - labels: 2, labels - r: 4
    violated: 131998, weighted: 1.1810171604156494, len: 0.0, nonzero: 0.07034502178430557
Epoch 200, Total loss: 57319583744.0000, CE loss: 1000.7906, RL loss: 5731958272.0000, Reward: -313967182.1250
    full cols: 354, non-full cols: 1
   r - labels: 2, labels - r: 4
    violated: 135169, weighted: 1.1728096008300781, len: 0.0, nonzero: 0.07035121321678162
Epoch 300, Total loss: 23020984320.0000, CE loss: 923.0714, RL loss: 2302098432.0000, Reward: -313462603.5000
    full cols: 354, non-full cols: 1
   r - labels: 2, labels - r: 4
    violated: 134332, weighted: 1.168705701828003, len: 0.0, nonzero: 0.07035431265830994
------ Before ABL ------
--- eval ---
prediction result:
f1 on test:    0.5776
f1 on test:    0.9096 (micro)
f1 on KB:      0.2955
f1 on orig KB: 0.2955
integrated f1: 0.3387, w_data: 0.3230, w_klg: 0.6770

integrated result:
f1 on test:    0.5341
f1 on test:    0.8938 (micro)
f1 on KB:      0.3704
f1 on orig KB: 0.3704
integrated f1: 0.4060, w_data: 0.3230, w_klg: 0.6770
------------
integrated f1 0.3387

Epoch 100, Total loss: 173689044992.0000, CE loss: 39.9352, RL loss: 1736890368.0000, Reward: -10977587.9844
    full cols: 355, non-full cols: 0
   r - labels: 3, labels - r: 5
    violated: 143673, weighted: 1.6641693115234375, len: 0.0, nonzero: 0.07036670297384262
Epoch 200, Total loss: 77675110400.0000, CE loss: 39.2966, RL loss: 776751104.0000, Reward: -10794060.0156
    full cols: 355, non-full cols: 0
   r - labels: 3, labels - r: 5
    violated: 146652, weighted: 1.6641693115234375, len: 0.0, nonzero: 0.07036670297384262
Epoch 300, Total loss: 54094282752.0000, CE loss: 38.4511, RL loss: 540942848.0000, Reward: -10426371.7969
    full cols: 355, non-full cols: 1
   r - labels: 4, labels - r: 5
    violated: 145307, weighted: 1.8325961828231812, len: 0.0, nonzero: 0.070509172976017
Epoch 400, Total loss: 6216475648.0000, CE loss: 37.6081, RL loss: 62164756.0000, Reward: -10065982.7969
    full cols: 356, non-full cols: 1
   r - labels: 5, labels - r: 5
    violated: 150956, weighted: 3.230027675628662, len: 0.0, nonzero: 0.07074765115976334
Epoch 500, Total loss: -35491143680.0000, CE loss: 36.2922, RL loss: -354911424.0000, Reward: -9048640.9922
    full cols: 358, non-full cols: 0
   r - labels: 6, labels - r: 5
    violated: 149201, weighted: 3.837238311767578, len: 0.0, nonzero: 0.0709613487124443
Epoch 600, Total loss: 41236922368.0000, CE loss: 34.9875, RL loss: 412369216.0000, Reward: -7867008.1719
    full cols: 358, non-full cols: 1
   r - labels: 7, labels - r: 5
    violated: 143931, weighted: 3.8867454528808594, len: 0.0, nonzero: 0.07115647196769714
Epoch 700, Total loss: 260930682880.0000, CE loss: 33.6466, RL loss: 2609306880.0000, Reward: -6307554.5156
    full cols: 355, non-full cols: 1
   r - labels: 6, labels - r: 7
    violated: 149051, weighted: 5.0740509033203125, len: 0.0, nonzero: 0.07039147615432739
Epoch 800, Total loss: 148874297344.0000, CE loss: 32.7549, RL loss: 1488743040.0000, Reward: -5466634.2344
    full cols: 359, non-full cols: 1
   r - labels: 9, labels - r: 6
    violated: 145996, weighted: 9.261850357055664, len: 0.0, nonzero: 0.0713546872138977
Epoch 900, Total loss: -52360380416.0000, CE loss: 32.1067, RL loss: -523603808.0000, Reward: -4791888.5430
    full cols: 361, non-full cols: 0
   r - labels: 10, labels - r: 6
    violated: 139153, weighted: 9.740997314453125, len: 0.0, nonzero: 0.07155599445104599
Epoch 1000, Total loss: -16929859584.0000, CE loss: 31.2682, RL loss: -169298592.0000, Reward: -2996260.2656
    full cols: 362, non-full cols: 1
   r - labels: 12, labels - r: 6
    violated: 145312, weighted: 11.322694778442383, len: 0.0, nonzero: 0.07177899032831192
Epoch 1100, Total loss: 18896103424.0000, CE loss: 30.8925, RL loss: 188961040.0000, Reward: -2467312.3457
    full cols: 362, non-full cols: 0
   r - labels: 12, labels - r: 7
    violated: 152302, weighted: 12.391674041748047, len: 0.0, nonzero: 0.07175421714782715
Epoch 1200, Total loss: -79583690752.0000, CE loss: 30.6234, RL loss: -795836928.0000, Reward: -2162646.1152
    full cols: 365, non-full cols: 0
   r - labels: 16, labels - r: 8
    violated: 151493, weighted: 54.99549865722656, len: 0.0, nonzero: 0.07234886288642883
Epoch 1300, Total loss: 139020926976.0000, CE loss: 30.4122, RL loss: 1390209280.0000, Reward: -2045575.3789
    full cols: 366, non-full cols: 3
   r - labels: 19, labels - r: 7
    violated: 141616, weighted: 46.05480194091797, len: 0.0, nonzero: 0.07294970750808716
Epoch 1400, Total loss: -4189028864.0000, CE loss: 30.2349, RL loss: -41890288.0000, Reward: -2044758.0039
    full cols: 363, non-full cols: 1
   r - labels: 16, labels - r: 9
    violated: 131803, weighted: 105.0218505859375, len: 0.0, nonzero: 0.07197720557451248
Epoch 1500, Total loss: 23155884032.0000, CE loss: 30.0670, RL loss: 231558848.0000, Reward: -2117488.2070
    full cols: 369, non-full cols: 3
   r - labels: 22, labels - r: 7
    violated: 146342, weighted: 133.5253448486328, len: 0.0, nonzero: 0.07340498268604279
Epoch 1600, Total loss: -27807113216.0000, CE loss: 29.9064, RL loss: -278071136.0000, Reward: -2101565.8945
    full cols: 373, non-full cols: 2
   r - labels: 28, labels - r: 10
    violated: 144688, weighted: 295.8958435058594, len: 0.0, nonzero: 0.07419165223836899
Epoch 1700, Total loss: -124437258240.0000, CE loss: 29.7095, RL loss: -1244372608.0000, Reward: -2126841.5098
    full cols: 372, non-full cols: 3
   r - labels: 29, labels - r: 11
    violated: 148336, weighted: 308.53558349609375, len: 0.0, nonzero: 0.07408325374126434
Epoch 1800, Total loss: -85747523584.0000, CE loss: 29.5034, RL loss: -857475200.0000, Reward: -2117917.4062
    full cols: 372, non-full cols: 3
   r - labels: 27, labels - r: 9
    violated: 152761, weighted: 281.916015625, len: 0.0, nonzero: 0.07411112636327744
Epoch 1900, Total loss: -241157881856.0000, CE loss: 29.2874, RL loss: -2411578880.0000, Reward: -2142373.9805
    full cols: 373, non-full cols: 1
   r - labels: 27, labels - r: 10
    violated: 151169, weighted: 308.2628173828125, len: 0.0, nonzero: 0.07393768429756165
--- eval ---
prediction result:
f1 on test:    0.5555
f1 on test:    0.9079 (micro)
f1 on KB:      0.3262
integrated f1: 0.3639, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5326
f1 on test:    0.8923 (micro)
f1 on KB:      0.3729
integrated f1: 0.4052, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: 32395094016.0000, CE loss: 29.0684, RL loss: 323950944.0000, Reward: -2126575.6113
    full cols: 369, non-full cols: 3
   r - labels: 27, labels - r: 12
    violated: 147085, weighted: 365.4178161621094, len: 0.0, nonzero: 0.07372398674488068
Epoch 2100, Total loss: 293015453696.0000, CE loss: 28.8380, RL loss: 2930154496.0000, Reward: -2086041.3379
    full cols: 373, non-full cols: 1
   r - labels: 30, labels - r: 13
    violated: 145883, weighted: 376.2558288574219, len: 0.0, nonzero: 0.07394388318061829
Epoch 2200, Total loss: 13700767744.0000, CE loss: 28.6148, RL loss: 137007680.0000, Reward: -2150589.0625
    full cols: 372, non-full cols: 1
   r - labels: 29, labels - r: 13
    violated: 149800, weighted: 388.2072448730469, len: 0.0, nonzero: 0.07392839342355728
Epoch 2300, Total loss: 156750610432.0000, CE loss: 28.3831, RL loss: 1567506048.0000, Reward: -2148774.7051
    full cols: 375, non-full cols: 0
   r - labels: 31, labels - r: 13
    violated: 150501, weighted: 473.69757080078125, len: 0.0, nonzero: 0.07433102279901505
Epoch 2400, Total loss: 98657099776.0000, CE loss: 28.1543, RL loss: 986571008.0000, Reward: -2148827.3262
    full cols: 377, non-full cols: 2
   r - labels: 36, labels - r: 14
    violated: 149043, weighted: 551.9818115234375, len: 0.0, nonzero: 0.0749504491686821
Epoch 2500, Total loss: -287636946944.0000, CE loss: 27.9542, RL loss: -2876369408.0000, Reward: -2206308.1367
    full cols: 379, non-full cols: 2
   r - labels: 38, labels - r: 14
    violated: 148940, weighted: 529.2727661132812, len: 0.0, nonzero: 0.07523538172245026
Epoch 2600, Total loss: 52215898112.0000, CE loss: 27.7839, RL loss: 522158976.0000, Reward: -2172617.4297
    full cols: 384, non-full cols: 4
   r - labels: 46, labels - r: 15
    violated: 141927, weighted: 645.8544921875, len: 0.0, nonzero: 0.07659192383289337
Epoch 2700, Total loss: -175287664640.0000, CE loss: 27.6293, RL loss: -1752876672.0000, Reward: -2207604.4551
    full cols: 382, non-full cols: 6
   r - labels: 47, labels - r: 16
    violated: 145668, weighted: 641.068359375, len: 0.0, nonzero: 0.07635034620761871
Epoch 2800, Total loss: 3265996032.0000, CE loss: 27.4935, RL loss: 32659960.0000, Reward: -2193709.1426
    full cols: 397, non-full cols: 3
   r - labels: 58, labels - r: 15
    violated: 144652, weighted: 879.5867919921875, len: 0.0, nonzero: 0.07902936637401581
Epoch 2900, Total loss: -30422276096.0000, CE loss: 27.3929, RL loss: -304222752.0000, Reward: -2189767.5508
    full cols: 397, non-full cols: 6
   r - labels: 60, labels - r: 14
    violated: 148300, weighted: 914.3152465820312, len: 0.0, nonzero: 0.07946605980396271
Epoch 3000, Total loss: -52047994880.0000, CE loss: 27.3165, RL loss: -520479968.0000, Reward: -2195392.8301
    full cols: 400, non-full cols: 4
   r - labels: 61, labels - r: 14
    violated: 141789, weighted: 1031.62939453125, len: 0.0, nonzero: 0.07969524711370468
Epoch 3100, Total loss: -18239291392.0000, CE loss: 27.2308, RL loss: -182392912.0000, Reward: -2213697.5742
    full cols: 406, non-full cols: 6
   r - labels: 68, labels - r: 13
    violated: 145566, weighted: 1104.185546875, len: 0.0, nonzero: 0.08087524771690369
Epoch 3200, Total loss: 179099369472.0000, CE loss: 27.1833, RL loss: 1790993664.0000, Reward: -2209684.9883
    full cols: 401, non-full cols: 3
   r - labels: 62, labels - r: 15
    violated: 140947, weighted: 1214.8543701171875, len: 0.0, nonzero: 0.07990894466638565
Epoch 3300, Total loss: 4148786688.0000, CE loss: 27.1350, RL loss: 41487868.0000, Reward: -2248594.5508
    full cols: 399, non-full cols: 3
   r - labels: 60, labels - r: 15
    violated: 144866, weighted: 1160.054931640625, len: 0.0, nonzero: 0.07950012385845184
Epoch 3400, Total loss: -12602810368.0000, CE loss: 27.0831, RL loss: -126028104.0000, Reward: -2254516.2773
    full cols: 401, non-full cols: 8
   r - labels: 68, labels - r: 16
    violated: 147308, weighted: 1363.720947265625, len: 0.0, nonzero: 0.08035493642091751
Epoch 3500, Total loss: -187944976384.0000, CE loss: 27.0592, RL loss: -1879449728.0000, Reward: -2296292.6895
    full cols: 408, non-full cols: 3
   r - labels: 70, labels - r: 16
    violated: 148480, weighted: 1423.592529296875, len: 0.0, nonzero: 0.08090931922197342
Epoch 3600, Total loss: -21836435456.0000, CE loss: 27.0213, RL loss: -218364352.0000, Reward: -2264731.5449
    full cols: 415, non-full cols: 4
   r - labels: 79, labels - r: 17
    violated: 145234, weighted: 1608.422119140625, len: 0.0, nonzero: 0.08283263444900513
Epoch 3700, Total loss: -108448612352.0000, CE loss: 27.0030, RL loss: -1084486144.0000, Reward: -2278344.8672
    full cols: 412, non-full cols: 6
   r - labels: 82, labels - r: 21
    violated: 144112, weighted: 1794.4595947265625, len: 0.0, nonzero: 0.08253840357065201
Epoch 3800, Total loss: 16174296064.0000, CE loss: 26.9752, RL loss: 161742960.0000, Reward: -2279258.4043
    full cols: 411, non-full cols: 3
   r - labels: 77, labels - r: 20
    violated: 148457, weighted: 1656.16748046875, len: 0.0, nonzero: 0.08184774965047836
Epoch 3900, Total loss: 160802390016.0000, CE loss: 26.9431, RL loss: 1608023936.0000, Reward: -2284470.9707
    full cols: 410, non-full cols: 5
   r - labels: 77, labels - r: 19
    violated: 145375, weighted: 1648.332275390625, len: 0.0, nonzero: 0.08201809227466583
--- eval ---
prediction result:
f1 on test:    0.5373
f1 on test:    0.8932 (micro)
f1 on KB:      0.3450
integrated f1: 0.3801, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5249
f1 on test:    0.8850 (micro)
f1 on KB:      0.3826
integrated f1: 0.4127, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: 98083168256.0000, CE loss: 26.9260, RL loss: 980831680.0000, Reward: -2281677.9707
    full cols: 412, non-full cols: 5
   r - labels: 79, labels - r: 19
    violated: 149348, weighted: 1704.9893798828125, len: 0.0, nonzero: 0.0822472795844078
Epoch 4100, Total loss: 87217537024.0000, CE loss: 26.9215, RL loss: 872175360.0000, Reward: -2278260.1172
    full cols: 407, non-full cols: 11
   r - labels: 81, labels - r: 20
    violated: 152143, weighted: 1830.710693359375, len: 0.0, nonzero: 0.0821295827627182
Epoch 4200, Total loss: 65050284032.0000, CE loss: 26.8911, RL loss: 650502848.0000, Reward: -2281285.7266
    full cols: 413, non-full cols: 12
   r - labels: 90, labels - r: 22
    violated: 142574, weighted: 1879.90576171875, len: 0.0, nonzero: 0.0826839730143547
Epoch 4300, Total loss: 44892786688.0000, CE loss: 26.8807, RL loss: 448927872.0000, Reward: -2296782.2461
    full cols: 416, non-full cols: 11
   r - labels: 97, labels - r: 27
    violated: 147633, weighted: 2191.98583984375, len: 0.0, nonzero: 0.082916259765625
Epoch 4400, Total loss: -34854490112.0000, CE loss: 26.8608, RL loss: -348544896.0000, Reward: -2303028.5293
    full cols: 416, non-full cols: 5
   r - labels: 93, labels - r: 29
    violated: 144568, weighted: 2371.97412109375, len: 0.0, nonzero: 0.08289457857608795
Epoch 4500, Total loss: 127812386816.0000, CE loss: 26.8564, RL loss: 1278123904.0000, Reward: -2296170.3672
    full cols: 420, non-full cols: 8
   r - labels: 99, labels - r: 28
    violated: 141293, weighted: 2453.39892578125, len: 0.0, nonzero: 0.08414271473884583
Epoch 4600, Total loss: 93665878016.0000, CE loss: 26.8401, RL loss: 936658816.0000, Reward: -2298014.7188
    full cols: 419, non-full cols: 6
   r - labels: 99, labels - r: 31
    violated: 152103, weighted: 2608.42236328125, len: 0.0, nonzero: 0.08384539186954498
Epoch 4700, Total loss: -8926019584.0000, CE loss: 26.8372, RL loss: -89260192.0000, Reward: -2315639.5508
    full cols: 423, non-full cols: 5
   r - labels: 104, labels - r: 33
    violated: 145066, weighted: 2764.9560546875, len: 0.0, nonzero: 0.08435332030057907
Epoch 4800, Total loss: 127019106304.0000, CE loss: 26.8111, RL loss: 1270191104.0000, Reward: -2326233.6660
    full cols: 435, non-full cols: 10
   r - labels: 119, labels - r: 31
    violated: 144416, weighted: 3053.708984375, len: 0.0, nonzero: 0.0873420462012291
Epoch 4900, Total loss: 20781121536.0000, CE loss: 26.8043, RL loss: 207811216.0000, Reward: -2330564.0898
    full cols: 432, non-full cols: 4
   r - labels: 114, labels - r: 35
    violated: 143167, weighted: 2976.643310546875, len: 0.0, nonzero: 0.08586781471967697
Epoch 5000, Total loss: -23818735616.0000, CE loss: 26.8190, RL loss: -238187360.0000, Reward: -2357884.0840
    full cols: 435, non-full cols: 9
   r - labels: 123, labels - r: 36
    violated: 145544, weighted: 3127.2587890625, len: 0.0, nonzero: 0.08717170357704163
Epoch 5100, Total loss: 107214888960.0000, CE loss: 26.7997, RL loss: 1072148864.0000, Reward: -2357247.0820
    full cols: 433, non-full cols: 6
   r - labels: 119, labels - r: 37
    violated: 152854, weighted: 3110.9853515625, len: 0.0, nonzero: 0.08669784665107727
Epoch 5200, Total loss: 20911110144.0000, CE loss: 26.7733, RL loss: 209111104.0000, Reward: -2363551.4355
    full cols: 441, non-full cols: 6
   r - labels: 124, labels - r: 34
    violated: 140753, weighted: 3220.84375, len: 0.0, nonzero: 0.08794908225536346
Epoch 5300, Total loss: -104546082816.0000, CE loss: 26.7688, RL loss: -1045460864.0000, Reward: -2396392.5273
    full cols: 437, non-full cols: 9
   r - labels: 127, labels - r: 38
    violated: 147244, weighted: 3370.53076171875, len: 0.0, nonzero: 0.08775706589221954
Epoch 5400, Total loss: 35819757568.0000, CE loss: 26.7690, RL loss: 358197568.0000, Reward: -2389013.5898
    full cols: 440, non-full cols: 8
   r - labels: 128, labels - r: 37
    violated: 151662, weighted: 3328.925048828125, len: 0.0, nonzero: 0.08784378319978714
Epoch 5500, Total loss: 10994810880.0000, CE loss: 26.7578, RL loss: 109948112.0000, Reward: -2415459.7070
    full cols: 442, non-full cols: 9
   r - labels: 134, labels - r: 40
    violated: 139554, weighted: 3534.4765625, len: 0.0, nonzero: 0.08854373544454575
Epoch 5600, Total loss: 185149997056.0000, CE loss: 26.7546, RL loss: 1851499904.0000, Reward: -2399829.0938
    full cols: 442, non-full cols: 11
   r - labels: 136, labels - r: 40
    violated: 145205, weighted: 3595.662841796875, len: 0.0, nonzero: 0.08863664418458939
Epoch 5700, Total loss: 68024692736.0000, CE loss: 26.7462, RL loss: 680246912.0000, Reward: -2410623.4414
    full cols: 447, non-full cols: 7
   r - labels: 139, labels - r: 42
    violated: 145333, weighted: 3681.28466796875, len: 0.0, nonzero: 0.08927465230226517
Epoch 5800, Total loss: -79647490048.0000, CE loss: 26.7400, RL loss: -796474880.0000, Reward: -2438871.3633
    full cols: 460, non-full cols: 5
   r - labels: 150, labels - r: 42
    violated: 143089, weighted: 4045.786865234375, len: 0.0, nonzero: 0.09202180802822113
Epoch 5900, Total loss: 34574991360.0000, CE loss: 26.7227, RL loss: 345749920.0000, Reward: -2447373.5449
    full cols: 452, non-full cols: 13
   r - labels: 152, labels - r: 44
    violated: 146879, weighted: 4025.515625, len: 0.0, nonzero: 0.09062810242176056
--- eval ---
prediction result:
f1 on test:    0.5374
f1 on test:    0.8932 (micro)
f1 on KB:      0.3450
integrated f1: 0.3801, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5197
f1 on test:    0.8797 (micro)
f1 on KB:      0.3943
integrated f1: 0.4221, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: 21556758528.0000, CE loss: 26.7327, RL loss: 215567584.0000, Reward: -2447004.1680
    full cols: 454, non-full cols: 18
   r - labels: 163, labels - r: 48
    violated: 150867, weighted: 4338.1572265625, len: 0.0, nonzero: 0.09191031008958817
Epoch 6100, Total loss: -93179084800.0000, CE loss: 26.7156, RL loss: -931790848.0000, Reward: -2468683.8867
    full cols: 461, non-full cols: 13
   r - labels: 165, labels - r: 48
    violated: 136791, weighted: 4451.97900390625, len: 0.0, nonzero: 0.09247089177370071
Epoch 6200, Total loss: 179527417856.0000, CE loss: 26.7104, RL loss: 1795274240.0000, Reward: -2455956.9980
    full cols: 462, non-full cols: 11
   r - labels: 164, labels - r: 48
    violated: 143770, weighted: 4331.05224609375, len: 0.0, nonzero: 0.09265052527189255
Epoch 6300, Total loss: -79954862080.0000, CE loss: 26.7211, RL loss: -799548608.0000, Reward: -2489319.8301
    full cols: 466, non-full cols: 19
   r - labels: 175, labels - r: 47
    violated: 141357, weighted: 4539.35400390625, len: 0.0, nonzero: 0.09432916343212128
Epoch 6400, Total loss: 32492417024.0000, CE loss: 26.7055, RL loss: 324924160.0000, Reward: -2479841.3809
    full cols: 462, non-full cols: 19
   r - labels: 173, labels - r: 49
    violated: 135043, weighted: 4520.86767578125, len: 0.0, nonzero: 0.09307482838630676
Epoch 6500, Total loss: 33322645504.0000, CE loss: 26.7074, RL loss: 333226464.0000, Reward: -2497947.8086
    full cols: 457, non-full cols: 21
   r - labels: 172, labels - r: 51
    violated: 141597, weighted: 4565.1103515625, len: 0.0, nonzero: 0.09323588013648987
Epoch 6600, Total loss: 18702067712.0000, CE loss: 26.7128, RL loss: 187020672.0000, Reward: -2497206.0898
    full cols: 459, non-full cols: 14
   r - labels: 166, labels - r: 50
    violated: 143541, weighted: 4555.4541015625, len: 0.0, nonzero: 0.09227576851844788
Epoch 6700, Total loss: -104853651456.0000, CE loss: 26.6944, RL loss: -1048536512.0000, Reward: -2518790.6211
    full cols: 473, non-full cols: 11
   r - labels: 181, labels - r: 54
    violated: 143361, weighted: 5044.00244140625, len: 0.0, nonzero: 0.09494239836931229
Epoch 6800, Total loss: -86223945728.0000, CE loss: 26.7035, RL loss: -862239488.0000, Reward: -2532345.3867
    full cols: 465, non-full cols: 17
   r - labels: 174, labels - r: 49
    violated: 143162, weighted: 4742.1748046875, len: 0.0, nonzero: 0.09399467706680298
Epoch 6900, Total loss: -26259787776.0000, CE loss: 26.6951, RL loss: -262597888.0000, Reward: -2531019.6445
    full cols: 469, non-full cols: 24
   r - labels: 187, labels - r: 51
    violated: 144668, weighted: 4966.95068359375, len: 0.0, nonzero: 0.09559588879346848
Epoch 7000, Total loss: -12176602112.0000, CE loss: 26.6863, RL loss: -121766024.0000, Reward: -2552041.0625
    full cols: 471, non-full cols: 24
   r - labels: 195, labels - r: 57
    violated: 144599, weighted: 5366.0380859375, len: 0.0, nonzero: 0.09627415984869003
Epoch 7100, Total loss: 22934622208.0000, CE loss: 26.6960, RL loss: 229346224.0000, Reward: -2537190.9844
    full cols: 479, non-full cols: 21
   r - labels: 196, labels - r: 53
    violated: 141270, weighted: 5275.16552734375, len: 0.0, nonzero: 0.09746655076742172
Epoch 7200, Total loss: 13387445248.0000, CE loss: 26.6952, RL loss: 133874456.0000, Reward: -2559142.7930
    full cols: 490, non-full cols: 16
   r - labels: 207, labels - r: 58
    violated: 141750, weighted: 5633.50244140625, len: 0.0, nonzero: 0.09884167462587357
Epoch 7300, Total loss: -19253411840.0000, CE loss: 26.6956, RL loss: -192534128.0000, Reward: -2576468.8984
    full cols: 488, non-full cols: 15
   r - labels: 201, labels - r: 55
    violated: 143475, weighted: 5422.2568359375, len: 0.0, nonzero: 0.09844834357500076
Epoch 7400, Total loss: 96699121664.0000, CE loss: 26.6753, RL loss: 966991232.0000, Reward: -2567983.2324
    full cols: 471, non-full cols: 27
   r - labels: 199, labels - r: 58
    violated: 147851, weighted: 5371.7353515625, len: 0.0, nonzero: 0.09679137915372849
Epoch 7500, Total loss: -48278798336.0000, CE loss: 26.6838, RL loss: -482787968.0000, Reward: -2598223.6914
    full cols: 468, non-full cols: 29
   r - labels: 203, labels - r: 63
    violated: 136983, weighted: 5317.310546875, len: 0.0, nonzero: 0.09557730704545975
Epoch 7600, Total loss: 36377403392.0000, CE loss: 26.6790, RL loss: 363774048.0000, Reward: -2595454.4805
    full cols: 474, non-full cols: 34
   r - labels: 214, labels - r: 63
    violated: 136851, weighted: 5657.9306640625, len: 0.0, nonzero: 0.0981479212641716
Epoch 7700, Total loss: 85873238016.0000, CE loss: 26.6800, RL loss: 858732352.0000, Reward: -2600863.4609
    full cols: 483, non-full cols: 24
   r - labels: 217, labels - r: 67
    violated: 144384, weighted: 5994.96875, len: 0.0, nonzero: 0.09819437563419342
Epoch 7800, Total loss: 99170738176.0000, CE loss: 26.6646, RL loss: 991707392.0000, Reward: -2598569.4688
    full cols: 468, non-full cols: 36
   r - labels: 213, labels - r: 66
    violated: 130948, weighted: 5792.8740234375, len: 0.0, nonzero: 0.09660864621400833
Epoch 7900, Total loss: 63615213568.0000, CE loss: 26.6616, RL loss: 636152128.0000, Reward: -2612378.2617
    full cols: 484, non-full cols: 23
   r - labels: 218, labels - r: 68
    violated: 139976, weighted: 6053.4453125, len: 0.0, nonzero: 0.0987735390663147
--- eval ---
prediction result:
f1 on test:    0.5374
f1 on test:    0.8932 (micro)
f1 on KB:      0.3450
integrated f1: 0.3801, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5142
f1 on test:    0.8729 (micro)
f1 on KB:      0.4047
integrated f1: 0.4300, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: 150182215680.0000, CE loss: 26.6782, RL loss: 1501822208.0000, Reward: -2618848.3594
    full cols: 488, non-full cols: 16
   r - labels: 225, labels - r: 78
    violated: 137844, weighted: 6413.2509765625, len: 0.0, nonzero: 0.0984390527009964
Epoch 8100, Total loss: -101048508416.0000, CE loss: 26.6708, RL loss: -1010485120.0000, Reward: -2633817.2969
    full cols: 487, non-full cols: 27
   r - labels: 234, labels - r: 77
    violated: 140119, weighted: 6488.33984375, len: 0.0, nonzero: 0.09919784963130951
Epoch 8200, Total loss: 91169210368.0000, CE loss: 26.6559, RL loss: 911692096.0000, Reward: -2606778.2539
    full cols: 492, non-full cols: 23
   r - labels: 238, labels - r: 80
    violated: 142841, weighted: 6533.5283203125, len: 0.0, nonzero: 0.09950446337461472
Epoch 8300, Total loss: 44046483456.0000, CE loss: 26.6671, RL loss: 440464832.0000, Reward: -2603914.2617
    full cols: 497, non-full cols: 25
   r - labels: 241, labels - r: 76
    violated: 141386, weighted: 6618.1943359375, len: 0.0, nonzero: 0.10094772279262543
Epoch 8400, Total loss: -79789113344.0000, CE loss: 26.6642, RL loss: -797891136.0000, Reward: -2634257.0312
    full cols: 498, non-full cols: 26
   r - labels: 247, labels - r: 80
    violated: 145394, weighted: 6955.23779296875, len: 0.0, nonzero: 0.10193260759115219
Epoch 8500, Total loss: 47682240512.0000, CE loss: 26.6725, RL loss: 476822400.0000, Reward: -2621442.2148
    full cols: 493, non-full cols: 28
   r - labels: 245, labels - r: 81
    violated: 134076, weighted: 6793.408203125, len: 0.0, nonzero: 0.10046457499265671
Epoch 8600, Total loss: -166754156544.0000, CE loss: 26.6761, RL loss: -1667541504.0000, Reward: -2629067.6875
    full cols: 498, non-full cols: 22
   r - labels: 242, labels - r: 79
    violated: 142580, weighted: 6894.455078125, len: 0.0, nonzero: 0.10106851160526276
Epoch 8700, Total loss: -49269739520.0000, CE loss: 26.6619, RL loss: -492697376.0000, Reward: -2634360.5820
    full cols: 497, non-full cols: 23
   r - labels: 243, labels - r: 80
    violated: 141823, weighted: 6874.1884765625, len: 0.0, nonzero: 0.10148662328720093
Epoch 8800, Total loss: -45278232576.0000, CE loss: 26.6540, RL loss: -452782336.0000, Reward: -2633533.5820
    full cols: 510, non-full cols: 20
   r - labels: 253, labels - r: 80
    violated: 140231, weighted: 7064.2578125, len: 0.0, nonzero: 0.10323959589004517
Epoch 8900, Total loss: -38168023040.0000, CE loss: 26.6670, RL loss: -381680224.0000, Reward: -2626575.4219
    full cols: 514, non-full cols: 19
   r - labels: 258, labels - r: 82
    violated: 139933, weighted: 7251.90869140625, len: 0.0, nonzero: 0.10402936488389969
Epoch 9000, Total loss: -6108861440.0000, CE loss: 26.6476, RL loss: -61088616.0000, Reward: -2636075.4844
    full cols: 499, non-full cols: 28
   r - labels: 255, labels - r: 85
    violated: 137500, weighted: 7052.0205078125, len: 0.0, nonzero: 0.1020657867193222
Epoch 9100, Total loss: -19708610560.0000, CE loss: 26.6540, RL loss: -197086112.0000, Reward: -2645856.9688
    full cols: 494, non-full cols: 27
   r - labels: 254, labels - r: 90
    violated: 140308, weighted: 7296.224609375, len: 0.0, nonzero: 0.10066279023885727
Epoch 9200, Total loss: -77482229760.0000, CE loss: 26.6437, RL loss: -774822272.0000, Reward: -2641594.4805
    full cols: 491, non-full cols: 30
   r - labels: 254, labels - r: 90
    violated: 143223, weighted: 7057.07763671875, len: 0.0, nonzero: 0.09966860711574554
Epoch 9300, Total loss: -12480963584.0000, CE loss: 26.6629, RL loss: -124809632.0000, Reward: -2654582.2930
    full cols: 495, non-full cols: 33
   r - labels: 261, labels - r: 90
    violated: 143246, weighted: 7390.0087890625, len: 0.0, nonzero: 0.10152998566627502
Epoch 9400, Total loss: -44711260160.0000, CE loss: 26.6529, RL loss: -447112608.0000, Reward: -2653309.9023
    full cols: 510, non-full cols: 28
   r - labels: 269, labels - r: 88
    violated: 141857, weighted: 7521.76806640625, len: 0.0, nonzero: 0.1036081537604332
Epoch 9500, Total loss: -46465150976.0000, CE loss: 26.6457, RL loss: -464651520.0000, Reward: -2640281.8945
    full cols: 499, non-full cols: 23
   r - labels: 256, labels - r: 91
    violated: 142258, weighted: 7437.3701171875, len: 0.0, nonzero: 0.10132867097854614
Epoch 9600, Total loss: 40832413696.0000, CE loss: 26.6439, RL loss: 408324128.0000, Reward: -2656078.6836
    full cols: 494, non-full cols: 34
   r - labels: 267, labels - r: 96
    violated: 142361, weighted: 7733.65234375, len: 0.0, nonzero: 0.10169102996587753
Epoch 9700, Total loss: 34610159616.0000, CE loss: 26.6500, RL loss: 346101600.0000, Reward: -2675651.1641
    full cols: 498, non-full cols: 22
   r - labels: 258, labels - r: 95
    violated: 141692, weighted: 7551.99658203125, len: 0.0, nonzero: 0.10111496597528458
Epoch 9800, Total loss: -7081326592.0000, CE loss: 26.6350, RL loss: -70813264.0000, Reward: -2667634.5781
    full cols: 489, non-full cols: 24
   r - labels: 255, labels - r: 99
    violated: 137709, weighted: 7566.50634765625, len: 0.0, nonzero: 0.09912971407175064
Epoch 9900, Total loss: 99738624000.0000, CE loss: 26.6552, RL loss: 997386240.0000, Reward: -2661871.5312
    full cols: 499, non-full cols: 28
   r - labels: 272, labels - r: 102
    violated: 138288, weighted: 7865.00927734375, len: 0.0, nonzero: 0.10088887810707092
--- eval ---
prediction result:
f1 on test:    0.5371
f1 on test:    0.8932 (micro)
f1 on KB:      0.3444
integrated f1: 0.3795, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5095
f1 on test:    0.8699 (micro)
f1 on KB:      0.4110
integrated f1: 0.4344, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 10000, Total loss: 46050095104.0000, CE loss: 26.6379, RL loss: 460500960.0000, Reward: -2677321.8281
    full cols: 502, non-full cols: 31
   r - labels: 277, labels - r: 101
    violated: 136246, weighted: 8019.02392578125, len: 0.0, nonzero: 0.10285245627164841
Epoch 10100, Total loss: -55632084992.0000, CE loss: 26.6373, RL loss: -556320832.0000, Reward: -2706021.2031
    full cols: 499, non-full cols: 29
   r - labels: 279, labels - r: 108
    violated: 138252, weighted: 8250.763671875, len: 0.0, nonzero: 0.10110567510128021
Epoch 10200, Total loss: 39754612736.0000, CE loss: 26.6562, RL loss: 397546144.0000, Reward: -2711457.7070
    full cols: 497, non-full cols: 31
   r - labels: 281, labels - r: 110
    violated: 140504, weighted: 8446.4619140625, len: 0.0, nonzero: 0.10092604160308838
Epoch 10300, Total loss: 109824778240.0000, CE loss: 26.6408, RL loss: 1098247808.0000, Reward: -2709947.5352
    full cols: 499, non-full cols: 30
   r - labels: 286, labels - r: 114
    violated: 143396, weighted: 8753.46875, len: 0.0, nonzero: 0.10179014503955841
Epoch 10400, Total loss: -85188444160.0000, CE loss: 26.6457, RL loss: -851884416.0000, Reward: -2734341.9844
    full cols: 502, non-full cols: 46
   r - labels: 304, labels - r: 113
    violated: 143284, weighted: 8895.240234375, len: 0.0, nonzero: 0.10338825732469559
Epoch 10500, Total loss: 65646657536.0000, CE loss: 26.6406, RL loss: 656466560.0000, Reward: -2735716.8633
    full cols: 513, non-full cols: 25
   r - labels: 296, labels - r: 115
    violated: 136908, weighted: 8963.9453125, len: 0.0, nonzero: 0.10364222526550293
Epoch 10600, Total loss: -111185674240.0000, CE loss: 26.6279, RL loss: -1111856768.0000, Reward: -2754662.3125
    full cols: 505, non-full cols: 32
   r - labels: 301, labels - r: 121
    violated: 136538, weighted: 9188.5537109375, len: 0.0, nonzero: 0.10354930907487869
Epoch 10700, Total loss: 16644061184.0000, CE loss: 26.6444, RL loss: 166440608.0000, Reward: -2768331.2539
    full cols: 505, non-full cols: 41
   r - labels: 308, labels - r: 119
    violated: 130741, weighted: 9363.1357421875, len: 0.0, nonzero: 0.1042647436261177
Epoch 10800, Total loss: 82414067712.0000, CE loss: 26.6312, RL loss: 824140672.0000, Reward: -2758213.9102
    full cols: 517, non-full cols: 40
   r - labels: 316, labels - r: 116
    violated: 141465, weighted: 9482.55859375, len: 0.0, nonzero: 0.10602391511201859
Epoch 10900, Total loss: 74312867840.0000, CE loss: 26.6452, RL loss: 743128704.0000, Reward: -2779681.2891
    full cols: 526, non-full cols: 28
   r - labels: 312, labels - r: 115
    violated: 138426, weighted: 9486.208984375, len: 0.0, nonzero: 0.1067827120423317
Epoch 11000, Total loss: -183571103744.0000, CE loss: 26.6302, RL loss: -1835710976.0000, Reward: -2808415.9336
    full cols: 516, non-full cols: 41
   r - labels: 319, labels - r: 119
    violated: 143211, weighted: 9487.779296875, len: 0.0, nonzero: 0.10617876797914505
Epoch 11100, Total loss: -44435984384.0000, CE loss: 26.6395, RL loss: -444359840.0000, Reward: -2795250.1641
    full cols: 509, non-full cols: 36
   r - labels: 308, labels - r: 120
    violated: 142858, weighted: 9299.134765625, len: 0.0, nonzero: 0.10458065569400787
Epoch 11200, Total loss: -116755914752.0000, CE loss: 26.6365, RL loss: -1167559168.0000, Reward: -2823518.5391
    full cols: 523, non-full cols: 24
   r - labels: 308, labels - r: 118
    violated: 139006, weighted: 9209.978515625, len: 0.0, nonzero: 0.10546333342790604
Epoch 11300, Total loss: -114681077760.0000, CE loss: 26.6513, RL loss: -1146810752.0000, Reward: -2840629.5352
    full cols: 519, non-full cols: 41
   r - labels: 319, labels - r: 116
    violated: 142796, weighted: 9334.380859375, len: 0.0, nonzero: 0.10658139735460281
Epoch 11400, Total loss: 132241866752.0000, CE loss: 26.6363, RL loss: 1322418688.0000, Reward: -2819229.7578
    full cols: 516, non-full cols: 56
   r - labels: 332, labels - r: 117
    violated: 141657, weighted: 9695.1103515625, len: 0.0, nonzero: 0.10842108726501465
Epoch 11500, Total loss: 82533941248.0000, CE loss: 26.6519, RL loss: 825339392.0000, Reward: -2857375.8750
    full cols: 513, non-full cols: 62
   r - labels: 332, labels - r: 114
    violated: 140829, weighted: 9688.888671875, len: 0.0, nonzero: 0.10868743807077408
Epoch 11600, Total loss: -24458184704.0000, CE loss: 26.6654, RL loss: -244581856.0000, Reward: -2877180.0586
    full cols: 520, non-full cols: 57
   r - labels: 337, labels - r: 117
    violated: 139599, weighted: 9644.25, len: 0.0, nonzero: 0.10865647345781326
Epoch 11700, Total loss: -76931350528.0000, CE loss: 26.6497, RL loss: -769313536.0000, Reward: -2897496.0820
    full cols: 492, non-full cols: 112
   r - labels: 361, labels - r: 114
    violated: 144849, weighted: 9650.3056640625, len: 0.0, nonzero: 0.10814544558525085
Epoch 11800, Total loss: -81194909696.0000, CE loss: 26.6349, RL loss: -811949056.0000, Reward: -2900031.6719
    full cols: 521, non-full cols: 64
   r - labels: 347, labels - r: 119
    violated: 132111, weighted: 9867.5615234375, len: 0.0, nonzero: 0.10942455381155014
Epoch 11900, Total loss: -131249405952.0000, CE loss: 26.6278, RL loss: -1312494080.0000, Reward: -2917449.8281
    full cols: 532, non-full cols: 62
   r - labels: 360, labels - r: 123
    violated: 140127, weighted: 10364.3291015625, len: 0.0, nonzero: 0.1117350161075592
--- eval ---
prediction result:
f1 on test:    0.5372
f1 on test:    0.8932 (micro)
f1 on KB:      0.3449
integrated f1: 0.3800, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5066
f1 on test:    0.8653 (micro)
f1 on KB:      0.4202
integrated f1: 0.4413, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 12000, Total loss: 167596654592.0000, CE loss: 26.6296, RL loss: 1675966464.0000, Reward: -2905048.5234
    full cols: 539, non-full cols: 54
   r - labels: 363, labels - r: 127
    violated: 137918, weighted: 10465.7734375, len: 0.0, nonzero: 0.1116761639714241
Epoch 12100, Total loss: 89597059072.0000, CE loss: 26.6409, RL loss: 895970560.0000, Reward: -2914119.0781
    full cols: 526, non-full cols: 46
   r - labels: 349, labels - r: 134
    violated: 141423, weighted: 10318.650390625, len: 0.0, nonzero: 0.10859142988920212
Epoch 12200, Total loss: 868146688.0000, CE loss: 26.6366, RL loss: 8681467.0000, Reward: -2927581.8984
    full cols: 528, non-full cols: 61
   r - labels: 362, labels - r: 130
    violated: 136488, weighted: 10290.7919921875, len: 0.0, nonzero: 0.10955463349819183
Epoch 12300, Total loss: 116991246336.0000, CE loss: 26.6408, RL loss: 1169912448.0000, Reward: -2933232.9648
    full cols: 531, non-full cols: 57
   r - labels: 359, labels - r: 128
    violated: 139933, weighted: 10357.416015625, len: 0.0, nonzero: 0.11054881662130356
Epoch 12400, Total loss: 117239693312.0000, CE loss: 26.6359, RL loss: 1172396928.0000, Reward: -2926121.7891
    full cols: 532, non-full cols: 52
   r - labels: 352, labels - r: 125
    violated: 144997, weighted: 10212.6962890625, len: 0.0, nonzero: 0.11048067361116409
Epoch 12500, Total loss: -49541115904.0000, CE loss: 26.6684, RL loss: -495411168.0000, Reward: -2941360.4766
    full cols: 522, non-full cols: 64
   r - labels: 353, labels - r: 124
    violated: 138714, weighted: 10225.103515625, len: 0.0, nonzero: 0.10973426699638367
Epoch 12600, Total loss: 48349376512.0000, CE loss: 26.6243, RL loss: 483493760.0000, Reward: -2910034.3047
    full cols: 522, non-full cols: 66
   r - labels: 355, labels - r: 124
    violated: 140409, weighted: 10396.640625, len: 0.0, nonzero: 0.11044351011514664
Epoch 12700, Total loss: 3461488128.0000, CE loss: 26.6241, RL loss: 34614880.0000, Reward: -2928888.7891
    full cols: 520, non-full cols: 75
   r - labels: 362, labels - r: 124
    violated: 139468, weighted: 10560.576171875, len: 0.0, nonzero: 0.11245045065879822
Epoch 12800, Total loss: -44187398144.0000, CE loss: 26.6327, RL loss: -441873984.0000, Reward: -2935819.0938
    full cols: 515, non-full cols: 61
   r - labels: 348, labels - r: 129
    violated: 142714, weighted: 10247.134765625, len: 0.0, nonzero: 0.10901883244514465
Epoch 12900, Total loss: -65955540992.0000, CE loss: 26.6520, RL loss: -659555392.0000, Reward: -2949786.4609
    full cols: 536, non-full cols: 40
   r - labels: 352, labels - r: 133
    violated: 131357, weighted: 10464.544921875, len: 0.0, nonzero: 0.11022361367940903
Epoch 13000, Total loss: -35420078080.0000, CE loss: 26.6413, RL loss: -354200800.0000, Reward: -2937128.4062
    full cols: 529, non-full cols: 43
   r - labels: 349, labels - r: 134
    violated: 139547, weighted: 10517.501953125, len: 0.0, nonzero: 0.10923253744840622
Epoch 13100, Total loss: 1931338752.0000, CE loss: 26.6211, RL loss: 19313388.0000, Reward: -2941991.2070
    full cols: 521, non-full cols: 55
   r - labels: 348, labels - r: 129
    violated: 139684, weighted: 10457.443359375, len: 0.0, nonzero: 0.10917369276285172
Epoch 13200, Total loss: -35679064064.0000, CE loss: 26.6387, RL loss: -356790656.0000, Reward: -2961575.5547
    full cols: 518, non-full cols: 50
   r - labels: 350, labels - r: 139
    violated: 128276, weighted: 10462.5458984375, len: 0.0, nonzero: 0.10774281620979309
Epoch 13300, Total loss: -18515910656.0000, CE loss: 26.6347, RL loss: -185159104.0000, Reward: -2966581.1250
    full cols: 514, non-full cols: 56
   r - labels: 353, labels - r: 140
    violated: 137686, weighted: 10588.431640625, len: 0.0, nonzero: 0.1075260192155838
Epoch 13400, Total loss: -87612882944.0000, CE loss: 26.6278, RL loss: -876128832.0000, Reward: -2969391.4336
    full cols: 528, non-full cols: 35
   r - labels: 347, labels - r: 141
    violated: 142011, weighted: 10595.9921875, len: 0.0, nonzero: 0.10793793946504593
Epoch 13500, Total loss: -8546463744.0000, CE loss: 26.6333, RL loss: -85464640.0000, Reward: -2953845.6875
    full cols: 514, non-full cols: 52
   r - labels: 348, labels - r: 139
    violated: 143418, weighted: 10500.375, len: 0.0, nonzero: 0.10658758878707886
Epoch 13600, Total loss: 74527784960.0000, CE loss: 26.6289, RL loss: 745277888.0000, Reward: -2966528.6680
    full cols: 516, non-full cols: 48
   r - labels: 350, labels - r: 143
    violated: 138812, weighted: 10553.560546875, len: 0.0, nonzero: 0.10719772428274155
Epoch 13700, Total loss: -48082055168.0000, CE loss: 26.6352, RL loss: -480820544.0000, Reward: -2971102.5938
    full cols: 506, non-full cols: 52
   r - labels: 340, labels - r: 139
    violated: 138906, weighted: 10329.9638671875, len: 0.0, nonzero: 0.1054726243019104
Epoch 13800, Total loss: 71911342080.0000, CE loss: 26.6195, RL loss: 719113408.0000, Reward: -2975211.8203
    full cols: 491, non-full cols: 79
   r - labels: 350, labels - r: 137
    violated: 135880, weighted: 10177.4072265625, len: 0.0, nonzero: 0.1054137796163559
Epoch 13900, Total loss: -90483490816.0000, CE loss: 26.6427, RL loss: -904834944.0000, Reward: -2992530.7266
    full cols: 494, non-full cols: 65
   r - labels: 339, labels - r: 137
    violated: 134025, weighted: 10086.4873046875, len: 0.0, nonzero: 0.1042058989405632
--- eval ---
prediction result:
f1 on test:    0.5373
f1 on test:    0.8932 (micro)
f1 on KB:      0.3449
integrated f1: 0.3801, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5091
f1 on test:    0.8684 (micro)
f1 on KB:      0.4113
integrated f1: 0.4346, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 14000, Total loss: -158889820160.0000, CE loss: 26.6278, RL loss: -1588898176.0000, Reward: -2991223.3906
    full cols: 490, non-full cols: 79
   r - labels: 349, labels - r: 137
    violated: 140980, weighted: 10030.115234375, len: 0.0, nonzero: 0.10453419387340546
Epoch 14100, Total loss: 100558012416.0000, CE loss: 26.6261, RL loss: 1005580096.0000, Reward: -2972553.1211
    full cols: 503, non-full cols: 49
   r - labels: 332, labels - r: 137
    violated: 145553, weighted: 9893.587890625, len: 0.0, nonzero: 0.1040448471903801
Epoch 14200, Total loss: -50193408000.0000, CE loss: 26.6218, RL loss: -501934080.0000, Reward: -2982330.7344
    full cols: 503, non-full cols: 36
   r - labels: 320, labels - r: 138
    violated: 144295, weighted: 9789.4423828125, len: 0.0, nonzero: 0.10367938876152039
Epoch 14300, Total loss: 62340702208.0000, CE loss: 26.6254, RL loss: 623407040.0000, Reward: -2957054.8906
    full cols: 493, non-full cols: 46
   r - labels: 320, labels - r: 138
    violated: 143608, weighted: 9764.490234375, len: 0.0, nonzero: 0.10224232077598572
Epoch 14400, Total loss: -10293575680.0000, CE loss: 26.6250, RL loss: -102935752.0000, Reward: -2981447.6992
    full cols: 500, non-full cols: 44
   r - labels: 328, labels - r: 141
    violated: 133536, weighted: 10093.91796875, len: 0.0, nonzero: 0.10292678326368332
Epoch 14500, Total loss: 67362918400.0000, CE loss: 26.6226, RL loss: 673629184.0000, Reward: -2964037.5391
    full cols: 507, non-full cols: 40
   r - labels: 330, labels - r: 140
    violated: 143946, weighted: 10169.099609375, len: 0.0, nonzero: 0.10415634512901306
Epoch 14600, Total loss: 27439239168.0000, CE loss: 26.6258, RL loss: 274392384.0000, Reward: -2992432.3867
    full cols: 506, non-full cols: 49
   r - labels: 336, labels - r: 138
    violated: 144851, weighted: 10180.716796875, len: 0.0, nonzero: 0.10476338118314743
Epoch 14700, Total loss: 17390082048.0000, CE loss: 26.6257, RL loss: 173900816.0000, Reward: -2966855.3789
    full cols: 507, non-full cols: 38
   r - labels: 331, labels - r: 143
    violated: 138447, weighted: 10110.111328125, len: 0.0, nonzero: 0.10359886288642883
Epoch 14800, Total loss: 13046051840.0000, CE loss: 26.6183, RL loss: 130460520.0000, Reward: -2981047.0391
    full cols: 509, non-full cols: 44
   r - labels: 334, labels - r: 138
    violated: 132528, weighted: 10061.953125, len: 0.0, nonzero: 0.10517530143260956
Epoch 14900, Total loss: 107269251072.0000, CE loss: 26.6300, RL loss: 1072692480.0000, Reward: -2959082.0000
    full cols: 501, non-full cols: 55
   r - labels: 336, labels - r: 137
    violated: 140865, weighted: 10091.490234375, len: 0.0, nonzero: 0.10588763654232025
Epoch 15000, Total loss: -48917925888.0000, CE loss: 26.6253, RL loss: -489179264.0000, Reward: -2975134.7188
    full cols: 503, non-full cols: 50
   r - labels: 334, labels - r: 138
    violated: 144719, weighted: 10022.900390625, len: 0.0, nonzero: 0.10406342893838882
------ ABL Loop 0 ------
--- eval ---
prediction result:
f1 on test:    0.5372
f1 on test:    0.8932 (micro)
f1 on KB:      0.3449
f1 on orig KB: 0.3449
integrated f1: 0.3831, w_data: 0.3230, w_klg: 0.6770

integrated result:
f1 on test:    0.5090
f1 on test:    0.8681 (micro)
f1 on KB:      0.4109
f1 on orig KB: 0.4109
integrated f1: 0.4362, w_data: 0.3230, w_klg: 0.6770
------------
integrated f1 0.3831

KB before refine:
num_nodes: 5045.0000
num_edges: 113056.0000
density: 0.0044
avg_degree: 22.4095
avg_clustering: 0.2501
degree_assortativity: 0.2171
modularity: 0.4990
avg_betweenness: 0.0002
avg_closeness: 0.0944
Iteration 0: Loss = 7442907.000000
|Xk-Y|_F:  7442907.000000, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 6858865, f1 =  0.370558, approx slack: 1298376
rounded before pow |X_k-Y|_0 = 6775783, f1 =  0.301287

Iteration 20: Loss = 8713644.000000
|Xk-Y|_F:  8420849.000000, |X-X0|:  292794.750000
rounded |X_k-Y|_0 = 7310100, f1 =  0.288569, approx slack: 1115063
rounded before pow |X_k-Y|_0 = 6775783, f1 =  0.301287

Iteration 40: Loss = 8608726.000000
|Xk-Y|_F:  8342604.500000, |X-X0|:  266121.593750
rounded |X_k-Y|_0 = 7260812, f1 =  0.290107, approx slack: 218760
rounded before pow |X_k-Y|_0 = 7351276, f1 =  0.287181

Iteration 60: Loss = 8528387.000000
|Xk-Y|_F:  8288873.000000, |X-X0|:  239514.421875
rounded |X_k-Y|_0 = 7226355, f1 =  0.291175, approx slack: 243546
rounded before pow |X_k-Y|_0 = 7331612, f1 =  0.287785

Iteration 80: Loss = 8467252.000000
|Xk-Y|_F:  8245945.500000, |X-X0|:  221306.000000
rounded |X_k-Y|_0 = 7205909, f1 =  0.291815, approx slack: 313325
rounded before pow |X_k-Y|_0 = 7369229, f1 =  0.286570

Iteration 100: Loss = 8410556.000000
|Xk-Y|_F:  8203396.500000, |X-X0|:  207159.734375
rounded |X_k-Y|_0 = 7187102, f1 =  0.292392, approx slack: 317861
rounded before pow |X_k-Y|_0 = 7353002, f1 =  0.287079

Iteration 120: Loss = 8354742.500000
|Xk-Y|_F:  8158815.500000, |X-X0|:  195927.125000
rounded |X_k-Y|_0 = 7155672, f1 =  0.293359, approx slack: 351419
rounded before pow |X_k-Y|_0 = 7336577, f1 =  0.287578

Iteration 140: Loss = 8301142.500000
|Xk-Y|_F:  8114568.500000, |X-X0|:  186573.890625
rounded |X_k-Y|_0 = 7137579, f1 =  0.293896, approx slack: 373999
rounded before pow |X_k-Y|_0 = 7323528, f1 =  0.287994

Iteration 160: Loss = 8251117.500000
|Xk-Y|_F:  8072311.500000, |X-X0|:  178805.968750
rounded |X_k-Y|_0 = 7125226, f1 =  0.294262, approx slack: 384116
rounded before pow |X_k-Y|_0 = 7310706, f1 =  0.288398

Iteration 180: Loss = 8192546.000000
|Xk-Y|_F:  8020316.500000, |X-X0|:  172229.687500
rounded |X_k-Y|_0 = 7110442, f1 =  0.294685, approx slack: 398424
rounded before pow |X_k-Y|_0 = 7287312, f1 =  0.289114

Iteration 200: Loss = 8130210.000000
|Xk-Y|_F:  7963688.000000, |X-X0|:  166522.062500
rounded |X_k-Y|_0 = 7086314, f1 =  0.295416, approx slack: 410069
rounded before pow |X_k-Y|_0 = 7280876, f1 =  0.289281

Iteration 220: Loss = 8071656.500000
|Xk-Y|_F:  7910199.000000, |X-X0|:  161457.671875
rounded |X_k-Y|_0 = 7068429, f1 =  0.295947, approx slack: 423071
rounded before pow |X_k-Y|_0 = 7272845, f1 =  0.289489

Iteration 240: Loss = 8032518.500000
|Xk-Y|_F:  7875583.000000, |X-X0|:  156935.437500
rounded |X_k-Y|_0 = 7048346, f1 =  0.296570, approx slack: 435594
rounded before pow |X_k-Y|_0 = 7268844, f1 =  0.289614

Iteration 260: Loss = 7995320.000000
|Xk-Y|_F:  7842424.000000, |X-X0|:  152896.109375
rounded |X_k-Y|_0 = 7030440, f1 =  0.297135, approx slack: 454303
rounded before pow |X_k-Y|_0 = 7254890, f1 =  0.290026

Iteration 280: Loss = 7951141.000000
|Xk-Y|_F:  7802008.000000, |X-X0|:  149133.062500
rounded |X_k-Y|_0 = 7007193, f1 =  0.297852, approx slack: 458058
rounded before pow |X_k-Y|_0 = 7244084, f1 =  0.290301

Iteration 300: Loss = 7912997.000000
|Xk-Y|_F:  7767399.000000, |X-X0|:  145598.234375
rounded |X_k-Y|_0 = 6982806, f1 =  0.298603, approx slack: 475692
rounded before pow |X_k-Y|_0 = 7236467, f1 =  0.290534

Iteration 320: Loss = 7871289.000000
|Xk-Y|_F:  7729062.500000, |X-X0|:  142226.468750
rounded |X_k-Y|_0 = 6955226, f1 =  0.299431, approx slack: 500865
rounded before pow |X_k-Y|_0 = 7231944, f1 =  0.290677

Iteration 340: Loss = 7818993.000000
|Xk-Y|_F:  7679972.500000, |X-X0|:  139020.265625
rounded |X_k-Y|_0 = 6919455, f1 =  0.300503, approx slack: 528932
rounded before pow |X_k-Y|_0 = 7218970, f1 =  0.291084

Iteration 360: Loss = 7760397.500000
|Xk-Y|_F:  7624338.500000, |X-X0|:  136058.968750
rounded |X_k-Y|_0 = 6878793, f1 =  0.301703, approx slack: 573178
rounded before pow |X_k-Y|_0 = 7213972, f1 =  0.291239

Iteration 380: Loss = 7691251.000000
|Xk-Y|_F:  7557973.000000, |X-X0|:  133278.062500
rounded |X_k-Y|_0 = 6830653, f1 =  0.303108, approx slack: 625010
rounded before pow |X_k-Y|_0 = 7209228, f1 =  0.291389

Iteration 400: Loss = 7606194.000000
|Xk-Y|_F:  7475539.500000, |X-X0|:  130654.609375
rounded |X_k-Y|_0 = 6770525, f1 =  0.304858, approx slack: 694771
rounded before pow |X_k-Y|_0 = 7206729, f1 =  0.291473

Iteration 420: Loss = 7493170.000000
|Xk-Y|_F:  7365028.500000, |X-X0|:  128141.359375
rounded |X_k-Y|_0 = 6688548, f1 =  0.307238, approx slack: 787714
rounded before pow |X_k-Y|_0 = 7204812, f1 =  0.291535

Iteration 440: Loss = 7338535.500000
|Xk-Y|_F:  7212732.500000, |X-X0|:  125803.226562
rounded |X_k-Y|_0 = 6575501, f1 =  0.310524, approx slack: 908735
rounded before pow |X_k-Y|_0 = 7200794, f1 =  0.291669

Iteration 460: Loss = 7131979.000000
|Xk-Y|_F:  7008403.000000, |X-X0|:  123575.875000
rounded |X_k-Y|_0 = 6420321, f1 =  0.314973, approx slack: 1092409
rounded before pow |X_k-Y|_0 = 7195813, f1 =  0.291825

Iteration 480: Loss = 6808866.000000
|Xk-Y|_F:  6687280.000000, |X-X0|:  121585.906250
rounded |X_k-Y|_0 = 6167979, f1 =  0.322188, approx slack: 1389030
rounded before pow |X_k-Y|_0 = 7190996, f1 =  0.291962

Iteration 500: Loss = 6261759.500000
|Xk-Y|_F:  6141495.500000, |X-X0|:  120264.031250
rounded |X_k-Y|_0 = 5723665, f1 =  0.334764, approx slack: 1915825
rounded before pow |X_k-Y|_0 = 7175366, f1 =  0.292436

Iteration 520: Loss = 5188480.000000
|Xk-Y|_F:  5065890.000000, |X-X0|:  122589.992188
rounded |X_k-Y|_0 = 4808657, f1 =  0.361168, approx slack: 2959020
rounded before pow |X_k-Y|_0 = 7106675, f1 =  0.294577

Iteration 540: Loss = 3854061.750000
|Xk-Y|_F:  3720901.500000, |X-X0|:  133160.312500
rounded |X_k-Y|_0 = 3601906, f1 =  0.396414, approx slack: 4063396
rounded before pow |X_k-Y|_0 = 6777755, f1 =  0.305107

Iteration 560: Loss = 2795805.500000
|Xk-Y|_F:  2644099.000000, |X-X0|:  151706.625000
rounded |X_k-Y|_0 = 2653756, f1 =  0.424818, approx slack: 5132347
rounded before pow |X_k-Y|_0 = 6617630, f1 =  0.310353

Iteration 580: Loss = 1940869.375000
|Xk-Y|_F:  1760966.625000, |X-X0|:  179902.718750
rounded |X_k-Y|_0 = 1761268, f1 =  0.495972, approx slack: 5754527
rounded before pow |X_k-Y|_0 = 6650935, f1 =  0.309376

Iteration 600: Loss = 1432552.500000
|Xk-Y|_F:  1245289.750000, |X-X0|:  187262.750000
rounded |X_k-Y|_0 = 1215187, f1 =  0.549159, approx slack: 6032315
rounded before pow |X_k-Y|_0 = 6565916, f1 =  0.312085

Iteration 620: Loss = 1148044.000000
|Xk-Y|_F:  966490.812500, |X-X0|:  181553.156250
rounded |X_k-Y|_0 = 936474, f1 =  0.581212, approx slack: 6217432
rounded before pow |X_k-Y|_0 = 6568324, f1 =  0.311999

Iteration 640: Loss = 979497.125000
|Xk-Y|_F:  804752.750000, |X-X0|:  174744.390625
rounded |X_k-Y|_0 = 774823, f1 =  0.601880, approx slack: 6329629
rounded before pow |X_k-Y|_0 = 6605973, f1 =  0.310723

Iteration 660: Loss = 865296.750000
|Xk-Y|_F:  696093.437500, |X-X0|:  169203.312500
rounded |X_k-Y|_0 = 657552, f1 =  0.618337, approx slack: 6505785
rounded before pow |X_k-Y|_0 = 6708807, f1 =  0.307434

Iteration 680: Loss = 792565.437500
|Xk-Y|_F:  628174.500000, |X-X0|:  164390.953125
rounded |X_k-Y|_0 = 591047, f1 =  0.628163, approx slack: 6674616
rounded before pow |X_k-Y|_0 = 6818580, f1 =  0.303913

Iteration 700: Loss = 740956.750000
|Xk-Y|_F:  579756.187500, |X-X0|:  161200.531250
rounded |X_k-Y|_0 = 546036, f1 =  0.635086, approx slack: 6760486
rounded before pow |X_k-Y|_0 = 6864854, f1 =  0.302419

Iteration 720: Loss = 706303.000000
|Xk-Y|_F:  549498.812500, |X-X0|:  156804.203125
rounded |X_k-Y|_0 = 521074, f1 =  0.639041, approx slack: 6806888
rounded before pow |X_k-Y|_0 = 6891110, f1 =  0.301563

Iteration 740: Loss = 686608.562500
|Xk-Y|_F:  534061.062500, |X-X0|:  152547.515625
rounded |X_k-Y|_0 = 508124, f1 =  0.641153, approx slack: 6846118
rounded before pow |X_k-Y|_0 = 6917241, f1 =  0.300725

Iteration 760: Loss = 672756.812500
|Xk-Y|_F:  523637.125000, |X-X0|:  149119.703125
rounded |X_k-Y|_0 = 500946, f1 =  0.642348, approx slack: 6869563
rounded before pow |X_k-Y|_0 = 6934725, f1 =  0.300157

Iteration 780: Loss = 660798.000000
|Xk-Y|_F:  514604.812500, |X-X0|:  146193.156250
rounded |X_k-Y|_0 = 493237, f1 =  0.643591, approx slack: 6893572
rounded before pow |X_k-Y|_0 = 6953487, f1 =  0.299556

Iteration 800: Loss = 652226.750000
|Xk-Y|_F:  508590.625000, |X-X0|:  143636.125000
rounded |X_k-Y|_0 = 488172, f1 =  0.644439, approx slack: 6930846
rounded before pow |X_k-Y|_0 = 6981735, f1 =  0.298668

Iteration 820: Loss = 645280.375000
|Xk-Y|_F:  503946.187500, |X-X0|:  141334.156250
rounded |X_k-Y|_0 = 483407, f1 =  0.645216, approx slack: 6942750
rounded before pow |X_k-Y|_0 = 6994100, f1 =  0.298243

Iteration 840: Loss = 639332.500000
|Xk-Y|_F:  500144.281250, |X-X0|:  139188.218750
rounded |X_k-Y|_0 = 480066, f1 =  0.645767, approx slack: 6967046
rounded before pow |X_k-Y|_0 = 7009943, f1 =  0.297741

Iteration 860: Loss = 634246.875000
|Xk-Y|_F:  496992.656250, |X-X0|:  137254.218750
rounded |X_k-Y|_0 = 476684, f1 =  0.646321, approx slack: 6979800
rounded before pow |X_k-Y|_0 = 7023281, f1 =  0.297308

Iteration 880: Loss = 629731.687500
|Xk-Y|_F:  494282.468750, |X-X0|:  135449.218750
rounded |X_k-Y|_0 = 473978, f1 =  0.646767, approx slack: 6975416
rounded before pow |X_k-Y|_0 = 7021905, f1 =  0.297339

Iteration 900: Loss = 625665.375000
|Xk-Y|_F:  491881.781250, |X-X0|:  133783.625000
rounded |X_k-Y|_0 = 471832, f1 =  0.647136, approx slack: 6971044
rounded before pow |X_k-Y|_0 = 7029882, f1 =  0.297075

Iteration 920: Loss = 622010.125000
|Xk-Y|_F:  489795.812500, |X-X0|:  132214.281250
rounded |X_k-Y|_0 = 469850, f1 =  0.647489, approx slack: 6975384
rounded before pow |X_k-Y|_0 = 7037749, f1 =  0.296816

Iteration 940: Loss = 618756.625000
|Xk-Y|_F:  488059.156250, |X-X0|:  130697.468750
rounded |X_k-Y|_0 = 468040, f1 =  0.647806, approx slack: 6988706
rounded before pow |X_k-Y|_0 = 7053306, f1 =  0.296323

Iteration 960: Loss = 615663.000000
|Xk-Y|_F:  486392.156250, |X-X0|:  129270.812500
rounded |X_k-Y|_0 = 467022, f1 =  0.647985, approx slack: 6988456
rounded before pow |X_k-Y|_0 = 7057214, f1 =  0.296183

Iteration 980: Loss = 612767.000000
|Xk-Y|_F:  484794.062500, |X-X0|:  127972.937500
rounded |X_k-Y|_0 = 465960, f1 =  0.648177, approx slack: 6989136
rounded before pow |X_k-Y|_0 = 7061187, f1 =  0.296041

Iteration 1000: Loss = 610144.187500
|Xk-Y|_F:  483473.218750, |X-X0|:  126670.945312
rounded |X_k-Y|_0 = 464795, f1 =  0.648379, approx slack: 6995625
rounded before pow |X_k-Y|_0 = 7066648, f1 =  0.295869

Iteration 1020: Loss = 607801.437500
|Xk-Y|_F:  482355.000000, |X-X0|:  125446.460938
rounded |X_k-Y|_0 = 464083, f1 =  0.648512, approx slack: 6990986
rounded before pow |X_k-Y|_0 = 7060506, f1 =  0.296067

Iteration 1040: Loss = 605601.250000
|Xk-Y|_F:  481331.500000, |X-X0|:  124269.781250
rounded |X_k-Y|_0 = 463356, f1 =  0.648644, approx slack: 7003406
rounded before pow |X_k-Y|_0 = 7074268, f1 =  0.295626

Iteration 1060: Loss = 603447.312500
|Xk-Y|_F:  480298.062500, |X-X0|:  123149.226562
rounded |X_k-Y|_0 = 462646, f1 =  0.648772, approx slack: 7001119
rounded before pow |X_k-Y|_0 = 7072165, f1 =  0.295692

Iteration 1080: Loss = 601499.750000
|Xk-Y|_F:  479453.562500, |X-X0|:  122046.210938
rounded |X_k-Y|_0 = 462049, f1 =  0.648880, approx slack: 6987916
rounded before pow |X_k-Y|_0 = 7063214, f1 =  0.295966

Iteration 1100: Loss = 599691.312500
|Xk-Y|_F:  478695.000000, |X-X0|:  120996.304688
rounded |X_k-Y|_0 = 461619, f1 =  0.648960, approx slack: 6986409
rounded before pow |X_k-Y|_0 = 7064085, f1 =  0.295935

Iteration 1120: Loss = 597941.312500
|Xk-Y|_F:  477991.031250, |X-X0|:  119950.281250
rounded |X_k-Y|_0 = 461286, f1 =  0.649025, approx slack: 6980617
rounded before pow |X_k-Y|_0 = 7058165, f1 =  0.296126

Iteration 1140: Loss = 596204.000000
|Xk-Y|_F:  477253.187500, |X-X0|:  118950.843750
rounded |X_k-Y|_0 = 460856, f1 =  0.649104, approx slack: 6986073
rounded before pow |X_k-Y|_0 = 7062907, f1 =  0.295974

Iteration 1160: Loss = 594474.562500
|Xk-Y|_F:  476488.125000, |X-X0|:  117986.453125
rounded |X_k-Y|_0 = 460323, f1 =  0.649202, approx slack: 6981740
rounded before pow |X_k-Y|_0 = 7058853, f1 =  0.296099

Iteration 1180: Loss = 592900.125000
|Xk-Y|_F:  475858.875000, |X-X0|:  117041.250000
rounded |X_k-Y|_0 = 459840, f1 =  0.649292, approx slack: 6981633
rounded before pow |X_k-Y|_0 = 7058499, f1 =  0.296110

Iteration 1200: Loss = 591430.750000
|Xk-Y|_F:  475319.031250, |X-X0|:  116111.718750
rounded |X_k-Y|_0 = 459432, f1 =  0.649363, approx slack: 6984167
rounded before pow |X_k-Y|_0 = 7060508, f1 =  0.296047

Iteration 1220: Loss = 589989.312500
|Xk-Y|_F:  474795.781250, |X-X0|:  115193.531250
rounded |X_k-Y|_0 = 459244, f1 =  0.649404, approx slack: 6985341
rounded before pow |X_k-Y|_0 = 7059710, f1 =  0.296076

Iteration 1240: Loss = 588590.250000
|Xk-Y|_F:  474287.937500, |X-X0|:  114302.328125
rounded |X_k-Y|_0 = 458873, f1 =  0.649472, approx slack: 6991009
rounded before pow |X_k-Y|_0 = 7065614, f1 =  0.295881

Iteration 1260: Loss = 587233.250000
|Xk-Y|_F:  473811.812500, |X-X0|:  113421.429688
rounded |X_k-Y|_0 = 458591, f1 =  0.649534, approx slack: 6989171
rounded before pow |X_k-Y|_0 = 7064055, f1 =  0.295930

Iteration 1280: Loss = 585908.187500
|Xk-Y|_F:  473353.750000, |X-X0|:  112554.437500
rounded |X_k-Y|_0 = 458044, f1 =  0.649634, approx slack: 6986933
rounded before pow |X_k-Y|_0 = 7061846, f1 =  0.296001

Iteration 1300: Loss = 584603.875000
|Xk-Y|_F:  472911.500000, |X-X0|:  111692.406250
rounded |X_k-Y|_0 = 457778, f1 =  0.649700, approx slack: 6978863
rounded before pow |X_k-Y|_0 = 7054137, f1 =  0.296249

Iteration 1320: Loss = 583316.312500
|Xk-Y|_F:  472470.468750, |X-X0|:  110845.828125
rounded |X_k-Y|_0 = 457447, f1 =  0.649775, approx slack: 6981061
rounded before pow |X_k-Y|_0 = 7056120, f1 =  0.296185

Iteration 1340: Loss = 582030.187500
|Xk-Y|_F:  472028.968750, |X-X0|:  110001.234375
rounded |X_k-Y|_0 = 457076, f1 =  0.649848, approx slack: 6984597
rounded before pow |X_k-Y|_0 = 7059808, f1 =  0.296065

Iteration 1360: Loss = 580783.062500
|Xk-Y|_F:  471600.062500, |X-X0|:  109183.007812
rounded |X_k-Y|_0 = 456756, f1 =  0.649914, approx slack: 6979652
rounded before pow |X_k-Y|_0 = 7057989, f1 =  0.296122

Iteration 1380: Loss = 579542.875000
|Xk-Y|_F:  471175.906250, |X-X0|:  108366.984375
rounded |X_k-Y|_0 = 456272, f1 =  0.650008, approx slack: 6978499
rounded before pow |X_k-Y|_0 = 7056910, f1 =  0.296154

Iteration 1400: Loss = 578311.062500
|Xk-Y|_F:  470751.343750, |X-X0|:  107559.695312
rounded |X_k-Y|_0 = 455923, f1 =  0.650075, approx slack: 6977977
rounded before pow |X_k-Y|_0 = 7054329, f1 =  0.296242

Iteration 1420: Loss = 577066.937500
|Xk-Y|_F:  470306.625000, |X-X0|:  106760.304688
rounded |X_k-Y|_0 = 455525, f1 =  0.650154, approx slack: 6968441
rounded before pow |X_k-Y|_0 = 7049141, f1 =  0.296391

Iteration 1440: Loss = 575859.062500
|Xk-Y|_F:  469877.781250, |X-X0|:  105981.257812
rounded |X_k-Y|_0 = 455086, f1 =  0.650240, approx slack: 6939299
rounded before pow |X_k-Y|_0 = 7022706, f1 =  0.297235

Iteration 1460: Loss = 574666.062500
|Xk-Y|_F:  469447.781250, |X-X0|:  105218.265625
rounded |X_k-Y|_0 = 454536, f1 =  0.650342, approx slack: 6942117
rounded before pow |X_k-Y|_0 = 7025698, f1 =  0.297138

Iteration 1480: Loss = 573487.875000
|Xk-Y|_F:  469031.437500, |X-X0|:  104456.414062
rounded |X_k-Y|_0 = 454169, f1 =  0.650409, approx slack: 6939035
rounded before pow |X_k-Y|_0 = 7023310, f1 =  0.297210

Iteration 1500: Loss = 572358.437500
|Xk-Y|_F:  468645.031250, |X-X0|:  103713.398438
rounded |X_k-Y|_0 = 453872, f1 =  0.650470, approx slack: 6938537
rounded before pow |X_k-Y|_0 = 7024441, f1 =  0.297169

Iteration 1520: Loss = 571233.062500
|Xk-Y|_F:  468275.906250, |X-X0|:  102957.140625
rounded |X_k-Y|_0 = 453615, f1 =  0.650519, approx slack: 6894560
rounded before pow |X_k-Y|_0 = 6992417, f1 =  0.298190

Iteration 1540: Loss = 570138.375000
|Xk-Y|_F:  467918.031250, |X-X0|:  102220.343750
rounded |X_k-Y|_0 = 453333, f1 =  0.650576, approx slack: 6898170
rounded before pow |X_k-Y|_0 = 6995202, f1 =  0.298110

Iteration 1560: Loss = 569076.062500
|Xk-Y|_F:  467574.156250, |X-X0|:  101501.921875
rounded |X_k-Y|_0 = 453086, f1 =  0.650625, approx slack: 6896343
rounded before pow |X_k-Y|_0 = 6993747, f1 =  0.298153

Iteration 1580: Loss = 568036.375000
|Xk-Y|_F:  467239.500000, |X-X0|:  100796.890625
rounded |X_k-Y|_0 = 452864, f1 =  0.650669, approx slack: 6888737
rounded before pow |X_k-Y|_0 = 6990768, f1 =  0.298244

Iteration 1600: Loss = 567030.437500
|Xk-Y|_F:  466920.156250, |X-X0|:  100110.265625
rounded |X_k-Y|_0 = 452663, f1 =  0.650708, approx slack: 6883914
rounded before pow |X_k-Y|_0 = 6990307, f1 =  0.298259

Iteration 1620: Loss = 566047.500000
|Xk-Y|_F:  466614.812500, |X-X0|:  99432.656250
rounded |X_k-Y|_0 = 452404, f1 =  0.650758, approx slack: 6874448
rounded before pow |X_k-Y|_0 = 6981402, f1 =  0.298539

Iteration 1640: Loss = 565083.875000
|Xk-Y|_F:  466320.687500, |X-X0|:  98763.171875
rounded |X_k-Y|_0 = 452255, f1 =  0.650788, approx slack: 6876373
rounded before pow |X_k-Y|_0 = 6983519, f1 =  0.298471

Iteration 1660: Loss = 564136.875000
|Xk-Y|_F:  466035.468750, |X-X0|:  98101.375000
rounded |X_k-Y|_0 = 452103, f1 =  0.650821, approx slack: 6879700
rounded before pow |X_k-Y|_0 = 6986992, f1 =  0.298359

Iteration 1680: Loss = 563201.625000
|Xk-Y|_F:  465763.437500, |X-X0|:  97438.203125
rounded |X_k-Y|_0 = 451868, f1 =  0.650863, approx slack: 6879823
rounded before pow |X_k-Y|_0 = 6987334, f1 =  0.298348

Iteration 1700: Loss = 562264.000000
|Xk-Y|_F:  465495.218750, |X-X0|:  96768.804688
rounded |X_k-Y|_0 = 451822, f1 =  0.650876, approx slack: 6887755
rounded before pow |X_k-Y|_0 = 6995233, f1 =  0.298095

Iteration 1720: Loss = 561369.375000
|Xk-Y|_F:  465248.718750, |X-X0|:  96120.625000
rounded |X_k-Y|_0 = 451702, f1 =  0.650898, approx slack: 6887819
rounded before pow |X_k-Y|_0 = 6995602, f1 =  0.298083

Iteration 1740: Loss = 560493.500000
|Xk-Y|_F:  465029.937500, |X-X0|:  95463.562500
rounded |X_k-Y|_0 = 451633, f1 =  0.650914, approx slack: 6890397
rounded before pow |X_k-Y|_0 = 6998196, f1 =  0.298000

Iteration 1760: Loss = 559628.625000
|Xk-Y|_F:  464813.343750, |X-X0|:  94815.273438
rounded |X_k-Y|_0 = 451535, f1 =  0.650934, approx slack: 6894318
rounded before pow |X_k-Y|_0 = 7002098, f1 =  0.297879

Iteration 1780: Loss = 558791.437500
|Xk-Y|_F:  464613.312500, |X-X0|:  94178.125000
rounded |X_k-Y|_0 = 451436, f1 =  0.650960, approx slack: 6901257
rounded before pow |X_k-Y|_0 = 7006328, f1 =  0.297794

Iteration 1800: Loss = 557960.625000
|Xk-Y|_F:  464424.781250, |X-X0|:  93535.867188
rounded |X_k-Y|_0 = 451411, f1 =  0.650968, approx slack: 6899150
rounded before pow |X_k-Y|_0 = 7005074, f1 =  0.297833

Iteration 1820: Loss = 557147.000000
|Xk-Y|_F:  464252.937500, |X-X0|:  92894.062500
rounded |X_k-Y|_0 = 451389, f1 =  0.650974, approx slack: 6896505
rounded before pow |X_k-Y|_0 = 7006130, f1 =  0.297799

Iteration 1840: Loss = 556352.687500
|Xk-Y|_F:  464095.062500, |X-X0|:  92257.609375
rounded |X_k-Y|_0 = 451362, f1 =  0.650982, approx slack: 6895911
rounded before pow |X_k-Y|_0 = 7006340, f1 =  0.297792

Iteration 1860: Loss = 555576.500000
|Xk-Y|_F:  463950.625000, |X-X0|:  91625.851562
rounded |X_k-Y|_0 = 451289, f1 =  0.650995, approx slack: 6894186
rounded before pow |X_k-Y|_0 = 7005123, f1 =  0.297832

Iteration 1880: Loss = 554800.312500
|Xk-Y|_F:  463815.625000, |X-X0|:  90984.703125
rounded |X_k-Y|_0 = 451286, f1 =  0.651000, approx slack: 6896560
rounded before pow |X_k-Y|_0 = 7007670, f1 =  0.297750

Iteration 1900: Loss = 554011.312500
|Xk-Y|_F:  463683.937500, |X-X0|:  90327.398438
rounded |X_k-Y|_0 = 451266, f1 =  0.651007, approx slack: 6893340
rounded before pow |X_k-Y|_0 = 7004909, f1 =  0.297838

Iteration 1920: Loss = 553236.875000
|Xk-Y|_F:  463556.531250, |X-X0|:  89680.359375
rounded |X_k-Y|_0 = 451214, f1 =  0.651019, approx slack: 6893191
rounded before pow |X_k-Y|_0 = 7005556, f1 =  0.297812

Iteration 1940: Loss = 552471.562500
|Xk-Y|_F:  463433.687500, |X-X0|:  89037.867188
rounded |X_k-Y|_0 = 451211, f1 =  0.651023, approx slack: 6893718
rounded before pow |X_k-Y|_0 = 7006146, f1 =  0.297793

Iteration 1960: Loss = 551717.875000
|Xk-Y|_F:  463317.843750, |X-X0|:  88400.039062
rounded |X_k-Y|_0 = 451118, f1 =  0.651041, approx slack: 6897146
rounded before pow |X_k-Y|_0 = 7009246, f1 =  0.297699

Iteration 1980: Loss = 550969.187500
|Xk-Y|_F:  463204.781250, |X-X0|:  87764.390625
rounded |X_k-Y|_0 = 450963, f1 =  0.651069, approx slack: 6898351
rounded before pow |X_k-Y|_0 = 7010445, f1 =  0.297657

Iteration 2000: Loss = 550235.375000
|Xk-Y|_F:  463093.781250, |X-X0|:  87141.562500
rounded |X_k-Y|_0 = 450920, f1 =  0.651079, approx slack: 6904004
rounded before pow |X_k-Y|_0 = 7013856, f1 =  0.297553

Iteration 2020: Loss = 549495.375000
|Xk-Y|_F:  462978.343750, |X-X0|:  86517.031250
rounded |X_k-Y|_0 = 450910, f1 =  0.651084, approx slack: 6903709
rounded before pow |X_k-Y|_0 = 7014095, f1 =  0.297549

Iteration 2040: Loss = 548738.875000
|Xk-Y|_F:  462846.781250, |X-X0|:  85892.109375
rounded |X_k-Y|_0 = 450790, f1 =  0.651106, approx slack: 6904115
rounded before pow |X_k-Y|_0 = 7014555, f1 =  0.297535

Iteration 2060: Loss = 548012.562500
|Xk-Y|_F:  462718.562500, |X-X0|:  85293.984375
rounded |X_k-Y|_0 = 450643, f1 =  0.651134, approx slack: 6904956
rounded before pow |X_k-Y|_0 = 7015365, f1 =  0.297510

Iteration 2080: Loss = 547275.375000
|Xk-Y|_F:  462587.031250, |X-X0|:  84688.343750
rounded |X_k-Y|_0 = 450561, f1 =  0.651151, approx slack: 6906720
rounded before pow |X_k-Y|_0 = 7015927, f1 =  0.297508

Iteration 2100: Loss = 546566.750000
|Xk-Y|_F:  462426.312500, |X-X0|:  84140.445312
rounded |X_k-Y|_0 = 450450, f1 =  0.651172, approx slack: 6905573
rounded before pow |X_k-Y|_0 = 7015131, f1 =  0.297533

Iteration 2120: Loss = 545841.562500
|Xk-Y|_F:  462262.468750, |X-X0|:  83579.093750
rounded |X_k-Y|_0 = 450306, f1 =  0.651197, approx slack: 6903035
rounded before pow |X_k-Y|_0 = 7012796, f1 =  0.297607

Iteration 2140: Loss = 545145.687500
|Xk-Y|_F:  462094.843750, |X-X0|:  83050.843750
rounded |X_k-Y|_0 = 450160, f1 =  0.651221, approx slack: 6901742
rounded before pow |X_k-Y|_0 = 7011619, f1 =  0.297645

Iteration 2160: Loss = 544453.687500
|Xk-Y|_F:  461922.906250, |X-X0|:  82530.765625
rounded |X_k-Y|_0 = 450009, f1 =  0.651247, approx slack: 6907453
rounded before pow |X_k-Y|_0 = 7016022, f1 =  0.297518

Iteration 2180: Loss = 543773.562500
|Xk-Y|_F:  461738.250000, |X-X0|:  82035.320312
rounded |X_k-Y|_0 = 449843, f1 =  0.651275, approx slack: 6908357
rounded before pow |X_k-Y|_0 = 7017168, f1 =  0.297481

Iteration 2200: Loss = 543102.437500
|Xk-Y|_F:  461551.812500, |X-X0|:  81550.609375
rounded |X_k-Y|_0 = 449634, f1 =  0.651310, approx slack: 6907762
rounded before pow |X_k-Y|_0 = 7016437, f1 =  0.297505

Iteration 2220: Loss = 542454.062500
|Xk-Y|_F:  461360.406250, |X-X0|:  81093.656250
rounded |X_k-Y|_0 = 449464, f1 =  0.651340, approx slack: 6910422
rounded before pow |X_k-Y|_0 = 7018613, f1 =  0.297440

Iteration 2240: Loss = 541804.875000
|Xk-Y|_F:  461159.531250, |X-X0|:  80645.359375
rounded |X_k-Y|_0 = 449242, f1 =  0.651378, approx slack: 6912378
rounded before pow |X_k-Y|_0 = 7020452, f1 =  0.297382

Iteration 2260: Loss = 541163.500000
|Xk-Y|_F:  460957.531250, |X-X0|:  80205.968750
rounded |X_k-Y|_0 = 449039, f1 =  0.651413, approx slack: 6916270
rounded before pow |X_k-Y|_0 = 7024835, f1 =  0.297240

Iteration 2280: Loss = 540528.312500
|Xk-Y|_F:  460754.593750, |X-X0|:  79773.734375
rounded |X_k-Y|_0 = 448864, f1 =  0.651444, approx slack: 6916815
rounded before pow |X_k-Y|_0 = 7025497, f1 =  0.297218

Iteration 2300: Loss = 539895.125000
|Xk-Y|_F:  460532.968750, |X-X0|:  79362.187500
rounded |X_k-Y|_0 = 448695, f1 =  0.651475, approx slack: 6910467
rounded before pow |X_k-Y|_0 = 7018964, f1 =  0.297434

Iteration 2320: Loss = 539226.625000
|Xk-Y|_F:  460265.843750, |X-X0|:  78960.750000
rounded |X_k-Y|_0 = 448456, f1 =  0.651520, approx slack: 6918086
rounded before pow |X_k-Y|_0 = 7025479, f1 =  0.297230

Iteration 2340: Loss = 538579.250000
|Xk-Y|_F:  460018.437500, |X-X0|:  78560.781250
rounded |X_k-Y|_0 = 448204, f1 =  0.651565, approx slack: 6917600
rounded before pow |X_k-Y|_0 = 7025068, f1 =  0.297243

Iteration 2360: Loss = 537969.250000
|Xk-Y|_F:  459813.281250, |X-X0|:  78155.945312
rounded |X_k-Y|_0 = 448043, f1 =  0.651593, approx slack: 6924581
rounded before pow |X_k-Y|_0 = 7031122, f1 =  0.297053

Iteration 2380: Loss = 537359.562500
|Xk-Y|_F:  459599.156250, |X-X0|:  77760.382812
rounded |X_k-Y|_0 = 447939, f1 =  0.651612, approx slack: 6946660
rounded before pow |X_k-Y|_0 = 7047932, f1 =  0.296562

Iteration 2400: Loss = 536757.625000
|Xk-Y|_F:  459387.906250, |X-X0|:  77369.718750
rounded |X_k-Y|_0 = 447766, f1 =  0.651644, approx slack: 6949676
rounded before pow |X_k-Y|_0 = 7050796, f1 =  0.296475

Iteration 2420: Loss = 536166.250000
|Xk-Y|_F:  459183.906250, |X-X0|:  76982.320312
rounded |X_k-Y|_0 = 447596, f1 =  0.651673, approx slack: 6956190
rounded before pow |X_k-Y|_0 = 7056679, f1 =  0.296301

Iteration 2440: Loss = 535610.562500
|Xk-Y|_F:  458992.031250, |X-X0|:  76618.531250
rounded |X_k-Y|_0 = 447494, f1 =  0.651692, approx slack: 6963271
rounded before pow |X_k-Y|_0 = 7062198, f1 =  0.296139

Iteration 2460: Loss = 535049.500000
|Xk-Y|_F:  458798.937500, |X-X0|:  76250.562500
rounded |X_k-Y|_0 = 447378, f1 =  0.651711, approx slack: 6966636
rounded before pow |X_k-Y|_0 = 7063420, f1 =  0.296124

Iteration 2480: Loss = 534480.187500
|Xk-Y|_F:  458607.281250, |X-X0|:  75872.914062
rounded |X_k-Y|_0 = 447228, f1 =  0.651738, approx slack: 6974963
rounded before pow |X_k-Y|_0 = 7069247, f1 =  0.295962

Iteration 2500: Loss = 533924.937500
|Xk-Y|_F:  458413.718750, |X-X0|:  75511.218750
rounded |X_k-Y|_0 = 447110, f1 =  0.651760, approx slack: 6985817
rounded before pow |X_k-Y|_0 = 7076946, f1 =  0.295740

Iteration 2520: Loss = 533367.000000
|Xk-Y|_F:  458208.593750, |X-X0|:  75158.429688
rounded |X_k-Y|_0 = 446962, f1 =  0.651785, approx slack: 7006485
rounded before pow |X_k-Y|_0 = 7094123, f1 =  0.295226

Iteration 2540: Loss = 532810.625000
|Xk-Y|_F:  457998.656250, |X-X0|:  74811.984375
rounded |X_k-Y|_0 = 446779, f1 =  0.651817, approx slack: 7008717
rounded before pow |X_k-Y|_0 = 7095785, f1 =  0.295179

Iteration 2560: Loss = 532238.875000
|Xk-Y|_F:  457783.406250, |X-X0|:  74455.453125
rounded |X_k-Y|_0 = 446598, f1 =  0.651848, approx slack: 7009452
rounded before pow |X_k-Y|_0 = 7096520, f1 =  0.295155

Iteration 2580: Loss = 531660.625000
|Xk-Y|_F:  457554.468750, |X-X0|:  74106.140625
rounded |X_k-Y|_0 = 446287, f1 =  0.651897, approx slack: 6994255
rounded before pow |X_k-Y|_0 = 7082555, f1 =  0.295595

Iteration 2600: Loss = 531092.312500
|Xk-Y|_F:  457322.906250, |X-X0|:  73769.382812
rounded |X_k-Y|_0 = 445901, f1 =  0.651959, approx slack: 6995312
rounded before pow |X_k-Y|_0 = 7083561, f1 =  0.295567

Iteration 2620: Loss = 530518.562500
|Xk-Y|_F:  457082.937500, |X-X0|:  73435.601562
rounded |X_k-Y|_0 = 445576, f1 =  0.652014, approx slack: 6994749
rounded before pow |X_k-Y|_0 = 7083218, f1 =  0.295578

Iteration 2640: Loss = 529932.875000
|Xk-Y|_F:  456827.656250, |X-X0|:  73105.234375
rounded |X_k-Y|_0 = 445252, f1 =  0.652070, approx slack: 6994644
rounded before pow |X_k-Y|_0 = 7083472, f1 =  0.295569

Iteration 2660: Loss = 529310.500000
|Xk-Y|_F:  456538.343750, |X-X0|:  72772.140625
rounded |X_k-Y|_0 = 444981, f1 =  0.652117, approx slack: 6993063
rounded before pow |X_k-Y|_0 = 7082175, f1 =  0.295614

Iteration 2680: Loss = 528678.937500
|Xk-Y|_F:  456235.531250, |X-X0|:  72443.414062
rounded |X_k-Y|_0 = 444659, f1 =  0.652171, approx slack: 6989579
rounded before pow |X_k-Y|_0 = 7078813, f1 =  0.295722

Iteration 2700: Loss = 528077.125000
|Xk-Y|_F:  455956.875000, |X-X0|:  72120.242188
rounded |X_k-Y|_0 = 444324, f1 =  0.652225, approx slack: 6986398
rounded before pow |X_k-Y|_0 = 7075954, f1 =  0.295811

Iteration 2720: Loss = 527451.687500
|Xk-Y|_F:  455661.656250, |X-X0|:  71790.015625
rounded |X_k-Y|_0 = 443968, f1 =  0.652284, approx slack: 6973589
rounded before pow |X_k-Y|_0 = 7063827, f1 =  0.296196

Iteration 2740: Loss = 526894.187500
|Xk-Y|_F:  455419.031250, |X-X0|:  71475.140625
rounded |X_k-Y|_0 = 443693, f1 =  0.652331, approx slack: 6950221
rounded before pow |X_k-Y|_0 = 7042028, f1 =  0.296882

Iteration 2760: Loss = 526325.500000
|Xk-Y|_F:  455164.937500, |X-X0|:  71160.546875
rounded |X_k-Y|_0 = 443447, f1 =  0.652373, approx slack: 6946085
rounded before pow |X_k-Y|_0 = 7038440, f1 =  0.296997

Iteration 2780: Loss = 525756.875000
|Xk-Y|_F:  454910.968750, |X-X0|:  70845.890625
rounded |X_k-Y|_0 = 443208, f1 =  0.652416, approx slack: 6930638
rounded before pow |X_k-Y|_0 = 7023101, f1 =  0.297467

Iteration 2800: Loss = 525178.187500
|Xk-Y|_F:  454644.187500, |X-X0|:  70534.000000
rounded |X_k-Y|_0 = 443024, f1 =  0.652447, approx slack: 6865276
rounded before pow |X_k-Y|_0 = 6958674, f1 =  0.299442

Iteration 2820: Loss = 524590.937500
|Xk-Y|_F:  454366.843750, |X-X0|:  70224.078125
rounded |X_k-Y|_0 = 442835, f1 =  0.652476, approx slack: 6764698
rounded before pow |X_k-Y|_0 = 6857743, f1 =  0.302522

Iteration 2840: Loss = 524014.906250
|Xk-Y|_F:  454116.656250, |X-X0|:  69898.250000
rounded |X_k-Y|_0 = 442648, f1 =  0.652503, approx slack: 6749666
rounded before pow |X_k-Y|_0 = 6842662, f1 =  0.302982

Iteration 2860: Loss = 523453.812500
|Xk-Y|_F:  453865.781250, |X-X0|:  69588.046875
rounded |X_k-Y|_0 = 442508, f1 =  0.652525, approx slack: 6733730
rounded before pow |X_k-Y|_0 = 6826040, f1 =  0.303491

Iteration 2880: Loss = 522892.125000
|Xk-Y|_F:  453605.375000, |X-X0|:  69286.734375
rounded |X_k-Y|_0 = 442299, f1 =  0.652561, approx slack: 6686025
rounded before pow |X_k-Y|_0 = 6781323, f1 =  0.304913

Iteration 2900: Loss = 522367.812500
|Xk-Y|_F:  453369.781250, |X-X0|:  68998.031250
rounded |X_k-Y|_0 = 442088, f1 =  0.652596, approx slack: 6686157
rounded before pow |X_k-Y|_0 = 6781771, f1 =  0.304898

Iteration 2920: Loss = 521726.906250
|Xk-Y|_F:  453014.843750, |X-X0|:  68712.062500
rounded |X_k-Y|_0 = 441894, f1 =  0.652633, approx slack: 6683819
rounded before pow |X_k-Y|_0 = 6779646, f1 =  0.304962

Iteration 2940: Loss = 521125.406250
|Xk-Y|_F:  452713.218750, |X-X0|:  68412.179688
rounded |X_k-Y|_0 = 441656, f1 =  0.652679, approx slack: 6677681
rounded before pow |X_k-Y|_0 = 6774235, f1 =  0.305133

Iteration 2960: Loss = 520520.500000
|Xk-Y|_F:  452405.250000, |X-X0|:  68115.234375
rounded |X_k-Y|_0 = 441468, f1 =  0.652713, approx slack: 6671578
rounded before pow |X_k-Y|_0 = 6769261, f1 =  0.305291

Iteration 2980: Loss = 519841.343750
|Xk-Y|_F:  452017.718750, |X-X0|:  67823.625000
rounded |X_k-Y|_0 = 441223, f1 =  0.652754, approx slack: 6667926
rounded before pow |X_k-Y|_0 = 6765998, f1 =  0.305398

Iteration 3000: Loss = 519197.937500
|Xk-Y|_F:  451675.625000, |X-X0|:  67522.296875
rounded |X_k-Y|_0 = 440847, f1 =  0.652816, approx slack: 6632157
rounded before pow |X_k-Y|_0 = 6734338, f1 =  0.306399

Iteration 3020: Loss = 518648.656250
|Xk-Y|_F:  451416.500000, |X-X0|:  67232.164062
rounded |X_k-Y|_0 = 440532, f1 =  0.652870, approx slack: 6631319
rounded before pow |X_k-Y|_0 = 6733693, f1 =  0.306420

Iteration 3040: Loss = 518097.531250
|Xk-Y|_F:  451154.093750, |X-X0|:  66943.437500
rounded |X_k-Y|_0 = 440199, f1 =  0.652928, approx slack: 6630231
rounded before pow |X_k-Y|_0 = 6732834, f1 =  0.306447

Iteration 3060: Loss = 517553.625000
|Xk-Y|_F:  450891.687500, |X-X0|:  66661.921875
rounded |X_k-Y|_0 = 439569, f1 =  0.653034, approx slack: 6631383
rounded before pow |X_k-Y|_0 = 6734776, f1 =  0.306385

Iteration 3080: Loss = 517086.812500
|Xk-Y|_F:  450688.343750, |X-X0|:  66398.468750
rounded |X_k-Y|_0 = 439333, f1 =  0.653075, approx slack: 6633268
rounded before pow |X_k-Y|_0 = 6736569, f1 =  0.306328

Iteration 3100: Loss = 516528.031250
|Xk-Y|_F:  450429.812500, |X-X0|:  66098.218750
rounded |X_k-Y|_0 = 439127, f1 =  0.653114, approx slack: 6655621
rounded before pow |X_k-Y|_0 = 6760862, f1 =  0.305532

Iteration 3120: Loss = 516021.843750
|Xk-Y|_F:  450204.562500, |X-X0|:  65817.273438
rounded |X_k-Y|_0 = 438932, f1 =  0.653149, approx slack: 6661649
rounded before pow |X_k-Y|_0 = 6766681, f1 =  0.305346

Iteration 3140: Loss = 515461.437500
|Xk-Y|_F:  449951.250000, |X-X0|:  65510.183594
rounded |X_k-Y|_0 = 438729, f1 =  0.653188, approx slack: 6655336
rounded before pow |X_k-Y|_0 = 6760760, f1 =  0.305535

Iteration 3160: Loss = 514940.093750
|Xk-Y|_F:  449724.468750, |X-X0|:  65215.613281
rounded |X_k-Y|_0 = 438519, f1 =  0.653226, approx slack: 6660973
rounded before pow |X_k-Y|_0 = 6765490, f1 =  0.305384

Iteration 3180: Loss = 514399.250000
|Xk-Y|_F:  449483.562500, |X-X0|:  64915.703125
rounded |X_k-Y|_0 = 438348, f1 =  0.653259, approx slack: 6608363
rounded before pow |X_k-Y|_0 = 6717940, f1 =  0.306893

Iteration 3200: Loss = 513882.656250
|Xk-Y|_F:  449257.406250, |X-X0|:  64625.238281
rounded |X_k-Y|_0 = 438193, f1 =  0.653288, approx slack: 6608544
rounded before pow |X_k-Y|_0 = 6718090, f1 =  0.306892

Iteration 3220: Loss = 513388.906250
|Xk-Y|_F:  449038.875000, |X-X0|:  64350.039062
rounded |X_k-Y|_0 = 438018, f1 =  0.653319, approx slack: 6609823
rounded before pow |X_k-Y|_0 = 6719423, f1 =  0.306849

Iteration 3240: Loss = 512909.375000
|Xk-Y|_F:  448835.875000, |X-X0|:  64073.515625
rounded |X_k-Y|_0 = 437977, f1 =  0.653328, approx slack: 6608367
rounded before pow |X_k-Y|_0 = 6718478, f1 =  0.306878

Iteration 3260: Loss = 512355.343750
|Xk-Y|_F:  448566.937500, |X-X0|:  63788.417969
rounded |X_k-Y|_0 = 437892, f1 =  0.653347, approx slack: 6608929
rounded before pow |X_k-Y|_0 = 6719038, f1 =  0.306861

Iteration 3280: Loss = 511902.000000
|Xk-Y|_F:  448403.375000, |X-X0|:  63498.640625
rounded |X_k-Y|_0 = 437744, f1 =  0.653373, approx slack: 6610768
rounded before pow |X_k-Y|_0 = 6720741, f1 =  0.306807

Iteration 3300: Loss = 511463.093750
|Xk-Y|_F:  448253.468750, |X-X0|:  63209.632812
rounded |X_k-Y|_0 = 437581, f1 =  0.653402, approx slack: 6607921
rounded before pow |X_k-Y|_0 = 6718075, f1 =  0.306892

Iteration 3320: Loss = 511006.593750
|Xk-Y|_F:  448075.312500, |X-X0|:  62931.273438
rounded |X_k-Y|_0 = 437463, f1 =  0.653424, approx slack: 6610792
rounded before pow |X_k-Y|_0 = 6720726, f1 =  0.306807

Iteration 3340: Loss = 510574.156250
|Xk-Y|_F:  447923.187500, |X-X0|:  62650.957031
rounded |X_k-Y|_0 = 437292, f1 =  0.653453, approx slack: 6614887
rounded before pow |X_k-Y|_0 = 6724103, f1 =  0.306701

Iteration 3360: Loss = 510186.093750
|Xk-Y|_F:  447805.218750, |X-X0|:  62380.875000
rounded |X_k-Y|_0 = 437236, f1 =  0.653464, approx slack: 6613275
rounded before pow |X_k-Y|_0 = 6723303, f1 =  0.306726

Iteration 3380: Loss = 509793.968750
|Xk-Y|_F:  447683.750000, |X-X0|:  62110.207031
rounded |X_k-Y|_0 = 437163, f1 =  0.653478, approx slack: 6609792
rounded before pow |X_k-Y|_0 = 6722319, f1 =  0.306756

Iteration 3400: Loss = 509385.937500
|Xk-Y|_F:  447551.843750, |X-X0|:  61834.093750
rounded |X_k-Y|_0 = 437098, f1 =  0.653491, approx slack: 6603076
rounded before pow |X_k-Y|_0 = 6722536, f1 =  0.306736

Iteration 3420: Loss = 508979.125000
|Xk-Y|_F:  447418.656250, |X-X0|:  61560.468750
rounded |X_k-Y|_0 = 436994, f1 =  0.653511, approx slack: 6598060
rounded before pow |X_k-Y|_0 = 6718088, f1 =  0.306883

Iteration 3440: Loss = 508631.187500
|Xk-Y|_F:  447333.843750, |X-X0|:  61297.343750
rounded |X_k-Y|_0 = 436916, f1 =  0.653525, approx slack: 6594630
rounded before pow |X_k-Y|_0 = 6715295, f1 =  0.306972

Iteration 3460: Loss = 508278.156250
|Xk-Y|_F:  447234.312500, |X-X0|:  61043.832031
rounded |X_k-Y|_0 = 436828, f1 =  0.653539, approx slack: 6594043
rounded before pow |X_k-Y|_0 = 6714898, f1 =  0.306984

Iteration 3480: Loss = 507902.468750
|Xk-Y|_F:  447111.218750, |X-X0|:  60791.253906
rounded |X_k-Y|_0 = 436720, f1 =  0.653557, approx slack: 6594822
rounded before pow |X_k-Y|_0 = 6715639, f1 =  0.306960

Iteration 3500: Loss = 507521.781250
|Xk-Y|_F:  446985.843750, |X-X0|:  60535.925781
rounded |X_k-Y|_0 = 436639, f1 =  0.653573, approx slack: 6594132
rounded before pow |X_k-Y|_0 = 6714924, f1 =  0.306982

Iteration 3520: Loss = 507175.062500
|Xk-Y|_F:  446894.125000, |X-X0|:  60280.929688
rounded |X_k-Y|_0 = 436585, f1 =  0.653583, approx slack: 6595615
rounded before pow |X_k-Y|_0 = 6715966, f1 =  0.306954

Iteration 3540: Loss = 506800.406250
|Xk-Y|_F:  446782.500000, |X-X0|:  60017.910156
rounded |X_k-Y|_0 = 436521, f1 =  0.653595, approx slack: 6594925
rounded before pow |X_k-Y|_0 = 6715363, f1 =  0.306973

Iteration 3560: Loss = 506411.187500
|Xk-Y|_F:  446652.937500, |X-X0|:  59758.242188
rounded |X_k-Y|_0 = 436418, f1 =  0.653613, approx slack: 6592742
rounded before pow |X_k-Y|_0 = 6713458, f1 =  0.307034

Iteration 3580: Loss = 506054.531250
|Xk-Y|_F:  446544.937500, |X-X0|:  59509.585938
rounded |X_k-Y|_0 = 436352, f1 =  0.653627, approx slack: 6593201
rounded before pow |X_k-Y|_0 = 6713796, f1 =  0.307025

Iteration 3600: Loss = 505715.187500
|Xk-Y|_F:  446442.468750, |X-X0|:  59272.726562
rounded |X_k-Y|_0 = 436282, f1 =  0.653638, approx slack: 6594378
rounded before pow |X_k-Y|_0 = 6715139, f1 =  0.306987

Iteration 3620: Loss = 505343.812500
|Xk-Y|_F:  446328.781250, |X-X0|:  59015.031250
rounded |X_k-Y|_0 = 436152, f1 =  0.653662, approx slack: 6593440
rounded before pow |X_k-Y|_0 = 6712065, f1 =  0.307088

Iteration 3640: Loss = 504994.062500
|Xk-Y|_F:  446231.250000, |X-X0|:  58762.820312
rounded |X_k-Y|_0 = 436100, f1 =  0.653671, approx slack: 6591511
rounded before pow |X_k-Y|_0 = 6710390, f1 =  0.307141

Iteration 3660: Loss = 504652.281250
|Xk-Y|_F:  446134.468750, |X-X0|:  58517.820312
rounded |X_k-Y|_0 = 436039, f1 =  0.653682, approx slack: 6590685
rounded before pow |X_k-Y|_0 = 6709570, f1 =  0.307167

Iteration 3680: Loss = 504308.375000
|Xk-Y|_F:  446035.093750, |X-X0|:  58273.281250
rounded |X_k-Y|_0 = 435981, f1 =  0.653693, approx slack: 6589806
rounded before pow |X_k-Y|_0 = 6708855, f1 =  0.307189

Iteration 3700: Loss = 503986.812500
|Xk-Y|_F:  445951.531250, |X-X0|:  58035.281250
rounded |X_k-Y|_0 = 435929, f1 =  0.653703, approx slack: 6587384
rounded before pow |X_k-Y|_0 = 6706730, f1 =  0.307256

Iteration 3720: Loss = 503658.187500
|Xk-Y|_F:  445861.531250, |X-X0|:  57796.667969
rounded |X_k-Y|_0 = 435865, f1 =  0.653713, approx slack: 6589504
rounded before pow |X_k-Y|_0 = 6706300, f1 =  0.307275

Iteration 3740: Loss = 503286.625000
|Xk-Y|_F:  445716.625000, |X-X0|:  57570.015625
rounded |X_k-Y|_0 = 435763, f1 =  0.653731, approx slack: 6592390
rounded before pow |X_k-Y|_0 = 6709005, f1 =  0.307188

Iteration 3760: Loss = 502923.531250
|Xk-Y|_F:  445595.281250, |X-X0|:  57328.253906
rounded |X_k-Y|_0 = 435701, f1 =  0.653746, approx slack: 6589362
rounded before pow |X_k-Y|_0 = 6707348, f1 =  0.307240

Iteration 3780: Loss = 502603.781250
|Xk-Y|_F:  445505.312500, |X-X0|:  57098.460938
rounded |X_k-Y|_0 = 435594, f1 =  0.653764, approx slack: 6597078
rounded before pow |X_k-Y|_0 = 6714072, f1 =  0.307026

Iteration 3800: Loss = 502258.906250
|Xk-Y|_F:  445385.968750, |X-X0|:  56872.937500
rounded |X_k-Y|_0 = 435549, f1 =  0.653774, approx slack: 6596165
rounded before pow |X_k-Y|_0 = 6713179, f1 =  0.307055

Iteration 3820: Loss = 501888.812500
|Xk-Y|_F:  445261.250000, |X-X0|:  56627.570312
rounded |X_k-Y|_0 = 435440, f1 =  0.653794, approx slack: 6594618
rounded before pow |X_k-Y|_0 = 6708936, f1 =  0.307196

Iteration 3840: Loss = 501524.593750
|Xk-Y|_F:  445120.593750, |X-X0|:  56404.000000
rounded |X_k-Y|_0 = 435359, f1 =  0.653810, approx slack: 6604225
rounded before pow |X_k-Y|_0 = 6717846, f1 =  0.306912

Iteration 3860: Loss = 501176.312500
|Xk-Y|_F:  444999.500000, |X-X0|:  56176.820312
rounded |X_k-Y|_0 = 435271, f1 =  0.653826, approx slack: 6605196
rounded before pow |X_k-Y|_0 = 6718633, f1 =  0.306887

Iteration 3880: Loss = 500874.468750
|Xk-Y|_F:  444911.968750, |X-X0|:  55962.503906
rounded |X_k-Y|_0 = 435181, f1 =  0.653842, approx slack: 6590932
rounded before pow |X_k-Y|_0 = 6704586, f1 =  0.307336

Iteration 3900: Loss = 500572.187500
|Xk-Y|_F:  444827.281250, |X-X0|:  55744.898438
rounded |X_k-Y|_0 = 435139, f1 =  0.653850, approx slack: 6601921
rounded before pow |X_k-Y|_0 = 6715808, f1 =  0.306972

Iteration 3920: Loss = 500226.625000
|Xk-Y|_F:  444702.906250, |X-X0|:  55523.718750
rounded |X_k-Y|_0 = 435042, f1 =  0.653869, approx slack: 6582820
rounded before pow |X_k-Y|_0 = 6697888, f1 =  0.307543

Iteration 3940: Loss = 499826.906250
|Xk-Y|_F:  444521.375000, |X-X0|:  55305.523438
rounded |X_k-Y|_0 = 434978, f1 =  0.653884, approx slack: 6590609
rounded before pow |X_k-Y|_0 = 6706317, f1 =  0.307271

Iteration 3960: Loss = 499500.000000
|Xk-Y|_F:  444411.343750, |X-X0|:  55088.656250
rounded |X_k-Y|_0 = 434906, f1 =  0.653899, approx slack: 6592249
rounded before pow |X_k-Y|_0 = 6708046, f1 =  0.307214

Iteration 3980: Loss = 499160.000000
|Xk-Y|_F:  444289.218750, |X-X0|:  54870.773438
rounded |X_k-Y|_0 = 434765, f1 =  0.653922, approx slack: 6578168
rounded before pow |X_k-Y|_0 = 6694450, f1 =  0.307649

Iteration 4000: Loss = 498819.968750
|Xk-Y|_F:  444162.218750, |X-X0|:  54657.757812
rounded |X_k-Y|_0 = 434657, f1 =  0.653942, approx slack: 6595515
rounded before pow |X_k-Y|_0 = 6709936, f1 =  0.307154

Iteration 4020: Loss = 498435.437500
|Xk-Y|_F:  443995.625000, |X-X0|:  54439.812500
rounded |X_k-Y|_0 = 434540, f1 =  0.653963, approx slack: 6594972
rounded before pow |X_k-Y|_0 = 6709429, f1 =  0.307171

Iteration 4040: Loss = 498046.875000
|Xk-Y|_F:  443830.031250, |X-X0|:  54216.843750
rounded |X_k-Y|_0 = 434340, f1 =  0.653997, approx slack: 6574894
rounded before pow |X_k-Y|_0 = 6690347, f1 =  0.307779

Iteration 4060: Loss = 497765.062500
|Xk-Y|_F:  443753.343750, |X-X0|:  54011.726562
rounded |X_k-Y|_0 = 434250, f1 =  0.654012, approx slack: 6590425
rounded before pow |X_k-Y|_0 = 6705436, f1 =  0.307296

Iteration 4080: Loss = 497403.062500
|Xk-Y|_F:  443603.156250, |X-X0|:  53799.906250
rounded |X_k-Y|_0 = 434107, f1 =  0.654037, approx slack: 6586272
rounded before pow |X_k-Y|_0 = 6701341, f1 =  0.307427

Iteration 4100: Loss = 497078.312500
|Xk-Y|_F:  443498.437500, |X-X0|:  53579.859375
rounded |X_k-Y|_0 = 434007, f1 =  0.654056, approx slack: 6571190
rounded before pow |X_k-Y|_0 = 6687011, f1 =  0.307884

Iteration 4120: Loss = 496739.312500
|Xk-Y|_F:  443377.968750, |X-X0|:  53361.359375
rounded |X_k-Y|_0 = 433878, f1 =  0.654078, approx slack: 6570449
rounded before pow |X_k-Y|_0 = 6686140, f1 =  0.307913

Iteration 4140: Loss = 496408.093750
|Xk-Y|_F:  443266.875000, |X-X0|:  53141.214844
rounded |X_k-Y|_0 = 433800, f1 =  0.654096, approx slack: 6571225
rounded before pow |X_k-Y|_0 = 6686517, f1 =  0.307906

Iteration 4160: Loss = 496071.562500
|Xk-Y|_F:  443149.593750, |X-X0|:  52921.953125
rounded |X_k-Y|_0 = 433713, f1 =  0.654113, approx slack: 6571183
rounded before pow |X_k-Y|_0 = 6686431, f1 =  0.307909

Iteration 4180: Loss = 495813.125000
|Xk-Y|_F:  443090.031250, |X-X0|:  52723.101562
rounded |X_k-Y|_0 = 433636, f1 =  0.654126, approx slack: 6581908
rounded before pow |X_k-Y|_0 = 6697409, f1 =  0.307552

Iteration 4200: Loss = 495489.093750
|Xk-Y|_F:  442988.968750, |X-X0|:  52500.132812
rounded |X_k-Y|_0 = 433589, f1 =  0.654137, approx slack: 6581602
rounded before pow |X_k-Y|_0 = 6697116, f1 =  0.307562

Iteration 4220: Loss = 495175.937500
|Xk-Y|_F:  442887.812500, |X-X0|:  52288.132812
rounded |X_k-Y|_0 = 433446, f1 =  0.654161, approx slack: 6569430
rounded before pow |X_k-Y|_0 = 6685238, f1 =  0.307941

Iteration 4240: Loss = 494867.281250
|Xk-Y|_F:  442796.093750, |X-X0|:  52071.191406
rounded |X_k-Y|_0 = 433421, f1 =  0.654169, approx slack: 6578609
rounded before pow |X_k-Y|_0 = 6694309, f1 =  0.307667

Iteration 4260: Loss = 494554.093750
|Xk-Y|_F:  442697.406250, |X-X0|:  51856.679688
rounded |X_k-Y|_0 = 433385, f1 =  0.654179, approx slack: 6591874
rounded before pow |X_k-Y|_0 = 6707234, f1 =  0.307254

Iteration 4280: Loss = 494193.250000
|Xk-Y|_F:  442551.062500, |X-X0|:  51642.171875
rounded |X_k-Y|_0 = 433326, f1 =  0.654192, approx slack: 6578752
rounded before pow |X_k-Y|_0 = 6694550, f1 =  0.307658

Iteration 4300: Loss = 493833.062500
|Xk-Y|_F:  442413.031250, |X-X0|:  51420.039062
rounded |X_k-Y|_0 = 433249, f1 =  0.654208, approx slack: 6583685
rounded before pow |X_k-Y|_0 = 6698546, f1 =  0.307532

Iteration 4320: Loss = 493522.562500
|Xk-Y|_F:  442316.500000, |X-X0|:  51206.062500
rounded |X_k-Y|_0 = 433197, f1 =  0.654217, approx slack: 6596083
rounded before pow |X_k-Y|_0 = 6710589, f1 =  0.307147

Iteration 4340: Loss = 493229.750000
|Xk-Y|_F:  442240.593750, |X-X0|:  50989.160156
rounded |X_k-Y|_0 = 433164, f1 =  0.654222, approx slack: 6592458
rounded before pow |X_k-Y|_0 = 6707461, f1 =  0.307247

Iteration 4360: Loss = 492904.875000
|Xk-Y|_F:  442130.843750, |X-X0|:  50774.035156
rounded |X_k-Y|_0 = 433054, f1 =  0.654241, approx slack: 6577709
rounded before pow |X_k-Y|_0 = 6693456, f1 =  0.307693

Iteration 4380: Loss = 492582.437500
|Xk-Y|_F:  442019.000000, |X-X0|:  50563.437500
rounded |X_k-Y|_0 = 432994, f1 =  0.654252, approx slack: 6590725
rounded before pow |X_k-Y|_0 = 6706085, f1 =  0.307289

Iteration 4400: Loss = 492246.000000
|Xk-Y|_F:  441904.406250, |X-X0|:  50341.585938
rounded |X_k-Y|_0 = 432939, f1 =  0.654262, approx slack: 6591548
rounded before pow |X_k-Y|_0 = 6706748, f1 =  0.307269

Iteration 4420: Loss = 491984.218750
|Xk-Y|_F:  441834.312500, |X-X0|:  50149.902344
rounded |X_k-Y|_0 = 432894, f1 =  0.654270, approx slack: 6576233
rounded before pow |X_k-Y|_0 = 6692043, f1 =  0.307738

Iteration 4440: Loss = 491670.750000
|Xk-Y|_F:  441734.343750, |X-X0|:  49936.410156
rounded |X_k-Y|_0 = 432839, f1 =  0.654280, approx slack: 6575980
rounded before pow |X_k-Y|_0 = 6692126, f1 =  0.307735

Iteration 4460: Loss = 491342.718750
|Xk-Y|_F:  441624.406250, |X-X0|:  49718.308594
rounded |X_k-Y|_0 = 432802, f1 =  0.654288, approx slack: 6571936
rounded before pow |X_k-Y|_0 = 6688544, f1 =  0.307843

Iteration 4480: Loss = 491004.687500
|Xk-Y|_F:  441508.906250, |X-X0|:  49495.796875
rounded |X_k-Y|_0 = 432664, f1 =  0.654313, approx slack: 6573983
rounded before pow |X_k-Y|_0 = 6690104, f1 =  0.307794

Iteration 4500: Loss = 490699.187500
|Xk-Y|_F:  441412.468750, |X-X0|:  49286.718750
rounded |X_k-Y|_0 = 432622, f1 =  0.654322, approx slack: 6573572
rounded before pow |X_k-Y|_0 = 6689714, f1 =  0.307807

Iteration 4520: Loss = 490709.843750
|Xk-Y|_F:  441632.593750, |X-X0|:  49077.242188
rounded |X_k-Y|_0 = 433356, f1 =  0.654208, approx slack: 6571329
rounded before pow |X_k-Y|_0 = 6687806, f1 =  0.307867

Iteration 4540: Loss = 490114.343750
|Xk-Y|_F:  441248.093750, |X-X0|:  48866.257812
rounded |X_k-Y|_0 = 432610, f1 =  0.654327, approx slack: 6576231
rounded before pow |X_k-Y|_0 = 6691409, f1 =  0.307753

Iteration 4560: Loss = 489755.843750
|Xk-Y|_F:  441088.937500, |X-X0|:  48666.894531
rounded |X_k-Y|_0 = 432356, f1 =  0.654367, approx slack: 6576533
rounded before pow |X_k-Y|_0 = 6691716, f1 =  0.307743

Iteration 4580: Loss = 489519.875000
|Xk-Y|_F:  441046.843750, |X-X0|:  48473.039062
rounded |X_k-Y|_0 = 432315, f1 =  0.654374, approx slack: 6606210
rounded before pow |X_k-Y|_0 = 6716152, f1 =  0.306965

Iteration 4600: Loss = 489151.843750
|Xk-Y|_F:  440890.312500, |X-X0|:  48261.527344
rounded |X_k-Y|_0 = 432186, f1 =  0.654397, approx slack: 6594268
rounded before pow |X_k-Y|_0 = 6704576, f1 =  0.307335

Iteration 4620: Loss = 488806.531250
|Xk-Y|_F:  440758.218750, |X-X0|:  48048.312500
rounded |X_k-Y|_0 = 432080, f1 =  0.654416, approx slack: 6596127
rounded before pow |X_k-Y|_0 = 6706295, f1 =  0.307281

Iteration 4640: Loss = 488484.375000
|Xk-Y|_F:  440639.812500, |X-X0|:  47844.546875
rounded |X_k-Y|_0 = 431976, f1 =  0.654437, approx slack: 6592699
rounded before pow |X_k-Y|_0 = 6703204, f1 =  0.307379

Iteration 4660: Loss = 488177.562500
|Xk-Y|_F:  440529.875000, |X-X0|:  47647.679688
rounded |X_k-Y|_0 = 431903, f1 =  0.654452, approx slack: 6591576
rounded before pow |X_k-Y|_0 = 6702325, f1 =  0.307405

Iteration 4680: Loss = 487872.687500
|Xk-Y|_F:  440416.625000, |X-X0|:  47456.070312
rounded |X_k-Y|_0 = 431756, f1 =  0.654480, approx slack: 6591942
rounded before pow |X_k-Y|_0 = 6702596, f1 =  0.307397

Iteration 4700: Loss = 487581.687500
|Xk-Y|_F:  440312.687500, |X-X0|:  47268.996094
rounded |X_k-Y|_0 = 431692, f1 =  0.654491, approx slack: 6594402
rounded before pow |X_k-Y|_0 = 6704238, f1 =  0.307347

Iteration 4720: Loss = 487307.593750
|Xk-Y|_F:  440215.812500, |X-X0|:  47091.777344
rounded |X_k-Y|_0 = 431620, f1 =  0.654504, approx slack: 6596586
rounded before pow |X_k-Y|_0 = 6703889, f1 =  0.307363

Iteration 4740: Loss = 486987.000000
|Xk-Y|_F:  440092.625000, |X-X0|:  46894.359375
rounded |X_k-Y|_0 = 431570, f1 =  0.654513, approx slack: 6600496
rounded before pow |X_k-Y|_0 = 6707375, f1 =  0.307253

Iteration 4760: Loss = 486676.906250
|Xk-Y|_F:  439982.343750, |X-X0|:  46694.562500
rounded |X_k-Y|_0 = 431483, f1 =  0.654527, approx slack: 6586435
rounded before pow |X_k-Y|_0 = 6697798, f1 =  0.307552

Iteration 4780: Loss = 486365.468750
|Xk-Y|_F:  439869.406250, |X-X0|:  46496.070312
rounded |X_k-Y|_0 = 431363, f1 =  0.654548, approx slack: 6589274
rounded before pow |X_k-Y|_0 = 6699677, f1 =  0.307498

Iteration 4800: Loss = 486067.937500
|Xk-Y|_F:  439753.156250, |X-X0|:  46314.781250
rounded |X_k-Y|_0 = 431214, f1 =  0.654573, approx slack: 6588181
rounded before pow |X_k-Y|_0 = 6698739, f1 =  0.307528

Iteration 4820: Loss = 485787.031250
|Xk-Y|_F:  439657.468750, |X-X0|:  46129.554688
rounded |X_k-Y|_0 = 431131, f1 =  0.654587, approx slack: 6584341
rounded before pow |X_k-Y|_0 = 6696887, f1 =  0.307585

Iteration 4840: Loss = 485480.593750
|Xk-Y|_F:  439543.593750, |X-X0|:  45937.011719
rounded |X_k-Y|_0 = 431032, f1 =  0.654604, approx slack: 6582863
rounded before pow |X_k-Y|_0 = 6695717, f1 =  0.307622

Iteration 4860: Loss = 485189.187500
|Xk-Y|_F:  439444.468750, |X-X0|:  45744.718750
rounded |X_k-Y|_0 = 430944, f1 =  0.654619, approx slack: 6579455
rounded before pow |X_k-Y|_0 = 6692962, f1 =  0.307710

Iteration 4880: Loss = 484895.125000
|Xk-Y|_F:  439337.562500, |X-X0|:  45557.558594
rounded |X_k-Y|_0 = 430814, f1 =  0.654641, approx slack: 6581072
rounded before pow |X_k-Y|_0 = 6694168, f1 =  0.307671

Iteration 4900: Loss = 484608.562500
|Xk-Y|_F:  439230.687500, |X-X0|:  45377.867188
rounded |X_k-Y|_0 = 430697, f1 =  0.654660, approx slack: 6584260
rounded before pow |X_k-Y|_0 = 6696871, f1 =  0.307586

Iteration 4920: Loss = 484336.000000
|Xk-Y|_F:  439125.031250, |X-X0|:  45210.980469
rounded |X_k-Y|_0 = 430579, f1 =  0.654681, approx slack: 6584071
rounded before pow |X_k-Y|_0 = 6696807, f1 =  0.307588

Iteration 4940: Loss = 484142.187500
|Xk-Y|_F:  439091.375000, |X-X0|:  45050.804688
rounded |X_k-Y|_0 = 430522, f1 =  0.654689, approx slack: 6588544
rounded before pow |X_k-Y|_0 = 6700968, f1 =  0.307455

Iteration 4960: Loss = 483876.750000
|Xk-Y|_F:  438995.937500, |X-X0|:  44880.828125
rounded |X_k-Y|_0 = 430422, f1 =  0.654705, approx slack: 6582260
rounded before pow |X_k-Y|_0 = 6694928, f1 =  0.307647

Iteration 4980: Loss = 483598.062500
|Xk-Y|_F:  438887.156250, |X-X0|:  44710.921875
rounded |X_k-Y|_0 = 430293, f1 =  0.654728, approx slack: 6580710
rounded before pow |X_k-Y|_0 = 6693637, f1 =  0.307689

Iteration 4999: Loss = 483334.875000
|Xk-Y|_F:  438798.468750, |X-X0|:  44536.414062
rounded |X_k-Y|_0 = 430209, f1 =  0.654742, approx slack: 6575375
rounded before pow |X_k-Y|_0 = 6689540, f1 =  0.307820


KB after refine:
num_nodes: 5045.0000
num_edges: 4074.0000
density: 0.0002
avg_degree: 0.8075
avg_clustering: 0.0978
degree_assortativity: -0.3570
modularity: 0.6165
avg_betweenness: 0.0000
avg_closeness: 0.0022
------ ABL 0 after refine ------
--- eval ---
prediction result:
f1 on test:    0.5372
f1 on test:    0.8932 (micro)
f1 on KB:      0.6494
f1 on orig KB: 0.3449
integrated f1: 0.3831, w_data: 0.3230, w_klg: 0.6770

integrated result:
f1 on test:    0.5266
f1 on test:    0.8932 (micro)
f1 on KB:      0.6572
f1 on orig KB: 0.3299
integrated f1: 0.3680, w_data: 0.3230, w_klg: 0.6770
------------
integrated f1 0.3831
Epoch 100, Total loss: -5695418880.0000, CE loss: 25.1474, RL loss: -56954188.0000, Reward: -1947289.3828
    full cols: 505, non-full cols: 52
   r - labels: 335, labels - r: 135
    violated: 8074, weighted: 10174.255859375, len: 0.0, nonzero: 0.10598984360694885
Epoch 200, Total loss: 62479437824.0000, CE loss: 25.1387, RL loss: 624794368.0000, Reward: -1941511.0938
    full cols: 517, non-full cols: 34
   r - labels: 330, labels - r: 136
    violated: 8285, weighted: 10156.759765625, len: 0.0, nonzero: 0.10580401867628098
Epoch 300, Total loss: 3356260096.0000, CE loss: 25.1300, RL loss: 33562600.0000, Reward: -1931088.9590
    full cols: 511, non-full cols: 46
   r - labels: 336, labels - r: 136
    violated: 8019, weighted: 10155.744140625, len: 0.0, nonzero: 0.10563057661056519
Epoch 400, Total loss: 34768642048.0000, CE loss: 25.1220, RL loss: 347686432.0000, Reward: -1921417.2480
    full cols: 517, non-full cols: 37
   r - labels: 334, labels - r: 137
    violated: 8651, weighted: 10207.412109375, len: 0.0, nonzero: 0.10533635318279266
Epoch 500, Total loss: 85048475648.0000, CE loss: 25.1139, RL loss: 850484736.0000, Reward: -1919609.0703
    full cols: 505, non-full cols: 51
   r - labels: 337, labels - r: 138
    violated: 8080, weighted: 10167.001953125, len: 0.0, nonzero: 0.10493991523981094
Epoch 600, Total loss: -43820470272.0000, CE loss: 25.1079, RL loss: -438204704.0000, Reward: -1931676.6973
    full cols: 451, non-full cols: 167
   r - labels: 396, labels - r: 135
    violated: 8523, weighted: 10250.83203125, len: 0.0, nonzero: 0.10515362024307251
Epoch 700, Total loss: -16215726080.0000, CE loss: 25.1021, RL loss: -162157264.0000, Reward: -1921516.6660
    full cols: 500, non-full cols: 52
   r - labels: 334, labels - r: 139
    violated: 8290, weighted: 10187.54296875, len: 0.0, nonzero: 0.10502354055643082
Epoch 800, Total loss: -34411773952.0000, CE loss: 25.0962, RL loss: -344117760.0000, Reward: -1914745.2344
    full cols: 504, non-full cols: 41
   r - labels: 331, labels - r: 143
    violated: 8342, weighted: 10177.3671875, len: 0.0, nonzero: 0.10354001820087433
Epoch 900, Total loss: -155732590592.0000, CE loss: 25.0916, RL loss: -1557325952.0000, Reward: -1929048.6055
    full cols: 508, non-full cols: 39
   r - labels: 333, labels - r: 143
    violated: 8554, weighted: 10289.150390625, len: 0.0, nonzero: 0.10489656031131744
Epoch 1000, Total loss: 11748914176.0000, CE loss: 25.0869, RL loss: 117489144.0000, Reward: -1903070.4961
    full cols: 500, non-full cols: 49
   r - labels: 335, labels - r: 143
    violated: 7944, weighted: 10385.4619140625, len: 0.0, nonzero: 0.10491514205932617
Epoch 1100, Total loss: -68411539456.0000, CE loss: 25.0830, RL loss: -684115392.0000, Reward: -1917797.2734
    full cols: 500, non-full cols: 52
   r - labels: 337, labels - r: 142
    violated: 7931, weighted: 10405.3212890625, len: 0.0, nonzero: 0.104497030377388
Epoch 1200, Total loss: 110903836672.0000, CE loss: 25.0789, RL loss: 1109038336.0000, Reward: -1910250.9219
    full cols: 475, non-full cols: 86
   r - labels: 345, labels - r: 141
    violated: 8426, weighted: 10195.314453125, len: 0.0, nonzero: 0.10298872739076614
Epoch 1300, Total loss: 39113060352.0000, CE loss: 25.0757, RL loss: 391130592.0000, Reward: -1909310.7441
    full cols: 487, non-full cols: 58
   r - labels: 333, labels - r: 145
    violated: 8597, weighted: 10119.58203125, len: 0.0, nonzero: 0.101743683218956
Epoch 1400, Total loss: 18284193792.0000, CE loss: 25.0722, RL loss: 182841936.0000, Reward: -1910900.7129
    full cols: 492, non-full cols: 52
   r - labels: 330, labels - r: 143
    violated: 8053, weighted: 10101.525390625, len: 0.0, nonzero: 0.10262946039438248
Epoch 1500, Total loss: 100409851904.0000, CE loss: 25.0688, RL loss: 1004098560.0000, Reward: -1901926.0215
    full cols: 491, non-full cols: 68
   r - labels: 336, labels - r: 134
    violated: 7925, weighted: 10048.23828125, len: 0.0, nonzero: 0.10450012981891632
Epoch 1600, Total loss: -31953395712.0000, CE loss: 25.0658, RL loss: -319533952.0000, Reward: -1909613.4688
    full cols: 495, non-full cols: 59
   r - labels: 336, labels - r: 139
    violated: 8018, weighted: 10251.314453125, len: 0.0, nonzero: 0.10363293439149857
Epoch 1700, Total loss: 16999688192.0000, CE loss: 25.0630, RL loss: 169996880.0000, Reward: -1898458.7168
    full cols: 483, non-full cols: 73
   r - labels: 340, labels - r: 141
    violated: 7827, weighted: 10230.703125, len: 0.0, nonzero: 0.10301040858030319
Epoch 1800, Total loss: -164719132672.0000, CE loss: 25.0602, RL loss: -1647191296.0000, Reward: -1918429.2812
    full cols: 490, non-full cols: 68
   r - labels: 342, labels - r: 141
    violated: 8958, weighted: 10265.0390625, len: 0.0, nonzero: 0.10297324508428574
Epoch 1900, Total loss: 53672517632.0000, CE loss: 25.0581, RL loss: 536725184.0000, Reward: -1910840.2305
    full cols: 416, non-full cols: 213
   r - labels: 402, labels - r: 130
    violated: 8236, weighted: 10054.064453125, len: 0.0, nonzero: 0.10198526084423065
--- eval ---
prediction result:
f1 on test:    0.5360
f1 on test:    0.8932 (micro)
f1 on KB:      0.6499
integrated f1: 0.6084, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5277
f1 on test:    0.8933 (micro)
f1 on KB:      0.6573
integrated f1: 0.6088, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: 22584356864.0000, CE loss: 25.0551, RL loss: 225843568.0000, Reward: -1917605.6621
    full cols: 478, non-full cols: 61
   r - labels: 327, labels - r: 145
    violated: 8315, weighted: 10044.216796875, len: 0.0, nonzero: 0.10167864710092545
Epoch 2100, Total loss: -76735741952.0000, CE loss: 25.0522, RL loss: -767357440.0000, Reward: -1909793.5684
    full cols: 477, non-full cols: 67
   r - labels: 329, labels - r: 142
    violated: 8186, weighted: 9731.1376953125, len: 0.0, nonzero: 0.10049863904714584
Epoch 2200, Total loss: 60792344576.0000, CE loss: 25.0488, RL loss: 607923456.0000, Reward: -1905041.6953
    full cols: 486, non-full cols: 55
   r - labels: 325, labels - r: 141
    violated: 8182, weighted: 9935.970703125, len: 0.0, nonzero: 0.10217418521642685
Epoch 2300, Total loss: 6567869952.0000, CE loss: 25.0465, RL loss: 65678700.0000, Reward: -1901898.3203
    full cols: 486, non-full cols: 45
   r - labels: 319, labels - r: 145
    violated: 8450, weighted: 9964.25, len: 0.0, nonzero: 0.10034997761249542
Epoch 2400, Total loss: -45549936640.0000, CE loss: 25.0443, RL loss: -455499360.0000, Reward: -1898420.1895
    full cols: 479, non-full cols: 48
   r - labels: 319, labels - r: 149
    violated: 8430, weighted: 9903.58203125, len: 0.0, nonzero: 0.09928146749734879
Epoch 2500, Total loss: -15513998336.0000, CE loss: 25.0421, RL loss: -155139984.0000, Reward: -1873851.6562
    full cols: 475, non-full cols: 52
   r - labels: 319, labels - r: 149
    violated: 8686, weighted: 9959.115234375, len: 0.0, nonzero: 0.09916996955871582
Epoch 2600, Total loss: -11770004480.0000, CE loss: 25.0391, RL loss: -117700040.0000, Reward: -1879813.9297
    full cols: 480, non-full cols: 38
   r - labels: 314, labels - r: 153
    violated: 8109, weighted: 10125.775390625, len: 0.0, nonzero: 0.09936819225549698
Epoch 2700, Total loss: -138249076736.0000, CE loss: 25.0359, RL loss: -1382490752.0000, Reward: -1908680.4219
    full cols: 478, non-full cols: 36
   r - labels: 313, labels - r: 156
    violated: 8200, weighted: 10126.5869140625, len: 0.0, nonzero: 0.09833065420389175
Epoch 2800, Total loss: -202656825344.0000, CE loss: 25.0322, RL loss: -2026568192.0000, Reward: -1913325.4414
    full cols: 467, non-full cols: 51
   r - labels: 314, labels - r: 153
    violated: 8241, weighted: 9996.73828125, len: 0.0, nonzero: 0.09743558615446091
Epoch 2900, Total loss: -110069530624.0000, CE loss: 25.0285, RL loss: -1100695296.0000, Reward: -1907118.2578
    full cols: 462, non-full cols: 76
   r - labels: 334, labels - r: 153
    violated: 8501, weighted: 10229.916015625, len: 0.0, nonzero: 0.0996624156832695
Epoch 3000, Total loss: -106812891136.0000, CE loss: 25.0236, RL loss: -1068128896.0000, Reward: -1911564.4648
    full cols: 450, non-full cols: 93
   r - labels: 339, labels - r: 153
    violated: 8558, weighted: 10181.306640625, len: 0.0, nonzero: 0.09767406433820724
Epoch 3100, Total loss: 25302456320.0000, CE loss: 25.0187, RL loss: 253024560.0000, Reward: -1884131.3008
    full cols: 475, non-full cols: 53
   r - labels: 325, labels - r: 154
    violated: 8414, weighted: 10259.2060546875, len: 0.0, nonzero: 0.09951375424861908
Epoch 3200, Total loss: -33331439616.0000, CE loss: 25.0130, RL loss: -333314400.0000, Reward: -1886027.4727
    full cols: 464, non-full cols: 66
   r - labels: 326, labels - r: 153
    violated: 8985, weighted: 10167.0439453125, len: 0.0, nonzero: 0.0988169014453888
Epoch 3300, Total loss: 153622921216.0000, CE loss: 25.0092, RL loss: 1536229248.0000, Reward: -1884431.6562
    full cols: 467, non-full cols: 56
   r - labels: 318, labels - r: 152
    violated: 8832, weighted: 9970.142578125, len: 0.0, nonzero: 0.09855984151363373
Epoch 3400, Total loss: -11160639488.0000, CE loss: 25.0044, RL loss: -111606400.0000, Reward: -1903268.2637
    full cols: 471, non-full cols: 51
   r - labels: 319, labels - r: 154
    violated: 8736, weighted: 10081.06640625, len: 0.0, nonzero: 0.09891600906848907
Epoch 3500, Total loss: -119868145664.0000, CE loss: 24.9997, RL loss: -1198681472.0000, Reward: -1914976.6094
    full cols: 438, non-full cols: 118
   r - labels: 349, labels - r: 150
    violated: 8149, weighted: 10000.7021484375, len: 0.0, nonzero: 0.0980890765786171
Epoch 3600, Total loss: -41945546752.0000, CE loss: 24.9961, RL loss: -419455488.0000, Reward: -1913712.7168
    full cols: 464, non-full cols: 70
   r - labels: 335, labels - r: 158
    violated: 8432, weighted: 10444.82421875, len: 0.0, nonzero: 0.099721260368824
Epoch 3700, Total loss: 55661793280.0000, CE loss: 24.9927, RL loss: 556617920.0000, Reward: -1879491.3184
    full cols: 482, non-full cols: 45
   r - labels: 329, labels - r: 159
    violated: 8845, weighted: 10472.83203125, len: 0.0, nonzero: 0.10053271055221558
Epoch 3800, Total loss: -21395206144.0000, CE loss: 24.9897, RL loss: -213952064.0000, Reward: -1893208.2109
    full cols: 474, non-full cols: 57
   r - labels: 334, labels - r: 160
    violated: 9026, weighted: 10485.587890625, len: 0.0, nonzero: 0.09928146749734879
Epoch 3900, Total loss: 3216210688.0000, CE loss: 24.9878, RL loss: 32162108.0000, Reward: -1888569.2168
    full cols: 470, non-full cols: 62
   r - labels: 332, labels - r: 157
    violated: 8186, weighted: 10395.43359375, len: 0.0, nonzero: 0.09902750700712204
--- eval ---
prediction result:
f1 on test:    0.5347
f1 on test:    0.8936 (micro)
f1 on KB:      0.6507
integrated f1: 0.6083, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5271
f1 on test:    0.8932 (micro)
f1 on KB:      0.6562
integrated f1: 0.6080, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: 155313848320.0000, CE loss: 24.9854, RL loss: 1553138560.0000, Reward: -1886305.5488
    full cols: 423, non-full cols: 179
   r - labels: 395, labels - r: 150
    violated: 8751, weighted: 10568.74609375, len: 0.0, nonzero: 0.09750372171401978
Epoch 4100, Total loss: -7115740672.0000, CE loss: 24.9838, RL loss: -71157408.0000, Reward: -1887194.8828
    full cols: 420, non-full cols: 192
   r - labels: 401, labels - r: 146
    violated: 8819, weighted: 10742.177734375, len: 0.0, nonzero: 0.09860629588365555
Epoch 4200, Total loss: -90528112640.0000, CE loss: 24.9823, RL loss: -905281152.0000, Reward: -1902161.8027
    full cols: 468, non-full cols: 51
   r - labels: 327, labels - r: 165
    violated: 8713, weighted: 10741.142578125, len: 0.0, nonzero: 0.09789086133241653
Epoch 4300, Total loss: 66496069632.0000, CE loss: 24.9801, RL loss: 664960704.0000, Reward: -1879605.2480
    full cols: 468, non-full cols: 57
   r - labels: 330, labels - r: 162
    violated: 8775, weighted: 10720.8671875, len: 0.0, nonzero: 0.09808597713708878
Epoch 4400, Total loss: 124693413888.0000, CE loss: 24.9785, RL loss: 1246934144.0000, Reward: -1881948.8809
    full cols: 467, non-full cols: 50
   r - labels: 327, labels - r: 167
    violated: 8579, weighted: 10721.267578125, len: 0.0, nonzero: 0.09718471765518188
Epoch 4500, Total loss: -85192048640.0000, CE loss: 24.9770, RL loss: -851920448.0000, Reward: -1881601.8066
    full cols: 464, non-full cols: 65
   r - labels: 333, labels - r: 161
    violated: 8158, weighted: 10758.984375, len: 0.0, nonzero: 0.09896866232156754
Epoch 4600, Total loss: -110033813504.0000, CE loss: 24.9756, RL loss: -1100338176.0000, Reward: -1903353.3496
    full cols: 454, non-full cols: 80
   r - labels: 339, labels - r: 162
    violated: 8316, weighted: 10808.6025390625, len: 0.0, nonzero: 0.09733957052230835
Epoch 4700, Total loss: 123651121152.0000, CE loss: 24.9743, RL loss: 1236511232.0000, Reward: -1870604.5820
    full cols: 467, non-full cols: 46
   r - labels: 317, labels - r: 161
    violated: 9151, weighted: 10628.87109375, len: 0.0, nonzero: 0.09752849489450455
Epoch 4800, Total loss: 67867533312.0000, CE loss: 24.9725, RL loss: 678675328.0000, Reward: -1876028.9453
    full cols: 465, non-full cols: 56
   r - labels: 327, labels - r: 163
    violated: 8750, weighted: 10742.8564453125, len: 0.0, nonzero: 0.09767406433820724
Epoch 4900, Total loss: 154809876480.0000, CE loss: 24.9721, RL loss: 1548098688.0000, Reward: -1892232.1387
    full cols: 448, non-full cols: 78
   r - labels: 328, labels - r: 159
    violated: 8856, weighted: 10540.4736328125, len: 0.0, nonzero: 0.09601090103387833
Epoch 5000, Total loss: -4647029760.0000, CE loss: 24.9709, RL loss: -46470296.0000, Reward: -1932561.3398
    full cols: 448, non-full cols: 76
   r - labels: 327, labels - r: 160
    violated: 8706, weighted: 10488.56640625, len: 0.0, nonzero: 0.09595825523138046
Epoch 5100, Total loss: -141974437888.0000, CE loss: 24.9696, RL loss: -1419744384.0000, Reward: -1960988.9688
    full cols: 461, non-full cols: 61
   r - labels: 325, labels - r: 160
    violated: 8725, weighted: 10410.0458984375, len: 0.0, nonzero: 0.09696482121944427
Epoch 5200, Total loss: 77537583104.0000, CE loss: 24.9696, RL loss: 775375808.0000, Reward: -1948507.6582
    full cols: 477, non-full cols: 50
   r - labels: 329, labels - r: 159
    violated: 8009, weighted: 10747.490234375, len: 0.0, nonzero: 0.09975223243236542
Epoch 5300, Total loss: 83162243072.0000, CE loss: 24.9682, RL loss: 831622464.0000, Reward: -1966687.3770
    full cols: 472, non-full cols: 53
   r - labels: 327, labels - r: 159
    violated: 8157, weighted: 10691.310546875, len: 0.0, nonzero: 0.0994734913110733
Epoch 5400, Total loss: 164477304832.0000, CE loss: 24.9669, RL loss: 1644772992.0000, Reward: -1938505.9023
    full cols: 471, non-full cols: 56
   r - labels: 329, labels - r: 159
    violated: 9202, weighted: 10874.099609375, len: 0.0, nonzero: 0.09915758669376373
Epoch 5500, Total loss: 25326112768.0000, CE loss: 24.9645, RL loss: 253261136.0000, Reward: -1940709.0430
    full cols: 464, non-full cols: 68
   r - labels: 331, labels - r: 156
    violated: 8376, weighted: 10758.4296875, len: 0.0, nonzero: 0.09863416850566864
Epoch 5600, Total loss: 32867522560.0000, CE loss: 24.9638, RL loss: 328675232.0000, Reward: -1962090.5234
    full cols: 477, non-full cols: 53
   r - labels: 335, labels - r: 162
    violated: 8604, weighted: 10903.708984375, len: 0.0, nonzero: 0.09926288574934006
Epoch 5700, Total loss: 109891903488.0000, CE loss: 24.9630, RL loss: 1098919040.0000, Reward: -1956887.4551
    full cols: 481, non-full cols: 45
   r - labels: 335, labels - r: 166
    violated: 8778, weighted: 10896.97265625, len: 0.0, nonzero: 0.09976771473884583
Epoch 5800, Total loss: -76114411520.0000, CE loss: 24.9610, RL loss: -761144128.0000, Reward: -1958380.2246
    full cols: 484, non-full cols: 54
   r - labels: 348, labels - r: 167
    violated: 8166, weighted: 11120.384765625, len: 0.0, nonzero: 0.10100656747817993
Epoch 5900, Total loss: 214244655104.0000, CE loss: 24.9610, RL loss: 2142446592.0000, Reward: -1925939.7930
    full cols: 489, non-full cols: 49
   r - labels: 344, labels - r: 163
    violated: 8086, weighted: 11107.337890625, len: 0.0, nonzero: 0.101759172976017
--- eval ---
prediction result:
f1 on test:    0.5330
f1 on test:    0.8936 (micro)
f1 on KB:      0.6503
integrated f1: 0.6073, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5262
f1 on test:    0.8931 (micro)
f1 on KB:      0.6567
integrated f1: 0.6078, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: -12710812672.0000, CE loss: 24.9596, RL loss: -127108128.0000, Reward: -1966248.9141
    full cols: 484, non-full cols: 56
   r - labels: 345, labels - r: 162
    violated: 8620, weighted: 10973.5126953125, len: 0.0, nonzero: 0.10135654360055923
Epoch 6100, Total loss: 27613853696.0000, CE loss: 24.9591, RL loss: 276138528.0000, Reward: -1966672.0156
    full cols: 460, non-full cols: 102
   r - labels: 364, labels - r: 159
    violated: 8105, weighted: 11025.359375, len: 0.0, nonzero: 0.10209055989980698
Epoch 6200, Total loss: 57877356544.0000, CE loss: 24.9573, RL loss: 578773568.0000, Reward: -1967313.7402
    full cols: 462, non-full cols: 79
   r - labels: 343, labels - r: 159
    violated: 8047, weighted: 10925.1171875, len: 0.0, nonzero: 0.09919165074825287
Epoch 6300, Total loss: 11600510976.0000, CE loss: 24.9559, RL loss: 116005112.0000, Reward: -1955771.4883
    full cols: 459, non-full cols: 63
   r - labels: 329, labels - r: 164
    violated: 8899, weighted: 10732.6904296875, len: 0.0, nonzero: 0.09685332328081131
Epoch 6400, Total loss: -156782592000.0000, CE loss: 24.9548, RL loss: -1567825920.0000, Reward: -1983710.3164
    full cols: 465, non-full cols: 53
   r - labels: 330, labels - r: 169
    violated: 9161, weighted: 10880.736328125, len: 0.0, nonzero: 0.09783510863780975
Epoch 6500, Total loss: -94189617152.0000, CE loss: 24.9538, RL loss: -941896192.0000, Reward: -2004845.2559
    full cols: 460, non-full cols: 52
   r - labels: 323, labels - r: 168
    violated: 7897, weighted: 10655.111328125, len: 0.0, nonzero: 0.09600161015987396
Epoch 6600, Total loss: -20929187840.0000, CE loss: 24.9532, RL loss: -209291888.0000, Reward: -2001518.7930
    full cols: 466, non-full cols: 48
   r - labels: 323, labels - r: 166
    violated: 8470, weighted: 10792.8310546875, len: 0.0, nonzero: 0.09738912433385849
Epoch 6700, Total loss: -53640425472.0000, CE loss: 24.9515, RL loss: -536404256.0000, Reward: -2026261.8398
    full cols: 458, non-full cols: 51
   r - labels: 323, labels - r: 171
    violated: 8256, weighted: 10705.6640625, len: 0.0, nonzero: 0.09588392078876495
Epoch 6800, Total loss: 42224640000.0000, CE loss: 24.9504, RL loss: 422246400.0000, Reward: -2004312.0215
    full cols: 444, non-full cols: 72
   r - labels: 331, labels - r: 172
    violated: 8711, weighted: 10700.9150390625, len: 0.0, nonzero: 0.09500433504581451
Epoch 6900, Total loss: -160192905216.0000, CE loss: 24.9489, RL loss: -1601929088.0000, Reward: -2011379.0391
    full cols: 379, non-full cols: 262
   r - labels: 433, labels - r: 149
    violated: 8396, weighted: 10808.203125, len: 0.0, nonzero: 0.0956144705414772
Epoch 7000, Total loss: -64035602432.0000, CE loss: 24.9478, RL loss: -640356032.0000, Reward: -2029599.0195
    full cols: 465, non-full cols: 55
   r - labels: 333, labels - r: 170
    violated: 8324, weighted: 10990.62109375, len: 0.0, nonzero: 0.09823773801326752
Epoch 7100, Total loss: 52998623232.0000, CE loss: 24.9467, RL loss: 529986240.0000, Reward: -2020484.3438
    full cols: 443, non-full cols: 86
   r - labels: 340, labels - r: 168
    violated: 8404, weighted: 10934.322265625, len: 0.0, nonzero: 0.09720329940319061
Epoch 7200, Total loss: 23771770880.0000, CE loss: 24.9457, RL loss: 237717712.0000, Reward: -2005758.5020
    full cols: 458, non-full cols: 48
   r - labels: 323, labels - r: 174
    violated: 8408, weighted: 10919.380859375, len: 0.0, nonzero: 0.09582817554473877
Epoch 7300, Total loss: -146089213952.0000, CE loss: 24.9447, RL loss: -1460892160.0000, Reward: -2027871.4609
    full cols: 448, non-full cols: 58
   r - labels: 322, labels - r: 173
    violated: 8679, weighted: 10664.673828125, len: 0.0, nonzero: 0.09434465318918228
Epoch 7400, Total loss: 96985776128.0000, CE loss: 24.9437, RL loss: 969857728.0000, Reward: -2012310.9043
    full cols: 461, non-full cols: 60
   r - labels: 335, labels - r: 171
    violated: 7870, weighted: 10964.23828125, len: 0.0, nonzero: 0.09678518772125244
Epoch 7500, Total loss: -63813427200.0000, CE loss: 24.9433, RL loss: -638134272.0000, Reward: -2026675.3691
    full cols: 457, non-full cols: 52
   r - labels: 323, labels - r: 171
    violated: 8904, weighted: 10735.39453125, len: 0.0, nonzero: 0.095905601978302
Epoch 7600, Total loss: -28861992960.0000, CE loss: 24.9436, RL loss: -288619936.0000, Reward: -2047583.5547
    full cols: 455, non-full cols: 71
   r - labels: 336, labels - r: 167
    violated: 8740, weighted: 10876.47265625, len: 0.0, nonzero: 0.09680376946926117
Epoch 7700, Total loss: -135941095424.0000, CE loss: 24.9430, RL loss: -1359410944.0000, Reward: -2056122.8164
    full cols: 478, non-full cols: 35
   r - labels: 326, labels - r: 170
    violated: 8238, weighted: 11016.36328125, len: 0.0, nonzero: 0.09786608070135117
Epoch 7800, Total loss: 48004689920.0000, CE loss: 24.9423, RL loss: 480046880.0000, Reward: -2021663.0977
    full cols: 459, non-full cols: 76
   r - labels: 348, labels - r: 170
    violated: 8741, weighted: 10996.2392578125, len: 0.0, nonzero: 0.09803642332553864
Epoch 7900, Total loss: 82977767424.0000, CE loss: 24.9415, RL loss: 829777664.0000, Reward: -2006977.2910
    full cols: 459, non-full cols: 61
   r - labels: 332, labels - r: 169
    violated: 8126, weighted: 10822.4091796875, len: 0.0, nonzero: 0.09645069390535355
--- eval ---
prediction result:
f1 on test:    0.5301
f1 on test:    0.8933 (micro)
f1 on KB:      0.6512
integrated f1: 0.6065, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5256
f1 on test:    0.8931 (micro)
f1 on KB:      0.6566
integrated f1: 0.6075, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: 133169577984.0000, CE loss: 24.9405, RL loss: 1331695744.0000, Reward: -1988926.4746
    full cols: 462, non-full cols: 54
   r - labels: 331, labels - r: 172
    violated: 8517, weighted: 11096.755859375, len: 0.0, nonzero: 0.09689977765083313
Epoch 8100, Total loss: 26956115968.0000, CE loss: 24.9399, RL loss: 269561152.0000, Reward: -1998431.5781
    full cols: 454, non-full cols: 58
   r - labels: 324, labels - r: 169
    violated: 8567, weighted: 10623.044921875, len: 0.0, nonzero: 0.09516538679599762
Epoch 8200, Total loss: -36680957952.0000, CE loss: 24.9398, RL loss: -366809600.0000, Reward: -2030695.8691
    full cols: 453, non-full cols: 66
   r - labels: 330, labels - r: 168
    violated: 8882, weighted: 10654.8408203125, len: 0.0, nonzero: 0.09467913955450058
Epoch 8300, Total loss: -185941671936.0000, CE loss: 24.9393, RL loss: -1859416704.0000, Reward: -2055465.3066
    full cols: 448, non-full cols: 65
   r - labels: 331, labels - r: 175
    violated: 8792, weighted: 10798.646484375, len: 0.0, nonzero: 0.0943322628736496
Epoch 8400, Total loss: -64209149952.0000, CE loss: 24.9395, RL loss: -642091520.0000, Reward: -2058715.2500
    full cols: 427, non-full cols: 131
   r - labels: 366, labels - r: 165
    violated: 8196, weighted: 10797.5390625, len: 0.0, nonzero: 0.09571357816457748
Epoch 8500, Total loss: -97579278336.0000, CE loss: 24.9393, RL loss: -975792768.0000, Reward: -2029760.2676
    full cols: 443, non-full cols: 95
   r - labels: 349, labels - r: 168
    violated: 8180, weighted: 10852.876953125, len: 0.0, nonzero: 0.09560208767652512
Epoch 8600, Total loss: -209217486848.0000, CE loss: 24.9391, RL loss: -2092174848.0000, Reward: -2050937.4746
    full cols: 459, non-full cols: 53
   r - labels: 328, labels - r: 173
    violated: 8747, weighted: 10933.4296875, len: 0.0, nonzero: 0.09592108428478241
Epoch 8700, Total loss: -38626385920.0000, CE loss: 24.9388, RL loss: -386263872.0000, Reward: -2041198.5957
    full cols: 460, non-full cols: 54
   r - labels: 326, labels - r: 169
    violated: 8356, weighted: 10821.103515625, len: 0.0, nonzero: 0.09645689278841019
Epoch 8800, Total loss: -47385460736.0000, CE loss: 24.9394, RL loss: -473854592.0000, Reward: -2052401.8945
    full cols: 444, non-full cols: 72
   r - labels: 333, labels - r: 174
    violated: 8831, weighted: 10845.18359375, len: 0.0, nonzero: 0.09553394466638565
Epoch 8900, Total loss: 1683731584.0000, CE loss: 24.9388, RL loss: 16837316.0000, Reward: -2040545.3359
    full cols: 465, non-full cols: 52
   r - labels: 329, labels - r: 169
    violated: 8472, weighted: 10907.384765625, len: 0.0, nonzero: 0.09826871007680893
Epoch 9000, Total loss: -182799630336.0000, CE loss: 24.9381, RL loss: -1827996288.0000, Reward: -2057610.4141
    full cols: 465, non-full cols: 66
   r - labels: 341, labels - r: 167
    violated: 8272, weighted: 11072.794921875, len: 0.0, nonzero: 0.09859081357717514
Epoch 9100, Total loss: -131119538176.0000, CE loss: 24.9379, RL loss: -1311195392.0000, Reward: -2067035.4707
    full cols: 464, non-full cols: 62
   r - labels: 340, labels - r: 171
    violated: 8531, weighted: 10997.255859375, len: 0.0, nonzero: 0.09868372231721878
Epoch 9200, Total loss: 92986171392.0000, CE loss: 24.9376, RL loss: 929861696.0000, Reward: -2020523.5156
    full cols: 444, non-full cols: 91
   r - labels: 345, labels - r: 167
    violated: 8828, weighted: 10816.0673828125, len: 0.0, nonzero: 0.09671705216169357
Epoch 9300, Total loss: -11461042176.0000, CE loss: 24.9375, RL loss: -114610424.0000, Reward: -2059868.0879
    full cols: 456, non-full cols: 57
   r - labels: 328, labels - r: 172
    violated: 8768, weighted: 10750.5791015625, len: 0.0, nonzero: 0.09569189697504044
Epoch 9400, Total loss: 125608755200.0000, CE loss: 24.9383, RL loss: 1256087552.0000, Reward: -2051479.2422
    full cols: 448, non-full cols: 83
   r - labels: 345, labels - r: 171
    violated: 8317, weighted: 10823.037109375, len: 0.0, nonzero: 0.09643521159887314
Epoch 9500, Total loss: -68374949888.0000, CE loss: 24.9377, RL loss: -683749504.0000, Reward: -2102695.9941
    full cols: 415, non-full cols: 183
   r - labels: 396, labels - r: 155
    violated: 8132, weighted: 11091.25, len: 0.0, nonzero: 0.09646927565336227
Epoch 9600, Total loss: -117578883072.0000, CE loss: 24.9377, RL loss: -1175788800.0000, Reward: -2102688.6699
    full cols: 442, non-full cols: 84
   r - labels: 336, labels - r: 167
    violated: 8398, weighted: 11024.275390625, len: 0.0, nonzero: 0.09528927505016327
Epoch 9700, Total loss: -187458666496.0000, CE loss: 24.9379, RL loss: -1874586624.0000, Reward: -2103776.2285
    full cols: 448, non-full cols: 62
   r - labels: 326, labels - r: 173
    violated: 9054, weighted: 10822.744140625, len: 0.0, nonzero: 0.09551846235990524
Epoch 9800, Total loss: -7020914176.0000, CE loss: 24.9377, RL loss: -70209144.0000, Reward: -2095917.1699
    full cols: 456, non-full cols: 58
   r - labels: 328, labels - r: 171
    violated: 8573, weighted: 10877.302734375, len: 0.0, nonzero: 0.0959644466638565
Epoch 9900, Total loss: 62003032064.0000, CE loss: 24.9377, RL loss: 620030336.0000, Reward: -2077597.4961
    full cols: 458, non-full cols: 42
   r - labels: 318, labels - r: 175
    violated: 8281, weighted: 10896.1962890625, len: 0.0, nonzero: 0.09565164148807526
--- eval ---
prediction result:
f1 on test:    0.5301
f1 on test:    0.8933 (micro)
f1 on KB:      0.6512
integrated f1: 0.6065, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5252
f1 on test:    0.8930 (micro)
f1 on KB:      0.6561
integrated f1: 0.6070, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 10000, Total loss: 27587368960.0000, CE loss: 24.9372, RL loss: 275873696.0000, Reward: -2065382.1855
    full cols: 453, non-full cols: 54
   r - labels: 329, labels - r: 179
    violated: 8120, weighted: 10968.4326171875, len: 0.0, nonzero: 0.09508486092090607
Epoch 10100, Total loss: -85740191744.0000, CE loss: 24.9375, RL loss: -857401920.0000, Reward: -2091192.6562
    full cols: 451, non-full cols: 63
   r - labels: 331, labels - r: 174
    violated: 8549, weighted: 10917.1103515625, len: 0.0, nonzero: 0.09497646242380142
Epoch 10200, Total loss: 37789618176.0000, CE loss: 24.9369, RL loss: 377896192.0000, Reward: -2069871.3652
    full cols: 452, non-full cols: 50
   r - labels: 322, labels - r: 177
    violated: 8372, weighted: 10882.138671875, len: 0.0, nonzero: 0.09442827105522156
Epoch 10300, Total loss: 153691258880.0000, CE loss: 24.9366, RL loss: 1536912640.0000, Reward: -2044159.5430
    full cols: 445, non-full cols: 61
   r - labels: 326, labels - r: 177
    violated: 8420, weighted: 11023.30078125, len: 0.0, nonzero: 0.09393273293972015
Epoch 10400, Total loss: -65550196736.0000, CE loss: 24.9369, RL loss: -655501952.0000, Reward: -2082034.1465
    full cols: 451, non-full cols: 39
   r - labels: 313, labels - r: 180
    violated: 8597, weighted: 10943.076171875, len: 0.0, nonzero: 0.09326685220003128
Epoch 10500, Total loss: -88621834240.0000, CE loss: 24.9368, RL loss: -886218304.0000, Reward: -2127951.1738
    full cols: 460, non-full cols: 54
   r - labels: 331, labels - r: 174
    violated: 8993, weighted: 11125.0625, len: 0.0, nonzero: 0.09564854204654694
Epoch 10600, Total loss: 63766605824.0000, CE loss: 24.9365, RL loss: 637666048.0000, Reward: -2111170.7227
    full cols: 447, non-full cols: 72
   r - labels: 340, labels - r: 178
    violated: 8434, weighted: 11253.7470703125, len: 0.0, nonzero: 0.09529546648263931
Epoch 10700, Total loss: -31262140416.0000, CE loss: 24.9368, RL loss: -312621408.0000, Reward: -2108163.6328
    full cols: 460, non-full cols: 49
   r - labels: 331, labels - r: 179
    violated: 9186, weighted: 11342.8515625, len: 0.0, nonzero: 0.09606355428695679
Epoch 10800, Total loss: -117949251584.0000, CE loss: 24.9367, RL loss: -1179492480.0000, Reward: -2154505.3984
    full cols: 462, non-full cols: 54
   r - labels: 334, labels - r: 175
    violated: 8216, weighted: 11270.26171875, len: 0.0, nonzero: 0.09686261415481567
Epoch 10900, Total loss: -120695603200.0000, CE loss: 24.9364, RL loss: -1206956032.0000, Reward: -2158670.2305
    full cols: 434, non-full cols: 141
   r - labels: 384, labels - r: 166
    violated: 8551, weighted: 11300.671875, len: 0.0, nonzero: 0.09696482121944427
Epoch 11000, Total loss: -48186449920.0000, CE loss: 24.9365, RL loss: -481864512.0000, Reward: -2134481.2734
    full cols: 456, non-full cols: 62
   r - labels: 338, labels - r: 177
    violated: 8570, weighted: 11218.57421875, len: 0.0, nonzero: 0.09610071778297424
Epoch 11100, Total loss: -60930859008.0000, CE loss: 24.9368, RL loss: -609308608.0000, Reward: -2175413.5293
    full cols: 444, non-full cols: 73
   r - labels: 337, labels - r: 177
    violated: 8575, weighted: 11155.31640625, len: 0.0, nonzero: 0.09453357756137848
Epoch 11200, Total loss: -13097646080.0000, CE loss: 24.9369, RL loss: -130976456.0000, Reward: -2181883.6914
    full cols: 440, non-full cols: 81
   r - labels: 344, labels - r: 180
    violated: 8737, weighted: 11285.439453125, len: 0.0, nonzero: 0.09478134661912918
Epoch 11300, Total loss: -3920893696.0000, CE loss: 24.9372, RL loss: -39208936.0000, Reward: -2196502.7656
    full cols: 437, non-full cols: 87
   r - labels: 346, labels - r: 179
    violated: 8742, weighted: 11292.029296875, len: 0.0, nonzero: 0.094843290746212
Epoch 11400, Total loss: 162153775104.0000, CE loss: 24.9372, RL loss: 1621537792.0000, Reward: -2187469.5664
    full cols: 445, non-full cols: 72
   r - labels: 341, labels - r: 181
    violated: 9688, weighted: 11258.056640625, len: 0.0, nonzero: 0.09457384049892426
Epoch 11500, Total loss: 81566253056.0000, CE loss: 24.9373, RL loss: 815662528.0000, Reward: -2189970.1367
    full cols: 442, non-full cols: 72
   r - labels: 338, labels - r: 181
    violated: 8218, weighted: 11268.91015625, len: 0.0, nonzero: 0.09410617500543594
Epoch 11600, Total loss: -223079710720.0000, CE loss: 24.9374, RL loss: -2230797056.0000, Reward: -2262101.1758
    full cols: 425, non-full cols: 96
   r - labels: 344, labels - r: 180
    violated: 8640, weighted: 11240.4140625, len: 0.0, nonzero: 0.09341861307621002
Epoch 11700, Total loss: -86238543872.0000, CE loss: 24.9372, RL loss: -862385472.0000, Reward: -2238904.9238
    full cols: 389, non-full cols: 187
   r - labels: 390, labels - r: 171
    violated: 8570, weighted: 11219.9287109375, len: 0.0, nonzero: 0.09382743388414383
Epoch 11800, Total loss: -14135034880.0000, CE loss: 24.9367, RL loss: -141350352.0000, Reward: -2245396.2656
    full cols: 455, non-full cols: 69
   r - labels: 345, labels - r: 178
    violated: 8230, weighted: 11537.189453125, len: 0.0, nonzero: 0.0969245582818985
Epoch 11900, Total loss: 58412634112.0000, CE loss: 24.9364, RL loss: 584126336.0000, Reward: -2211278.0234
    full cols: 444, non-full cols: 69
   r - labels: 339, labels - r: 183
    violated: 8371, weighted: 11478.2734375, len: 0.0, nonzero: 0.0951777771115303
--- eval ---
prediction result:
f1 on test:    0.5301
f1 on test:    0.8933 (micro)
f1 on KB:      0.6512
integrated f1: 0.6065, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5246
f1 on test:    0.8929 (micro)
f1 on KB:      0.6561
integrated f1: 0.6068, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 12000, Total loss: 16315313152.0000, CE loss: 24.9366, RL loss: 163153136.0000, Reward: -2228121.9492
    full cols: 375, non-full cols: 249
   r - labels: 435, labels - r: 168
    violated: 8778, weighted: 11333.427734375, len: 0.0, nonzero: 0.09532953798770905
Epoch 12100, Total loss: -84433641472.0000, CE loss: 24.9362, RL loss: -844336384.0000, Reward: -2214030.4141
    full cols: 460, non-full cols: 51
   r - labels: 335, labels - r: 181
    violated: 8317, weighted: 11398.138671875, len: 0.0, nonzero: 0.09652502834796906
Epoch 12200, Total loss: -90493968384.0000, CE loss: 24.9363, RL loss: -904939648.0000, Reward: -2222692.9375
    full cols: 368, non-full cols: 250
   r - labels: 429, labels - r: 168
    violated: 8435, weighted: 11133.013671875, len: 0.0, nonzero: 0.09350842982530594
Epoch 12300, Total loss: -10117345280.0000, CE loss: 24.9358, RL loss: -101173456.0000, Reward: -2189966.7070
    full cols: 432, non-full cols: 71
   r - labels: 331, labels - r: 185
    violated: 8341, weighted: 11009.896484375, len: 0.0, nonzero: 0.09164085984230042
Epoch 12400, Total loss: 43893751808.0000, CE loss: 24.9360, RL loss: 438937536.0000, Reward: -2201504.5449
    full cols: 427, non-full cols: 78
   r - labels: 329, labels - r: 181
    violated: 8231, weighted: 11037.0068359375, len: 0.0, nonzero: 0.09177093952894211
Epoch 12500, Total loss: -42766954496.0000, CE loss: 24.9359, RL loss: -427669536.0000, Reward: -2232537.3301
    full cols: 433, non-full cols: 78
   r - labels: 335, labels - r: 181
    violated: 8987, weighted: 11165.630859375, len: 0.0, nonzero: 0.09372212737798691
Epoch 12600, Total loss: 25711675392.0000, CE loss: 24.9362, RL loss: 257116752.0000, Reward: -2220269.0840
    full cols: 436, non-full cols: 69
   r - labels: 333, labels - r: 185
    violated: 8379, weighted: 11159.16015625, len: 0.0, nonzero: 0.09314916282892227
Epoch 12700, Total loss: 29833216000.0000, CE loss: 24.9364, RL loss: 298332160.0000, Reward: -2221863.4668
    full cols: 376, non-full cols: 216
   r - labels: 409, labels - r: 174
    violated: 8737, weighted: 11056.12109375, len: 0.0, nonzero: 0.09208994358778
Epoch 12800, Total loss: -141720453120.0000, CE loss: 24.9361, RL loss: -1417204480.0000, Reward: -2234339.1523
    full cols: 428, non-full cols: 80
   r - labels: 335, labels - r: 184
    violated: 8316, weighted: 11049.19921875, len: 0.0, nonzero: 0.09217976033687592
Epoch 12900, Total loss: -40775839744.0000, CE loss: 24.9362, RL loss: -407758400.0000, Reward: -2230379.9219
    full cols: 429, non-full cols: 63
   r - labels: 319, labels - r: 184
    violated: 9036, weighted: 10989.380859375, len: 0.0, nonzero: 0.09122893959283829
Epoch 13000, Total loss: 26293508096.0000, CE loss: 24.9362, RL loss: 262935088.0000, Reward: -2232322.0918
    full cols: 428, non-full cols: 66
   r - labels: 324, labels - r: 187
    violated: 8971, weighted: 11079.7265625, len: 0.0, nonzero: 0.09122274816036224
Epoch 13100, Total loss: 105205030912.0000, CE loss: 24.9359, RL loss: 1052050304.0000, Reward: -2205242.6172
    full cols: 431, non-full cols: 66
   r - labels: 323, labels - r: 183
    violated: 9582, weighted: 10876.51171875, len: 0.0, nonzero: 0.09050111472606659
Epoch 13200, Total loss: -16194916352.0000, CE loss: 24.9357, RL loss: -161949168.0000, Reward: -2210424.4668
    full cols: 378, non-full cols: 211
   r - labels: 404, labels - r: 172
    violated: 8389, weighted: 11076.158203125, len: 0.0, nonzero: 0.09096258878707886
Epoch 13300, Total loss: -17072030720.0000, CE loss: 24.9351, RL loss: -170720304.0000, Reward: -2217575.5977
    full cols: 429, non-full cols: 70
   r - labels: 326, labels - r: 184
    violated: 7984, weighted: 11079.91015625, len: 0.0, nonzero: 0.09184836596250534
Epoch 13400, Total loss: 26073247744.0000, CE loss: 24.9351, RL loss: 260732480.0000, Reward: -2233059.4453
    full cols: 428, non-full cols: 63
   r - labels: 318, labels - r: 184
    violated: 8508, weighted: 10907.138671875, len: 0.0, nonzero: 0.09073959290981293
Epoch 13500, Total loss: -42907140096.0000, CE loss: 24.9350, RL loss: -429071392.0000, Reward: -2253965.0000
    full cols: 428, non-full cols: 60
   r - labels: 316, labels - r: 185
    violated: 8175, weighted: 10850.8662109375, len: 0.0, nonzero: 0.09025025367736816
Epoch 13600, Total loss: 100827037696.0000, CE loss: 24.9360, RL loss: 1008270336.0000, Reward: -2234000.8125
    full cols: 420, non-full cols: 75
   r - labels: 320, labels - r: 182
    violated: 8332, weighted: 10838.4296875, len: 0.0, nonzero: 0.08976709842681885
Epoch 13700, Total loss: -244386054144.0000, CE loss: 24.9353, RL loss: -2443860480.0000, Reward: -2274730.7969
    full cols: 422, non-full cols: 63
   r - labels: 315, labels - r: 187
    violated: 8114, weighted: 10926.9296875, len: 0.0, nonzero: 0.08971444517374039
Epoch 13800, Total loss: 105589219328.0000, CE loss: 24.9348, RL loss: 1055892224.0000, Reward: -2232650.1094
    full cols: 408, non-full cols: 87
   r - labels: 323, labels - r: 185
    violated: 8310, weighted: 10898.1796875, len: 0.0, nonzero: 0.08918793499469757
Epoch 13900, Total loss: -149715386368.0000, CE loss: 24.9352, RL loss: -1497153792.0000, Reward: -2259506.7969
    full cols: 421, non-full cols: 59
   r - labels: 312, labels - r: 189
    violated: 8304, weighted: 11019.2841796875, len: 0.0, nonzero: 0.0889153927564621
--- eval ---
prediction result:
f1 on test:    0.5301
f1 on test:    0.8933 (micro)
f1 on KB:      0.6512
integrated f1: 0.6065, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5260
f1 on test:    0.8931 (micro)
f1 on KB:      0.6561
integrated f1: 0.6074, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 14000, Total loss: 133748465664.0000, CE loss: 24.9349, RL loss: 1337484672.0000, Reward: -2224082.8105
    full cols: 427, non-full cols: 53
   r - labels: 313, labels - r: 190
    violated: 9525, weighted: 11025.87109375, len: 0.0, nonzero: 0.08925607055425644
Epoch 14100, Total loss: -185874415616.0000, CE loss: 24.9346, RL loss: -1858744192.0000, Reward: -2242312.1387
    full cols: 429, non-full cols: 53
   r - labels: 315, labels - r: 190
    violated: 8543, weighted: 11264.2578125, len: 0.0, nonzero: 0.09016662836074829
Epoch 14200, Total loss: -142139867136.0000, CE loss: 24.9342, RL loss: -1421398656.0000, Reward: -2207281.5410
    full cols: 379, non-full cols: 188
   r - labels: 393, labels - r: 183
    violated: 8977, weighted: 11522.345703125, len: 0.0, nonzero: 0.09163156896829605
Epoch 14300, Total loss: -26939949056.0000, CE loss: 24.9346, RL loss: -269399488.0000, Reward: -2174286.9414
    full cols: 433, non-full cols: 55
   r - labels: 323, labels - r: 192
    violated: 8828, weighted: 11387.546875, len: 0.0, nonzero: 0.09173377603292465
Epoch 14400, Total loss: -26387558400.0000, CE loss: 24.9347, RL loss: -263875584.0000, Reward: -2176124.7129
    full cols: 437, non-full cols: 41
   r - labels: 315, labels - r: 194
    violated: 8773, weighted: 11354.1484375, len: 0.0, nonzero: 0.09084179997444153
Epoch 14500, Total loss: -98933366784.0000, CE loss: 24.9343, RL loss: -989333632.0000, Reward: -2168871.6309
    full cols: 426, non-full cols: 86
   r - labels: 345, labels - r: 190
    violated: 9338, weighted: 11399.822265625, len: 0.0, nonzero: 0.09087587147951126
Epoch 14600, Total loss: -51661279232.0000, CE loss: 24.9341, RL loss: -516612800.0000, Reward: -2154023.5195
    full cols: 436, non-full cols: 67
   r - labels: 335, labels - r: 189
    violated: 9265, weighted: 11373.552734375, len: 0.0, nonzero: 0.0915665253996849
Epoch 14700, Total loss: -126359191552.0000, CE loss: 24.9338, RL loss: -1263591936.0000, Reward: -2157003.0137
    full cols: 445, non-full cols: 38
   r - labels: 316, labels - r: 190
    violated: 8745, weighted: 11324.748046875, len: 0.0, nonzero: 0.09140238165855408
Epoch 14800, Total loss: 14194980864.0000, CE loss: 24.9338, RL loss: 141949808.0000, Reward: -2132114.7402
    full cols: 443, non-full cols: 47
   r - labels: 322, labels - r: 189
    violated: 8738, weighted: 11394.79296875, len: 0.0, nonzero: 0.09281157702207565
Epoch 14900, Total loss: 13159512064.0000, CE loss: 24.9339, RL loss: 131595120.0000, Reward: -2133446.0938
    full cols: 439, non-full cols: 66
   r - labels: 331, labels - r: 183
    violated: 8163, weighted: 11349.107421875, len: 0.0, nonzero: 0.09304695576429367
Epoch 15000, Total loss: 44787109888.0000, CE loss: 24.9338, RL loss: 447871104.0000, Reward: -2122088.2129
    full cols: 443, non-full cols: 42
   r - labels: 314, labels - r: 186
    violated: 7940, weighted: 11264.3642578125, len: 0.0, nonzero: 0.09160678833723068
------ ABL Loop 1 ------
--- eval ---
prediction result:
f1 on test:    0.5301
f1 on test:    0.8933 (micro)
f1 on KB:      0.6512
f1 on orig KB: 0.3322
integrated f1: 0.3705, w_data: 0.3230, w_klg: 0.6770

integrated result:
f1 on test:    0.5244
f1 on test:    0.8928 (micro)
f1 on KB:      0.6556
f1 on orig KB: 0.3317
integrated f1: 0.3694, w_data: 0.3230, w_klg: 0.6770
------------
integrated f1 0.3705

KB before refine:
num_nodes: 5045.0000
num_edges: 4074.0000
density: 0.0002
avg_degree: 0.8075
avg_clustering: 0.0978
degree_assortativity: -0.3570
modularity: 0.6165
avg_betweenness: 0.0000
avg_closeness: 0.0022
Iteration 0: Loss = 1326299.125000
|Xk-Y|_F:  1326299.125000, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 1323903, f1 =  0.388798, approx slack: 4612348
rounded before pow |X_k-Y|_0 = 1323903, f1 =  0.388798

Iteration 20: Loss = 491333.500000
|Xk-Y|_F:  407495.687500, |X-X0|:  83837.812500
rounded |X_k-Y|_0 = 419766, f1 =  0.646312, approx slack: 254652
rounded before pow |X_k-Y|_0 = 595648, f1 =  0.614224

Iteration 40: Loss = 453699.812500
|Xk-Y|_F:  393153.406250, |X-X0|:  60546.421875
rounded |X_k-Y|_0 = 399277, f1 =  0.649692, approx slack: 135564
rounded before pow |X_k-Y|_0 = 420717, f1 =  0.645940

Iteration 60: Loss = 428612.875000
|Xk-Y|_F:  383213.750000, |X-X0|:  45399.109375
rounded |X_k-Y|_0 = 374528, f1 =  0.653651, approx slack: 116190
rounded before pow |X_k-Y|_0 = 423479, f1 =  0.645294

Iteration 80: Loss = 409649.343750
|Xk-Y|_F:  369528.625000, |X-X0|:  40120.718750
rounded |X_k-Y|_0 = 362788, f1 =  0.655471, approx slack: 114455
rounded before pow |X_k-Y|_0 = 427802, f1 =  0.644558

Iteration 100: Loss = 398879.812500
|Xk-Y|_F:  364263.968750, |X-X0|:  34615.835938
rounded |X_k-Y|_0 = 358234, f1 =  0.656180, approx slack: 116774
rounded before pow |X_k-Y|_0 = 432622, f1 =  0.643796

Iteration 120: Loss = 388690.562500
|Xk-Y|_F:  359669.750000, |X-X0|:  29020.800781
rounded |X_k-Y|_0 = 354818, f1 =  0.656712, approx slack: 109076
rounded before pow |X_k-Y|_0 = 428245, f1 =  0.644496

Iteration 140: Loss = 381652.437500
|Xk-Y|_F:  356380.937500, |X-X0|:  25271.515625
rounded |X_k-Y|_0 = 353661, f1 =  0.656896, approx slack: 107635
rounded before pow |X_k-Y|_0 = 428210, f1 =  0.644555

Iteration 160: Loss = 377070.656250
|Xk-Y|_F:  353617.218750, |X-X0|:  23453.429688
rounded |X_k-Y|_0 = 352845, f1 =  0.657025, approx slack: 107412
rounded before pow |X_k-Y|_0 = 427928, f1 =  0.644598

Iteration 180: Loss = 373064.500000
|Xk-Y|_F:  351219.375000, |X-X0|:  21845.128906
rounded |X_k-Y|_0 = 350840, f1 =  0.657341, approx slack: 106794
rounded before pow |X_k-Y|_0 = 426869, f1 =  0.644761

Iteration 200: Loss = 370413.281250
|Xk-Y|_F:  349561.406250, |X-X0|:  20851.878906
rounded |X_k-Y|_0 = 350120, f1 =  0.657463, approx slack: 105757
rounded before pow |X_k-Y|_0 = 426821, f1 =  0.644855

Iteration 220: Loss = 368513.500000
|Xk-Y|_F:  348371.000000, |X-X0|:  20142.509766
rounded |X_k-Y|_0 = 349465, f1 =  0.657604, approx slack: 103912
rounded before pow |X_k-Y|_0 = 426237, f1 =  0.645119

Iteration 240: Loss = 367007.937500
|Xk-Y|_F:  347474.781250, |X-X0|:  19533.144531
rounded |X_k-Y|_0 = 348892, f1 =  0.657700, approx slack: 104065
rounded before pow |X_k-Y|_0 = 426227, f1 =  0.645123

Iteration 260: Loss = 365752.000000
|Xk-Y|_F:  346747.812500, |X-X0|:  19004.173828
rounded |X_k-Y|_0 = 348582, f1 =  0.657751, approx slack: 102910
rounded before pow |X_k-Y|_0 = 424935, f1 =  0.645274

Iteration 280: Loss = 364655.125000
|Xk-Y|_F:  346126.031250, |X-X0|:  18529.109375
rounded |X_k-Y|_0 = 348327, f1 =  0.657803, approx slack: 103130
rounded before pow |X_k-Y|_0 = 424919, f1 =  0.645277

Iteration 300: Loss = 363684.031250
|Xk-Y|_F:  345578.000000, |X-X0|:  18106.031250
rounded |X_k-Y|_0 = 348089, f1 =  0.657846, approx slack: 105783
rounded before pow |X_k-Y|_0 = 427747, f1 =  0.644904

Iteration 320: Loss = 362788.218750
|Xk-Y|_F:  345085.468750, |X-X0|:  17702.759766
rounded |X_k-Y|_0 = 347626, f1 =  0.657920, approx slack: 105999
rounded before pow |X_k-Y|_0 = 427741, f1 =  0.644911

Iteration 340: Loss = 361929.812500
|Xk-Y|_F:  344635.562500, |X-X0|:  17294.238281
rounded |X_k-Y|_0 = 347260, f1 =  0.657979, approx slack: 106358
rounded before pow |X_k-Y|_0 = 427733, f1 =  0.644912

Iteration 360: Loss = 361121.156250
|Xk-Y|_F:  344227.937500, |X-X0|:  16893.230469
rounded |X_k-Y|_0 = 347094, f1 =  0.658006, approx slack: 106595
rounded before pow |X_k-Y|_0 = 427732, f1 =  0.644913

Iteration 380: Loss = 360372.062500
|Xk-Y|_F:  343854.093750, |X-X0|:  16517.966797
rounded |X_k-Y|_0 = 346642, f1 =  0.658092, approx slack: 109948
rounded before pow |X_k-Y|_0 = 430562, f1 =  0.644504

Iteration 400: Loss = 359684.500000
|Xk-Y|_F:  343508.312500, |X-X0|:  16176.195312
rounded |X_k-Y|_0 = 346229, f1 =  0.658162, approx slack: 104619
rounded before pow |X_k-Y|_0 = 425169, f1 =  0.645287

Iteration 420: Loss = 359038.187500
|Xk-Y|_F:  343184.437500, |X-X0|:  15853.737305
rounded |X_k-Y|_0 = 346013, f1 =  0.658197, approx slack: 104569
rounded before pow |X_k-Y|_0 = 425168, f1 =  0.645309

Iteration 440: Loss = 358467.531250
|Xk-Y|_F:  342883.437500, |X-X0|:  15584.079102
rounded |X_k-Y|_0 = 345751, f1 =  0.658239, approx slack: 104450
rounded before pow |X_k-Y|_0 = 425160, f1 =  0.645311

Iteration 460: Loss = 357976.562500
|Xk-Y|_F:  342599.437500, |X-X0|:  15377.129883
rounded |X_k-Y|_0 = 345572, f1 =  0.658268, approx slack: 104412
rounded before pow |X_k-Y|_0 = 425160, f1 =  0.645311

Iteration 480: Loss = 357526.343750
|Xk-Y|_F:  342335.125000, |X-X0|:  15191.226562
rounded |X_k-Y|_0 = 345357, f1 =  0.658306, approx slack: 101615
rounded before pow |X_k-Y|_0 = 422319, f1 =  0.645725

Iteration 500: Loss = 357087.375000
|Xk-Y|_F:  342087.468750, |X-X0|:  14999.917969
rounded |X_k-Y|_0 = 345207, f1 =  0.658330, approx slack: 106732
rounded before pow |X_k-Y|_0 = 427367, f1 =  0.644991

Iteration 520: Loss = 356678.593750
|Xk-Y|_F:  341853.968750, |X-X0|:  14824.613281
rounded |X_k-Y|_0 = 344991, f1 =  0.658366, approx slack: 106809
rounded before pow |X_k-Y|_0 = 427367, f1 =  0.644991

Iteration 540: Loss = 356298.375000
|Xk-Y|_F:  341633.031250, |X-X0|:  14665.335938
rounded |X_k-Y|_0 = 344809, f1 =  0.658395, approx slack: 106865
rounded before pow |X_k-Y|_0 = 427365, f1 =  0.644991

Iteration 560: Loss = 355932.906250
|Xk-Y|_F:  341423.031250, |X-X0|:  14509.888672
rounded |X_k-Y|_0 = 344578, f1 =  0.658432, approx slack: 107873
rounded before pow |X_k-Y|_0 = 428036, f1 =  0.644867

Iteration 580: Loss = 355588.031250
|Xk-Y|_F:  341224.562500, |X-X0|:  14363.483398
rounded |X_k-Y|_0 = 344321, f1 =  0.658474, approx slack: 108094
rounded before pow |X_k-Y|_0 = 428141, f1 =  0.644851

Iteration 600: Loss = 355235.937500
|Xk-Y|_F:  341031.250000, |X-X0|:  14204.701172
rounded |X_k-Y|_0 = 344108, f1 =  0.658508, approx slack: 108548
rounded before pow |X_k-Y|_0 = 427974, f1 =  0.644821

Iteration 620: Loss = 354903.031250
|Xk-Y|_F:  340840.656250, |X-X0|:  14062.385742
rounded |X_k-Y|_0 = 343863, f1 =  0.658547, approx slack: 108849
rounded before pow |X_k-Y|_0 = 427817, f1 =  0.644815

Iteration 640: Loss = 354603.093750
|Xk-Y|_F:  340661.531250, |X-X0|:  13941.569336
rounded |X_k-Y|_0 = 343770, f1 =  0.658561, approx slack: 108912
rounded before pow |X_k-Y|_0 = 427813, f1 =  0.644818

Iteration 660: Loss = 354306.250000
|Xk-Y|_F:  340489.281250, |X-X0|:  13816.964844
rounded |X_k-Y|_0 = 343608, f1 =  0.658587, approx slack: 108997
rounded before pow |X_k-Y|_0 = 427820, f1 =  0.644817

Iteration 680: Loss = 354020.750000
|Xk-Y|_F:  340328.093750, |X-X0|:  13692.654297
rounded |X_k-Y|_0 = 343490, f1 =  0.658606, approx slack: 109093
rounded before pow |X_k-Y|_0 = 427819, f1 =  0.644817

Converged at iteration 698

KB after refine:
num_nodes: 5045.0000
num_edges: 4067.0000
density: 0.0002
avg_degree: 0.8061
avg_clustering: 0.0979
degree_assortativity: -0.3566
modularity: 0.6233
avg_betweenness: 0.0000
avg_closeness: 0.0019
------ ABL 1 after refine ------
--- eval ---
prediction result:
f1 on test:    0.5301
f1 on test:    0.8933 (micro)
f1 on KB:      0.6563
f1 on orig KB: 0.3322
integrated f1: 0.3705, w_data: 0.3230, w_klg: 0.6770

integrated result:
f1 on test:    0.5246
f1 on test:    0.8928 (micro)
f1 on KB:      0.6601
f1 on orig KB: 0.3316
integrated f1: 0.3693, w_data: 0.3230, w_klg: 0.6770
------------
integrated f1 0.3705
