MLP_norman_Sep20_4
log/EGOAL-hsa-2025-09-20-20:55:01.820935.txt
random seed: 0
test perts: ["['FOXA3', 'FOXA1']", "['ETS2', 'IGDCC3']", "['BCORL1', 'ctrl']", "['CBL', 'ctrl']", "['ctrl', 'FEV']", "['RREB1', 'ctrl']", "['MIDN', 'ctrl']", "['CBFA2T3', 'ctrl']", "['IGDCC3', 'ZBTB25']", "['FOXO4', 'ctrl']", "['POU3F2', 'ctrl']", "['ctrl', 'CNN1']", "['CELF2', 'ctrl']", "['JUN', 'CEBPA']", "['ZBTB25', 'ctrl']", "['CDKN1A', 'ctrl']", "['ctrl', 'TBX2']", "['PTPN12', 'ctrl']", "['ctrl', 'MAP7D1']", "['MAPK1', 'ctrl']", "['TMSB4X', 'BAK1']", "['HOXB9', 'ctrl']", "['MAPK1', 'IKZF3']", "['LHX1', 'ELMSAN1']", "['CKS1B', 'ctrl']", "['ctrl', 'DLX2']", "['PTPN12', 'PTPN9']", "['KLF1', 'CEBPA']", "['FOXA3', 'HOXB9']", "['ctrl', 'ZBTB1']", "['ctrl', 'KIF2C']", "['ARID1A', 'ctrl']", "['ctrl', 'BAK1']", "['CBL', 'CNN1']", "['CBL', 'UBASH3B']", "['FOXF1', 'HOXB9']", "['UBASH3B', 'CNN1']", "['ctrl', 'SPI1']", "['CEBPB', 'MAPK1']", "['ATL1', 'ctrl']", "['CDKN1B', 'ctrl']", "['JUN', 'ctrl']", "['POU3F2', 'CBFA2T3']", "['FOXA1', 'HOXB9']", "['ctrl', 'MAPK1']", "['ETS2', 'IKZF3']", "['HOXA13', 'ctrl']", "['SAMD1', 'PTPN12']", "['FOSB', 'OSR2']", "['ctrl', 'OSR2']", "['ZBTB10', 'ELMSAN1']", "['PRDM1', 'CBFA2T3']", "['KIF18B', 'ctrl']", "['CDKN1C', 'CDKN1A']", "['PLK4', 'STIL']"]
train: torch.Size([73491, 5045])
unlabel: torch.Size([2854, 5045])
cuda availability: True
/home/u-xiangyf/anaconda3/envs/egoal/lib/python3.13/site-packages/torch/nn/modules/loss.py:608: UserWarning: Using a target size (torch.Size([5045])) that is different to the input size (torch.Size([5045, 5045])). This will likely lead to incorrect results due to broadcasting. Please ensure they have the same size.
  return F.mse_loss(input, target, reduction=self.reduction)
Epoch 0, Loss: 0.1390
Epoch 100, Loss: 0.1328
Epoch 200, Loss: 0.1268
Epoch 300, Loss: 0.1211
Epoch 400, Loss: 0.1156
Epoch 500, Loss: 0.1103
Epoch 600, Loss: 0.1052
Epoch 700, Loss: 0.1003
Epoch 800, Loss: 0.0956
Epoch 900, Loss: 0.0911
Final loss: 0.08684717863798141
Achieved outputs: tensor([[0.4019, 0.4238, 0.4490,  ..., 0.4155, 0.3809, 0.4171],
        [0.4012, 0.4233, 0.4483,  ..., 0.4150, 0.3801, 0.4168],
        [0.4017, 0.4234, 0.4487,  ..., 0.4151, 0.3805, 0.4168],
        ...,
        [0.4012, 0.4234, 0.4487,  ..., 0.4149, 0.3804, 0.4166],
        [0.4012, 0.4235, 0.4485,  ..., 0.4149, 0.3802, 0.4170],
        [0.4014, 0.4237, 0.4486,  ..., 0.4153, 0.3804, 0.4170]],
       device='cuda:3')
Eval weight w_data: 0.3265088886726568
Before pretrain: integrated f1 0.2606
Epoch 100, Total loss: 55318487040.0000, CE loss: 1097.2418, RL loss: 5531848704.0000, Reward: -290930792.1250
    full cols: 352, non-full cols: 2
   r - labels: 4, labels - r: 7
    violated: 137658, weighted: 2.3553004264831543, len: 0.0, nonzero: 0.07014061510562897
Epoch 200, Total loss: -52073959424.0000, CE loss: 970.1246, RL loss: -5207395840.0000, Reward: -291793435.9844
    full cols: 352, non-full cols: 2
   r - labels: 4, labels - r: 7
    violated: 136256, weighted: 2.3348681926727295, len: 0.0, nonzero: 0.07009415328502655
Epoch 300, Total loss: 78761279488.0000, CE loss: 895.9941, RL loss: 7876128256.0000, Reward: -290504698.6875
    full cols: 352, non-full cols: 2
   r - labels: 4, labels - r: 7
    violated: 130059, weighted: 2.3254034519195557, len: 0.0, nonzero: 0.07013751566410065
------ Before ABL ------
--- eval ---
prediction result:
f1 on test:    0.5838
f1 on test:    0.9105 (micro)
f1 on KB:      0.3033
f1 on orig KB: 0.3033
integrated f1: 0.3475, w_data: 0.3265, w_klg: 0.6735

integrated result:
f1 on test:    0.5379
f1 on test:    0.8942 (micro)
f1 on KB:      0.3830
f1 on orig KB: 0.3830
integrated f1: 0.4182, w_data: 0.3265, w_klg: 0.6735
------------
integrated f1 0.3475

Epoch 100, Total loss: -132320690176.0000, CE loss: 40.3491, RL loss: -1323206912.0000, Reward: -11116746.4062
    full cols: 353, non-full cols: 2
   r - labels: 3, labels - r: 5
    violated: 148295, weighted: 2.500276803970337, len: 0.0, nonzero: 0.07001672685146332
Epoch 200, Total loss: 12358712320.0000, CE loss: 39.4970, RL loss: 123587120.0000, Reward: -10658427.0938
    full cols: 351, non-full cols: 3
   r - labels: 4, labels - r: 7
    violated: 151531, weighted: 2.9626572132110596, len: 0.0, nonzero: 0.0697813481092453
Epoch 300, Total loss: 64904359936.0000, CE loss: 38.4146, RL loss: 649043584.0000, Reward: -9991949.0391
    full cols: 353, non-full cols: 0
   r - labels: 5, labels - r: 9
    violated: 144299, weighted: 6.186527252197266, len: 0.0, nonzero: 0.0699702724814415
Epoch 400, Total loss: 29979910144.0000, CE loss: 37.0536, RL loss: 299799104.0000, Reward: -8944454.4062
    full cols: 353, non-full cols: 1
   r - labels: 6, labels - r: 9
    violated: 153680, weighted: 7.000855445861816, len: 0.0, nonzero: 0.07016538828611374
Epoch 500, Total loss: 100063084544.0000, CE loss: 35.7420, RL loss: 1000630848.0000, Reward: -7876338.7500
    full cols: 355, non-full cols: 0
   r - labels: 8, labels - r: 10
    violated: 153203, weighted: 10.456668853759766, len: 0.0, nonzero: 0.07036670297384262
Epoch 600, Total loss: 42356453376.0000, CE loss: 34.6409, RL loss: 423564544.0000, Reward: -7027805.1406
    full cols: 354, non-full cols: 1
   r - labels: 8, labels - r: 10
    violated: 144433, weighted: 10.542303085327148, len: 0.0, nonzero: 0.07022113353013992
Epoch 700, Total loss: -9882336256.0000, CE loss: 33.5466, RL loss: -98823360.0000, Reward: -5970126.0000
    full cols: 354, non-full cols: 1
   r - labels: 8, labels - r: 10
    violated: 142512, weighted: 11.204363822937012, len: 0.0, nonzero: 0.07023662328720093
Epoch 800, Total loss: 181504966656.0000, CE loss: 32.9272, RL loss: 1815049600.0000, Reward: -5706619.9766
    full cols: 357, non-full cols: 0
   r - labels: 10, labels - r: 10
    violated: 143133, weighted: 70.39627075195312, len: 0.0, nonzero: 0.07076313346624374
Epoch 900, Total loss: 55639482368.0000, CE loss: 32.0368, RL loss: 556394816.0000, Reward: -4567938.6484
    full cols: 360, non-full cols: 0
   r - labels: 12, labels - r: 9
    violated: 150726, weighted: 41.74584197998047, len: 0.0, nonzero: 0.07135777920484543
Epoch 1000, Total loss: -39585423360.0000, CE loss: 31.5691, RL loss: -395854240.0000, Reward: -4241902.1406
    full cols: 356, non-full cols: 2
   r - labels: 11, labels - r: 10
    violated: 149940, weighted: 66.23623657226562, len: 0.0, nonzero: 0.07093657553195953
Epoch 1100, Total loss: -57206411264.0000, CE loss: 31.1409, RL loss: -572064128.0000, Reward: -3853120.6719
    full cols: 358, non-full cols: 0
   r - labels: 12, labels - r: 11
    violated: 146166, weighted: 69.77373504638672, len: 0.0, nonzero: 0.0709613487124443
Epoch 1200, Total loss: 179879624704.0000, CE loss: 30.6875, RL loss: 1798796288.0000, Reward: -3046963.2109
    full cols: 361, non-full cols: 1
   r - labels: 16, labels - r: 11
    violated: 148490, weighted: 148.27224731445312, len: 0.0, nonzero: 0.07175111770629883
Epoch 1300, Total loss: 47349452800.0000, CE loss: 30.3715, RL loss: 473494528.0000, Reward: -2537019.9336
    full cols: 360, non-full cols: 1
   r - labels: 16, labels - r: 12
    violated: 147865, weighted: 148.2390594482422, len: 0.0, nonzero: 0.07140424102544785
Epoch 1400, Total loss: 337272668160.0000, CE loss: 30.1658, RL loss: 3372726528.0000, Reward: -2431288.4609
    full cols: 365, non-full cols: 2
   r - labels: 21, labels - r: 11
    violated: 148705, weighted: 199.5198974609375, len: 0.0, nonzero: 0.0723581537604332
Epoch 1500, Total loss: -196195024896.0000, CE loss: 30.0005, RL loss: -1961950208.0000, Reward: -2646526.2656
    full cols: 372, non-full cols: 1
   r - labels: 27, labels - r: 11
    violated: 149306, weighted: 346.7928466796875, len: 0.0, nonzero: 0.0739160105586052
Epoch 1600, Total loss: -43941974016.0000, CE loss: 29.8141, RL loss: -439419744.0000, Reward: -2625438.7695
    full cols: 371, non-full cols: 1
   r - labels: 28, labels - r: 13
    violated: 147747, weighted: 410.26568603515625, len: 0.0, nonzero: 0.07366204261779785
Epoch 1700, Total loss: -211053117440.0000, CE loss: 29.6014, RL loss: -2110531200.0000, Reward: -2616746.6250
    full cols: 370, non-full cols: 3
   r - labels: 30, labels - r: 14
    violated: 154191, weighted: 402.25390625, len: 0.0, nonzero: 0.07360319793224335
Epoch 1800, Total loss: -244396081152.0000, CE loss: 29.3872, RL loss: -2443960832.0000, Reward: -2564772.9102
    full cols: 380, non-full cols: 1
   r - labels: 37, labels - r: 13
    violated: 148539, weighted: 522.385986328125, len: 0.0, nonzero: 0.07537785172462463
Epoch 1900, Total loss: -258287616000.0000, CE loss: 29.1595, RL loss: -2582876160.0000, Reward: -2544374.7305
    full cols: 374, non-full cols: 5
   r - labels: 35, labels - r: 13
    violated: 148331, weighted: 445.8634338378906, len: 0.0, nonzero: 0.07463144510984421
--- eval ---
prediction result:
f1 on test:    0.5579
f1 on test:    0.9082 (micro)
f1 on KB:      0.3255
integrated f1: 0.3635, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5353
f1 on test:    0.8920 (micro)
f1 on KB:      0.3874
integrated f1: 0.4184, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: -41067012096.0000, CE loss: 28.9331, RL loss: -410670112.0000, Reward: -2484999.3203
    full cols: 378, non-full cols: 3
   r - labels: 37, labels - r: 13
    violated: 152720, weighted: 602.4697875976562, len: 0.0, nonzero: 0.07529732584953308
Epoch 2100, Total loss: -69725085696.0000, CE loss: 28.6988, RL loss: -697250880.0000, Reward: -2458538.1992
    full cols: 380, non-full cols: 2
   r - labels: 40, labels - r: 15
    violated: 147161, weighted: 726.9674682617188, len: 0.0, nonzero: 0.07553890347480774
Epoch 2200, Total loss: -54088773632.0000, CE loss: 28.4697, RL loss: -540887744.0000, Reward: -2405738.0156
    full cols: 376, non-full cols: 2
   r - labels: 38, labels - r: 17
    violated: 141571, weighted: 696.385986328125, len: 0.0, nonzero: 0.07471506297588348
Epoch 2300, Total loss: 47131570176.0000, CE loss: 28.2121, RL loss: 471315712.0000, Reward: -2342351.7539
    full cols: 376, non-full cols: 1
   r - labels: 34, labels - r: 14
    violated: 141886, weighted: 612.4505615234375, len: 0.0, nonzero: 0.07460666447877884
Epoch 2400, Total loss: 59311915008.0000, CE loss: 28.0189, RL loss: 593119168.0000, Reward: -2321721.5332
    full cols: 382, non-full cols: 2
   r - labels: 42, labels - r: 15
    violated: 148730, weighted: 830.6666870117188, len: 0.0, nonzero: 0.07583622634410858
Epoch 2500, Total loss: -10929317888.0000, CE loss: 27.8144, RL loss: -109293176.0000, Reward: -2299748.8613
    full cols: 376, non-full cols: 4
   r - labels: 38, labels - r: 15
    violated: 151010, weighted: 747.8927001953125, len: 0.0, nonzero: 0.07511769235134125
Epoch 2600, Total loss: -172476858368.0000, CE loss: 27.6508, RL loss: -1724768640.0000, Reward: -2303595.1250
    full cols: 384, non-full cols: 2
   r - labels: 41, labels - r: 12
    violated: 151426, weighted: 847.238525390625, len: 0.0, nonzero: 0.07650210708379745
Epoch 2700, Total loss: -80597041152.0000, CE loss: 27.5155, RL loss: -805970432.0000, Reward: -2273992.4121
    full cols: 384, non-full cols: 3
   r - labels: 44, labels - r: 14
    violated: 146485, weighted: 858.9066772460938, len: 0.0, nonzero: 0.07616762071847916
Epoch 2800, Total loss: 100590182400.0000, CE loss: 27.4145, RL loss: 1005901824.0000, Reward: -2266330.1094
    full cols: 387, non-full cols: 1
   r - labels: 45, labels - r: 14
    violated: 150667, weighted: 948.909912109375, len: 0.0, nonzero: 0.07678394764661789
Epoch 2900, Total loss: 167068205056.0000, CE loss: 27.3416, RL loss: 1670681984.0000, Reward: -2278297.3203
    full cols: 383, non-full cols: 3
   r - labels: 45, labels - r: 16
    violated: 150227, weighted: 955.64208984375, len: 0.0, nonzero: 0.07630079239606857
Epoch 3000, Total loss: -202596597760.0000, CE loss: 27.2654, RL loss: -2025965952.0000, Reward: -2356396.9316
    full cols: 380, non-full cols: 2
   r - labels: 45, labels - r: 20
    violated: 147391, weighted: 1050.306884765625, len: 0.0, nonzero: 0.07554199546575546
Epoch 3100, Total loss: -166081953792.0000, CE loss: 27.2066, RL loss: -1660819584.0000, Reward: -2391568.6055
    full cols: 388, non-full cols: 1
   r - labels: 50, labels - r: 18
    violated: 147492, weighted: 1177.5020751953125, len: 0.0, nonzero: 0.076944999396801
Epoch 3200, Total loss: -22752458752.0000, CE loss: 27.1523, RL loss: -227524592.0000, Reward: -2413272.7617
    full cols: 388, non-full cols: 8
   r - labels: 61, labels - r: 22
    violated: 154039, weighted: 1310.0826416015625, len: 0.0, nonzero: 0.0778493583202362
Epoch 3300, Total loss: 65391976448.0000, CE loss: 27.1114, RL loss: 653919744.0000, Reward: -2412487.3027
    full cols: 402, non-full cols: 2
   r - labels: 69, labels - r: 22
    violated: 151164, weighted: 1542.466064453125, len: 0.0, nonzero: 0.07972311973571777
Epoch 3400, Total loss: 127356362752.0000, CE loss: 27.0634, RL loss: 1273563648.0000, Reward: -2434088.1914
    full cols: 398, non-full cols: 13
   r - labels: 76, labels - r: 22
    violated: 150707, weighted: 1545.158935546875, len: 0.0, nonzero: 0.08015671372413635
Epoch 3500, Total loss: 76966051840.0000, CE loss: 27.0395, RL loss: 769660544.0000, Reward: -2449588.0859
    full cols: 411, non-full cols: 5
   r - labels: 83, labels - r: 24
    violated: 145604, weighted: 1807.4793701171875, len: 0.0, nonzero: 0.08210480958223343
Epoch 3600, Total loss: 45924995072.0000, CE loss: 27.0249, RL loss: 459249952.0000, Reward: -2480729.3477
    full cols: 422, non-full cols: 7
   r - labels: 95, labels - r: 23
    violated: 141106, weighted: 2016.185791015625, len: 0.0, nonzero: 0.08437500149011612
Epoch 3700, Total loss: -53186220032.0000, CE loss: 27.0025, RL loss: -531862208.0000, Reward: -2539861.9766
    full cols: 418, non-full cols: 10
   r - labels: 96, labels - r: 25
    violated: 149379, weighted: 2108.73681640625, len: 0.0, nonzero: 0.08380203694105148
Epoch 3800, Total loss: -42119024640.0000, CE loss: 26.9876, RL loss: -421190240.0000, Reward: -2577226.7207
    full cols: 413, non-full cols: 13
   r - labels: 95, labels - r: 26
    violated: 146650, weighted: 2078.0498046875, len: 0.0, nonzero: 0.08357594162225723
Epoch 3900, Total loss: -153045893120.0000, CE loss: 26.9742, RL loss: -1530459008.0000, Reward: -2615658.1758
    full cols: 410, non-full cols: 21
   r - labels: 98, labels - r: 24
    violated: 140729, weighted: 2134.25927734375, len: 0.0, nonzero: 0.08369673043489456
--- eval ---
prediction result:
f1 on test:    0.5389
f1 on test:    0.8936 (micro)
f1 on KB:      0.3422
integrated f1: 0.3776, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5278
f1 on test:    0.8853 (micro)
f1 on KB:      0.3991
integrated f1: 0.4275, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: 79523799040.0000, CE loss: 26.9531, RL loss: 795238016.0000, Reward: -2598227.5820
    full cols: 409, non-full cols: 28
   r - labels: 101, labels - r: 21
    violated: 142835, weighted: 2125.917724609375, len: 0.0, nonzero: 0.08439358323812485
Epoch 4100, Total loss: 121172008960.0000, CE loss: 26.9290, RL loss: 1211720064.0000, Reward: -2588720.8086
    full cols: 419, non-full cols: 14
   r - labels: 98, labels - r: 22
    violated: 145050, weighted: 2148.18310546875, len: 0.0, nonzero: 0.084560826420784
Epoch 4200, Total loss: 27975628800.0000, CE loss: 26.9235, RL loss: 279756288.0000, Reward: -2624825.3535
    full cols: 422, non-full cols: 11
   r - labels: 101, labels - r: 25
    violated: 148355, weighted: 2171.329345703125, len: 0.0, nonzero: 0.084576316177845
Epoch 4300, Total loss: 113960304640.0000, CE loss: 26.9196, RL loss: 1139603072.0000, Reward: -2615179.7734
    full cols: 413, non-full cols: 21
   r - labels: 104, labels - r: 27
    violated: 132927, weighted: 2217.433349609375, len: 0.0, nonzero: 0.0841241329908371
Epoch 4400, Total loss: 61573169152.0000, CE loss: 26.9338, RL loss: 615731712.0000, Reward: -2679663.3945
    full cols: 413, non-full cols: 30
   r - labels: 111, labels - r: 25
    violated: 140816, weighted: 2371.662109375, len: 0.0, nonzero: 0.08497584611177444
Epoch 4500, Total loss: 73035251712.0000, CE loss: 26.9295, RL loss: 730352512.0000, Reward: -2684711.4336
    full cols: 422, non-full cols: 25
   r - labels: 115, labels - r: 25
    violated: 147398, weighted: 2432.479736328125, len: 0.0, nonzero: 0.08621779084205627
Epoch 4600, Total loss: -57863020544.0000, CE loss: 26.9066, RL loss: -578630208.0000, Reward: -2692517.9141
    full cols: 428, non-full cols: 28
   r - labels: 125, labels - r: 26
    violated: 147021, weighted: 2580.370849609375, len: 0.0, nonzero: 0.08700136840343475
Epoch 4700, Total loss: -7423351296.0000, CE loss: 26.9341, RL loss: -74233512.0000, Reward: -2738517.9023
    full cols: 413, non-full cols: 51
   r - labels: 131, labels - r: 24
    violated: 145117, weighted: 2604.26171875, len: 0.0, nonzero: 0.087196484208107
Epoch 4800, Total loss: 44408901632.0000, CE loss: 26.8848, RL loss: 444089024.0000, Reward: -2741531.9961
    full cols: 413, non-full cols: 42
   r - labels: 127, labels - r: 29
    violated: 145938, weighted: 2764.88623046875, len: 0.0, nonzero: 0.08656466752290726
Epoch 4900, Total loss: 68253278208.0000, CE loss: 26.8756, RL loss: 682532800.0000, Reward: -2717071.5859
    full cols: 414, non-full cols: 44
   r - labels: 133, labels - r: 32
    violated: 148948, weighted: 2813.869140625, len: 0.0, nonzero: 0.0863819420337677
Epoch 5000, Total loss: -46985105408.0000, CE loss: 26.8596, RL loss: -469851072.0000, Reward: -2754393.6562
    full cols: 429, non-full cols: 27
   r - labels: 131, labels - r: 32
    violated: 145436, weighted: 2996.5361328125, len: 0.0, nonzero: 0.0879552811384201
Epoch 5100, Total loss: 96918249472.0000, CE loss: 26.8832, RL loss: 969182464.0000, Reward: -2757216.7305
    full cols: 421, non-full cols: 40
   r - labels: 137, labels - r: 33
    violated: 141611, weighted: 3025.78076171875, len: 0.0, nonzero: 0.08752787858247757
Epoch 5200, Total loss: -119353024512.0000, CE loss: 26.8180, RL loss: -1193530240.0000, Reward: -2746876.5430
    full cols: 430, non-full cols: 36
   r - labels: 142, labels - r: 33
    violated: 143337, weighted: 3071.162841796875, len: 0.0, nonzero: 0.08857470750808716
Epoch 5300, Total loss: -53157425152.0000, CE loss: 26.8311, RL loss: -531574240.0000, Reward: -2743716.8164
    full cols: 428, non-full cols: 36
   r - labels: 141, labels - r: 34
    violated: 138851, weighted: 3025.43505859375, len: 0.0, nonzero: 0.0874442532658577
Epoch 5400, Total loss: 73855721472.0000, CE loss: 26.8007, RL loss: 738557248.0000, Reward: -2723422.5781
    full cols: 433, non-full cols: 27
   r - labels: 140, labels - r: 37
    violated: 147875, weighted: 3207.252197265625, len: 0.0, nonzero: 0.08838887512683868
Epoch 5500, Total loss: -51475169280.0000, CE loss: 26.7919, RL loss: -514751712.0000, Reward: -2747610.7695
    full cols: 432, non-full cols: 35
   r - labels: 144, labels - r: 34
    violated: 146816, weighted: 3374.46875, len: 0.0, nonzero: 0.08908882737159729
Epoch 5600, Total loss: -44934668288.0000, CE loss: 26.7748, RL loss: -449346688.0000, Reward: -2758538.0000
    full cols: 426, non-full cols: 35
   r - labels: 146, labels - r: 42
    violated: 146269, weighted: 3461.4423828125, len: 0.0, nonzero: 0.08806058019399643
Epoch 5700, Total loss: 145537171456.0000, CE loss: 26.7838, RL loss: 1455371776.0000, Reward: -2752140.3477
    full cols: 417, non-full cols: 51
   r - labels: 147, labels - r: 36
    violated: 138722, weighted: 3426.92578125, len: 0.0, nonzero: 0.08829905837774277
Epoch 5800, Total loss: 114247319552.0000, CE loss: 26.7782, RL loss: 1142473216.0000, Reward: -2757665.3203
    full cols: 434, non-full cols: 25
   r - labels: 141, labels - r: 39
    violated: 146930, weighted: 3412.326171875, len: 0.0, nonzero: 0.08800793439149857
Epoch 5900, Total loss: -107806310400.0000, CE loss: 26.8169, RL loss: -1078063104.0000, Reward: -2838701.8242
    full cols: 431, non-full cols: 42
   r - labels: 158, labels - r: 42
    violated: 142725, weighted: 3630.5419921875, len: 0.0, nonzero: 0.08971444517374039
--- eval ---
prediction result:
f1 on test:    0.5395
f1 on test:    0.8937 (micro)
f1 on KB:      0.3421
integrated f1: 0.3776, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5210
f1 on test:    0.8796 (micro)
f1 on KB:      0.4076
integrated f1: 0.4336, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: 56842285056.0000, CE loss: 26.8075, RL loss: 568422848.0000, Reward: -2799481.9688
    full cols: 428, non-full cols: 59
   r - labels: 176, labels - r: 46
    violated: 148527, weighted: 3922.919921875, len: 0.0, nonzero: 0.08977019786834717
Epoch 6100, Total loss: -142336376832.0000, CE loss: 26.7881, RL loss: -1423363840.0000, Reward: -2813027.9570
    full cols: 441, non-full cols: 40
   r - labels: 169, labels - r: 45
    violated: 140532, weighted: 3890.71728515625, len: 0.0, nonzero: 0.09035555273294449
Epoch 6200, Total loss: 44593950720.0000, CE loss: 26.8135, RL loss: 445939488.0000, Reward: -2820588.3984
    full cols: 433, non-full cols: 75
   r - labels: 194, labels - r: 43
    violated: 151753, weighted: 4110.671875, len: 0.0, nonzero: 0.09239345788955688
Epoch 6300, Total loss: 3618199296.0000, CE loss: 26.7768, RL loss: 36181992.0000, Reward: -2844771.5508
    full cols: 426, non-full cols: 74
   r - labels: 190, labels - r: 47
    violated: 143254, weighted: 4247.8896484375, len: 0.0, nonzero: 0.09231603145599365
Epoch 6400, Total loss: -8991250432.0000, CE loss: 26.7760, RL loss: -89912504.0000, Reward: -2867916.3867
    full cols: 439, non-full cols: 67
   r - labels: 200, labels - r: 51
    violated: 141288, weighted: 4452.130859375, len: 0.0, nonzero: 0.09330091625452042
Epoch 6500, Total loss: -131516186624.0000, CE loss: 26.8043, RL loss: -1315161856.0000, Reward: -2905234.6602
    full cols: 428, non-full cols: 83
   r - labels: 206, labels - r: 52
    violated: 138945, weighted: 4474.3388671875, len: 0.0, nonzero: 0.09265052527189255
Epoch 6600, Total loss: -4385489920.0000, CE loss: 26.7874, RL loss: -43854900.0000, Reward: -2871288.0195
    full cols: 439, non-full cols: 70
   r - labels: 204, labels - r: 52
    violated: 145976, weighted: 4568.69921875, len: 0.0, nonzero: 0.09329162538051605
Epoch 6700, Total loss: -48588058624.0000, CE loss: 26.7757, RL loss: -485880576.0000, Reward: -2881946.9805
    full cols: 438, non-full cols: 71
   r - labels: 201, labels - r: 49
    violated: 137770, weighted: 4610.92919921875, len: 0.0, nonzero: 0.09413714706897736
Epoch 6800, Total loss: 656484096.0000, CE loss: 26.7659, RL loss: 6564841.0000, Reward: -2880925.1172
    full cols: 443, non-full cols: 64
   r - labels: 202, labels - r: 52
    violated: 140438, weighted: 4537.654296875, len: 0.0, nonzero: 0.09333808720111847
Epoch 6900, Total loss: -98308169728.0000, CE loss: 26.7648, RL loss: -983081664.0000, Reward: -2888759.4453
    full cols: 436, non-full cols: 75
   r - labels: 203, labels - r: 49
    violated: 143674, weighted: 4543.04296875, len: 0.0, nonzero: 0.09333498775959015
Epoch 7000, Total loss: 72985968640.0000, CE loss: 26.7804, RL loss: 729859648.0000, Reward: -2874348.6875
    full cols: 443, non-full cols: 61
   r - labels: 201, labels - r: 54
    violated: 148199, weighted: 4643.376953125, len: 0.0, nonzero: 0.09324517101049423
Epoch 7100, Total loss: -61901164544.0000, CE loss: 26.7556, RL loss: -619011648.0000, Reward: -2893453.7109
    full cols: 436, non-full cols: 96
   r - labels: 228, labels - r: 53
    violated: 146259, weighted: 4938.3984375, len: 0.0, nonzero: 0.0952644944190979
Epoch 7200, Total loss: -56921395200.0000, CE loss: 26.7290, RL loss: -569213952.0000, Reward: -2875327.3984
    full cols: 433, non-full cols: 90
   r - labels: 222, labels - r: 56
    violated: 139328, weighted: 4982.103515625, len: 0.0, nonzero: 0.09450260549783707
Epoch 7300, Total loss: -135834984448.0000, CE loss: 26.7241, RL loss: -1358349824.0000, Reward: -2892782.5156
    full cols: 443, non-full cols: 66
   r - labels: 213, labels - r: 61
    violated: 140986, weighted: 4898.17919921875, len: 0.0, nonzero: 0.09415572881698608
Epoch 7400, Total loss: 66810892288.0000, CE loss: 26.7383, RL loss: 668108928.0000, Reward: -2883417.8906
    full cols: 432, non-full cols: 111
   r - labels: 239, labels - r: 53
    violated: 141481, weighted: 5033.56982421875, len: 0.0, nonzero: 0.09623079746961594
Epoch 7500, Total loss: -76412403712.0000, CE loss: 26.7447, RL loss: -764124032.0000, Reward: -2889189.3359
    full cols: 444, non-full cols: 57
   r - labels: 211, labels - r: 67
    violated: 145632, weighted: 5156.82763671875, len: 0.0, nonzero: 0.09368186444044113
Epoch 7600, Total loss: 51591520256.0000, CE loss: 26.7212, RL loss: 515915200.0000, Reward: -2869051.2695
    full cols: 456, non-full cols: 47
   r - labels: 211, labels - r: 65
    violated: 136962, weighted: 5192.4228515625, len: 0.0, nonzero: 0.09472250193357468
Epoch 7700, Total loss: -31177900032.0000, CE loss: 26.7314, RL loss: -311779008.0000, Reward: -2899367.2422
    full cols: 416, non-full cols: 137
   r - labels: 255, labels - r: 59
    violated: 148704, weighted: 5230.5732421875, len: 0.0, nonzero: 0.09392963349819183
Epoch 7800, Total loss: 31596064768.0000, CE loss: 26.7034, RL loss: 315960640.0000, Reward: -2864928.9180
    full cols: 448, non-full cols: 53
   r - labels: 213, labels - r: 69
    violated: 144911, weighted: 5351.2802734375, len: 0.0, nonzero: 0.09339073300361633
Epoch 7900, Total loss: -67524030464.0000, CE loss: 26.7035, RL loss: -675240320.0000, Reward: -2870773.3125
    full cols: 440, non-full cols: 64
   r - labels: 214, labels - r: 67
    violated: 143538, weighted: 5279.666015625, len: 0.0, nonzero: 0.09362301975488663
--- eval ---
prediction result:
f1 on test:    0.5390
f1 on test:    0.8936 (micro)
f1 on KB:      0.3426
integrated f1: 0.3781, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5177
f1 on test:    0.8758 (micro)
f1 on KB:      0.4136
integrated f1: 0.4380, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: 39692996608.0000, CE loss: 26.7012, RL loss: 396929984.0000, Reward: -2883092.4805
    full cols: 452, non-full cols: 68
   r - labels: 227, labels - r: 64
    violated: 142987, weighted: 5291.142578125, len: 0.0, nonzero: 0.09527378529310226
Epoch 8100, Total loss: -102322249728.0000, CE loss: 26.6970, RL loss: -1023222464.0000, Reward: -2897136.5117
    full cols: 451, non-full cols: 71
   r - labels: 231, labels - r: 66
    violated: 139989, weighted: 5331.0009765625, len: 0.0, nonzero: 0.09542864561080933
Epoch 8200, Total loss: 59931705344.0000, CE loss: 26.6877, RL loss: 599317056.0000, Reward: -2881431.3418
    full cols: 452, non-full cols: 46
   r - labels: 212, labels - r: 71
    violated: 140387, weighted: 5383.46533203125, len: 0.0, nonzero: 0.09433845430612564
Epoch 8300, Total loss: -18538608640.0000, CE loss: 26.6949, RL loss: -185386080.0000, Reward: -2888084.3438
    full cols: 451, non-full cols: 55
   r - labels: 218, labels - r: 69
    violated: 138817, weighted: 5347.8359375, len: 0.0, nonzero: 0.09507247805595398
Epoch 8400, Total loss: 73937739776.0000, CE loss: 26.6609, RL loss: 739377408.0000, Reward: -2854134.7773
    full cols: 447, non-full cols: 57
   r - labels: 220, labels - r: 73
    violated: 138878, weighted: 5658.6630859375, len: 0.0, nonzero: 0.09405971318483353
Epoch 8500, Total loss: -37588369408.0000, CE loss: 26.6669, RL loss: -375883712.0000, Reward: -2883413.1328
    full cols: 433, non-full cols: 94
   r - labels: 238, labels - r: 68
    violated: 139747, weighted: 5402.0927734375, len: 0.0, nonzero: 0.09291377663612366
Epoch 8600, Total loss: -57391116288.0000, CE loss: 26.6848, RL loss: -573911168.0000, Reward: -2887058.4961
    full cols: 449, non-full cols: 46
   r - labels: 212, labels - r: 74
    violated: 141673, weighted: 5276.447265625, len: 0.0, nonzero: 0.09282086789608002
Epoch 8700, Total loss: 7140872192.0000, CE loss: 26.6668, RL loss: 71408720.0000, Reward: -2884809.4648
    full cols: 430, non-full cols: 88
   r - labels: 232, labels - r: 71
    violated: 145256, weighted: 5261.0068359375, len: 0.0, nonzero: 0.09245540201663971
Epoch 8800, Total loss: -141521403904.0000, CE loss: 26.6687, RL loss: -1415214080.0000, Reward: -2883688.0742
    full cols: 436, non-full cols: 74
   r - labels: 226, labels - r: 73
    violated: 146332, weighted: 5421.76611328125, len: 0.0, nonzero: 0.09307172894477844
Epoch 8900, Total loss: -116380557312.0000, CE loss: 26.6666, RL loss: -1163805568.0000, Reward: -2880280.0156
    full cols: 442, non-full cols: 66
   r - labels: 225, labels - r: 74
    violated: 144105, weighted: 5521.8720703125, len: 0.0, nonzero: 0.09443137049674988
Epoch 9000, Total loss: -93696163840.0000, CE loss: 26.6703, RL loss: -936961600.0000, Reward: -2909777.2539
    full cols: 407, non-full cols: 173
   r - labels: 285, labels - r: 62
    violated: 145785, weighted: 5654.0126953125, len: 0.0, nonzero: 0.0944344699382782
Epoch 9100, Total loss: -61497114624.0000, CE loss: 26.6572, RL loss: -614971136.0000, Reward: -2905160.8281
    full cols: 438, non-full cols: 88
   r - labels: 239, labels - r: 70
    violated: 140597, weighted: 5700.00439453125, len: 0.0, nonzero: 0.0952799841761589
Epoch 9200, Total loss: -2230710272.0000, CE loss: 26.6653, RL loss: -22307102.0000, Reward: -2885167.3477
    full cols: 425, non-full cols: 114
   r - labels: 254, labels - r: 72
    violated: 146497, weighted: 5713.744140625, len: 0.0, nonzero: 0.09453047811985016
Epoch 9300, Total loss: -9327237120.0000, CE loss: 26.6576, RL loss: -93272376.0000, Reward: -2911928.2305
    full cols: 445, non-full cols: 72
   r - labels: 236, labels - r: 76
    violated: 147519, weighted: 6050.8076171875, len: 0.0, nonzero: 0.09585294872522354
Epoch 9400, Total loss: -1366992768.0000, CE loss: 26.6539, RL loss: -13669928.0000, Reward: -2908219.2949
    full cols: 443, non-full cols: 65
   r - labels: 227, labels - r: 76
    violated: 147436, weighted: 5924.88818359375, len: 0.0, nonzero: 0.09470082074403763
Epoch 9500, Total loss: 67843674112.0000, CE loss: 26.6612, RL loss: 678436736.0000, Reward: -2908725.6367
    full cols: 446, non-full cols: 65
   r - labels: 234, labels - r: 80
    violated: 139945, weighted: 6177.607421875, len: 0.0, nonzero: 0.09547200798988342
Epoch 9600, Total loss: -24531884032.0000, CE loss: 26.6458, RL loss: -245318848.0000, Reward: -2906371.6641
    full cols: 425, non-full cols: 118
   r - labels: 264, labels - r: 78
    violated: 133710, weighted: 6278.7978515625, len: 0.0, nonzero: 0.09513441473245621
Epoch 9700, Total loss: 32660359168.0000, CE loss: 26.6451, RL loss: 326603584.0000, Reward: -2907252.9805
    full cols: 444, non-full cols: 73
   r - labels: 242, labels - r: 82
    violated: 140900, weighted: 6205.74560546875, len: 0.0, nonzero: 0.09360133856534958
Epoch 9800, Total loss: -89099714560.0000, CE loss: 26.6603, RL loss: -890997120.0000, Reward: -2935885.9609
    full cols: 438, non-full cols: 84
   r - labels: 250, labels - r: 85
    violated: 147134, weighted: 6342.7294921875, len: 0.0, nonzero: 0.09456764161586761
Epoch 9900, Total loss: 87092346880.0000, CE loss: 26.6445, RL loss: 870923456.0000, Reward: -2924715.5742
    full cols: 421, non-full cols: 141
   r - labels: 283, labels - r: 78
    violated: 146531, weighted: 6489.4287109375, len: 0.0, nonzero: 0.09516848623752594
--- eval ---
prediction result:
f1 on test:    0.5394
f1 on test:    0.8937 (micro)
f1 on KB:      0.3424
integrated f1: 0.3779, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5171
f1 on test:    0.8750 (micro)
f1 on KB:      0.4142
integrated f1: 0.4384, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 10000, Total loss: -20652345344.0000, CE loss: 26.6437, RL loss: -206523456.0000, Reward: -2924438.5469
    full cols: 440, non-full cols: 84
   r - labels: 256, labels - r: 89
    violated: 144887, weighted: 6561.90234375, len: 0.0, nonzero: 0.09528927505016327
Epoch 10100, Total loss: -130627518464.0000, CE loss: 26.6402, RL loss: -1306275200.0000, Reward: -2909329.5820
    full cols: 458, non-full cols: 40
   r - labels: 236, labels - r: 95
    violated: 133888, weighted: 6563.9990234375, len: 0.0, nonzero: 0.0950600877404213
Epoch 10200, Total loss: -5615232000.0000, CE loss: 26.6378, RL loss: -56152320.0000, Reward: -2891477.5039
    full cols: 451, non-full cols: 46
   r - labels: 238, labels - r: 98
    violated: 141905, weighted: 6792.26904296875, len: 0.0, nonzero: 0.09448711574077606
Epoch 10300, Total loss: -45838315520.0000, CE loss: 26.6427, RL loss: -458383136.0000, Reward: -2887125.5391
    full cols: 451, non-full cols: 54
   r - labels: 243, labels - r: 95
    violated: 142702, weighted: 6759.09375, len: 0.0, nonzero: 0.09519945830106735
Epoch 10400, Total loss: 61552734208.0000, CE loss: 26.6323, RL loss: 615527360.0000, Reward: -2902828.1250
    full cols: 412, non-full cols: 141
   r - labels: 288, labels - r: 92
    violated: 145124, weighted: 6725.09521484375, len: 0.0, nonzero: 0.09356417506933212
Epoch 10500, Total loss: 20590680064.0000, CE loss: 26.6535, RL loss: 205906800.0000, Reward: -2909343.5352
    full cols: 441, non-full cols: 53
   r - labels: 242, labels - r: 105
    violated: 148183, weighted: 6873.54248046875, len: 0.0, nonzero: 0.09323897957801819
Epoch 10600, Total loss: 38358188032.0000, CE loss: 26.6436, RL loss: 383581888.0000, Reward: -2902389.4727
    full cols: 440, non-full cols: 55
   r - labels: 239, labels - r: 101
    violated: 144097, weighted: 6870.4853515625, len: 0.0, nonzero: 0.09293855726718903
Epoch 10700, Total loss: -114194530304.0000, CE loss: 26.6604, RL loss: -1141945344.0000, Reward: -2950774.0117
    full cols: 456, non-full cols: 55
   r - labels: 250, labels - r: 96
    violated: 148582, weighted: 6943.10546875, len: 0.0, nonzero: 0.09500124305486679
Epoch 10800, Total loss: -3709587968.0000, CE loss: 26.6306, RL loss: -37095880.0000, Reward: -2917793.5781
    full cols: 461, non-full cols: 51
   r - labels: 256, labels - r: 101
    violated: 127472, weighted: 7232.09228515625, len: 0.0, nonzero: 0.09649715572595596
Epoch 10900, Total loss: 133949054976.0000, CE loss: 26.6326, RL loss: 1339490560.0000, Reward: -2879064.4258
    full cols: 452, non-full cols: 66
   r - labels: 262, labels - r: 101
    violated: 143341, weighted: 7371.1923828125, len: 0.0, nonzero: 0.09733027964830399
Epoch 11000, Total loss: -5788014080.0000, CE loss: 26.6247, RL loss: -57880140.0000, Reward: -2852688.0508
    full cols: 437, non-full cols: 106
   r - labels: 283, labels - r: 97
    violated: 140556, weighted: 7303.9990234375, len: 0.0, nonzero: 0.096967913210392
Epoch 11100, Total loss: 139964284928.0000, CE loss: 26.6291, RL loss: 1399642880.0000, Reward: -2826287.4570
    full cols: 471, non-full cols: 40
   r - labels: 257, labels - r: 103
    violated: 138502, weighted: 7413.9609375, len: 0.0, nonzero: 0.0970856100320816
Epoch 11200, Total loss: 70886285312.0000, CE loss: 26.6126, RL loss: 708862848.0000, Reward: -2825219.8086
    full cols: 472, non-full cols: 33
   r - labels: 253, labels - r: 105
    violated: 144624, weighted: 7467.79248046875, len: 0.0, nonzero: 0.09668917208909988
Epoch 11300, Total loss: 70632456.0000, CE loss: 26.6287, RL loss: 706324.5625, Reward: -2798656.7852
    full cols: 465, non-full cols: 45
   r - labels: 256, labels - r: 103
    violated: 142355, weighted: 7482.5224609375, len: 0.0, nonzero: 0.09678827971220016
Epoch 11400, Total loss: -6716828672.0000, CE loss: 26.6148, RL loss: -67168288.0000, Reward: -2801845.9258
    full cols: 470, non-full cols: 30
   r - labels: 250, labels - r: 107
    violated: 133749, weighted: 7478.40673828125, len: 0.0, nonzero: 0.09601090103387833
Epoch 11500, Total loss: -56494538752.0000, CE loss: 26.6089, RL loss: -564945408.0000, Reward: -2794616.8125
    full cols: 475, non-full cols: 23
   r - labels: 248, labels - r: 107
    violated: 144431, weighted: 7338.4228515625, len: 0.0, nonzero: 0.09616886079311371
Epoch 11600, Total loss: 7194756608.0000, CE loss: 26.6332, RL loss: 71947568.0000, Reward: -2766246.0352
    full cols: 466, non-full cols: 32
   r - labels: 251, labels - r: 110
    violated: 143492, weighted: 7357.10546875, len: 0.0, nonzero: 0.09500433504581451
Epoch 11700, Total loss: 66618470400.0000, CE loss: 26.6211, RL loss: 666184704.0000, Reward: -2746840.8789
    full cols: 467, non-full cols: 36
   r - labels: 256, labels - r: 110
    violated: 139020, weighted: 7452.52685546875, len: 0.0, nonzero: 0.09621531516313553
Epoch 11800, Total loss: 57645228032.0000, CE loss: 26.6153, RL loss: 576452288.0000, Reward: -2739947.0352
    full cols: 472, non-full cols: 27
   r - labels: 252, labels - r: 110
    violated: 137490, weighted: 7303.84521484375, len: 0.0, nonzero: 0.09616576135158539
Epoch 11900, Total loss: -6921235968.0000, CE loss: 26.6203, RL loss: -69212360.0000, Reward: -2694068.4453
    full cols: 477, non-full cols: 23
   r - labels: 251, labels - r: 108
    violated: 134791, weighted: 7372.93115234375, len: 0.0, nonzero: 0.0965900644659996
--- eval ---
prediction result:
f1 on test:    0.5392
f1 on test:    0.8937 (micro)
f1 on KB:      0.3423
integrated f1: 0.3778, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5161
f1 on test:    0.8725 (micro)
f1 on KB:      0.4171
integrated f1: 0.4407, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 12000, Total loss: -6840109056.0000, CE loss: 26.6057, RL loss: -68401088.0000, Reward: -2679718.9180
    full cols: 480, non-full cols: 24
   r - labels: 258, labels - r: 111
    violated: 135065, weighted: 7566.46826171875, len: 0.0, nonzero: 0.09772671014070511
Epoch 12100, Total loss: 37125853184.0000, CE loss: 26.6176, RL loss: 371258528.0000, Reward: -2630721.9941
    full cols: 480, non-full cols: 36
   r - labels: 272, labels - r: 113
    violated: 138224, weighted: 7792.09619140625, len: 0.0, nonzero: 0.09863726794719696
Epoch 12200, Total loss: -62191775744.0000, CE loss: 26.6175, RL loss: -621917760.0000, Reward: -2624976.3047
    full cols: 480, non-full cols: 23
   r - labels: 261, labels - r: 115
    violated: 139780, weighted: 7678.0634765625, len: 0.0, nonzero: 0.0965312197804451
Epoch 12300, Total loss: 15684974592.0000, CE loss: 26.6033, RL loss: 156849744.0000, Reward: -2565130.3555
    full cols: 481, non-full cols: 19
   r - labels: 260, labels - r: 117
    violated: 143608, weighted: 7857.0390625, len: 0.0, nonzero: 0.09754398465156555
Epoch 12400, Total loss: 53708324864.0000, CE loss: 26.6100, RL loss: 537083264.0000, Reward: -2564404.9531
    full cols: 478, non-full cols: 18
   r - labels: 261, labels - r: 122
    violated: 143442, weighted: 7876.640625, len: 0.0, nonzero: 0.0967789888381958
Epoch 12500, Total loss: 42455543808.0000, CE loss: 26.6093, RL loss: 424555424.0000, Reward: -2544813.6445
    full cols: 477, non-full cols: 17
   r - labels: 259, labels - r: 122
    violated: 144408, weighted: 7966.669921875, len: 0.0, nonzero: 0.09658697247505188
Epoch 12600, Total loss: 140121620480.0000, CE loss: 26.6112, RL loss: 1401216256.0000, Reward: -2516397.0664
    full cols: 473, non-full cols: 15
   r - labels: 253, labels - r: 122
    violated: 140119, weighted: 7768.8193359375, len: 0.0, nonzero: 0.09533572942018509
Epoch 12700, Total loss: 61971820544.0000, CE loss: 26.6167, RL loss: 619718208.0000, Reward: -2490880.1523
    full cols: 472, non-full cols: 22
   r - labels: 258, labels - r: 121
    violated: 137252, weighted: 7873.76171875, len: 0.0, nonzero: 0.09587772935628891
Epoch 12800, Total loss: 123198185472.0000, CE loss: 26.6091, RL loss: 1231981824.0000, Reward: -2459285.5117
    full cols: 474, non-full cols: 20
   r - labels: 257, labels - r: 120
    violated: 142942, weighted: 7879.6826171875, len: 0.0, nonzero: 0.09588082879781723
Epoch 12900, Total loss: -20015155200.0000, CE loss: 26.6053, RL loss: -200151552.0000, Reward: -2463859.9609
    full cols: 467, non-full cols: 44
   r - labels: 274, labels - r: 120
    violated: 145278, weighted: 8024.26806640625, len: 0.0, nonzero: 0.09762141108512878
Epoch 13000, Total loss: -42718326784.0000, CE loss: 26.6170, RL loss: -427183264.0000, Reward: -2440560.8984
    full cols: 475, non-full cols: 21
   r - labels: 261, labels - r: 122
    violated: 146256, weighted: 7940.22509765625, len: 0.0, nonzero: 0.09616266191005707
Epoch 13100, Total loss: 59984519168.0000, CE loss: 26.6110, RL loss: 599845184.0000, Reward: -2415737.8828
    full cols: 468, non-full cols: 16
   r - labels: 252, labels - r: 125
    violated: 137359, weighted: 7921.2431640625, len: 0.0, nonzero: 0.09458932280540466
Epoch 13200, Total loss: -90163961856.0000, CE loss: 26.6180, RL loss: -901639616.0000, Reward: -2418017.3633
    full cols: 461, non-full cols: 20
   r - labels: 253, labels - r: 129
    violated: 139562, weighted: 8055.576171875, len: 0.0, nonzero: 0.09381504356861115
Epoch 13300, Total loss: -1503008256.0000, CE loss: 26.6157, RL loss: -15030083.0000, Reward: -2390317.8184
    full cols: 462, non-full cols: 20
   r - labels: 259, labels - r: 134
    violated: 144882, weighted: 8104.255859375, len: 0.0, nonzero: 0.09352701157331467
Epoch 13400, Total loss: 26893586432.0000, CE loss: 26.6187, RL loss: 268935872.0000, Reward: -2386309.8340
    full cols: 471, non-full cols: 14
   r - labels: 260, labels - r: 132
    violated: 140380, weighted: 8263.7734375, len: 0.0, nonzero: 0.0944499522447586
Epoch 13500, Total loss: -48209883136.0000, CE loss: 26.6130, RL loss: -482098848.0000, Reward: -2387750.3281
    full cols: 464, non-full cols: 23
   r - labels: 268, labels - r: 138
    violated: 129191, weighted: 8395.3037109375, len: 0.0, nonzero: 0.09408758580684662
Epoch 13600, Total loss: -42702516224.0000, CE loss: 26.6151, RL loss: -427025152.0000, Reward: -2407165.0312
    full cols: 468, non-full cols: 16
   r - labels: 267, labels - r: 140
    violated: 147275, weighted: 8467.40625, len: 0.0, nonzero: 0.0941867008805275
Epoch 13700, Total loss: 65336762368.0000, CE loss: 26.6036, RL loss: 653367616.0000, Reward: -2382978.3906
    full cols: 463, non-full cols: 14
   r - labels: 261, labels - r: 141
    violated: 139495, weighted: 8470.3203125, len: 0.0, nonzero: 0.09320800751447678
Epoch 13800, Total loss: -12254670848.0000, CE loss: 26.6149, RL loss: -122546704.0000, Reward: -2411995.0586
    full cols: 460, non-full cols: 25
   r - labels: 264, labels - r: 136
    violated: 131188, weighted: 8246.3232421875, len: 0.0, nonzero: 0.09325136244297028
Epoch 13900, Total loss: 849732480.0000, CE loss: 26.5999, RL loss: 8497325.0000, Reward: -2433738.7363
    full cols: 476, non-full cols: 16
   r - labels: 279, labels - r: 144
    violated: 135013, weighted: 8964.130859375, len: 0.0, nonzero: 0.09604187309741974
--- eval ---
prediction result:
f1 on test:    0.5398
f1 on test:    0.8937 (micro)
f1 on KB:      0.3426
integrated f1: 0.3782, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5140
f1 on test:    0.8701 (micro)
f1 on KB:      0.4197
integrated f1: 0.4424, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 14000, Total loss: -81781776384.0000, CE loss: 26.6187, RL loss: -817817728.0000, Reward: -2461146.6289
    full cols: 483, non-full cols: 31
   r - labels: 292, labels - r: 135
    violated: 138056, weighted: 8820.591796875, len: 0.0, nonzero: 0.0981045588850975
Epoch 14100, Total loss: -101148688384.0000, CE loss: 26.6099, RL loss: -1011486912.0000, Reward: -2485974.0449
    full cols: 481, non-full cols: 21
   r - labels: 285, labels - r: 140
    violated: 140913, weighted: 8807.5888671875, len: 0.0, nonzero: 0.09749443084001541
Epoch 14200, Total loss: 25706326016.0000, CE loss: 26.6079, RL loss: 257063264.0000, Reward: -2488767.8828
    full cols: 469, non-full cols: 29
   r - labels: 281, labels - r: 140
    violated: 134611, weighted: 8710.6435546875, len: 0.0, nonzero: 0.09563305228948593
Epoch 14300, Total loss: -105098125312.0000, CE loss: 26.6123, RL loss: -1050981248.0000, Reward: -2522133.3086
    full cols: 472, non-full cols: 24
   r - labels: 282, labels - r: 143
    violated: 144078, weighted: 8937.015625, len: 0.0, nonzero: 0.09613168984651566
Epoch 14400, Total loss: 25416970240.0000, CE loss: 26.6109, RL loss: 254169696.0000, Reward: -2525019.2188
    full cols: 474, non-full cols: 23
   r - labels: 284, labels - r: 144
    violated: 136910, weighted: 8932.259765625, len: 0.0, nonzero: 0.09585914760828018
Epoch 14500, Total loss: -36350902272.0000, CE loss: 26.6090, RL loss: -363509024.0000, Reward: -2539683.4121
    full cols: 478, non-full cols: 20
   r - labels: 281, labels - r: 140
    violated: 144555, weighted: 8918.4306640625, len: 0.0, nonzero: 0.09721259027719498
Epoch 14600, Total loss: 93781065728.0000, CE loss: 26.6197, RL loss: 937810624.0000, Reward: -2538183.6523
    full cols: 486, non-full cols: 27
   r - labels: 295, labels - r: 139
    violated: 140740, weighted: 9090.9453125, len: 0.0, nonzero: 0.09941774606704712
Epoch 14700, Total loss: -148345585664.0000, CE loss: 26.6024, RL loss: -1483455872.0000, Reward: -2536766.6484
    full cols: 481, non-full cols: 30
   r - labels: 294, labels - r: 140
    violated: 141075, weighted: 9218.1435546875, len: 0.0, nonzero: 0.09885096549987793
Epoch 14800, Total loss: -121712050176.0000, CE loss: 26.6051, RL loss: -1217120512.0000, Reward: -2527291.2969
    full cols: 489, non-full cols: 17
   r - labels: 294, labels - r: 145
    violated: 143621, weighted: 9361.9775390625, len: 0.0, nonzero: 0.09848550707101822
Epoch 14900, Total loss: -124852150272.0000, CE loss: 26.6009, RL loss: -1248521472.0000, Reward: -2522971.2832
    full cols: 481, non-full cols: 22
   r - labels: 291, labels - r: 145
    violated: 140351, weighted: 9082.90234375, len: 0.0, nonzero: 0.0972745344042778
Epoch 15000, Total loss: 868179008.0000, CE loss: 26.6009, RL loss: 8681790.0000, Reward: -2524089.7852
    full cols: 490, non-full cols: 18
   r - labels: 293, labels - r: 142
    violated: 138271, weighted: 9264.810546875, len: 0.0, nonzero: 0.0986868217587471
------ ABL Loop 0 ------
--- eval ---
prediction result:
f1 on test:    0.5396
f1 on test:    0.8937 (micro)
f1 on KB:      0.3428
f1 on orig KB: 0.3428
integrated f1: 0.3820, w_data: 0.3265, w_klg: 0.6735

integrated result:
f1 on test:    0.5145
f1 on test:    0.8707 (micro)
f1 on KB:      0.4173
f1 on orig KB: 0.4173
integrated f1: 0.4428, w_data: 0.3265, w_klg: 0.6735
------------
integrated f1 0.3820

KB before refine:
num_nodes: 5045.0000
num_edges: 113056.0000
density: 0.0044
avg_degree: 22.4095
avg_clustering: 0.2501
degree_assortativity: 0.2171
modularity: 0.4990
avg_betweenness: 0.0002
avg_closeness: 0.0944
Iteration 0: Loss = 7455166.500000
|Xk-Y|_F:  7455166.500000, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 6860581, f1 =  0.370298, approx slack: 1303601
rounded before pow |X_k-Y|_0 = 6777008, f1 =  0.301205

Iteration 20: Loss = 8750257.000000
|Xk-Y|_F:  8441712.000000, |X-X0|:  308545.156250
rounded |X_k-Y|_0 = 7323986, f1 =  0.288228, approx slack: 1146402
rounded before pow |X_k-Y|_0 = 6777008, f1 =  0.301205

Iteration 40: Loss = 8655808.000000
|Xk-Y|_F:  8373539.000000, |X-X0|:  282269.375000
rounded |X_k-Y|_0 = 7284374, f1 =  0.289462, approx slack: 183831
rounded before pow |X_k-Y|_0 = 7354316, f1 =  0.287171

Iteration 60: Loss = 8577709.000000
|Xk-Y|_F:  8322556.000000, |X-X0|:  255152.625000
rounded |X_k-Y|_0 = 7252269, f1 =  0.290455, approx slack: 202279
rounded before pow |X_k-Y|_0 = 7342770, f1 =  0.287520

Iteration 80: Loss = 8514110.000000
|Xk-Y|_F:  8277890.500000, |X-X0|:  236219.562500
rounded |X_k-Y|_0 = 7228472, f1 =  0.291197, approx slack: 279772
rounded before pow |X_k-Y|_0 = 7378062, f1 =  0.286374

Iteration 100: Loss = 8459743.000000
|Xk-Y|_F:  8237914.500000, |X-X0|:  221828.812500
rounded |X_k-Y|_0 = 7210673, f1 =  0.291745, approx slack: 281879
rounded before pow |X_k-Y|_0 = 7353113, f1 =  0.287145

Iteration 120: Loss = 8409296.000000
|Xk-Y|_F:  8198968.000000, |X-X0|:  210327.828125
rounded |X_k-Y|_0 = 7182345, f1 =  0.292624, approx slack: 312411
rounded before pow |X_k-Y|_0 = 7341831, f1 =  0.287499

Iteration 140: Loss = 8355415.000000
|Xk-Y|_F:  8154827.000000, |X-X0|:  200587.921875
rounded |X_k-Y|_0 = 7164586, f1 =  0.293153, approx slack: 369686
rounded before pow |X_k-Y|_0 = 7368345, f1 =  0.286654

Iteration 160: Loss = 8307678.500000
|Xk-Y|_F:  8115372.500000, |X-X0|:  192306.156250
rounded |X_k-Y|_0 = 7151583, f1 =  0.293543, approx slack: 388653
rounded before pow |X_k-Y|_0 = 7360635, f1 =  0.286894

Iteration 180: Loss = 8252640.000000
|Xk-Y|_F:  8067425.000000, |X-X0|:  185214.750000
rounded |X_k-Y|_0 = 7136479, f1 =  0.293985, approx slack: 405823
rounded before pow |X_k-Y|_0 = 7340455, f1 =  0.287515

Iteration 200: Loss = 8193380.000000
|Xk-Y|_F:  8014219.500000, |X-X0|:  179160.484375
rounded |X_k-Y|_0 = 7111630, f1 =  0.294743, approx slack: 416700
rounded before pow |X_k-Y|_0 = 7330152, f1 =  0.287805

Iteration 220: Loss = 8125811.500000
|Xk-Y|_F:  7952049.000000, |X-X0|:  173762.421875
rounded |X_k-Y|_0 = 7093947, f1 =  0.295257, approx slack: 440015
rounded before pow |X_k-Y|_0 = 7320176, f1 =  0.288104

Iteration 240: Loss = 8083985.500000
|Xk-Y|_F:  7915043.000000, |X-X0|:  168942.390625
rounded |X_k-Y|_0 = 7073887, f1 =  0.295882, approx slack: 456417
rounded before pow |X_k-Y|_0 = 7312058, f1 =  0.288357

Iteration 260: Loss = 8042486.500000
|Xk-Y|_F:  7877971.500000, |X-X0|:  164514.984375
rounded |X_k-Y|_0 = 7053317, f1 =  0.296523, approx slack: 443647
rounded before pow |X_k-Y|_0 = 7259646, f1 =  0.290014

Iteration 280: Loss = 7997271.000000
|Xk-Y|_F:  7836832.500000, |X-X0|:  160438.687500
rounded |X_k-Y|_0 = 7029338, f1 =  0.297262, approx slack: 436279
rounded before pow |X_k-Y|_0 = 7247282, f1 =  0.290296

Iteration 300: Loss = 7959506.500000
|Xk-Y|_F:  7802866.000000, |X-X0|:  156640.640625
rounded |X_k-Y|_0 = 7005059, f1 =  0.298009, approx slack: 457977
rounded before pow |X_k-Y|_0 = 7239287, f1 =  0.290549

Iteration 320: Loss = 7918513.500000
|Xk-Y|_F:  7765458.500000, |X-X0|:  153054.906250
rounded |X_k-Y|_0 = 6978213, f1 =  0.298817, approx slack: 484771
rounded before pow |X_k-Y|_0 = 7235556, f1 =  0.290660

Iteration 340: Loss = 7868256.000000
|Xk-Y|_F:  7718606.500000, |X-X0|:  149649.437500
rounded |X_k-Y|_0 = 6943811, f1 =  0.299850, approx slack: 519898
rounded before pow |X_k-Y|_0 = 7230653, f1 =  0.290816

Iteration 360: Loss = 7807304.000000
|Xk-Y|_F:  7660776.500000, |X-X0|:  146527.562500
rounded |X_k-Y|_0 = 6901504, f1 =  0.301100, approx slack: 565821
rounded before pow |X_k-Y|_0 = 7225883, f1 =  0.290957

Iteration 380: Loss = 7737881.000000
|Xk-Y|_F:  7594283.000000, |X-X0|:  143598.156250
rounded |X_k-Y|_0 = 6853663, f1 =  0.302499, approx slack: 617810
rounded before pow |X_k-Y|_0 = 7220484, f1 =  0.291141

Iteration 400: Loss = 7651193.000000
|Xk-Y|_F:  7510349.500000, |X-X0|:  140843.531250
rounded |X_k-Y|_0 = 6791913, f1 =  0.304301, approx slack: 689695
rounded before pow |X_k-Y|_0 = 7217723, f1 =  0.291230

Iteration 420: Loss = 7538314.000000
|Xk-Y|_F:  7400105.500000, |X-X0|:  138208.593750
rounded |X_k-Y|_0 = 6710007, f1 =  0.306692, approx slack: 802554
rounded before pow |X_k-Y|_0 = 7194310, f1 =  0.291964

Iteration 440: Loss = 7374035.500000
|Xk-Y|_F:  7238322.500000, |X-X0|:  135712.781250
rounded |X_k-Y|_0 = 6589569, f1 =  0.310191, approx slack: 923667
rounded before pow |X_k-Y|_0 = 7190928, f1 =  0.292075

Iteration 460: Loss = 7155334.500000
|Xk-Y|_F:  7021990.000000, |X-X0|:  133344.359375
rounded |X_k-Y|_0 = 6424955, f1 =  0.314913, approx slack: 1116074
rounded before pow |X_k-Y|_0 = 7181569, f1 =  0.292357

Iteration 480: Loss = 6813932.000000
|Xk-Y|_F:  6682761.500000, |X-X0|:  131170.625000
rounded |X_k-Y|_0 = 6158164, f1 =  0.322563, approx slack: 1430692
rounded before pow |X_k-Y|_0 = 7176046, f1 =  0.292529

Iteration 500: Loss = 6208991.500000
|Xk-Y|_F:  6079069.500000, |X-X0|:  129922.039062
rounded |X_k-Y|_0 = 5663997, f1 =  0.336591, approx slack: 2008481
rounded before pow |X_k-Y|_0 = 7161441, f1 =  0.292977

Iteration 520: Loss = 5055808.000000
|Xk-Y|_F:  4922540.500000, |X-X0|:  133267.343750
rounded |X_k-Y|_0 = 4673536, f1 =  0.365169, approx slack: 3096913
rounded before pow |X_k-Y|_0 = 7066435, f1 =  0.295984

Iteration 540: Loss = 3767534.750000
|Xk-Y|_F:  3623064.000000, |X-X0|:  144470.718750
rounded |X_k-Y|_0 = 3511796, f1 =  0.398886, approx slack: 4162798
rounded before pow |X_k-Y|_0 = 6735288, f1 =  0.306562

Iteration 560: Loss = 2729108.750000
|Xk-Y|_F:  2565416.250000, |X-X0|:  163692.562500
rounded |X_k-Y|_0 = 2585016, f1 =  0.427457, approx slack: 5244056
rounded before pow |X_k-Y|_0 = 6593258, f1 =  0.311276

Iteration 580: Loss = 1917843.250000
|Xk-Y|_F:  1724505.000000, |X-X0|:  193338.281250
rounded |X_k-Y|_0 = 1728728, f1 =  0.499207, approx slack: 5709383
rounded before pow |X_k-Y|_0 = 6582199, f1 =  0.311647

Iteration 600: Loss = 1417199.625000
|Xk-Y|_F:  1218192.125000, |X-X0|:  199007.484375
rounded |X_k-Y|_0 = 1198178, f1 =  0.551416, approx slack: 6023378
rounded before pow |X_k-Y|_0 = 6542644, f1 =  0.312905

Iteration 620: Loss = 1117100.750000
|Xk-Y|_F:  922256.125000, |X-X0|:  194844.562500
rounded |X_k-Y|_0 = 896288, f1 =  0.586240, approx slack: 6252170
rounded before pow |X_k-Y|_0 = 6557411, f1 =  0.312431

Iteration 640: Loss = 949913.750000
|Xk-Y|_F:  763171.562500, |X-X0|:  186742.187500
rounded |X_k-Y|_0 = 726350, f1 =  0.608704, approx slack: 6480176
rounded before pow |X_k-Y|_0 = 6664225, f1 =  0.309019

Iteration 660: Loss = 846190.000000
|Xk-Y|_F:  665652.437500, |X-X0|:  180537.593750
rounded |X_k-Y|_0 = 629498, f1 =  0.622528, approx slack: 6624064
rounded before pow |X_k-Y|_0 = 6738491, f1 =  0.306600

Iteration 680: Loss = 772494.125000
|Xk-Y|_F:  597039.250000, |X-X0|:  175454.890625
rounded |X_k-Y|_0 = 562515, f1 =  0.632609, approx slack: 6747154
rounded before pow |X_k-Y|_0 = 6808610, f1 =  0.304348

Iteration 700: Loss = 732615.000000
|Xk-Y|_F:  563258.375000, |X-X0|:  169356.656250
rounded |X_k-Y|_0 = 530689, f1 =  0.637595, approx slack: 6762240
rounded before pow |X_k-Y|_0 = 6854362, f1 =  0.302826

Iteration 720: Loss = 710150.125000
|Xk-Y|_F:  545820.750000, |X-X0|:  164329.343750
rounded |X_k-Y|_0 = 515292, f1 =  0.640109, approx slack: 6794405
rounded before pow |X_k-Y|_0 = 6877405, f1 =  0.302087

Iteration 740: Loss = 694620.875000
|Xk-Y|_F:  534353.687500, |X-X0|:  160267.187500
rounded |X_k-Y|_0 = 508068, f1 =  0.641297, approx slack: 6843530
rounded before pow |X_k-Y|_0 = 6917686, f1 =  0.300797

Iteration 760: Loss = 682727.250000
|Xk-Y|_F:  525866.562500, |X-X0|:  156860.656250
rounded |X_k-Y|_0 = 502628, f1 =  0.642191, approx slack: 6880831
rounded before pow |X_k-Y|_0 = 6948186, f1 =  0.299825

Iteration 780: Loss = 672969.750000
|Xk-Y|_F:  519101.343750, |X-X0|:  153868.375000
rounded |X_k-Y|_0 = 498274, f1 =  0.642908, approx slack: 6919827
rounded before pow |X_k-Y|_0 = 6981892, f1 =  0.298747

Iteration 800: Loss = 665059.187500
|Xk-Y|_F:  513790.843750, |X-X0|:  151268.328125
rounded |X_k-Y|_0 = 494303, f1 =  0.643565, approx slack: 6931006
rounded before pow |X_k-Y|_0 = 6985259, f1 =  0.298652

Iteration 820: Loss = 657477.687500
|Xk-Y|_F:  508553.968750, |X-X0|:  148923.734375
rounded |X_k-Y|_0 = 489439, f1 =  0.644350, approx slack: 6934812
rounded before pow |X_k-Y|_0 = 6986682, f1 =  0.298592

Iteration 840: Loss = 649755.062500
|Xk-Y|_F:  502987.687500, |X-X0|:  146767.359375
rounded |X_k-Y|_0 = 484747, f1 =  0.645100, approx slack: 6947170
rounded before pow |X_k-Y|_0 = 6994978, f1 =  0.298312

Iteration 860: Loss = 642228.562500
|Xk-Y|_F:  497509.718750, |X-X0|:  144718.843750
rounded |X_k-Y|_0 = 478789, f1 =  0.646040, approx slack: 6907518
rounded before pow |X_k-Y|_0 = 6976872, f1 =  0.298846

Iteration 880: Loss = 637249.312500
|Xk-Y|_F:  494471.375000, |X-X0|:  142777.953125
rounded |X_k-Y|_0 = 475948, f1 =  0.646515, approx slack: 6901356
rounded before pow |X_k-Y|_0 = 6973871, f1 =  0.298926

Iteration 900: Loss = 632956.375000
|Xk-Y|_F:  491994.093750, |X-X0|:  140962.250000
rounded |X_k-Y|_0 = 473216, f1 =  0.646988, approx slack: 6912931
rounded before pow |X_k-Y|_0 = 6988289, f1 =  0.298462

Iteration 920: Loss = 629124.687500
|Xk-Y|_F:  489883.625000, |X-X0|:  139241.078125
rounded |X_k-Y|_0 = 471418, f1 =  0.647309, approx slack: 6922543
rounded before pow |X_k-Y|_0 = 6996166, f1 =  0.298219

Iteration 940: Loss = 625502.000000
|Xk-Y|_F:  487865.500000, |X-X0|:  137636.468750
rounded |X_k-Y|_0 = 469597, f1 =  0.647622, approx slack: 6919684
rounded before pow |X_k-Y|_0 = 6997441, f1 =  0.298166

Iteration 960: Loss = 622134.125000
|Xk-Y|_F:  486074.656250, |X-X0|:  136059.453125
rounded |X_k-Y|_0 = 467833, f1 =  0.647926, approx slack: 6922798
rounded before pow |X_k-Y|_0 = 7001138, f1 =  0.298050

Iteration 980: Loss = 619105.750000
|Xk-Y|_F:  484504.031250, |X-X0|:  134601.718750
rounded |X_k-Y|_0 = 466091, f1 =  0.648217, approx slack: 6929940
rounded before pow |X_k-Y|_0 = 7010763, f1 =  0.297741

Iteration 1000: Loss = 616305.500000
|Xk-Y|_F:  483064.531250, |X-X0|:  133240.937500
rounded |X_k-Y|_0 = 464876, f1 =  0.648428, approx slack: 6945798
rounded before pow |X_k-Y|_0 = 7023204, f1 =  0.297345

Iteration 1020: Loss = 613713.750000
|Xk-Y|_F:  481806.718750, |X-X0|:  131907.062500
rounded |X_k-Y|_0 = 463903, f1 =  0.648604, approx slack: 6943974
rounded before pow |X_k-Y|_0 = 7020732, f1 =  0.297424

Iteration 1040: Loss = 611322.687500
|Xk-Y|_F:  480695.937500, |X-X0|:  130626.726562
rounded |X_k-Y|_0 = 463146, f1 =  0.648739, approx slack: 6939365
rounded before pow |X_k-Y|_0 = 7017762, f1 =  0.297520

Iteration 1060: Loss = 609006.875000
|Xk-Y|_F:  479638.500000, |X-X0|:  129368.390625
rounded |X_k-Y|_0 = 462477, f1 =  0.648859, approx slack: 6938731
rounded before pow |X_k-Y|_0 = 7016167, f1 =  0.297561

Iteration 1080: Loss = 606721.625000
|Xk-Y|_F:  478604.781250, |X-X0|:  128116.875000
rounded |X_k-Y|_0 = 461682, f1 =  0.648999, approx slack: 6936751
rounded before pow |X_k-Y|_0 = 7016203, f1 =  0.297557

Iteration 1100: Loss = 604524.375000
|Xk-Y|_F:  477611.593750, |X-X0|:  126912.781250
rounded |X_k-Y|_0 = 460986, f1 =  0.649126, approx slack: 6928313
rounded before pow |X_k-Y|_0 = 7009895, f1 =  0.297759

Iteration 1120: Loss = 602436.875000
|Xk-Y|_F:  476681.343750, |X-X0|:  125755.531250
rounded |X_k-Y|_0 = 460331, f1 =  0.649239, approx slack: 6931719
rounded before pow |X_k-Y|_0 = 7013101, f1 =  0.297655

Iteration 1140: Loss = 600431.250000
|Xk-Y|_F:  475826.031250, |X-X0|:  124605.234375
rounded |X_k-Y|_0 = 459692, f1 =  0.649354, approx slack: 6935980
rounded before pow |X_k-Y|_0 = 7016209, f1 =  0.297553

Iteration 1160: Loss = 598562.250000
|Xk-Y|_F:  475081.812500, |X-X0|:  123480.406250
rounded |X_k-Y|_0 = 459029, f1 =  0.649480, approx slack: 6943164
rounded before pow |X_k-Y|_0 = 7023231, f1 =  0.297323

Iteration 1180: Loss = 596772.625000
|Xk-Y|_F:  474406.750000, |X-X0|:  122365.859375
rounded |X_k-Y|_0 = 458451, f1 =  0.649588, approx slack: 6939496
rounded before pow |X_k-Y|_0 = 7019182, f1 =  0.297454

Iteration 1200: Loss = 595046.375000
|Xk-Y|_F:  473743.343750, |X-X0|:  121303.054688
rounded |X_k-Y|_0 = 457889, f1 =  0.649690, approx slack: 6940947
rounded before pow |X_k-Y|_0 = 7020435, f1 =  0.297413

Iteration 1220: Loss = 593391.875000
|Xk-Y|_F:  473158.906250, |X-X0|:  120232.968750
rounded |X_k-Y|_0 = 457358, f1 =  0.649793, approx slack: 6939451
rounded before pow |X_k-Y|_0 = 7019460, f1 =  0.297453

Iteration 1240: Loss = 591846.500000
|Xk-Y|_F:  472633.343750, |X-X0|:  119213.156250
rounded |X_k-Y|_0 = 456976, f1 =  0.649867, approx slack: 6938958
rounded before pow |X_k-Y|_0 = 7019032, f1 =  0.297464

Iteration 1260: Loss = 590327.875000
|Xk-Y|_F:  472114.343750, |X-X0|:  118213.546875
rounded |X_k-Y|_0 = 456541, f1 =  0.649951, approx slack: 6927941
rounded before pow |X_k-Y|_0 = 7012648, f1 =  0.297648

Iteration 1280: Loss = 588814.562500
|Xk-Y|_F:  471608.468750, |X-X0|:  117206.078125
rounded |X_k-Y|_0 = 456091, f1 =  0.650032, approx slack: 6933213
rounded before pow |X_k-Y|_0 = 7015631, f1 =  0.297557

Iteration 1300: Loss = 587345.250000
|Xk-Y|_F:  471126.968750, |X-X0|:  116218.250000
rounded |X_k-Y|_0 = 455772, f1 =  0.650098, approx slack: 6933763
rounded before pow |X_k-Y|_0 = 7016262, f1 =  0.297536

Iteration 1320: Loss = 585902.750000
|Xk-Y|_F:  470664.500000, |X-X0|:  115238.257812
rounded |X_k-Y|_0 = 455512, f1 =  0.650150, approx slack: 6935488
rounded before pow |X_k-Y|_0 = 7018475, f1 =  0.297464

Iteration 1340: Loss = 584509.562500
|Xk-Y|_F:  470237.406250, |X-X0|:  114272.171875
rounded |X_k-Y|_0 = 455150, f1 =  0.650219, approx slack: 6897727
rounded before pow |X_k-Y|_0 = 6987454, f1 =  0.298451

Iteration 1360: Loss = 583171.375000
|Xk-Y|_F:  469828.000000, |X-X0|:  113343.359375
rounded |X_k-Y|_0 = 454784, f1 =  0.650281, approx slack: 6888802
rounded before pow |X_k-Y|_0 = 6984481, f1 =  0.298546

Iteration 1380: Loss = 581867.937500
|Xk-Y|_F:  469436.750000, |X-X0|:  112431.203125
rounded |X_k-Y|_0 = 454555, f1 =  0.650330, approx slack: 6897862
rounded before pow |X_k-Y|_0 = 6992865, f1 =  0.298286

Iteration 1400: Loss = 580586.812500
|Xk-Y|_F:  469061.718750, |X-X0|:  111525.109375
rounded |X_k-Y|_0 = 454330, f1 =  0.650377, approx slack: 6896388
rounded before pow |X_k-Y|_0 = 6991621, f1 =  0.298327

Iteration 1420: Loss = 579329.625000
|Xk-Y|_F:  468691.250000, |X-X0|:  110638.359375
rounded |X_k-Y|_0 = 454017, f1 =  0.650440, approx slack: 6889739
rounded before pow |X_k-Y|_0 = 6987678, f1 =  0.298453

Iteration 1440: Loss = 578021.062500
|Xk-Y|_F:  468281.250000, |X-X0|:  109739.796875
rounded |X_k-Y|_0 = 453568, f1 =  0.650521, approx slack: 6887795
rounded before pow |X_k-Y|_0 = 6985930, f1 =  0.298509

Iteration 1460: Loss = 576800.687500
|Xk-Y|_F:  467944.187500, |X-X0|:  108856.484375
rounded |X_k-Y|_0 = 453334, f1 =  0.650566, approx slack: 6892338
rounded before pow |X_k-Y|_0 = 6990215, f1 =  0.298378

Iteration 1480: Loss = 575610.625000
|Xk-Y|_F:  467611.625000, |X-X0|:  107999.023438
rounded |X_k-Y|_0 = 453076, f1 =  0.650619, approx slack: 6893885
rounded before pow |X_k-Y|_0 = 6992816, f1 =  0.298282

Iteration 1500: Loss = 574425.500000
|Xk-Y|_F:  467285.718750, |X-X0|:  107139.750000
rounded |X_k-Y|_0 = 452791, f1 =  0.650672, approx slack: 6894578
rounded before pow |X_k-Y|_0 = 6993966, f1 =  0.298245

Iteration 1520: Loss = 573245.687500
|Xk-Y|_F:  466966.687500, |X-X0|:  106279.015625
rounded |X_k-Y|_0 = 452409, f1 =  0.650743, approx slack: 6890586
rounded before pow |X_k-Y|_0 = 6992760, f1 =  0.298279

Iteration 1540: Loss = 572082.937500
|Xk-Y|_F:  466669.531250, |X-X0|:  105413.421875
rounded |X_k-Y|_0 = 452178, f1 =  0.650788, approx slack: 6887044
rounded before pow |X_k-Y|_0 = 6991226, f1 =  0.298326

Iteration 1560: Loss = 570961.437500
|Xk-Y|_F:  466389.875000, |X-X0|:  104571.554688
rounded |X_k-Y|_0 = 451957, f1 =  0.650831, approx slack: 6886987
rounded before pow |X_k-Y|_0 = 6992108, f1 =  0.298297

Iteration 1580: Loss = 569862.187500
|Xk-Y|_F:  466126.718750, |X-X0|:  103735.468750
rounded |X_k-Y|_0 = 451802, f1 =  0.650860, approx slack: 6887790
rounded before pow |X_k-Y|_0 = 6994724, f1 =  0.298213

Iteration 1600: Loss = 568788.937500
|Xk-Y|_F:  465880.812500, |X-X0|:  102908.125000
rounded |X_k-Y|_0 = 451675, f1 =  0.650886, approx slack: 6883731
rounded before pow |X_k-Y|_0 = 6988075, f1 =  0.298433

Iteration 1620: Loss = 567738.625000
|Xk-Y|_F:  465644.968750, |X-X0|:  102093.671875
rounded |X_k-Y|_0 = 451487, f1 =  0.650922, approx slack: 6883973
rounded before pow |X_k-Y|_0 = 6989205, f1 =  0.298393

Iteration 1640: Loss = 566704.000000
|Xk-Y|_F:  465421.500000, |X-X0|:  101282.531250
rounded |X_k-Y|_0 = 451377, f1 =  0.650947, approx slack: 6887238
rounded before pow |X_k-Y|_0 = 6990068, f1 =  0.298366

Iteration 1660: Loss = 565678.500000
|Xk-Y|_F:  465209.843750, |X-X0|:  100468.687500
rounded |X_k-Y|_0 = 451183, f1 =  0.650983, approx slack: 6888036
rounded before pow |X_k-Y|_0 = 6991015, f1 =  0.298336

Iteration 1680: Loss = 564672.437500
|Xk-Y|_F:  465009.781250, |X-X0|:  99662.648438
rounded |X_k-Y|_0 = 450992, f1 =  0.651019, approx slack: 6895637
rounded before pow |X_k-Y|_0 = 6998127, f1 =  0.298118

Iteration 1700: Loss = 563661.500000
|Xk-Y|_F:  464805.625000, |X-X0|:  98855.859375
rounded |X_k-Y|_0 = 450874, f1 =  0.651042, approx slack: 6894764
rounded before pow |X_k-Y|_0 = 6997693, f1 =  0.298132

Iteration 1720: Loss = 562675.812500
|Xk-Y|_F:  464626.281250, |X-X0|:  98049.515625
rounded |X_k-Y|_0 = 450730, f1 =  0.651069, approx slack: 6894998
rounded before pow |X_k-Y|_0 = 6998378, f1 =  0.298111

Iteration 1740: Loss = 561690.687500
|Xk-Y|_F:  464468.125000, |X-X0|:  97222.570312
rounded |X_k-Y|_0 = 450662, f1 =  0.651084, approx slack: 6893577
rounded before pow |X_k-Y|_0 = 6996938, f1 =  0.298161

Iteration 1760: Loss = 560740.125000
|Xk-Y|_F:  464334.281250, |X-X0|:  96405.859375
rounded |X_k-Y|_0 = 450428, f1 =  0.651126, approx slack: 6894365
rounded before pow |X_k-Y|_0 = 6997935, f1 =  0.298129

Iteration 1780: Loss = 559794.437500
|Xk-Y|_F:  464226.812500, |X-X0|:  95567.625000
rounded |X_k-Y|_0 = 450394, f1 =  0.651137, approx slack: 6897149
rounded before pow |X_k-Y|_0 = 7001224, f1 =  0.298020

Iteration 1800: Loss = 558872.875000
|Xk-Y|_F:  464141.718750, |X-X0|:  94731.187500
rounded |X_k-Y|_0 = 450242, f1 =  0.651165, approx slack: 6896990
rounded before pow |X_k-Y|_0 = 7002422, f1 =  0.297986

Iteration 1820: Loss = 557981.375000
|Xk-Y|_F:  464058.000000, |X-X0|:  93923.343750
rounded |X_k-Y|_0 = 450187, f1 =  0.651177, approx slack: 6896448
rounded before pow |X_k-Y|_0 = 7002255, f1 =  0.297991

Iteration 1840: Loss = 557100.500000
|Xk-Y|_F:  463984.062500, |X-X0|:  93116.429688
rounded |X_k-Y|_0 = 450124, f1 =  0.651187, approx slack: 6898108
rounded before pow |X_k-Y|_0 = 7005035, f1 =  0.297901

Iteration 1860: Loss = 556229.937500
|Xk-Y|_F:  463916.812500, |X-X0|:  92313.125000
rounded |X_k-Y|_0 = 450046, f1 =  0.651202, approx slack: 6898959
rounded before pow |X_k-Y|_0 = 7003372, f1 =  0.298010

Iteration 1880: Loss = 555364.062500
|Xk-Y|_F:  463831.906250, |X-X0|:  91532.140625
rounded |X_k-Y|_0 = 449953, f1 =  0.651217, approx slack: 6902625
rounded before pow |X_k-Y|_0 = 7006980, f1 =  0.297895

Iteration 1900: Loss = 554510.062500
|Xk-Y|_F:  463722.937500, |X-X0|:  90787.109375
rounded |X_k-Y|_0 = 449852, f1 =  0.651234, approx slack: 6917907
rounded before pow |X_k-Y|_0 = 7019771, f1 =  0.297507

Iteration 1920: Loss = 553677.937500
|Xk-Y|_F:  463598.000000, |X-X0|:  90079.953125
rounded |X_k-Y|_0 = 449759, f1 =  0.651251, approx slack: 6919984
rounded before pow |X_k-Y|_0 = 7021010, f1 =  0.297478

Iteration 1940: Loss = 552861.250000
|Xk-Y|_F:  463451.062500, |X-X0|:  89410.171875
rounded |X_k-Y|_0 = 449645, f1 =  0.651272, approx slack: 6917863
rounded before pow |X_k-Y|_0 = 7019202, f1 =  0.297536

Iteration 1960: Loss = 552062.437500
|Xk-Y|_F:  463284.218750, |X-X0|:  88778.195312
rounded |X_k-Y|_0 = 449579, f1 =  0.651285, approx slack: 6925224
rounded before pow |X_k-Y|_0 = 7023899, f1 =  0.297391

Iteration 1980: Loss = 551293.062500
|Xk-Y|_F:  463109.750000, |X-X0|:  88183.289062
rounded |X_k-Y|_0 = 449444, f1 =  0.651307, approx slack: 6932202
rounded before pow |X_k-Y|_0 = 7029110, f1 =  0.297243

Iteration 2000: Loss = 550540.125000
|Xk-Y|_F:  462930.812500, |X-X0|:  87609.328125
rounded |X_k-Y|_0 = 449325, f1 =  0.651331, approx slack: 6932191
rounded before pow |X_k-Y|_0 = 7029229, f1 =  0.297239

Iteration 2020: Loss = 549790.375000
|Xk-Y|_F:  462748.781250, |X-X0|:  87041.593750
rounded |X_k-Y|_0 = 449112, f1 =  0.651368, approx slack: 6930583
rounded before pow |X_k-Y|_0 = 7029657, f1 =  0.297225

Iteration 2040: Loss = 549038.875000
|Xk-Y|_F:  462564.281250, |X-X0|:  86474.562500
rounded |X_k-Y|_0 = 448981, f1 =  0.651391, approx slack: 6929663
rounded before pow |X_k-Y|_0 = 7028344, f1 =  0.297266

Iteration 2060: Loss = 548298.750000
|Xk-Y|_F:  462376.937500, |X-X0|:  85921.796875
rounded |X_k-Y|_0 = 448831, f1 =  0.651419, approx slack: 6929770
rounded before pow |X_k-Y|_0 = 7028432, f1 =  0.297263

Iteration 2080: Loss = 547568.062500
|Xk-Y|_F:  462192.906250, |X-X0|:  85375.164062
rounded |X_k-Y|_0 = 448644, f1 =  0.651451, approx slack: 6931977
rounded before pow |X_k-Y|_0 = 7029403, f1 =  0.297240

Iteration 2100: Loss = 546849.812500
|Xk-Y|_F:  462007.718750, |X-X0|:  84842.109375
rounded |X_k-Y|_0 = 448457, f1 =  0.651482, approx slack: 6930461
rounded before pow |X_k-Y|_0 = 7027743, f1 =  0.297293

Iteration 2120: Loss = 546142.625000
|Xk-Y|_F:  461823.281250, |X-X0|:  84319.312500
rounded |X_k-Y|_0 = 448267, f1 =  0.651517, approx slack: 6929013
rounded before pow |X_k-Y|_0 = 7027891, f1 =  0.297289

Iteration 2140: Loss = 545448.187500
|Xk-Y|_F:  461639.218750, |X-X0|:  83808.945312
rounded |X_k-Y|_0 = 447999, f1 =  0.651561, approx slack: 6934468
rounded before pow |X_k-Y|_0 = 7032882, f1 =  0.297133

Iteration 2160: Loss = 544764.625000
|Xk-Y|_F:  461453.937500, |X-X0|:  83310.664062
rounded |X_k-Y|_0 = 447734, f1 =  0.651604, approx slack: 6933469
rounded before pow |X_k-Y|_0 = 7032093, f1 =  0.297158

Iteration 2180: Loss = 544088.375000
|Xk-Y|_F:  461272.375000, |X-X0|:  82815.992188
rounded |X_k-Y|_0 = 447508, f1 =  0.651643, approx slack: 6940224
rounded before pow |X_k-Y|_0 = 7037310, f1 =  0.297006

Iteration 2200: Loss = 543418.125000
|Xk-Y|_F:  461088.562500, |X-X0|:  82329.531250
rounded |X_k-Y|_0 = 447384, f1 =  0.651665, approx slack: 6948570
rounded before pow |X_k-Y|_0 = 7046518, f1 =  0.296715

Iteration 2220: Loss = 542768.750000
|Xk-Y|_F:  460905.750000, |X-X0|:  81863.000000
rounded |X_k-Y|_0 = 447256, f1 =  0.651687, approx slack: 6955028
rounded before pow |X_k-Y|_0 = 7052327, f1 =  0.296534

Iteration 2240: Loss = 542120.500000
|Xk-Y|_F:  460723.343750, |X-X0|:  81397.125000
rounded |X_k-Y|_0 = 447091, f1 =  0.651715, approx slack: 6953764
rounded before pow |X_k-Y|_0 = 7050733, f1 =  0.296589

Iteration 2260: Loss = 541462.875000
|Xk-Y|_F:  460538.937500, |X-X0|:  80923.968750
rounded |X_k-Y|_0 = 446938, f1 =  0.651743, approx slack: 6950305
rounded before pow |X_k-Y|_0 = 7048133, f1 =  0.296671

Iteration 2280: Loss = 540805.625000
|Xk-Y|_F:  460353.718750, |X-X0|:  80451.875000
rounded |X_k-Y|_0 = 446821, f1 =  0.651762, approx slack: 6961542
rounded before pow |X_k-Y|_0 = 7057373, f1 =  0.296391

Iteration 2300: Loss = 540171.125000
|Xk-Y|_F:  460168.218750, |X-X0|:  80002.875000
rounded |X_k-Y|_0 = 446693, f1 =  0.651785, approx slack: 6967491
rounded before pow |X_k-Y|_0 = 7060939, f1 =  0.296296

Iteration 2320: Loss = 539544.437500
|Xk-Y|_F:  459976.187500, |X-X0|:  79568.265625
rounded |X_k-Y|_0 = 446589, f1 =  0.651804, approx slack: 6968459
rounded before pow |X_k-Y|_0 = 7059808, f1 =  0.296347

Iteration 2340: Loss = 538902.625000
|Xk-Y|_F:  459765.031250, |X-X0|:  79137.609375
rounded |X_k-Y|_0 = 446431, f1 =  0.651831, approx slack: 6956702
rounded before pow |X_k-Y|_0 = 7048514, f1 =  0.296710

Iteration 2360: Loss = 538277.187500
|Xk-Y|_F:  459559.375000, |X-X0|:  78717.796875
rounded |X_k-Y|_0 = 446251, f1 =  0.651860, approx slack: 6956878
rounded before pow |X_k-Y|_0 = 7048507, f1 =  0.296721

Iteration 2380: Loss = 537603.750000
|Xk-Y|_F:  459312.312500, |X-X0|:  78291.437500
rounded |X_k-Y|_0 = 446050, f1 =  0.651893, approx slack: 6958979
rounded before pow |X_k-Y|_0 = 7049803, f1 =  0.296688

Iteration 2400: Loss = 536916.375000
|Xk-Y|_F:  459051.562500, |X-X0|:  77864.812500
rounded |X_k-Y|_0 = 445736, f1 =  0.651944, approx slack: 6965139
rounded before pow |X_k-Y|_0 = 7053768, f1 =  0.296583

Iteration 2420: Loss = 536250.687500
|Xk-Y|_F:  458804.062500, |X-X0|:  77446.632812
rounded |X_k-Y|_0 = 445431, f1 =  0.651991, approx slack: 6975771
rounded before pow |X_k-Y|_0 = 7061428, f1 =  0.296369

Iteration 2440: Loss = 535586.562500
|Xk-Y|_F:  458546.281250, |X-X0|:  77040.273438
rounded |X_k-Y|_0 = 445165, f1 =  0.652036, approx slack: 6973655
rounded before pow |X_k-Y|_0 = 7059626, f1 =  0.296427

Iteration 2460: Loss = 534892.125000
|Xk-Y|_F:  458259.406250, |X-X0|:  76632.750000
rounded |X_k-Y|_0 = 444833, f1 =  0.652089, approx slack: 6976465
rounded before pow |X_k-Y|_0 = 7061067, f1 =  0.296394

Iteration 2480: Loss = 534177.437500
|Xk-Y|_F:  457951.562500, |X-X0|:  76225.875000
rounded |X_k-Y|_0 = 444508, f1 =  0.652139, approx slack: 6976698
rounded before pow |X_k-Y|_0 = 7061507, f1 =  0.296376

Iteration 2500: Loss = 533489.312500
|Xk-Y|_F:  457650.531250, |X-X0|:  75838.781250
rounded |X_k-Y|_0 = 444158, f1 =  0.652195, approx slack: 6973773
rounded before pow |X_k-Y|_0 = 7058807, f1 =  0.296462

Iteration 2520: Loss = 532823.625000
|Xk-Y|_F:  457364.593750, |X-X0|:  75459.046875
rounded |X_k-Y|_0 = 443832, f1 =  0.652250, approx slack: 6956962
rounded before pow |X_k-Y|_0 = 7042382, f1 =  0.296966

Iteration 2540: Loss = 532161.937500
|Xk-Y|_F:  457075.531250, |X-X0|:  75086.421875
rounded |X_k-Y|_0 = 443586, f1 =  0.652293, approx slack: 6922775
rounded before pow |X_k-Y|_0 = 7008287, f1 =  0.298007

Iteration 2560: Loss = 531490.312500
|Xk-Y|_F:  456783.093750, |X-X0|:  74707.195312
rounded |X_k-Y|_0 = 443351, f1 =  0.652333, approx slack: 6796485
rounded before pow |X_k-Y|_0 = 6881694, f1 =  0.301871

Iteration 2580: Loss = 530825.187500
|Xk-Y|_F:  456488.687500, |X-X0|:  74336.500000
rounded |X_k-Y|_0 = 443128, f1 =  0.652371, approx slack: 6779279
rounded before pow |X_k-Y|_0 = 6864689, f1 =  0.302392

Iteration 2600: Loss = 530135.812500
|Xk-Y|_F:  456168.250000, |X-X0|:  73967.554688
rounded |X_k-Y|_0 = 442849, f1 =  0.652417, approx slack: 6748442
rounded before pow |X_k-Y|_0 = 6835424, f1 =  0.303288

Iteration 2620: Loss = 529455.687500
|Xk-Y|_F:  455853.343750, |X-X0|:  73602.343750
rounded |X_k-Y|_0 = 442615, f1 =  0.652456, approx slack: 6748853
rounded before pow |X_k-Y|_0 = 6835819, f1 =  0.303276

Iteration 2640: Loss = 528767.000000
|Xk-Y|_F:  455531.656250, |X-X0|:  73235.312500
rounded |X_k-Y|_0 = 442420, f1 =  0.652491, approx slack: 6741717
rounded before pow |X_k-Y|_0 = 6829208, f1 =  0.303487

Iteration 2660: Loss = 528083.937500
|Xk-Y|_F:  455203.625000, |X-X0|:  72880.296875
rounded |X_k-Y|_0 = 442145, f1 =  0.652538, approx slack: 6740906
rounded before pow |X_k-Y|_0 = 6828575, f1 =  0.303507

Iteration 2680: Loss = 527411.500000
|Xk-Y|_F:  454875.500000, |X-X0|:  72535.984375
rounded |X_k-Y|_0 = 441860, f1 =  0.652588, approx slack: 6740585
rounded before pow |X_k-Y|_0 = 6828532, f1 =  0.303507

Iteration 2700: Loss = 526751.000000
|Xk-Y|_F:  454565.656250, |X-X0|:  72185.359375
rounded |X_k-Y|_0 = 441629, f1 =  0.652627, approx slack: 6693060
rounded before pow |X_k-Y|_0 = 6785976, f1 =  0.304861

Iteration 2720: Loss = 526110.125000
|Xk-Y|_F:  454260.781250, |X-X0|:  71849.375000
rounded |X_k-Y|_0 = 441356, f1 =  0.652675, approx slack: 6692431
rounded before pow |X_k-Y|_0 = 6785499, f1 =  0.304877

Iteration 2740: Loss = 525450.875000
|Xk-Y|_F:  453944.968750, |X-X0|:  71505.906250
rounded |X_k-Y|_0 = 441145, f1 =  0.652711, approx slack: 6668155
rounded before pow |X_k-Y|_0 = 6762803, f1 =  0.305598

Iteration 2760: Loss = 524801.062500
|Xk-Y|_F:  453637.781250, |X-X0|:  71163.265625
rounded |X_k-Y|_0 = 440770, f1 =  0.652775, approx slack: 6662378
rounded before pow |X_k-Y|_0 = 6757894, f1 =  0.305754

Iteration 2780: Loss = 524178.812500
|Xk-Y|_F:  453346.187500, |X-X0|:  70832.617188
rounded |X_k-Y|_0 = 440408, f1 =  0.652837, approx slack: 6662408
rounded before pow |X_k-Y|_0 = 6757903, f1 =  0.305758

Iteration 2800: Loss = 523581.500000
|Xk-Y|_F:  453083.218750, |X-X0|:  70498.265625
rounded |X_k-Y|_0 = 440109, f1 =  0.652887, approx slack: 6662373
rounded before pow |X_k-Y|_0 = 6757997, f1 =  0.305755

Iteration 2820: Loss = 522998.000000
|Xk-Y|_F:  452834.625000, |X-X0|:  70163.390625
rounded |X_k-Y|_0 = 439856, f1 =  0.652928, approx slack: 6655683
rounded before pow |X_k-Y|_0 = 6752073, f1 =  0.305939

Iteration 2840: Loss = 522420.531250
|Xk-Y|_F:  452584.593750, |X-X0|:  69835.937500
rounded |X_k-Y|_0 = 439665, f1 =  0.652962, approx slack: 6660269
rounded before pow |X_k-Y|_0 = 6756440, f1 =  0.305801

Iteration 2860: Loss = 521752.968750
|Xk-Y|_F:  452256.000000, |X-X0|:  69496.976562
rounded |X_k-Y|_0 = 439478, f1 =  0.653001, approx slack: 6655366
rounded before pow |X_k-Y|_0 = 6752239, f1 =  0.305935

Iteration 2880: Loss = 521111.593750
|Xk-Y|_F:  451934.343750, |X-X0|:  69177.242188
rounded |X_k-Y|_0 = 439164, f1 =  0.653053, approx slack: 6657101
rounded before pow |X_k-Y|_0 = 6754172, f1 =  0.305873

Iteration 2900: Loss = 520512.093750
|Xk-Y|_F:  451679.000000, |X-X0|:  68833.085938
rounded |X_k-Y|_0 = 438992, f1 =  0.653084, approx slack: 6649510
rounded before pow |X_k-Y|_0 = 6748276, f1 =  0.306058

Iteration 2920: Loss = 519904.187500
|Xk-Y|_F:  451410.437500, |X-X0|:  68493.750000
rounded |X_k-Y|_0 = 438788, f1 =  0.653120, approx slack: 6648128
rounded before pow |X_k-Y|_0 = 6747045, f1 =  0.306099

Iteration 2940: Loss = 519290.906250
|Xk-Y|_F:  451140.562500, |X-X0|:  68150.351562
rounded |X_k-Y|_0 = 438527, f1 =  0.653166, approx slack: 6645209
rounded before pow |X_k-Y|_0 = 6743906, f1 =  0.306200

Iteration 2960: Loss = 518649.625000
|Xk-Y|_F:  450829.375000, |X-X0|:  67820.250000
rounded |X_k-Y|_0 = 438167, f1 =  0.653224, approx slack: 6642751
rounded before pow |X_k-Y|_0 = 6741546, f1 =  0.306273

Iteration 2980: Loss = 518083.187500
|Xk-Y|_F:  450596.062500, |X-X0|:  67487.132812
rounded |X_k-Y|_0 = 438019, f1 =  0.653252, approx slack: 6642404
rounded before pow |X_k-Y|_0 = 6741305, f1 =  0.306280

Iteration 3000: Loss = 517578.250000
|Xk-Y|_F:  450403.937500, |X-X0|:  67174.328125
rounded |X_k-Y|_0 = 437869, f1 =  0.653279, approx slack: 6638859
rounded before pow |X_k-Y|_0 = 6737682, f1 =  0.306395

Iteration 3020: Loss = 517073.937500
|Xk-Y|_F:  450211.937500, |X-X0|:  66861.984375
rounded |X_k-Y|_0 = 437684, f1 =  0.653312, approx slack: 6638844
rounded before pow |X_k-Y|_0 = 6735246, f1 =  0.306478

Iteration 3040: Loss = 516589.187500
|Xk-Y|_F:  450031.250000, |X-X0|:  66557.921875
rounded |X_k-Y|_0 = 437534, f1 =  0.653340, approx slack: 6642118
rounded before pow |X_k-Y|_0 = 6736153, f1 =  0.306454

Iteration 3060: Loss = 516096.656250
|Xk-Y|_F:  449848.250000, |X-X0|:  66248.398438
rounded |X_k-Y|_0 = 437411, f1 =  0.653361, approx slack: 6642927
rounded before pow |X_k-Y|_0 = 6737007, f1 =  0.306427

Iteration 3080: Loss = 515599.562500
|Xk-Y|_F:  449663.718750, |X-X0|:  65935.843750
rounded |X_k-Y|_0 = 437201, f1 =  0.653396, approx slack: 6643146
rounded before pow |X_k-Y|_0 = 6737492, f1 =  0.306411

Iteration 3100: Loss = 515149.875000
|Xk-Y|_F:  449509.593750, |X-X0|:  65640.273438
rounded |X_k-Y|_0 = 437070, f1 =  0.653418, approx slack: 6647822
rounded before pow |X_k-Y|_0 = 6741777, f1 =  0.306275

Iteration 3120: Loss = 514683.375000
|Xk-Y|_F:  449338.000000, |X-X0|:  65345.359375
rounded |X_k-Y|_0 = 436990, f1 =  0.653432, approx slack: 6644825
rounded before pow |X_k-Y|_0 = 6739208, f1 =  0.306357

Iteration 3140: Loss = 514183.500000
|Xk-Y|_F:  449147.531250, |X-X0|:  65035.976562
rounded |X_k-Y|_0 = 436848, f1 =  0.653458, approx slack: 6643120
rounded before pow |X_k-Y|_0 = 6737647, f1 =  0.306411

Iteration 3160: Loss = 513685.812500
|Xk-Y|_F:  448955.937500, |X-X0|:  64729.878906
rounded |X_k-Y|_0 = 436631, f1 =  0.653495, approx slack: 6640880
rounded before pow |X_k-Y|_0 = 6735771, f1 =  0.306471

Iteration 3180: Loss = 513242.500000
|Xk-Y|_F:  448801.531250, |X-X0|:  64440.984375
rounded |X_k-Y|_0 = 436534, f1 =  0.653512, approx slack: 6642846
rounded before pow |X_k-Y|_0 = 6737532, f1 =  0.306415

Iteration 3200: Loss = 512770.906250
|Xk-Y|_F:  448625.062500, |X-X0|:  64145.851562
rounded |X_k-Y|_0 = 436385, f1 =  0.653538, approx slack: 6642752
rounded before pow |X_k-Y|_0 = 6737633, f1 =  0.306412

Iteration 3220: Loss = 512305.218750
|Xk-Y|_F:  448455.593750, |X-X0|:  63849.632812
rounded |X_k-Y|_0 = 436163, f1 =  0.653575, approx slack: 6642259
rounded before pow |X_k-Y|_0 = 6737379, f1 =  0.306420

Iteration 3240: Loss = 511856.718750
|Xk-Y|_F:  448299.968750, |X-X0|:  63556.753906
rounded |X_k-Y|_0 = 436060, f1 =  0.653595, approx slack: 6654053
rounded before pow |X_k-Y|_0 = 6748658, f1 =  0.306060

Iteration 3260: Loss = 511410.250000
|Xk-Y|_F:  448144.937500, |X-X0|:  63265.308594
rounded |X_k-Y|_0 = 435920, f1 =  0.653620, approx slack: 6651813
rounded before pow |X_k-Y|_0 = 6746825, f1 =  0.306118

Iteration 3280: Loss = 510996.218750
|Xk-Y|_F:  448018.031250, |X-X0|:  62978.187500
rounded |X_k-Y|_0 = 435819, f1 =  0.653637, approx slack: 6651533
rounded before pow |X_k-Y|_0 = 6746834, f1 =  0.306118

Iteration 3300: Loss = 510581.187500
|Xk-Y|_F:  447875.218750, |X-X0|:  62705.972656
rounded |X_k-Y|_0 = 435740, f1 =  0.653653, approx slack: 6651096
rounded before pow |X_k-Y|_0 = 6746496, f1 =  0.306128

Iteration 3320: Loss = 510178.125000
|Xk-Y|_F:  447743.218750, |X-X0|:  62434.921875
rounded |X_k-Y|_0 = 435643, f1 =  0.653669, approx slack: 6650365
rounded before pow |X_k-Y|_0 = 6745877, f1 =  0.306148

Iteration 3340: Loss = 509777.937500
|Xk-Y|_F:  447617.843750, |X-X0|:  62160.085938
rounded |X_k-Y|_0 = 435553, f1 =  0.653685, approx slack: 6653494
rounded before pow |X_k-Y|_0 = 6748576, f1 =  0.306067

Iteration 3360: Loss = 509357.218750
|Xk-Y|_F:  447463.500000, |X-X0|:  61893.714844
rounded |X_k-Y|_0 = 435434, f1 =  0.653706, approx slack: 6654622
rounded before pow |X_k-Y|_0 = 6749834, f1 =  0.306026

Iteration 3380: Loss = 508886.500000
|Xk-Y|_F:  447257.906250, |X-X0|:  61628.593750
rounded |X_k-Y|_0 = 435195, f1 =  0.653744, approx slack: 6655329
rounded before pow |X_k-Y|_0 = 6750552, f1 =  0.306003

Iteration 3400: Loss = 508480.531250
|Xk-Y|_F:  447119.718750, |X-X0|:  61360.816406
rounded |X_k-Y|_0 = 435066, f1 =  0.653767, approx slack: 6654603
rounded before pow |X_k-Y|_0 = 6749695, f1 =  0.306031

Iteration 3420: Loss = 508074.656250
|Xk-Y|_F:  446975.156250, |X-X0|:  61099.500000
rounded |X_k-Y|_0 = 435036, f1 =  0.653776, approx slack: 6655139
rounded before pow |X_k-Y|_0 = 6750079, f1 =  0.306024

Iteration 3440: Loss = 507693.062500
|Xk-Y|_F:  446851.375000, |X-X0|:  60841.703125
rounded |X_k-Y|_0 = 434862, f1 =  0.653806, approx slack: 6654869
rounded before pow |X_k-Y|_0 = 6749839, f1 =  0.306031

Iteration 3460: Loss = 507323.125000
|Xk-Y|_F:  446738.687500, |X-X0|:  60584.429688
rounded |X_k-Y|_0 = 434742, f1 =  0.653826, approx slack: 6656694
rounded before pow |X_k-Y|_0 = 6750179, f1 =  0.306027

Iteration 3480: Loss = 506945.656250
|Xk-Y|_F:  446619.812500, |X-X0|:  60325.832031
rounded |X_k-Y|_0 = 434573, f1 =  0.653854, approx slack: 6655935
rounded before pow |X_k-Y|_0 = 6749564, f1 =  0.306046

Iteration 3500: Loss = 506581.250000
|Xk-Y|_F:  446512.531250, |X-X0|:  60068.726562
rounded |X_k-Y|_0 = 434497, f1 =  0.653867, approx slack: 6656679
rounded before pow |X_k-Y|_0 = 6750407, f1 =  0.306019

Iteration 3520: Loss = 506216.000000
|Xk-Y|_F:  446399.812500, |X-X0|:  59816.175781
rounded |X_k-Y|_0 = 434399, f1 =  0.653884, approx slack: 6657789
rounded before pow |X_k-Y|_0 = 6751709, f1 =  0.305990

Iteration 3540: Loss = 505837.718750
|Xk-Y|_F:  446274.406250, |X-X0|:  59563.304688
rounded |X_k-Y|_0 = 434334, f1 =  0.653897, approx slack: 6646914
rounded before pow |X_k-Y|_0 = 6740698, f1 =  0.306340

Iteration 3560: Loss = 505459.750000
|Xk-Y|_F:  446140.187500, |X-X0|:  59319.554688
rounded |X_k-Y|_0 = 434228, f1 =  0.653915, approx slack: 6646380
rounded before pow |X_k-Y|_0 = 6740178, f1 =  0.306358

Iteration 3580: Loss = 505066.875000
|Xk-Y|_F:  445988.781250, |X-X0|:  59078.105469
rounded |X_k-Y|_0 = 434107, f1 =  0.653938, approx slack: 6645776
rounded before pow |X_k-Y|_0 = 6739645, f1 =  0.306375

Iteration 3600: Loss = 504685.687500
|Xk-Y|_F:  445847.031250, |X-X0|:  58838.671875
rounded |X_k-Y|_0 = 433970, f1 =  0.653964, approx slack: 6645734
rounded before pow |X_k-Y|_0 = 6739648, f1 =  0.306375

Iteration 3620: Loss = 504313.437500
|Xk-Y|_F:  445721.031250, |X-X0|:  58592.410156
rounded |X_k-Y|_0 = 433828, f1 =  0.653988, approx slack: 6648347
rounded before pow |X_k-Y|_0 = 6741892, f1 =  0.306305

Iteration 3640: Loss = 503976.500000
|Xk-Y|_F:  445624.687500, |X-X0|:  58351.812500
rounded |X_k-Y|_0 = 433699, f1 =  0.654011, approx slack: 6646796
rounded before pow |X_k-Y|_0 = 6740529, f1 =  0.306348

Iteration 3660: Loss = 503720.125000
|Xk-Y|_F:  445587.218750, |X-X0|:  58132.906250
rounded |X_k-Y|_0 = 433631, f1 =  0.654021, approx slack: 6652275
rounded before pow |X_k-Y|_0 = 6745671, f1 =  0.306184

Iteration 3680: Loss = 503392.750000
|Xk-Y|_F:  445491.718750, |X-X0|:  57901.023438
rounded |X_k-Y|_0 = 433541, f1 =  0.654037, approx slack: 6641110
rounded before pow |X_k-Y|_0 = 6735816, f1 =  0.306496

Iteration 3700: Loss = 503042.656250
|Xk-Y|_F:  445390.281250, |X-X0|:  57652.363281
rounded |X_k-Y|_0 = 433469, f1 =  0.654051, approx slack: 6640652
rounded before pow |X_k-Y|_0 = 6735301, f1 =  0.306513

Iteration 3720: Loss = 502692.500000
|Xk-Y|_F:  445284.562500, |X-X0|:  57407.945312
rounded |X_k-Y|_0 = 433359, f1 =  0.654069, approx slack: 6638139
rounded before pow |X_k-Y|_0 = 6733056, f1 =  0.306585

Iteration 3740: Loss = 502373.562500
|Xk-Y|_F:  445187.937500, |X-X0|:  57185.632812
rounded |X_k-Y|_0 = 433311, f1 =  0.654080, approx slack: 6636689
rounded before pow |X_k-Y|_0 = 6731686, f1 =  0.306628

Iteration 3760: Loss = 502095.281250
|Xk-Y|_F:  445130.437500, |X-X0|:  56964.851562
rounded |X_k-Y|_0 = 433246, f1 =  0.654090, approx slack: 6640884
rounded before pow |X_k-Y|_0 = 6735459, f1 =  0.306508

Iteration 3780: Loss = 501770.906250
|Xk-Y|_F:  445037.937500, |X-X0|:  56732.960938
rounded |X_k-Y|_0 = 433150, f1 =  0.654108, approx slack: 6641971
rounded before pow |X_k-Y|_0 = 6736444, f1 =  0.306477

Iteration 3800: Loss = 501441.593750
|Xk-Y|_F:  444941.031250, |X-X0|:  56500.570312
rounded |X_k-Y|_0 = 433101, f1 =  0.654117, approx slack: 6644171
rounded before pow |X_k-Y|_0 = 6738554, f1 =  0.306409

Iteration 3820: Loss = 501112.562500
|Xk-Y|_F:  444843.656250, |X-X0|:  56268.906250
rounded |X_k-Y|_0 = 433011, f1 =  0.654133, approx slack: 6641246
rounded before pow |X_k-Y|_0 = 6737354, f1 =  0.306447

Iteration 3840: Loss = 500768.781250
|Xk-Y|_F:  444738.468750, |X-X0|:  56030.316406
rounded |X_k-Y|_0 = 432937, f1 =  0.654148, approx slack: 6637291
rounded before pow |X_k-Y|_0 = 6733727, f1 =  0.306563

Iteration 3860: Loss = 500461.687500
|Xk-Y|_F:  444655.687500, |X-X0|:  55805.988281
rounded |X_k-Y|_0 = 432840, f1 =  0.654163, approx slack: 6638371
rounded before pow |X_k-Y|_0 = 6734492, f1 =  0.306539

Iteration 3880: Loss = 500155.187500
|Xk-Y|_F:  444573.968750, |X-X0|:  55581.218750
rounded |X_k-Y|_0 = 432792, f1 =  0.654172, approx slack: 6640292
rounded before pow |X_k-Y|_0 = 6736163, f1 =  0.306486

Iteration 3900: Loss = 499826.437500
|Xk-Y|_F:  444479.875000, |X-X0|:  55346.550781
rounded |X_k-Y|_0 = 432735, f1 =  0.654184, approx slack: 6638672
rounded before pow |X_k-Y|_0 = 6734635, f1 =  0.306535

Iteration 3920: Loss = 499445.875000
|Xk-Y|_F:  444332.343750, |X-X0|:  55113.546875
rounded |X_k-Y|_0 = 432595, f1 =  0.654206, approx slack: 6636565
rounded before pow |X_k-Y|_0 = 6732717, f1 =  0.306596

Iteration 3940: Loss = 499117.437500
|Xk-Y|_F:  444229.250000, |X-X0|:  54888.187500
rounded |X_k-Y|_0 = 432566, f1 =  0.654212, approx slack: 6634283
rounded before pow |X_k-Y|_0 = 6730515, f1 =  0.306667

Iteration 3960: Loss = 498675.625000
|Xk-Y|_F:  444027.500000, |X-X0|:  54648.117188
rounded |X_k-Y|_0 = 432401, f1 =  0.654245, approx slack: 6627544
rounded before pow |X_k-Y|_0 = 6724819, f1 =  0.306849

Iteration 3980: Loss = 498213.093750
|Xk-Y|_F:  443788.781250, |X-X0|:  54424.304688
rounded |X_k-Y|_0 = 432296, f1 =  0.654269, approx slack: 6631322
rounded before pow |X_k-Y|_0 = 6728329, f1 =  0.306738

Iteration 4000: Loss = 497880.312500
|Xk-Y|_F:  443694.875000, |X-X0|:  54185.421875
rounded |X_k-Y|_0 = 432267, f1 =  0.654275, approx slack: 6627905
rounded before pow |X_k-Y|_0 = 6724867, f1 =  0.306851

Iteration 4020: Loss = 497518.531250
|Xk-Y|_F:  443570.218750, |X-X0|:  53948.304688
rounded |X_k-Y|_0 = 432188, f1 =  0.654289, approx slack: 6627578
rounded before pow |X_k-Y|_0 = 6724513, f1 =  0.306863

Iteration 4040: Loss = 497209.937500
|Xk-Y|_F:  443495.437500, |X-X0|:  53714.492188
rounded |X_k-Y|_0 = 432162, f1 =  0.654295, approx slack: 6627060
rounded before pow |X_k-Y|_0 = 6724027, f1 =  0.306878

Iteration 4060: Loss = 496873.250000
|Xk-Y|_F:  443393.906250, |X-X0|:  53479.359375
rounded |X_k-Y|_0 = 432121, f1 =  0.654303, approx slack: 6625014
rounded before pow |X_k-Y|_0 = 6723093, f1 =  0.306905

Iteration 4080: Loss = 496533.843750
|Xk-Y|_F:  443284.906250, |X-X0|:  53248.945312
rounded |X_k-Y|_0 = 432071, f1 =  0.654314, approx slack: 6625516
rounded before pow |X_k-Y|_0 = 6723527, f1 =  0.306891

Iteration 4100: Loss = 496206.500000
|Xk-Y|_F:  443194.781250, |X-X0|:  53011.710938
rounded |X_k-Y|_0 = 432031, f1 =  0.654322, approx slack: 6625659
rounded before pow |X_k-Y|_0 = 6723658, f1 =  0.306887

Iteration 4120: Loss = 495804.843750
|Xk-Y|_F:  443034.281250, |X-X0|:  52770.554688
rounded |X_k-Y|_0 = 431952, f1 =  0.654338, approx slack: 6624635
rounded before pow |X_k-Y|_0 = 6722335, f1 =  0.306929

Iteration 4140: Loss = 495478.562500
|Xk-Y|_F:  442926.718750, |X-X0|:  52551.851562
rounded |X_k-Y|_0 = 431912, f1 =  0.654348, approx slack: 6625430
rounded before pow |X_k-Y|_0 = 6723042, f1 =  0.306907

Iteration 4160: Loss = 495163.562500
|Xk-Y|_F:  442839.875000, |X-X0|:  52323.679688
rounded |X_k-Y|_0 = 431812, f1 =  0.654363, approx slack: 6626999
rounded before pow |X_k-Y|_0 = 6724484, f1 =  0.306861

Converged at iteration 4180

KB after refine:
num_nodes: 5045.0000
num_edges: 3669.0000
density: 0.0001
avg_degree: 0.7273
avg_clustering: 0.0715
degree_assortativity: -0.3286
modularity: 0.6439
avg_betweenness: 0.0000
avg_closeness: 0.0022
------ ABL 0 after refine ------
--- eval ---
prediction result:
f1 on test:    0.5396
f1 on test:    0.8937 (micro)
f1 on KB:      0.6371
f1 on orig KB: 0.3428
integrated f1: 0.3820, w_data: 0.3265, w_klg: 0.6735

integrated result:
f1 on test:    0.5294
f1 on test:    0.8933 (micro)
f1 on KB:      0.6505
f1 on orig KB: 0.3364
integrated f1: 0.3749, w_data: 0.3265, w_klg: 0.6735
------------
integrated f1 0.3820
Epoch 100, Total loss: 12859631616.0000, CE loss: 25.1988, RL loss: 128596312.0000, Reward: -1600034.8281
    full cols: 482, non-full cols: 22
   r - labels: 294, labels - r: 147
    violated: 8687, weighted: 9392.451171875, len: 0.0, nonzero: 0.09789705276489258
Epoch 200, Total loss: -42394632192.0000, CE loss: 25.1847, RL loss: -423946304.0000, Reward: -1594305.8574
    full cols: 486, non-full cols: 16
   r - labels: 292, labels - r: 147
    violated: 9054, weighted: 9331.54296875, len: 0.0, nonzero: 0.09745725989341736
Epoch 300, Total loss: -18048612352.0000, CE loss: 25.1695, RL loss: -180486128.0000, Reward: -1587393.6523
    full cols: 485, non-full cols: 22
   r - labels: 297, labels - r: 147
    violated: 8598, weighted: 9380.6201171875, len: 0.0, nonzero: 0.09803333133459091
Epoch 400, Total loss: 89555566592.0000, CE loss: 25.1553, RL loss: 895555648.0000, Reward: -1579836.4492
    full cols: 488, non-full cols: 20
   r - labels: 298, labels - r: 147
    violated: 8821, weighted: 9390.501953125, len: 0.0, nonzero: 0.09837091714143753
Epoch 500, Total loss: 76630466560.0000, CE loss: 25.1425, RL loss: 766304704.0000, Reward: -1575777.3594
    full cols: 483, non-full cols: 27
   r - labels: 297, labels - r: 144
    violated: 8889, weighted: 9262.083984375, len: 0.0, nonzero: 0.09790944308042526
Epoch 600, Total loss: -66232049664.0000, CE loss: 25.1317, RL loss: -662320512.0000, Reward: -1594595.4961
    full cols: 483, non-full cols: 20
   r - labels: 295, labels - r: 149
    violated: 8571, weighted: 9424.306640625, len: 0.0, nonzero: 0.09852886945009232
Epoch 700, Total loss: -8298271232.0000, CE loss: 25.1219, RL loss: -82982712.0000, Reward: -1584450.0898
    full cols: 485, non-full cols: 20
   r - labels: 294, labels - r: 146
    violated: 8698, weighted: 9306.8857421875, len: 0.0, nonzero: 0.09804262220859528
Epoch 800, Total loss: 15416740864.0000, CE loss: 25.1128, RL loss: 154167408.0000, Reward: -1573889.6934
    full cols: 479, non-full cols: 18
   r - labels: 291, labels - r: 151
    violated: 8853, weighted: 9367.47265625, len: 0.0, nonzero: 0.09729930758476257
Epoch 900, Total loss: -77776961536.0000, CE loss: 25.1055, RL loss: -777769600.0000, Reward: -1585251.3242
    full cols: 485, non-full cols: 16
   r - labels: 296, labels - r: 152
    violated: 8619, weighted: 9457.072265625, len: 0.0, nonzero: 0.09793112426996231
Epoch 1000, Total loss: 27737303040.0000, CE loss: 25.0988, RL loss: 277373024.0000, Reward: -1565730.6055
    full cols: 480, non-full cols: 21
   r - labels: 296, labels - r: 152
    violated: 8575, weighted: 9466.296875, len: 0.0, nonzero: 0.09783820807933807
Epoch 1100, Total loss: 23496546304.0000, CE loss: 25.0933, RL loss: 234965456.0000, Reward: -1573275.4492
    full cols: 481, non-full cols: 20
   r - labels: 297, labels - r: 153
    violated: 8712, weighted: 9524.150390625, len: 0.0, nonzero: 0.09740151464939117
Epoch 1200, Total loss: 5315169792.0000, CE loss: 25.0880, RL loss: 53151700.0000, Reward: -1572282.1855
    full cols: 471, non-full cols: 28
   r - labels: 295, labels - r: 153
    violated: 8828, weighted: 9509.2021484375, len: 0.0, nonzero: 0.096983402967453
Epoch 1300, Total loss: 48719650816.0000, CE loss: 25.0830, RL loss: 487196512.0000, Reward: -1574747.5039
    full cols: 474, non-full cols: 29
   r - labels: 296, labels - r: 150
    violated: 8621, weighted: 9432.48828125, len: 0.0, nonzero: 0.09646927565336227
Epoch 1400, Total loss: -36967415808.0000, CE loss: 25.0792, RL loss: -369674176.0000, Reward: -1588563.4316
    full cols: 478, non-full cols: 22
   r - labels: 294, labels - r: 151
    violated: 9128, weighted: 9493.6845703125, len: 0.0, nonzero: 0.096967913210392
Epoch 1500, Total loss: -63795322880.0000, CE loss: 25.0759, RL loss: -637953216.0000, Reward: -1588142.0059
    full cols: 482, non-full cols: 15
   r - labels: 292, labels - r: 152
    violated: 9576, weighted: 9440.9599609375, len: 0.0, nonzero: 0.09707631915807724
Epoch 1600, Total loss: -4331565056.0000, CE loss: 25.0720, RL loss: -43315648.0000, Reward: -1586960.9648
    full cols: 465, non-full cols: 36
   r - labels: 296, labels - r: 152
    violated: 9006, weighted: 9292.0078125, len: 0.0, nonzero: 0.09558040648698807
Epoch 1700, Total loss: 24790886400.0000, CE loss: 25.0691, RL loss: 247908864.0000, Reward: -1575335.1152
    full cols: 467, non-full cols: 29
   r - labels: 292, labels - r: 153
    violated: 8743, weighted: 9327.0751953125, len: 0.0, nonzero: 0.0955277532339096
Epoch 1800, Total loss: 12119359488.0000, CE loss: 25.0648, RL loss: 121193600.0000, Reward: -1582053.1172
    full cols: 479, non-full cols: 20
   r - labels: 296, labels - r: 154
    violated: 9445, weighted: 9464.4326171875, len: 0.0, nonzero: 0.09687190502882004
Epoch 1900, Total loss: -5071622144.0000, CE loss: 25.0620, RL loss: -50716224.0000, Reward: -1584970.8711
    full cols: 454, non-full cols: 55
   r - labels: 306, labels - r: 154
    violated: 9487, weighted: 9577.041015625, len: 0.0, nonzero: 0.09617815166711807
--- eval ---
prediction result:
f1 on test:    0.5385
f1 on test:    0.8936 (micro)
f1 on KB:      0.6364
integrated f1: 0.6016, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5303
f1 on test:    0.8932 (micro)
f1 on KB:      0.6498
integrated f1: 0.6058, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: -32586866688.0000, CE loss: 25.0583, RL loss: -325868672.0000, Reward: -1584766.6113
    full cols: 474, non-full cols: 21
   r - labels: 292, labels - r: 154
    violated: 9214, weighted: 9418.6396484375, len: 0.0, nonzero: 0.09575074911117554
Epoch 2100, Total loss: 13587980288.0000, CE loss: 25.0554, RL loss: 135879808.0000, Reward: -1578135.4609
    full cols: 479, non-full cols: 9
   r - labels: 285, labels - r: 154
    violated: 8648, weighted: 9400.796875, len: 0.0, nonzero: 0.09571357816457748
Epoch 2200, Total loss: 17196232704.0000, CE loss: 25.0500, RL loss: 171962320.0000, Reward: -1579270.3574
    full cols: 475, non-full cols: 21
   r - labels: 291, labels - r: 152
    violated: 8427, weighted: 9344.943359375, len: 0.0, nonzero: 0.09596754610538483
Epoch 2300, Total loss: -101557821440.0000, CE loss: 25.0452, RL loss: -1015578176.0000, Reward: -1591876.6543
    full cols: 477, non-full cols: 17
   r - labels: 290, labels - r: 153
    violated: 9400, weighted: 9373.287109375, len: 0.0, nonzero: 0.09620292484760284
Epoch 2400, Total loss: 15442428928.0000, CE loss: 25.0400, RL loss: 154424288.0000, Reward: -1574307.6484
    full cols: 473, non-full cols: 23
   r - labels: 291, labels - r: 152
    violated: 9189, weighted: 9457.0498046875, len: 0.0, nonzero: 0.09678827971220016
Epoch 2500, Total loss: -76534751232.0000, CE loss: 25.0340, RL loss: -765347520.0000, Reward: -1585510.7344
    full cols: 468, non-full cols: 19
   r - labels: 281, labels - r: 151
    violated: 8507, weighted: 9156.63671875, len: 0.0, nonzero: 0.0951622948050499
Epoch 2600, Total loss: 47839252480.0000, CE loss: 25.0278, RL loss: 478392544.0000, Reward: -1574365.3809
    full cols: 473, non-full cols: 22
   r - labels: 288, labels - r: 150
    violated: 8332, weighted: 9266.140625, len: 0.0, nonzero: 0.09626796841621399
Epoch 2700, Total loss: 35306278912.0000, CE loss: 25.0212, RL loss: 353062784.0000, Reward: -1577549.0410
    full cols: 470, non-full cols: 29
   r - labels: 292, labels - r: 150
    violated: 9031, weighted: 9236.2587890625, len: 0.0, nonzero: 0.09607904404401779
Epoch 2800, Total loss: -14314374144.0000, CE loss: 25.0158, RL loss: -143143744.0000, Reward: -1591566.9473
    full cols: 464, non-full cols: 29
   r - labels: 288, labels - r: 152
    violated: 8978, weighted: 9221.4189453125, len: 0.0, nonzero: 0.0949300080537796
Epoch 2900, Total loss: -16069675008.0000, CE loss: 25.0101, RL loss: -160696752.0000, Reward: -1587898.6914
    full cols: 476, non-full cols: 9
   r - labels: 279, labels - r: 151
    violated: 9005, weighted: 9191.3525390625, len: 0.0, nonzero: 0.09543793648481369
Epoch 3000, Total loss: -28552818688.0000, CE loss: 25.0046, RL loss: -285528192.0000, Reward: -1586832.7090
    full cols: 469, non-full cols: 26
   r - labels: 291, labels - r: 153
    violated: 8784, weighted: 9296.8720703125, len: 0.0, nonzero: 0.0952799841761589
Epoch 3100, Total loss: 21270097920.0000, CE loss: 25.0007, RL loss: 212700976.0000, Reward: -1604847.9180
    full cols: 455, non-full cols: 42
   r - labels: 294, labels - r: 154
    violated: 8952, weighted: 9398.322265625, len: 0.0, nonzero: 0.0953233391046524
Epoch 3200, Total loss: 122732707840.0000, CE loss: 24.9973, RL loss: 1227327104.0000, Reward: -1605842.8281
    full cols: 461, non-full cols: 29
   r - labels: 289, labels - r: 156
    violated: 9312, weighted: 9419.5986328125, len: 0.0, nonzero: 0.09389866143465042
Epoch 3300, Total loss: -24799102976.0000, CE loss: 24.9942, RL loss: -247991024.0000, Reward: -1632147.4492
    full cols: 429, non-full cols: 88
   r - labels: 311, labels - r: 151
    violated: 8576, weighted: 9450.0810546875, len: 0.0, nonzero: 0.09500433504581451
Epoch 3400, Total loss: 1706168960.0000, CE loss: 24.9920, RL loss: 17061690.0000, Reward: -1653008.7520
    full cols: 464, non-full cols: 20
   r - labels: 284, labels - r: 157
    violated: 9093, weighted: 9554.7138671875, len: 0.0, nonzero: 0.09410617500543594
Epoch 3500, Total loss: -25255712768.0000, CE loss: 24.9894, RL loss: -252557120.0000, Reward: -1619964.5938
    full cols: 461, non-full cols: 39
   r - labels: 305, labels - r: 162
    violated: 8490, weighted: 9802.515625, len: 0.0, nonzero: 0.09492071717977524
Epoch 3600, Total loss: -67381608448.0000, CE loss: 24.9875, RL loss: -673816064.0000, Reward: -1656342.3633
    full cols: 459, non-full cols: 36
   r - labels: 297, labels - r: 159
    violated: 8429, weighted: 9665.8955078125, len: 0.0, nonzero: 0.09481541067361832
Epoch 3700, Total loss: -52423979008.0000, CE loss: 24.9849, RL loss: -524239776.0000, Reward: -1660474.7129
    full cols: 460, non-full cols: 39
   r - labels: 304, labels - r: 162
    violated: 8246, weighted: 9803.4296875, len: 0.0, nonzero: 0.09523043036460876
Epoch 3800, Total loss: -103802126336.0000, CE loss: 24.9835, RL loss: -1038021248.0000, Reward: -1669362.6348
    full cols: 460, non-full cols: 26
   r - labels: 292, labels - r: 163
    violated: 8890, weighted: 9745.728515625, len: 0.0, nonzero: 0.09435084462165833
Epoch 3900, Total loss: -10465096704.0000, CE loss: 24.9808, RL loss: -104650968.0000, Reward: -1646113.6367
    full cols: 471, non-full cols: 26
   r - labels: 309, labels - r: 169
    violated: 8423, weighted: 10150.89453125, len: 0.0, nonzero: 0.0956423431634903
--- eval ---
prediction result:
f1 on test:    0.5379
f1 on test:    0.8939 (micro)
f1 on KB:      0.6373
integrated f1: 0.6019, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5296
f1 on test:    0.8932 (micro)
f1 on KB:      0.6496
integrated f1: 0.6054, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: 5843143168.0000, CE loss: 24.9799, RL loss: 58431432.0000, Reward: -1649619.0938
    full cols: 474, non-full cols: 20
   r - labels: 308, labels - r: 171
    violated: 8743, weighted: 10296.556640625, len: 0.0, nonzero: 0.09631752222776413
Epoch 4100, Total loss: -55466565632.0000, CE loss: 24.9788, RL loss: -554665664.0000, Reward: -1659607.7812
    full cols: 480, non-full cols: 23
   r - labels: 317, labels - r: 171
    violated: 7906, weighted: 10432.3359375, len: 0.0, nonzero: 0.09737983345985413
Epoch 4200, Total loss: -92478373888.0000, CE loss: 24.9772, RL loss: -924783744.0000, Reward: -1656310.4824
    full cols: 478, non-full cols: 29
   r - labels: 323, labels - r: 173
    violated: 8736, weighted: 10570.28125, len: 0.0, nonzero: 0.09793421626091003
Epoch 4300, Total loss: 33201152000.0000, CE loss: 24.9758, RL loss: 332011520.0000, Reward: -1646950.5684
    full cols: 480, non-full cols: 35
   r - labels: 331, labels - r: 173
    violated: 8281, weighted: 10658.861328125, len: 0.0, nonzero: 0.0986279770731926
Epoch 4400, Total loss: -35936088064.0000, CE loss: 24.9763, RL loss: -359360896.0000, Reward: -1694251.4434
    full cols: 439, non-full cols: 121
   r - labels: 368, labels - r: 165
    violated: 8952, weighted: 10706.73046875, len: 0.0, nonzero: 0.09940225630998611
Epoch 4500, Total loss: 46656356352.0000, CE loss: 24.9758, RL loss: 466563552.0000, Reward: -1688093.1953
    full cols: 475, non-full cols: 56
   r - labels: 345, labels - r: 171
    violated: 8537, weighted: 10713.53515625, len: 0.0, nonzero: 0.10032829642295837
Epoch 4600, Total loss: 17099460608.0000, CE loss: 24.9744, RL loss: 170994608.0000, Reward: -1698762.5938
    full cols: 481, non-full cols: 38
   r - labels: 335, labels - r: 173
    violated: 8981, weighted: 10765.6416015625, len: 0.0, nonzero: 0.09988231211900711
Epoch 4700, Total loss: 22523383808.0000, CE loss: 24.9748, RL loss: 225233840.0000, Reward: -1730636.4395
    full cols: 477, non-full cols: 44
   r - labels: 340, labels - r: 176
    violated: 8784, weighted: 11027.2294921875, len: 0.0, nonzero: 0.09963454306125641
Epoch 4800, Total loss: 73134743552.0000, CE loss: 24.9732, RL loss: 731347456.0000, Reward: -1708964.9141
    full cols: 434, non-full cols: 136
   r - labels: 382, labels - r: 169
    violated: 9004, weighted: 11268.65234375, len: 0.0, nonzero: 0.10064110904932022
Epoch 4900, Total loss: 43530268672.0000, CE loss: 24.9722, RL loss: 435302688.0000, Reward: -1724084.6230
    full cols: 485, non-full cols: 48
   r - labels: 353, labels - r: 177
    violated: 8609, weighted: 11407.171875, len: 0.0, nonzero: 0.10124195367097855
Epoch 5000, Total loss: -55540781056.0000, CE loss: 24.9706, RL loss: -555407808.0000, Reward: -1712827.4668
    full cols: 482, non-full cols: 48
   r - labels: 353, labels - r: 180
    violated: 9156, weighted: 11405.50390625, len: 0.0, nonzero: 0.10056058317422867
Epoch 5100, Total loss: 67956006912.0000, CE loss: 24.9698, RL loss: 679560064.0000, Reward: -1690479.2988
    full cols: 480, non-full cols: 56
   r - labels: 359, labels - r: 180
    violated: 8756, weighted: 11429.3505859375, len: 0.0, nonzero: 0.10110567510128021
Epoch 5200, Total loss: 4182247680.0000, CE loss: 24.9689, RL loss: 41822476.0000, Reward: -1703821.9844
    full cols: 491, non-full cols: 38
   r - labels: 355, labels - r: 183
    violated: 9952, weighted: 11519.830078125, len: 0.0, nonzero: 0.10022608935832977
Epoch 5300, Total loss: -14831362048.0000, CE loss: 24.9694, RL loss: -148313616.0000, Reward: -1726705.3750
    full cols: 476, non-full cols: 54
   r - labels: 358, labels - r: 185
    violated: 9329, weighted: 11540.171875, len: 0.0, nonzero: 0.10005265474319458
Epoch 5400, Total loss: -20345303040.0000, CE loss: 24.9686, RL loss: -203453024.0000, Reward: -1732721.3301
    full cols: 481, non-full cols: 47
   r - labels: 360, labels - r: 189
    violated: 8940, weighted: 11764.90234375, len: 0.0, nonzero: 0.10027255117893219
Epoch 5500, Total loss: 17741477888.0000, CE loss: 24.9685, RL loss: 177414784.0000, Reward: -1739432.3086
    full cols: 489, non-full cols: 42
   r - labels: 364, labels - r: 190
    violated: 9307, weighted: 11913.4853515625, len: 0.0, nonzero: 0.10130389034748077
Epoch 5600, Total loss: 15565854720.0000, CE loss: 24.9670, RL loss: 155658544.0000, Reward: -1727830.2891
    full cols: 488, non-full cols: 43
   r - labels: 361, labels - r: 187
    violated: 8761, weighted: 11814.4453125, len: 0.0, nonzero: 0.10110877454280853
Epoch 5700, Total loss: 47714115584.0000, CE loss: 24.9665, RL loss: 477141152.0000, Reward: -1733453.0664
    full cols: 479, non-full cols: 46
   r - labels: 356, labels - r: 188
    violated: 8641, weighted: 11704.51171875, len: 0.0, nonzero: 0.10005265474319458
Epoch 5800, Total loss: -70901456896.0000, CE loss: 24.9652, RL loss: -709014592.0000, Reward: -1742063.4043
    full cols: 483, non-full cols: 40
   r - labels: 353, labels - r: 187
    violated: 8426, weighted: 11642.1416015625, len: 0.0, nonzero: 0.1002880334854126
Epoch 5900, Total loss: -47473307648.0000, CE loss: 24.9646, RL loss: -474733088.0000, Reward: -1748847.1582
    full cols: 479, non-full cols: 48
   r - labels: 355, labels - r: 185
    violated: 8425, weighted: 11534.716796875, len: 0.0, nonzero: 0.09975842386484146
--- eval ---
prediction result:
f1 on test:    0.5368
f1 on test:    0.8938 (micro)
f1 on KB:      0.6370
integrated f1: 0.6012, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5300
f1 on test:    0.8934 (micro)
f1 on KB:      0.6488
integrated f1: 0.6051, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: 60436422656.0000, CE loss: 24.9635, RL loss: 604364224.0000, Reward: -1751348.7246
    full cols: 491, non-full cols: 47
   r - labels: 367, labels - r: 186
    violated: 8594, weighted: 11678.6376953125, len: 0.0, nonzero: 0.10189234465360641
Epoch 6100, Total loss: 81775321088.0000, CE loss: 24.9629, RL loss: 817753216.0000, Reward: -1763473.2500
    full cols: 497, non-full cols: 44
   r - labels: 368, labels - r: 184
    violated: 8887, weighted: 11829.8388671875, len: 0.0, nonzero: 0.10236620903015137
Epoch 6200, Total loss: -29924163584.0000, CE loss: 24.9617, RL loss: -299241632.0000, Reward: -1768654.1172
    full cols: 493, non-full cols: 45
   r - labels: 365, labels - r: 184
    violated: 8446, weighted: 11791.0517578125, len: 0.0, nonzero: 0.102341428399086
Epoch 6300, Total loss: 67159859200.0000, CE loss: 24.9612, RL loss: 671598592.0000, Reward: -1786160.9902
    full cols: 478, non-full cols: 63
   r - labels: 368, labels - r: 184
    violated: 8961, weighted: 11834.8515625, len: 0.0, nonzero: 0.10114903748035431
Epoch 6400, Total loss: -57039294464.0000, CE loss: 24.9593, RL loss: -570392960.0000, Reward: -1785871.4746
    full cols: 489, non-full cols: 33
   r - labels: 353, labels - r: 188
    violated: 8969, weighted: 11693.548828125, len: 0.0, nonzero: 0.10017344355583191
Epoch 6500, Total loss: 63467159552.0000, CE loss: 24.9584, RL loss: 634671616.0000, Reward: -1766087.2441
    full cols: 498, non-full cols: 33
   r - labels: 357, labels - r: 183
    violated: 8891, weighted: 11757.3056640625, len: 0.0, nonzero: 0.10136273503303528
Epoch 6600, Total loss: -24877690880.0000, CE loss: 24.9570, RL loss: -248776912.0000, Reward: -1763392.7832
    full cols: 497, non-full cols: 19
   r - labels: 346, labels - r: 187
    violated: 8649, weighted: 11595.857421875, len: 0.0, nonzero: 0.10010530799627304
Epoch 6700, Total loss: -46717648896.0000, CE loss: 24.9572, RL loss: -467176480.0000, Reward: -1800486.8125
    full cols: 445, non-full cols: 116
   r - labels: 377, labels - r: 173
    violated: 8450, weighted: 11614.30078125, len: 0.0, nonzero: 0.10059155523777008
Epoch 6800, Total loss: -74301079552.0000, CE loss: 24.9561, RL loss: -743010816.0000, Reward: -1800348.8867
    full cols: 477, non-full cols: 48
   r - labels: 346, labels - r: 178
    violated: 8816, weighted: 11340.783203125, len: 0.0, nonzero: 0.10056058317422867
Epoch 6900, Total loss: -69308628992.0000, CE loss: 24.9564, RL loss: -693086272.0000, Reward: -1838875.6660
    full cols: 477, non-full cols: 50
   r - labels: 346, labels - r: 176
    violated: 8228, weighted: 11339.34765625, len: 0.0, nonzero: 0.09940845519304276
Epoch 7000, Total loss: 175474262016.0000, CE loss: 24.9561, RL loss: 1754742656.0000, Reward: -1832836.7422
    full cols: 464, non-full cols: 77
   r - labels: 361, labels - r: 177
    violated: 7844, weighted: 11461.8583984375, len: 0.0, nonzero: 0.1005946546792984
Epoch 7100, Total loss: -34844205056.0000, CE loss: 24.9558, RL loss: -348442048.0000, Reward: -1872534.4062
    full cols: 472, non-full cols: 62
   r - labels: 358, labels - r: 181
    violated: 8785, weighted: 11507.0546875, len: 0.0, nonzero: 0.09988231211900711
Epoch 7200, Total loss: 26214440960.0000, CE loss: 24.9538, RL loss: 262144400.0000, Reward: -1821982.1895
    full cols: 455, non-full cols: 105
   r - labels: 377, labels - r: 174
    violated: 8666, weighted: 11615.326171875, len: 0.0, nonzero: 0.10094153136014938
Epoch 7300, Total loss: 46085373952.0000, CE loss: 24.9536, RL loss: 460853728.0000, Reward: -1831541.9883
    full cols: 474, non-full cols: 44
   r - labels: 344, labels - r: 183
    violated: 8263, weighted: 11319.2548828125, len: 0.0, nonzero: 0.09807978570461273
Epoch 7400, Total loss: -87782645760.0000, CE loss: 24.9540, RL loss: -877826496.0000, Reward: -1872805.5156
    full cols: 444, non-full cols: 111
   r - labels: 376, labels - r: 178
    violated: 8595, weighted: 11393.0400390625, len: 0.0, nonzero: 0.09880761057138443
Epoch 7500, Total loss: -209101127680.0000, CE loss: 24.9534, RL loss: -2091011328.0000, Reward: -1900401.4590
    full cols: 452, non-full cols: 84
   r - labels: 359, labels - r: 180
    violated: 8382, weighted: 11430.75390625, len: 0.0, nonzero: 0.09871779382228851
Epoch 7600, Total loss: 116007870464.0000, CE loss: 24.9531, RL loss: 1160078720.0000, Reward: -1864115.1875
    full cols: 469, non-full cols: 52
   r - labels: 343, labels - r: 179
    violated: 8451, weighted: 11313.47265625, len: 0.0, nonzero: 0.09768954664468765
Epoch 7700, Total loss: 12710932480.0000, CE loss: 24.9515, RL loss: 127109320.0000, Reward: -1840763.1211
    full cols: 473, non-full cols: 45
   r - labels: 343, labels - r: 182
    violated: 8453, weighted: 11218.181640625, len: 0.0, nonzero: 0.09777317196130753
Epoch 7800, Total loss: -45791010816.0000, CE loss: 24.9509, RL loss: -457910112.0000, Reward: -1829268.7656
    full cols: 471, non-full cols: 54
   r - labels: 350, labels - r: 182
    violated: 9305, weighted: 11253.859375, len: 0.0, nonzero: 0.09853196144104004
Epoch 7900, Total loss: -127222439936.0000, CE loss: 24.9499, RL loss: -1272224384.0000, Reward: -1801177.6660
    full cols: 484, non-full cols: 33
   r - labels: 341, labels - r: 181
    violated: 8390, weighted: 11232.2578125, len: 0.0, nonzero: 0.0993279293179512
--- eval ---
prediction result:
f1 on test:    0.5350
f1 on test:    0.8937 (micro)
f1 on KB:      0.6375
integrated f1: 0.6008, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5276
f1 on test:    0.8931 (micro)
f1 on KB:      0.6493
integrated f1: 0.6043, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: 145006526464.0000, CE loss: 24.9495, RL loss: 1450065280.0000, Reward: -1793955.9336
    full cols: 474, non-full cols: 46
   r - labels: 342, labels - r: 179
    violated: 8766, weighted: 11202.712890625, len: 0.0, nonzero: 0.0991668775677681
Epoch 8100, Total loss: -38390239232.0000, CE loss: 24.9498, RL loss: -383902400.0000, Reward: -1812252.9316
    full cols: 464, non-full cols: 48
   r - labels: 338, labels - r: 183
    violated: 8371, weighted: 11200.6279296875, len: 0.0, nonzero: 0.09782581776380539
Epoch 8200, Total loss: -92344238080.0000, CE loss: 24.9492, RL loss: -923442368.0000, Reward: -1785420.4531
    full cols: 466, non-full cols: 45
   r - labels: 338, labels - r: 184
    violated: 8574, weighted: 11255.482421875, len: 0.0, nonzero: 0.09684093296527863
Epoch 8300, Total loss: -31597580288.0000, CE loss: 24.9488, RL loss: -315975808.0000, Reward: -1785849.3242
    full cols: 465, non-full cols: 39
   r - labels: 335, labels - r: 188
    violated: 9038, weighted: 11412.2880859375, len: 0.0, nonzero: 0.09662723541259766
Epoch 8400, Total loss: 46171533312.0000, CE loss: 24.9489, RL loss: 461715328.0000, Reward: -1778267.2656
    full cols: 463, non-full cols: 42
   r - labels: 339, labels - r: 191
    violated: 9421, weighted: 11280.947265625, len: 0.0, nonzero: 0.09544103592634201
Epoch 8500, Total loss: 41958842368.0000, CE loss: 24.9486, RL loss: 419588416.0000, Reward: -1758120.4199
    full cols: 451, non-full cols: 46
   r - labels: 334, labels - r: 194
    violated: 9196, weighted: 11305.2783203125, len: 0.0, nonzero: 0.09454905986785889
Epoch 8600, Total loss: -114087141376.0000, CE loss: 24.9487, RL loss: -1140871424.0000, Reward: -1773631.6602
    full cols: 461, non-full cols: 29
   r - labels: 325, labels - r: 192
    violated: 8294, weighted: 11343.1328125, len: 0.0, nonzero: 0.09407829493284225
Epoch 8700, Total loss: -39401844736.0000, CE loss: 24.9481, RL loss: -394018432.0000, Reward: -1753532.2148
    full cols: 464, non-full cols: 39
   r - labels: 340, labels - r: 194
    violated: 9093, weighted: 11468.0654296875, len: 0.0, nonzero: 0.09560517966747284
Epoch 8800, Total loss: 7480907264.0000, CE loss: 24.9486, RL loss: 74809072.0000, Reward: -1751206.1035
    full cols: 463, non-full cols: 44
   r - labels: 344, labels - r: 194
    violated: 8710, weighted: 11736.3310546875, len: 0.0, nonzero: 0.09591489285230637
Epoch 8900, Total loss: 15827464192.0000, CE loss: 24.9483, RL loss: 158274640.0000, Reward: -1752864.3184
    full cols: 463, non-full cols: 46
   r - labels: 344, labels - r: 192
    violated: 8033, weighted: 11759.76953125, len: 0.0, nonzero: 0.09615956991910934
Epoch 9000, Total loss: 67399065600.0000, CE loss: 24.9482, RL loss: 673990656.0000, Reward: -1737720.1953
    full cols: 473, non-full cols: 30
   r - labels: 342, labels - r: 196
    violated: 9000, weighted: 11779.943359375, len: 0.0, nonzero: 0.09691216796636581
Epoch 9100, Total loss: -93190283264.0000, CE loss: 24.9479, RL loss: -931902848.0000, Reward: -1764877.0312
    full cols: 463, non-full cols: 45
   r - labels: 343, labels - r: 192
    violated: 8479, weighted: 11597.81640625, len: 0.0, nonzero: 0.09577552229166031
Epoch 9200, Total loss: 119386955776.0000, CE loss: 24.9483, RL loss: 1193869568.0000, Reward: -1736922.0215
    full cols: 446, non-full cols: 67
   r - labels: 350, labels - r: 194
    violated: 8520, weighted: 11719.033203125, len: 0.0, nonzero: 0.09659935534000397
Epoch 9300, Total loss: 128369532928.0000, CE loss: 24.9471, RL loss: 1283695360.0000, Reward: -1721742.1777
    full cols: 454, non-full cols: 40
   r - labels: 336, labels - r: 199
    violated: 8604, weighted: 11663.96875, len: 0.0, nonzero: 0.09455525875091553
Epoch 9400, Total loss: 26436352000.0000, CE loss: 24.9477, RL loss: 264363520.0000, Reward: -1738234.1191
    full cols: 454, non-full cols: 50
   r - labels: 347, labels - r: 200
    violated: 8730, weighted: 11767.701171875, len: 0.0, nonzero: 0.09490213543176651
Epoch 9500, Total loss: 44884873216.0000, CE loss: 24.9475, RL loss: 448848736.0000, Reward: -1742726.5391
    full cols: 459, non-full cols: 31
   r - labels: 336, labels - r: 203
    violated: 9232, weighted: 11802.0771484375, len: 0.0, nonzero: 0.09376239031553268
Epoch 9600, Total loss: -40078680064.0000, CE loss: 24.9476, RL loss: -400786816.0000, Reward: -1734449.3789
    full cols: 470, non-full cols: 15
   r - labels: 333, labels - r: 205
    violated: 8894, weighted: 11837.90625, len: 0.0, nonzero: 0.09476276487112045
Epoch 9700, Total loss: 3862183680.0000, CE loss: 24.9474, RL loss: 38621836.0000, Reward: -1706638.7852
    full cols: 467, non-full cols: 29
   r - labels: 347, labels - r: 208
    violated: 8706, weighted: 12055.16796875, len: 0.0, nonzero: 0.09503840655088425
Epoch 9800, Total loss: 4002364928.0000, CE loss: 24.9471, RL loss: 40023648.0000, Reward: -1712651.3887
    full cols: 451, non-full cols: 28
   r - labels: 330, labels - r: 208
    violated: 9258, weighted: 11671.494140625, len: 0.0, nonzero: 0.09268458932638168
Epoch 9900, Total loss: 58889101312.0000, CE loss: 24.9471, RL loss: 588891008.0000, Reward: -1711518.6387
    full cols: 447, non-full cols: 24
   r - labels: 321, labels - r: 207
    violated: 9106, weighted: 11594.2587890625, len: 0.0, nonzero: 0.09114532172679901
--- eval ---
prediction result:
f1 on test:    0.5347
f1 on test:    0.8937 (micro)
f1 on KB:      0.6376
integrated f1: 0.6007, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5287
f1 on test:    0.8930 (micro)
f1 on KB:      0.6479
integrated f1: 0.6040, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 10000, Total loss: 10974279680.0000, CE loss: 24.9473, RL loss: 109742792.0000, Reward: -1712998.9297
    full cols: 451, non-full cols: 29
   r - labels: 329, labels - r: 206
    violated: 9524, weighted: 11645.0517578125, len: 0.0, nonzero: 0.09199083596467972
Epoch 10100, Total loss: -44870488064.0000, CE loss: 24.9467, RL loss: -448704864.0000, Reward: -1721786.3965
    full cols: 450, non-full cols: 33
   r - labels: 335, labels - r: 209
    violated: 8846, weighted: 11627.154296875, len: 0.0, nonzero: 0.09175854921340942
Epoch 10200, Total loss: -80152870912.0000, CE loss: 24.9467, RL loss: -801528704.0000, Reward: -1745755.6699
    full cols: 445, non-full cols: 31
   r - labels: 329, labels - r: 210
    violated: 9007, weighted: 11697.447265625, len: 0.0, nonzero: 0.0906621664762497
Epoch 10300, Total loss: 702326592.0000, CE loss: 24.9472, RL loss: 7023266.0000, Reward: -1742404.5215
    full cols: 450, non-full cols: 43
   r - labels: 342, labels - r: 206
    violated: 9551, weighted: 11814.791015625, len: 0.0, nonzero: 0.09297572076320648
Epoch 10400, Total loss: -47176925184.0000, CE loss: 24.9470, RL loss: -471769248.0000, Reward: -1744447.3027
    full cols: 454, non-full cols: 35
   r - labels: 336, labels - r: 204
    violated: 9103, weighted: 11689.7861328125, len: 0.0, nonzero: 0.09353010356426239
Epoch 10500, Total loss: -13640738816.0000, CE loss: 24.9473, RL loss: -136407392.0000, Reward: -1739592.0234
    full cols: 459, non-full cols: 31
   r - labels: 337, labels - r: 204
    violated: 8839, weighted: 11674.89453125, len: 0.0, nonzero: 0.09388627856969833
Epoch 10600, Total loss: -61324390400.0000, CE loss: 24.9471, RL loss: -613243904.0000, Reward: -1761562.5488
    full cols: 450, non-full cols: 32
   r - labels: 331, labels - r: 206
    violated: 9257, weighted: 11707.4765625, len: 0.0, nonzero: 0.09236868470907211
Epoch 10700, Total loss: 36006756352.0000, CE loss: 24.9468, RL loss: 360067584.0000, Reward: -1733412.7598
    full cols: 448, non-full cols: 38
   r - labels: 336, labels - r: 207
    violated: 8424, weighted: 11764.142578125, len: 0.0, nonzero: 0.09326685220003128
Epoch 10800, Total loss: 90134659072.0000, CE loss: 24.9470, RL loss: 901346560.0000, Reward: -1740384.4453
    full cols: 453, non-full cols: 28
   r - labels: 334, labels - r: 210
    violated: 9359, weighted: 11714.076171875, len: 0.0, nonzero: 0.09190411865711212
Epoch 10900, Total loss: 138888445952.0000, CE loss: 24.9472, RL loss: 1388884480.0000, Reward: -1754349.9766
    full cols: 459, non-full cols: 26
   r - labels: 339, labels - r: 211
    violated: 8102, weighted: 12068.2236328125, len: 0.0, nonzero: 0.09420837461948395
Epoch 11000, Total loss: 44274749440.0000, CE loss: 24.9470, RL loss: 442747488.0000, Reward: -1749028.9414
    full cols: 460, non-full cols: 31
   r - labels: 346, labels - r: 212
    violated: 9029, weighted: 12183.916015625, len: 0.0, nonzero: 0.09383362531661987
Epoch 11100, Total loss: -174757724160.0000, CE loss: 24.9468, RL loss: -1747577216.0000, Reward: -1796388.0703
    full cols: 440, non-full cols: 42
   r - labels: 336, labels - r: 211
    violated: 8800, weighted: 11902.28125, len: 0.0, nonzero: 0.09176164865493774
Epoch 11200, Total loss: 23499180032.0000, CE loss: 24.9465, RL loss: 234991808.0000, Reward: -1780691.1641
    full cols: 443, non-full cols: 35
   r - labels: 336, labels - r: 215
    violated: 8717, weighted: 12034.1611328125, len: 0.0, nonzero: 0.09245540201663971
Epoch 11300, Total loss: 663192000.0000, CE loss: 24.9467, RL loss: 6631920.0000, Reward: -1787283.8535
    full cols: 439, non-full cols: 37
   r - labels: 336, labels - r: 217
    violated: 9205, weighted: 11990.228515625, len: 0.0, nonzero: 0.09108956903219223
Epoch 11400, Total loss: -275895058432.0000, CE loss: 24.9468, RL loss: -2758950656.0000, Reward: -1819543.3633
    full cols: 431, non-full cols: 50
   r - labels: 340, labels - r: 216
    violated: 9076, weighted: 11860.548828125, len: 0.0, nonzero: 0.09101833403110504
Epoch 11500, Total loss: -44983877632.0000, CE loss: 24.9462, RL loss: -449838784.0000, Reward: -1782670.8750
    full cols: 450, non-full cols: 23
   r - labels: 340, labels - r: 224
    violated: 9307, weighted: 12241.4267578125, len: 0.0, nonzero: 0.09207755327224731
Epoch 11600, Total loss: 196138713088.0000, CE loss: 24.9464, RL loss: 1961387136.0000, Reward: -1765138.0820
    full cols: 442, non-full cols: 41
   r - labels: 345, labels - r: 219
    violated: 9406, weighted: 12140.2890625, len: 0.0, nonzero: 0.09211781620979309
Epoch 11700, Total loss: 82897043456.0000, CE loss: 24.9467, RL loss: 828970432.0000, Reward: -1792461.9824
    full cols: 435, non-full cols: 54
   r - labels: 354, labels - r: 222
    violated: 8750, weighted: 12275.80859375, len: 0.0, nonzero: 0.09180501103401184
Epoch 11800, Total loss: 90823196672.0000, CE loss: 24.9463, RL loss: 908232000.0000, Reward: -1807996.2734
    full cols: 445, non-full cols: 48
   r - labels: 354, labels - r: 218
    violated: 8741, weighted: 12151.671875, len: 0.0, nonzero: 0.09278060495853424
Epoch 11900, Total loss: 119694909440.0000, CE loss: 24.9463, RL loss: 1196949120.0000, Reward: -1825339.3711
    full cols: 447, non-full cols: 54
   r - labels: 363, labels - r: 219
    violated: 8640, weighted: 12242.267578125, len: 0.0, nonzero: 0.09382433444261551
--- eval ---
prediction result:
f1 on test:    0.5347
f1 on test:    0.8937 (micro)
f1 on KB:      0.6376
integrated f1: 0.6007, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5300
f1 on test:    0.8931 (micro)
f1 on KB:      0.6464
integrated f1: 0.6037, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 12000, Total loss: -25312186368.0000, CE loss: 24.9463, RL loss: -253121872.0000, Reward: -1823310.8477
    full cols: 452, non-full cols: 42
   r - labels: 361, labels - r: 224
    violated: 9772, weighted: 12543.08984375, len: 0.0, nonzero: 0.093765489757061
Epoch 12100, Total loss: 38721589248.0000, CE loss: 24.9462, RL loss: 387215904.0000, Reward: -1821936.5918
    full cols: 450, non-full cols: 43
   r - labels: 359, labels - r: 223
    violated: 9952, weighted: 12615.390625, len: 0.0, nonzero: 0.09361062943935394
Epoch 12200, Total loss: 25189957632.0000, CE loss: 24.9463, RL loss: 251899584.0000, Reward: -1833858.3789
    full cols: 449, non-full cols: 46
   r - labels: 362, labels - r: 224
    violated: 8962, weighted: 12650.82421875, len: 0.0, nonzero: 0.09375
Epoch 12300, Total loss: 146996101120.0000, CE loss: 24.9459, RL loss: 1469960960.0000, Reward: -1844401.7891
    full cols: 447, non-full cols: 50
   r - labels: 362, labels - r: 222
    violated: 9140, weighted: 12556.703125, len: 0.0, nonzero: 0.09366947412490845
Epoch 12400, Total loss: 28230512640.0000, CE loss: 24.9465, RL loss: 282305120.0000, Reward: -1889602.5645
    full cols: 453, non-full cols: 50
   r - labels: 369, labels - r: 223
    violated: 9221, weighted: 12631.1064453125, len: 0.0, nonzero: 0.09414643794298172
Epoch 12500, Total loss: -9020362752.0000, CE loss: 24.9458, RL loss: -90203624.0000, Reward: -1867269.4805
    full cols: 443, non-full cols: 65
   r - labels: 370, labels - r: 219
    violated: 10162, weighted: 12572.2685546875, len: 0.0, nonzero: 0.09382123500108719
Epoch 12600, Total loss: 100223336448.0000, CE loss: 24.9459, RL loss: 1002233344.0000, Reward: -1867460.5781
    full cols: 452, non-full cols: 45
   r - labels: 363, labels - r: 223
    violated: 9241, weighted: 12483.9794921875, len: 0.0, nonzero: 0.0934155136346817
Epoch 12700, Total loss: 159870943232.0000, CE loss: 24.9467, RL loss: 1598709376.0000, Reward: -1874482.4102
    full cols: 435, non-full cols: 56
   r - labels: 354, labels - r: 220
    violated: 9499, weighted: 12195.89453125, len: 0.0, nonzero: 0.09145193547010422
Epoch 12800, Total loss: -43557089280.0000, CE loss: 24.9465, RL loss: -435570912.0000, Reward: -1897107.6875
    full cols: 435, non-full cols: 49
   r - labels: 349, labels - r: 222
    violated: 8981, weighted: 12307.2265625, len: 0.0, nonzero: 0.09157272428274155
Epoch 12900, Total loss: -47436144640.0000, CE loss: 24.9465, RL loss: -474361440.0000, Reward: -1906305.6328
    full cols: 438, non-full cols: 50
   r - labels: 351, labels - r: 220
    violated: 8969, weighted: 12303.884765625, len: 0.0, nonzero: 0.09218595176935196
Epoch 13000, Total loss: -56818130944.0000, CE loss: 24.9463, RL loss: -568181312.0000, Reward: -1907943.3594
    full cols: 409, non-full cols: 89
   r - labels: 361, labels - r: 220
    violated: 8363, weighted: 12133.314453125, len: 0.0, nonzero: 0.08980116993188858
Epoch 13100, Total loss: 21302245376.0000, CE loss: 24.9467, RL loss: 213022448.0000, Reward: -1921426.0059
    full cols: 443, non-full cols: 41
   r - labels: 348, labels - r: 221
    violated: 8836, weighted: 12176.693359375, len: 0.0, nonzero: 0.09158511459827423
Epoch 13200, Total loss: 65137713152.0000, CE loss: 24.9473, RL loss: 651377152.0000, Reward: -1949673.4629
    full cols: 420, non-full cols: 78
   r - labels: 360, labels - r: 219
    violated: 9195, weighted: 12281.4296875, len: 0.0, nonzero: 0.09065597504377365
Epoch 13300, Total loss: 172418105344.0000, CE loss: 24.9464, RL loss: 1724181120.0000, Reward: -1919402.2812
    full cols: 427, non-full cols: 66
   r - labels: 358, labels - r: 222
    violated: 9035, weighted: 12557.171875, len: 0.0, nonzero: 0.09239965677261353
Epoch 13400, Total loss: 8803005440.0000, CE loss: 24.9459, RL loss: 88030056.0000, Reward: -1920265.1660
    full cols: 433, non-full cols: 49
   r - labels: 349, labels - r: 224
    violated: 8645, weighted: 12456.95703125, len: 0.0, nonzero: 0.09074889123439789
Epoch 13500, Total loss: 124366454784.0000, CE loss: 24.9459, RL loss: 1243664512.0000, Reward: -1902685.0469
    full cols: 440, non-full cols: 43
   r - labels: 350, labels - r: 224
    violated: 10398, weighted: 12527.4453125, len: 0.0, nonzero: 0.09254831820726395
Epoch 13600, Total loss: 137076752384.0000, CE loss: 24.9461, RL loss: 1370767488.0000, Reward: -1903558.9688
    full cols: 433, non-full cols: 55
   r - labels: 355, labels - r: 224
    violated: 9294, weighted: 12526.966796875, len: 0.0, nonzero: 0.09246160089969635
Epoch 13700, Total loss: 54902280192.0000, CE loss: 24.9462, RL loss: 549022784.0000, Reward: -1899878.7012
    full cols: 428, non-full cols: 79
   r - labels: 373, labels - r: 223
    violated: 9294, weighted: 12671.853515625, len: 0.0, nonzero: 0.09200941771268845
Epoch 13800, Total loss: -88255217664.0000, CE loss: 24.9463, RL loss: -882552192.0000, Reward: -1932022.8027
    full cols: 453, non-full cols: 37
   r - labels: 361, labels - r: 228
    violated: 9016, weighted: 12891.173828125, len: 0.0, nonzero: 0.09337525069713593
Epoch 13900, Total loss: 11052699648.0000, CE loss: 24.9462, RL loss: 110526992.0000, Reward: -1906833.6406
    full cols: 451, non-full cols: 46
   r - labels: 366, labels - r: 226
    violated: 9125, weighted: 12864.0078125, len: 0.0, nonzero: 0.09469772130250931
--- eval ---
prediction result:
f1 on test:    0.5347
f1 on test:    0.8937 (micro)
f1 on KB:      0.6376
integrated f1: 0.6008, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.5301
f1 on test:    0.8935 (micro)
f1 on KB:      0.6458
integrated f1: 0.6034, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 14000, Total loss: 27654184960.0000, CE loss: 24.9459, RL loss: 276541856.0000, Reward: -1897717.0723
    full cols: 446, non-full cols: 46
   r - labels: 362, labels - r: 227
    violated: 9184, weighted: 12990.107421875, len: 0.0, nonzero: 0.09323278069496155
Epoch 14100, Total loss: 45341896704.0000, CE loss: 24.9462, RL loss: 453418976.0000, Reward: -1928035.5508
    full cols: 442, non-full cols: 47
   r - labels: 360, labels - r: 228
    violated: 8814, weighted: 12915.0439453125, len: 0.0, nonzero: 0.09311509132385254
Epoch 14200, Total loss: -140320178176.0000, CE loss: 24.9464, RL loss: -1403201792.0000, Reward: -1961955.7793
    full cols: 442, non-full cols: 43
   r - labels: 356, labels - r: 228
    violated: 9185, weighted: 12825.89453125, len: 0.0, nonzero: 0.09210852533578873
Epoch 14300, Total loss: 1928013184.0000, CE loss: 24.9457, RL loss: 19280132.0000, Reward: -1935223.6953
    full cols: 443, non-full cols: 32
   r - labels: 350, labels - r: 232
    violated: 9897, weighted: 12845.705078125, len: 0.0, nonzero: 0.09112673997879028
Epoch 14400, Total loss: 73054986240.0000, CE loss: 24.9463, RL loss: 730549888.0000, Reward: -1939835.0098
    full cols: 431, non-full cols: 48
   r - labels: 354, labels - r: 232
    violated: 8398, weighted: 12760.98828125, len: 0.0, nonzero: 0.09029670804738998
Epoch 14500, Total loss: -84279361536.0000, CE loss: 24.9460, RL loss: -842793600.0000, Reward: -1931858.1641
    full cols: 444, non-full cols: 40
   r - labels: 360, labels - r: 233
    violated: 8735, weighted: 12931.4375, len: 0.0, nonzero: 0.09226028621196747
Epoch 14600, Total loss: 33600937984.0000, CE loss: 24.9455, RL loss: 336009376.0000, Reward: -1921750.1094
    full cols: 439, non-full cols: 50
   r - labels: 361, labels - r: 229
    violated: 8840, weighted: 12740.0693359375, len: 0.0, nonzero: 0.09161607921123505
Epoch 14700, Total loss: 55135756288.0000, CE loss: 24.9458, RL loss: 551357568.0000, Reward: -1880788.2285
    full cols: 440, non-full cols: 44
   r - labels: 356, labels - r: 229
    violated: 9584, weighted: 12838.296875, len: 0.0, nonzero: 0.0917120948433876
Epoch 14800, Total loss: -92488949760.0000, CE loss: 24.9460, RL loss: -924889472.0000, Reward: -1900522.4102
    full cols: 438, non-full cols: 37
   r - labels: 345, labels - r: 227
    violated: 9193, weighted: 12612.884765625, len: 0.0, nonzero: 0.09050111472606659
Epoch 14900, Total loss: -103713488896.0000, CE loss: 24.9455, RL loss: -1037134848.0000, Reward: -1879531.6543
    full cols: 436, non-full cols: 35
   r - labels: 345, labels - r: 231
    violated: 9134, weighted: 12717.1875, len: 0.0, nonzero: 0.08960295468568802
Epoch 15000, Total loss: 170226712576.0000, CE loss: 24.9456, RL loss: 1702267136.0000, Reward: -1795519.7129
    full cols: 429, non-full cols: 30
   r - labels: 336, labels - r: 234
    violated: 8616, weighted: 12588.970703125, len: 0.0, nonzero: 0.08885964006185532
------ ABL Loop 1 ------
--- eval ---
prediction result:
f1 on test:    0.5347
f1 on test:    0.8937 (micro)
f1 on KB:      0.6377
f1 on orig KB: 0.3363
integrated f1: 0.3754, w_data: 0.3265, w_klg: 0.6735

integrated result:
f1 on test:    0.5293
f1 on test:    0.8932 (micro)
f1 on KB:      0.6464
f1 on orig KB: 0.3362
integrated f1: 0.3746, w_data: 0.3265, w_klg: 0.6735
------------
integrated f1 0.3754

KB before refine:
num_nodes: 5045.0000
num_edges: 3669.0000
density: 0.0001
avg_degree: 0.7273
avg_clustering: 0.0715
degree_assortativity: -0.3286
modularity: 0.6439
avg_betweenness: 0.0000
avg_closeness: 0.0022
Iteration 0: Loss = 1339812.500000
|Xk-Y|_F:  1339812.500000, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 1337255, f1 =  0.390872, approx slack: 3762111
rounded before pow |X_k-Y|_0 = 1337255, f1 =  0.390872

Iteration 20: Loss = 566107.187500
|Xk-Y|_F:  418858.125000, |X-X0|:  147249.046875
rounded |X_k-Y|_0 = 434928, f1 =  0.647036, approx slack: 377539
rounded before pow |X_k-Y|_0 = 691391, f1 =  0.597683

Iteration 40: Loss = 478558.343750
|Xk-Y|_F:  419032.125000, |X-X0|:  59526.218750
rounded |X_k-Y|_0 = 401189, f1 =  0.652264, approx slack: 163112
rounded before pow |X_k-Y|_0 = 480382, f1 =  0.639089

Iteration 60: Loss = 454594.000000
|Xk-Y|_F:  404148.031250, |X-X0|:  50445.968750
rounded |X_k-Y|_0 = 392815, f1 =  0.653598, approx slack: 190170
rounded before pow |X_k-Y|_0 = 514486, f1 =  0.634943

Iteration 80: Loss = 433926.843750
|Xk-Y|_F:  392145.406250, |X-X0|:  41781.445312
rounded |X_k-Y|_0 = 381176, f1 =  0.655420, approx slack: 198182
rounded before pow |X_k-Y|_0 = 531109, f1 =  0.632664

Iteration 100: Loss = 423508.937500
|Xk-Y|_F:  388482.031250, |X-X0|:  35026.902344
rounded |X_k-Y|_0 = 377797, f1 =  0.655954, approx slack: 190949
rounded before pow |X_k-Y|_0 = 526697, f1 =  0.633281

Iteration 120: Loss = 412334.156250
|Xk-Y|_F:  384321.593750, |X-X0|:  28012.556641
rounded |X_k-Y|_0 = 374003, f1 =  0.656551, approx slack: 190699
rounded before pow |X_k-Y|_0 = 529187, f1 =  0.632942

Iteration 140: Loss = 405526.812500
|Xk-Y|_F:  380585.437500, |X-X0|:  24941.371094
rounded |X_k-Y|_0 = 372410, f1 =  0.656811, approx slack: 194292
rounded before pow |X_k-Y|_0 = 534657, f1 =  0.632207

Iteration 160: Loss = 400725.156250
|Xk-Y|_F:  377755.343750, |X-X0|:  22969.798828
rounded |X_k-Y|_0 = 369916, f1 =  0.657211, approx slack: 193952
rounded before pow |X_k-Y|_0 = 534655, f1 =  0.632255

Iteration 180: Loss = 397446.312500
|Xk-Y|_F:  375997.625000, |X-X0|:  21448.703125
rounded |X_k-Y|_0 = 368913, f1 =  0.657372, approx slack: 193809
rounded before pow |X_k-Y|_0 = 534623, f1 =  0.632267

Iteration 200: Loss = 394877.656250
|Xk-Y|_F:  374307.281250, |X-X0|:  20570.373047
rounded |X_k-Y|_0 = 367467, f1 =  0.657605, approx slack: 192929
rounded before pow |X_k-Y|_0 = 533093, f1 =  0.632477

Iteration 220: Loss = 393047.843750
|Xk-Y|_F:  373116.750000, |X-X0|:  19931.101562
rounded |X_k-Y|_0 = 366903, f1 =  0.657714, approx slack: 192447
rounded before pow |X_k-Y|_0 = 533081, f1 =  0.632542

Iteration 240: Loss = 391507.531250
|Xk-Y|_F:  372147.968750, |X-X0|:  19359.566406
rounded |X_k-Y|_0 = 366606, f1 =  0.657767, approx slack: 192307
rounded before pow |X_k-Y|_0 = 533069, f1 =  0.632557

Iteration 260: Loss = 390153.218750
|Xk-Y|_F:  371287.750000, |X-X0|:  18865.455078
rounded |X_k-Y|_0 = 366243, f1 =  0.657827, approx slack: 188757
rounded before pow |X_k-Y|_0 = 530240, f1 =  0.633027

Iteration 280: Loss = 388907.437500
|Xk-Y|_F:  370519.281250, |X-X0|:  18388.150391
rounded |X_k-Y|_0 = 366071, f1 =  0.657858, approx slack: 188336
rounded before pow |X_k-Y|_0 = 529769, f1 =  0.633096

Iteration 300: Loss = 387785.593750
|Xk-Y|_F:  369833.156250, |X-X0|:  17952.437500
rounded |X_k-Y|_0 = 365876, f1 =  0.657892, approx slack: 188522
rounded before pow |X_k-Y|_0 = 529767, f1 =  0.633098

Iteration 320: Loss = 386788.500000
|Xk-Y|_F:  369224.468750, |X-X0|:  17564.025391
rounded |X_k-Y|_0 = 365667, f1 =  0.657927, approx slack: 188343
rounded before pow |X_k-Y|_0 = 529758, f1 =  0.633127

Iteration 340: Loss = 385886.781250
|Xk-Y|_F:  368667.187500, |X-X0|:  17219.582031
rounded |X_k-Y|_0 = 365388, f1 =  0.657972, approx slack: 188618
rounded before pow |X_k-Y|_0 = 529753, f1 =  0.633129

Iteration 360: Loss = 385098.968750
|Xk-Y|_F:  368156.375000, |X-X0|:  16942.595703
rounded |X_k-Y|_0 = 365225, f1 =  0.657998, approx slack: 187876
rounded before pow |X_k-Y|_0 = 528798, f1 =  0.633260

Iteration 380: Loss = 384383.812500
|Xk-Y|_F:  367685.250000, |X-X0|:  16698.562500
rounded |X_k-Y|_0 = 364989, f1 =  0.658037, approx slack: 187773
rounded before pow |X_k-Y|_0 = 528501, f1 =  0.633301

Iteration 400: Loss = 383724.656250
|Xk-Y|_F:  367243.312500, |X-X0|:  16481.349609
rounded |X_k-Y|_0 = 364799, f1 =  0.658067, approx slack: 187878
rounded before pow |X_k-Y|_0 = 528501, f1 =  0.633301

Iteration 420: Loss = 383100.812500
|Xk-Y|_F:  366830.875000, |X-X0|:  16269.937500
rounded |X_k-Y|_0 = 364621, f1 =  0.658095, approx slack: 187937
rounded before pow |X_k-Y|_0 = 528480, f1 =  0.633310

Iteration 440: Loss = 382506.437500
|Xk-Y|_F:  366446.000000, |X-X0|:  16060.451172
rounded |X_k-Y|_0 = 364386, f1 =  0.658133, approx slack: 187943
rounded before pow |X_k-Y|_0 = 528466, f1 =  0.633313

Iteration 460: Loss = 381946.343750
|Xk-Y|_F:  366086.375000, |X-X0|:  15859.959961
rounded |X_k-Y|_0 = 364120, f1 =  0.658176, approx slack: 188003
rounded before pow |X_k-Y|_0 = 528459, f1 =  0.633316

Iteration 480: Loss = 381433.093750
|Xk-Y|_F:  365769.000000, |X-X0|:  15664.085938
rounded |X_k-Y|_0 = 363870, f1 =  0.658219, approx slack: 188260
rounded before pow |X_k-Y|_0 = 528567, f1 =  0.633301

Iteration 500: Loss = 380904.531250
|Xk-Y|_F:  365436.843750, |X-X0|:  15467.677734
rounded |X_k-Y|_0 = 363633, f1 =  0.658263, approx slack: 190413
rounded before pow |X_k-Y|_0 = 531404, f1 =  0.633015

Iteration 520: Loss = 380379.687500
|Xk-Y|_F:  365110.250000, |X-X0|:  15269.424805
rounded |X_k-Y|_0 = 363355, f1 =  0.658311, approx slack: 202124
rounded before pow |X_k-Y|_0 = 542768, f1 =  0.631466

Iteration 540: Loss = 379867.656250
|Xk-Y|_F:  364796.093750, |X-X0|:  15071.560547
rounded |X_k-Y|_0 = 363165, f1 =  0.658343, approx slack: 202402
rounded before pow |X_k-Y|_0 = 542768, f1 =  0.631467

Iteration 560: Loss = 379387.250000
|Xk-Y|_F:  364503.968750, |X-X0|:  14883.283203
rounded |X_k-Y|_0 = 362915, f1 =  0.658383, approx slack: 202706
rounded before pow |X_k-Y|_0 = 542768, f1 =  0.631469

Iteration 580: Loss = 378916.937500
|Xk-Y|_F:  364214.531250, |X-X0|:  14702.392578
rounded |X_k-Y|_0 = 362799, f1 =  0.658403, approx slack: 202831
rounded before pow |X_k-Y|_0 = 542768, f1 =  0.631470

Iteration 600: Loss = 378478.468750
|Xk-Y|_F:  363944.218750, |X-X0|:  14534.240234
rounded |X_k-Y|_0 = 362696, f1 =  0.658423, approx slack: 202933
rounded before pow |X_k-Y|_0 = 542768, f1 =  0.631470

Iteration 620: Loss = 378064.000000
|Xk-Y|_F:  363679.093750, |X-X0|:  14384.917969
rounded |X_k-Y|_0 = 362496, f1 =  0.658455, approx slack: 203050
rounded before pow |X_k-Y|_0 = 542758, f1 =  0.631473

Iteration 640: Loss = 377691.500000
|Xk-Y|_F:  363456.875000, |X-X0|:  14234.629883
rounded |X_k-Y|_0 = 362363, f1 =  0.658476, approx slack: 203212
rounded before pow |X_k-Y|_0 = 542756, f1 =  0.631475

Iteration 660: Loss = 377286.500000
|Xk-Y|_F:  363196.468750, |X-X0|:  14090.033203
rounded |X_k-Y|_0 = 362195, f1 =  0.658506, approx slack: 202926
rounded before pow |X_k-Y|_0 = 542765, f1 =  0.631475

Iteration 680: Loss = 376866.968750
|Xk-Y|_F:  362939.687500, |X-X0|:  13927.267578
rounded |X_k-Y|_0 = 362092, f1 =  0.658528, approx slack: 203128
rounded before pow |X_k-Y|_0 = 542765, f1 =  0.631476

Iteration 700: Loss = 376463.156250
|Xk-Y|_F:  362702.562500, |X-X0|:  13760.595703
rounded |X_k-Y|_0 = 361962, f1 =  0.658553, approx slack: 203316
rounded before pow |X_k-Y|_0 = 542765, f1 =  0.631479

Iteration 720: Loss = 376094.781250
|Xk-Y|_F:  362477.937500, |X-X0|:  13616.833984
rounded |X_k-Y|_0 = 361821, f1 =  0.658578, approx slack: 189093
rounded before pow |X_k-Y|_0 = 528559, f1 =  0.633419

Iteration 740: Loss = 375705.500000
|Xk-Y|_F:  362241.531250, |X-X0|:  13463.959961
rounded |X_k-Y|_0 = 361705, f1 =  0.658598, approx slack: 189149
rounded before pow |X_k-Y|_0 = 528556, f1 =  0.633426

Iteration 760: Loss = 375299.687500
|Xk-Y|_F:  361987.968750, |X-X0|:  13311.729492
rounded |X_k-Y|_0 = 361546, f1 =  0.658624, approx slack: 189174
rounded before pow |X_k-Y|_0 = 528557, f1 =  0.633428

Iteration 780: Loss = 374958.750000
|Xk-Y|_F:  361765.468750, |X-X0|:  13193.270508
rounded |X_k-Y|_0 = 361366, f1 =  0.658654, approx slack: 189221
rounded before pow |X_k-Y|_0 = 528555, f1 =  0.633430

Iteration 800: Loss = 374653.937500
|Xk-Y|_F:  361560.062500, |X-X0|:  13093.872070
rounded |X_k-Y|_0 = 361213, f1 =  0.658681, approx slack: 189321
rounded before pow |X_k-Y|_0 = 528630, f1 =  0.633421

Iteration 820: Loss = 374400.625000
|Xk-Y|_F:  361376.500000, |X-X0|:  13024.134766
rounded |X_k-Y|_0 = 361138, f1 =  0.658695, approx slack: 189404
rounded before pow |X_k-Y|_0 = 528754, f1 =  0.633416

Iteration 840: Loss = 374094.718750
|Xk-Y|_F:  361159.031250, |X-X0|:  12935.697266
rounded |X_k-Y|_0 = 361035, f1 =  0.658719, approx slack: 189571
rounded before pow |X_k-Y|_0 = 528786, f1 =  0.633412

Iteration 860: Loss = 373859.937500
|Xk-Y|_F:  360994.812500, |X-X0|:  12865.128906
rounded |X_k-Y|_0 = 360892, f1 =  0.658742, approx slack: 189811
rounded before pow |X_k-Y|_0 = 528980, f1 =  0.633387

Iteration 880: Loss = 373612.281250
|Xk-Y|_F:  360816.375000, |X-X0|:  12795.916016
rounded |X_k-Y|_0 = 360828, f1 =  0.658753, approx slack: 189856
rounded before pow |X_k-Y|_0 = 528980, f1 =  0.633388

Iteration 900: Loss = 373389.656250
|Xk-Y|_F:  360656.093750, |X-X0|:  12733.570312
rounded |X_k-Y|_0 = 360707, f1 =  0.658774, approx slack: 189907
rounded before pow |X_k-Y|_0 = 528980, f1 =  0.633389

Iteration 920: Loss = 373172.437500
|Xk-Y|_F:  360502.687500, |X-X0|:  12669.765625
rounded |X_k-Y|_0 = 360651, f1 =  0.658785, approx slack: 189813
rounded before pow |X_k-Y|_0 = 528962, f1 =  0.633398

Iteration 940: Loss = 372939.406250
|Xk-Y|_F:  360322.937500, |X-X0|:  12616.478516
rounded |X_k-Y|_0 = 360509, f1 =  0.658808, approx slack: 189840
rounded before pow |X_k-Y|_0 = 528961, f1 =  0.633396

Iteration 960: Loss = 372726.625000
|Xk-Y|_F:  360161.375000, |X-X0|:  12565.261719
rounded |X_k-Y|_0 = 360358, f1 =  0.658832, approx slack: 189827
rounded before pow |X_k-Y|_0 = 528849, f1 =  0.633401

Iteration 980: Loss = 372498.468750
|Xk-Y|_F:  359982.781250, |X-X0|:  12515.685547
rounded |X_k-Y|_0 = 360272, f1 =  0.658847, approx slack: 190757
rounded before pow |X_k-Y|_0 = 528848, f1 =  0.633301

Iteration 1000: Loss = 372274.187500
|Xk-Y|_F:  359803.156250, |X-X0|:  12471.015625
rounded |X_k-Y|_0 = 360108, f1 =  0.658874, approx slack: 188688
rounded before pow |X_k-Y|_0 = 527067, f1 =  0.633572

Iteration 1020: Loss = 372124.562500
|Xk-Y|_F:  359689.312500, |X-X0|:  12435.251953
rounded |X_k-Y|_0 = 360064, f1 =  0.658882, approx slack: 188679
rounded before pow |X_k-Y|_0 = 527075, f1 =  0.633572

Iteration 1040: Loss = 371950.750000
|Xk-Y|_F:  359564.500000, |X-X0|:  12386.264648
rounded |X_k-Y|_0 = 359989, f1 =  0.658894, approx slack: 188690
rounded before pow |X_k-Y|_0 = 527058, f1 =  0.633574

Iteration 1060: Loss = 371768.375000
|Xk-Y|_F:  359437.656250, |X-X0|:  12330.718750
rounded |X_k-Y|_0 = 359913, f1 =  0.658907, approx slack: 188672
rounded before pow |X_k-Y|_0 = 527054, f1 =  0.633574

Iteration 1080: Loss = 371566.375000
|Xk-Y|_F:  359293.281250, |X-X0|:  12273.103516
rounded |X_k-Y|_0 = 359826, f1 =  0.658921, approx slack: 188617
rounded before pow |X_k-Y|_0 = 527037, f1 =  0.633577

Iteration 1100: Loss = 371367.031250
|Xk-Y|_F:  359155.062500, |X-X0|:  12211.956055
rounded |X_k-Y|_0 = 359766, f1 =  0.658930, approx slack: 188872
rounded before pow |X_k-Y|_0 = 527024, f1 =  0.633553

Iteration 1120: Loss = 371169.343750
|Xk-Y|_F:  359011.312500, |X-X0|:  12158.044922
rounded |X_k-Y|_0 = 359742, f1 =  0.658935, approx slack: 193097
rounded before pow |X_k-Y|_0 = 529749, f1 =  0.633015

Iteration 1140: Loss = 370948.187500
|Xk-Y|_F:  358835.937500, |X-X0|:  12112.240234
rounded |X_k-Y|_0 = 359662, f1 =  0.658948, approx slack: 188109
rounded before pow |X_k-Y|_0 = 529474, f1 =  0.633529

Iteration 1160: Loss = 370748.218750
|Xk-Y|_F:  358674.718750, |X-X0|:  12073.488281
rounded |X_k-Y|_0 = 359589, f1 =  0.658960, approx slack: 188182
rounded before pow |X_k-Y|_0 = 529478, f1 =  0.633528

Iteration 1180: Loss = 370535.187500
|Xk-Y|_F:  358508.437500, |X-X0|:  12026.739258
rounded |X_k-Y|_0 = 359508, f1 =  0.658973, approx slack: 185926
rounded before pow |X_k-Y|_0 = 529689, f1 =  0.633783

Iteration 1200: Loss = 370343.250000
|Xk-Y|_F:  358363.812500, |X-X0|:  11979.430664
rounded |X_k-Y|_0 = 359225, f1 =  0.659019, approx slack: 185726
rounded before pow |X_k-Y|_0 = 529688, f1 =  0.633783

Iteration 1220: Loss = 370192.687500
|Xk-Y|_F:  358258.281250, |X-X0|:  11934.393555
rounded |X_k-Y|_0 = 358950, f1 =  0.659063, approx slack: 182159
rounded before pow |X_k-Y|_0 = 530947, f1 =  0.633758

Iteration 1240: Loss = 370025.281250
|Xk-Y|_F:  358141.531250, |X-X0|:  11883.756836
rounded |X_k-Y|_0 = 358850, f1 =  0.659078, approx slack: 182178
rounded before pow |X_k-Y|_0 = 530942, f1 =  0.633758

Iteration 1260: Loss = 369895.000000
|Xk-Y|_F:  358052.718750, |X-X0|:  11842.289062
rounded |X_k-Y|_0 = 358736, f1 =  0.659096, approx slack: 182142
rounded before pow |X_k-Y|_0 = 530859, f1 =  0.633770

Iteration 1280: Loss = 369748.687500
|Xk-Y|_F:  357959.875000, |X-X0|:  11788.824219
rounded |X_k-Y|_0 = 358683, f1 =  0.659105, approx slack: 182200
rounded before pow |X_k-Y|_0 = 530859, f1 =  0.633770

Iteration 1300: Loss = 369581.625000
|Xk-Y|_F:  357855.531250, |X-X0|:  11726.109375
rounded |X_k-Y|_0 = 358577, f1 =  0.659121, approx slack: 182242
rounded before pow |X_k-Y|_0 = 530854, f1 =  0.633771

Iteration 1320: Loss = 369455.343750
|Xk-Y|_F:  357777.312500, |X-X0|:  11678.028320
rounded |X_k-Y|_0 = 358516, f1 =  0.659131, approx slack: 182238
rounded before pow |X_k-Y|_0 = 530852, f1 =  0.633771

Iteration 1340: Loss = 369328.468750
|Xk-Y|_F:  357691.312500, |X-X0|:  11637.166992
rounded |X_k-Y|_0 = 358409, f1 =  0.659148, approx slack: 182247
rounded before pow |X_k-Y|_0 = 530861, f1 =  0.633770

Iteration 1360: Loss = 369201.406250
|Xk-Y|_F:  357609.843750, |X-X0|:  11591.550781
rounded |X_k-Y|_0 = 358300, f1 =  0.659165, approx slack: 182282
rounded before pow |X_k-Y|_0 = 530862, f1 =  0.633770

Iteration 1380: Loss = 369063.125000
|Xk-Y|_F:  357516.843750, |X-X0|:  11546.278320
rounded |X_k-Y|_0 = 358082, f1 =  0.659200, approx slack: 182274
rounded before pow |X_k-Y|_0 = 530862, f1 =  0.633770

Iteration 1400: Loss = 368910.375000
|Xk-Y|_F:  357422.250000, |X-X0|:  11488.127930
rounded |X_k-Y|_0 = 357963, f1 =  0.659219, approx slack: 182302
rounded before pow |X_k-Y|_0 = 530864, f1 =  0.633770

Iteration 1420: Loss = 368773.625000
|Xk-Y|_F:  357337.593750, |X-X0|:  11436.023438
rounded |X_k-Y|_0 = 357846, f1 =  0.659237, approx slack: 182316
rounded before pow |X_k-Y|_0 = 530857, f1 =  0.633771

Iteration 1440: Loss = 368623.500000
|Xk-Y|_F:  357241.218750, |X-X0|:  11382.271484
rounded |X_k-Y|_0 = 357665, f1 =  0.659266, approx slack: 182388
rounded before pow |X_k-Y|_0 = 530845, f1 =  0.633772

Iteration 1460: Loss = 368499.406250
|Xk-Y|_F:  357175.406250, |X-X0|:  11323.998047
rounded |X_k-Y|_0 = 357472, f1 =  0.659297, approx slack: 136504
rounded before pow |X_k-Y|_0 = 485254, f1 =  0.640156

Iteration 1480: Loss = 368369.187500
|Xk-Y|_F:  357101.375000, |X-X0|:  11267.811523
rounded |X_k-Y|_0 = 357393, f1 =  0.659309, approx slack: 136587
rounded before pow |X_k-Y|_0 = 485257, f1 =  0.640155

Iteration 1500: Loss = 368254.625000
|Xk-Y|_F:  357045.343750, |X-X0|:  11209.275391
rounded |X_k-Y|_0 = 357322, f1 =  0.659320, approx slack: 119478
rounded before pow |X_k-Y|_0 = 468158, f1 =  0.642606

Iteration 1520: Loss = 368117.562500
|Xk-Y|_F:  356974.812500, |X-X0|:  11142.759766
rounded |X_k-Y|_0 = 357322, f1 =  0.659320, approx slack: 119391
rounded before pow |X_k-Y|_0 = 468076, f1 =  0.642618

Iteration 1540: Loss = 367964.968750
|Xk-Y|_F:  356892.562500, |X-X0|:  11072.400391
rounded |X_k-Y|_0 = 357300, f1 =  0.659324, approx slack: 119384
rounded before pow |X_k-Y|_0 = 468044, f1 =  0.642622

Iteration 1560: Loss = 367821.687500
|Xk-Y|_F:  356819.187500, |X-X0|:  11002.498047
rounded |X_k-Y|_0 = 357216, f1 =  0.659337, approx slack: 118957
rounded before pow |X_k-Y|_0 = 467570, f1 =  0.642691

Iteration 1580: Loss = 367681.437500
|Xk-Y|_F:  356751.593750, |X-X0|:  10929.836914
rounded |X_k-Y|_0 = 357157, f1 =  0.659346, approx slack: 118961
rounded before pow |X_k-Y|_0 = 467490, f1 =  0.642702

Iteration 1600: Loss = 367601.093750
|Xk-Y|_F:  356730.093750, |X-X0|:  10871.009766
rounded |X_k-Y|_0 = 357163, f1 =  0.659345, approx slack: 119065
rounded before pow |X_k-Y|_0 = 467593, f1 =  0.642683

Iteration 1620: Loss = 367494.656250
|Xk-Y|_F:  356678.093750, |X-X0|:  10816.563477
rounded |X_k-Y|_0 = 357120, f1 =  0.659352, approx slack: 118340
rounded before pow |X_k-Y|_0 = 466865, f1 =  0.642787

Iteration 1640: Loss = 367360.000000
|Xk-Y|_F:  356602.281250, |X-X0|:  10757.725586
rounded |X_k-Y|_0 = 357073, f1 =  0.659360, approx slack: 118336
rounded before pow |X_k-Y|_0 = 466788, f1 =  0.642803

Iteration 1660: Loss = 367269.500000
|Xk-Y|_F:  356561.250000, |X-X0|:  10708.250000
rounded |X_k-Y|_0 = 357048, f1 =  0.659363, approx slack: 118374
rounded before pow |X_k-Y|_0 = 466820, f1 =  0.642794

Iteration 1680: Loss = 367159.937500
|Xk-Y|_F:  356509.281250, |X-X0|:  10650.644531
rounded |X_k-Y|_0 = 356956, f1 =  0.659378, approx slack: 118425
rounded before pow |X_k-Y|_0 = 466743, f1 =  0.642810

Iteration 1700: Loss = 367017.500000
|Xk-Y|_F:  356417.593750, |X-X0|:  10599.905273
rounded |X_k-Y|_0 = 356882, f1 =  0.659390, approx slack: 118423
rounded before pow |X_k-Y|_0 = 466729, f1 =  0.642812

Iteration 1720: Loss = 366947.718750
|Xk-Y|_F:  356400.750000, |X-X0|:  10546.977539
rounded |X_k-Y|_0 = 356872, f1 =  0.659391, approx slack: 118567
rounded before pow |X_k-Y|_0 = 466831, f1 =  0.642785

Iteration 1740: Loss = 366848.437500
|Xk-Y|_F:  356345.375000, |X-X0|:  10503.077148
rounded |X_k-Y|_0 = 356801, f1 =  0.659402, approx slack: 118603
rounded before pow |X_k-Y|_0 = 466725, f1 =  0.642805

Iteration 1760: Loss = 366736.843750
|Xk-Y|_F:  356279.437500, |X-X0|:  10457.408203
rounded |X_k-Y|_0 = 356753, f1 =  0.659410, approx slack: 118617
rounded before pow |X_k-Y|_0 = 466719, f1 =  0.642806

Iteration 1780: Loss = 366669.906250
|Xk-Y|_F:  356250.000000, |X-X0|:  10419.894531
rounded |X_k-Y|_0 = 356723, f1 =  0.659415, approx slack: 118678
rounded before pow |X_k-Y|_0 = 466787, f1 =  0.642792

Iteration 1800: Loss = 366565.687500
|Xk-Y|_F:  356197.968750, |X-X0|:  10367.722656
rounded |X_k-Y|_0 = 356684, f1 =  0.659421, approx slack: 118724
rounded before pow |X_k-Y|_0 = 466705, f1 =  0.642808

Iteration 1820: Loss = 366448.500000
|Xk-Y|_F:  356133.593750, |X-X0|:  10314.894531
rounded |X_k-Y|_0 = 356658, f1 =  0.659425, approx slack: 118756
rounded before pow |X_k-Y|_0 = 466707, f1 =  0.642808

Iteration 1840: Loss = 366373.593750
|Xk-Y|_F:  356099.562500, |X-X0|:  10274.026367
rounded |X_k-Y|_0 = 356629, f1 =  0.659430, approx slack: 118791
rounded before pow |X_k-Y|_0 = 466699, f1 =  0.642809

Iteration 1860: Loss = 366270.937500
|Xk-Y|_F:  356045.875000, |X-X0|:  10225.068359
rounded |X_k-Y|_0 = 356577, f1 =  0.659438, approx slack: 119681
rounded before pow |X_k-Y|_0 = 467370, f1 =  0.642694

Iteration 1880: Loss = 366154.156250
|Xk-Y|_F:  355977.937500, |X-X0|:  10176.226562
rounded |X_k-Y|_0 = 356516, f1 =  0.659447, approx slack: 119695
rounded before pow |X_k-Y|_0 = 467334, f1 =  0.642699

Iteration 1900: Loss = 366055.437500
|Xk-Y|_F:  355923.218750, |X-X0|:  10132.219727
rounded |X_k-Y|_0 = 356465, f1 =  0.659455, approx slack: 119711
rounded before pow |X_k-Y|_0 = 467332, f1 =  0.642699

Iteration 1920: Loss = 365949.000000
|Xk-Y|_F:  355876.843750, |X-X0|:  10072.150391
rounded |X_k-Y|_0 = 356431, f1 =  0.659461, approx slack: 111145
rounded before pow |X_k-Y|_0 = 458785, f1 =  0.643936

Iteration 1940: Loss = 365836.187500
|Xk-Y|_F:  355822.375000, |X-X0|:  10013.804688
rounded |X_k-Y|_0 = 356354, f1 =  0.659473, approx slack: 105332
rounded before pow |X_k-Y|_0 = 452969, f1 =  0.644783

Iteration 1960: Loss = 365747.718750
|Xk-Y|_F:  355786.125000, |X-X0|:  9961.582031
rounded |X_k-Y|_0 = 356363, f1 =  0.659471, approx slack: 102549
rounded before pow |X_k-Y|_0 = 450123, f1 =  0.645198

Iteration 1980: Loss = 365678.781250
|Xk-Y|_F:  355758.000000, |X-X0|:  9920.787109
rounded |X_k-Y|_0 = 356347, f1 =  0.659474, approx slack: 102629
rounded before pow |X_k-Y|_0 = 450121, f1 =  0.645199

Iteration 2000: Loss = 365587.687500
|Xk-Y|_F:  355712.000000, |X-X0|:  9875.689453
rounded |X_k-Y|_0 = 356277, f1 =  0.659485, approx slack: 102659
rounded before pow |X_k-Y|_0 = 450091, f1 =  0.645203

Iteration 2020: Loss = 365519.093750
|Xk-Y|_F:  355675.593750, |X-X0|:  9843.511719
rounded |X_k-Y|_0 = 356224, f1 =  0.659493, approx slack: 102571
rounded before pow |X_k-Y|_0 = 450087, f1 =  0.645221

Iteration 2040: Loss = 365463.468750
|Xk-Y|_F:  355650.531250, |X-X0|:  9812.926758
rounded |X_k-Y|_0 = 356189, f1 =  0.659499, approx slack: 102795
rounded before pow |X_k-Y|_0 = 450115, f1 =  0.645195

Iteration 2060: Loss = 365404.343750
|Xk-Y|_F:  355620.906250, |X-X0|:  9783.428711
rounded |X_k-Y|_0 = 356138, f1 =  0.659507, approx slack: 102863
rounded before pow |X_k-Y|_0 = 450134, f1 =  0.645192

Iteration 2080: Loss = 365307.781250
|Xk-Y|_F:  355567.125000, |X-X0|:  9740.668945
rounded |X_k-Y|_0 = 356088, f1 =  0.659515, approx slack: 102839
rounded before pow |X_k-Y|_0 = 450086, f1 =  0.645204

Iteration 2100: Loss = 365235.593750
|Xk-Y|_F:  355527.031250, |X-X0|:  9708.550781
rounded |X_k-Y|_0 = 356053, f1 =  0.659520, approx slack: 85789
rounded before pow |X_k-Y|_0 = 433066, f1 =  0.647708

Iteration 2120: Loss = 365157.281250
|Xk-Y|_F:  355484.875000, |X-X0|:  9672.402344
rounded |X_k-Y|_0 = 356006, f1 =  0.659528, approx slack: 85794
rounded before pow |X_k-Y|_0 = 433048, f1 =  0.647710

Iteration 2140: Loss = 365109.031250
|Xk-Y|_F:  355459.781250, |X-X0|:  9649.263672
rounded |X_k-Y|_0 = 355989, f1 =  0.659530, approx slack: 85811
rounded before pow |X_k-Y|_0 = 433027, f1 =  0.647714

Iteration 2160: Loss = 365037.937500
|Xk-Y|_F:  355413.781250, |X-X0|:  9624.167969
rounded |X_k-Y|_0 = 355945, f1 =  0.659537, approx slack: 85854
rounded before pow |X_k-Y|_0 = 433025, f1 =  0.647714

Iteration 2180: Loss = 364978.156250
|Xk-Y|_F:  355386.687500, |X-X0|:  9591.457031
rounded |X_k-Y|_0 = 355941, f1 =  0.659538, approx slack: 85919
rounded before pow |X_k-Y|_0 = 433070, f1 =  0.647707

Iteration 2200: Loss = 364912.625000
|Xk-Y|_F:  355347.187500, |X-X0|:  9565.427734
rounded |X_k-Y|_0 = 355894, f1 =  0.659545, approx slack: 84270
rounded before pow |X_k-Y|_0 = 431900, f1 =  0.647934

Iteration 2220: Loss = 364850.437500
|Xk-Y|_F:  355319.968750, |X-X0|:  9530.482422
rounded |X_k-Y|_0 = 355859, f1 =  0.659551, approx slack: 84330
rounded before pow |X_k-Y|_0 = 431900, f1 =  0.647934

Iteration 2240: Loss = 364778.000000
|Xk-Y|_F:  355282.343750, |X-X0|:  9495.641602
rounded |X_k-Y|_0 = 355837, f1 =  0.659554, approx slack: 84394
rounded before pow |X_k-Y|_0 = 431900, f1 =  0.647934

Iteration 2260: Loss = 364710.250000
|Xk-Y|_F:  355251.062500, |X-X0|:  9459.175781
rounded |X_k-Y|_0 = 355838, f1 =  0.659554, approx slack: 84435
rounded before pow |X_k-Y|_0 = 431908, f1 =  0.647933

Iteration 2280: Loss = 364644.406250
|Xk-Y|_F:  355221.250000, |X-X0|:  9423.150391
rounded |X_k-Y|_0 = 355759, f1 =  0.659567, approx slack: 84316
rounded before pow |X_k-Y|_0 = 431699, f1 =  0.647964

Iteration 2300: Loss = 364573.593750
|Xk-Y|_F:  355188.781250, |X-X0|:  9384.815430
rounded |X_k-Y|_0 = 355721, f1 =  0.659573, approx slack: 84307
rounded before pow |X_k-Y|_0 = 431709, f1 =  0.647962

Iteration 2320: Loss = 364527.406250
|Xk-Y|_F:  355172.343750, |X-X0|:  9355.074219
rounded |X_k-Y|_0 = 355703, f1 =  0.659576, approx slack: 84298
rounded before pow |X_k-Y|_0 = 431698, f1 =  0.647964

Iteration 2340: Loss = 364456.937500
|Xk-Y|_F:  355137.000000, |X-X0|:  9319.923828
rounded |X_k-Y|_0 = 355700, f1 =  0.659576, approx slack: 84333
rounded before pow |X_k-Y|_0 = 431707, f1 =  0.647962

Iteration 2360: Loss = 364425.593750
|Xk-Y|_F:  355122.812500, |X-X0|:  9302.785156
rounded |X_k-Y|_0 = 355677, f1 =  0.659580, approx slack: 84285
rounded before pow |X_k-Y|_0 = 431672, f1 =  0.647969

Iteration 2380: Loss = 364357.156250
|Xk-Y|_F:  355087.250000, |X-X0|:  9269.912109
rounded |X_k-Y|_0 = 355645, f1 =  0.659585, approx slack: 84322
rounded before pow |X_k-Y|_0 = 431671, f1 =  0.647969

Iteration 2400: Loss = 364308.531250
|Xk-Y|_F:  355064.687500, |X-X0|:  9243.849609
rounded |X_k-Y|_0 = 355632, f1 =  0.659587, approx slack: 84324
rounded before pow |X_k-Y|_0 = 431669, f1 =  0.647969

Iteration 2420: Loss = 364253.781250
|Xk-Y|_F:  355039.312500, |X-X0|:  9214.476562
rounded |X_k-Y|_0 = 355595, f1 =  0.659593, approx slack: 84412
rounded before pow |X_k-Y|_0 = 431666, f1 =  0.647970

Converged at iteration 2424

KB after refine:
num_nodes: 5045.0000
num_edges: 3644.0000
density: 0.0001
avg_degree: 0.7223
avg_clustering: 0.0715
degree_assortativity: -0.2304
modularity: 0.6412
avg_betweenness: 0.0000
avg_closeness: 0.0022
------ ABL 1 after refine ------
--- eval ---
prediction result:
f1 on test:    0.5347
f1 on test:    0.8937 (micro)
f1 on KB:      0.6453
f1 on orig KB: 0.3363
integrated f1: 0.3754, w_data: 0.3265, w_klg: 0.6735

integrated result:
f1 on test:    0.5294
f1 on test:    0.8933 (micro)
f1 on KB:      0.6528
f1 on orig KB: 0.3358
integrated f1: 0.3743, w_data: 0.3265, w_klg: 0.6735
------------
integrated f1 0.3754
