MLP_adamson_Sep20_2
log/EGOAL-hsa-2025-09-21-06:52:14.607595.txt
random seed: 6
test perts: ["['BHLHE40', 'ctrl']", "['DDIT3', 'ctrl']", "['SAMM50', 'ctrl']", "['MTHFD1', 'ctrl']", "['EIF2B2', 'ctrl']", "['PSMD4', 'ctrl']", "['EIF2S1', 'ctrl']", "['CCND3', 'ctrl']", "['PPWD1', 'ctrl']", "['COPZ1', 'ctrl']", "['EIF2B3', 'ctrl']", "['XRN1', 'ctrl']", "['TMED2', 'ctrl']", "['SPCS2', 'ctrl']"]
train: torch.Size([59822, 5060])
unlabel: torch.Size([3737, 5060])
cuda availability: True
/home/u-xiangyf/anaconda3/envs/egoal/lib/python3.13/site-packages/torch/nn/modules/loss.py:608: UserWarning: Using a target size (torch.Size([5060])) that is different to the input size (torch.Size([5060, 5060])). This will likely lead to incorrect results due to broadcasting. Please ensure they have the same size.
  return F.mse_loss(input, target, reduction=self.reduction)
Epoch 0, Loss: 0.1519
Epoch 100, Loss: 0.1461
Epoch 200, Loss: 0.1405
Epoch 300, Loss: 0.1350
Epoch 400, Loss: 0.1298
Epoch 500, Loss: 0.1248
Epoch 600, Loss: 0.1199
Epoch 700, Loss: 0.1152
Epoch 800, Loss: 0.1107
Epoch 900, Loss: 0.1063
Final loss: 0.10217843949794769
Achieved outputs: tensor([[0.4243, 0.4113, 0.4649,  ..., 0.4061, 0.4344, 0.4337],
        [0.4247, 0.4116, 0.4655,  ..., 0.4063, 0.4348, 0.4339],
        [0.4243, 0.4112, 0.4651,  ..., 0.4062, 0.4345, 0.4337],
        ...,
        [0.4245, 0.4116, 0.4653,  ..., 0.4063, 0.4346, 0.4338],
        [0.4242, 0.4110, 0.4651,  ..., 0.4059, 0.4342, 0.4336],
        [0.4242, 0.4112, 0.4648,  ..., 0.4060, 0.4342, 0.4337]],
       device='cuda:1')
Eval weight w_data: 0.28702506841431497
Before pretrain: integrated f1 0.2885
Epoch 100, Total loss: 67401199616.0000, CE loss: 959.3845, RL loss: 6740120064.0000, Reward: -286024939.4844
    full cols: 666, non-full cols: 1
   r - labels: 4, labels - r: 2
    violated: 93094, weighted: 1.174919843673706, len: 0.0, nonzero: 0.1318150907754898
Epoch 200, Total loss: 5807547904.0000, CE loss: 897.2288, RL loss: 580754688.0000, Reward: -285975134.9375
    full cols: 666, non-full cols: 1
   r - labels: 4, labels - r: 2
    violated: 101012, weighted: 1.174919843673706, len: 0.0, nonzero: 0.1318150907754898
Epoch 300, Total loss: -9621304320.0000, CE loss: 850.7980, RL loss: -962130496.0000, Reward: -285533433.4375
    full cols: 667, non-full cols: 0
   r - labels: 4, labels - r: 2
    violated: 103914, weighted: 1.1520576477050781, len: 0.0, nonzero: 0.13181817531585693
------ Before ABL ------
--- eval ---
prediction result:
f1 on test:    0.4963
f1 on test:    0.7730 (micro)
f1 on KB:      0.2816
f1 on orig KB: 0.2816
integrated f1: 0.3138, w_data: 0.2870, w_klg: 0.7130

integrated result:
f1 on test:    0.4780
f1 on test:    0.7476 (micro)
f1 on KB:      0.3983
f1 on orig KB: 0.3983
integrated f1: 0.4170, w_data: 0.2870, w_klg: 0.7130
------------
integrated f1 0.3138

Epoch 100, Total loss: 211941343232.0000, CE loss: 53.8591, RL loss: 2119413504.0000, Reward: -17015019.3281
    full cols: 664, non-full cols: 0
   r - labels: 2, labels - r: 3
    violated: 155705, weighted: 0.4470672607421875, len: 0.0, nonzero: 0.13122528791427612
Epoch 200, Total loss: 205513654272.0000, CE loss: 53.0419, RL loss: 2055136512.0000, Reward: -16703068.1250
    full cols: 662, non-full cols: 1
   r - labels: 2, labels - r: 4
    violated: 158792, weighted: 0.7631160020828247, len: 0.0, nonzero: 0.13100604712963104
Epoch 300, Total loss: -125391093760.0000, CE loss: 51.9469, RL loss: -1253910912.0000, Reward: -16268114.0703
    full cols: 660, non-full cols: 2
   r - labels: 2, labels - r: 5
    violated: 158144, weighted: 1.9848425388336182, len: 0.0, nonzero: 0.13055212795734406
Epoch 400, Total loss: -20810219520.0000, CE loss: 50.7470, RL loss: -208102192.0000, Reward: -15740061.0156
    full cols: 659, non-full cols: 3
   r - labels: 3, labels - r: 6
    violated: 166461, weighted: 2.3555328845977783, len: 0.0, nonzero: 0.13053667545318604
Epoch 500, Total loss: -67257774080.0000, CE loss: 49.5147, RL loss: -672577728.0000, Reward: -15255343.6719
    full cols: 661, non-full cols: 2
   r - labels: 4, labels - r: 6
    violated: 154100, weighted: 3.3314437866210938, len: 0.0, nonzero: 0.1307806372642517
Epoch 600, Total loss: 97684848640.0000, CE loss: 46.7868, RL loss: 976848448.0000, Reward: -13217367.9609
    full cols: 665, non-full cols: 0
   r - labels: 8, labels - r: 8
    violated: 154342, weighted: 6.901065826416016, len: 0.0, nonzero: 0.13142292201519012
Epoch 700, Total loss: 89881829376.0000, CE loss: 45.2453, RL loss: 898818304.0000, Reward: -12190983.5234
    full cols: 668, non-full cols: 1
   r - labels: 11, labels - r: 7
    violated: 152619, weighted: 11.18330192565918, len: 0.0, nonzero: 0.1320250779390335
Epoch 800, Total loss: 184016158720.0000, CE loss: 43.8297, RL loss: 1840161536.0000, Reward: -10976516.9219
    full cols: 672, non-full cols: 1
   r - labels: 15, labels - r: 7
    violated: 158817, weighted: 13.662109375, len: 0.0, nonzero: 0.13300086557865143
Epoch 900, Total loss: -123121500160.0000, CE loss: 41.9034, RL loss: -1231214976.0000, Reward: -7755569.7969
    full cols: 675, non-full cols: 0
   r - labels: 17, labels - r: 7
    violated: 157382, weighted: 18.428096771240234, len: 0.0, nonzero: 0.13339920341968536
Epoch 1000, Total loss: 61580562432.0000, CE loss: 41.2914, RL loss: 615805632.0000, Reward: -7000632.3281
    full cols: 674, non-full cols: 2
   r - labels: 17, labels - r: 6
    violated: 155126, weighted: 14.64516830444336, len: 0.0, nonzero: 0.1333930343389511
Epoch 1100, Total loss: -152238505984.0000, CE loss: 40.7970, RL loss: -1522385024.0000, Reward: -6324669.6250
    full cols: 672, non-full cols: 1
   r - labels: 18, labels - r: 10
    violated: 155472, weighted: 22.971412658691406, len: 0.0, nonzero: 0.13300086557865143
Epoch 1200, Total loss: 28515999744.0000, CE loss: 40.4448, RL loss: 285160000.0000, Reward: -6049564.8477
    full cols: 674, non-full cols: 3
   r - labels: 20, labels - r: 8
    violated: 163211, weighted: 25.46062469482422, len: 0.0, nonzero: 0.13360610604286194
Epoch 1300, Total loss: 104384561152.0000, CE loss: 40.1102, RL loss: 1043845632.0000, Reward: -5896917.5898
    full cols: 671, non-full cols: 2
   r - labels: 19, labels - r: 11
    violated: 149564, weighted: 49.25225830078125, len: 0.0, nonzero: 0.13280941545963287
Epoch 1400, Total loss: 46127251456.0000, CE loss: 39.8213, RL loss: 461272512.0000, Reward: -5646996.9258
    full cols: 670, non-full cols: 3
   r - labels: 21, labels - r: 13
    violated: 159623, weighted: 42.071388244628906, len: 0.0, nonzero: 0.13270750641822815
Epoch 1500, Total loss: 1887292416.0000, CE loss: 39.5222, RL loss: 18872924.0000, Reward: -5400105.1133
    full cols: 670, non-full cols: 1
   r - labels: 19, labels - r: 13
    violated: 150712, weighted: 114.70494079589844, len: 0.0, nonzero: 0.1324172466993332
Epoch 1600, Total loss: 150362849280.0000, CE loss: 39.2060, RL loss: 1503628544.0000, Reward: -5353628.5156
    full cols: 668, non-full cols: 3
   r - labels: 21, labels - r: 15
    violated: 172843, weighted: 215.76095581054688, len: 0.0, nonzero: 0.1321949064731598
Epoch 1700, Total loss: -48125480960.0000, CE loss: 38.8806, RL loss: -481254816.0000, Reward: -5343924.8867
    full cols: 669, non-full cols: 1
   r - labels: 25, labels - r: 20
    violated: 150544, weighted: 328.0921325683594, len: 0.0, nonzero: 0.13240797817707062
Epoch 1800, Total loss: 92726673408.0000, CE loss: 38.5683, RL loss: 927266752.0000, Reward: -5310164.5312
    full cols: 676, non-full cols: 2
   r - labels: 32, labels - r: 19
    violated: 155924, weighted: 444.4157409667969, len: 0.0, nonzero: 0.13369564712047577
Epoch 1900, Total loss: 105333858304.0000, CE loss: 38.2436, RL loss: 1053338560.0000, Reward: -5350595.4922
    full cols: 678, non-full cols: 1
   r - labels: 33, labels - r: 19
    violated: 155096, weighted: 435.094970703125, len: 0.0, nonzero: 0.1340939998626709
--- eval ---
prediction result:
f1 on test:    0.4982
f1 on test:    0.7691 (micro)
f1 on KB:      0.3142
integrated f1: 0.3471, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4775
f1 on test:    0.7461 (micro)
f1 on KB:      0.4014
integrated f1: 0.4203, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: -3414488064.0000, CE loss: 37.9392, RL loss: -34144880.0000, Reward: -5377305.2305
    full cols: 677, non-full cols: 1
   r - labels: 32, labels - r: 19
    violated: 149933, weighted: 422.5382385253906, len: 0.0, nonzero: 0.13392415642738342
Epoch 2100, Total loss: -63212244992.0000, CE loss: 37.5942, RL loss: -632122432.0000, Reward: -5390953.0625
    full cols: 672, non-full cols: 6
   r - labels: 35, labels - r: 22
    violated: 153418, weighted: 490.3033752441406, len: 0.0, nonzero: 0.13347949087619781
Epoch 2200, Total loss: -39511867392.0000, CE loss: 37.2962, RL loss: -395118688.0000, Reward: -5413003.4180
    full cols: 673, non-full cols: 2
   r - labels: 33, labels - r: 23
    violated: 157956, weighted: 470.654541015625, len: 0.0, nonzero: 0.1332448124885559
Epoch 2300, Total loss: -98588409856.0000, CE loss: 37.0406, RL loss: -985884096.0000, Reward: -5448631.9922
    full cols: 671, non-full cols: 6
   r - labels: 38, labels - r: 26
    violated: 149702, weighted: 564.3641967773438, len: 0.0, nonzero: 0.1333158314228058
Epoch 2400, Total loss: -120164786176.0000, CE loss: 36.8388, RL loss: -1201647872.0000, Reward: -5462546.4688
    full cols: 668, non-full cols: 5
   r - labels: 37, labels - r: 29
    violated: 154535, weighted: 534.2117919921875, len: 0.0, nonzero: 0.13279396295547485
Epoch 2500, Total loss: -97769381888.0000, CE loss: 36.6312, RL loss: -977693824.0000, Reward: -5466479.1562
    full cols: 670, non-full cols: 3
   r - labels: 40, labels - r: 32
    violated: 159014, weighted: 657.3360595703125, len: 0.0, nonzero: 0.1327630877494812
Epoch 2600, Total loss: 79285002240.0000, CE loss: 36.4854, RL loss: 792849984.0000, Reward: -5463912.7500
    full cols: 665, non-full cols: 3
   r - labels: 36, labels - r: 33
    violated: 154500, weighted: 635.5416870117188, len: 0.0, nonzero: 0.13179965317249298
Epoch 2700, Total loss: 97983299584.0000, CE loss: 36.3642, RL loss: 979833024.0000, Reward: -5456801.9883
    full cols: 665, non-full cols: 3
   r - labels: 38, labels - r: 35
    violated: 144086, weighted: 684.9417114257812, len: 0.0, nonzero: 0.13150320947170258
Epoch 2800, Total loss: -65326161920.0000, CE loss: 36.2476, RL loss: -653261632.0000, Reward: -5484879.7344
    full cols: 664, non-full cols: 4
   r - labels: 37, labels - r: 34
    violated: 156523, weighted: 656.02392578125, len: 0.0, nonzero: 0.1316421627998352
Epoch 2900, Total loss: -47638806528.0000, CE loss: 36.1796, RL loss: -476388064.0000, Reward: -5492961.5781
    full cols: 668, non-full cols: 2
   r - labels: 39, labels - r: 34
    violated: 149549, weighted: 704.4102783203125, len: 0.0, nonzero: 0.1322072595357895
Epoch 3000, Total loss: -167111737344.0000, CE loss: 36.0900, RL loss: -1671117312.0000, Reward: -5518692.7188
    full cols: 668, non-full cols: 3
   r - labels: 42, labels - r: 36
    violated: 151329, weighted: 868.3260498046875, len: 0.0, nonzero: 0.13234621286392212
Epoch 3100, Total loss: 72476860416.0000, CE loss: 36.0149, RL loss: 724768576.0000, Reward: -5500517.3555
    full cols: 671, non-full cols: 3
   r - labels: 46, labels - r: 37
    violated: 154049, weighted: 877.456787109375, len: 0.0, nonzero: 0.13296380639076233
Epoch 3200, Total loss: -227191472128.0000, CE loss: 35.9948, RL loss: -2271914752.0000, Reward: -5546303.5469
    full cols: 657, non-full cols: 9
   r - labels: 44, labels - r: 43
    violated: 154270, weighted: 965.5960083007812, len: 0.0, nonzero: 0.1309041529893875
Epoch 3300, Total loss: -8079268864.0000, CE loss: 35.9194, RL loss: -80792688.0000, Reward: -5536326.0391
    full cols: 660, non-full cols: 5
   r - labels: 45, labels - r: 45
    violated: 156422, weighted: 1007.8917236328125, len: 0.0, nonzero: 0.13072504103183746
Epoch 3400, Total loss: 75469275136.0000, CE loss: 35.9124, RL loss: 754692736.0000, Reward: -5489694.0977
    full cols: 660, non-full cols: 12
   r - labels: 50, labels - r: 43
    violated: 159245, weighted: 1080.1429443359375, len: 0.0, nonzero: 0.13142909109592438
Epoch 3500, Total loss: -99985670144.0000, CE loss: 35.8332, RL loss: -999856704.0000, Reward: -5519330.0469
    full cols: 662, non-full cols: 8
   r - labels: 52, labels - r: 47
    violated: 156461, weighted: 1159.6636962890625, len: 0.0, nonzero: 0.13175642490386963
Epoch 3600, Total loss: -41956528128.0000, CE loss: 35.8170, RL loss: -419565280.0000, Reward: -5529110.6289
    full cols: 672, non-full cols: 2
   r - labels: 54, labels - r: 45
    violated: 163258, weighted: 1291.37646484375, len: 0.0, nonzero: 0.1329977810382843
Epoch 3700, Total loss: -150960046080.0000, CE loss: 35.8372, RL loss: -1509600384.0000, Reward: -5520870.6289
    full cols: 662, non-full cols: 12
   r - labels: 58, labels - r: 49
    violated: 152051, weighted: 1337.6712646484375, len: 0.0, nonzero: 0.13200654089450836
Epoch 3800, Total loss: -71267426304.0000, CE loss: 35.7391, RL loss: -712674240.0000, Reward: -5505417.4141
    full cols: 666, non-full cols: 9
   r - labels: 60, labels - r: 50
    violated: 155789, weighted: 1428.6416015625, len: 0.0, nonzero: 0.13265809416770935
Epoch 3900, Total loss: 349402660864.0000, CE loss: 35.7500, RL loss: 3494026496.0000, Reward: -5479567.8047
    full cols: 680, non-full cols: 3
   r - labels: 66, labels - r: 48
    violated: 151746, weighted: 1503.738037109375, len: 0.0, nonzero: 0.1348690688610077
--- eval ---
prediction result:
f1 on test:    0.4860
f1 on test:    0.7505 (micro)
f1 on KB:      0.3325
integrated f1: 0.3627, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4753
f1 on test:    0.7412 (micro)
f1 on KB:      0.4061
integrated f1: 0.4236, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: -122540351488.0000, CE loss: 35.7110, RL loss: -1225403520.0000, Reward: -5533780.6016
    full cols: 674, non-full cols: 9
   r - labels: 72, labels - r: 54
    violated: 165855, weighted: 1780.410400390625, len: 0.0, nonzero: 0.13424530625343323
Epoch 4100, Total loss: 209471504384.0000, CE loss: 35.6874, RL loss: 2094715008.0000, Reward: -5497106.3750
    full cols: 674, non-full cols: 2
   r - labels: 70, labels - r: 59
    violated: 156663, weighted: 1917.082763671875, len: 0.0, nonzero: 0.1335875689983368
Epoch 4200, Total loss: -193450459136.0000, CE loss: 35.6838, RL loss: -1934504576.0000, Reward: -5552238.9414
    full cols: 681, non-full cols: 6
   r - labels: 78, labels - r: 56
    violated: 160920, weighted: 1942.5496826171875, len: 0.0, nonzero: 0.13525506854057312
Epoch 4300, Total loss: -188312223744.0000, CE loss: 35.6339, RL loss: -1883122176.0000, Reward: -5536345.9961
    full cols: 680, non-full cols: 11
   r - labels: 84, labels - r: 58
    violated: 143342, weighted: 2107.468505859375, len: 0.0, nonzero: 0.13538166880607605
Epoch 4400, Total loss: 40127881216.0000, CE loss: 35.6099, RL loss: 401278816.0000, Reward: -5531215.6016
    full cols: 686, non-full cols: 12
   r - labels: 87, labels - r: 54
    violated: 151638, weighted: 2187.266845703125, len: 0.0, nonzero: 0.1373332440853119
Epoch 4500, Total loss: -110182424576.0000, CE loss: 35.5971, RL loss: -1101824256.0000, Reward: -5535767.6641
    full cols: 677, non-full cols: 13
   r - labels: 84, labels - r: 59
    violated: 159938, weighted: 2175.8681640625, len: 0.0, nonzero: 0.13494935631752014
Epoch 4600, Total loss: -120761204736.0000, CE loss: 35.5813, RL loss: -1207612032.0000, Reward: -5547760.3516
    full cols: 676, non-full cols: 10
   r - labels: 83, labels - r: 62
    violated: 144855, weighted: 2398.158203125, len: 0.0, nonzero: 0.13478878140449524
Epoch 4700, Total loss: 135399948288.0000, CE loss: 35.5649, RL loss: 1353999488.0000, Reward: -5515236.9219
    full cols: 682, non-full cols: 7
   r - labels: 92, labels - r: 68
    violated: 150974, weighted: 2640.415283203125, len: 0.0, nonzero: 0.1353631466627121
Epoch 4800, Total loss: -9299543040.0000, CE loss: 35.5640, RL loss: -92995432.0000, Reward: -5551349.1094
    full cols: 696, non-full cols: 15
   r - labels: 106, labels - r: 60
    violated: 140718, weighted: 2757.158203125, len: 0.0, nonzero: 0.13904397189617157
Epoch 4900, Total loss: -6908841472.0000, CE loss: 35.5857, RL loss: -69088416.0000, Reward: -5566564.6875
    full cols: 693, non-full cols: 12
   r - labels: 105, labels - r: 65
    violated: 137309, weighted: 2918.732421875, len: 0.0, nonzero: 0.13789525628089905
Epoch 5000, Total loss: 137793355776.0000, CE loss: 35.5276, RL loss: 1377933568.0000, Reward: -5559917.4453
    full cols: 697, non-full cols: 9
   r - labels: 110, labels - r: 69
    violated: 156075, weighted: 3040.98291015625, len: 0.0, nonzero: 0.13851284980773926
Epoch 5100, Total loss: -32123721728.0000, CE loss: 35.5246, RL loss: -321237216.0000, Reward: -5601128.3125
    full cols: 697, non-full cols: 6
   r - labels: 111, labels - r: 73
    violated: 157179, weighted: 3108.74755859375, len: 0.0, nonzero: 0.13819169998168945
Epoch 5200, Total loss: 51181957120.0000, CE loss: 35.5280, RL loss: 511819584.0000, Reward: -5589868.6445
    full cols: 690, non-full cols: 11
   r - labels: 113, labels - r: 77
    violated: 150166, weighted: 3246.92333984375, len: 0.0, nonzero: 0.13746602833271027
Epoch 5300, Total loss: -80219185152.0000, CE loss: 35.5097, RL loss: -802191872.0000, Reward: -5613792.4609
    full cols: 680, non-full cols: 16
   r - labels: 109, labels - r: 78
    violated: 143453, weighted: 3019.247802734375, len: 0.0, nonzero: 0.13640686869621277
Epoch 5400, Total loss: 88787083264.0000, CE loss: 35.4976, RL loss: 887870848.0000, Reward: -5603930.1445
    full cols: 682, non-full cols: 13
   r - labels: 111, labels - r: 81
    violated: 156674, weighted: 3189.12744140625, len: 0.0, nonzero: 0.13628952205181122
Epoch 5500, Total loss: 173916422144.0000, CE loss: 35.5286, RL loss: 1739164160.0000, Reward: -5597531.1875
    full cols: 693, non-full cols: 10
   r - labels: 119, labels - r: 81
    violated: 156906, weighted: 3378.803955078125, len: 0.0, nonzero: 0.13792304694652557
Epoch 5600, Total loss: 66719334400.0000, CE loss: 35.4873, RL loss: 667193344.0000, Reward: -5619168.4531
    full cols: 680, non-full cols: 16
   r - labels: 117, labels - r: 86
    violated: 161028, weighted: 3405.890869140625, len: 0.0, nonzero: 0.1362123191356659
Epoch 5700, Total loss: 114824830976.0000, CE loss: 35.5382, RL loss: 1148248320.0000, Reward: -5593199.8047
    full cols: 688, non-full cols: 14
   r - labels: 119, labels - r: 82
    violated: 154255, weighted: 3413.236083984375, len: 0.0, nonzero: 0.13726839423179626
Epoch 5800, Total loss: -7288329728.0000, CE loss: 35.5048, RL loss: -72883296.0000, Reward: -5619395.8555
    full cols: 694, non-full cols: 16
   r - labels: 130, labels - r: 85
    violated: 149305, weighted: 3726.8017578125, len: 0.0, nonzero: 0.13885869085788727
Epoch 5900, Total loss: -206801108992.0000, CE loss: 35.5084, RL loss: -2068011136.0000, Reward: -5666504.0742
    full cols: 695, non-full cols: 11
   r - labels: 129, labels - r: 88
    violated: 151855, weighted: 3845.412841796875, len: 0.0, nonzero: 0.13852828741073608
--- eval ---
prediction result:
f1 on test:    0.4860
f1 on test:    0.7505 (micro)
f1 on KB:      0.3325
integrated f1: 0.3627, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4743
f1 on test:    0.7378 (micro)
f1 on KB:      0.4119
integrated f1: 0.4280, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: -65170907136.0000, CE loss: 35.4503, RL loss: -651709056.0000, Reward: -5665595.5000
    full cols: 688, non-full cols: 12
   r - labels: 126, labels - r: 91
    violated: 151840, weighted: 3932.05322265625, len: 0.0, nonzero: 0.13713562488555908
Epoch 6100, Total loss: 150963863552.0000, CE loss: 35.4675, RL loss: 1509638656.0000, Reward: -5630366.5312
    full cols: 687, non-full cols: 10
   r - labels: 128, labels - r: 96
    violated: 150257, weighted: 4114.7470703125, len: 0.0, nonzero: 0.13661684095859528
Epoch 6200, Total loss: 39796256768.0000, CE loss: 35.4422, RL loss: 397962560.0000, Reward: -5657631.5938
    full cols: 694, non-full cols: 15
   r - labels: 138, labels - r: 94
    violated: 164694, weighted: 4188.1552734375, len: 0.0, nonzero: 0.1384449154138565
Epoch 6300, Total loss: -44698861568.0000, CE loss: 35.4422, RL loss: -446988608.0000, Reward: -5665320.3906
    full cols: 705, non-full cols: 13
   r - labels: 154, labels - r: 101
    violated: 166176, weighted: 4651.6650390625, len: 0.0, nonzero: 0.14095540344715118
Epoch 6400, Total loss: -80046014464.0000, CE loss: 35.4570, RL loss: -800460160.0000, Reward: -5695765.6797
    full cols: 703, non-full cols: 13
   r - labels: 155, labels - r: 104
    violated: 155884, weighted: 4912.42578125, len: 0.0, nonzero: 0.14054162800312042
Epoch 6500, Total loss: -284627566592.0000, CE loss: 35.4430, RL loss: -2846275584.0000, Reward: -5728213.5547
    full cols: 707, non-full cols: 18
   r - labels: 164, labels - r: 104
    violated: 149675, weighted: 5074.58349609375, len: 0.0, nonzero: 0.14227087795734406
Epoch 6600, Total loss: 90133782528.0000, CE loss: 35.4480, RL loss: 901337856.0000, Reward: -5697956.9727
    full cols: 687, non-full cols: 46
   r - labels: 170, labels - r: 102
    violated: 152894, weighted: 5362.62060546875, len: 0.0, nonzero: 0.1416594535112381
Epoch 6700, Total loss: -123959066624.0000, CE loss: 35.4700, RL loss: -1239590656.0000, Reward: -5741745.4336
    full cols: 712, non-full cols: 20
   r - labels: 175, labels - r: 108
    violated: 161838, weighted: 5456.962890625, len: 0.0, nonzero: 0.1426815688610077
Epoch 6800, Total loss: -83378708480.0000, CE loss: 35.4532, RL loss: -833787072.0000, Reward: -5739880.4531
    full cols: 717, non-full cols: 19
   r - labels: 173, labels - r: 102
    violated: 159807, weighted: 5334.8974609375, len: 0.0, nonzero: 0.14412054419517517
Epoch 6900, Total loss: -55937925120.0000, CE loss: 35.4658, RL loss: -559379264.0000, Reward: -5729320.7578
    full cols: 728, non-full cols: 18
   r - labels: 185, labels - r: 104
    violated: 150662, weighted: 5660.171875, len: 0.0, nonzero: 0.14542366564273834
Epoch 7000, Total loss: -12789723136.0000, CE loss: 35.4408, RL loss: -127897232.0000, Reward: -5743900.3320
    full cols: 724, non-full cols: 14
   r - labels: 175, labels - r: 102
    violated: 153568, weighted: 5201.02734375, len: 0.0, nonzero: 0.14483694732189178
Epoch 7100, Total loss: -111088001024.0000, CE loss: 35.4183, RL loss: -1110880000.0000, Reward: -5763557.4219
    full cols: 733, non-full cols: 15
   r - labels: 193, labels - r: 110
    violated: 158442, weighted: 5751.640625, len: 0.0, nonzero: 0.1464890092611313
Epoch 7200, Total loss: -12275448832.0000, CE loss: 35.4336, RL loss: -122754488.0000, Reward: -5754515.4453
    full cols: 724, non-full cols: 38
   r - labels: 202, labels - r: 105
    violated: 160773, weighted: 6035.0458984375, len: 0.0, nonzero: 0.14718997478485107
Epoch 7300, Total loss: -112855425024.0000, CE loss: 35.3874, RL loss: -1128554240.0000, Reward: -5775437.0078
    full cols: 731, non-full cols: 28
   r - labels: 200, labels - r: 106
    violated: 158227, weighted: 6042.009765625, len: 0.0, nonzero: 0.14797431230545044
Epoch 7400, Total loss: 161827864576.0000, CE loss: 35.4134, RL loss: 1618278656.0000, Reward: -5754910.1914
    full cols: 735, non-full cols: 26
   r - labels: 206, labels - r: 110
    violated: 154220, weighted: 6034.5546875, len: 0.0, nonzero: 0.1480051875114441
Epoch 7500, Total loss: -44827873280.0000, CE loss: 35.4424, RL loss: -448278752.0000, Reward: -5804132.1406
    full cols: 736, non-full cols: 19
   r - labels: 199, labels - r: 109
    violated: 152993, weighted: 5986.068359375, len: 0.0, nonzero: 0.14764389395713806
Epoch 7600, Total loss: -127209046016.0000, CE loss: 35.4242, RL loss: -1272090496.0000, Reward: -5839887.1641
    full cols: 729, non-full cols: 23
   r - labels: 203, labels - r: 116
    violated: 149529, weighted: 6291.6875, len: 0.0, nonzero: 0.14623579382896423
Epoch 7700, Total loss: 73688784896.0000, CE loss: 35.3978, RL loss: 736887872.0000, Reward: -5799110.7891
    full cols: 730, non-full cols: 37
   r - labels: 210, labels - r: 108
    violated: 155661, weighted: 6451.25537109375, len: 0.0, nonzero: 0.14800210297107697
Epoch 7800, Total loss: -2433528064.0000, CE loss: 35.4116, RL loss: -24335280.0000, Reward: -5804848.7656
    full cols: 733, non-full cols: 28
   r - labels: 213, labels - r: 117
    violated: 152857, weighted: 6717.17578125, len: 0.0, nonzero: 0.14686574041843414
Epoch 7900, Total loss: 64353574912.0000, CE loss: 35.4050, RL loss: 643535744.0000, Reward: -5804849.5703
    full cols: 743, non-full cols: 14
   r - labels: 215, labels - r: 123
    violated: 151042, weighted: 6899.4755859375, len: 0.0, nonzero: 0.14866600930690765
--- eval ---
prediction result:
f1 on test:    0.4860
f1 on test:    0.7505 (micro)
f1 on KB:      0.3325
integrated f1: 0.3627, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4730
f1 on test:    0.7333 (micro)
f1 on KB:      0.4220
integrated f1: 0.4355, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: -156609380352.0000, CE loss: 35.3919, RL loss: -1566093824.0000, Reward: -5873512.6445
    full cols: 735, non-full cols: 16
   r - labels: 209, labels - r: 123
    violated: 150069, weighted: 6694.88671875, len: 0.0, nonzero: 0.14697690308094025
Epoch 8100, Total loss: 118668238848.0000, CE loss: 35.4050, RL loss: 1186682368.0000, Reward: -5840279.5781
    full cols: 718, non-full cols: 46
   r - labels: 220, labels - r: 121
    violated: 145313, weighted: 6869.7978515625, len: 0.0, nonzero: 0.14626049995422363
Epoch 8200, Total loss: -168186003456.0000, CE loss: 35.4217, RL loss: -1681859968.0000, Reward: -5874962.1133
    full cols: 738, non-full cols: 16
   r - labels: 219, labels - r: 130
    violated: 154134, weighted: 7049.4853515625, len: 0.0, nonzero: 0.14752964675426483
Epoch 8300, Total loss: 89082953728.0000, CE loss: 35.4298, RL loss: 890829504.0000, Reward: -5876021.1953
    full cols: 723, non-full cols: 30
   r - labels: 217, labels - r: 129
    violated: 153186, weighted: 7008.791015625, len: 0.0, nonzero: 0.14604125916957855
Epoch 8400, Total loss: 3158014720.0000, CE loss: 35.4092, RL loss: 31580146.0000, Reward: -5897968.0469
    full cols: 730, non-full cols: 33
   r - labels: 230, labels - r: 132
    violated: 147553, weighted: 7265.8134765625, len: 0.0, nonzero: 0.14813797175884247
Epoch 8500, Total loss: 116063944704.0000, CE loss: 35.3922, RL loss: 1160639488.0000, Reward: -5912366.5859
    full cols: 727, non-full cols: 59
   r - labels: 246, labels - r: 125
    violated: 152632, weighted: 7256.34375, len: 0.0, nonzero: 0.14960473775863647
Epoch 8600, Total loss: -44575092736.0000, CE loss: 35.3930, RL loss: -445750912.0000, Reward: -5963890.1055
    full cols: 725, non-full cols: 50
   r - labels: 243, labels - r: 133
    violated: 143616, weighted: 7470.423828125, len: 0.0, nonzero: 0.14856410026550293
Epoch 8700, Total loss: 152992661504.0000, CE loss: 35.3932, RL loss: 1529926656.0000, Reward: -5968645.4922
    full cols: 726, non-full cols: 50
   r - labels: 247, labels - r: 136
    violated: 150069, weighted: 7635.453125, len: 0.0, nonzero: 0.14859189093112946
Epoch 8800, Total loss: 302144290816.0000, CE loss: 35.4264, RL loss: 3021442816.0000, Reward: -6022560.2031
    full cols: 734, non-full cols: 62
   r - labels: 266, labels - r: 135
    violated: 145416, weighted: 7986.1328125, len: 0.0, nonzero: 0.15139883756637573
Epoch 8900, Total loss: -24491610112.0000, CE loss: 35.4226, RL loss: -244916096.0000, Reward: -6063976.9102
    full cols: 725, non-full cols: 87
   r - labels: 287, labels - r: 140
    violated: 148965, weighted: 8298.751953125, len: 0.0, nonzero: 0.15192070603370667
Epoch 9000, Total loss: -9533102080.0000, CE loss: 35.4401, RL loss: -95331016.0000, Reward: -6081046.1172
    full cols: 713, non-full cols: 100
   r - labels: 284, labels - r: 136
    violated: 146836, weighted: 8221.6513671875, len: 0.0, nonzero: 0.15158411860466003
Epoch 9100, Total loss: 35804938240.0000, CE loss: 35.4403, RL loss: 358049376.0000, Reward: -6073842.3516
    full cols: 724, non-full cols: 69
   r - labels: 270, labels - r: 142
    violated: 153630, weighted: 8147.0087890625, len: 0.0, nonzero: 0.15009263157844543
Epoch 9200, Total loss: 88441061376.0000, CE loss: 35.4219, RL loss: 884410624.0000, Reward: -6062806.6641
    full cols: 724, non-full cols: 87
   r - labels: 284, labels - r: 138
    violated: 153138, weighted: 8313.248046875, len: 0.0, nonzero: 0.15179409086704254
Epoch 9300, Total loss: 57117003776.0000, CE loss: 35.4112, RL loss: 571170048.0000, Reward: -6103439.2422
    full cols: 731, non-full cols: 70
   r - labels: 281, labels - r: 145
    violated: 156005, weighted: 8348.7421875, len: 0.0, nonzero: 0.15095417201519012
Epoch 9400, Total loss: 96103956480.0000, CE loss: 35.4621, RL loss: 961039552.0000, Reward: -6121801.2031
    full cols: 718, non-full cols: 87
   r - labels: 286, labels - r: 146
    violated: 151454, weighted: 8480.4033203125, len: 0.0, nonzero: 0.15099123120307922
Epoch 9500, Total loss: -129235263488.0000, CE loss: 35.4084, RL loss: -1292352640.0000, Reward: -6145984.3516
    full cols: 717, non-full cols: 72
   r - labels: 280, labels - r: 156
    violated: 144280, weighted: 8707.37890625, len: 0.0, nonzero: 0.15010498464107513
Epoch 9600, Total loss: 163897720832.0000, CE loss: 35.4292, RL loss: 1638977152.0000, Reward: -6141336.6875
    full cols: 711, non-full cols: 89
   r - labels: 290, labels - r: 155
    violated: 151811, weighted: 8683.201171875, len: 0.0, nonzero: 0.15076889097690582
Epoch 9700, Total loss: 218616217600.0000, CE loss: 35.4087, RL loss: 2186162176.0000, Reward: -6137898.7812
    full cols: 731, non-full cols: 70
   r - labels: 292, labels - r: 156
    violated: 144380, weighted: 9083.98046875, len: 0.0, nonzero: 0.15085536241531372
Epoch 9800, Total loss: -77467688960.0000, CE loss: 35.4337, RL loss: -774676928.0000, Reward: -6206751.5352
    full cols: 705, non-full cols: 113
   r - labels: 301, labels - r: 148
    violated: 150721, weighted: 8964.6708984375, len: 0.0, nonzero: 0.15085844695568085
Epoch 9900, Total loss: -125311049728.0000, CE loss: 35.4313, RL loss: -1253110528.0000, Reward: -6207639.7188
    full cols: 707, non-full cols: 117
   r - labels: 310, labels - r: 151
    violated: 160400, weighted: 9119.349609375, len: 0.0, nonzero: 0.1505187749862671
--- eval ---
prediction result:
f1 on test:    0.4860
f1 on test:    0.7505 (micro)
f1 on KB:      0.3325
integrated f1: 0.3627, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4710
f1 on test:    0.7295 (micro)
f1 on KB:      0.4264
integrated f1: 0.4384, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 10000, Total loss: 28016459776.0000, CE loss: 35.4262, RL loss: 280164608.0000, Reward: -6184098.4141
    full cols: 714, non-full cols: 102
   r - labels: 304, labels - r: 153
    violated: 153641, weighted: 9213.9404296875, len: 0.0, nonzero: 0.14994750916957855
Epoch 10100, Total loss: 44660350976.0000, CE loss: 35.4448, RL loss: 446603520.0000, Reward: -6168399.8281
    full cols: 714, non-full cols: 96
   r - labels: 298, labels - r: 153
    violated: 149992, weighted: 9178.779296875, len: 0.0, nonzero: 0.15037982165813446
Epoch 10200, Total loss: 83369041920.0000, CE loss: 35.4148, RL loss: 833690432.0000, Reward: -6141564.4609
    full cols: 703, non-full cols: 120
   r - labels: 311, labels - r: 153
    violated: 145245, weighted: 9197.1875, len: 0.0, nonzero: 0.14966031908988953
Epoch 10300, Total loss: 48095133696.0000, CE loss: 35.4142, RL loss: 480951328.0000, Reward: -6148253.0703
    full cols: 695, non-full cols: 136
   r - labels: 320, labels - r: 154
    violated: 146268, weighted: 9398.0126953125, len: 0.0, nonzero: 0.14976531267166138
Epoch 10400, Total loss: 41499140096.0000, CE loss: 35.4195, RL loss: 414991392.0000, Reward: -6167748.2656
    full cols: 695, non-full cols: 127
   r - labels: 314, labels - r: 157
    violated: 144778, weighted: 9187.890625, len: 0.0, nonzero: 0.15012352168560028
Epoch 10500, Total loss: -107772224.0000, CE loss: 35.3859, RL loss: -1077722.2500, Reward: -6172228.9062
    full cols: 700, non-full cols: 93
   r - labels: 291, labels - r: 163
    violated: 146775, weighted: 9272.7919921875, len: 0.0, nonzero: 0.1480051875114441
Epoch 10600, Total loss: -6824750592.0000, CE loss: 35.4176, RL loss: -68247504.0000, Reward: -6187833.1328
    full cols: 706, non-full cols: 97
   r - labels: 298, labels - r: 160
    violated: 150429, weighted: 9412.87890625, len: 0.0, nonzero: 0.14855793118476868
Epoch 10700, Total loss: 65269006336.0000, CE loss: 35.4260, RL loss: 652690048.0000, Reward: -6192251.3281
    full cols: 680, non-full cols: 147
   r - labels: 319, labels - r: 157
    violated: 157303, weighted: 9298.318359375, len: 0.0, nonzero: 0.14892539381980896
Epoch 10800, Total loss: 60571308032.0000, CE loss: 35.3804, RL loss: 605713088.0000, Reward: -6185755.5742
    full cols: 728, non-full cols: 84
   r - labels: 310, labels - r: 163
    violated: 156571, weighted: 9526.1171875, len: 0.0, nonzero: 0.1526031345129013
Epoch 10900, Total loss: -225122992128.0000, CE loss: 35.3860, RL loss: -2251229952.0000, Reward: -6218646.7500
    full cols: 658, non-full cols: 214
   r - labels: 360, labels - r: 153
    violated: 147958, weighted: 9636.48828125, len: 0.0, nonzero: 0.14940093457698822
Epoch 11000, Total loss: -45949022208.0000, CE loss: 35.3817, RL loss: -459490208.0000, Reward: -6211822.5859
    full cols: 678, non-full cols: 157
   r - labels: 331, labels - r: 161
    violated: 147036, weighted: 9584.455078125, len: 0.0, nonzero: 0.14911067485809326
Epoch 11100, Total loss: 296726495232.0000, CE loss: 35.4430, RL loss: 2967265024.0000, Reward: -6232884.9531
    full cols: 704, non-full cols: 105
   r - labels: 311, labels - r: 167
    violated: 150752, weighted: 9700.3359375, len: 0.0, nonzero: 0.1496695876121521
Epoch 11200, Total loss: 52645703680.0000, CE loss: 35.4156, RL loss: 526457024.0000, Reward: -6268482.4531
    full cols: 699, non-full cols: 117
   r - labels: 323, labels - r: 172
    violated: 148311, weighted: 10059.7958984375, len: 0.0, nonzero: 0.15069787204265594
Epoch 11300, Total loss: 111321743360.0000, CE loss: 35.4025, RL loss: 1113217408.0000, Reward: -6246968.4258
    full cols: 692, non-full cols: 136
   r - labels: 337, labels - r: 174
    violated: 155416, weighted: 10199.734375, len: 0.0, nonzero: 0.14965106546878815
Epoch 11400, Total loss: 108135563264.0000, CE loss: 35.3736, RL loss: 1081355648.0000, Reward: -6210009.4453
    full cols: 648, non-full cols: 253
   r - labels: 393, labels - r: 157
    violated: 139747, weighted: 10132.69140625, len: 0.0, nonzero: 0.1519608348608017
Epoch 11500, Total loss: 11455962112.0000, CE loss: 35.3598, RL loss: 114559624.0000, Reward: -6210395.1016
    full cols: 704, non-full cols: 135
   r - labels: 348, labels - r: 174
    violated: 144872, weighted: 10198.51953125, len: 0.0, nonzero: 0.1510004848241806
Epoch 11600, Total loss: 102142517248.0000, CE loss: 35.3946, RL loss: 1021425152.0000, Reward: -6173305.1797
    full cols: 703, non-full cols: 114
   r - labels: 333, labels - r: 181
    violated: 148989, weighted: 10281.349609375, len: 0.0, nonzero: 0.15004323422908783
Epoch 11700, Total loss: -35491096.0000, CE loss: 35.3666, RL loss: -354910.9688, Reward: -6208035.7734
    full cols: 685, non-full cols: 146
   r - labels: 342, labels - r: 176
    violated: 151574, weighted: 10142.826171875, len: 0.0, nonzero: 0.14962635934352875
Epoch 11800, Total loss: -17551245312.0000, CE loss: 35.3694, RL loss: -175512448.0000, Reward: -6194517.5195
    full cols: 715, non-full cols: 79
   r - labels: 314, labels - r: 185
    violated: 159001, weighted: 10185.189453125, len: 0.0, nonzero: 0.14900876581668854
Epoch 11900, Total loss: -53839233024.0000, CE loss: 35.3762, RL loss: -538392320.0000, Reward: -6184232.3945
    full cols: 708, non-full cols: 88
   r - labels: 315, labels - r: 184
    violated: 147305, weighted: 10130.240234375, len: 0.0, nonzero: 0.1487709879875183
--- eval ---
prediction result:
f1 on test:    0.4860
f1 on test:    0.7505 (micro)
f1 on KB:      0.3325
integrated f1: 0.3627, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4698
f1 on test:    0.7273 (micro)
f1 on KB:      0.4271
integrated f1: 0.4387, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 12000, Total loss: -52042686464.0000, CE loss: 35.3741, RL loss: -520426848.0000, Reward: -6183609.6953
    full cols: 684, non-full cols: 126
   r - labels: 329, labels - r: 184
    violated: 147268, weighted: 10540.5673828125, len: 0.0, nonzero: 0.14818736910820007
Epoch 12100, Total loss: -50539966464.0000, CE loss: 35.4328, RL loss: -505399680.0000, Reward: -6184580.8711
    full cols: 701, non-full cols: 107
   r - labels: 331, labels - r: 188
    violated: 149084, weighted: 10332.705078125, len: 0.0, nonzero: 0.14965415000915527
Epoch 12200, Total loss: -13747633152.0000, CE loss: 35.3387, RL loss: -137476336.0000, Reward: -6197867.6172
    full cols: 672, non-full cols: 163
   r - labels: 346, labels - r: 176
    violated: 151229, weighted: 10417.841796875, len: 0.0, nonzero: 0.14831706881523132
Epoch 12300, Total loss: -148179763200.0000, CE loss: 35.3441, RL loss: -1481797632.0000, Reward: -6220608.2617
    full cols: 686, non-full cols: 138
   r - labels: 345, labels - r: 186
    violated: 147217, weighted: 10561.978515625, len: 0.0, nonzero: 0.1481163501739502
Epoch 12400, Total loss: 158422908928.0000, CE loss: 35.3461, RL loss: 1584229120.0000, Reward: -6190434.6953
    full cols: 716, non-full cols: 76
   r - labels: 321, labels - r: 194
    violated: 143359, weighted: 10755.6943359375, len: 0.0, nonzero: 0.15002469718456268
Epoch 12500, Total loss: -81574289408.0000, CE loss: 35.3588, RL loss: -815742912.0000, Reward: -6266522.3633
    full cols: 662, non-full cols: 176
   r - labels: 353, labels - r: 180
    violated: 150142, weighted: 10580.935546875, len: 0.0, nonzero: 0.14820590615272522
Epoch 12600, Total loss: 154932690944.0000, CE loss: 35.3859, RL loss: 1549326848.0000, Reward: -6239058.0195
    full cols: 677, non-full cols: 140
   r - labels: 344, labels - r: 192
    violated: 147648, weighted: 10711.4716796875, len: 0.0, nonzero: 0.14863203465938568
Epoch 12700, Total loss: 80771080192.0000, CE loss: 35.3492, RL loss: 807710784.0000, Reward: -6218045.1562
    full cols: 675, non-full cols: 136
   r - labels: 332, labels - r: 186
    violated: 144469, weighted: 10695.580078125, len: 0.0, nonzero: 0.1475389003753662
Epoch 12800, Total loss: 78055710720.0000, CE loss: 35.3944, RL loss: 780557120.0000, Reward: -6232265.3672
    full cols: 646, non-full cols: 194
   r - labels: 358, labels - r: 183
    violated: 151646, weighted: 10650.150390625, len: 0.0, nonzero: 0.14625123143196106
Epoch 12900, Total loss: -120547876864.0000, CE loss: 35.3664, RL loss: -1205478784.0000, Reward: -6299532.8867
    full cols: 676, non-full cols: 133
   r - labels: 340, labels - r: 196
    violated: 142514, weighted: 10788.9560546875, len: 0.0, nonzero: 0.14731039106845856
Epoch 13000, Total loss: 23517401088.0000, CE loss: 35.4317, RL loss: 235174016.0000, Reward: -6322858.7500
    full cols: 656, non-full cols: 172
   r - labels: 355, labels - r: 192
    violated: 156245, weighted: 10704.126953125, len: 0.0, nonzero: 0.14744935929775238
Epoch 13100, Total loss: 123149656064.0000, CE loss: 35.4134, RL loss: 1231496576.0000, Reward: -6292151.6641
    full cols: 663, non-full cols: 152
   r - labels: 349, labels - r: 199
    violated: 152350, weighted: 10716.01171875, len: 0.0, nonzero: 0.14700469374656677
Epoch 13200, Total loss: -81758552064.0000, CE loss: 35.3964, RL loss: -817585536.0000, Reward: -6333398.8242
    full cols: 668, non-full cols: 143
   r - labels: 349, labels - r: 203
    violated: 148895, weighted: 10815.23828125, len: 0.0, nonzero: 0.14648282527923584
Epoch 13300, Total loss: 35025944576.0000, CE loss: 35.3930, RL loss: 350259456.0000, Reward: -6356192.7422
    full cols: 661, non-full cols: 147
   r - labels: 345, labels - r: 202
    violated: 146670, weighted: 10883.548828125, len: 0.0, nonzero: 0.14560584723949432
Epoch 13400, Total loss: -50669240320.0000, CE loss: 35.3949, RL loss: -506692416.0000, Reward: -6387170.8906
    full cols: 595, non-full cols: 327
   r - labels: 436, labels - r: 179
    violated: 150211, weighted: 10917.857421875, len: 0.0, nonzero: 0.14448802173137665
Epoch 13500, Total loss: -5967845888.0000, CE loss: 35.4263, RL loss: -59678460.0000, Reward: -6302098.2109
    full cols: 629, non-full cols: 211
   r - labels: 373, labels - r: 198
    violated: 140113, weighted: 10844.267578125, len: 0.0, nonzero: 0.14441390335559845
Epoch 13600, Total loss: -58912129024.0000, CE loss: 35.3945, RL loss: -589121280.0000, Reward: -6326485.0273
    full cols: 619, non-full cols: 233
   r - labels: 383, labels - r: 196
    violated: 147259, weighted: 11092.8154296875, len: 0.0, nonzero: 0.14408040046691895
Epoch 13700, Total loss: -247948345344.0000, CE loss: 35.3607, RL loss: -2479483392.0000, Reward: -6358510.1562
    full cols: 604, non-full cols: 277
   r - labels: 411, labels - r: 195
    violated: 144264, weighted: 11240.6845703125, len: 0.0, nonzero: 0.1427680253982544
Epoch 13800, Total loss: 118857818112.0000, CE loss: 35.3889, RL loss: 1188578176.0000, Reward: -6342731.8008
    full cols: 632, non-full cols: 194
   r - labels: 371, labels - r: 210
    violated: 154150, weighted: 11380.84765625, len: 0.0, nonzero: 0.143607959151268
Epoch 13900, Total loss: 57409605632.0000, CE loss: 35.3600, RL loss: 574096064.0000, Reward: -6354559.5625
    full cols: 618, non-full cols: 242
   r - labels: 397, labels - r: 202
    violated: 154764, weighted: 11129.32421875, len: 0.0, nonzero: 0.14266304671764374
--- eval ---
prediction result:
f1 on test:    0.4860
f1 on test:    0.7505 (micro)
f1 on KB:      0.3325
integrated f1: 0.3627, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4683
f1 on test:    0.7257 (micro)
f1 on KB:      0.4283
integrated f1: 0.4392, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 14000, Total loss: -60819103744.0000, CE loss: 35.3529, RL loss: -608191040.0000, Reward: -6356708.4531
    full cols: 608, non-full cols: 285
   r - labels: 424, labels - r: 196
    violated: 152265, weighted: 11286.701171875, len: 0.0, nonzero: 0.14286375045776367
Epoch 14100, Total loss: -352756105216.0000, CE loss: 35.3473, RL loss: -3527561216.0000, Reward: -6369434.6758
    full cols: 614, non-full cols: 241
   r - labels: 399, labels - r: 209
    violated: 165589, weighted: 11294.79296875, len: 0.0, nonzero: 0.14291316270828247
Epoch 14200, Total loss: 114123669504.0000, CE loss: 35.3459, RL loss: 1141236736.0000, Reward: -6334660.3203
    full cols: 630, non-full cols: 217
   r - labels: 391, labels - r: 209
    violated: 142417, weighted: 11498.9423828125, len: 0.0, nonzero: 0.1446918249130249
Epoch 14300, Total loss: 43418005504.0000, CE loss: 35.3426, RL loss: 434180064.0000, Reward: -6305434.0859
    full cols: 660, non-full cols: 136
   r - labels: 352, labels - r: 221
    violated: 147257, weighted: 11452.9873046875, len: 0.0, nonzero: 0.14422862231731415
Epoch 14400, Total loss: -102903791616.0000, CE loss: 35.3852, RL loss: -1029037888.0000, Reward: -6318101.2383
    full cols: 628, non-full cols: 203
   r - labels: 382, labels - r: 216
    violated: 156700, weighted: 11542.544921875, len: 0.0, nonzero: 0.14256422221660614
Epoch 14500, Total loss: 22589444096.0000, CE loss: 35.3613, RL loss: 225894432.0000, Reward: -6288135.1641
    full cols: 652, non-full cols: 143
   r - labels: 351, labels - r: 221
    violated: 148969, weighted: 11555.6591796875, len: 0.0, nonzero: 0.14265069365501404
Epoch 14600, Total loss: -89073762304.0000, CE loss: 35.3283, RL loss: -890737600.0000, Reward: -6262067.3242
    full cols: 656, non-full cols: 132
   r - labels: 351, labels - r: 228
    violated: 158792, weighted: 11594.35546875, len: 0.0, nonzero: 0.1436450034379959
Epoch 14700, Total loss: 24666527744.0000, CE loss: 35.3423, RL loss: 246665280.0000, Reward: -6234512.2344
    full cols: 678, non-full cols: 96
   r - labels: 338, labels - r: 229
    violated: 150280, weighted: 11644.361328125, len: 0.0, nonzero: 0.14346590638160706
Epoch 14800, Total loss: 123625250816.0000, CE loss: 35.3287, RL loss: 1236252544.0000, Reward: -6271981.0117
    full cols: 655, non-full cols: 132
   r - labels: 347, labels - r: 225
    violated: 153140, weighted: 11636.13671875, len: 0.0, nonzero: 0.14359869062900543
Epoch 14900, Total loss: 182997073920.0000, CE loss: 35.3696, RL loss: 1829970688.0000, Reward: -6295179.1172
    full cols: 653, non-full cols: 162
   r - labels: 369, labels - r: 219
    violated: 142624, weighted: 11871.8583984375, len: 0.0, nonzero: 0.14474740624427795
Epoch 15000, Total loss: -95398019072.0000, CE loss: 35.3375, RL loss: -953980160.0000, Reward: -6322901.9141
    full cols: 622, non-full cols: 225
   r - labels: 395, labels - r: 213
    violated: 152417, weighted: 11849.951171875, len: 0.0, nonzero: 0.1437283754348755
------ ABL Loop 0 ------
--- eval ---
prediction result:
f1 on test:    0.4860
f1 on test:    0.7505 (micro)
f1 on KB:      0.3325
f1 on orig KB: 0.3325
integrated f1: 0.3612, w_data: 0.2870, w_klg: 0.7130

integrated result:
f1 on test:    0.4688
f1 on test:    0.7256 (micro)
f1 on KB:      0.4285
f1 on orig KB: 0.4285
integrated f1: 0.4390, w_data: 0.2870, w_klg: 0.7130
------------
integrated f1 0.3612

KB before refine:
num_nodes: 5060.0000
num_edges: 173493.0000
density: 0.0068
avg_degree: 34.2872
avg_clustering: 0.2880
degree_assortativity: 0.1845
modularity: 0.4495
avg_betweenness: 0.0002
avg_closeness: 0.1414
Iteration 0: Loss = 10852311.000000
|Xk-Y|_F:  10852311.000000, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 9443902, f1 =  0.366878, approx slack: 2132405
rounded before pow |X_k-Y|_0 = 9294933, f1 =  0.316330

Iteration 20: Loss = 13104920.000000
|Xk-Y|_F:  12839117.000000, |X-X0|:  265802.937500
rounded |X_k-Y|_0 = 10908287, f1 =  0.274091, approx slack: 2007617
rounded before pow |X_k-Y|_0 = 9294933, f1 =  0.316330

Iteration 40: Loss = 12931615.000000
|Xk-Y|_F:  12699641.000000, |X-X0|:  231974.468750
rounded |X_k-Y|_0 = 10806915, f1 =  0.277015, approx slack: 264184
rounded before pow |X_k-Y|_0 = 11002479, f1 =  0.271377

Iteration 60: Loss = 12539144.000000
|Xk-Y|_F:  12337286.000000, |X-X0|:  201858.125000
rounded |X_k-Y|_0 = 10520089, f1 =  0.285195, approx slack: 623888
rounded before pow |X_k-Y|_0 = 10958465, f1 =  0.272656

Iteration 80: Loss = 11834150.000000
|Xk-Y|_F:  11653621.000000, |X-X0|:  180528.812500
rounded |X_k-Y|_0 = 9895145, f1 =  0.302407, approx slack: 456542
rounded before pow |X_k-Y|_0 = 9942918, f1 =  0.301355

Iteration 100: Loss = 11546964.000000
|Xk-Y|_F:  11380830.000000, |X-X0|:  166134.218750
rounded |X_k-Y|_0 = 9630108, f1 =  0.309714, approx slack: 327799
rounded before pow |X_k-Y|_0 = 9805102, f1 =  0.305018

Iteration 120: Loss = 11454628.000000
|Xk-Y|_F:  11299055.000000, |X-X0|:  155573.156250
rounded |X_k-Y|_0 = 9548473, f1 =  0.311945, approx slack: 320742
rounded before pow |X_k-Y|_0 = 9718606, f1 =  0.307409

Iteration 140: Loss = 11389205.000000
|Xk-Y|_F:  11241962.000000, |X-X0|:  147243.031250
rounded |X_k-Y|_0 = 9495125, f1 =  0.313387, approx slack: 306056
rounded before pow |X_k-Y|_0 = 9638495, f1 =  0.309624

Iteration 160: Loss = 11311812.000000
|Xk-Y|_F:  11171371.000000, |X-X0|:  140441.031250
rounded |X_k-Y|_0 = 9435521, f1 =  0.315007, approx slack: 279707
rounded before pow |X_k-Y|_0 = 9582903, f1 =  0.311158

Iteration 180: Loss = 11239510.000000
|Xk-Y|_F:  11104526.000000, |X-X0|:  134984.109375
rounded |X_k-Y|_0 = 9382893, f1 =  0.316443, approx slack: 231177
rounded before pow |X_k-Y|_0 = 9520363, f1 =  0.312891

Iteration 200: Loss = 11189994.000000
|Xk-Y|_F:  11059450.000000, |X-X0|:  130544.296875
rounded |X_k-Y|_0 = 9350402, f1 =  0.317336, approx slack: 256682
rounded before pow |X_k-Y|_0 = 9501314, f1 =  0.313600

Iteration 220: Loss = 11141469.000000
|Xk-Y|_F:  11014758.000000, |X-X0|:  126710.812500
rounded |X_k-Y|_0 = 9314920, f1 =  0.318474, approx slack: 841419
rounded before pow |X_k-Y|_0 = 10039190, f1 =  0.298722

Iteration 240: Loss = 11102383.000000
|Xk-Y|_F:  10979264.000000, |X-X0|:  123118.937500
rounded |X_k-Y|_0 = 9287306, f1 =  0.319401, approx slack: 891355
rounded before pow |X_k-Y|_0 = 10048915, f1 =  0.298467

Iteration 260: Loss = 11063037.000000
|Xk-Y|_F:  10943278.000000, |X-X0|:  119758.953125
rounded |X_k-Y|_0 = 9263155, f1 =  0.320111, approx slack: 903400
rounded before pow |X_k-Y|_0 = 10052345, f1 =  0.298372

Iteration 280: Loss = 11029988.000000
|Xk-Y|_F:  10913277.000000, |X-X0|:  116711.101562
rounded |X_k-Y|_0 = 9245132, f1 =  0.320622, approx slack: 891342
rounded before pow |X_k-Y|_0 = 10025640, f1 =  0.299118

Iteration 300: Loss = 10988558.000000
|Xk-Y|_F:  10874638.000000, |X-X0|:  113919.609375
rounded |X_k-Y|_0 = 9221593, f1 =  0.321275, approx slack: 895178
rounded before pow |X_k-Y|_0 = 10002193, f1 =  0.299773

Iteration 320: Loss = 10945730.000000
|Xk-Y|_F:  10834397.000000, |X-X0|:  111333.320312
rounded |X_k-Y|_0 = 9197525, f1 =  0.321924, approx slack: 875044
rounded before pow |X_k-Y|_0 = 9967565, f1 =  0.300713

Iteration 340: Loss = 10907102.000000
|Xk-Y|_F:  10798139.000000, |X-X0|:  108963.343750
rounded |X_k-Y|_0 = 9175722, f1 =  0.322504, approx slack: 912737
rounded before pow |X_k-Y|_0 = 9983781, f1 =  0.300225

Iteration 360: Loss = 10868170.000000
|Xk-Y|_F:  10761405.000000, |X-X0|:  106765.468750
rounded |X_k-Y|_0 = 9152580, f1 =  0.323109, approx slack: 985737
rounded before pow |X_k-Y|_0 = 10027234, f1 =  0.299018

Iteration 380: Loss = 10823033.000000
|Xk-Y|_F:  10718304.000000, |X-X0|:  104728.921875
rounded |X_k-Y|_0 = 9124745, f1 =  0.323831, approx slack: 1002946
rounded before pow |X_k-Y|_0 = 10012381, f1 =  0.299431

Iteration 400: Loss = 10770473.000000
|Xk-Y|_F:  10667628.000000, |X-X0|:  102844.984375
rounded |X_k-Y|_0 = 9091711, f1 =  0.324686, approx slack: 1026863
rounded before pow |X_k-Y|_0 = 9992551, f1 =  0.299984

Iteration 420: Loss = 10713461.000000
|Xk-Y|_F:  10612319.000000, |X-X0|:  101141.765625
rounded |X_k-Y|_0 = 9052377, f1 =  0.325701, approx slack: 1058550
rounded before pow |X_k-Y|_0 = 9970683, f1 =  0.300611

Iteration 440: Loss = 10636652.000000
|Xk-Y|_F:  10537036.000000, |X-X0|:  99616.312500
rounded |X_k-Y|_0 = 9000511, f1 =  0.327031, approx slack: 858976
rounded before pow |X_k-Y|_0 = 9728418, f1 =  0.307360

Iteration 460: Loss = 10555427.000000
|Xk-Y|_F:  10457115.000000, |X-X0|:  98311.906250
rounded |X_k-Y|_0 = 8944619, f1 =  0.328461, approx slack: 922553
rounded before pow |X_k-Y|_0 = 9721497, f1 =  0.307552

Iteration 480: Loss = 10454141.000000
|Xk-Y|_F:  10357020.000000, |X-X0|:  97120.671875
rounded |X_k-Y|_0 = 8869778, f1 =  0.330361, approx slack: 1062029
rounded before pow |X_k-Y|_0 = 9760397, f1 =  0.306483

Iteration 500: Loss = 10305843.000000
|Xk-Y|_F:  10209637.000000, |X-X0|:  96205.687500
rounded |X_k-Y|_0 = 8755857, f1 =  0.333232, approx slack: 1207587
rounded before pow |X_k-Y|_0 = 9760282, f1 =  0.306487

Iteration 520: Loss = 10069690.000000
|Xk-Y|_F:  9973502.000000, |X-X0|:  96188.093750
rounded |X_k-Y|_0 = 8576212, f1 =  0.337662, approx slack: 1730562
rounded before pow |X_k-Y|_0 = 10029228, f1 =  0.299009

Iteration 540: Loss = 9569032.000000
|Xk-Y|_F:  9464981.000000, |X-X0|:  104050.601562
rounded |X_k-Y|_0 = 8181632, f1 =  0.346525, approx slack: 2300252
rounded before pow |X_k-Y|_0 = 9991765, f1 =  0.300000

Iteration 560: Loss = 9031695.000000
|Xk-Y|_F:  8913270.000000, |X-X0|:  118424.921875
rounded |X_k-Y|_0 = 7738371, f1 =  0.356673, approx slack: 2908866
rounded before pow |X_k-Y|_0 = 10025187, f1 =  0.299086

Iteration 580: Loss = 8567321.000000
|Xk-Y|_F:  8433924.000000, |X-X0|:  133397.125000
rounded |X_k-Y|_0 = 7348254, f1 =  0.365909, approx slack: 4137020
rounded before pow |X_k-Y|_0 = 10722613, f1 =  0.279437

Iteration 600: Loss = 7908224.000000
|Xk-Y|_F:  7758421.500000, |X-X0|:  149802.500000
rounded |X_k-Y|_0 = 6798894, f1 =  0.379817, approx slack: 4784300
rounded before pow |X_k-Y|_0 = 10700862, f1 =  0.280062

Iteration 620: Loss = 7100244.000000
|Xk-Y|_F:  6941361.000000, |X-X0|:  158882.906250
rounded |X_k-Y|_0 = 6072680, f1 =  0.402061, approx slack: 5009425
rounded before pow |X_k-Y|_0 = 10287154, f1 =  0.291783

Iteration 640: Loss = 6264266.000000
|Xk-Y|_F:  6097862.500000, |X-X0|:  166403.500000
rounded |X_k-Y|_0 = 5359748, f1 =  0.422866, approx slack: 5679537
rounded before pow |X_k-Y|_0 = 10171793, f1 =  0.295046

Iteration 660: Loss = 5188385.000000
|Xk-Y|_F:  5010620.000000, |X-X0|:  177765.125000
rounded |X_k-Y|_0 = 4435432, f1 =  0.452117, approx slack: 6676583
rounded before pow |X_k-Y|_0 = 10141761, f1 =  0.295887

Iteration 680: Loss = 3987460.250000
|Xk-Y|_F:  3793438.500000, |X-X0|:  194021.750000
rounded |X_k-Y|_0 = 3386770, f1 =  0.490608, approx slack: 7764007
rounded before pow |X_k-Y|_0 = 10061023, f1 =  0.298154

Iteration 700: Loss = 2825563.250000
|Xk-Y|_F:  2610799.500000, |X-X0|:  214763.703125
rounded |X_k-Y|_0 = 2346559, f1 =  0.539964, approx slack: 8758935
rounded before pow |X_k-Y|_0 = 10033004, f1 =  0.298939

Iteration 720: Loss = 1863851.875000
|Xk-Y|_F:  1631146.750000, |X-X0|:  232705.093750
rounded |X_k-Y|_0 = 1462800, f1 =  0.595759, approx slack: 9443831
rounded before pow |X_k-Y|_0 = 10003335, f1 =  0.299750

Iteration 740: Loss = 1350778.000000
|Xk-Y|_F:  1115317.250000, |X-X0|:  235460.781250
rounded |X_k-Y|_0 = 985452, f1 =  0.632094, approx slack: 9775807
rounded before pow |X_k-Y|_0 = 10011913, f1 =  0.299502

Iteration 760: Loss = 1191630.750000
|Xk-Y|_F:  971536.437500, |X-X0|:  220094.312500
rounded |X_k-Y|_0 = 870249, f1 =  0.641592, approx slack: 9889622
rounded before pow |X_k-Y|_0 = 10046601, f1 =  0.298527

Iteration 780: Loss = 1130965.375000
|Xk-Y|_F:  925038.312500, |X-X0|:  205927.046875
rounded |X_k-Y|_0 = 836072, f1 =  0.644488, approx slack: 9965643
rounded before pow |X_k-Y|_0 = 10102526, f1 =  0.296949

Iteration 800: Loss = 1098307.500000
|Xk-Y|_F:  899834.250000, |X-X0|:  198473.187500
rounded |X_k-Y|_0 = 815843, f1 =  0.646234, approx slack: 10010197
rounded before pow |X_k-Y|_0 = 10135793, f1 =  0.296015

Iteration 820: Loss = 1075736.250000
|Xk-Y|_F:  882392.000000, |X-X0|:  193344.265625
rounded |X_k-Y|_0 = 806468, f1 =  0.647195, approx slack: 10027006
rounded before pow |X_k-Y|_0 = 10149504, f1 =  0.295622

Iteration 840: Loss = 1057864.375000
|Xk-Y|_F:  868384.875000, |X-X0|:  189479.468750
rounded |X_k-Y|_0 = 796970, f1 =  0.648056, approx slack: 10049792
rounded before pow |X_k-Y|_0 = 10167021, f1 =  0.295127

Iteration 860: Loss = 1043137.375000
|Xk-Y|_F:  856864.937500, |X-X0|:  186272.406250
rounded |X_k-Y|_0 = 789293, f1 =  0.648755, approx slack: 10099883
rounded before pow |X_k-Y|_0 = 10211629, f1 =  0.293867

Iteration 880: Loss = 1031060.750000
|Xk-Y|_F:  847526.875000, |X-X0|:  183533.906250
rounded |X_k-Y|_0 = 780799, f1 =  0.649505, approx slack: 10118656
rounded before pow |X_k-Y|_0 = 10220474, f1 =  0.293622

Iteration 900: Loss = 1022006.375000
|Xk-Y|_F:  840935.000000, |X-X0|:  181071.343750
rounded |X_k-Y|_0 = 777387, f1 =  0.649843, approx slack: 10121798
rounded before pow |X_k-Y|_0 = 10222728, f1 =  0.293557

Iteration 920: Loss = 1014887.875000
|Xk-Y|_F:  836070.812500, |X-X0|:  178817.093750
rounded |X_k-Y|_0 = 774994, f1 =  0.650101, approx slack: 10070671
rounded before pow |X_k-Y|_0 = 10172576, f1 =  0.294969

Iteration 940: Loss = 1008750.937500
|Xk-Y|_F:  831974.375000, |X-X0|:  176776.562500
rounded |X_k-Y|_0 = 773001, f1 =  0.650305, approx slack: 10087211
rounded before pow |X_k-Y|_0 = 10185793, f1 =  0.294599

Iteration 960: Loss = 1003371.500000
|Xk-Y|_F:  828474.937500, |X-X0|:  174896.578125
rounded |X_k-Y|_0 = 771374, f1 =  0.650490, approx slack: 10047367
rounded before pow |X_k-Y|_0 = 10149093, f1 =  0.295629

Iteration 980: Loss = 998462.812500
|Xk-Y|_F:  825332.750000, |X-X0|:  173130.046875
rounded |X_k-Y|_0 = 770203, f1 =  0.650631, approx slack: 10049750
rounded before pow |X_k-Y|_0 = 10150268, f1 =  0.295592

Iteration 1000: Loss = 993979.812500
|Xk-Y|_F:  822506.062500, |X-X0|:  171473.750000
rounded |X_k-Y|_0 = 769119, f1 =  0.650763, approx slack: 10038824
rounded before pow |X_k-Y|_0 = 10140008, f1 =  0.295877

Iteration 1020: Loss = 989899.875000
|Xk-Y|_F:  819974.125000, |X-X0|:  169925.781250
rounded |X_k-Y|_0 = 768116, f1 =  0.650883, approx slack: 10030570
rounded before pow |X_k-Y|_0 = 10131940, f1 =  0.296102

Iteration 1040: Loss = 986171.625000
|Xk-Y|_F:  817666.437500, |X-X0|:  168505.187500
rounded |X_k-Y|_0 = 767285, f1 =  0.650990, approx slack: 10047481
rounded before pow |X_k-Y|_0 = 10147995, f1 =  0.295650

Iteration 1060: Loss = 982668.000000
|Xk-Y|_F:  815540.937500, |X-X0|:  167127.093750
rounded |X_k-Y|_0 = 766504, f1 =  0.651085, approx slack: 10043938
rounded before pow |X_k-Y|_0 = 10143513, f1 =  0.295777

Iteration 1080: Loss = 979337.625000
|Xk-Y|_F:  813519.687500, |X-X0|:  165817.906250
rounded |X_k-Y|_0 = 765753, f1 =  0.651171, approx slack: 10187547
rounded before pow |X_k-Y|_0 = 10284097, f1 =  0.291812

Iteration 1100: Loss = 976010.875000
|Xk-Y|_F:  811425.000000, |X-X0|:  164585.843750
rounded |X_k-Y|_0 = 765145, f1 =  0.651247, approx slack: 10192143
rounded before pow |X_k-Y|_0 = 10283940, f1 =  0.291824

Iteration 1120: Loss = 972246.250000
|Xk-Y|_F:  808866.625000, |X-X0|:  163379.593750
rounded |X_k-Y|_0 = 764308, f1 =  0.651341, approx slack: 10093484
rounded before pow |X_k-Y|_0 = 10186550, f1 =  0.294572

Iteration 1140: Loss = 968057.750000
|Xk-Y|_F:  805841.000000, |X-X0|:  162216.734375
rounded |X_k-Y|_0 = 761129, f1 =  0.651619, approx slack: 10094546
rounded before pow |X_k-Y|_0 = 10185056, f1 =  0.294613

Iteration 1160: Loss = 965081.062500
|Xk-Y|_F:  803975.000000, |X-X0|:  161106.078125
rounded |X_k-Y|_0 = 760432, f1 =  0.651699, approx slack: 10082852
rounded before pow |X_k-Y|_0 = 10173034, f1 =  0.294953

Iteration 1180: Loss = 962424.187500
|Xk-Y|_F:  802366.125000, |X-X0|:  160058.062500
rounded |X_k-Y|_0 = 759972, f1 =  0.651764, approx slack: 10079576
rounded before pow |X_k-Y|_0 = 10170076, f1 =  0.295035

Iteration 1200: Loss = 959868.625000
|Xk-Y|_F:  800851.062500, |X-X0|:  159017.562500
rounded |X_k-Y|_0 = 759508, f1 =  0.651825, approx slack: 10083258
rounded before pow |X_k-Y|_0 = 10173402, f1 =  0.294941

Iteration 1220: Loss = 957360.375000
|Xk-Y|_F:  799382.000000, |X-X0|:  157978.406250
rounded |X_k-Y|_0 = 759034, f1 =  0.651886, approx slack: 10072645
rounded before pow |X_k-Y|_0 = 10162527, f1 =  0.295247

Iteration 1240: Loss = 955020.375000
|Xk-Y|_F:  798018.125000, |X-X0|:  157002.250000
rounded |X_k-Y|_0 = 758552, f1 =  0.651946, approx slack: 10070779
rounded before pow |X_k-Y|_0 = 10160335, f1 =  0.295308

Iteration 1260: Loss = 952743.125000
|Xk-Y|_F:  796680.687500, |X-X0|:  156062.437500
rounded |X_k-Y|_0 = 758197, f1 =  0.651995, approx slack: 10061886
rounded before pow |X_k-Y|_0 = 10151252, f1 =  0.295562

Iteration 1280: Loss = 950569.437500
|Xk-Y|_F:  795437.437500, |X-X0|:  155132.015625
rounded |X_k-Y|_0 = 757828, f1 =  0.652041, approx slack: 10055482
rounded before pow |X_k-Y|_0 = 10144656, f1 =  0.295748

Iteration 1300: Loss = 948646.000000
|Xk-Y|_F:  794379.312500, |X-X0|:  154266.687500
rounded |X_k-Y|_0 = 757455, f1 =  0.652088, approx slack: 10051382
rounded before pow |X_k-Y|_0 = 10140612, f1 =  0.295861

Iteration 1320: Loss = 946808.500000
|Xk-Y|_F:  793359.687500, |X-X0|:  153448.843750
rounded |X_k-Y|_0 = 756989, f1 =  0.652142, approx slack: 10045996
rounded before pow |X_k-Y|_0 = 10135322, f1 =  0.296009

Iteration 1340: Loss = 945034.312500
|Xk-Y|_F:  792384.437500, |X-X0|:  152649.875000
rounded |X_k-Y|_0 = 756630, f1 =  0.652187, approx slack: 10039753
rounded before pow |X_k-Y|_0 = 10128709, f1 =  0.296197

Iteration 1360: Loss = 943340.500000
|Xk-Y|_F:  791460.312500, |X-X0|:  151880.187500
rounded |X_k-Y|_0 = 756279, f1 =  0.652229, approx slack: 10039007
rounded before pow |X_k-Y|_0 = 10127528, f1 =  0.296231

Iteration 1380: Loss = 941722.125000
|Xk-Y|_F:  790590.125000, |X-X0|:  151131.984375
rounded |X_k-Y|_0 = 755962, f1 =  0.652265, approx slack: 10035597
rounded before pow |X_k-Y|_0 = 10123877, f1 =  0.296333

Iteration 1400: Loss = 940178.812500
|Xk-Y|_F:  789774.125000, |X-X0|:  150404.687500
rounded |X_k-Y|_0 = 755666, f1 =  0.652299, approx slack: 10042862
rounded before pow |X_k-Y|_0 = 10130623, f1 =  0.296143

Iteration 1420: Loss = 938701.500000
|Xk-Y|_F:  788994.000000, |X-X0|:  149707.500000
rounded |X_k-Y|_0 = 755260, f1 =  0.652340, approx slack: 10036627
rounded before pow |X_k-Y|_0 = 10124518, f1 =  0.296315

Iteration 1440: Loss = 937265.625000
|Xk-Y|_F:  788227.750000, |X-X0|:  149037.859375
rounded |X_k-Y|_0 = 755020, f1 =  0.652369, approx slack: 10052822
rounded before pow |X_k-Y|_0 = 10140309, f1 =  0.295870

Iteration 1460: Loss = 935869.062500
|Xk-Y|_F:  787477.375000, |X-X0|:  148391.687500
rounded |X_k-Y|_0 = 754721, f1 =  0.652404, approx slack: 10048412
rounded before pow |X_k-Y|_0 = 10136044, f1 =  0.295989

Iteration 1480: Loss = 934495.562500
|Xk-Y|_F:  786734.000000, |X-X0|:  147761.546875
rounded |X_k-Y|_0 = 754404, f1 =  0.652437, approx slack: 10037920
rounded before pow |X_k-Y|_0 = 10126538, f1 =  0.296254

Iteration 1500: Loss = 933152.187500
|Xk-Y|_F:  785996.500000, |X-X0|:  147155.687500
rounded |X_k-Y|_0 = 754099, f1 =  0.652470, approx slack: 10015463
rounded before pow |X_k-Y|_0 = 10119272, f1 =  0.296438

Iteration 1520: Loss = 931846.250000
|Xk-Y|_F:  785289.750000, |X-X0|:  146556.531250
rounded |X_k-Y|_0 = 753713, f1 =  0.652508, approx slack: 10004956
rounded before pow |X_k-Y|_0 = 10108757, f1 =  0.296734

Iteration 1540: Loss = 930579.250000
|Xk-Y|_F:  784602.500000, |X-X0|:  145976.718750
rounded |X_k-Y|_0 = 753300, f1 =  0.652553, approx slack: 10001506
rounded before pow |X_k-Y|_0 = 10105358, f1 =  0.296829

Iteration 1560: Loss = 929352.562500
|Xk-Y|_F:  783925.125000, |X-X0|:  145427.421875
rounded |X_k-Y|_0 = 752978, f1 =  0.652588, approx slack: 9998720
rounded before pow |X_k-Y|_0 = 10102578, f1 =  0.296907

Iteration 1580: Loss = 928145.125000
|Xk-Y|_F:  783257.500000, |X-X0|:  144887.656250
rounded |X_k-Y|_0 = 752617, f1 =  0.652628, approx slack: 9998915
rounded before pow |X_k-Y|_0 = 10102437, f1 =  0.296911

Iteration 1600: Loss = 926935.187500
|Xk-Y|_F:  782574.875000, |X-X0|:  144360.312500
rounded |X_k-Y|_0 = 752258, f1 =  0.652667, approx slack: 10083300
rounded before pow |X_k-Y|_0 = 10188245, f1 =  0.294490

Iteration 1620: Loss = 925711.437500
|Xk-Y|_F:  781874.187500, |X-X0|:  143837.234375
rounded |X_k-Y|_0 = 751852, f1 =  0.652711, approx slack: 10062207
rounded before pow |X_k-Y|_0 = 10168047, f1 =  0.295057

Iteration 1640: Loss = 924499.312500
|Xk-Y|_F:  781159.375000, |X-X0|:  143339.921875
rounded |X_k-Y|_0 = 751376, f1 =  0.652759, approx slack: 10059915
rounded before pow |X_k-Y|_0 = 10165698, f1 =  0.295124

Iteration 1660: Loss = 923300.937500
|Xk-Y|_F:  780447.125000, |X-X0|:  142853.812500
rounded |X_k-Y|_0 = 750820, f1 =  0.652813, approx slack: 10059305
rounded before pow |X_k-Y|_0 = 10165102, f1 =  0.295140

Iteration 1680: Loss = 922118.312500
|Xk-Y|_F:  779744.812500, |X-X0|:  142373.484375
rounded |X_k-Y|_0 = 750348, f1 =  0.652861, approx slack: 10052078
rounded before pow |X_k-Y|_0 = 10158112, f1 =  0.295337

Iteration 1700: Loss = 920968.812500
|Xk-Y|_F:  779052.000000, |X-X0|:  141916.812500
rounded |X_k-Y|_0 = 749964, f1 =  0.652898, approx slack: 10048066
rounded before pow |X_k-Y|_0 = 10154575, f1 =  0.295436

Iteration 1720: Loss = 919825.937500
|Xk-Y|_F:  778365.187500, |X-X0|:  141460.765625
rounded |X_k-Y|_0 = 749514, f1 =  0.652944, approx slack: 10039362
rounded before pow |X_k-Y|_0 = 10146597, f1 =  0.295658

Iteration 1740: Loss = 918712.875000
|Xk-Y|_F:  777691.250000, |X-X0|:  141021.656250
rounded |X_k-Y|_0 = 749101, f1 =  0.652987, approx slack: 10034468
rounded before pow |X_k-Y|_0 = 10142126, f1 =  0.295783

Iteration 1760: Loss = 917627.000000
|Xk-Y|_F:  777049.437500, |X-X0|:  140577.531250
rounded |X_k-Y|_0 = 748684, f1 =  0.653027, approx slack: 10022820
rounded before pow |X_k-Y|_0 = 10130896, f1 =  0.296099

Iteration 1780: Loss = 916563.250000
|Xk-Y|_F:  776416.625000, |X-X0|:  140146.593750
rounded |X_k-Y|_0 = 748281, f1 =  0.653068, approx slack: 10021673
rounded before pow |X_k-Y|_0 = 10129540, f1 =  0.296137

Iteration 1800: Loss = 915531.250000
|Xk-Y|_F:  775816.062500, |X-X0|:  139715.156250
rounded |X_k-Y|_0 = 747838, f1 =  0.653111, approx slack: 10014737
rounded before pow |X_k-Y|_0 = 10123119, f1 =  0.296317

Iteration 1820: Loss = 914504.000000
|Xk-Y|_F:  775221.000000, |X-X0|:  139283.031250
rounded |X_k-Y|_0 = 747436, f1 =  0.653149, approx slack: 10010938
rounded before pow |X_k-Y|_0 = 10119915, f1 =  0.296406

Iteration 1840: Loss = 913520.062500
|Xk-Y|_F:  774660.500000, |X-X0|:  138859.562500
rounded |X_k-Y|_0 = 747185, f1 =  0.653174, approx slack: 10000131
rounded before pow |X_k-Y|_0 = 10109633, f1 =  0.296694

Iteration 1860: Loss = 912543.375000
|Xk-Y|_F:  774093.250000, |X-X0|:  138450.156250
rounded |X_k-Y|_0 = 746940, f1 =  0.653200, approx slack: 9994285
rounded before pow |X_k-Y|_0 = 10103586, f1 =  0.296866

Iteration 1880: Loss = 911588.000000
|Xk-Y|_F:  773539.875000, |X-X0|:  138048.125000
rounded |X_k-Y|_0 = 746672, f1 =  0.653228, approx slack: 9993469
rounded before pow |X_k-Y|_0 = 10102134, f1 =  0.296909

Iteration 1900: Loss = 910659.062500
|Xk-Y|_F:  773007.875000, |X-X0|:  137651.203125
rounded |X_k-Y|_0 = 746453, f1 =  0.653251, approx slack: 9987635
rounded before pow |X_k-Y|_0 = 10096628, f1 =  0.297063

Iteration 1920: Loss = 909744.312500
|Xk-Y|_F:  772485.125000, |X-X0|:  137259.203125
rounded |X_k-Y|_0 = 746212, f1 =  0.653277, approx slack: 9980857
rounded before pow |X_k-Y|_0 = 10093037, f1 =  0.297164

Iteration 1940: Loss = 908845.937500
|Xk-Y|_F:  771974.250000, |X-X0|:  136871.703125
rounded |X_k-Y|_0 = 746085, f1 =  0.653294, approx slack: 9980669
rounded before pow |X_k-Y|_0 = 10092830, f1 =  0.297170

Iteration 1960: Loss = 907963.625000
|Xk-Y|_F:  771473.187500, |X-X0|:  136490.421875
rounded |X_k-Y|_0 = 745852, f1 =  0.653319, approx slack: 9977449
rounded before pow |X_k-Y|_0 = 10090258, f1 =  0.297241

Iteration 1980: Loss = 907081.625000
|Xk-Y|_F:  770977.812500, |X-X0|:  136103.843750
rounded |X_k-Y|_0 = 745611, f1 =  0.653343, approx slack: 9971198
rounded before pow |X_k-Y|_0 = 10084041, f1 =  0.297415

Iteration 2000: Loss = 906218.562500
|Xk-Y|_F:  770488.000000, |X-X0|:  135730.578125
rounded |X_k-Y|_0 = 745483, f1 =  0.653357, approx slack: 9962114
rounded before pow |X_k-Y|_0 = 10076574, f1 =  0.297623

Iteration 2020: Loss = 905385.375000
|Xk-Y|_F:  770015.875000, |X-X0|:  135369.531250
rounded |X_k-Y|_0 = 745258, f1 =  0.653381, approx slack: 9960521
rounded before pow |X_k-Y|_0 = 10074949, f1 =  0.297669

Iteration 2040: Loss = 904562.937500
|Xk-Y|_F:  769554.625000, |X-X0|:  135008.312500
rounded |X_k-Y|_0 = 745100, f1 =  0.653398, approx slack: 9952629
rounded before pow |X_k-Y|_0 = 10067164, f1 =  0.297888

Iteration 2060: Loss = 903756.750000
|Xk-Y|_F:  769105.312500, |X-X0|:  134651.406250
rounded |X_k-Y|_0 = 744896, f1 =  0.653421, approx slack: 9945357
rounded before pow |X_k-Y|_0 = 10059825, f1 =  0.298094

Iteration 2080: Loss = 902948.375000
|Xk-Y|_F:  768655.750000, |X-X0|:  134292.593750
rounded |X_k-Y|_0 = 744682, f1 =  0.653443, approx slack: 9943921
rounded before pow |X_k-Y|_0 = 10058305, f1 =  0.298136

Iteration 2100: Loss = 902144.625000
|Xk-Y|_F:  768200.125000, |X-X0|:  133944.531250
rounded |X_k-Y|_0 = 744511, f1 =  0.653462, approx slack: 9944818
rounded before pow |X_k-Y|_0 = 10059319, f1 =  0.298107

Iteration 2120: Loss = 901362.875000
|Xk-Y|_F:  767763.562500, |X-X0|:  133599.312500
rounded |X_k-Y|_0 = 744311, f1 =  0.653482, approx slack: 9934892
rounded before pow |X_k-Y|_0 = 10049779, f1 =  0.298374

Iteration 2140: Loss = 900556.000000
|Xk-Y|_F:  767324.125000, |X-X0|:  133231.859375
rounded |X_k-Y|_0 = 744207, f1 =  0.653494, approx slack: 9920367
rounded before pow |X_k-Y|_0 = 10035223, f1 =  0.298782

Iteration 2160: Loss = 899769.062500
|Xk-Y|_F:  766879.812500, |X-X0|:  132889.265625
rounded |X_k-Y|_0 = 744009, f1 =  0.653517, approx slack: 9917229
rounded before pow |X_k-Y|_0 = 10031838, f1 =  0.298878

Iteration 2180: Loss = 898990.000000
|Xk-Y|_F:  766436.750000, |X-X0|:  132553.218750
rounded |X_k-Y|_0 = 743832, f1 =  0.653538, approx slack: 9909803
rounded before pow |X_k-Y|_0 = 10024716, f1 =  0.299077

Iteration 2200: Loss = 898216.625000
|Xk-Y|_F:  765993.562500, |X-X0|:  132223.031250
rounded |X_k-Y|_0 = 743676, f1 =  0.653557, approx slack: 9907930
rounded before pow |X_k-Y|_0 = 10022565, f1 =  0.299138

Iteration 2220: Loss = 897449.000000
|Xk-Y|_F:  765556.562500, |X-X0|:  131892.437500
rounded |X_k-Y|_0 = 743502, f1 =  0.653577, approx slack: 9904777
rounded before pow |X_k-Y|_0 = 10019480, f1 =  0.299224

Iteration 2240: Loss = 896682.062500
|Xk-Y|_F:  765114.500000, |X-X0|:  131567.562500
rounded |X_k-Y|_0 = 743328, f1 =  0.653595, approx slack: 9899445
rounded before pow |X_k-Y|_0 = 10014799, f1 =  0.299354

Iteration 2260: Loss = 895902.500000
|Xk-Y|_F:  764658.312500, |X-X0|:  131244.218750
rounded |X_k-Y|_0 = 743094, f1 =  0.653618, approx slack: 9897025
rounded before pow |X_k-Y|_0 = 10013098, f1 =  0.299402

Iteration 2280: Loss = 895145.125000
|Xk-Y|_F:  764223.875000, |X-X0|:  130921.250000
rounded |X_k-Y|_0 = 742866, f1 =  0.653641, approx slack: 9886639
rounded before pow |X_k-Y|_0 = 10003124, f1 =  0.299681

Iteration 2300: Loss = 894424.250000
|Xk-Y|_F:  763811.125000, |X-X0|:  130613.156250
rounded |X_k-Y|_0 = 742702, f1 =  0.653658, approx slack: 9876254
rounded before pow |X_k-Y|_0 = 9993137, f1 =  0.299961

Iteration 2320: Loss = 893704.250000
|Xk-Y|_F:  763405.250000, |X-X0|:  130299.000000
rounded |X_k-Y|_0 = 742545, f1 =  0.653674, approx slack: 9863059
rounded before pow |X_k-Y|_0 = 9980904, f1 =  0.300302

Iteration 2340: Loss = 892989.625000
|Xk-Y|_F:  763014.062500, |X-X0|:  129975.593750
rounded |X_k-Y|_0 = 742318, f1 =  0.653696, approx slack: 9856873
rounded before pow |X_k-Y|_0 = 9974882, f1 =  0.300471

Iteration 2360: Loss = 892300.750000
|Xk-Y|_F:  762642.187500, |X-X0|:  129658.562500
rounded |X_k-Y|_0 = 742123, f1 =  0.653716, approx slack: 9849131
rounded before pow |X_k-Y|_0 = 9967279, f1 =  0.300684

Iteration 2380: Loss = 891621.750000
|Xk-Y|_F:  762270.937500, |X-X0|:  129350.835938
rounded |X_k-Y|_0 = 741946, f1 =  0.653734, approx slack: 9850299
rounded before pow |X_k-Y|_0 = 9964795, f1 =  0.300758

Iteration 2400: Loss = 890942.375000
|Xk-Y|_F:  761908.875000, |X-X0|:  129033.531250
rounded |X_k-Y|_0 = 741764, f1 =  0.653752, approx slack: 9846031
rounded before pow |X_k-Y|_0 = 9960571, f1 =  0.300876

Iteration 2420: Loss = 890270.625000
|Xk-Y|_F:  761552.062500, |X-X0|:  128718.531250
rounded |X_k-Y|_0 = 741593, f1 =  0.653770, approx slack: 9840714
rounded before pow |X_k-Y|_0 = 9954818, f1 =  0.301038

Iteration 2440: Loss = 889598.000000
|Xk-Y|_F:  761202.125000, |X-X0|:  128395.859375
rounded |X_k-Y|_0 = 741438, f1 =  0.653787, approx slack: 9765543
rounded before pow |X_k-Y|_0 = 9880523, f1 =  0.303116

Iteration 2460: Loss = 888938.687500
|Xk-Y|_F:  760847.187500, |X-X0|:  128091.484375
rounded |X_k-Y|_0 = 741302, f1 =  0.653802, approx slack: 9758608
rounded before pow |X_k-Y|_0 = 9873963, f1 =  0.303299

Iteration 2480: Loss = 888269.750000
|Xk-Y|_F:  760481.375000, |X-X0|:  127788.382812
rounded |X_k-Y|_0 = 741039, f1 =  0.653828, approx slack: 9750941
rounded before pow |X_k-Y|_0 = 9866697, f1 =  0.303502

Iteration 2500: Loss = 887604.125000
|Xk-Y|_F:  760119.062500, |X-X0|:  127485.062500
rounded |X_k-Y|_0 = 740842, f1 =  0.653848, approx slack: 9748456
rounded before pow |X_k-Y|_0 = 9864546, f1 =  0.303561

Iteration 2520: Loss = 886934.500000
|Xk-Y|_F:  759750.875000, |X-X0|:  127183.656250
rounded |X_k-Y|_0 = 740790, f1 =  0.653857, approx slack: 9742953
rounded before pow |X_k-Y|_0 = 9859380, f1 =  0.303705

Iteration 2540: Loss = 886270.687500
|Xk-Y|_F:  759378.187500, |X-X0|:  126892.515625
rounded |X_k-Y|_0 = 740586, f1 =  0.653879, approx slack: 9734937
rounded before pow |X_k-Y|_0 = 9851283, f1 =  0.303931

Iteration 2560: Loss = 885632.375000
|Xk-Y|_F:  759022.000000, |X-X0|:  126610.390625
rounded |X_k-Y|_0 = 740384, f1 =  0.653901, approx slack: 9730663
rounded before pow |X_k-Y|_0 = 9846747, f1 =  0.304058

Iteration 2580: Loss = 884975.187500
|Xk-Y|_F:  758659.375000, |X-X0|:  126315.828125
rounded |X_k-Y|_0 = 740147, f1 =  0.653925, approx slack: 9731243
rounded before pow |X_k-Y|_0 = 9847694, f1 =  0.304031

Iteration 2600: Loss = 884331.937500
|Xk-Y|_F:  758304.500000, |X-X0|:  126027.437500
rounded |X_k-Y|_0 = 739909, f1 =  0.653949, approx slack: 9725973
rounded before pow |X_k-Y|_0 = 9842441, f1 =  0.304178

Iteration 2620: Loss = 883696.500000
|Xk-Y|_F:  757961.437500, |X-X0|:  125735.078125
rounded |X_k-Y|_0 = 739670, f1 =  0.653972, approx slack: 9718632
rounded before pow |X_k-Y|_0 = 9834854, f1 =  0.304390

Iteration 2640: Loss = 883072.500000
|Xk-Y|_F:  757623.500000, |X-X0|:  125448.984375
rounded |X_k-Y|_0 = 739456, f1 =  0.653992, approx slack: 9715714
rounded before pow |X_k-Y|_0 = 9831991, f1 =  0.304470

Iteration 2660: Loss = 882463.625000
|Xk-Y|_F:  757297.437500, |X-X0|:  125166.179688
rounded |X_k-Y|_0 = 739275, f1 =  0.654012, approx slack: 9715165
rounded before pow |X_k-Y|_0 = 9831809, f1 =  0.304474

Iteration 2680: Loss = 881833.500000
|Xk-Y|_F:  756964.875000, |X-X0|:  124868.656250
rounded |X_k-Y|_0 = 739027, f1 =  0.654036, approx slack: 9714063
rounded before pow |X_k-Y|_0 = 9830915, f1 =  0.304499

Iteration 2700: Loss = 881235.875000
|Xk-Y|_F:  756645.875000, |X-X0|:  124590.007812
rounded |X_k-Y|_0 = 738863, f1 =  0.654054, approx slack: 9709465
rounded before pow |X_k-Y|_0 = 9826767, f1 =  0.304615

Iteration 2720: Loss = 880650.750000
|Xk-Y|_F:  756330.250000, |X-X0|:  124320.507812
rounded |X_k-Y|_0 = 738643, f1 =  0.654075, approx slack: 9704009
rounded before pow |X_k-Y|_0 = 9821366, f1 =  0.304765

Iteration 2740: Loss = 880066.250000
|Xk-Y|_F:  756017.312500, |X-X0|:  124048.937500
rounded |X_k-Y|_0 = 738429, f1 =  0.654096, approx slack: 9694457
rounded before pow |X_k-Y|_0 = 9812794, f1 =  0.305003

Iteration 2760: Loss = 879470.062500
|Xk-Y|_F:  755699.437500, |X-X0|:  123770.648438
rounded |X_k-Y|_0 = 738224, f1 =  0.654118, approx slack: 9686344
rounded before pow |X_k-Y|_0 = 9804846, f1 =  0.305225

Iteration 2780: Loss = 878881.437500
|Xk-Y|_F:  755367.312500, |X-X0|:  123514.109375
rounded |X_k-Y|_0 = 738017, f1 =  0.654137, approx slack: 9676254
rounded before pow |X_k-Y|_0 = 9795344, f1 =  0.305489

Iteration 2800: Loss = 878294.125000
|Xk-Y|_F:  755049.000000, |X-X0|:  123245.156250
rounded |X_k-Y|_0 = 737815, f1 =  0.654157, approx slack: 9673343
rounded before pow |X_k-Y|_0 = 9792617, f1 =  0.305565

Iteration 2820: Loss = 877722.437500
|Xk-Y|_F:  754741.750000, |X-X0|:  122980.703125
rounded |X_k-Y|_0 = 737580, f1 =  0.654181, approx slack: 9679530
rounded before pow |X_k-Y|_0 = 9797566, f1 =  0.305428

Iteration 2840: Loss = 877158.500000
|Xk-Y|_F:  754435.187500, |X-X0|:  122723.320312
rounded |X_k-Y|_0 = 737352, f1 =  0.654202, approx slack: 9682164
rounded before pow |X_k-Y|_0 = 9799371, f1 =  0.305378

Iteration 2860: Loss = 876490.875000
|Xk-Y|_F:  754101.562500, |X-X0|:  122389.328125
rounded |X_k-Y|_0 = 737144, f1 =  0.654223, approx slack: 9671992
rounded before pow |X_k-Y|_0 = 9789842, f1 =  0.305643

Iteration 2880: Loss = 875772.000000
|Xk-Y|_F:  753728.000000, |X-X0|:  122044.015625
rounded |X_k-Y|_0 = 736963, f1 =  0.654243, approx slack: 9671910
rounded before pow |X_k-Y|_0 = 9789267, f1 =  0.305661

Iteration 2900: Loss = 875091.875000
|Xk-Y|_F:  753319.000000, |X-X0|:  121772.890625
rounded |X_k-Y|_0 = 736779, f1 =  0.654264, approx slack: 9662838
rounded before pow |X_k-Y|_0 = 9780544, f1 =  0.305904

Iteration 2920: Loss = 874601.062500
|Xk-Y|_F:  753068.750000, |X-X0|:  121532.304688
rounded |X_k-Y|_0 = 736602, f1 =  0.654281, approx slack: 9658250
rounded before pow |X_k-Y|_0 = 9776462, f1 =  0.306016

Iteration 2940: Loss = 874075.250000
|Xk-Y|_F:  752795.187500, |X-X0|:  121280.062500
rounded |X_k-Y|_0 = 736408, f1 =  0.654299, approx slack: 9645060
rounded before pow |X_k-Y|_0 = 9764211, f1 =  0.306356

Iteration 2960: Loss = 873533.250000
|Xk-Y|_F:  752542.562500, |X-X0|:  120990.687500
rounded |X_k-Y|_0 = 736252, f1 =  0.654315, approx slack: 9640853
rounded before pow |X_k-Y|_0 = 9760385, f1 =  0.306463

Iteration 2980: Loss = 873055.187500
|Xk-Y|_F:  752314.750000, |X-X0|:  120740.429688
rounded |X_k-Y|_0 = 736098, f1 =  0.654330, approx slack: 9639724
rounded before pow |X_k-Y|_0 = 9758943, f1 =  0.306503

Iteration 3000: Loss = 872567.312500
|Xk-Y|_F:  752090.687500, |X-X0|:  120476.640625
rounded |X_k-Y|_0 = 735902, f1 =  0.654348, approx slack: 9637682
rounded before pow |X_k-Y|_0 = 9756872, f1 =  0.306561

Iteration 3020: Loss = 872077.000000
|Xk-Y|_F:  751865.250000, |X-X0|:  120211.718750
rounded |X_k-Y|_0 = 735794, f1 =  0.654359, approx slack: 9632473
rounded before pow |X_k-Y|_0 = 9751857, f1 =  0.306701

Iteration 3040: Loss = 871623.312500
|Xk-Y|_F:  751653.250000, |X-X0|:  119970.085938
rounded |X_k-Y|_0 = 735664, f1 =  0.654370, approx slack: 9628915
rounded before pow |X_k-Y|_0 = 9748539, f1 =  0.306793

Iteration 3060: Loss = 871137.125000
|Xk-Y|_F:  751434.250000, |X-X0|:  119702.875000
rounded |X_k-Y|_0 = 735512, f1 =  0.654384, approx slack: 9625600
rounded before pow |X_k-Y|_0 = 9745482, f1 =  0.306878

Iteration 3080: Loss = 870666.875000
|Xk-Y|_F:  751218.312500, |X-X0|:  119448.546875
rounded |X_k-Y|_0 = 735377, f1 =  0.654398, approx slack: 9619980
rounded before pow |X_k-Y|_0 = 9740043, f1 =  0.307029

Iteration 3100: Loss = 870200.312500
|Xk-Y|_F:  750999.875000, |X-X0|:  119200.414062
rounded |X_k-Y|_0 = 735266, f1 =  0.654409, approx slack: 9619401
rounded before pow |X_k-Y|_0 = 9739267, f1 =  0.307051

Iteration 3120: Loss = 869736.687500
|Xk-Y|_F:  750784.625000, |X-X0|:  118952.070312
rounded |X_k-Y|_0 = 735091, f1 =  0.654426, approx slack: 9617969
rounded before pow |X_k-Y|_0 = 9738818, f1 =  0.307062

Iteration 3140: Loss = 869296.000000
|Xk-Y|_F:  750578.250000, |X-X0|:  118717.742188
rounded |X_k-Y|_0 = 734949, f1 =  0.654439, approx slack: 9616235
rounded before pow |X_k-Y|_0 = 9737287, f1 =  0.307104

Iteration 3160: Loss = 868857.250000
|Xk-Y|_F:  750387.687500, |X-X0|:  118469.546875
rounded |X_k-Y|_0 = 734809, f1 =  0.654452, approx slack: 9625465
rounded before pow |X_k-Y|_0 = 9743419, f1 =  0.306937

Iteration 3180: Loss = 868403.750000
|Xk-Y|_F:  750180.687500, |X-X0|:  118223.093750
rounded |X_k-Y|_0 = 734647, f1 =  0.654467, approx slack: 9620118
rounded before pow |X_k-Y|_0 = 9738309, f1 =  0.307079

Iteration 3200: Loss = 867961.125000
|Xk-Y|_F:  749985.625000, |X-X0|:  117975.523438
rounded |X_k-Y|_0 = 734544, f1 =  0.654477, approx slack: 9616190
rounded before pow |X_k-Y|_0 = 9734592, f1 =  0.307182

Iteration 3220: Loss = 867552.000000
|Xk-Y|_F:  749796.687500, |X-X0|:  117755.281250
rounded |X_k-Y|_0 = 734365, f1 =  0.654493, approx slack: 9614004
rounded before pow |X_k-Y|_0 = 9732461, f1 =  0.307242

Iteration 3240: Loss = 867120.312500
|Xk-Y|_F:  749614.250000, |X-X0|:  117506.039062
rounded |X_k-Y|_0 = 734239, f1 =  0.654505, approx slack: 9611409
rounded before pow |X_k-Y|_0 = 9730192, f1 =  0.307304

Iteration 3260: Loss = 866668.125000
|Xk-Y|_F:  749412.812500, |X-X0|:  117255.281250
rounded |X_k-Y|_0 = 734131, f1 =  0.654514, approx slack: 9609500
rounded before pow |X_k-Y|_0 = 9727317, f1 =  0.307385

Iteration 3280: Loss = 866259.625000
|Xk-Y|_F:  749227.375000, |X-X0|:  117032.265625
rounded |X_k-Y|_0 = 734023, f1 =  0.654524, approx slack: 9605775
rounded before pow |X_k-Y|_0 = 9723722, f1 =  0.307485

Iteration 3300: Loss = 865830.812500
|Xk-Y|_F:  749036.062500, |X-X0|:  116794.742188
rounded |X_k-Y|_0 = 733909, f1 =  0.654535, approx slack: 9604230
rounded before pow |X_k-Y|_0 = 9722669, f1 =  0.307514

Iteration 3320: Loss = 865397.687500
|Xk-Y|_F:  748837.562500, |X-X0|:  116560.140625
rounded |X_k-Y|_0 = 733724, f1 =  0.654551, approx slack: 9602845
rounded before pow |X_k-Y|_0 = 9721752, f1 =  0.307539

Iteration 3340: Loss = 864975.812500
|Xk-Y|_F:  748652.312500, |X-X0|:  116323.500000
rounded |X_k-Y|_0 = 733537, f1 =  0.654567, approx slack: 9605539
rounded before pow |X_k-Y|_0 = 9724195, f1 =  0.307471

Iteration 3360: Loss = 864576.062500
|Xk-Y|_F:  748470.187500, |X-X0|:  116105.859375
rounded |X_k-Y|_0 = 733435, f1 =  0.654577, approx slack: 9600702
rounded before pow |X_k-Y|_0 = 9719564, f1 =  0.307600

Iteration 3380: Loss = 864162.937500
|Xk-Y|_F:  748289.125000, |X-X0|:  115873.828125
rounded |X_k-Y|_0 = 733318, f1 =  0.654588, approx slack: 9479688
rounded before pow |X_k-Y|_0 = 9606916, f1 =  0.310722

Iteration 3400: Loss = 863768.000000
|Xk-Y|_F:  748116.437500, |X-X0|:  115651.585938
rounded |X_k-Y|_0 = 733189, f1 =  0.654599, approx slack: 9478073
rounded before pow |X_k-Y|_0 = 9605306, f1 =  0.310767

Iteration 3420: Loss = 863343.500000
|Xk-Y|_F:  747920.687500, |X-X0|:  115422.789062
rounded |X_k-Y|_0 = 733114, f1 =  0.654607, approx slack: 9464008
rounded before pow |X_k-Y|_0 = 9591429, f1 =  0.311152

Iteration 3440: Loss = 862885.687500
|Xk-Y|_F:  747713.687500, |X-X0|:  115172.007812
rounded |X_k-Y|_0 = 732961, f1 =  0.654620, approx slack: 9462645
rounded before pow |X_k-Y|_0 = 9590093, f1 =  0.311189

Iteration 3460: Loss = 862412.812500
|Xk-Y|_F:  747451.875000, |X-X0|:  114960.937500
rounded |X_k-Y|_0 = 732846, f1 =  0.654634, approx slack: 9461554
rounded before pow |X_k-Y|_0 = 9592208, f1 =  0.311127

Iteration 3480: Loss = 861781.750000
|Xk-Y|_F:  747064.187500, |X-X0|:  114717.546875
rounded |X_k-Y|_0 = 732777, f1 =  0.654646, approx slack: 9454316
rounded before pow |X_k-Y|_0 = 9585595, f1 =  0.311309

Iteration 3500: Loss = 861377.937500
|Xk-Y|_F:  746871.812500, |X-X0|:  114506.101562
rounded |X_k-Y|_0 = 732674, f1 =  0.654656, approx slack: 9453956
rounded before pow |X_k-Y|_0 = 9585316, f1 =  0.311317

Iteration 3520: Loss = 860983.937500
|Xk-Y|_F:  746703.250000, |X-X0|:  114280.687500
rounded |X_k-Y|_0 = 732568, f1 =  0.654666, approx slack: 9453525
rounded before pow |X_k-Y|_0 = 9584982, f1 =  0.311326

Iteration 3540: Loss = 860601.625000
|Xk-Y|_F:  746529.125000, |X-X0|:  114072.500000
rounded |X_k-Y|_0 = 732461, f1 =  0.654676, approx slack: 9459120
rounded before pow |X_k-Y|_0 = 9589514, f1 =  0.311202

Iteration 3560: Loss = 860183.000000
|Xk-Y|_F:  746341.062500, |X-X0|:  113841.921875
rounded |X_k-Y|_0 = 732309, f1 =  0.654690, approx slack: 9458735
rounded before pow |X_k-Y|_0 = 9589221, f1 =  0.311210

Iteration 3580: Loss = 859777.750000
|Xk-Y|_F:  746157.875000, |X-X0|:  113619.875000
rounded |X_k-Y|_0 = 732175, f1 =  0.654702, approx slack: 9457680
rounded before pow |X_k-Y|_0 = 9588133, f1 =  0.311240

Iteration 3600: Loss = 859380.625000
|Xk-Y|_F:  745972.625000, |X-X0|:  113407.976562
rounded |X_k-Y|_0 = 732050, f1 =  0.654714, approx slack: 9455616
rounded before pow |X_k-Y|_0 = 9586096, f1 =  0.311296

Iteration 3620: Loss = 858992.312500
|Xk-Y|_F:  745788.562500, |X-X0|:  113203.734375
rounded |X_k-Y|_0 = 731920, f1 =  0.654725, approx slack: 9465205
rounded before pow |X_k-Y|_0 = 9595767, f1 =  0.311027

Iteration 3640: Loss = 858624.000000
|Xk-Y|_F:  745628.250000, |X-X0|:  112995.750000
rounded |X_k-Y|_0 = 731814, f1 =  0.654735, approx slack: 9465615
rounded before pow |X_k-Y|_0 = 9596064, f1 =  0.311019

Iteration 3660: Loss = 858220.000000
|Xk-Y|_F:  745447.562500, |X-X0|:  112772.421875
rounded |X_k-Y|_0 = 731705, f1 =  0.654746, approx slack: 9465860
rounded before pow |X_k-Y|_0 = 9596241, f1 =  0.311014

Iteration 3680: Loss = 857901.562500
|Xk-Y|_F:  745323.625000, |X-X0|:  112577.937500
rounded |X_k-Y|_0 = 731586, f1 =  0.654757, approx slack: 9467774
rounded before pow |X_k-Y|_0 = 9598062, f1 =  0.310964

Iteration 3700: Loss = 857512.500000
|Xk-Y|_F:  745135.312500, |X-X0|:  112377.179688
rounded |X_k-Y|_0 = 731424, f1 =  0.654771, approx slack: 9468234
rounded before pow |X_k-Y|_0 = 9598467, f1 =  0.310953

Iteration 3720: Loss = 857089.125000
|Xk-Y|_F:  744909.562500, |X-X0|:  112179.531250
rounded |X_k-Y|_0 = 731321, f1 =  0.654781, approx slack: 9467093
rounded before pow |X_k-Y|_0 = 9597345, f1 =  0.310984

Iteration 3740: Loss = 856675.062500
|Xk-Y|_F:  744713.250000, |X-X0|:  111961.812500
rounded |X_k-Y|_0 = 731181, f1 =  0.654795, approx slack: 9465995
rounded before pow |X_k-Y|_0 = 9596344, f1 =  0.311011

Iteration 3760: Loss = 856221.750000
|Xk-Y|_F:  744468.375000, |X-X0|:  111753.382812
rounded |X_k-Y|_0 = 731059, f1 =  0.654808, approx slack: 9469512
rounded before pow |X_k-Y|_0 = 9599801, f1 =  0.310915

Iteration 3780: Loss = 855774.625000
|Xk-Y|_F:  744230.750000, |X-X0|:  111543.882812
rounded |X_k-Y|_0 = 730945, f1 =  0.654820, approx slack: 9467808
rounded before pow |X_k-Y|_0 = 9598131, f1 =  0.310961

Iteration 3800: Loss = 855295.875000
|Xk-Y|_F:  743954.125000, |X-X0|:  111341.734375
rounded |X_k-Y|_0 = 730872, f1 =  0.654831, approx slack: 9464141
rounded before pow |X_k-Y|_0 = 9594458, f1 =  0.311063

Iteration 3820: Loss = 854710.500000
|Xk-Y|_F:  743583.562500, |X-X0|:  111126.968750
rounded |X_k-Y|_0 = 730763, f1 =  0.654850, approx slack: 9442258
rounded before pow |X_k-Y|_0 = 9572862, f1 =  0.311662

Iteration 3840: Loss = 854279.687500
|Xk-Y|_F:  743369.812500, |X-X0|:  110909.898438
rounded |X_k-Y|_0 = 730637, f1 =  0.654866, approx slack: 9442263
rounded before pow |X_k-Y|_0 = 9572834, f1 =  0.311663

Iteration 3860: Loss = 853856.125000
|Xk-Y|_F:  743174.812500, |X-X0|:  110681.304688
rounded |X_k-Y|_0 = 730471, f1 =  0.654884, approx slack: 9438330
rounded before pow |X_k-Y|_0 = 9568962, f1 =  0.311770

Iteration 3880: Loss = 853480.625000
|Xk-Y|_F:  743010.312500, |X-X0|:  110470.289062
rounded |X_k-Y|_0 = 730411, f1 =  0.654890, approx slack: 9436680
rounded before pow |X_k-Y|_0 = 9567138, f1 =  0.311821

Iteration 3900: Loss = 853081.750000
|Xk-Y|_F:  742828.312500, |X-X0|:  110253.453125
rounded |X_k-Y|_0 = 730285, f1 =  0.654902, approx slack: 9435331
rounded before pow |X_k-Y|_0 = 9566568, f1 =  0.311838

Iteration 3920: Loss = 852720.125000
|Xk-Y|_F:  742689.312500, |X-X0|:  110030.843750
rounded |X_k-Y|_0 = 730146, f1 =  0.654915, approx slack: 9440982
rounded before pow |X_k-Y|_0 = 9571136, f1 =  0.311713

Iteration 3940: Loss = 852316.937500
|Xk-Y|_F:  742489.125000, |X-X0|:  109827.828125
rounded |X_k-Y|_0 = 730023, f1 =  0.654926, approx slack: 9441364
rounded before pow |X_k-Y|_0 = 9571601, f1 =  0.311699

Iteration 3960: Loss = 851952.312500
|Xk-Y|_F:  742338.937500, |X-X0|:  109613.390625
rounded |X_k-Y|_0 = 729890, f1 =  0.654938, approx slack: 9441782
rounded before pow |X_k-Y|_0 = 9571973, f1 =  0.311689

Iteration 3980: Loss = 851610.437500
|Xk-Y|_F:  742193.687500, |X-X0|:  109416.765625
rounded |X_k-Y|_0 = 729830, f1 =  0.654944, approx slack: 9435562
rounded before pow |X_k-Y|_0 = 9565840, f1 =  0.311859

Iteration 4000: Loss = 851255.812500
|Xk-Y|_F:  742038.625000, |X-X0|:  109217.171875
rounded |X_k-Y|_0 = 729690, f1 =  0.654957, approx slack: 9435063
rounded before pow |X_k-Y|_0 = 9565354, f1 =  0.311873

Iteration 4020: Loss = 850909.687500
|Xk-Y|_F:  741896.937500, |X-X0|:  109012.765625
rounded |X_k-Y|_0 = 729588, f1 =  0.654967, approx slack: 9429862
rounded before pow |X_k-Y|_0 = 9560962, f1 =  0.311993

Iteration 4040: Loss = 850601.937500
|Xk-Y|_F:  741767.750000, |X-X0|:  108834.171875
rounded |X_k-Y|_0 = 729470, f1 =  0.654977, approx slack: 9418491
rounded before pow |X_k-Y|_0 = 9549811, f1 =  0.312302

Iteration 4060: Loss = 850269.187500
|Xk-Y|_F:  741632.875000, |X-X0|:  108636.328125
rounded |X_k-Y|_0 = 729342, f1 =  0.654989, approx slack: 9416827
rounded before pow |X_k-Y|_0 = 9548335, f1 =  0.312343

Iteration 4080: Loss = 849929.937500
|Xk-Y|_F:  741499.812500, |X-X0|:  108430.125000
rounded |X_k-Y|_0 = 729229, f1 =  0.654999, approx slack: 9417736
rounded before pow |X_k-Y|_0 = 9549210, f1 =  0.312319

Iteration 4100: Loss = 849596.250000
|Xk-Y|_F:  741358.812500, |X-X0|:  108237.421875
rounded |X_k-Y|_0 = 729101, f1 =  0.655011, approx slack: 9418012
rounded before pow |X_k-Y|_0 = 9549437, f1 =  0.312312

Iteration 4120: Loss = 849259.625000
|Xk-Y|_F:  741226.000000, |X-X0|:  108033.640625
rounded |X_k-Y|_0 = 729025, f1 =  0.655018, approx slack: 9417732
rounded before pow |X_k-Y|_0 = 9548608, f1 =  0.312336

Iteration 4140: Loss = 848941.375000
|Xk-Y|_F:  741098.750000, |X-X0|:  107842.609375
rounded |X_k-Y|_0 = 728916, f1 =  0.655028, approx slack: 9413082
rounded before pow |X_k-Y|_0 = 9544094, f1 =  0.312461

Iteration 4160: Loss = 848586.625000
|Xk-Y|_F:  740944.125000, |X-X0|:  107642.484375
rounded |X_k-Y|_0 = 728864, f1 =  0.655033, approx slack: 9412250
rounded before pow |X_k-Y|_0 = 9543285, f1 =  0.312484

Iteration 4180: Loss = 848262.062500
|Xk-Y|_F:  740797.812500, |X-X0|:  107464.234375
rounded |X_k-Y|_0 = 728720, f1 =  0.655046, approx slack: 9412571
rounded before pow |X_k-Y|_0 = 9543597, f1 =  0.312475

Iteration 4200: Loss = 847962.937500
|Xk-Y|_F:  740667.812500, |X-X0|:  107295.140625
rounded |X_k-Y|_0 = 728609, f1 =  0.655055, approx slack: 9395297
rounded before pow |X_k-Y|_0 = 9531579, f1 =  0.312804

Iteration 4220: Loss = 847704.687500
|Xk-Y|_F:  740540.187500, |X-X0|:  107164.515625
rounded |X_k-Y|_0 = 728448, f1 =  0.655068, approx slack: 9395783
rounded before pow |X_k-Y|_0 = 9532081, f1 =  0.312790

Iteration 4240: Loss = 847277.937500
|Xk-Y|_F:  740309.125000, |X-X0|:  106968.796875
rounded |X_k-Y|_0 = 728343, f1 =  0.655079, approx slack: 9390931
rounded before pow |X_k-Y|_0 = 9527884, f1 =  0.312905

Iteration 4260: Loss = 846930.375000
|Xk-Y|_F:  740149.062500, |X-X0|:  106781.281250
rounded |X_k-Y|_0 = 728218, f1 =  0.655089, approx slack: 9388383
rounded before pow |X_k-Y|_0 = 9525520, f1 =  0.312970

Iteration 4280: Loss = 846543.812500
|Xk-Y|_F:  739914.250000, |X-X0|:  106629.562500
rounded |X_k-Y|_0 = 728119, f1 =  0.655099, approx slack: 9386918
rounded before pow |X_k-Y|_0 = 9524501, f1 =  0.312997

Iteration 4300: Loss = 846252.312500
|Xk-Y|_F:  739780.562500, |X-X0|:  106471.734375
rounded |X_k-Y|_0 = 727949, f1 =  0.655113, approx slack: 9384484
rounded before pow |X_k-Y|_0 = 9522082, f1 =  0.313064

Iteration 4320: Loss = 845887.687500
|Xk-Y|_F:  739580.500000, |X-X0|:  106307.187500
rounded |X_k-Y|_0 = 727757, f1 =  0.655131, approx slack: 9382222
rounded before pow |X_k-Y|_0 = 9520078, f1 =  0.313120

Iteration 4340: Loss = 845541.562500
|Xk-Y|_F:  739421.250000, |X-X0|:  106120.296875
rounded |X_k-Y|_0 = 727590, f1 =  0.655145, approx slack: 9352807
rounded before pow |X_k-Y|_0 = 9490612, f1 =  0.313937

Iteration 4360: Loss = 845185.562500
|Xk-Y|_F:  739249.187500, |X-X0|:  105936.359375
rounded |X_k-Y|_0 = 727438, f1 =  0.655158, approx slack: 9353120
rounded before pow |X_k-Y|_0 = 9490986, f1 =  0.313927

Iteration 4380: Loss = 844879.250000
|Xk-Y|_F:  739133.250000, |X-X0|:  105746.015625
rounded |X_k-Y|_0 = 727240, f1 =  0.655175, approx slack: 9349681
rounded before pow |X_k-Y|_0 = 9487814, f1 =  0.314014

Iteration 4400: Loss = 844390.875000
|Xk-Y|_F:  738958.625000, |X-X0|:  105432.265625
rounded |X_k-Y|_0 = 727068, f1 =  0.655192, approx slack: 9188597
rounded before pow |X_k-Y|_0 = 9326841, f1 =  0.318469

Iteration 4420: Loss = 844121.312500
|Xk-Y|_F:  738864.187500, |X-X0|:  105257.148438
rounded |X_k-Y|_0 = 726918, f1 =  0.655204, approx slack: 9183630
rounded before pow |X_k-Y|_0 = 9322455, f1 =  0.318589

Iteration 4440: Loss = 843851.375000
|Xk-Y|_F:  738741.812500, |X-X0|:  105109.531250
rounded |X_k-Y|_0 = 726777, f1 =  0.655216, approx slack: 9175117
rounded before pow |X_k-Y|_0 = 9314549, f1 =  0.318807

Iteration 4460: Loss = 843568.500000
|Xk-Y|_F:  738646.875000, |X-X0|:  104921.656250
rounded |X_k-Y|_0 = 726586, f1 =  0.655232, approx slack: 9174900
rounded before pow |X_k-Y|_0 = 9314488, f1 =  0.318808

Iteration 4480: Loss = 843224.437500
|Xk-Y|_F:  738521.750000, |X-X0|:  104702.664062
rounded |X_k-Y|_0 = 726429, f1 =  0.655247, approx slack: 9168746
rounded before pow |X_k-Y|_0 = 9308361, f1 =  0.318977

Iteration 4500: Loss = 842949.562500
|Xk-Y|_F:  738405.625000, |X-X0|:  104543.953125
rounded |X_k-Y|_0 = 726314, f1 =  0.655257, approx slack: 9227206
rounded before pow |X_k-Y|_0 = 9364030, f1 =  0.317443

Iteration 4520: Loss = 842628.187500
|Xk-Y|_F:  738281.062500, |X-X0|:  104347.148438
rounded |X_k-Y|_0 = 726153, f1 =  0.655271, approx slack: 9179892
rounded before pow |X_k-Y|_0 = 9319194, f1 =  0.318678

Iteration 4540: Loss = 842306.687500
|Xk-Y|_F:  738165.062500, |X-X0|:  104141.632812
rounded |X_k-Y|_0 = 726005, f1 =  0.655284, approx slack: 9178063
rounded before pow |X_k-Y|_0 = 9317546, f1 =  0.318724

Iteration 4560: Loss = 842083.312500
|Xk-Y|_F:  738075.312500, |X-X0|:  104008.015625
rounded |X_k-Y|_0 = 725842, f1 =  0.655299, approx slack: 9179071
rounded before pow |X_k-Y|_0 = 9318420, f1 =  0.318700

Iteration 4580: Loss = 841854.375000
|Xk-Y|_F:  737966.062500, |X-X0|:  103888.281250
rounded |X_k-Y|_0 = 725729, f1 =  0.655308, approx slack: 9178844
rounded before pow |X_k-Y|_0 = 9318232, f1 =  0.318705

Iteration 4600: Loss = 841532.750000
|Xk-Y|_F:  737858.250000, |X-X0|:  103674.468750
rounded |X_k-Y|_0 = 725627, f1 =  0.655317, approx slack: 9172393
rounded before pow |X_k-Y|_0 = 9311708, f1 =  0.318885

Iteration 4620: Loss = 841279.750000
|Xk-Y|_F:  737775.937500, |X-X0|:  103503.796875
rounded |X_k-Y|_0 = 725539, f1 =  0.655325, approx slack: 9171541
rounded before pow |X_k-Y|_0 = 9310933, f1 =  0.318907

Iteration 4640: Loss = 840879.500000
|Xk-Y|_F:  737642.062500, |X-X0|:  103237.437500
rounded |X_k-Y|_0 = 725444, f1 =  0.655334, approx slack: 9171990
rounded before pow |X_k-Y|_0 = 9311181, f1 =  0.318900

Iteration 4660: Loss = 840596.312500
|Xk-Y|_F:  737540.375000, |X-X0|:  103055.921875
rounded |X_k-Y|_0 = 725304, f1 =  0.655346, approx slack: 9164585
rounded before pow |X_k-Y|_0 = 9306313, f1 =  0.319031

Iteration 4680: Loss = 840271.250000
|Xk-Y|_F:  737421.187500, |X-X0|:  102850.085938
rounded |X_k-Y|_0 = 725203, f1 =  0.655355, approx slack: 9159473
rounded before pow |X_k-Y|_0 = 9301349, f1 =  0.319168

Iteration 4700: Loss = 839955.625000
|Xk-Y|_F:  737308.812500, |X-X0|:  102646.828125
rounded |X_k-Y|_0 = 725144, f1 =  0.655362, approx slack: 9159631
rounded before pow |X_k-Y|_0 = 9300992, f1 =  0.319177

Iteration 4720: Loss = 839617.937500
|Xk-Y|_F:  737193.937500, |X-X0|:  102424.015625
rounded |X_k-Y|_0 = 725025, f1 =  0.655373, approx slack: 9160126
rounded before pow |X_k-Y|_0 = 9300768, f1 =  0.319185

Iteration 4740: Loss = 839334.500000
|Xk-Y|_F:  737082.625000, |X-X0|:  102251.859375
rounded |X_k-Y|_0 = 724938, f1 =  0.655381, approx slack: 9160364
rounded before pow |X_k-Y|_0 = 9301065, f1 =  0.319177

Iteration 4760: Loss = 839077.375000
|Xk-Y|_F:  736994.250000, |X-X0|:  102083.156250
rounded |X_k-Y|_0 = 724809, f1 =  0.655393, approx slack: 9161592
rounded before pow |X_k-Y|_0 = 9302035, f1 =  0.319151

Iteration 4780: Loss = 838729.062500
|Xk-Y|_F:  736850.187500, |X-X0|:  101878.875000
rounded |X_k-Y|_0 = 724683, f1 =  0.655404, approx slack: 9157685
rounded before pow |X_k-Y|_0 = 9298883, f1 =  0.319230

Iteration 4800: Loss = 838497.000000
|Xk-Y|_F:  736762.187500, |X-X0|:  101734.812500
rounded |X_k-Y|_0 = 724593, f1 =  0.655411, approx slack: 9152602
rounded before pow |X_k-Y|_0 = 9294558, f1 =  0.319348

Iteration 4820: Loss = 838208.250000
|Xk-Y|_F:  736660.125000, |X-X0|:  101548.109375
rounded |X_k-Y|_0 = 724574, f1 =  0.655414, approx slack: 9151361
rounded before pow |X_k-Y|_0 = 9293485, f1 =  0.319378

Iteration 4840: Loss = 838074.812500
|Xk-Y|_F:  736681.500000, |X-X0|:  101393.296875
rounded |X_k-Y|_0 = 724425, f1 =  0.655425, approx slack: 9134926
rounded before pow |X_k-Y|_0 = 9277227, f1 =  0.319825

Iteration 4860: Loss = 837617.562500
|Xk-Y|_F:  736440.937500, |X-X0|:  101176.609375
rounded |X_k-Y|_0 = 724295, f1 =  0.655438, approx slack: 9133775
rounded before pow |X_k-Y|_0 = 9276165, f1 =  0.319854

Iteration 4880: Loss = 837366.312500
|Xk-Y|_F:  736344.875000, |X-X0|:  101021.437500
rounded |X_k-Y|_0 = 724261, f1 =  0.655442, approx slack: 9132529
rounded before pow |X_k-Y|_0 = 9275087, f1 =  0.319884

Iteration 4900: Loss = 837174.187500
|Xk-Y|_F:  736320.812500, |X-X0|:  100853.367188
rounded |X_k-Y|_0 = 724097, f1 =  0.655454, approx slack: 9129278
rounded before pow |X_k-Y|_0 = 9271912, f1 =  0.319970

Iteration 4920: Loss = 836859.937500
|Xk-Y|_F:  736171.000000, |X-X0|:  100688.945312
rounded |X_k-Y|_0 = 724022, f1 =  0.655462, approx slack: 9130813
rounded before pow |X_k-Y|_0 = 9273359, f1 =  0.319931

Iteration 4940: Loss = 836579.000000
|Xk-Y|_F:  736079.187500, |X-X0|:  100499.796875
rounded |X_k-Y|_0 = 723951, f1 =  0.655468, approx slack: 9130354
rounded before pow |X_k-Y|_0 = 9273025, f1 =  0.319939

Iteration 4960: Loss = 836273.250000
|Xk-Y|_F:  736000.812500, |X-X0|:  100272.406250
rounded |X_k-Y|_0 = 723738, f1 =  0.655486, approx slack: 9137211
rounded before pow |X_k-Y|_0 = 9279400, f1 =  0.319765

Iteration 4980: Loss = 835947.875000
|Xk-Y|_F:  735882.000000, |X-X0|:  100065.851562
rounded |X_k-Y|_0 = 723692, f1 =  0.655490, approx slack: 9134824
rounded before pow |X_k-Y|_0 = 9277367, f1 =  0.319820

Iteration 4999: Loss = 835777.625000
|Xk-Y|_F:  735820.687500, |X-X0|:  99956.960938
rounded |X_k-Y|_0 = 723565, f1 =  0.655502, approx slack: 9142840
rounded before pow |X_k-Y|_0 = 9285536, f1 =  0.319595


KB after refine:
num_nodes: 5060.0000
num_edges: 4339.0000
density: 0.0002
avg_degree: 0.8575
avg_clustering: 0.0217
degree_assortativity: -0.2053
modularity: 0.8008
avg_betweenness: 0.0000
avg_closeness: 0.0023
------ ABL 0 after refine ------
--- eval ---
prediction result:
f1 on test:    0.4860
f1 on test:    0.7505 (micro)
f1 on KB:      0.6251
f1 on orig KB: 0.3325
integrated f1: 0.3612, w_data: 0.2870, w_klg: 0.7130

integrated result:
f1 on test:    0.4715
f1 on test:    0.7474 (micro)
f1 on KB:      0.6468
f1 on orig KB: 0.3317
integrated f1: 0.3587, w_data: 0.2870, w_klg: 0.7130
------------
integrated f1 0.3612
Epoch 100, Total loss: 18603616256.0000, CE loss: 33.0844, RL loss: 186036160.0000, Reward: -5166945.4023
    full cols: 636, non-full cols: 211
   r - labels: 401, labels - r: 219
    violated: 12000, weighted: 12007.841796875, len: 0.0, nonzero: 0.14417922496795654
Epoch 200, Total loss: 2507191296.0000, CE loss: 33.0770, RL loss: 25071912.0000, Reward: -5169977.8906
    full cols: 651, non-full cols: 155
   r - labels: 368, labels - r: 227
    violated: 14374, weighted: 12003.048828125, len: 0.0, nonzero: 0.14414216578006744
Epoch 300, Total loss: 18252601344.0000, CE loss: 33.0695, RL loss: 182526016.0000, Reward: -5135929.0078
    full cols: 597, non-full cols: 290
   r - labels: 433, labels - r: 211
    violated: 12520, weighted: 12058.7314453125, len: 0.0, nonzero: 0.14437375962734222
Epoch 400, Total loss: -13914811392.0000, CE loss: 33.0618, RL loss: -139148112.0000, Reward: -5135822.8242
    full cols: 634, non-full cols: 195
   r - labels: 388, labels - r: 224
    violated: 13593, weighted: 11979.0517578125, len: 0.0, nonzero: 0.14409585297107697
Epoch 500, Total loss: 56537145344.0000, CE loss: 33.0581, RL loss: 565371456.0000, Reward: -5136123.4922
    full cols: 603, non-full cols: 271
   r - labels: 423, labels - r: 214
    violated: 12727, weighted: 11976.88671875, len: 0.0, nonzero: 0.14372220635414124
Epoch 600, Total loss: 115828686848.0000, CE loss: 33.0540, RL loss: 1158286848.0000, Reward: -5128779.1875
    full cols: 671, non-full cols: 109
   r - labels: 345, labels - r: 230
    violated: 11517, weighted: 11938.873046875, len: 0.0, nonzero: 0.14335782825946808
Epoch 700, Total loss: 40676016128.0000, CE loss: 33.0515, RL loss: 406760160.0000, Reward: -5127299.1543
    full cols: 630, non-full cols: 207
   r - labels: 392, labels - r: 220
    violated: 12970, weighted: 11966.681640625, len: 0.0, nonzero: 0.14379940927028656
Epoch 800, Total loss: 28983695360.0000, CE loss: 33.0430, RL loss: 289836960.0000, Reward: -5130663.7617
    full cols: 658, non-full cols: 133
   r - labels: 357, labels - r: 231
    violated: 12468, weighted: 11893.7890625, len: 0.0, nonzero: 0.14304594695568085
Epoch 900, Total loss: 147972833280.0000, CE loss: 33.0371, RL loss: 1479728256.0000, Reward: -5080334.2090
    full cols: 600, non-full cols: 273
   r - labels: 422, labels - r: 214
    violated: 12325, weighted: 11903.990234375, len: 0.0, nonzero: 0.14264759421348572
Epoch 1000, Total loss: 79128199168.0000, CE loss: 33.0360, RL loss: 791281984.0000, Reward: -5104112.2656
    full cols: 624, non-full cols: 205
   r - labels: 388, labels - r: 224
    violated: 11878, weighted: 11903.0576171875, len: 0.0, nonzero: 0.14309535920619965
Epoch 1100, Total loss: -52052615168.0000, CE loss: 33.0312, RL loss: -520526144.0000, Reward: -5121863.9062
    full cols: 622, non-full cols: 206
   r - labels: 389, labels - r: 226
    violated: 12340, weighted: 11864.05078125, len: 0.0, nonzero: 0.14314475655555725
Epoch 1200, Total loss: 71121846272.0000, CE loss: 33.0303, RL loss: 711218496.0000, Reward: -5083768.5332
    full cols: 610, non-full cols: 234
   r - labels: 400, labels - r: 221
    violated: 12623, weighted: 11846.201171875, len: 0.0, nonzero: 0.14242218434810638
Epoch 1300, Total loss: -53128908800.0000, CE loss: 33.0301, RL loss: -531289088.0000, Reward: -5107982.0547
    full cols: 628, non-full cols: 176
   r - labels: 369, labels - r: 230
    violated: 12137, weighted: 11961.74609375, len: 0.0, nonzero: 0.14250247180461884
Epoch 1400, Total loss: -65002016768.0000, CE loss: 33.0227, RL loss: -650020160.0000, Reward: -5075133.1172
    full cols: 643, non-full cols: 145
   r - labels: 352, labels - r: 229
    violated: 11683, weighted: 11816.91796875, len: 0.0, nonzero: 0.14248085021972656
Epoch 1500, Total loss: -167608057856.0000, CE loss: 33.0207, RL loss: -1676080512.0000, Reward: -5077572.6016
    full cols: 585, non-full cols: 273
   r - labels: 409, labels - r: 216
    violated: 12492, weighted: 11837.203125, len: 0.0, nonzero: 0.1418694406747818
Epoch 1600, Total loss: 159079907328.0000, CE loss: 33.0191, RL loss: 1590799104.0000, Reward: -5030329.1445
    full cols: 610, non-full cols: 206
   r - labels: 376, labels - r: 225
    violated: 12850, weighted: 11847.3232421875, len: 0.0, nonzero: 0.1411190629005432
Epoch 1700, Total loss: -276984397824.0000, CE loss: 33.0161, RL loss: -2769843968.0000, Reward: -5062878.0977
    full cols: 615, non-full cols: 190
   r - labels: 367, labels - r: 227
    violated: 11981, weighted: 11722.947265625, len: 0.0, nonzero: 0.13986536860466003
Epoch 1800, Total loss: -32195174400.0000, CE loss: 33.0178, RL loss: -321951744.0000, Reward: -5053290.4492
    full cols: 593, non-full cols: 246
   r - labels: 398, labels - r: 224
    violated: 12434, weighted: 11726.83984375, len: 0.0, nonzero: 0.13977272808551788
Epoch 1900, Total loss: -42893963264.0000, CE loss: 33.0128, RL loss: -428939648.0000, Reward: -5032815.0703
    full cols: 623, non-full cols: 174
   r - labels: 360, labels - r: 228
    violated: 11600, weighted: 11777.6484375, len: 0.0, nonzero: 0.14056015014648438
--- eval ---
prediction result:
f1 on test:    0.4861
f1 on test:    0.7506 (micro)
f1 on KB:      0.6253
integrated f1: 0.5716, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4713
f1 on test:    0.7473 (micro)
f1 on KB:      0.6461
integrated f1: 0.5748, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: -152939184128.0000, CE loss: 33.0125, RL loss: -1529391872.0000, Reward: -5043257.3398
    full cols: 624, non-full cols: 159
   r - labels: 346, labels - r: 228
    violated: 13335, weighted: 11795.666015625, len: 0.0, nonzero: 0.13958744704723358
Epoch 2100, Total loss: 160229294080.0000, CE loss: 33.0118, RL loss: 1602292992.0000, Reward: -4976930.4688
    full cols: 616, non-full cols: 168
   r - labels: 347, labels - r: 228
    violated: 12037, weighted: 11774.8193359375, len: 0.0, nonzero: 0.13976037502288818
Epoch 2200, Total loss: -6021462528.0000, CE loss: 33.0077, RL loss: -60214624.0000, Reward: -4974338.7500
    full cols: 645, non-full cols: 112
   r - labels: 327, labels - r: 235
    violated: 13282, weighted: 11641.310546875, len: 0.0, nonzero: 0.13890191912651062
Epoch 2300, Total loss: 112864944128.0000, CE loss: 33.0057, RL loss: 1128649472.0000, Reward: -4949196.3008
    full cols: 621, non-full cols: 154
   r - labels: 341, labels - r: 231
    violated: 12350, weighted: 11775.4150390625, len: 0.0, nonzero: 0.1384943127632141
Epoch 2400, Total loss: -69680668672.0000, CE loss: 33.0033, RL loss: -696806720.0000, Reward: -4953363.3047
    full cols: 587, non-full cols: 240
   r - labels: 386, labels - r: 224
    violated: 12074, weighted: 11794.5185546875, len: 0.0, nonzero: 0.13805274665355682
Epoch 2500, Total loss: -35753242624.0000, CE loss: 33.0027, RL loss: -357532416.0000, Reward: -4937194.4375
    full cols: 621, non-full cols: 155
   r - labels: 346, labels - r: 235
    violated: 12616, weighted: 11789.05859375, len: 0.0, nonzero: 0.13662919402122498
Epoch 2600, Total loss: -78038310912.0000, CE loss: 33.0021, RL loss: -780383104.0000, Reward: -4948379.1836
    full cols: 609, non-full cols: 185
   r - labels: 360, labels - r: 231
    violated: 12662, weighted: 11795.837890625, len: 0.0, nonzero: 0.1371387094259262
Epoch 2700, Total loss: 108099624960.0000, CE loss: 32.9993, RL loss: 1080996224.0000, Reward: -4932375.1055
    full cols: 611, non-full cols: 183
   r - labels: 362, labels - r: 233
    violated: 13135, weighted: 11756.111328125, len: 0.0, nonzero: 0.13778099417686462
Epoch 2800, Total loss: 171589894144.0000, CE loss: 32.9976, RL loss: 1715898880.0000, Reward: -4915481.0664
    full cols: 636, non-full cols: 117
   r - labels: 330, labels - r: 242
    violated: 12401, weighted: 11838.572265625, len: 0.0, nonzero: 0.13708004355430603
Epoch 2900, Total loss: -175764635648.0000, CE loss: 32.9973, RL loss: -1757646336.0000, Reward: -4931519.5625
    full cols: 625, non-full cols: 138
   r - labels: 339, labels - r: 241
    violated: 13114, weighted: 11825.998046875, len: 0.0, nonzero: 0.13714179396629333
Epoch 3000, Total loss: 13373321216.0000, CE loss: 32.9969, RL loss: 133733208.0000, Reward: -4892176.6992
    full cols: 624, non-full cols: 141
   r - labels: 342, labels - r: 242
    violated: 13702, weighted: 11890.076171875, len: 0.0, nonzero: 0.1367681473493576
Epoch 3100, Total loss: 22985373696.0000, CE loss: 32.9927, RL loss: 229853728.0000, Reward: -4862736.9219
    full cols: 617, non-full cols: 140
   r - labels: 337, labels - r: 245
    violated: 11861, weighted: 11900.4921875, len: 0.0, nonzero: 0.13534769415855408
Epoch 3200, Total loss: 149886763008.0000, CE loss: 32.9885, RL loss: 1498867584.0000, Reward: -4883946.8086
    full cols: 604, non-full cols: 155
   r - labels: 337, labels - r: 243
    violated: 11437, weighted: 11767.701171875, len: 0.0, nonzero: 0.1341928094625473
Epoch 3300, Total loss: 107295113216.0000, CE loss: 32.9902, RL loss: 1072951168.0000, Reward: -4898882.3281
    full cols: 569, non-full cols: 233
   r - labels: 372, labels - r: 235
    violated: 11617, weighted: 11817.607421875, len: 0.0, nonzero: 0.13459733128547668
Epoch 3400, Total loss: 81070039040.0000, CE loss: 32.9871, RL loss: 810700352.0000, Reward: -4874534.5156
    full cols: 617, non-full cols: 118
   r - labels: 319, labels - r: 249
    violated: 12706, weighted: 11804.5205078125, len: 0.0, nonzero: 0.13458189368247986
Epoch 3500, Total loss: -59996766208.0000, CE loss: 32.9853, RL loss: -599967680.0000, Reward: -4852100.4082
    full cols: 611, non-full cols: 118
   r - labels: 314, labels - r: 250
    violated: 11762, weighted: 11825.349609375, len: 0.0, nonzero: 0.1335412561893463
Epoch 3600, Total loss: -161598275584.0000, CE loss: 32.9798, RL loss: -1615982720.0000, Reward: -4844064.4102
    full cols: 602, non-full cols: 139
   r - labels: 329, labels - r: 253
    violated: 13569, weighted: 11776.693359375, len: 0.0, nonzero: 0.1321949064731598
Epoch 3700, Total loss: -106309353472.0000, CE loss: 32.9777, RL loss: -1063093504.0000, Reward: -4839324.9219
    full cols: 602, non-full cols: 131
   r - labels: 322, labels - r: 254
    violated: 13528, weighted: 11680.076171875, len: 0.0, nonzero: 0.1312469094991684
Epoch 3800, Total loss: -33405190144.0000, CE loss: 32.9794, RL loss: -334051904.0000, Reward: -4851415.9043
    full cols: 560, non-full cols: 242
   r - labels: 367, labels - r: 230
    violated: 12281, weighted: 11650.9775390625, len: 0.0, nonzero: 0.13164524734020233
Epoch 3900, Total loss: -119046160384.0000, CE loss: 32.9741, RL loss: -1190461568.0000, Reward: -4810595.3203
    full cols: 608, non-full cols: 115
   r - labels: 309, labels - r: 251
    violated: 14248, weighted: 11526.0625, len: 0.0, nonzero: 0.13098444044589996
--- eval ---
prediction result:
f1 on test:    0.4859
f1 on test:    0.7507 (micro)
f1 on KB:      0.6253
integrated f1: 0.5716, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4736
f1 on test:    0.7477 (micro)
f1 on KB:      0.6450
integrated f1: 0.5754, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: -38713331712.0000, CE loss: 32.9731, RL loss: -387133312.0000, Reward: -4799523.5742
    full cols: 617, non-full cols: 98
   r - labels: 302, labels - r: 252
    violated: 13617, weighted: 11531.2265625, len: 0.0, nonzero: 0.13111412525177002
Epoch 4100, Total loss: 52300333056.0000, CE loss: 32.9731, RL loss: 523003328.0000, Reward: -4774074.1797
    full cols: 622, non-full cols: 72
   r - labels: 290, labels - r: 261
    violated: 12604, weighted: 11552.4375, len: 0.0, nonzero: 0.130644753575325
Epoch 4200, Total loss: -74747977728.0000, CE loss: 32.9686, RL loss: -747479808.0000, Reward: -4769627.1973
    full cols: 588, non-full cols: 172
   r - labels: 342, labels - r: 247
    violated: 13896, weighted: 11822.240234375, len: 0.0, nonzero: 0.1317903846502304
Epoch 4300, Total loss: -21038546944.0000, CE loss: 32.9673, RL loss: -210385472.0000, Reward: -4764394.1289
    full cols: 605, non-full cols: 111
   r - labels: 310, labels - r: 259
    violated: 12323, weighted: 11770.0546875, len: 0.0, nonzero: 0.12944664061069489
Epoch 4400, Total loss: -11907658752.0000, CE loss: 32.9639, RL loss: -119076592.0000, Reward: -4748677.0547
    full cols: 598, non-full cols: 107
   r - labels: 298, labels - r: 258
    violated: 14191, weighted: 11747.583984375, len: 0.0, nonzero: 0.1287950873374939
Epoch 4500, Total loss: 6988779008.0000, CE loss: 32.9609, RL loss: 69887792.0000, Reward: -4718434.0508
    full cols: 592, non-full cols: 134
   r - labels: 310, labels - r: 249
    violated: 12712, weighted: 11651.302734375, len: 0.0, nonzero: 0.1294373720884323
Epoch 4600, Total loss: 55350808576.0000, CE loss: 32.9582, RL loss: 553508096.0000, Reward: -4686465.1875
    full cols: 608, non-full cols: 76
   r - labels: 278, labels - r: 259
    violated: 13335, weighted: 11489.13671875, len: 0.0, nonzero: 0.1278223842382431
Epoch 4700, Total loss: -20090243072.0000, CE loss: 32.9527, RL loss: -200902432.0000, Reward: -4697472.7188
    full cols: 609, non-full cols: 93
   r - labels: 295, labels - r: 258
    violated: 12500, weighted: 11686.1416015625, len: 0.0, nonzero: 0.1292026937007904
Epoch 4800, Total loss: -48637665280.0000, CE loss: 32.9504, RL loss: -486376640.0000, Reward: -4707856.2754
    full cols: 621, non-full cols: 56
   r - labels: 279, labels - r: 267
    violated: 11825, weighted: 11667.521484375, len: 0.0, nonzero: 0.1284615844488144
Epoch 4900, Total loss: 31532326912.0000, CE loss: 32.9463, RL loss: 315323264.0000, Reward: -4702936.1816
    full cols: 588, non-full cols: 132
   r - labels: 303, labels - r: 248
    violated: 14079, weighted: 11398.51171875, len: 0.0, nonzero: 0.1285974532365799
Epoch 5000, Total loss: 100990869504.0000, CE loss: 32.9406, RL loss: 1009908672.0000, Reward: -4686607.1895
    full cols: 590, non-full cols: 130
   r - labels: 307, labels - r: 252
    violated: 12169, weighted: 11450.13671875, len: 0.0, nonzero: 0.12781928479671478
Epoch 5100, Total loss: -15348931584.0000, CE loss: 32.9411, RL loss: -153489312.0000, Reward: -4669251.1172
    full cols: 603, non-full cols: 85
   r - labels: 285, labels - r: 262
    violated: 13055, weighted: 11519.62890625, len: 0.0, nonzero: 0.12749196588993073
Epoch 5200, Total loss: 137673965568.0000, CE loss: 32.9346, RL loss: 1376739712.0000, Reward: -4661873.3086
    full cols: 567, non-full cols: 160
   r - labels: 315, labels - r: 253
    violated: 14093, weighted: 11755.6943359375, len: 0.0, nonzero: 0.12689907848834991
Epoch 5300, Total loss: -204135661568.0000, CE loss: 32.9317, RL loss: -2041356672.0000, Reward: -4728731.7305
    full cols: 546, non-full cols: 221
   r - labels: 349, labels - r: 247
    violated: 12004, weighted: 11834.880859375, len: 0.0, nonzero: 0.1278223842382431
Epoch 5400, Total loss: 27476475904.0000, CE loss: 32.9299, RL loss: 274764768.0000, Reward: -4691062.9102
    full cols: 588, non-full cols: 99
   r - labels: 289, labels - r: 267
    violated: 12351, weighted: 11909.8671875, len: 0.0, nonzero: 0.12671998143196106
Epoch 5500, Total loss: 79217123328.0000, CE loss: 32.9280, RL loss: 792171200.0000, Reward: -4686085.0801
    full cols: 568, non-full cols: 151
   r - labels: 307, labels - r: 253
    violated: 11584, weighted: 11807.642578125, len: 0.0, nonzero: 0.12728816270828247
Epoch 5600, Total loss: -122873765888.0000, CE loss: 32.9238, RL loss: -1228737664.0000, Reward: -4683954.4141
    full cols: 554, non-full cols: 185
   r - labels: 327, labels - r: 253
    violated: 13245, weighted: 11959.078125, len: 0.0, nonzero: 0.12712758779525757
Epoch 5700, Total loss: 56784826368.0000, CE loss: 32.9192, RL loss: 567848256.0000, Reward: -4623868.3281
    full cols: 573, non-full cols: 109
   r - labels: 287, labels - r: 270
    violated: 11878, weighted: 11931.5029296875, len: 0.0, nonzero: 0.12473134696483612
Epoch 5800, Total loss: 99817250816.0000, CE loss: 32.9166, RL loss: 998172544.0000, Reward: -4595301.8203
    full cols: 583, non-full cols: 78
   r - labels: 277, labels - r: 281
    violated: 11865, weighted: 12037.2451171875, len: 0.0, nonzero: 0.1224246546626091
Epoch 5900, Total loss: 72757772288.0000, CE loss: 32.9144, RL loss: 727577728.0000, Reward: -4596450.6484
    full cols: 551, non-full cols: 150
   r - labels: 307, labels - r: 271
    violated: 13297, weighted: 11954.158203125, len: 0.0, nonzero: 0.12166501581668854
--- eval ---
prediction result:
f1 on test:    0.4836
f1 on test:    0.7501 (micro)
f1 on KB:      0.6255
integrated f1: 0.5706, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4728
f1 on test:    0.7476 (micro)
f1 on KB:      0.6439
integrated f1: 0.5744, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: -10751733760.0000, CE loss: 32.9122, RL loss: -107517336.0000, Reward: -4608086.7852
    full cols: 565, non-full cols: 122
   r - labels: 298, labels - r: 276
    violated: 13033, weighted: 12242.09765625, len: 0.0, nonzero: 0.12374938279390335
Epoch 6100, Total loss: -131741949952.0000, CE loss: 32.9105, RL loss: -1317419520.0000, Reward: -4613910.9961
    full cols: 561, non-full cols: 119
   r - labels: 288, labels - r: 273
    violated: 11748, weighted: 11905.09375, len: 0.0, nonzero: 0.12284769862890244
Epoch 6200, Total loss: 103591043072.0000, CE loss: 32.9094, RL loss: 1035910400.0000, Reward: -4608896.7109
    full cols: 544, non-full cols: 146
   r - labels: 297, labels - r: 272
    violated: 12271, weighted: 11835.681640625, len: 0.0, nonzero: 0.12181323766708374
Epoch 6300, Total loss: 225354924032.0000, CE loss: 32.9073, RL loss: 2253549312.0000, Reward: -4581145.7715
    full cols: 584, non-full cols: 64
   r - labels: 273, labels - r: 290
    violated: 12822, weighted: 12101.009765625, len: 0.0, nonzero: 0.12174221873283386
Epoch 6400, Total loss: -165904220160.0000, CE loss: 32.9060, RL loss: -1659042176.0000, Reward: -4624304.3984
    full cols: 573, non-full cols: 85
   r - labels: 281, labels - r: 288
    violated: 12630, weighted: 12104.908203125, len: 0.0, nonzero: 0.12142106890678406
Epoch 6500, Total loss: 107774615552.0000, CE loss: 32.9050, RL loss: 1077746176.0000, Reward: -4533111.2070
    full cols: 563, non-full cols: 92
   r - labels: 282, labels - r: 292
    violated: 14152, weighted: 12170.5556640625, len: 0.0, nonzero: 0.12017662823200226
Epoch 6600, Total loss: 13821780992.0000, CE loss: 32.9039, RL loss: 138217808.0000, Reward: -4563397.7617
    full cols: 585, non-full cols: 52
   r - labels: 270, labels - r: 298
    violated: 14932, weighted: 12319.291015625, len: 0.0, nonzero: 0.12224555015563965
Epoch 6700, Total loss: 106582065152.0000, CE loss: 32.9023, RL loss: 1065820672.0000, Reward: -4518025.7578
    full cols: 559, non-full cols: 97
   r - labels: 282, labels - r: 291
    violated: 11435, weighted: 12146.73046875, len: 0.0, nonzero: 0.12128828465938568
Epoch 6800, Total loss: -119005118464.0000, CE loss: 32.9026, RL loss: -1190051200.0000, Reward: -4492070.0391
    full cols: 586, non-full cols: 52
   r - labels: 268, labels - r: 295
    violated: 13070, weighted: 12352.583984375, len: 0.0, nonzero: 0.12058115005493164
Epoch 6900, Total loss: 120512847872.0000, CE loss: 32.8984, RL loss: 1205128448.0000, Reward: -4426210.0566
    full cols: 587, non-full cols: 44
   r - labels: 265, labels - r: 299
    violated: 13394, weighted: 12258.89453125, len: 0.0, nonzero: 0.11982151120901108
Epoch 7000, Total loss: 21515851776.0000, CE loss: 32.8979, RL loss: 215158512.0000, Reward: -4374703.5547
    full cols: 584, non-full cols: 25
   r - labels: 253, labels - r: 309
    violated: 12515, weighted: 12246.80078125, len: 0.0, nonzero: 0.11777729541063309
Epoch 7100, Total loss: 37655470080.0000, CE loss: 32.8978, RL loss: 376554688.0000, Reward: -4329921.9434
    full cols: 567, non-full cols: 57
   r - labels: 260, labels - r: 301
    violated: 13596, weighted: 12171.0341796875, len: 0.0, nonzero: 0.11765068769454956
Epoch 7200, Total loss: 73124118528.0000, CE loss: 32.8988, RL loss: 731241152.0000, Reward: -4280303.9922
    full cols: 552, non-full cols: 96
   r - labels: 278, labels - r: 295
    violated: 13137, weighted: 12329.009765625, len: 0.0, nonzero: 0.11760745942592621
Epoch 7300, Total loss: -99802054656.0000, CE loss: 32.8964, RL loss: -998020544.0000, Reward: -4215289.7305
    full cols: 568, non-full cols: 52
   r - labels: 261, labels - r: 306
    violated: 13065, weighted: 12167.6611328125, len: 0.0, nonzero: 0.11768465489149094
Epoch 7400, Total loss: 95139602432.0000, CE loss: 32.8973, RL loss: 951396032.0000, Reward: -4194577.8516
    full cols: 560, non-full cols: 65
   r - labels: 267, labels - r: 307
    violated: 12913, weighted: 12267.732421875, len: 0.0, nonzero: 0.11753643304109573
Epoch 7500, Total loss: -52213460992.0000, CE loss: 32.8967, RL loss: -522134592.0000, Reward: -4180246.0352
    full cols: 570, non-full cols: 47
   r - labels: 264, labels - r: 312
    violated: 12968, weighted: 12547.6455078125, len: 0.0, nonzero: 0.11798109859228134
Epoch 7600, Total loss: 77861928960.0000, CE loss: 32.8979, RL loss: 778619328.0000, Reward: -4129226.7422
    full cols: 572, non-full cols: 43
   r - labels: 258, labels - r: 308
    violated: 12070, weighted: 12297.5810546875, len: 0.0, nonzero: 0.1170516312122345
Epoch 7700, Total loss: 3272610560.0000, CE loss: 32.8951, RL loss: 32726106.0000, Reward: -4113038.2422
    full cols: 561, non-full cols: 45
   r - labels: 252, labels - r: 311
    violated: 13506, weighted: 12243.822265625, len: 0.0, nonzero: 0.11525444686412811
Epoch 7800, Total loss: 46756818944.0000, CE loss: 32.8969, RL loss: 467568192.0000, Reward: -4088636.7832
    full cols: 568, non-full cols: 33
   r - labels: 248, labels - r: 312
    violated: 12019, weighted: 12271.86328125, len: 0.0, nonzero: 0.11665946245193481
Epoch 7900, Total loss: 30737664000.0000, CE loss: 32.8930, RL loss: 307376640.0000, Reward: -4067690.0781
    full cols: 576, non-full cols: 43
   r - labels: 265, labels - r: 311
    violated: 12908, weighted: 12540.365234375, len: 0.0, nonzero: 0.11800580471754074
--- eval ---
prediction result:
f1 on test:    0.4822
f1 on test:    0.7498 (micro)
f1 on KB:      0.6256
integrated f1: 0.5700, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4730
f1 on test:    0.7476 (micro)
f1 on KB:      0.6426
integrated f1: 0.5739, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: -40760152064.0000, CE loss: 32.8952, RL loss: -407601536.0000, Reward: -4054460.8906
    full cols: 553, non-full cols: 68
   r - labels: 268, labels - r: 312
    violated: 12888, weighted: 12507.8798828125, len: 0.0, nonzero: 0.11633831262588501
Epoch 8100, Total loss: -133091229696.0000, CE loss: 32.8950, RL loss: -1330912256.0000, Reward: -4064200.5820
    full cols: 547, non-full cols: 81
   r - labels: 278, labels - r: 315
    violated: 13593, weighted: 12908.609375, len: 0.0, nonzero: 0.11716897040605545
Epoch 8200, Total loss: -29063962624.0000, CE loss: 32.8933, RL loss: -290639616.0000, Reward: -4001456.4668
    full cols: 576, non-full cols: 25
   r - labels: 260, labels - r: 324
    violated: 14607, weighted: 12608.365234375, len: 0.0, nonzero: 0.11610054224729538
Epoch 8300, Total loss: 33489119232.0000, CE loss: 32.8960, RL loss: 334891200.0000, Reward: -4000158.7383
    full cols: 573, non-full cols: 28
   r - labels: 258, labels - r: 322
    violated: 13878, weighted: 12636.15234375, len: 0.0, nonzero: 0.11651124060153961
Epoch 8400, Total loss: 118290702336.0000, CE loss: 32.8955, RL loss: 1182907008.0000, Reward: -3971682.0312
    full cols: 546, non-full cols: 41
   r - labels: 252, labels - r: 330
    violated: 14425, weighted: 12680.0078125, len: 0.0, nonzero: 0.11166007816791534
Epoch 8500, Total loss: -10293420032.0000, CE loss: 32.8965, RL loss: -102934200.0000, Reward: -3953426.4570
    full cols: 562, non-full cols: 27
   r - labels: 252, labels - r: 328
    violated: 13682, weighted: 12536.7421875, len: 0.0, nonzero: 0.11404397338628769
Epoch 8600, Total loss: -7660775936.0000, CE loss: 32.8942, RL loss: -76607760.0000, Reward: -3940192.6094
    full cols: 563, non-full cols: 27
   r - labels: 253, labels - r: 328
    violated: 13277, weighted: 12596.90625, len: 0.0, nonzero: 0.1142416000366211
Epoch 8700, Total loss: -29729517568.0000, CE loss: 32.8952, RL loss: -297295168.0000, Reward: -3930835.3711
    full cols: 558, non-full cols: 37
   r - labels: 252, labels - r: 322
    violated: 12952, weighted: 12571.716796875, len: 0.0, nonzero: 0.11402544379234314
Epoch 8800, Total loss: -67097780224.0000, CE loss: 32.8948, RL loss: -670977792.0000, Reward: -3953998.9844
    full cols: 550, non-full cols: 36
   r - labels: 253, labels - r: 332
    violated: 13052, weighted: 12696.728515625, len: 0.0, nonzero: 0.11327198147773743
Epoch 8900, Total loss: 57643929600.0000, CE loss: 32.8917, RL loss: 576439296.0000, Reward: -3904808.1191
    full cols: 563, non-full cols: 27
   r - labels: 256, labels - r: 331
    violated: 14220, weighted: 12688.103515625, len: 0.0, nonzero: 0.11407484859228134
Epoch 9000, Total loss: 64909496320.0000, CE loss: 32.8912, RL loss: 649094976.0000, Reward: -3897293.3750
    full cols: 569, non-full cols: 20
   r - labels: 250, labels - r: 326
    violated: 11994, weighted: 12538.4091796875, len: 0.0, nonzero: 0.11421380937099457
Epoch 9100, Total loss: -44540362752.0000, CE loss: 32.8922, RL loss: -445403648.0000, Reward: -3891869.9746
    full cols: 572, non-full cols: 24
   r - labels: 258, labels - r: 327
    violated: 11799, weighted: 12679.494140625, len: 0.0, nonzero: 0.11482831090688705
Epoch 9200, Total loss: 119873896448.0000, CE loss: 32.8926, RL loss: 1198738944.0000, Reward: -3890435.5215
    full cols: 569, non-full cols: 29
   r - labels: 261, labels - r: 328
    violated: 12777, weighted: 12721.79296875, len: 0.0, nonzero: 0.11520503461360931
Epoch 9300, Total loss: 99864158208.0000, CE loss: 32.8952, RL loss: 998641600.0000, Reward: -3900611.4180
    full cols: 563, non-full cols: 25
   r - labels: 255, labels - r: 332
    violated: 14245, weighted: 12703.291015625, len: 0.0, nonzero: 0.11368267983198166
Epoch 9400, Total loss: -126840610816.0000, CE loss: 32.8940, RL loss: -1268406144.0000, Reward: -3942512.2969
    full cols: 564, non-full cols: 33
   r - labels: 262, labels - r: 330
    violated: 13274, weighted: 12839.2587890625, len: 0.0, nonzero: 0.11427247524261475
Epoch 9500, Total loss: 17695154176.0000, CE loss: 32.8930, RL loss: 176951552.0000, Reward: -3948934.8613
    full cols: 573, non-full cols: 20
   r - labels: 258, labels - r: 330
    violated: 12053, weighted: 12692.998046875, len: 0.0, nonzero: 0.11551692336797714
Epoch 9600, Total loss: 1562218624.0000, CE loss: 32.8945, RL loss: 15622186.0000, Reward: -3947618.7676
    full cols: 568, non-full cols: 23
   r - labels: 262, labels - r: 336
    violated: 14075, weighted: 12911.7099609375, len: 0.0, nonzero: 0.11481286585330963
Epoch 9700, Total loss: -249191661568.0000, CE loss: 32.8942, RL loss: -2491916544.0000, Reward: -3989662.8320
    full cols: 565, non-full cols: 46
   r - labels: 275, labels - r: 329
    violated: 12602, weighted: 12748.166015625, len: 0.0, nonzero: 0.1158689484000206
Epoch 9800, Total loss: 166962970624.0000, CE loss: 32.8910, RL loss: 1669629696.0000, Reward: -3955262.6602
    full cols: 569, non-full cols: 21
   r - labels: 261, labels - r: 336
    violated: 11972, weighted: 12719.7705078125, len: 0.0, nonzero: 0.11409646272659302
Epoch 9900, Total loss: -44300541952.0000, CE loss: 32.8930, RL loss: -443005440.0000, Reward: -3965233.7207
    full cols: 571, non-full cols: 32
   r - labels: 273, labels - r: 335
    violated: 13033, weighted: 12967.84765625, len: 0.0, nonzero: 0.11584115028381348
--- eval ---
prediction result:
f1 on test:    0.4822
f1 on test:    0.7498 (micro)
f1 on KB:      0.6256
integrated f1: 0.5700, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4723
f1 on test:    0.7474 (micro)
f1 on KB:      0.6418
integrated f1: 0.5731, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 10000, Total loss: -233776381952.0000, CE loss: 32.8923, RL loss: -2337763840.0000, Reward: -3971903.8047
    full cols: 573, non-full cols: 19
   r - labels: 266, labels - r: 339
    violated: 15100, weighted: 13008.78515625, len: 0.0, nonzero: 0.11505681276321411
Epoch 10100, Total loss: -14398319616.0000, CE loss: 32.8964, RL loss: -143983200.0000, Reward: -3927702.5566
    full cols: 563, non-full cols: 28
   r - labels: 272, labels - r: 346
    violated: 14357, weighted: 13212.8203125, len: 0.0, nonzero: 0.11374135315418243
Epoch 10200, Total loss: 118596861952.0000, CE loss: 32.8919, RL loss: 1185968640.0000, Reward: -3918901.4648
    full cols: 572, non-full cols: 27
   r - labels: 277, labels - r: 343
    violated: 11895, weighted: 13352.3349609375, len: 0.0, nonzero: 0.1160789281129837
Epoch 10300, Total loss: -27614982144.0000, CE loss: 32.8936, RL loss: -276149824.0000, Reward: -3937072.5469
    full cols: 578, non-full cols: 31
   r - labels: 285, labels - r: 341
    violated: 13226, weighted: 13491.875, len: 0.0, nonzero: 0.11744379997253418
Epoch 10400, Total loss: -149441609728.0000, CE loss: 32.8904, RL loss: -1494416128.0000, Reward: -3936590.8750
    full cols: 569, non-full cols: 21
   r - labels: 271, labels - r: 346
    violated: 13583, weighted: 13432.36328125, len: 0.0, nonzero: 0.11439290642738342
Epoch 10500, Total loss: -18273994752.0000, CE loss: 32.8916, RL loss: -182739952.0000, Reward: -3920314.4688
    full cols: 565, non-full cols: 39
   r - labels: 281, labels - r: 342
    violated: 14030, weighted: 13431.4560546875, len: 0.0, nonzero: 0.11522974073886871
Epoch 10600, Total loss: -22138112000.0000, CE loss: 32.8938, RL loss: -221381120.0000, Reward: -3927079.2520
    full cols: 576, non-full cols: 37
   r - labels: 288, labels - r: 340
    violated: 13473, weighted: 13765.4013671875, len: 0.0, nonzero: 0.11688487976789474
Epoch 10700, Total loss: -11555569664.0000, CE loss: 32.8926, RL loss: -115555696.0000, Reward: -3932093.8203
    full cols: 577, non-full cols: 22
   r - labels: 279, labels - r: 345
    violated: 12935, weighted: 13712.419921875, len: 0.0, nonzero: 0.11631669849157333
Epoch 10800, Total loss: 31905935360.0000, CE loss: 32.8914, RL loss: 319059360.0000, Reward: -3940909.3477
    full cols: 576, non-full cols: 15
   r - labels: 274, labels - r: 348
    violated: 13189, weighted: 13581.1572265625, len: 0.0, nonzero: 0.11505372822284698
Epoch 10900, Total loss: -79454470144.0000, CE loss: 32.8942, RL loss: -794544704.0000, Reward: -3934968.1602
    full cols: 572, non-full cols: 30
   r - labels: 280, labels - r: 343
    violated: 12001, weighted: 13742.90234375, len: 0.0, nonzero: 0.11589056253433228
Epoch 11000, Total loss: -89152176128.0000, CE loss: 32.8917, RL loss: -891521728.0000, Reward: -3960715.8047
    full cols: 563, non-full cols: 26
   r - labels: 280, labels - r: 356
    violated: 14620, weighted: 13998.3486328125, len: 0.0, nonzero: 0.1143157109618187
Epoch 11100, Total loss: 243114934272.0000, CE loss: 32.8916, RL loss: 2431149312.0000, Reward: -3920869.5156
    full cols: 564, non-full cols: 24
   r - labels: 277, labels - r: 354
    violated: 12809, weighted: 13892.7353515625, len: 0.0, nonzero: 0.11369811743497849
Epoch 11200, Total loss: -1338608000.0000, CE loss: 32.8907, RL loss: -13386080.0000, Reward: -3949859.9844
    full cols: 556, non-full cols: 18
   r - labels: 266, labels - r: 357
    violated: 13238, weighted: 13745.5087890625, len: 0.0, nonzero: 0.11172183603048325
Epoch 11300, Total loss: 126901018624.0000, CE loss: 32.8935, RL loss: 1269010176.0000, Reward: -3956219.1738
    full cols: 559, non-full cols: 25
   r - labels: 274, labels - r: 355
    violated: 16160, weighted: 13897.2470703125, len: 0.0, nonzero: 0.11317317187786102
Epoch 11400, Total loss: -5877854208.0000, CE loss: 32.8948, RL loss: -58778544.0000, Reward: -3970804.9023
    full cols: 564, non-full cols: 21
   r - labels: 281, labels - r: 361
    violated: 13017, weighted: 14370.6953125, len: 0.0, nonzero: 0.11380619555711746
Epoch 11500, Total loss: 52070535168.0000, CE loss: 32.8923, RL loss: 520705344.0000, Reward: -3955244.6211
    full cols: 561, non-full cols: 27
   r - labels: 282, labels - r: 359
    violated: 13015, weighted: 14142.6708984375, len: 0.0, nonzero: 0.11339858919382095
Epoch 11600, Total loss: 23097413632.0000, CE loss: 32.8932, RL loss: 230974128.0000, Reward: -3968250.3301
    full cols: 561, non-full cols: 27
   r - labels: 281, labels - r: 358
    violated: 12728, weighted: 14316.37890625, len: 0.0, nonzero: 0.1131947860121727
Epoch 11700, Total loss: 61839507456.0000, CE loss: 32.8927, RL loss: 618395072.0000, Reward: -3960945.0000
    full cols: 570, non-full cols: 22
   r - labels: 281, labels - r: 354
    violated: 13193, weighted: 14267.794921875, len: 0.0, nonzero: 0.11418601870536804
Epoch 11800, Total loss: -101517860864.0000, CE loss: 32.8902, RL loss: -1015178624.0000, Reward: -3965280.8418
    full cols: 575, non-full cols: 24
   r - labels: 287, labels - r: 353
    violated: 12944, weighted: 14095.6484375, len: 0.0, nonzero: 0.11644330620765686
Epoch 11900, Total loss: -54564298752.0000, CE loss: 32.8921, RL loss: -545643008.0000, Reward: -3949051.4668
    full cols: 558, non-full cols: 23
   r - labels: 275, labels - r: 359
    violated: 13167, weighted: 13944.40234375, len: 0.0, nonzero: 0.11221899837255478
--- eval ---
prediction result:
f1 on test:    0.4822
f1 on test:    0.7498 (micro)
f1 on KB:      0.6256
integrated f1: 0.5700, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4721
f1 on test:    0.7476 (micro)
f1 on KB:      0.6410
integrated f1: 0.5727, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 12000, Total loss: -57754308608.0000, CE loss: 32.8914, RL loss: -577543104.0000, Reward: -3931951.8047
    full cols: 551, non-full cols: 30
   r - labels: 274, labels - r: 358
    violated: 14358, weighted: 14102.5859375, len: 0.0, nonzero: 0.11261733621358871
Epoch 12100, Total loss: 71794581504.0000, CE loss: 32.8970, RL loss: 717945792.0000, Reward: -3907180.3984
    full cols: 553, non-full cols: 30
   r - labels: 280, labels - r: 362
    violated: 12969, weighted: 14059.3408203125, len: 0.0, nonzero: 0.11167551577091217
Epoch 12200, Total loss: -121665675264.0000, CE loss: 32.8912, RL loss: -1216656768.0000, Reward: -3928869.6641
    full cols: 549, non-full cols: 21
   r - labels: 271, labels - r: 366
    violated: 13693, weighted: 14137.0322265625, len: 0.0, nonzero: 0.11016859859228134
Epoch 12300, Total loss: -154209288192.0000, CE loss: 32.8917, RL loss: -1542092928.0000, Reward: -3914421.4844
    full cols: 555, non-full cols: 26
   r - labels: 278, labels - r: 362
    violated: 14237, weighted: 14105.896484375, len: 0.0, nonzero: 0.11219429224729538
Epoch 12400, Total loss: -60891930624.0000, CE loss: 32.8942, RL loss: -608919296.0000, Reward: -3905993.8125
    full cols: 552, non-full cols: 29
   r - labels: 276, labels - r: 360
    violated: 12875, weighted: 14160.494140625, len: 0.0, nonzero: 0.11242588609457016
Epoch 12500, Total loss: -51601547264.0000, CE loss: 32.8920, RL loss: -516015456.0000, Reward: -3918760.3164
    full cols: 553, non-full cols: 26
   r - labels: 282, labels - r: 368
    violated: 12616, weighted: 14335.396484375, len: 0.0, nonzero: 0.11176197975873947
Epoch 12600, Total loss: -125882294272.0000, CE loss: 32.8915, RL loss: -1258822912.0000, Reward: -3878904.1680
    full cols: 564, non-full cols: 22
   r - labels: 283, labels - r: 362
    violated: 13173, weighted: 14217.4326171875, len: 0.0, nonzero: 0.1135406345129013
Epoch 12700, Total loss: 109770850304.0000, CE loss: 32.8904, RL loss: 1097708544.0000, Reward: -3855441.6758
    full cols: 555, non-full cols: 23
   r - labels: 282, labels - r: 369
    violated: 12228, weighted: 14397.7294921875, len: 0.0, nonzero: 0.11255557835102081
Epoch 12800, Total loss: 142119698432.0000, CE loss: 32.8914, RL loss: 1421196928.0000, Reward: -3852813.5820
    full cols: 547, non-full cols: 26
   r - labels: 285, labels - r: 377
    violated: 13258, weighted: 14574.5986328125, len: 0.0, nonzero: 0.1106441468000412
Epoch 12900, Total loss: -130568822784.0000, CE loss: 32.8955, RL loss: -1305688192.0000, Reward: -3875573.2930
    full cols: 549, non-full cols: 24
   r - labels: 287, labels - r: 379
    violated: 12351, weighted: 14578.1875, len: 0.0, nonzero: 0.11103013902902603
Epoch 13000, Total loss: 140972818432.0000, CE loss: 32.8922, RL loss: 1409728128.0000, Reward: -3848679.3711
    full cols: 547, non-full cols: 25
   r - labels: 285, labels - r: 378
    violated: 13650, weighted: 14504.986328125, len: 0.0, nonzero: 0.11056385934352875
Epoch 13100, Total loss: 4170248704.0000, CE loss: 32.8924, RL loss: 41702488.0000, Reward: -3869854.9023
    full cols: 555, non-full cols: 26
   r - labels: 296, labels - r: 380
    violated: 16504, weighted: 14686.9423828125, len: 0.0, nonzero: 0.11238574236631393
Epoch 13200, Total loss: -63873146880.0000, CE loss: 32.8938, RL loss: -638731456.0000, Reward: -3881376.5645
    full cols: 544, non-full cols: 31
   r - labels: 292, labels - r: 382
    violated: 14369, weighted: 14683.798828125, len: 0.0, nonzero: 0.11073987185955048
Epoch 13300, Total loss: 295989542912.0000, CE loss: 32.8927, RL loss: 2959895296.0000, Reward: -3845387.5742
    full cols: 545, non-full cols: 19
   r - labels: 288, labels - r: 389
    violated: 12755, weighted: 14855.9267578125, len: 0.0, nonzero: 0.10962512344121933
Epoch 13400, Total loss: -7265086464.0000, CE loss: 32.8892, RL loss: -72650864.0000, Reward: -3867152.2539
    full cols: 547, non-full cols: 24
   r - labels: 294, labels - r: 388
    violated: 13836, weighted: 14894.001953125, len: 0.0, nonzero: 0.10987524688243866
Epoch 13500, Total loss: -67640197120.0000, CE loss: 32.8913, RL loss: -676401984.0000, Reward: -3896344.4805
    full cols: 554, non-full cols: 26
   r - labels: 297, labels - r: 382
    violated: 16181, weighted: 15005.716796875, len: 0.0, nonzero: 0.11220355331897736
Epoch 13600, Total loss: 114183004160.0000, CE loss: 32.8917, RL loss: 1141830016.0000, Reward: -3850567.1055
    full cols: 556, non-full cols: 29
   r - labels: 301, labels - r: 381
    violated: 13554, weighted: 15003.2548828125, len: 0.0, nonzero: 0.11252778768539429
Epoch 13700, Total loss: 79701532672.0000, CE loss: 32.8937, RL loss: 797015296.0000, Reward: -3858276.3984
    full cols: 567, non-full cols: 12
   r - labels: 298, labels - r: 384
    violated: 13345, weighted: 15097.3046875, len: 0.0, nonzero: 0.1133924126625061
Epoch 13800, Total loss: -138052665344.0000, CE loss: 32.8922, RL loss: -1380526592.0000, Reward: -3874959.7500
    full cols: 560, non-full cols: 25
   r - labels: 301, labels - r: 381
    violated: 12853, weighted: 14914.654296875, len: 0.0, nonzero: 0.11310523748397827
Epoch 13900, Total loss: 36399042560.0000, CE loss: 32.8916, RL loss: 363990432.0000, Reward: -3860144.0176
    full cols: 555, non-full cols: 25
   r - labels: 302, labels - r: 387
    violated: 15334, weighted: 15173.96484375, len: 0.0, nonzero: 0.11212018132209778
--- eval ---
prediction result:
f1 on test:    0.4822
f1 on test:    0.7498 (micro)
f1 on KB:      0.6256
integrated f1: 0.5700, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4724
f1 on test:    0.7475 (micro)
f1 on KB:      0.6395
integrated f1: 0.5721, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 14000, Total loss: -50412531712.0000, CE loss: 32.8923, RL loss: -504125312.0000, Reward: -3871962.0508
    full cols: 549, non-full cols: 37
   r - labels: 304, labels - r: 383
    violated: 12855, weighted: 15037.177734375, len: 0.0, nonzero: 0.11211400479078293
Epoch 14100, Total loss: -89655869440.0000, CE loss: 32.8886, RL loss: -896558720.0000, Reward: -3868548.3633
    full cols: 549, non-full cols: 35
   r - labels: 303, labels - r: 384
    violated: 13670, weighted: 15132.869140625, len: 0.0, nonzero: 0.11240735650062561
Epoch 14200, Total loss: 47068700672.0000, CE loss: 32.8910, RL loss: 470687008.0000, Reward: -3876672.0000
    full cols: 553, non-full cols: 31
   r - labels: 303, labels - r: 384
    violated: 12721, weighted: 15335.572265625, len: 0.0, nonzero: 0.11253396421670914
Epoch 14300, Total loss: -303724527616.0000, CE loss: 32.8916, RL loss: -3037245184.0000, Reward: -3896911.0156
    full cols: 556, non-full cols: 26
   r - labels: 307, labels - r: 390
    violated: 14893, weighted: 15255.6279296875, len: 0.0, nonzero: 0.11238883435726166
Epoch 14400, Total loss: 141938425856.0000, CE loss: 32.8897, RL loss: 1419384320.0000, Reward: -3851843.6641
    full cols: 561, non-full cols: 22
   r - labels: 307, labels - r: 389
    violated: 13998, weighted: 15223.724609375, len: 0.0, nonzero: 0.11296319216489792
Epoch 14500, Total loss: 125096624128.0000, CE loss: 32.8933, RL loss: 1250966272.0000, Reward: -3860557.5469
    full cols: 550, non-full cols: 33
   r - labels: 307, labels - r: 389
    violated: 12927, weighted: 15341.3798828125, len: 0.0, nonzero: 0.11197195947170258
Epoch 14600, Total loss: 17388722176.0000, CE loss: 32.8929, RL loss: 173887216.0000, Reward: -3875686.9180
    full cols: 556, non-full cols: 38
   r - labels: 312, labels - r: 383
    violated: 13601, weighted: 15304.427734375, len: 0.0, nonzero: 0.11361166089773178
Epoch 14700, Total loss: -60585062400.0000, CE loss: 32.8930, RL loss: -605850624.0000, Reward: -3891445.6738
    full cols: 552, non-full cols: 30
   r - labels: 304, labels - r: 387
    violated: 12329, weighted: 15157.193359375, len: 0.0, nonzero: 0.1116291955113411
Epoch 14800, Total loss: -47275692032.0000, CE loss: 32.8915, RL loss: -472756928.0000, Reward: -3889227.6289
    full cols: 541, non-full cols: 43
   r - labels: 307, labels - r: 388
    violated: 17727, weighted: 15191.48828125, len: 0.0, nonzero: 0.1106564924120903
Epoch 14900, Total loss: -141878968320.0000, CE loss: 32.8912, RL loss: -1418789760.0000, Reward: -3866093.4648
    full cols: 556, non-full cols: 32
   r - labels: 311, labels - r: 388
    violated: 13224, weighted: 15372.466796875, len: 0.0, nonzero: 0.11330904066562653
Epoch 15000, Total loss: 65618067456.0000, CE loss: 32.8918, RL loss: 656180672.0000, Reward: -3878875.7188
    full cols: 555, non-full cols: 19
   r - labels: 309, labels - r: 400
    violated: 14134, weighted: 15639.46484375, len: 0.0, nonzero: 0.11162611097097397
------ ABL Loop 1 ------
--- eval ---
prediction result:
f1 on test:    0.4822
f1 on test:    0.7498 (micro)
f1 on KB:      0.6256
f1 on orig KB: 0.3290
integrated f1: 0.3575, w_data: 0.2870, w_klg: 0.7130

integrated result:
f1 on test:    0.4723
f1 on test:    0.7474 (micro)
f1 on KB:      0.6392
f1 on orig KB: 0.3297
integrated f1: 0.3570, w_data: 0.2870, w_klg: 0.7130
------------
integrated f1 0.3575

KB before refine:
num_nodes: 5060.0000
num_edges: 4339.0000
density: 0.0002
avg_degree: 0.8575
avg_clustering: 0.0217
degree_assortativity: -0.2053
modularity: 0.8008
avg_betweenness: 0.0000
avg_closeness: 0.0023
Iteration 0: Loss = 2928601.000000
|Xk-Y|_F:  2928601.000000, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 2927529, f1 =  0.319725, approx slack: 2186249
rounded before pow |X_k-Y|_0 = 2927529, f1 =  0.319725

Iteration 20: Loss = 884377.625000
|Xk-Y|_F:  686048.937500, |X-X0|:  198328.687500
rounded |X_k-Y|_0 = 649148, f1 =  0.653595, approx slack: 277857
rounded before pow |X_k-Y|_0 = 905126, f1 =  0.634611

Iteration 40: Loss = 758722.875000
|Xk-Y|_F:  639101.875000, |X-X0|:  119620.984375
rounded |X_k-Y|_0 = 633937, f1 =  0.654766, approx slack: 305154
rounded before pow |X_k-Y|_0 = 910779, f1 =  0.634127

Iteration 60: Loss = 707973.000000
|Xk-Y|_F:  625974.000000, |X-X0|:  81999.015625
rounded |X_k-Y|_0 = 627866, f1 =  0.655234, approx slack: 322809
rounded before pow |X_k-Y|_0 = 918810, f1 =  0.633542

Iteration 80: Loss = 686331.687500
|Xk-Y|_F:  620152.187500, |X-X0|:  66179.500000
rounded |X_k-Y|_0 = 623615, f1 =  0.655568, approx slack: 337067
rounded before pow |X_k-Y|_0 = 930400, f1 =  0.632618

Iteration 100: Loss = 675154.125000
|Xk-Y|_F:  616949.000000, |X-X0|:  58205.148438
rounded |X_k-Y|_0 = 620377, f1 =  0.655819, approx slack: 338190
rounded before pow |X_k-Y|_0 = 930294, f1 =  0.632752

Iteration 120: Loss = 668658.562500
|Xk-Y|_F:  614643.250000, |X-X0|:  54015.335938
rounded |X_k-Y|_0 = 618407, f1 =  0.655973, approx slack: 336605
rounded before pow |X_k-Y|_0 = 926561, f1 =  0.633015

Iteration 140: Loss = 663702.375000
|Xk-Y|_F:  612919.000000, |X-X0|:  50783.386719
rounded |X_k-Y|_0 = 616888, f1 =  0.656091, approx slack: 340502
rounded before pow |X_k-Y|_0 = 929671, f1 =  0.632805

Iteration 160: Loss = 659459.562500
|Xk-Y|_F:  611590.937500, |X-X0|:  47868.617188
rounded |X_k-Y|_0 = 615242, f1 =  0.656220, approx slack: 338289
rounded before pow |X_k-Y|_0 = 925922, f1 =  0.633069

Iteration 180: Loss = 655667.250000
|Xk-Y|_F:  610437.187500, |X-X0|:  45230.085938
rounded |X_k-Y|_0 = 613705, f1 =  0.656340, approx slack: 339421
rounded before pow |X_k-Y|_0 = 925868, f1 =  0.633074

Iteration 200: Loss = 652182.250000
|Xk-Y|_F:  609364.062500, |X-X0|:  42818.210938
rounded |X_k-Y|_0 = 612812, f1 =  0.656410, approx slack: 339987
rounded before pow |X_k-Y|_0 = 925839, f1 =  0.633077

Iteration 220: Loss = 648934.375000
|Xk-Y|_F:  608363.750000, |X-X0|:  40570.601562
rounded |X_k-Y|_0 = 611863, f1 =  0.656484, approx slack: 332991
rounded before pow |X_k-Y|_0 = 918373, f1 =  0.633601

Iteration 240: Loss = 646138.375000
|Xk-Y|_F:  607477.437500, |X-X0|:  38660.968750
rounded |X_k-Y|_0 = 611013, f1 =  0.656551, approx slack: 330653
rounded before pow |X_k-Y|_0 = 915589, f1 =  0.633818

Iteration 260: Loss = 643665.187500
|Xk-Y|_F:  606709.375000, |X-X0|:  36955.820312
rounded |X_k-Y|_0 = 610157, f1 =  0.656617, approx slack: 320786
rounded before pow |X_k-Y|_0 = 905033, f1 =  0.634562

Iteration 280: Loss = 641652.937500
|Xk-Y|_F:  606008.062500, |X-X0|:  35644.847656
rounded |X_k-Y|_0 = 609535, f1 =  0.656666, approx slack: 323211
rounded before pow |X_k-Y|_0 = 906973, f1 =  0.634426

Iteration 300: Loss = 639731.312500
|Xk-Y|_F:  605362.375000, |X-X0|:  34368.937500
rounded |X_k-Y|_0 = 608988, f1 =  0.656709, approx slack: 330685
rounded before pow |X_k-Y|_0 = 913993, f1 =  0.633934

Iteration 320: Loss = 637944.250000
|Xk-Y|_F:  604747.375000, |X-X0|:  33196.890625
rounded |X_k-Y|_0 = 608248, f1 =  0.656767, approx slack: 329134
rounded before pow |X_k-Y|_0 = 911985, f1 =  0.634076

Iteration 340: Loss = 636477.375000
|Xk-Y|_F:  604152.875000, |X-X0|:  32324.531250
rounded |X_k-Y|_0 = 607390, f1 =  0.656834, approx slack: 333499
rounded before pow |X_k-Y|_0 = 915691, f1 =  0.633816

Iteration 360: Loss = 634937.000000
|Xk-Y|_F:  603571.250000, |X-X0|:  31365.761719
rounded |X_k-Y|_0 = 606755, f1 =  0.656884, approx slack: 327030
rounded before pow |X_k-Y|_0 = 908792, f1 =  0.634302

Iteration 380: Loss = 633677.875000
|Xk-Y|_F:  603006.500000, |X-X0|:  30671.390625
rounded |X_k-Y|_0 = 606191, f1 =  0.656928, approx slack: 328436
rounded before pow |X_k-Y|_0 = 909932, f1 =  0.634222

Iteration 400: Loss = 632574.187500
|Xk-Y|_F:  602447.062500, |X-X0|:  30127.109375
rounded |X_k-Y|_0 = 605597, f1 =  0.656975, approx slack: 328885
rounded before pow |X_k-Y|_0 = 909931, f1 =  0.634222

Iteration 420: Loss = 631506.437500
|Xk-Y|_F:  601902.625000, |X-X0|:  29603.828125
rounded |X_k-Y|_0 = 605170, f1 =  0.657008, approx slack: 329198
rounded before pow |X_k-Y|_0 = 909913, f1 =  0.634223

Iteration 440: Loss = 630426.562500
|Xk-Y|_F:  601365.312500, |X-X0|:  29061.269531
rounded |X_k-Y|_0 = 604732, f1 =  0.657043, approx slack: 329405
rounded before pow |X_k-Y|_0 = 909905, f1 =  0.634224

Iteration 460: Loss = 629405.375000
|Xk-Y|_F:  600858.437500, |X-X0|:  28546.953125
rounded |X_k-Y|_0 = 604166, f1 =  0.657090, approx slack: 329842
rounded before pow |X_k-Y|_0 = 909876, f1 =  0.634226

Iteration 480: Loss = 628405.500000
|Xk-Y|_F:  600365.062500, |X-X0|:  28040.433594
rounded |X_k-Y|_0 = 603746, f1 =  0.657124, approx slack: 330110
rounded before pow |X_k-Y|_0 = 909849, f1 =  0.634228

Iteration 500: Loss = 627501.625000
|Xk-Y|_F:  599885.687500, |X-X0|:  27615.912109
rounded |X_k-Y|_0 = 603357, f1 =  0.657154, approx slack: 330293
rounded before pow |X_k-Y|_0 = 909815, f1 =  0.634231

Iteration 520: Loss = 626608.875000
|Xk-Y|_F:  599405.625000, |X-X0|:  27203.226562
rounded |X_k-Y|_0 = 602937, f1 =  0.657190, approx slack: 330525
rounded before pow |X_k-Y|_0 = 909799, f1 =  0.634232

Iteration 540: Loss = 625726.187500
|Xk-Y|_F:  598913.625000, |X-X0|:  26812.542969
rounded |X_k-Y|_0 = 602672, f1 =  0.657221, approx slack: 330735
rounded before pow |X_k-Y|_0 = 909762, f1 =  0.634231

Iteration 560: Loss = 624758.687500
|Xk-Y|_F:  598405.812500, |X-X0|:  26352.894531
rounded |X_k-Y|_0 = 602115, f1 =  0.657266, approx slack: 330963
rounded before pow |X_k-Y|_0 = 909728, f1 =  0.634234

Iteration 580: Loss = 623870.125000
|Xk-Y|_F:  597907.062500, |X-X0|:  25963.078125
rounded |X_k-Y|_0 = 601334, f1 =  0.657327, approx slack: 331614
rounded before pow |X_k-Y|_0 = 909676, f1 =  0.634237

Iteration 600: Loss = 623041.125000
|Xk-Y|_F:  597420.687500, |X-X0|:  25620.433594
rounded |X_k-Y|_0 = 600683, f1 =  0.657379, approx slack: 332025
rounded before pow |X_k-Y|_0 = 909621, f1 =  0.634241

Iteration 620: Loss = 622199.437500
|Xk-Y|_F:  596948.000000, |X-X0|:  25251.437500
rounded |X_k-Y|_0 = 600420, f1 =  0.657400, approx slack: 334306
rounded before pow |X_k-Y|_0 = 911250, f1 =  0.634105

Iteration 640: Loss = 621393.562500
|Xk-Y|_F:  596472.562500, |X-X0|:  24921.021484
rounded |X_k-Y|_0 = 600024, f1 =  0.657431, approx slack: 331509
rounded before pow |X_k-Y|_0 = 908364, f1 =  0.634308

Iteration 660: Loss = 620616.562500
|Xk-Y|_F:  596034.625000, |X-X0|:  24581.939453
rounded |X_k-Y|_0 = 599638, f1 =  0.657462, approx slack: 331337
rounded before pow |X_k-Y|_0 = 908350, f1 =  0.634310

Iteration 680: Loss = 619921.937500
|Xk-Y|_F:  595627.375000, |X-X0|:  24294.542969
rounded |X_k-Y|_0 = 599092, f1 =  0.657505, approx slack: 331844
rounded before pow |X_k-Y|_0 = 908326, f1 =  0.634311

Iteration 700: Loss = 619325.625000
|Xk-Y|_F:  595289.687500, |X-X0|:  24035.941406
rounded |X_k-Y|_0 = 598758, f1 =  0.657531, approx slack: 332179
rounded before pow |X_k-Y|_0 = 908314, f1 =  0.634312

Iteration 720: Loss = 618808.375000
|Xk-Y|_F:  595000.437500, |X-X0|:  23807.929688
rounded |X_k-Y|_0 = 598376, f1 =  0.657561, approx slack: 328192
rounded before pow |X_k-Y|_0 = 904040, f1 =  0.634615

Iteration 740: Loss = 618352.375000
|Xk-Y|_F:  594747.312500, |X-X0|:  23605.033203
rounded |X_k-Y|_0 = 597993, f1 =  0.657591, approx slack: 327415
rounded before pow |X_k-Y|_0 = 903508, f1 =  0.634678

Iteration 760: Loss = 617885.625000
|Xk-Y|_F:  594522.500000, |X-X0|:  23363.132812
rounded |X_k-Y|_0 = 597757, f1 =  0.657610, approx slack: 330438
rounded before pow |X_k-Y|_0 = 906352, f1 =  0.634478

Iteration 780: Loss = 617423.187500
|Xk-Y|_F:  594320.750000, |X-X0|:  23102.417969
rounded |X_k-Y|_0 = 597551, f1 =  0.657626, approx slack: 330488
rounded before pow |X_k-Y|_0 = 906308, f1 =  0.634483

Iteration 800: Loss = 616871.562500
|Xk-Y|_F:  594140.687500, |X-X0|:  22730.867188
rounded |X_k-Y|_0 = 597419, f1 =  0.657637, approx slack: 330035
rounded before pow |X_k-Y|_0 = 905788, f1 =  0.634520

Iteration 820: Loss = 616457.125000
|Xk-Y|_F:  593967.500000, |X-X0|:  22489.623047
rounded |X_k-Y|_0 = 597274, f1 =  0.657648, approx slack: 329995
rounded before pow |X_k-Y|_0 = 905760, f1 =  0.634525

Iteration 840: Loss = 616112.125000
|Xk-Y|_F:  593805.062500, |X-X0|:  22307.078125
rounded |X_k-Y|_0 = 597139, f1 =  0.657659, approx slack: 330028
rounded before pow |X_k-Y|_0 = 905721, f1 =  0.634528

Iteration 860: Loss = 615797.375000
|Xk-Y|_F:  593647.187500, |X-X0|:  22150.175781
rounded |X_k-Y|_0 = 596975, f1 =  0.657672, approx slack: 330059
rounded before pow |X_k-Y|_0 = 905706, f1 =  0.634530

Iteration 880: Loss = 615488.437500
|Xk-Y|_F:  593487.812500, |X-X0|:  22000.634766
rounded |X_k-Y|_0 = 596859, f1 =  0.657681, approx slack: 328495
rounded before pow |X_k-Y|_0 = 904078, f1 =  0.634645

Iteration 900: Loss = 615174.625000
|Xk-Y|_F:  593331.875000, |X-X0|:  21842.761719
rounded |X_k-Y|_0 = 596707, f1 =  0.657694, approx slack: 328565
rounded before pow |X_k-Y|_0 = 904069, f1 =  0.634646

Iteration 920: Loss = 614877.687500
|Xk-Y|_F:  593176.687500, |X-X0|:  21701.015625
rounded |X_k-Y|_0 = 596596, f1 =  0.657702, approx slack: 328586
rounded before pow |X_k-Y|_0 = 904033, f1 =  0.634648

Iteration 940: Loss = 614523.437500
|Xk-Y|_F:  593015.312500, |X-X0|:  21508.125000
rounded |X_k-Y|_0 = 596470, f1 =  0.657713, approx slack: 328537
rounded before pow |X_k-Y|_0 = 903882, f1 =  0.634659

Iteration 960: Loss = 614215.250000
|Xk-Y|_F:  592855.250000, |X-X0|:  21360.023438
rounded |X_k-Y|_0 = 596376, f1 =  0.657721, approx slack: 328536
rounded before pow |X_k-Y|_0 = 903870, f1 =  0.634660

Iteration 980: Loss = 613900.625000
|Xk-Y|_F:  592692.875000, |X-X0|:  21207.767578
rounded |X_k-Y|_0 = 596180, f1 =  0.657736, approx slack: 326201
rounded before pow |X_k-Y|_0 = 901375, f1 =  0.634833

Iteration 1000: Loss = 613548.250000
|Xk-Y|_F:  592526.125000, |X-X0|:  21022.125000
rounded |X_k-Y|_0 = 596044, f1 =  0.657747, approx slack: 327461
rounded before pow |X_k-Y|_0 = 902477, f1 =  0.634751

Iteration 1020: Loss = 613206.000000
|Xk-Y|_F:  592338.500000, |X-X0|:  20867.480469
rounded |X_k-Y|_0 = 595907, f1 =  0.657759, approx slack: 325640
rounded before pow |X_k-Y|_0 = 900079, f1 =  0.634895

Iteration 1040: Loss = 612854.187500
|Xk-Y|_F:  592158.062500, |X-X0|:  20696.132812
rounded |X_k-Y|_0 = 595780, f1 =  0.657769, approx slack: 322131
rounded before pow |X_k-Y|_0 = 900299, f1 =  0.635066

Iteration 1060: Loss = 612508.500000
|Xk-Y|_F:  592035.687500, |X-X0|:  20472.812500
rounded |X_k-Y|_0 = 595608, f1 =  0.657783, approx slack: 321892
rounded before pow |X_k-Y|_0 = 900142, f1 =  0.635084

Iteration 1080: Loss = 612266.312500
|Xk-Y|_F:  591919.687500, |X-X0|:  20346.625000
rounded |X_k-Y|_0 = 595429, f1 =  0.657797, approx slack: 321396
rounded before pow |X_k-Y|_0 = 899587, f1 =  0.635124

Iteration 1100: Loss = 612005.125000
|Xk-Y|_F:  591801.125000, |X-X0|:  20204.000000
rounded |X_k-Y|_0 = 595333, f1 =  0.657804, approx slack: 321339
rounded before pow |X_k-Y|_0 = 899533, f1 =  0.635128

Iteration 1120: Loss = 611785.812500
|Xk-Y|_F:  591693.750000, |X-X0|:  20092.074219
rounded |X_k-Y|_0 = 595202, f1 =  0.657815, approx slack: 321323
rounded before pow |X_k-Y|_0 = 899453, f1 =  0.635133

Iteration 1140: Loss = 611554.187500
|Xk-Y|_F:  591590.000000, |X-X0|:  19964.197266
rounded |X_k-Y|_0 = 595024, f1 =  0.657829, approx slack: 320862
rounded before pow |X_k-Y|_0 = 899084, f1 =  0.635160

Iteration 1160: Loss = 611343.437500
|Xk-Y|_F:  591487.375000, |X-X0|:  19856.046875
rounded |X_k-Y|_0 = 594922, f1 =  0.657837, approx slack: 321150
rounded before pow |X_k-Y|_0 = 899325, f1 =  0.635143

Iteration 1180: Loss = 611116.625000
|Xk-Y|_F:  591381.375000, |X-X0|:  19735.228516
rounded |X_k-Y|_0 = 594797, f1 =  0.657846, approx slack: 321709
rounded before pow |X_k-Y|_0 = 899843, f1 =  0.635106

Iteration 1200: Loss = 610909.937500
|Xk-Y|_F:  591284.750000, |X-X0|:  19625.187500
rounded |X_k-Y|_0 = 594654, f1 =  0.657858, approx slack: 321675
rounded before pow |X_k-Y|_0 = 899785, f1 =  0.635110

Iteration 1220: Loss = 610637.312500
|Xk-Y|_F:  591188.562500, |X-X0|:  19448.753906
rounded |X_k-Y|_0 = 594564, f1 =  0.657865, approx slack: 321748
rounded before pow |X_k-Y|_0 = 899794, f1 =  0.635110

Iteration 1240: Loss = 610400.437500
|Xk-Y|_F:  591088.875000, |X-X0|:  19311.546875
rounded |X_k-Y|_0 = 594433, f1 =  0.657875, approx slack: 321744
rounded before pow |X_k-Y|_0 = 899786, f1 =  0.635110

Iteration 1260: Loss = 610216.312500
|Xk-Y|_F:  590995.687500, |X-X0|:  19220.628906
rounded |X_k-Y|_0 = 594287, f1 =  0.657887, approx slack: 317878
rounded before pow |X_k-Y|_0 = 895947, f1 =  0.635382

Iteration 1280: Loss = 610030.062500
|Xk-Y|_F:  590900.375000, |X-X0|:  19129.716797
rounded |X_k-Y|_0 = 594175, f1 =  0.657896, approx slack: 317924
rounded before pow |X_k-Y|_0 = 895834, f1 =  0.635391

Converged at iteration 1288

KB after refine:
num_nodes: 5060.0000
num_edges: 4318.0000
density: 0.0002
avg_degree: 0.8534
avg_clustering: 0.0213
degree_assortativity: -0.1614
modularity: 0.7901
avg_betweenness: 0.0000
avg_closeness: 0.0027
------ ABL 1 after refine ------
--- eval ---
prediction result:
f1 on test:    0.4822
f1 on test:    0.7498 (micro)
f1 on KB:      0.6386
f1 on orig KB: 0.3290
integrated f1: 0.3575, w_data: 0.2870, w_klg: 0.7130

integrated result:
f1 on test:    0.4728
f1 on test:    0.7474 (micro)
f1 on KB:      0.6506
f1 on orig KB: 0.3292
integrated f1: 0.3566, w_data: 0.2870, w_klg: 0.7130
------------
integrated f1 0.3575
