MLP_eco_Sep3_4
log/EGOAL-eco-2025-09-04-07:27:54.804551.txt
random seed: 114
train shape: torch.Size([434, 1514]), test shape: torch.Size([72, 1514])
cuda availability: True
/home/u-xiangyf/anaconda3/envs/egoal/lib/python3.13/site-packages/torch/nn/modules/loss.py:608: UserWarning: Using a target size (torch.Size([1514])) that is different to the input size (torch.Size([4639, 1514])). This will likely lead to incorrect results due to broadcasting. Please ensure they have the same size.
  return F.mse_loss(input, target, reduction=self.reduction)
Epoch 0, Loss: 0.2183
Epoch 100, Loss: 0.2120
Epoch 200, Loss: 0.2058
Epoch 300, Loss: 0.1997
Epoch 400, Loss: 0.1938
Epoch 500, Loss: 0.1881
Epoch 600, Loss: 0.1824
Epoch 700, Loss: 0.1770
Epoch 800, Loss: 0.1716
Epoch 900, Loss: 0.1665
Final loss: 0.16145059466362
Achieved outputs: tensor([[0.4087, 0.4366, 0.4430,  ..., 0.4114, 0.4328, 0.4300],
        [0.4084, 0.4363, 0.4428,  ..., 0.4111, 0.4326, 0.4297],
        [0.4087, 0.4364, 0.4430,  ..., 0.4113, 0.4327, 0.4297],
        ...,
        [0.4087, 0.4364, 0.4430,  ..., 0.4113, 0.4325, 0.4295],
        [0.4084, 0.4365, 0.4432,  ..., 0.4115, 0.4326, 0.4300],
        [0.4087, 0.4366, 0.4429,  ..., 0.4114, 0.4329, 0.4299]],
       device='cuda:6')
Eval weight w_data: 0.4246200244007528
Before pretrain: integrated f1 0.2367
Epoch 100, Total loss: -7911006.5000, CE loss: 7.4103, RL loss: -791101.3750, Reward: -139688.3086
    full cols: 162, non-full cols: 0
   r - labels: 1, labels - r: 0
    violated: 12640, weighted: 0.33303070068359375, len: 0.0, nonzero: 0.10700132697820663
Epoch 200, Total loss: 1222873.2500, CE loss: 7.1446, RL loss: 122286.6094, Reward: -138287.9824
    full cols: 162, non-full cols: 0
   r - labels: 1, labels - r: 0
    violated: 13069, weighted: 0.33303070068359375, len: 0.0, nonzero: 0.10700132697820663
Epoch 300, Total loss: 2568957.5000, CE loss: 6.9205, RL loss: 256895.0625, Reward: -137794.9053
    full cols: 162, non-full cols: 0
   r - labels: 1, labels - r: 0
    violated: 11347, weighted: 0.33303070068359375, len: 0.0, nonzero: 0.10700132697820663
Epoch 400, Total loss: 14709258.0000, CE loss: 6.7702, RL loss: 1470925.1250, Reward: -137000.0195
    full cols: 162, non-full cols: 0
   r - labels: 1, labels - r: 0
    violated: 8767, weighted: 0.33303070068359375, len: 0.0, nonzero: 0.10700132697820663
Epoch 500, Total loss: 8503373.0000, CE loss: 6.6799, RL loss: 850336.5625, Reward: -135976.8555
    full cols: 161, non-full cols: 1
   r - labels: 1, labels - r: 0
    violated: 12119, weighted: 0.32262349128723145, len: 0.0, nonzero: 0.10698068141937256
------ Before ABL ------
--- eval ---
prediction result:
f1 on test:    0.3309
f1 on test:    0.6642 (micro)
f1 on KB:      0.3368
integrated f1: 0.3343, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3607
f1 on test:    0.6733 (micro)
f1 on KB:      0.5271
integrated f1: 0.4565, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3343

Epoch 100, Total loss: 62884588.0000, CE loss: 4.5587, RL loss: 628845.8750, Reward: -96565.1875
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 10393, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 200, Total loss: 72157128.0000, CE loss: 4.5033, RL loss: 721571.2500, Reward: -95912.1934
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 8750, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 300, Total loss: 73682984.0000, CE loss: 4.4241, RL loss: 736829.8750, Reward: -95099.1406
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 8033, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 400, Total loss: -44414080.0000, CE loss: 4.3385, RL loss: -444140.8125, Reward: -94165.8438
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 7515, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 500, Total loss: 234638368.0000, CE loss: 4.2344, RL loss: 2346383.7500, Reward: -91140.8379
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 7311, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 600, Total loss: 103299560.0000, CE loss: 4.1010, RL loss: 1032995.5625, Reward: -87829.5156
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 6537, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 700, Total loss: 84904584.0000, CE loss: 3.9253, RL loss: 849045.8125, Reward: -81046.5771
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 7313, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 800, Total loss: 301697440.0000, CE loss: 3.7623, RL loss: 3016974.5000, Reward: -70017.4072
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 8634, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 900, Total loss: 88863312.0000, CE loss: 3.6742, RL loss: 888633.1250, Reward: -63124.3730
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 8489, weighted: 1.7954750061035156, len: 0.0, nonzero: 0.10501981526613235
Epoch 1000, Total loss: 41397072.0000, CE loss: 3.6355, RL loss: 413970.7188, Reward: -59754.5781
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 9615, weighted: 1.7954750061035156, len: 0.0, nonzero: 0.10501981526613235
Epoch 1100, Total loss: 2684090.7500, CE loss: 3.6122, RL loss: 26840.9082, Reward: -58406.7656
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 8775, weighted: 1.7954750061035156, len: 0.0, nonzero: 0.10501981526613235
Epoch 1200, Total loss: 81747928.0000, CE loss: 3.5865, RL loss: 817479.2500, Reward: -57118.9902
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 7326, weighted: 1.7954750061035156, len: 0.0, nonzero: 0.10501981526613235
Epoch 1300, Total loss: -33443578.0000, CE loss: 3.5838, RL loss: -334435.7812, Reward: -56498.0117
    full cols: 158, non-full cols: 0
   r - labels: 0, labels - r: 3
    violated: 9026, weighted: 2.6208152770996094, len: 0.0, nonzero: 0.10435931384563446
Epoch 1400, Total loss: -27107050.0000, CE loss: 3.5583, RL loss: -271070.5000, Reward: -55880.6992
    full cols: 158, non-full cols: 0
   r - labels: 0, labels - r: 3
    violated: 9743, weighted: 2.6208152770996094, len: 0.0, nonzero: 0.10435931384563446
Epoch 1500, Total loss: -20977532.0000, CE loss: 3.5628, RL loss: -209775.3125, Reward: -55364.1631
    full cols: 158, non-full cols: 0
   r - labels: 0, labels - r: 3
    violated: 8735, weighted: 2.6208152770996094, len: 0.0, nonzero: 0.10435931384563446
Epoch 1600, Total loss: 24739618.0000, CE loss: 3.5450, RL loss: 247396.1875, Reward: -54766.6865
    full cols: 158, non-full cols: 1
   r - labels: 0, labels - r: 2
    violated: 8145, weighted: 1.8194571733474731, len: 0.0, nonzero: 0.10483404994010925
Epoch 1700, Total loss: 33302782.0000, CE loss: 3.5432, RL loss: 333027.8125, Reward: -54412.8838
    full cols: 158, non-full cols: 0
   r - labels: 0, labels - r: 3
    violated: 7502, weighted: 2.6208152770996094, len: 0.0, nonzero: 0.10435931384563446
Epoch 1800, Total loss: -31291078.0000, CE loss: 3.5326, RL loss: -312910.7812, Reward: -54504.1162
    full cols: 159, non-full cols: 0
   r - labels: 1, labels - r: 3
    violated: 7788, weighted: 3.9674224853515625, len: 0.0, nonzero: 0.10501981526613235
Epoch 1900, Total loss: -111249512.0000, CE loss: 3.5109, RL loss: -1112495.1250, Reward: -54622.0615
    full cols: 159, non-full cols: 0
   r - labels: 1, labels - r: 3
    violated: 11163, weighted: 3.9674224853515625, len: 0.0, nonzero: 0.10501981526613235
--- eval ---
prediction result:
f1 on test:    0.3575
f1 on test:    0.6631 (micro)
f1 on KB:      0.3587
integrated f1: 0.3583, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3621
f1 on test:    0.6735 (micro)
f1 on KB:      0.5229
integrated f1: 0.4747, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: -24439082.0000, CE loss: 3.5215, RL loss: -244390.8125, Reward: -54204.4238
    full cols: 158, non-full cols: 1
   r - labels: 0, labels - r: 2
    violated: 7025, weighted: 2.530543804168701, len: 0.0, nonzero: 0.10443156212568283
Epoch 2100, Total loss: -103799384.0000, CE loss: 3.5119, RL loss: -1037993.8750, Reward: -54407.7246
    full cols: 158, non-full cols: 0
   r - labels: 0, labels - r: 3
    violated: 9297, weighted: 2.6208152770996094, len: 0.0, nonzero: 0.10435931384563446
Epoch 2200, Total loss: -54917100.0000, CE loss: 3.4872, RL loss: -549171.0000, Reward: -54181.1406
    full cols: 158, non-full cols: 1
   r - labels: 0, labels - r: 2
    violated: 8481, weighted: 1.9373303651809692, len: 0.0, nonzero: 0.10490629822015762
Epoch 2300, Total loss: 93098304.0000, CE loss: 3.4989, RL loss: 930983.0000, Reward: -53847.1836
    full cols: 158, non-full cols: 0
   r - labels: 0, labels - r: 3
    violated: 7986, weighted: 2.6208152770996094, len: 0.0, nonzero: 0.10435931384563446
Epoch 2400, Total loss: 54585288.0000, CE loss: 3.4891, RL loss: 545852.8750, Reward: -53877.0156
    full cols: 158, non-full cols: 0
   r - labels: 0, labels - r: 3
    violated: 9324, weighted: 2.6208152770996094, len: 0.0, nonzero: 0.10435931384563446
Epoch 2500, Total loss: -7444785.0000, CE loss: 3.4782, RL loss: -74447.8516, Reward: -53979.4297
    full cols: 159, non-full cols: 0
   r - labels: 1, labels - r: 3
    violated: 9057, weighted: 3.9674224853515625, len: 0.0, nonzero: 0.10501981526613235
Epoch 2600, Total loss: 39526820.0000, CE loss: 3.4676, RL loss: 395268.2188, Reward: -53999.9043
    full cols: 160, non-full cols: 0
   r - labels: 2, labels - r: 3
    violated: 9137, weighted: 35.96742248535156, len: 0.0, nonzero: 0.10568031668663025
Epoch 2700, Total loss: 6716997.5000, CE loss: 3.4634, RL loss: 67169.9766, Reward: -54071.5605
    full cols: 160, non-full cols: 1
   r - labels: 2, labels - r: 2
    violated: 9127, weighted: 35.671268463134766, len: 0.0, nonzero: 0.10585576295852661
Epoch 2800, Total loss: 131094072.0000, CE loss: 3.4550, RL loss: 1310940.7500, Reward: -53787.9043
    full cols: 160, non-full cols: 1
   r - labels: 2, labels - r: 2
    violated: 9583, weighted: 35.932579040527344, len: 0.0, nonzero: 0.10570096224546432
Epoch 2900, Total loss: -128255200.0000, CE loss: 3.4489, RL loss: -1282552.0000, Reward: -54347.4434
    full cols: 160, non-full cols: 2
   r - labels: 3, labels - r: 2
    violated: 8709, weighted: 36.22918701171875, len: 0.0, nonzero: 0.10628922283649445
Epoch 3000, Total loss: -79282272.0000, CE loss: 3.4393, RL loss: -792822.6875, Reward: -54289.6455
    full cols: 161, non-full cols: 0
   r - labels: 3, labels - r: 3
    violated: 7440, weighted: 36.300453186035156, len: 0.0, nonzero: 0.10634082555770874
Epoch 3100, Total loss: -14511373.0000, CE loss: 3.4238, RL loss: -145113.7344, Reward: -54223.7793
    full cols: 160, non-full cols: 0
   r - labels: 2, labels - r: 3
    violated: 8169, weighted: 35.96742248535156, len: 0.0, nonzero: 0.10568031668663025
Epoch 3200, Total loss: -16232100.0000, CE loss: 3.4162, RL loss: -162321.0000, Reward: -54223.3213
    full cols: 160, non-full cols: 0
   r - labels: 2, labels - r: 3
    violated: 10747, weighted: 35.96742248535156, len: 0.0, nonzero: 0.10568031668663025
Epoch 3300, Total loss: 23237360.0000, CE loss: 3.4059, RL loss: 232373.5938, Reward: -54081.5811
    full cols: 160, non-full cols: 0
   r - labels: 2, labels - r: 3
    violated: 11591, weighted: 35.96742248535156, len: 0.0, nonzero: 0.10568031668663025
Epoch 3400, Total loss: 92747328.0000, CE loss: 3.4059, RL loss: 927473.2500, Reward: -53931.1387
    full cols: 160, non-full cols: 2
   r - labels: 3, labels - r: 2
    violated: 9245, weighted: 37.13009262084961, len: 0.0, nonzero: 0.10602089017629623
Epoch 3500, Total loss: 34252968.0000, CE loss: 3.4014, RL loss: 342529.6875, Reward: -54076.3750
    full cols: 161, non-full cols: 0
   r - labels: 3, labels - r: 3
    violated: 6498, weighted: 36.879638671875, len: 0.0, nonzero: 0.10634082555770874
Epoch 3600, Total loss: 1367094.5000, CE loss: 3.3914, RL loss: 13670.9453, Reward: -54330.5771
    full cols: 160, non-full cols: 2
   r - labels: 4, labels - r: 3
    violated: 8795, weighted: 48.55406951904297, len: 0.0, nonzero: 0.1059589684009552
Epoch 3700, Total loss: -30251024.0000, CE loss: 3.3796, RL loss: -302510.2500, Reward: -54459.4873
    full cols: 160, non-full cols: 1
   r - labels: 3, labels - r: 3
    violated: 9733, weighted: 41.03302764892578, len: 0.0, nonzero: 0.10579384118318558
Epoch 3800, Total loss: 26089424.0000, CE loss: 3.3705, RL loss: 260894.2500, Reward: -54339.7100
    full cols: 161, non-full cols: 1
   r - labels: 4, labels - r: 3
    violated: 10242, weighted: 77.53303527832031, len: 0.0, nonzero: 0.10654722899198532
Epoch 3900, Total loss: 73081272.0000, CE loss: 3.3550, RL loss: 730812.7500, Reward: -54117.1709
    full cols: 161, non-full cols: 0
   r - labels: 3, labels - r: 3
    violated: 7199, weighted: 68.40180969238281, len: 0.0, nonzero: 0.10634082555770874
--- eval ---
prediction result:
f1 on test:    0.3780
f1 on test:    0.6593 (micro)
f1 on KB:      0.3715
integrated f1: 0.3734, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3608
f1 on test:    0.6731 (micro)
f1 on KB:      0.5266
integrated f1: 0.4769, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: -183875280.0000, CE loss: 3.3497, RL loss: -1838752.8750, Reward: -54798.9268
    full cols: 161, non-full cols: 0
   r - labels: 3, labels - r: 3
    violated: 8643, weighted: 55.268775939941406, len: 0.0, nonzero: 0.10634082555770874
Epoch 4100, Total loss: -1191976.8750, CE loss: 3.3417, RL loss: -11919.7686, Reward: -54362.3838
    full cols: 162, non-full cols: 1
   r - labels: 5, labels - r: 3
    violated: 8572, weighted: 94.26876831054688, len: 0.0, nonzero: 0.10714580863714218
Epoch 4200, Total loss: -1882794.5000, CE loss: 3.3241, RL loss: -18827.9453, Reward: -54274.5625
    full cols: 161, non-full cols: 0
   r - labels: 3, labels - r: 3
    violated: 7945, weighted: 68.40180969238281, len: 0.0, nonzero: 0.10634082555770874
Epoch 4300, Total loss: -41111416.0000, CE loss: 3.3184, RL loss: -411114.1562, Reward: -54469.0537
    full cols: 162, non-full cols: 1
   r - labels: 5, labels - r: 3
    violated: 9601, weighted: 105.26876831054688, len: 0.0, nonzero: 0.10737285763025284
Epoch 4400, Total loss: 88767760.0000, CE loss: 3.3078, RL loss: 887677.5625, Reward: -54051.6621
    full cols: 161, non-full cols: 1
   r - labels: 4, labels - r: 3
    violated: 10389, weighted: 88.93574523925781, len: 0.0, nonzero: 0.1063821017742157
Epoch 4500, Total loss: -14071262.0000, CE loss: 3.2983, RL loss: -140712.6250, Reward: -54413.5283
    full cols: 163, non-full cols: 1
   r - labels: 6, labels - r: 3
    violated: 7266, weighted: 149.26876831054688, len: 0.0, nonzero: 0.10828104615211487
Epoch 4600, Total loss: -23261764.0000, CE loss: 3.2861, RL loss: -232617.6406, Reward: -54336.9639
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 9258, weighted: 121.91854858398438, len: 0.0, nonzero: 0.10832232981920242
Epoch 4700, Total loss: 10959684.0000, CE loss: 3.2746, RL loss: 109596.8359, Reward: -54155.9307
    full cols: 165, non-full cols: 0
   r - labels: 7, labels - r: 3
    violated: 10347, weighted: 153.91854858398438, len: 0.0, nonzero: 0.10898283123970032
Epoch 4800, Total loss: -10445704.0000, CE loss: 3.2625, RL loss: -104457.0391, Reward: -54183.1484
    full cols: 164, non-full cols: 1
   r - labels: 7, labels - r: 3
    violated: 9563, weighted: 151.41854858398438, len: 0.0, nonzero: 0.10893122851848602
Epoch 4900, Total loss: -33328804.0000, CE loss: 3.2453, RL loss: -333288.0312, Reward: -54193.7129
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 8345, weighted: 121.91854858398438, len: 0.0, nonzero: 0.10832232981920242
Epoch 5000, Total loss: 34883208.0000, CE loss: 3.2294, RL loss: 348832.0625, Reward: -54069.0020
    full cols: 165, non-full cols: 1
   r - labels: 8, labels - r: 3
    violated: 8069, weighted: 183.91854858398438, len: 0.0, nonzero: 0.10960204899311066
Epoch 5100, Total loss: -27951076.0000, CE loss: 3.2252, RL loss: -279510.7500, Reward: -54175.2168
    full cols: 166, non-full cols: 0
   r - labels: 8, labels - r: 3
    violated: 8490, weighted: 185.91854858398438, len: 0.0, nonzero: 0.10964333266019821
Epoch 5200, Total loss: 130037448.0000, CE loss: 3.2152, RL loss: 1300374.5000, Reward: -53745.8623
    full cols: 164, non-full cols: 1
   r - labels: 7, labels - r: 3
    violated: 7431, weighted: 167.78326416015625, len: 0.0, nonzero: 0.10854937881231308
Epoch 5300, Total loss: -35449488.0000, CE loss: 3.2027, RL loss: -354494.8750, Reward: -54126.8799
    full cols: 163, non-full cols: 0
   r - labels: 6, labels - r: 4
    violated: 10117, weighted: 136.16650390625, len: 0.0, nonzero: 0.10766182839870453
Epoch 5400, Total loss: -5628748.0000, CE loss: 3.1879, RL loss: -56287.4805, Reward: -54100.2031
    full cols: 163, non-full cols: 1
   r - labels: 7, labels - r: 4
    violated: 8781, weighted: 178.38369750976562, len: 0.0, nonzero: 0.10819848626852036
Epoch 5500, Total loss: 20443308.0000, CE loss: 3.1767, RL loss: 204433.0781, Reward: -53996.1553
    full cols: 164, non-full cols: 2
   r - labels: 8, labels - r: 3
    violated: 9761, weighted: 148.83935546875, len: 0.0, nonzero: 0.10888994485139847
Epoch 5600, Total loss: 2539975.0000, CE loss: 3.1679, RL loss: 25399.7500, Reward: -54010.1396
    full cols: 163, non-full cols: 1
   r - labels: 6, labels - r: 3
    violated: 8112, weighted: 122.15995788574219, len: 0.0, nonzero: 0.10800239443778992
Epoch 5700, Total loss: 79832440.0000, CE loss: 3.1567, RL loss: 798324.4375, Reward: -53929.1006
    full cols: 163, non-full cols: 1
   r - labels: 7, labels - r: 4
    violated: 9699, weighted: 105.70179748535156, len: 0.0, nonzero: 0.10780631005764008
Epoch 5800, Total loss: -24360270.0000, CE loss: 3.1507, RL loss: -243602.7031, Reward: -54212.5908
    full cols: 163, non-full cols: 0
   r - labels: 5, labels - r: 3
    violated: 7636, weighted: 58.68597412109375, len: 0.0, nonzero: 0.10766182839870453
Epoch 5900, Total loss: 45818048.0000, CE loss: 3.1412, RL loss: 458180.5000, Reward: -54057.8418
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 8641, weighted: 94.30587768554688, len: 0.0, nonzero: 0.10832232981920242
--- eval ---
prediction result:
f1 on test:    0.3869
f1 on test:    0.6478 (micro)
f1 on KB:      0.3710
integrated f1: 0.3755, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3608
f1 on test:    0.6724 (micro)
f1 on KB:      0.5275
integrated f1: 0.4775, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: 69410496.0000, CE loss: 3.1315, RL loss: 694105.0000, Reward: -53966.0205
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 8077, weighted: 94.30587768554688, len: 0.0, nonzero: 0.10832232981920242
Epoch 6100, Total loss: 19060598.0000, CE loss: 3.1285, RL loss: 190605.9844, Reward: -54020.4150
    full cols: 164, non-full cols: 1
   r - labels: 6, labels - r: 2
    violated: 8412, weighted: 90.66854858398438, len: 0.0, nonzero: 0.10833264887332916
Epoch 6200, Total loss: 97556496.0000, CE loss: 3.1233, RL loss: 975564.9375, Reward: -53821.3770
    full cols: 166, non-full cols: 1
   r - labels: 8, labels - r: 2
    violated: 7910, weighted: 101.00248718261719, len: 0.0, nonzero: 0.10990133881568909
Epoch 6300, Total loss: -23455356.0000, CE loss: 3.1184, RL loss: -234553.5625, Reward: -54270.3691
    full cols: 166, non-full cols: 0
   r - labels: 8, labels - r: 3
    violated: 9519, weighted: 122.33845520019531, len: 0.0, nonzero: 0.10964333266019821
Epoch 6400, Total loss: -125418072.0000, CE loss: 3.1145, RL loss: -1254180.7500, Reward: -54471.7031
    full cols: 166, non-full cols: 0
   r - labels: 7, labels - r: 2
    violated: 10414, weighted: 63.88416290283203, len: 0.0, nonzero: 0.10964333266019821
Epoch 6500, Total loss: 107170176.0000, CE loss: 3.1123, RL loss: 1071701.7500, Reward: -53865.1699
    full cols: 166, non-full cols: 1
   r - labels: 8, labels - r: 2
    violated: 8353, weighted: 102.91108703613281, len: 0.0, nonzero: 0.11012838780879974
Epoch 6600, Total loss: 87007752.0000, CE loss: 3.1112, RL loss: 870077.5000, Reward: -54049.4004
    full cols: 166, non-full cols: 1
   r - labels: 9, labels - r: 3
    violated: 8623, weighted: 154.13551330566406, len: 0.0, nonzero: 0.10990133881568909
Epoch 6700, Total loss: 20044416.0000, CE loss: 3.1084, RL loss: 200444.1562, Reward: -54272.4199
    full cols: 166, non-full cols: 2
   r - labels: 9, labels - r: 2
    violated: 8331, weighted: 150.09841918945312, len: 0.0, nonzero: 0.11027287691831589
Epoch 6800, Total loss: 82771720.0000, CE loss: 3.1075, RL loss: 827717.1875, Reward: -54123.4629
    full cols: 164, non-full cols: 2
   r - labels: 8, labels - r: 3
    violated: 9213, weighted: 121.66607666015625, len: 0.0, nonzero: 0.10883834213018417
Epoch 6900, Total loss: -23215366.0000, CE loss: 3.1051, RL loss: -232153.6562, Reward: -54386.2461
    full cols: 162, non-full cols: 1
   r - labels: 5, labels - r: 3
    violated: 7662, weighted: 84.47081756591797, len: 0.0, nonzero: 0.10738317668437958
Epoch 7000, Total loss: 121395904.0000, CE loss: 3.1056, RL loss: 1213959.0000, Reward: -53950.3594
    full cols: 164, non-full cols: 3
   r - labels: 9, labels - r: 3
    violated: 11822, weighted: 160.11289978027344, len: 0.0, nonzero: 0.10977749526500702
Epoch 7100, Total loss: 9272403.0000, CE loss: 3.1044, RL loss: 92724.0312, Reward: -54274.3096
    full cols: 166, non-full cols: 1
   r - labels: 9, labels - r: 3
    violated: 8522, weighted: 167.7298583984375, len: 0.0, nonzero: 0.11008710414171219
Epoch 7200, Total loss: 126605976.0000, CE loss: 3.1038, RL loss: 1266059.7500, Reward: -54144.6787
    full cols: 165, non-full cols: 1
   r - labels: 8, labels - r: 3
    violated: 9603, weighted: 140.2298583984375, len: 0.0, nonzero: 0.10951948910951614
Epoch 7300, Total loss: 102702272.0000, CE loss: 3.1028, RL loss: 1027022.6875, Reward: -54163.1113
    full cols: 164, non-full cols: 1
   r - labels: 7, labels - r: 3
    violated: 10324, weighted: 125.88325500488281, len: 0.0, nonzero: 0.10859065502882004
Epoch 7400, Total loss: 39478664.0000, CE loss: 3.1017, RL loss: 394786.6562, Reward: -54319.7900
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 7936, weighted: 112.88325500488281, len: 0.0, nonzero: 0.10832232981920242
Epoch 7500, Total loss: -76050248.0000, CE loss: 3.1023, RL loss: -760502.5000, Reward: -54608.1953
    full cols: 166, non-full cols: 1
   r - labels: 9, labels - r: 3
    violated: 10729, weighted: 133.6466064453125, len: 0.0, nonzero: 0.1097981408238411
Epoch 7600, Total loss: 17966948.0000, CE loss: 3.1016, RL loss: 179669.4844, Reward: -54296.6162
    full cols: 164, non-full cols: 3
   r - labels: 9, labels - r: 3
    violated: 9263, weighted: 139.6889190673828, len: 0.0, nonzero: 0.10894154757261276
Epoch 7700, Total loss: -79424800.0000, CE loss: 3.1037, RL loss: -794248.0000, Reward: -54537.6133
    full cols: 165, non-full cols: 0
   r - labels: 7, labels - r: 3
    violated: 10445, weighted: 144.88327026367188, len: 0.0, nonzero: 0.10898283123970032
Epoch 7800, Total loss: 94716088.0000, CE loss: 3.1000, RL loss: 947160.8750, Reward: -54085.4141
    full cols: 166, non-full cols: 0
   r - labels: 7, labels - r: 2
    violated: 8296, weighted: 143.18914794921875, len: 0.0, nonzero: 0.10964333266019821
Epoch 7900, Total loss: -121690976.0000, CE loss: 3.1001, RL loss: -1216909.7500, Reward: -54609.0410
    full cols: 169, non-full cols: 1
   r - labels: 11, labels - r: 2
    violated: 7560, weighted: 260.4949951171875, len: 0.0, nonzero: 0.11209957301616669
--- eval ---
prediction result:
f1 on test:    0.3871
f1 on test:    0.6445 (micro)
f1 on KB:      0.3710
integrated f1: 0.3756, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3612
f1 on test:    0.6724 (micro)
f1 on KB:      0.5278
integrated f1: 0.4778, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: -48530852.0000, CE loss: 3.0996, RL loss: -485308.5312, Reward: -54395.4971
    full cols: 166, non-full cols: 2
   r - labels: 9, labels - r: 2
    violated: 8531, weighted: 176.98370361328125, len: 0.0, nonzero: 0.11094369739294052
------ ABL Loop 0 ------
--- eval ---
prediction result:
f1 on test:    0.3871
f1 on test:    0.6445 (micro)
f1 on KB:      0.3710
integrated f1: 0.3776, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3612
f1 on test:    0.6724 (micro)
f1 on KB:      0.5278
integrated f1: 0.4570, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3776
Iteration 0: Loss = 128640.414062
|Xk-Y|_F:  128640.414062, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 112809, f1 =  0.314900, approx slack: 1004
rounded before pow |X_k-Y|_0 = 112809, f1 =  0.314900

Iteration 20: Loss = 128159.445312
|Xk-Y|_F:  127214.218750, |X-X0|:  945.225464
rounded |X_k-Y|_0 = 112417, f1 =  0.317427, approx slack: 249
rounded before pow |X_k-Y|_0 = 112452, f1 =  0.317202

Iteration 40: Loss = 126380.765625
|Xk-Y|_F:  126141.945312, |X-X0|:  238.823898
rounded |X_k-Y|_0 = 112411, f1 =  0.317465, approx slack: 217
rounded before pow |X_k-Y|_0 = 112419, f1 =  0.317414

Iteration 60: Loss = 125054.515625
|Xk-Y|_F:  124936.015625, |X-X0|:  118.499138
rounded |X_k-Y|_0 = 112418, f1 =  0.317420, approx slack: 141
rounded before pow |X_k-Y|_0 = 112421, f1 =  0.317401

Iteration 80: Loss = 123645.093750
|Xk-Y|_F:  123541.007812, |X-X0|:  104.087021
rounded |X_k-Y|_0 = 112419, f1 =  0.317414, approx slack: 146
rounded before pow |X_k-Y|_0 = 112423, f1 =  0.317388

Iteration 100: Loss = 122048.867188
|Xk-Y|_F:  121943.804688, |X-X0|:  105.060455
rounded |X_k-Y|_0 = 112369, f1 =  0.317541, approx slack: 301
rounded before pow |X_k-Y|_0 = 112288, f1 =  0.318254

Iteration 120: Loss = 120226.820312
|Xk-Y|_F:  120119.929688, |X-X0|:  106.888725
rounded |X_k-Y|_0 = 102647, f1 =  0.324616, approx slack: 12579
rounded before pow |X_k-Y|_0 = 112288, f1 =  0.318254

Iteration 140: Loss = 118129.351562
|Xk-Y|_F:  118020.218750, |X-X0|:  109.136681
rounded |X_k-Y|_0 = 102643, f1 =  0.324626, approx slack: 24019
rounded before pow |X_k-Y|_0 = 112288, f1 =  0.318254

Iteration 160: Loss = 115688.296875
|Xk-Y|_F:  115579.625000, |X-X0|:  108.669106
rounded |X_k-Y|_0 = 102648, f1 =  0.324590, approx slack: 25230
rounded before pow |X_k-Y|_0 = 112288, f1 =  0.318254

Iteration 180: Loss = 112814.406250
|Xk-Y|_F:  112706.257812, |X-X0|:  108.150124
rounded |X_k-Y|_0 = 101768, f1 =  0.325160, approx slack: 27622
rounded before pow |X_k-Y|_0 = 112285, f1 =  0.318274

Iteration 200: Loss = 109397.273438
|Xk-Y|_F:  109289.078125, |X-X0|:  108.191704
rounded |X_k-Y|_0 = 97136, f1 =  0.328735, approx slack: 34326
rounded before pow |X_k-Y|_0 = 112696, f1 =  0.318243

Iteration 220: Loss = 105304.781250
|Xk-Y|_F:  105193.625000, |X-X0|:  111.155426
rounded |X_k-Y|_0 = 94965, f1 =  0.330486, approx slack: 41342
rounded before pow |X_k-Y|_0 = 112696, f1 =  0.318243

Iteration 240: Loss = 100342.531250
|Xk-Y|_F:  100229.960938, |X-X0|:  112.570282
rounded |X_k-Y|_0 = 91391, f1 =  0.333311, approx slack: 50118
rounded before pow |X_k-Y|_0 = 113050, f1 =  0.318127

Iteration 260: Loss = 94219.804688
|Xk-Y|_F:  94103.109375, |X-X0|:  116.695053
rounded |X_k-Y|_0 = 86440, f1 =  0.337436, approx slack: 60894
rounded before pow |X_k-Y|_0 = 113279, f1 =  0.318094

Iteration 280: Loss = 86636.890625
|Xk-Y|_F:  86512.851562, |X-X0|:  124.035828
rounded |X_k-Y|_0 = 80260, f1 =  0.342811, approx slack: 81322
rounded before pow |X_k-Y|_0 = 115517, f1 =  0.317428

Iteration 300: Loss = 77601.335938
|Xk-Y|_F:  77472.640625, |X-X0|:  128.697083
rounded |X_k-Y|_0 = 72960, f1 =  0.349930, approx slack: 100763
rounded before pow |X_k-Y|_0 = 115977, f1 =  0.317412

Iteration 320: Loss = 67728.312500
|Xk-Y|_F:  67595.156250, |X-X0|:  133.152847
rounded |X_k-Y|_0 = 63707, f1 =  0.360207, approx slack: 121448
rounded before pow |X_k-Y|_0 = 116206, f1 =  0.317374

Iteration 340: Loss = 57958.359375
|Xk-Y|_F:  57816.707031, |X-X0|:  141.654083
rounded |X_k-Y|_0 = 54020, f1 =  0.372607, approx slack: 144822
rounded before pow |X_k-Y|_0 = 116206, f1 =  0.317374

Iteration 360: Loss = 49107.722656
|Xk-Y|_F:  48953.371094, |X-X0|:  154.351562
rounded |X_k-Y|_0 = 45397, f1 =  0.386262, approx slack: 170707
rounded before pow |X_k-Y|_0 = 116681, f1 =  0.317624

Iteration 380: Loss = 41918.363281
|Xk-Y|_F:  41747.855469, |X-X0|:  170.508148
rounded |X_k-Y|_0 = 38423, f1 =  0.402563, approx slack: 214922
rounded before pow |X_k-Y|_0 = 126114, f1 =  0.311692

Iteration 400: Loss = 36785.000000
|Xk-Y|_F:  36592.351562, |X-X0|:  192.647827
rounded |X_k-Y|_0 = 33248, f1 =  0.420820, approx slack: 332862
rounded before pow |X_k-Y|_0 = 163987, f1 =  0.288775

Iteration 420: Loss = 33479.234375
|Xk-Y|_F:  33253.640625, |X-X0|:  225.592407
rounded |X_k-Y|_0 = 30213, f1 =  0.438433, approx slack: 353957
rounded before pow |X_k-Y|_0 = 167290, f1 =  0.287075

Iteration 440: Loss = 31403.660156
|Xk-Y|_F:  31143.136719, |X-X0|:  260.522614
rounded |X_k-Y|_0 = 28709, f1 =  0.452767, approx slack: 387963
rounded before pow |X_k-Y|_0 = 173124, f1 =  0.284337

Iteration 460: Loss = 30056.880859
|Xk-Y|_F:  29753.070312, |X-X0|:  303.810181
rounded |X_k-Y|_0 = 27935, f1 =  0.467999, approx slack: 408832
rounded before pow |X_k-Y|_0 = 177974, f1 =  0.281863

Iteration 480: Loss = 29081.919922
|Xk-Y|_F:  28689.419922, |X-X0|:  392.499878
rounded |X_k-Y|_0 = 27338, f1 =  0.486139, approx slack: 448056
rounded before pow |X_k-Y|_0 = 190720, f1 =  0.274840

Iteration 500: Loss = 28148.681641
|Xk-Y|_F:  27687.312500, |X-X0|:  461.369324
rounded |X_k-Y|_0 = 26351, f1 =  0.529370, approx slack: 469328
rounded before pow |X_k-Y|_0 = 198403, f1 =  0.270548

Iteration 520: Loss = 27602.681641
|Xk-Y|_F:  27147.777344, |X-X0|:  454.904266
rounded |X_k-Y|_0 = 25943, f1 =  0.545351, approx slack: 441907
rounded before pow |X_k-Y|_0 = 187299, f1 =  0.278014

Iteration 540: Loss = 27246.445312
|Xk-Y|_F:  26800.197266, |X-X0|:  446.248444
rounded |X_k-Y|_0 = 25746, f1 =  0.553124, approx slack: 434782
rounded before pow |X_k-Y|_0 = 184055, f1 =  0.280188

Iteration 560: Loss = 26987.746094
|Xk-Y|_F:  26542.195312, |X-X0|:  445.549988
rounded |X_k-Y|_0 = 25582, f1 =  0.558274, approx slack: 423905
rounded before pow |X_k-Y|_0 = 179448, f1 =  0.283279

Iteration 580: Loss = 26795.537109
|Xk-Y|_F:  26349.945312, |X-X0|:  445.591492
rounded |X_k-Y|_0 = 25533, f1 =  0.559816, approx slack: 424685
rounded before pow |X_k-Y|_0 = 179269, f1 =  0.283404

Iteration 600: Loss = 26657.808594
|Xk-Y|_F:  26211.781250, |X-X0|:  446.026611
rounded |X_k-Y|_0 = 25512, f1 =  0.560268, approx slack: 422790
rounded before pow |X_k-Y|_0 = 178192, f1 =  0.284127

Iteration 620: Loss = 26547.619141
|Xk-Y|_F:  26103.294922, |X-X0|:  444.324249
rounded |X_k-Y|_0 = 25494, f1 =  0.560727, approx slack: 422865
rounded before pow |X_k-Y|_0 = 178003, f1 =  0.284253

Iteration 640: Loss = 26462.904297
|Xk-Y|_F:  26019.634766, |X-X0|:  443.269714
rounded |X_k-Y|_0 = 25505, f1 =  0.560351, approx slack: 417982
rounded before pow |X_k-Y|_0 = 175848, f1 =  0.285700

Iteration 660: Loss = 26391.783203
|Xk-Y|_F:  25950.695312, |X-X0|:  441.087952
rounded |X_k-Y|_0 = 25506, f1 =  0.560321, approx slack: 415556
rounded before pow |X_k-Y|_0 = 174769, f1 =  0.286425

Iteration 680: Loss = 26334.207031
|Xk-Y|_F:  25892.638672, |X-X0|:  441.568909
rounded |X_k-Y|_0 = 25481, f1 =  0.560846, approx slack: 415985
rounded before pow |X_k-Y|_0 = 174769, f1 =  0.286425

Iteration 700: Loss = 26281.789062
|Xk-Y|_F:  25841.607422, |X-X0|:  440.181641
rounded |X_k-Y|_0 = 25480, f1 =  0.560868, approx slack: 415762
rounded before pow |X_k-Y|_0 = 174769, f1 =  0.286425

Iteration 720: Loss = 26237.333984
|Xk-Y|_F:  25795.435547, |X-X0|:  441.898895
rounded |X_k-Y|_0 = 25480, f1 =  0.560872, approx slack: 416220
rounded before pow |X_k-Y|_0 = 174942, f1 =  0.286307

Iteration 740: Loss = 26195.869141
|Xk-Y|_F:  25753.132812, |X-X0|:  442.736511
rounded |X_k-Y|_0 = 25482, f1 =  0.560777, approx slack: 416470
rounded before pow |X_k-Y|_0 = 174942, f1 =  0.286307

Iteration 760: Loss = 26157.906250
|Xk-Y|_F:  25715.060547, |X-X0|:  442.845734
rounded |X_k-Y|_0 = 25480, f1 =  0.560829, approx slack: 414051
rounded before pow |X_k-Y|_0 = 173861, f1 =  0.287034

Iteration 780: Loss = 26123.291016
|Xk-Y|_F:  25678.898438, |X-X0|:  444.392761
rounded |X_k-Y|_0 = 25477, f1 =  0.560914, approx slack: 414275
rounded before pow |X_k-Y|_0 = 173861, f1 =  0.287034

Iteration 800: Loss = 26091.105469
|Xk-Y|_F:  25644.544922, |X-X0|:  446.559631
rounded |X_k-Y|_0 = 25470, f1 =  0.561071, approx slack: 414463
rounded before pow |X_k-Y|_0 = 173861, f1 =  0.287034

Iteration 820: Loss = 26058.687500
|Xk-Y|_F:  25612.720703, |X-X0|:  445.967255
rounded |X_k-Y|_0 = 25465, f1 =  0.561226, approx slack: 409326
rounded before pow |X_k-Y|_0 = 171724, f1 =  0.288473

Iteration 840: Loss = 26029.431641
|Xk-Y|_F:  25581.039062, |X-X0|:  448.391754
rounded |X_k-Y|_0 = 25456, f1 =  0.561464, approx slack: 409639
rounded before pow |X_k-Y|_0 = 171842, f1 =  0.288392

Iteration 860: Loss = 25999.714844
|Xk-Y|_F:  25550.732422, |X-X0|:  448.981628
rounded |X_k-Y|_0 = 25450, f1 =  0.561656, approx slack: 407287
rounded before pow |X_k-Y|_0 = 170833, f1 =  0.289072

Iteration 880: Loss = 25973.794922
|Xk-Y|_F:  25521.548828, |X-X0|:  452.245697
rounded |X_k-Y|_0 = 25444, f1 =  0.561862, approx slack: 407418
rounded before pow |X_k-Y|_0 = 170833, f1 =  0.289072

Iteration 900: Loss = 25948.134766
|Xk-Y|_F:  25493.232422, |X-X0|:  454.902283
rounded |X_k-Y|_0 = 25436, f1 =  0.562082, approx slack: 407496
rounded before pow |X_k-Y|_0 = 170833, f1 =  0.289072

Iteration 920: Loss = 25922.087891
|Xk-Y|_F:  25465.441406, |X-X0|:  456.647034
rounded |X_k-Y|_0 = 25429, f1 =  0.562315, approx slack: 407563
rounded before pow |X_k-Y|_0 = 170833, f1 =  0.289072

Iteration 940: Loss = 25897.492188
|Xk-Y|_F:  25438.054688, |X-X0|:  459.437256
rounded |X_k-Y|_0 = 25414, f1 =  0.562777, approx slack: 407591
rounded before pow |X_k-Y|_0 = 170833, f1 =  0.289072

Iteration 960: Loss = 25872.880859
|Xk-Y|_F:  25409.730469, |X-X0|:  463.150482
rounded |X_k-Y|_0 = 25401, f1 =  0.563220, approx slack: 406827
rounded before pow |X_k-Y|_0 = 170580, f1 =  0.289242

Iteration 980: Loss = 25849.322266
|Xk-Y|_F:  25381.095703, |X-X0|:  468.225830
rounded |X_k-Y|_0 = 25385, f1 =  0.563750, approx slack: 407132
rounded before pow |X_k-Y|_0 = 170863, f1 =  0.289048

Iteration 1000: Loss = 25824.878906
|Xk-Y|_F:  25351.333984, |X-X0|:  473.545319
rounded |X_k-Y|_0 = 25374, f1 =  0.564191, approx slack: 418842
rounded before pow |X_k-Y|_0 = 170974, f1 =  0.288972

Iteration 1020: Loss = 25798.941406
|Xk-Y|_F:  25318.828125, |X-X0|:  480.112549
rounded |X_k-Y|_0 = 25364, f1 =  0.564601, approx slack: 418688
rounded before pow |X_k-Y|_0 = 170974, f1 =  0.288972

Iteration 1040: Loss = 25771.746094
|Xk-Y|_F:  25284.435547, |X-X0|:  487.310669
rounded |X_k-Y|_0 = 25348, f1 =  0.565154, approx slack: 419022
rounded before pow |X_k-Y|_0 = 171383, f1 =  0.288692

Iteration 1060: Loss = 25742.744141
|Xk-Y|_F:  25250.919922, |X-X0|:  491.823364
rounded |X_k-Y|_0 = 25324, f1 =  0.565873, approx slack: 418828
rounded before pow |X_k-Y|_0 = 171325, f1 =  0.288732

Iteration 1080: Loss = 25712.906250
|Xk-Y|_F:  25214.630859, |X-X0|:  498.275787
rounded |X_k-Y|_0 = 25307, f1 =  0.566437, approx slack: 442150
rounded before pow |X_k-Y|_0 = 171433, f1 =  0.288658

Iteration 1100: Loss = 25681.798828
|Xk-Y|_F:  25179.248047, |X-X0|:  502.551208
rounded |X_k-Y|_0 = 25281, f1 =  0.567371, approx slack: 441925
rounded before pow |X_k-Y|_0 = 171433, f1 =  0.288658

Iteration 1120: Loss = 25652.841797
|Xk-Y|_F:  25144.980469, |X-X0|:  507.861053
rounded |X_k-Y|_0 = 25264, f1 =  0.568011, approx slack: 441982
rounded before pow |X_k-Y|_0 = 171709, f1 =  0.288469

Iteration 1140: Loss = 25622.740234
|Xk-Y|_F:  25112.654297, |X-X0|:  510.085449
rounded |X_k-Y|_0 = 25252, f1 =  0.568536, approx slack: 455026
rounded before pow |X_k-Y|_0 = 174526, f1 =  0.286589

Iteration 1160: Loss = 25591.361328
|Xk-Y|_F:  25080.447266, |X-X0|:  510.914062
rounded |X_k-Y|_0 = 25241, f1 =  0.568920, approx slack: 453316
rounded before pow |X_k-Y|_0 = 173057, f1 =  0.287548

Iteration 1180: Loss = 25557.886719
|Xk-Y|_F:  25047.253906, |X-X0|:  510.632233
rounded |X_k-Y|_0 = 25205, f1 =  0.570300, approx slack: 456761
rounded before pow |X_k-Y|_0 = 174896, f1 =  0.286308

Iteration 1200: Loss = 25524.972656
|Xk-Y|_F:  25013.322266, |X-X0|:  511.650604
rounded |X_k-Y|_0 = 25177, f1 =  0.571421, approx slack: 465304
rounded before pow |X_k-Y|_0 = 174896, f1 =  0.286308

Iteration 1220: Loss = 25491.687500
|Xk-Y|_F:  24979.503906, |X-X0|:  512.183960
rounded |X_k-Y|_0 = 25134, f1 =  0.573086, approx slack: 462746
rounded before pow |X_k-Y|_0 = 173954, f1 =  0.286942

Iteration 1240: Loss = 25456.810547
|Xk-Y|_F:  24944.841797, |X-X0|:  511.968201
rounded |X_k-Y|_0 = 25094, f1 =  0.574707, approx slack: 462527
rounded before pow |X_k-Y|_0 = 174059, f1 =  0.286870

Iteration 1260: Loss = 25423.025391
|Xk-Y|_F:  24909.558594, |X-X0|:  513.466064
rounded |X_k-Y|_0 = 25047, f1 =  0.576574, approx slack: 462055
rounded before pow |X_k-Y|_0 = 174059, f1 =  0.286870

Iteration 1280: Loss = 25387.021484
|Xk-Y|_F:  24874.173828, |X-X0|:  512.847107
rounded |X_k-Y|_0 = 25005, f1 =  0.578316, approx slack: 461684
rounded before pow |X_k-Y|_0 = 174059, f1 =  0.286870

Iteration 1300: Loss = 25352.343750
|Xk-Y|_F:  24838.570312, |X-X0|:  513.773865
rounded |X_k-Y|_0 = 24947, f1 =  0.580446, approx slack: 461427
rounded before pow |X_k-Y|_0 = 174059, f1 =  0.286870

Iteration 1320: Loss = 25317.716797
|Xk-Y|_F:  24804.947266, |X-X0|:  512.769775
rounded |X_k-Y|_0 = 24899, f1 =  0.582302, approx slack: 461223
rounded before pow |X_k-Y|_0 = 174059, f1 =  0.286870

Iteration 1340: Loss = 25283.830078
|Xk-Y|_F:  24770.613281, |X-X0|:  513.216187
rounded |X_k-Y|_0 = 24866, f1 =  0.583574, approx slack: 461347
rounded before pow |X_k-Y|_0 = 174246, f1 =  0.286743

Iteration 1360: Loss = 25250.527344
|Xk-Y|_F:  24735.394531, |X-X0|:  515.131897
rounded |X_k-Y|_0 = 24817, f1 =  0.585483, approx slack: 461168
rounded before pow |X_k-Y|_0 = 174246, f1 =  0.286743

Iteration 1380: Loss = 25216.878906
|Xk-Y|_F:  24702.394531, |X-X0|:  514.484009
rounded |X_k-Y|_0 = 24774, f1 =  0.587056, approx slack: 461226
rounded before pow |X_k-Y|_0 = 174246, f1 =  0.286743

Iteration 1400: Loss = 25186.681641
|Xk-Y|_F:  24671.964844, |X-X0|:  514.716553
rounded |X_k-Y|_0 = 24744, f1 =  0.588189, approx slack: 463469
rounded before pow |X_k-Y|_0 = 174051, f1 =  0.286874

Iteration 1420: Loss = 25159.087891
|Xk-Y|_F:  24644.248047, |X-X0|:  514.839844
rounded |X_k-Y|_0 = 24704, f1 =  0.589633, approx slack: 463339
rounded before pow |X_k-Y|_0 = 174051, f1 =  0.286874

Iteration 1440: Loss = 25133.345703
|Xk-Y|_F:  24617.458984, |X-X0|:  515.885803
rounded |X_k-Y|_0 = 24674, f1 =  0.590688, approx slack: 463331
rounded before pow |X_k-Y|_0 = 174098, f1 =  0.286842

Iteration 1460: Loss = 25107.843750
|Xk-Y|_F:  24592.552734, |X-X0|:  515.290527
rounded |X_k-Y|_0 = 24658, f1 =  0.591267, approx slack: 463258
rounded before pow |X_k-Y|_0 = 174098, f1 =  0.286842

Iteration 1480: Loss = 25083.531250
|Xk-Y|_F:  24568.634766, |X-X0|:  514.897095
rounded |X_k-Y|_0 = 24644, f1 =  0.591738, approx slack: 463173
rounded before pow |X_k-Y|_0 = 174098, f1 =  0.286842

Iteration 1500: Loss = 25059.138672
|Xk-Y|_F:  24544.384766, |X-X0|:  514.753662
rounded |X_k-Y|_0 = 24632, f1 =  0.592184, approx slack: 447065
rounded before pow |X_k-Y|_0 = 176088, f1 =  0.285510

Iteration 1520: Loss = 25035.957031
|Xk-Y|_F:  24521.115234, |X-X0|:  514.842224
rounded |X_k-Y|_0 = 24614, f1 =  0.592840, approx slack: 446925
rounded before pow |X_k-Y|_0 = 176088, f1 =  0.285510

Iteration 1540: Loss = 25013.773438
|Xk-Y|_F:  24498.416016, |X-X0|:  515.358276
rounded |X_k-Y|_0 = 24570, f1 =  0.594411, approx slack: 446806
rounded before pow |X_k-Y|_0 = 176088, f1 =  0.285510

Iteration 1560: Loss = 24991.234375
|Xk-Y|_F:  24475.960938, |X-X0|:  515.273804
rounded |X_k-Y|_0 = 24564, f1 =  0.594653, approx slack: 455542
rounded before pow |X_k-Y|_0 = 176088, f1 =  0.285510

Iteration 1580: Loss = 24969.880859
|Xk-Y|_F:  24451.593750, |X-X0|:  518.286194
rounded |X_k-Y|_0 = 24529, f1 =  0.595908, approx slack: 455530
rounded before pow |X_k-Y|_0 = 176088, f1 =  0.285510

Iteration 1600: Loss = 24945.312500
|Xk-Y|_F:  24426.222656, |X-X0|:  519.090454
rounded |X_k-Y|_0 = 24500, f1 =  0.596962, approx slack: 454677
rounded before pow |X_k-Y|_0 = 175822, f1 =  0.285688

Iteration 1620: Loss = 24919.742188
|Xk-Y|_F:  24399.830078, |X-X0|:  519.912476
rounded |X_k-Y|_0 = 24466, f1 =  0.598146, approx slack: 454953
rounded before pow |X_k-Y|_0 = 175924, f1 =  0.285619

Iteration 1640: Loss = 24893.103516
|Xk-Y|_F:  24372.447266, |X-X0|:  520.655334
rounded |X_k-Y|_0 = 24430, f1 =  0.599477, approx slack: 445494
rounded before pow |X_k-Y|_0 = 172258, f1 =  0.287910

Iteration 1660: Loss = 24870.759766
|Xk-Y|_F:  24348.388672, |X-X0|:  522.371338
rounded |X_k-Y|_0 = 24389, f1 =  0.600917, approx slack: 445420
rounded before pow |X_k-Y|_0 = 172258, f1 =  0.287910

Iteration 1680: Loss = 24850.074219
|Xk-Y|_F:  24326.955078, |X-X0|:  523.119690
rounded |X_k-Y|_0 = 24339, f1 =  0.602653, approx slack: 445256
rounded before pow |X_k-Y|_0 = 172093, f1 =  0.288023

Iteration 1700: Loss = 24829.378906
|Xk-Y|_F:  24306.544922, |X-X0|:  522.834167
rounded |X_k-Y|_0 = 24307, f1 =  0.603782, approx slack: 442861
rounded before pow |X_k-Y|_0 = 172522, f1 =  0.287732

Iteration 1720: Loss = 24810.863281
|Xk-Y|_F:  24286.732422, |X-X0|:  524.130493
rounded |X_k-Y|_0 = 24291, f1 =  0.604312, approx slack: 442817
rounded before pow |X_k-Y|_0 = 172522, f1 =  0.287732

Iteration 1740: Loss = 24795.175781
|Xk-Y|_F:  24269.357422, |X-X0|:  525.817505
rounded |X_k-Y|_0 = 24272, f1 =  0.604939, approx slack: 442980
rounded before pow |X_k-Y|_0 = 172621, f1 =  0.287664

Iteration 1760: Loss = 24779.697266
|Xk-Y|_F:  24253.738281, |X-X0|:  525.958191
rounded |X_k-Y|_0 = 24252, f1 =  0.605628, approx slack: 415380
rounded before pow |X_k-Y|_0 = 161707, f1 =  0.295104

Iteration 1780: Loss = 24766.136719
|Xk-Y|_F:  24239.343750, |X-X0|:  526.792236
rounded |X_k-Y|_0 = 24239, f1 =  0.606051, approx slack: 414087
rounded before pow |X_k-Y|_0 = 161206, f1 =  0.295438

Iteration 1800: Loss = 24752.109375
|Xk-Y|_F:  24225.966797, |X-X0|:  526.143494
rounded |X_k-Y|_0 = 24222, f1 =  0.606630, approx slack: 441440
rounded before pow |X_k-Y|_0 = 172073, f1 =  0.288026

Iteration 1820: Loss = 24739.089844
|Xk-Y|_F:  24211.751953, |X-X0|:  527.338562
rounded |X_k-Y|_0 = 24215, f1 =  0.606850, approx slack: 441177
rounded before pow |X_k-Y|_0 = 171788, f1 =  0.288221

Iteration 1840: Loss = 24724.298828
|Xk-Y|_F:  24196.273438, |X-X0|:  528.026001
rounded |X_k-Y|_0 = 24188, f1 =  0.607738, approx slack: 479678
rounded before pow |X_k-Y|_0 = 184674, f1 =  0.279586

Iteration 1860: Loss = 24707.826172
|Xk-Y|_F:  24179.380859, |X-X0|:  528.446167
rounded |X_k-Y|_0 = 24159, f1 =  0.608681, approx slack: 479595
rounded before pow |X_k-Y|_0 = 184809, f1 =  0.279495

Converged at iteration 1879
------ ABL 0 after refine ------
--- eval ---
prediction result:
f1 on test:    0.3871
f1 on test:    0.6445 (micro)
f1 on KB:      0.3769
integrated f1: 0.3811, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3472
f1 on test:    0.6721 (micro)
f1 on KB:      0.5899
integrated f1: 0.4868, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3811
Epoch 100, Total loss: 15742244.0000, CE loss: 2.9380, RL loss: 157422.4375, Reward: -47994.2188
    full cols: 168, non-full cols: 1
   r - labels: 9, labels - r: 1
    violated: 4153, weighted: 176.30316162109375, len: 0.0, nonzero: 0.11160419881343842
Epoch 200, Total loss: -21979968.0000, CE loss: 2.9375, RL loss: -219799.6719, Reward: -48064.7383
    full cols: 168, non-full cols: 1
   r - labels: 9, labels - r: 1
    violated: 4154, weighted: 175.80316162109375, len: 0.0, nonzero: 0.11159387975931168
Epoch 300, Total loss: -16071964.0000, CE loss: 2.9374, RL loss: -160719.6406, Reward: -48001.0195
    full cols: 167, non-full cols: 2
   r - labels: 9, labels - r: 1
    violated: 4154, weighted: 166.80316162109375, len: 0.0, nonzero: 0.11140811443328857
Epoch 400, Total loss: 155331680.0000, CE loss: 2.9358, RL loss: 1553316.8750, Reward: -47648.5488
    full cols: 167, non-full cols: 2
   r - labels: 9, labels - r: 1
    violated: 4155, weighted: 167.80316162109375, len: 0.0, nonzero: 0.11142875254154205
Epoch 500, Total loss: -21795382.0000, CE loss: 2.9347, RL loss: -217953.8281, Reward: -48008.7559
    full cols: 168, non-full cols: 1
   r - labels: 9, labels - r: 1
    violated: 4156, weighted: 174.80316162109375, len: 0.0, nonzero: 0.1115732342004776
Epoch 600, Total loss: -85892936.0000, CE loss: 2.9335, RL loss: -858929.3750, Reward: -48082.3818
    full cols: 167, non-full cols: 2
   r - labels: 9, labels - r: 1
    violated: 4155, weighted: 172.80316162109375, len: 0.0, nonzero: 0.11153195798397064
Epoch 700, Total loss: 17154976.0000, CE loss: 2.9315, RL loss: 171549.7500, Reward: -47900.8711
    full cols: 168, non-full cols: 1
   r - labels: 9, labels - r: 1
    violated: 4150, weighted: 176.30316162109375, len: 0.0, nonzero: 0.11160419881343842
Epoch 800, Total loss: -70620168.0000, CE loss: 2.9294, RL loss: -706201.6875, Reward: -48097.1064
    full cols: 167, non-full cols: 2
   r - labels: 9, labels - r: 1
    violated: 4153, weighted: 176.30316162109375, len: 0.0, nonzero: 0.11160419881343842
Epoch 900, Total loss: 73370024.0000, CE loss: 2.9271, RL loss: 733700.2500, Reward: -47712.0586
    full cols: 168, non-full cols: 1
   r - labels: 9, labels - r: 1
    violated: 4156, weighted: 173.30316162109375, len: 0.0, nonzero: 0.11154227703809738
Epoch 1000, Total loss: 47660872.0000, CE loss: 2.9246, RL loss: 476608.7188, Reward: -47776.3330
    full cols: 168, non-full cols: 1
   r - labels: 9, labels - r: 1
    violated: 4154, weighted: 169.80316162109375, len: 0.0, nonzero: 0.11147003620862961
Epoch 1100, Total loss: 4654674.5000, CE loss: 2.9222, RL loss: 46546.7461, Reward: -47922.7715
    full cols: 168, non-full cols: 1
   r - labels: 9, labels - r: 1
    violated: 4154, weighted: 145.3898162841797, len: 0.0, nonzero: 0.11097465455532074
Epoch 1200, Total loss: 28839778.0000, CE loss: 2.9202, RL loss: 288397.7812, Reward: -47786.4727
    full cols: 167, non-full cols: 2
   r - labels: 9, labels - r: 1
    violated: 4154, weighted: 114.1497802734375, len: 0.0, nonzero: 0.1103554368019104
Epoch 1300, Total loss: -12276822.0000, CE loss: 2.9185, RL loss: -122768.2188, Reward: -47941.5977
    full cols: 167, non-full cols: 1
   r - labels: 8, labels - r: 1
    violated: 4151, weighted: 140.80316162109375, len: 0.0, nonzero: 0.11087145656347275
Epoch 1400, Total loss: 29258900.0000, CE loss: 2.9165, RL loss: 292589.0000, Reward: -47788.0449
    full cols: 167, non-full cols: 2
   r - labels: 9, labels - r: 1
    violated: 4158, weighted: 114.92964172363281, len: 0.0, nonzero: 0.11044831573963165
Epoch 1500, Total loss: 36877156.0000, CE loss: 2.9145, RL loss: 368771.5625, Reward: -47714.2510
    full cols: 168, non-full cols: 0
   r - labels: 8, labels - r: 1
    violated: 4154, weighted: 118.84886932373047, len: 0.0, nonzero: 0.110964335501194
Epoch 1600, Total loss: 79035392.0000, CE loss: 2.9130, RL loss: 790353.9375, Reward: -47545.4414
    full cols: 169, non-full cols: 0
   r - labels: 9, labels - r: 1
    violated: 4154, weighted: 150.848876953125, len: 0.0, nonzero: 0.1116248369216919
Epoch 1700, Total loss: -49894984.0000, CE loss: 2.9112, RL loss: -498949.8438, Reward: -47850.7607
    full cols: 168, non-full cols: 0
   r - labels: 8, labels - r: 1
    violated: 4157, weighted: 118.84886932373047, len: 0.0, nonzero: 0.110964335501194
Epoch 1800, Total loss: 59630308.0000, CE loss: 2.9098, RL loss: 596303.0625, Reward: -47660.1357
    full cols: 167, non-full cols: 2
   r - labels: 9, labels - r: 1
    violated: 4153, weighted: 134.348876953125, len: 0.0, nonzero: 0.11128426343202591
Epoch 1900, Total loss: -87809504.0000, CE loss: 2.9085, RL loss: -878095.0625, Reward: -47960.0684
    full cols: 168, non-full cols: 1
   r - labels: 9, labels - r: 1
    violated: 4158, weighted: 128.848876953125, len: 0.0, nonzero: 0.11117074638605118
--- eval ---
prediction result:
f1 on test:    0.3802
f1 on test:    0.6511 (micro)
f1 on KB:      0.3977
integrated f1: 0.3922, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3461
f1 on test:    0.6720 (micro)
f1 on KB:      0.5953
integrated f1: 0.5205, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: 55822788.0000, CE loss: 2.9071, RL loss: 558227.8750, Reward: -47689.3936
    full cols: 167, non-full cols: 2
   r - labels: 9, labels - r: 1
    violated: 4155, weighted: 129.848876953125, len: 0.0, nonzero: 0.11119138449430466
Epoch 2100, Total loss: -6800773.5000, CE loss: 2.9065, RL loss: -68007.7344, Reward: -47705.9355
    full cols: 169, non-full cols: 1
   r - labels: 10, labels - r: 1
    violated: 4156, weighted: 155.348876953125, len: 0.0, nonzero: 0.11171772330999374
Epoch 2200, Total loss: -69138704.0000, CE loss: 2.9057, RL loss: -691387.0000, Reward: -47855.9180
    full cols: 169, non-full cols: 1
   r - labels: 10, labels - r: 1
    violated: 4158, weighted: 177.848876953125, len: 0.0, nonzero: 0.1121821403503418
Epoch 2300, Total loss: 17641740.0000, CE loss: 2.9053, RL loss: 176417.3906, Reward: -47660.0527
    full cols: 170, non-full cols: 0
   r - labels: 10, labels - r: 1
    violated: 4153, weighted: 181.15475463867188, len: 0.0, nonzero: 0.11228533834218979
Epoch 2400, Total loss: -59980356.0000, CE loss: 2.9049, RL loss: -599803.5625, Reward: -47790.9688
    full cols: 170, non-full cols: 0
   r - labels: 10, labels - r: 1
    violated: 4158, weighted: 181.15475463867188, len: 0.0, nonzero: 0.11228533834218979
Epoch 2500, Total loss: -32404972.0000, CE loss: 2.9049, RL loss: -324049.7188, Reward: -47742.8066
    full cols: 170, non-full cols: 0
   r - labels: 10, labels - r: 1
    violated: 4092, weighted: 149.48779296875, len: 0.0, nonzero: 0.11228533834218979
Epoch 2600, Total loss: -29944418.0000, CE loss: 2.9048, RL loss: -299444.1875, Reward: -47839.5830
    full cols: 169, non-full cols: 0
   r - labels: 9, labels - r: 1
    violated: 4153, weighted: 149.15475463867188, len: 0.0, nonzero: 0.1116248369216919
Epoch 2700, Total loss: 20846012.0000, CE loss: 2.9045, RL loss: 208460.1250, Reward: -47758.8896
    full cols: 169, non-full cols: 1
   r - labels: 10, labels - r: 1
    violated: 4090, weighted: 148.48779296875, len: 0.0, nonzero: 0.11226470023393631
Epoch 2800, Total loss: 51360908.0000, CE loss: 2.9042, RL loss: 513609.0625, Reward: -47510.3848
    full cols: 169, non-full cols: 1
   r - labels: 10, labels - r: 1
    violated: 4095, weighted: 143.98779296875, len: 0.0, nonzero: 0.11217181384563446
Epoch 2900, Total loss: -107008328.0000, CE loss: 2.9042, RL loss: -1070083.2500, Reward: -47986.0215
    full cols: 170, non-full cols: 0
   r - labels: 10, labels - r: 1
    violated: 4093, weighted: 122.743896484375, len: 0.0, nonzero: 0.11228533834218979
Epoch 3000, Total loss: 24382940.0000, CE loss: 2.9038, RL loss: 243829.4062, Reward: -47728.7139
    full cols: 169, non-full cols: 0
   r - labels: 9, labels - r: 1
    violated: 4094, weighted: 117.48777770996094, len: 0.0, nonzero: 0.1116248369216919
Epoch 3100, Total loss: -36953040.0000, CE loss: 2.9035, RL loss: -369530.4062, Reward: -47828.2598
    full cols: 169, non-full cols: 0
   r - labels: 9, labels - r: 1
    violated: 4091, weighted: 117.48777770996094, len: 0.0, nonzero: 0.1116248369216919
Epoch 3200, Total loss: 65803768.0000, CE loss: 2.9033, RL loss: 658037.6875, Reward: -47582.2373
    full cols: 169, non-full cols: 1
   r - labels: 10, labels - r: 1
    violated: 4093, weighted: 121.98778533935547, len: 0.0, nonzero: 0.11171772330999374
Epoch 3300, Total loss: 73717928.0000, CE loss: 2.9032, RL loss: 737179.2500, Reward: -47590.7314
    full cols: 168, non-full cols: 0
   r - labels: 8, labels - r: 1
    violated: 4154, weighted: 117.15475463867188, len: 0.0, nonzero: 0.110964335501194
Epoch 3400, Total loss: 63122712.0000, CE loss: 2.9021, RL loss: 631227.1250, Reward: -47622.5811
    full cols: 167, non-full cols: 2
   r - labels: 8, labels - r: 0
    violated: 4146, weighted: 110.52511596679688, len: 0.0, nonzero: 0.1105412021279335
Epoch 3500, Total loss: 2328543.5000, CE loss: 2.9022, RL loss: 23285.4355, Reward: -47704.7256
    full cols: 167, non-full cols: 1
   r - labels: 7, labels - r: 0
    violated: 4130, weighted: 101.68869018554688, len: 0.0, nonzero: 0.11055152118206024
Epoch 3600, Total loss: 24572760.0000, CE loss: 2.9020, RL loss: 245727.6094, Reward: -47724.5771
    full cols: 169, non-full cols: 1
   r - labels: 9, labels - r: 0
    violated: 4057, weighted: 101.904296875, len: 0.0, nonzero: 0.11200669407844543
Epoch 3700, Total loss: 21212818.0000, CE loss: 2.9017, RL loss: 212128.1875, Reward: -47741.1748
    full cols: 169, non-full cols: 1
   r - labels: 9, labels - r: 0
    violated: 4084, weighted: 112.6513671875, len: 0.0, nonzero: 0.11173836141824722
Epoch 3800, Total loss: 21598240.0000, CE loss: 2.9015, RL loss: 215982.3906, Reward: -47747.4639
    full cols: 170, non-full cols: 0
   r - labels: 10, labels - r: 1
    violated: 4095, weighted: 128.82534790039062, len: 0.0, nonzero: 0.11228533834218979
Epoch 3900, Total loss: -5358931.0000, CE loss: 2.9020, RL loss: -53589.3125, Reward: -47817.8252
    full cols: 169, non-full cols: 0
   r - labels: 9, labels - r: 1
    violated: 4158, weighted: 128.4923095703125, len: 0.0, nonzero: 0.1116248369216919
--- eval ---
prediction result:
f1 on test:    0.3788
f1 on test:    0.6514 (micro)
f1 on KB:      0.3988
integrated f1: 0.3925, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3459
f1 on test:    0.6724 (micro)
f1 on KB:      0.5999
integrated f1: 0.5237, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: 2805169.5000, CE loss: 2.9013, RL loss: 28051.6953, Reward: -47766.5283
    full cols: 171, non-full cols: 0
   r - labels: 11, labels - r: 1
    violated: 4092, weighted: 115.83710479736328, len: 0.0, nonzero: 0.11294583976268768
Epoch 4100, Total loss: 30510278.0000, CE loss: 2.9014, RL loss: 305102.7812, Reward: -47738.9551
    full cols: 171, non-full cols: 1
   r - labels: 12, labels - r: 1
    violated: 4093, weighted: 144.57737731933594, len: 0.0, nonzero: 0.11319353431463242
Epoch 4200, Total loss: -14081711.0000, CE loss: 2.9017, RL loss: -140817.1094, Reward: -47768.6709
    full cols: 170, non-full cols: 1
   r - labels: 11, labels - r: 1
    violated: 4091, weighted: 133.2669677734375, len: 0.0, nonzero: 0.11278071999549866
Epoch 4300, Total loss: 124618024.0000, CE loss: 2.9012, RL loss: 1246180.2500, Reward: -47443.0430
    full cols: 170, non-full cols: 0
   r - labels: 10, labels - r: 1
    violated: 4093, weighted: 124.43800354003906, len: 0.0, nonzero: 0.11228533834218979
Epoch 4400, Total loss: 77060552.0000, CE loss: 2.9013, RL loss: 770605.5000, Reward: -47598.9785
    full cols: 170, non-full cols: 2
   r - labels: 12, labels - r: 1
    violated: 4095, weighted: 126.77488708496094, len: 0.0, nonzero: 0.11283231526613235
Epoch 4500, Total loss: 30213562.0000, CE loss: 2.9012, RL loss: 302135.6250, Reward: -47794.2207
    full cols: 172, non-full cols: 1
   r - labels: 13, labels - r: 1
    violated: 4095, weighted: 139.8065643310547, len: 0.0, nonzero: 0.11407075822353363
Epoch 4600, Total loss: 51402896.0000, CE loss: 2.9011, RL loss: 514028.9688, Reward: -47680.7871
    full cols: 172, non-full cols: 1
   r - labels: 13, labels - r: 1
    violated: 4092, weighted: 137.26333618164062, len: 0.0, nonzero: 0.11410172283649445
Epoch 4700, Total loss: 41865708.0000, CE loss: 2.9013, RL loss: 418657.0625, Reward: -47690.9238
    full cols: 171, non-full cols: 1
   r - labels: 12, labels - r: 1
    violated: 4095, weighted: 104.71154022216797, len: 0.0, nonzero: 0.11341025680303574
Epoch 4800, Total loss: -22874970.0000, CE loss: 2.9013, RL loss: -228749.7031, Reward: -47912.5869
    full cols: 172, non-full cols: 1
   r - labels: 13, labels - r: 1
    violated: 4030, weighted: 158.03280639648438, len: 0.0, nonzero: 0.11369922757148743
Epoch 4900, Total loss: -29870334.0000, CE loss: 2.9011, RL loss: -298703.3438, Reward: -47913.0215
    full cols: 173, non-full cols: 0
   r - labels: 13, labels - r: 1
    violated: 4092, weighted: 119.83348083496094, len: 0.0, nonzero: 0.11426685005426407
Epoch 5000, Total loss: 49813848.0000, CE loss: 2.9013, RL loss: 498138.5000, Reward: -47641.7021
    full cols: 174, non-full cols: 0
   r - labels: 14, labels - r: 1
    violated: 4028, weighted: 151.83349609375, len: 0.0, nonzero: 0.11492735147476196
Epoch 5100, Total loss: -44594364.0000, CE loss: 2.9014, RL loss: -445943.6562, Reward: -48050.7988
    full cols: 173, non-full cols: 1
   r - labels: 14, labels - r: 1
    violated: 4092, weighted: 143.18844604492188, len: 0.0, nonzero: 0.11444228887557983
Epoch 5200, Total loss: -48655284.0000, CE loss: 2.9010, RL loss: -486552.8438, Reward: -48042.2490
    full cols: 172, non-full cols: 3
   r - labels: 15, labels - r: 1
    violated: 4090, weighted: 130.95269775390625, len: 0.0, nonzero: 0.11416364461183548
Epoch 5300, Total loss: 28307638.0000, CE loss: 2.9014, RL loss: 283076.3750, Reward: -47817.4326
    full cols: 170, non-full cols: 0
   r - labels: 10, labels - r: 1
    violated: 4094, weighted: 93.63981628417969, len: 0.0, nonzero: 0.11228533834218979
Epoch 5400, Total loss: 4700572.5000, CE loss: 2.9010, RL loss: 47005.7227, Reward: -47843.4082
    full cols: 171, non-full cols: 0
   r - labels: 11, labels - r: 1
    violated: 4096, weighted: 125.63981628417969, len: 0.0, nonzero: 0.11294583976268768
Epoch 5500, Total loss: 42380052.0000, CE loss: 2.9013, RL loss: 423800.5312, Reward: -47814.6055
    full cols: 172, non-full cols: 0
   r - labels: 11, labels - r: 0
    violated: 4032, weighted: 78.81266784667969, len: 0.0, nonzero: 0.11360634118318558
Epoch 5600, Total loss: -10685418.0000, CE loss: 2.9011, RL loss: -106854.1797, Reward: -47970.0889
    full cols: 173, non-full cols: 0
   r - labels: 12, labels - r: 0
    violated: 4032, weighted: 81.60723876953125, len: 0.0, nonzero: 0.11426685005426407
Epoch 5700, Total loss: -43151612.0000, CE loss: 2.9007, RL loss: -431516.1250, Reward: -48029.9922
    full cols: 174, non-full cols: 1
   r - labels: 14, labels - r: 0
    violated: 4032, weighted: 96.07601928710938, len: 0.0, nonzero: 0.11500991135835648
Epoch 5800, Total loss: -82469176.0000, CE loss: 2.9011, RL loss: -824691.7500, Reward: -48125.4023
    full cols: 173, non-full cols: 0
   r - labels: 12, labels - r: 0
    violated: 4032, weighted: 89.28144836425781, len: 0.0, nonzero: 0.11426685005426407
Epoch 5900, Total loss: 74044448.0000, CE loss: 2.9009, RL loss: 740444.5000, Reward: -47889.7383
    full cols: 173, non-full cols: 0
   r - labels: 12, labels - r: 0
    violated: 4032, weighted: 89.28144836425781, len: 0.0, nonzero: 0.11426685005426407
--- eval ---
prediction result:
f1 on test:    0.3788
f1 on test:    0.6514 (micro)
f1 on KB:      0.3988
integrated f1: 0.3925, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3459
f1 on test:    0.6727 (micro)
f1 on KB:      0.6047
integrated f1: 0.5271, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: 47276292.0000, CE loss: 2.9007, RL loss: 472762.9375, Reward: -47844.0518
    full cols: 173, non-full cols: 0
   r - labels: 12, labels - r: 0
    violated: 4032, weighted: 89.28144836425781, len: 0.0, nonzero: 0.11426685005426407
Epoch 6100, Total loss: -10522673.0000, CE loss: 2.9017, RL loss: -105226.7344, Reward: -48094.4951
    full cols: 172, non-full cols: 1
   r - labels: 12, labels - r: 0
    violated: 4048, weighted: 108.61605834960938, len: 0.0, nonzero: 0.1140914037823677
Epoch 6200, Total loss: -16339777.0000, CE loss: 2.9006, RL loss: -163397.7656, Reward: -48080.2637
    full cols: 169, non-full cols: 2
   r - labels: 11, labels - r: 1
    violated: 4145, weighted: 94.38370513916016, len: 0.0, nonzero: 0.11224406212568283
Epoch 6300, Total loss: -32661618.0000, CE loss: 2.9009, RL loss: -326616.1875, Reward: -48171.0195
    full cols: 172, non-full cols: 2
   r - labels: 14, labels - r: 1
    violated: 4094, weighted: 114.91131591796875, len: 0.0, nonzero: 0.11445261538028717
Epoch 6400, Total loss: 8769944.0000, CE loss: 2.9009, RL loss: 87699.4375, Reward: -48034.1182
    full cols: 170, non-full cols: 0
   r - labels: 11, labels - r: 2
    violated: 4155, weighted: 102.03800964355469, len: 0.0, nonzero: 0.11228533834218979
Epoch 6500, Total loss: 85033160.0000, CE loss: 2.9009, RL loss: 850331.6250, Reward: -47876.5684
    full cols: 171, non-full cols: 2
   r - labels: 13, labels - r: 1
    violated: 4096, weighted: 81.47940063476562, len: 0.0, nonzero: 0.11369922757148743
Epoch 6600, Total loss: 48296468.0000, CE loss: 2.9005, RL loss: 482964.6875, Reward: -47997.0059
    full cols: 173, non-full cols: 1
   r - labels: 14, labels - r: 1
    violated: 4096, weighted: 84.48190307617188, len: 0.0, nonzero: 0.11428748816251755
Epoch 6700, Total loss: -21370050.0000, CE loss: 2.9011, RL loss: -213700.5000, Reward: -48249.5234
    full cols: 171, non-full cols: 2
   r - labels: 13, labels - r: 1
    violated: 4096, weighted: 91.67102813720703, len: 0.0, nonzero: 0.1135857030749321
Epoch 6800, Total loss: -43620520.0000, CE loss: 2.9007, RL loss: -436205.2188, Reward: -48289.7812
    full cols: 173, non-full cols: 1
   r - labels: 14, labels - r: 1
    violated: 4096, weighted: 91.7280502319336, len: 0.0, nonzero: 0.11445261538028717
Epoch 6900, Total loss: -66356412.0000, CE loss: 2.9010, RL loss: -663564.1250, Reward: -48382.0625
    full cols: 172, non-full cols: 1
   r - labels: 13, labels - r: 1
    violated: 4096, weighted: 98.88053894042969, len: 0.0, nonzero: 0.11422556638717651
Epoch 7000, Total loss: 24541628.0000, CE loss: 2.9007, RL loss: 245416.2812, Reward: -48130.7227
    full cols: 174, non-full cols: 0
   r - labels: 14, labels - r: 1
    violated: 4096, weighted: 124.22080993652344, len: 0.0, nonzero: 0.11492735147476196
Epoch 7100, Total loss: 40648908.0000, CE loss: 2.9008, RL loss: 406489.0625, Reward: -48101.8838
    full cols: 173, non-full cols: 1
   r - labels: 14, labels - r: 1
    violated: 4096, weighted: 114.76199340820312, len: 0.0, nonzero: 0.11476222425699234
Epoch 7200, Total loss: -14788892.0000, CE loss: 2.9005, RL loss: -147888.9219, Reward: -48295.2275
    full cols: 173, non-full cols: 1
   r - labels: 14, labels - r: 1
    violated: 4096, weighted: 113.92329406738281, len: 0.0, nonzero: 0.11477254331111908
Epoch 7300, Total loss: -29770532.0000, CE loss: 2.9009, RL loss: -297705.3125, Reward: -48318.9609
    full cols: 175, non-full cols: 0
   r - labels: 15, labels - r: 1
    violated: 4096, weighted: 131.93844604492188, len: 0.0, nonzero: 0.11558785289525986
Epoch 7400, Total loss: 46040312.0000, CE loss: 2.9011, RL loss: 460403.1250, Reward: -48194.1279
    full cols: 174, non-full cols: 0
   r - labels: 14, labels - r: 1
    violated: 4095, weighted: 120.74569702148438, len: 0.0, nonzero: 0.11492735147476196
Epoch 7500, Total loss: 35059028.0000, CE loss: 2.9007, RL loss: 350590.2812, Reward: -48159.4512
    full cols: 176, non-full cols: 0
   r - labels: 16, labels - r: 1
    violated: 4096, weighted: 137.77374267578125, len: 0.0, nonzero: 0.11624835431575775
Epoch 7600, Total loss: 18400982.0000, CE loss: 2.9006, RL loss: 184009.8125, Reward: -48246.7080
    full cols: 176, non-full cols: 1
   r - labels: 18, labels - r: 2
    violated: 4091, weighted: 146.27871704101562, len: 0.0, nonzero: 0.11649604141712189
Epoch 7700, Total loss: -10980401.0000, CE loss: 2.9007, RL loss: -109804.0078, Reward: -48274.3242
    full cols: 174, non-full cols: 0
   r - labels: 15, labels - r: 2
    violated: 4093, weighted: 141.59637451171875, len: 0.0, nonzero: 0.11492735147476196
Epoch 7800, Total loss: 84789536.0000, CE loss: 2.9014, RL loss: 847895.3750, Reward: -48123.3340
    full cols: 173, non-full cols: 1
   r - labels: 15, labels - r: 2
    violated: 4091, weighted: 117.75044250488281, len: 0.0, nonzero: 0.11427716910839081
Epoch 7900, Total loss: -30250994.0000, CE loss: 2.9011, RL loss: -302509.9375, Reward: -48342.4873
    full cols: 173, non-full cols: 2
   r - labels: 16, labels - r: 2
    violated: 4092, weighted: 130.87826538085938, len: 0.0, nonzero: 0.11494798958301544
--- eval ---
prediction result:
f1 on test:    0.3783
f1 on test:    0.6520 (micro)
f1 on KB:      0.4006
integrated f1: 0.3935, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3469
f1 on test:    0.6727 (micro)
f1 on KB:      0.5945
integrated f1: 0.5202, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: 677174.6250, CE loss: 2.9006, RL loss: 6771.7461, Reward: -48275.3828
    full cols: 172, non-full cols: 1
   r - labels: 14, labels - r: 2
    violated: 4092, weighted: 115.92781829833984, len: 0.0, nonzero: 0.11415332555770874
------ ABL Loop 1 ------
--- eval ---
prediction result:
f1 on test:    0.3783
f1 on test:    0.6520 (micro)
f1 on KB:      0.4006
integrated f1: 0.3907, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3469
f1 on test:    0.6727 (micro)
f1 on KB:      0.5945
integrated f1: 0.4893, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3907
Iteration 0: Loss = 25929.677734
|Xk-Y|_F:  25929.677734, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 25943, f1 =  0.339541, approx slack: 24148
rounded before pow |X_k-Y|_0 = 25943, f1 =  0.339541

Iteration 20: Loss = 24395.097656
|Xk-Y|_F:  23470.369141, |X-X0|:  924.729126
rounded |X_k-Y|_0 = 24223, f1 =  0.482712, approx slack: 694648
rounded before pow |X_k-Y|_0 = 60621, f1 =  0.386968

Iteration 40: Loss = 23216.960938
|Xk-Y|_F:  22315.802734, |X-X0|:  901.159180
rounded |X_k-Y|_0 = 23567, f1 =  0.522135, approx slack: 698465
rounded before pow |X_k-Y|_0 = 61250, f1 =  0.385843

Iteration 60: Loss = 22212.177734
|Xk-Y|_F:  21358.742188, |X-X0|:  853.435791
rounded |X_k-Y|_0 = 21242, f1 =  0.618361, approx slack: 662192
rounded before pow |X_k-Y|_0 = 61786, f1 =  0.385237

Iteration 80: Loss = 21616.406250
|Xk-Y|_F:  20831.716797, |X-X0|:  784.690063
rounded |X_k-Y|_0 = 20569, f1 =  0.639199, approx slack: 602183
rounded before pow |X_k-Y|_0 = 63639, f1 =  0.382629

Iteration 100: Loss = 21322.136719
|Xk-Y|_F:  20592.880859, |X-X0|:  729.256714
rounded |X_k-Y|_0 = 20462, f1 =  0.642278, approx slack: 549226
rounded before pow |X_k-Y|_0 = 62895, f1 =  0.383965

Iteration 120: Loss = 21170.994141
|Xk-Y|_F:  20479.271484, |X-X0|:  691.723267
rounded |X_k-Y|_0 = 20431, f1 =  0.643186, approx slack: 500403
rounded before pow |X_k-Y|_0 = 61724, f1 =  0.385925

Iteration 140: Loss = 21082.958984
|Xk-Y|_F:  20410.406250, |X-X0|:  672.552979
rounded |X_k-Y|_0 = 20396, f1 =  0.644225, approx slack: 428016
rounded before pow |X_k-Y|_0 = 60125, f1 =  0.389005

Iteration 160: Loss = 21025.595703
|Xk-Y|_F:  20365.962891, |X-X0|:  659.632202
rounded |X_k-Y|_0 = 20332, f1 =  0.646014, approx slack: 416747
rounded before pow |X_k-Y|_0 = 60008, f1 =  0.389227

Iteration 180: Loss = 20987.404297
|Xk-Y|_F:  20333.273438, |X-X0|:  654.131226
rounded |X_k-Y|_0 = 20298, f1 =  0.646969, approx slack: 410641
rounded before pow |X_k-Y|_0 = 59524, f1 =  0.390153

Iteration 200: Loss = 20957.523438
|Xk-Y|_F:  20307.015625, |X-X0|:  650.506958
rounded |X_k-Y|_0 = 20288, f1 =  0.647243, approx slack: 402842
rounded before pow |X_k-Y|_0 = 58941, f1 =  0.391267

Iteration 220: Loss = 20933.218750
|Xk-Y|_F:  20285.660156, |X-X0|:  647.557739
rounded |X_k-Y|_0 = 20292, f1 =  0.647138, approx slack: 399799
rounded before pow |X_k-Y|_0 = 58798, f1 =  0.391548

Iteration 240: Loss = 20909.095703
|Xk-Y|_F:  20268.085938, |X-X0|:  641.009583
rounded |X_k-Y|_0 = 20276, f1 =  0.647598, approx slack: 389686
rounded before pow |X_k-Y|_0 = 58226, f1 =  0.392684

Iteration 260: Loss = 20891.371094
|Xk-Y|_F:  20252.751953, |X-X0|:  638.619751
rounded |X_k-Y|_0 = 20265, f1 =  0.647906, approx slack: 414213
rounded before pow |X_k-Y|_0 = 60107, f1 =  0.389039

Iteration 280: Loss = 20876.224609
|Xk-Y|_F:  20239.433594, |X-X0|:  636.791138
rounded |X_k-Y|_0 = 20252, f1 =  0.648267, approx slack: 414037
rounded before pow |X_k-Y|_0 = 60091, f1 =  0.389070

Iteration 300: Loss = 20863.623047
|Xk-Y|_F:  20228.226562, |X-X0|:  635.396973
rounded |X_k-Y|_0 = 20233, f1 =  0.648804, approx slack: 413828
rounded before pow |X_k-Y|_0 = 60074, f1 =  0.389102

Iteration 320: Loss = 20850.972656
|Xk-Y|_F:  20218.052734, |X-X0|:  632.920593
rounded |X_k-Y|_0 = 20218, f1 =  0.649227, approx slack: 414022
rounded before pow |X_k-Y|_0 = 60272, f1 =  0.388728

Iteration 340: Loss = 20838.931641
|Xk-Y|_F:  20208.265625, |X-X0|:  630.666504
rounded |X_k-Y|_0 = 20213, f1 =  0.649374, approx slack: 413328
rounded before pow |X_k-Y|_0 = 60230, f1 =  0.388807

Iteration 360: Loss = 20829.025391
|Xk-Y|_F:  20199.181641, |X-X0|:  629.842896
rounded |X_k-Y|_0 = 20203, f1 =  0.649657, approx slack: 412276
rounded before pow |X_k-Y|_0 = 60230, f1 =  0.388807

Iteration 380: Loss = 20819.585938
|Xk-Y|_F:  20191.222656, |X-X0|:  628.364197
rounded |X_k-Y|_0 = 20208, f1 =  0.649518, approx slack: 411577
rounded before pow |X_k-Y|_0 = 60178, f1 =  0.388905

Iteration 400: Loss = 20810.824219
|Xk-Y|_F:  20183.271484, |X-X0|:  627.553223
rounded |X_k-Y|_0 = 20205, f1 =  0.649603, approx slack: 411174
rounded before pow |X_k-Y|_0 = 60170, f1 =  0.388920

Iteration 420: Loss = 20799.332031
|Xk-Y|_F:  20175.107422, |X-X0|:  624.223755
rounded |X_k-Y|_0 = 20195, f1 =  0.649882, approx slack: 405775
rounded before pow |X_k-Y|_0 = 60139, f1 =  0.388979

Iteration 440: Loss = 20792.861328
|Xk-Y|_F:  20168.117188, |X-X0|:  624.744141
rounded |X_k-Y|_0 = 20188, f1 =  0.650074, approx slack: 405783
rounded before pow |X_k-Y|_0 = 60139, f1 =  0.388979

Iteration 460: Loss = 20786.228516
|Xk-Y|_F:  20161.634766, |X-X0|:  624.594238
rounded |X_k-Y|_0 = 20176, f1 =  0.650409, approx slack: 405875
rounded before pow |X_k-Y|_0 = 60139, f1 =  0.388979

Iteration 480: Loss = 20778.812500
|Xk-Y|_F:  20155.298828, |X-X0|:  623.514587
rounded |X_k-Y|_0 = 20167, f1 =  0.650650, approx slack: 396460
rounded before pow |X_k-Y|_0 = 59382, f1 =  0.390427

Iteration 500: Loss = 20770.210938
|Xk-Y|_F:  20148.697266, |X-X0|:  621.512939
rounded |X_k-Y|_0 = 20144, f1 =  0.651278, approx slack: 396525
rounded before pow |X_k-Y|_0 = 59382, f1 =  0.390427

Iteration 520: Loss = 20763.384766
|Xk-Y|_F:  20142.996094, |X-X0|:  620.388000
rounded |X_k-Y|_0 = 20143, f1 =  0.651303, approx slack: 395654
rounded before pow |X_k-Y|_0 = 59266, f1 =  0.390652

Iteration 540: Loss = 20757.779297
|Xk-Y|_F:  20137.759766, |X-X0|:  620.019043
rounded |X_k-Y|_0 = 20131, f1 =  0.651639, approx slack: 395654
rounded before pow |X_k-Y|_0 = 59266, f1 =  0.390652

Iteration 560: Loss = 20753.119141
|Xk-Y|_F:  20132.460938, |X-X0|:  620.658813
rounded |X_k-Y|_0 = 20121, f1 =  0.651914, approx slack: 395445
rounded before pow |X_k-Y|_0 = 59266, f1 =  0.390652

Iteration 580: Loss = 20747.691406
|Xk-Y|_F:  20127.572266, |X-X0|:  620.120056
rounded |X_k-Y|_0 = 20117, f1 =  0.652025, approx slack: 395577
rounded before pow |X_k-Y|_0 = 59266, f1 =  0.390652

Iteration 600: Loss = 20742.972656
|Xk-Y|_F:  20122.787109, |X-X0|:  620.185852
rounded |X_k-Y|_0 = 20117, f1 =  0.652022, approx slack: 395628
rounded before pow |X_k-Y|_0 = 59266, f1 =  0.390652

Iteration 620: Loss = 20736.832031
|Xk-Y|_F:  20118.263672, |X-X0|:  618.568542
rounded |X_k-Y|_0 = 20111, f1 =  0.652187, approx slack: 393764
rounded before pow |X_k-Y|_0 = 59217, f1 =  0.390747

Iteration 640: Loss = 20729.031250
|Xk-Y|_F:  20113.910156, |X-X0|:  615.121948
rounded |X_k-Y|_0 = 20109, f1 =  0.652248, approx slack: 393313
rounded before pow |X_k-Y|_0 = 59184, f1 =  0.390811

Iteration 660: Loss = 20722.542969
|Xk-Y|_F:  20109.703125, |X-X0|:  612.839722
rounded |X_k-Y|_0 = 20106, f1 =  0.652332, approx slack: 391988
rounded before pow |X_k-Y|_0 = 59035, f1 =  0.391102

Iteration 680: Loss = 20715.466797
|Xk-Y|_F:  20105.556641, |X-X0|:  609.909363
rounded |X_k-Y|_0 = 20094, f1 =  0.652662, approx slack: 387254
rounded before pow |X_k-Y|_0 = 58119, f1 =  0.392919

Iteration 700: Loss = 20711.445312
|Xk-Y|_F:  20101.464844, |X-X0|:  609.981140
rounded |X_k-Y|_0 = 20094, f1 =  0.652663, approx slack: 387289
rounded before pow |X_k-Y|_0 = 58119, f1 =  0.392919

Iteration 720: Loss = 20706.537109
|Xk-Y|_F:  20097.595703, |X-X0|:  608.940796
rounded |X_k-Y|_0 = 20091, f1 =  0.652743, approx slack: 387450
rounded before pow |X_k-Y|_0 = 58119, f1 =  0.392919

Iteration 740: Loss = 20700.468750
|Xk-Y|_F:  20094.066406, |X-X0|:  606.402344
rounded |X_k-Y|_0 = 20081, f1 =  0.653021, approx slack: 379944
rounded before pow |X_k-Y|_0 = 57767, f1 =  0.393630

Iteration 760: Loss = 20695.105469
|Xk-Y|_F:  20090.068359, |X-X0|:  605.036438
rounded |X_k-Y|_0 = 20086, f1 =  0.652883, approx slack: 380063
rounded before pow |X_k-Y|_0 = 57767, f1 =  0.393630

Iteration 780: Loss = 20690.896484
|Xk-Y|_F:  20087.343750, |X-X0|:  603.552002
rounded |X_k-Y|_0 = 20085, f1 =  0.652911, approx slack: 378785
rounded before pow |X_k-Y|_0 = 57634, f1 =  0.393901

Iteration 800: Loss = 20686.734375
|Xk-Y|_F:  20084.390625, |X-X0|:  602.343628
rounded |X_k-Y|_0 = 20087, f1 =  0.652856, approx slack: 378903
rounded before pow |X_k-Y|_0 = 57634, f1 =  0.393901

Iteration 820: Loss = 20683.119141
|Xk-Y|_F:  20081.142578, |X-X0|:  601.976746
rounded |X_k-Y|_0 = 20087, f1 =  0.652858, approx slack: 378114
rounded before pow |X_k-Y|_0 = 57520, f1 =  0.394135

Iteration 840: Loss = 20678.150391
|Xk-Y|_F:  20078.478516, |X-X0|:  599.672241
rounded |X_k-Y|_0 = 20078, f1 =  0.653110, approx slack: 378401
rounded before pow |X_k-Y|_0 = 57503, f1 =  0.394169

Iteration 860: Loss = 20674.798828
|Xk-Y|_F:  20075.333984, |X-X0|:  599.465210
rounded |X_k-Y|_0 = 20074, f1 =  0.653218, approx slack: 378553
rounded before pow |X_k-Y|_0 = 57503, f1 =  0.394169

Iteration 880: Loss = 20671.187500
|Xk-Y|_F:  20072.433594, |X-X0|:  598.753662
rounded |X_k-Y|_0 = 20070, f1 =  0.653327, approx slack: 378666
rounded before pow |X_k-Y|_0 = 57494, f1 =  0.394188

Iteration 900: Loss = 20668.130859
|Xk-Y|_F:  20069.826172, |X-X0|:  598.304077
rounded |X_k-Y|_0 = 20075, f1 =  0.653188, approx slack: 377646
rounded before pow |X_k-Y|_0 = 57064, f1 =  0.395076

Iteration 920: Loss = 20665.142578
|Xk-Y|_F:  20067.292969, |X-X0|:  597.850281
rounded |X_k-Y|_0 = 20066, f1 =  0.653436, approx slack: 377751
rounded before pow |X_k-Y|_0 = 57064, f1 =  0.395076

Converged at iteration 940
------ ABL 1 after refine ------
--- eval ---
prediction result:
f1 on test:    0.3783
f1 on test:    0.6520 (micro)
f1 on KB:      0.4040
integrated f1: 0.3925, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3463
f1 on test:    0.6722 (micro)
f1 on KB:      0.5985
integrated f1: 0.4914, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3925
