GNN_eco_Sep3_8
log/EGOAL-eco-2025-09-04-19:56:57.543745.txt
random seed: 9999
train shape: torch.Size([434, 1514]), test shape: torch.Size([72, 1514])
cuda availability: True
/home/u-xiangyf/anaconda3/envs/egoal/lib/python3.13/site-packages/torch/nn/modules/loss.py:608: UserWarning: Using a target size (torch.Size([1514])) that is different to the input size (torch.Size([4639, 1514])). This will likely lead to incorrect results due to broadcasting. Please ensure they have the same size.
  return F.mse_loss(input, target, reduction=self.reduction)
Epoch 0, Loss: 0.2190
Epoch 100, Loss: 0.0015
Epoch 200, Loss: 0.0004
Epoch 300, Loss: 0.0002
Epoch 400, Loss: 0.0001
Final loss: 9.99338153633289e-05
Achieved outputs: tensor([[0.2157, 0.0025, 0.0029,  ..., 0.0243, 0.0026, 0.0021],
        [0.2419, 0.0057, 0.0065,  ..., 0.0381, 0.0059, 0.0049],
        [0.2568, 0.0109, 0.0120,  ..., 0.0555, 0.0110, 0.0096],
        ...,
        [0.2281, 0.0042, 0.0048,  ..., 0.0326, 0.0044, 0.0036],
        [0.2313, 0.0047, 0.0053,  ..., 0.0341, 0.0050, 0.0042],
        [0.2558, 0.0079, 0.0090,  ..., 0.0469, 0.0083, 0.0069]],
       device='cuda:7')
Eval weight w_data: 0.4246200244007528
Before pretrain: integrated f1 0.2378
Epoch 100, Total loss: 208058304.0000, CE loss: 6.4209, RL loss: 20805830.0000, Reward: -216470.6367
    full cols: 12, non-full cols: 1417
   r - labels: 1268, labels - r: 0
    violated: 7754, weighted: 35688.0234375, len: 42734.19921875, nonzero: 0.7410316467285156
Epoch 200, Total loss: 165714048.0000, CE loss: 6.4037, RL loss: 16571405.0000, Reward: -216219.4102
    full cols: 12, non-full cols: 1418
   r - labels: 1269, labels - r: 0
    violated: 5887, weighted: 37663.0390625, len: 46143.19921875, nonzero: 0.7762137055397034
Epoch 300, Total loss: -197828784.0000, CE loss: 6.3892, RL loss: -19782878.0000, Reward: -216903.6348
    full cols: 12, non-full cols: 1418
   r - labels: 1269, labels - r: 0
    violated: 6300, weighted: 38312.203125, len: 47261.19921875, nonzero: 0.7877518534660339
Epoch 400, Total loss: 203870848.0000, CE loss: 6.3754, RL loss: 20387084.0000, Reward: -215982.3730
    full cols: 12, non-full cols: 1418
   r - labels: 1269, labels - r: 0
    violated: 5385, weighted: 37663.03125, len: 46143.19921875, nonzero: 0.7762137055397034
Epoch 500, Total loss: 100188824.0000, CE loss: 6.3618, RL loss: 10018882.0000, Reward: -216246.7246
    full cols: 12, non-full cols: 1418
   r - labels: 1269, labels - r: 0
    violated: 4900, weighted: 37013.8671875, len: 45025.19921875, nonzero: 0.7646755576133728
------ Before ABL ------
--- eval ---
prediction result:
f1 on test:    0.3946
f1 on test:    0.6430 (micro)
f1 on KB:      0.3506
integrated f1: 0.3674, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3741
f1 on test:    0.6536 (micro)
f1 on KB:      0.4961
integrated f1: 0.4443, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3674

Epoch 100, Total loss: -394568896.0000, CE loss: 3.3890, RL loss: -3945689.0000, Reward: -55914.2686
    full cols: 162, non-full cols: 0
   r - labels: 4, labels - r: 3
    violated: 30580, weighted: 11.192764282226562, len: 0.0, nonzero: 0.10700132697820663
Epoch 200, Total loss: -53841664.0000, CE loss: 3.3727, RL loss: -538416.6250, Reward: -55414.1660
    full cols: 162, non-full cols: 0
   r - labels: 4, labels - r: 3
    violated: 29328, weighted: 11.192764282226562, len: 0.0, nonzero: 0.10700132697820663
Epoch 300, Total loss: 94717904.0000, CE loss: 3.3669, RL loss: 947179.0000, Reward: -55064.8877
    full cols: 162, non-full cols: 0
   r - labels: 4, labels - r: 3
    violated: 29233, weighted: 11.192764282226562, len: 0.0, nonzero: 0.10700132697820663
Epoch 400, Total loss: -440842560.0000, CE loss: 3.3623, RL loss: -4408425.5000, Reward: -55221.0322
    full cols: 162, non-full cols: 0
   r - labels: 4, labels - r: 3
    violated: 27967, weighted: 11.192764282226562, len: 0.0, nonzero: 0.10700132697820663
Epoch 500, Total loss: 75892384.0000, CE loss: 3.3608, RL loss: 758923.8125, Reward: -54899.4043
    full cols: 162, non-full cols: 0
   r - labels: 4, labels - r: 3
    violated: 28592, weighted: 11.192764282226562, len: 0.0, nonzero: 0.10700132697820663
Epoch 600, Total loss: -447486400.0000, CE loss: 3.3536, RL loss: -4474864.0000, Reward: -54824.8262
    full cols: 162, non-full cols: 0
   r - labels: 4, labels - r: 3
    violated: 26863, weighted: 11.192764282226562, len: 0.0, nonzero: 0.10700132697820663
Epoch 700, Total loss: -59465712.0000, CE loss: 3.3561, RL loss: -594657.1250, Reward: -54345.5254
    full cols: 162, non-full cols: 0
   r - labels: 4, labels - r: 3
    violated: 28213, weighted: 11.192764282226562, len: 0.0, nonzero: 0.10700132697820663
Epoch 800, Total loss: 75255000.0000, CE loss: 3.3627, RL loss: 752550.0000, Reward: -54374.4541
    full cols: 170, non-full cols: 0
   r - labels: 12, labels - r: 3
    violated: 24202, weighted: 195.14208984375, len: 0.0, nonzero: 0.11228533834218979
Epoch 900, Total loss: 41153948.0000, CE loss: 3.3625, RL loss: 411539.4688, Reward: -54383.2314
    full cols: 170, non-full cols: 0
   r - labels: 12, labels - r: 3
    violated: 25349, weighted: 195.14208984375, len: 0.0, nonzero: 0.11228533834218979
Epoch 1000, Total loss: 173417824.0000, CE loss: 3.3906, RL loss: 1734178.2500, Reward: -54221.9053
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24561, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1100, Total loss: 355884960.0000, CE loss: 3.3756, RL loss: 3558849.5000, Reward: -54192.7285
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25380, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1200, Total loss: 226370000.0000, CE loss: 3.3712, RL loss: 2263700.0000, Reward: -54198.6357
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25783, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1300, Total loss: -570554752.0000, CE loss: 3.3741, RL loss: -5705547.5000, Reward: -54593.0244
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25674, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1400, Total loss: -216904672.0000, CE loss: 3.3727, RL loss: -2169046.7500, Reward: -54469.5781
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25171, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1500, Total loss: -201558656.0000, CE loss: 3.3716, RL loss: -2015586.5000, Reward: -54319.6787
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 26356, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1600, Total loss: 333486528.0000, CE loss: 3.3720, RL loss: 3334865.2500, Reward: -54152.3203
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25226, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1700, Total loss: -203184944.0000, CE loss: 3.3720, RL loss: -2031849.5000, Reward: -54378.4268
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24524, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1800, Total loss: -71512712.0000, CE loss: 3.3709, RL loss: -715127.1250, Reward: -54415.0947
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25114, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1900, Total loss: 205086496.0000, CE loss: 3.3736, RL loss: 2050865.0000, Reward: -54221.1436
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24815, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
--- eval ---
prediction result:
f1 on test:    0.3565
f1 on test:    0.6310 (micro)
f1 on KB:      0.3552
integrated f1: 0.3556, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3602
f1 on test:    0.6465 (micro)
f1 on KB:      0.5109
integrated f1: 0.4657, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: 503298336.0000, CE loss: 3.3751, RL loss: 5032983.5000, Reward: -54084.0244
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25344, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 2100, Total loss: 279687168.0000, CE loss: 3.3893, RL loss: 2796871.7500, Reward: -54206.0137
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25962, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 2200, Total loss: 366724544.0000, CE loss: 3.3897, RL loss: 3667245.5000, Reward: -54129.4688
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24827, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 2300, Total loss: -169303856.0000, CE loss: 3.3910, RL loss: -1693038.6250, Reward: -54324.5605
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24712, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 2400, Total loss: 49108344.0000, CE loss: 3.4068, RL loss: 491083.4375, Reward: -54358.5342
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25637, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 2500, Total loss: -332538176.0000, CE loss: 3.4017, RL loss: -3325381.7500, Reward: -54394.7480
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25862, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 2600, Total loss: 306516576.0000, CE loss: 3.4026, RL loss: 3065165.7500, Reward: -54282.1465
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24130, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 2700, Total loss: 123133936.0000, CE loss: 3.4000, RL loss: 1231339.3750, Reward: -54301.4961
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24655, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 2800, Total loss: -112944704.0000, CE loss: 3.4012, RL loss: -1129447.0000, Reward: -54344.0195
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25293, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 2900, Total loss: 30217078.0000, CE loss: 3.4027, RL loss: 302170.7812, Reward: -54249.3809
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24284, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3000, Total loss: 310767456.0000, CE loss: 3.4006, RL loss: 3107674.5000, Reward: -54128.9033
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25705, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3100, Total loss: 37828476.0000, CE loss: 3.4012, RL loss: 378284.7500, Reward: -54230.0186
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24417, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3200, Total loss: -52805280.0000, CE loss: 3.4053, RL loss: -528052.8125, Reward: -54304.1162
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24643, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3300, Total loss: 45857576.0000, CE loss: 3.4057, RL loss: 458575.7500, Reward: -54289.2764
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24683, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3400, Total loss: 225478400.0000, CE loss: 3.4044, RL loss: 2254784.0000, Reward: -54132.9238
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 23599, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3500, Total loss: 44555464.0000, CE loss: 3.4009, RL loss: 445554.6250, Reward: -54325.3721
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 23732, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3600, Total loss: -204987968.0000, CE loss: 3.4033, RL loss: -2049879.7500, Reward: -54358.8516
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24494, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3700, Total loss: -88111824.0000, CE loss: 3.4077, RL loss: -881118.2500, Reward: -54224.6836
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25638, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3800, Total loss: 318064256.0000, CE loss: 3.4055, RL loss: 3180642.5000, Reward: -54063.3848
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24402, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3900, Total loss: 270266240.0000, CE loss: 3.4080, RL loss: 2702662.5000, Reward: -54160.0586
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 23664, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
--- eval ---
prediction result:
f1 on test:    0.3554
f1 on test:    0.6309 (micro)
f1 on KB:      0.3555
integrated f1: 0.3555, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3586
f1 on test:    0.6463 (micro)
f1 on KB:      0.5109
integrated f1: 0.4652, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: -10184594.0000, CE loss: 3.4132, RL loss: -101845.9375, Reward: -54165.1055
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24909, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 4100, Total loss: -222315648.0000, CE loss: 3.4155, RL loss: -2223156.5000, Reward: -54322.7627
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25714, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 4200, Total loss: 439745792.0000, CE loss: 3.4175, RL loss: 4397458.0000, Reward: -53988.9229
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24087, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 4300, Total loss: -257570800.0000, CE loss: 3.4174, RL loss: -2575708.0000, Reward: -54263.5352
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25668, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 4400, Total loss: 15855145.0000, CE loss: 3.4169, RL loss: 158551.4531, Reward: -54154.0186
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25344, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 4500, Total loss: 51553508.0000, CE loss: 3.4153, RL loss: 515535.0938, Reward: -54160.2490
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24605, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 4600, Total loss: -112159160.0000, CE loss: 3.4168, RL loss: -1121591.6250, Reward: -54247.2295
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 23795, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 4700, Total loss: -362186016.0000, CE loss: 3.4191, RL loss: -3621860.2500, Reward: -54299.0107
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25487, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 4800, Total loss: -332968672.0000, CE loss: 3.4172, RL loss: -3329686.7500, Reward: -54301.4248
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 23854, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 4900, Total loss: 5912490.0000, CE loss: 3.4161, RL loss: 59124.9023, Reward: -54151.8154
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24657, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5000, Total loss: 112183888.0000, CE loss: 3.4176, RL loss: 1121838.8750, Reward: -54101.8809
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24021, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5100, Total loss: 136083056.0000, CE loss: 3.4158, RL loss: 1360830.5000, Reward: -54133.0762
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24079, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5200, Total loss: 196844400.0000, CE loss: 3.4170, RL loss: 1968444.0000, Reward: -54063.1807
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 23804, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5300, Total loss: 163135280.0000, CE loss: 3.4195, RL loss: 1631352.7500, Reward: -54024.5576
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24212, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5400, Total loss: -539513536.0000, CE loss: 3.4198, RL loss: -5395135.5000, Reward: -54392.3770
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25471, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5500, Total loss: 169780032.0000, CE loss: 3.4207, RL loss: 1697800.2500, Reward: -53970.4736
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25213, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5600, Total loss: 336616640.0000, CE loss: 3.4206, RL loss: 3366166.5000, Reward: -53994.4346
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24525, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5700, Total loss: -193243504.0000, CE loss: 3.4589, RL loss: -1932435.0000, Reward: -54311.4990
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24853, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5800, Total loss: 307687296.0000, CE loss: 3.4539, RL loss: 3076873.0000, Reward: -53976.9395
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24694, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5900, Total loss: -136509968.0000, CE loss: 3.4696, RL loss: -1365099.6250, Reward: -54244.3428
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 23879, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
--- eval ---
prediction result:
f1 on test:    0.3529
f1 on test:    0.6305 (micro)
f1 on KB:      0.3550
integrated f1: 0.3543, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3579
f1 on test:    0.6464 (micro)
f1 on KB:      0.5111
integrated f1: 0.4652, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: 2163345.2500, CE loss: 3.4582, RL loss: 21633.4531, Reward: -54201.6006
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24831, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 6100, Total loss: 325933632.0000, CE loss: 3.4575, RL loss: 3259336.2500, Reward: -54053.8203
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24673, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 6200, Total loss: 213852480.0000, CE loss: 3.4560, RL loss: 2138524.7500, Reward: -54137.6357
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24233, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 6300, Total loss: -240682080.0000, CE loss: 3.4561, RL loss: -2406820.7500, Reward: -54217.9697
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25113, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 6400, Total loss: 340961728.0000, CE loss: 3.4617, RL loss: 3409617.2500, Reward: -54044.9258
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 23205, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 6500, Total loss: -619367872.0000, CE loss: 3.4690, RL loss: -6193679.0000, Reward: -54404.0029
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25020, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 6600, Total loss: -116679824.0000, CE loss: 3.4734, RL loss: -1166798.2500, Reward: -54155.2900
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24896, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 6700, Total loss: -108131976.0000, CE loss: 3.4676, RL loss: -1081319.7500, Reward: -54165.7500
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24344, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 6800, Total loss: -55354608.0000, CE loss: 3.4630, RL loss: -553546.0625, Reward: -54155.5312
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24115, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 6900, Total loss: 144735072.0000, CE loss: 3.4620, RL loss: 1447350.7500, Reward: -54041.0859
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24161, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7000, Total loss: 280323936.0000, CE loss: 3.4724, RL loss: 2803239.5000, Reward: -53860.1221
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 23112, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7100, Total loss: 165184608.0000, CE loss: 3.4868, RL loss: 1651846.0000, Reward: -53747.4766
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 23300, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7200, Total loss: 69286848.0000, CE loss: 3.4551, RL loss: 692868.5000, Reward: -53909.9951
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24424, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7300, Total loss: -22626440.0000, CE loss: 3.4566, RL loss: -226264.3906, Reward: -53977.7861
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 23893, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7400, Total loss: -266370672.0000, CE loss: 3.4603, RL loss: -2663706.7500, Reward: -54160.3311
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 25805, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7500, Total loss: 418961760.0000, CE loss: 3.4641, RL loss: 4189617.5000, Reward: -53738.1904
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24316, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7600, Total loss: 30229250.0000, CE loss: 3.4600, RL loss: 302292.5000, Reward: -54039.4922
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24512, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7700, Total loss: 78629128.0000, CE loss: 3.4582, RL loss: 786291.2500, Reward: -53950.4102
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 23809, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7800, Total loss: 259331152.0000, CE loss: 3.4596, RL loss: 2593311.5000, Reward: -53935.3486
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24493, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7900, Total loss: -228451376.0000, CE loss: 3.4618, RL loss: -2284513.7500, Reward: -54038.0166
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 24675, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
--- eval ---
prediction result:
f1 on test:    0.3521
f1 on test:    0.6308 (micro)
f1 on KB:      0.3549
integrated f1: 0.3540, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3574
f1 on test:    0.6465 (micro)
f1 on KB:      0.5126
integrated f1: 0.4660, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: 302560736.0000, CE loss: 3.4619, RL loss: 3025607.5000, Reward: -53866.4365
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 23100, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
------ ABL Loop 0 ------
--- eval ---
prediction result:
f1 on test:    0.3521
f1 on test:    0.6308 (micro)
f1 on KB:      0.3549
integrated f1: 0.3537, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3574
f1 on test:    0.6465 (micro)
f1 on KB:      0.5126
integrated f1: 0.4467, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3537
Iteration 0: Loss = 183085.000000
|Xk-Y|_F:  183085.000000, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 144487, f1 =  0.320974, approx slack: 7636
rounded before pow |X_k-Y|_0 = 144487, f1 =  0.320974

Iteration 20: Loss = 181996.593750
|Xk-Y|_F:  179980.265625, |X-X0|:  2016.327881
rounded |X_k-Y|_0 = 142960, f1 =  0.331388, approx slack: 15082
rounded before pow |X_k-Y|_0 = 145190, f1 =  0.331026

Iteration 40: Loss = 179667.968750
|Xk-Y|_F:  178703.109375, |X-X0|:  964.851990
rounded |X_k-Y|_0 = 142868, f1 =  0.331387, approx slack: 20873
rounded before pow |X_k-Y|_0 = 143832, f1 =  0.342033

Iteration 60: Loss = 177747.203125
|Xk-Y|_F:  176844.500000, |X-X0|:  902.702759
rounded |X_k-Y|_0 = 142710, f1 =  0.332567, approx slack: 31067
rounded before pow |X_k-Y|_0 = 144205, f1 =  0.350768

Iteration 80: Loss = 174613.625000
|Xk-Y|_F:  173553.359375, |X-X0|:  1060.267334
rounded |X_k-Y|_0 = 141075, f1 =  0.341912, approx slack: 52453
rounded before pow |X_k-Y|_0 = 147328, f1 =  0.360189

Iteration 100: Loss = 170683.187500
|Xk-Y|_F:  169548.234375, |X-X0|:  1134.957642
rounded |X_k-Y|_0 = 139567, f1 =  0.350413, approx slack: 35344
rounded before pow |X_k-Y|_0 = 145134, f1 =  0.366341

Iteration 120: Loss = 166984.265625
|Xk-Y|_F:  165860.125000, |X-X0|:  1124.138184
rounded |X_k-Y|_0 = 128894, f1 =  0.377456, approx slack: 33570
rounded before pow |X_k-Y|_0 = 144571, f1 =  0.370365

Iteration 140: Loss = 163880.781250
|Xk-Y|_F:  162741.828125, |X-X0|:  1138.956543
rounded |X_k-Y|_0 = 127703, f1 =  0.382769, approx slack: 41304
rounded before pow |X_k-Y|_0 = 143232, f1 =  0.375061

Iteration 160: Loss = 160791.046875
|Xk-Y|_F:  159648.093750, |X-X0|:  1142.952637
rounded |X_k-Y|_0 = 126779, f1 =  0.386913, approx slack: 40977
rounded before pow |X_k-Y|_0 = 143139, f1 =  0.375599

Iteration 180: Loss = 157422.453125
|Xk-Y|_F:  156292.312500, |X-X0|:  1130.142334
rounded |X_k-Y|_0 = 125012, f1 =  0.391809, approx slack: 42941
rounded before pow |X_k-Y|_0 = 143303, f1 =  0.375491

Iteration 200: Loss = 153602.359375
|Xk-Y|_F:  152484.250000, |X-X0|:  1118.104858
rounded |X_k-Y|_0 = 121025, f1 =  0.398853, approx slack: 48473
rounded before pow |X_k-Y|_0 = 143829, f1 =  0.374977

Iteration 220: Loss = 149142.218750
|Xk-Y|_F:  148033.671875, |X-X0|:  1108.550537
rounded |X_k-Y|_0 = 118925, f1 =  0.402897, approx slack: 54902
rounded before pow |X_k-Y|_0 = 143827, f1 =  0.374962

Iteration 240: Loss = 143811.578125
|Xk-Y|_F:  142707.718750, |X-X0|:  1103.865479
rounded |X_k-Y|_0 = 116127, f1 =  0.407808, approx slack: 61758
rounded before pow |X_k-Y|_0 = 143619, f1 =  0.375145

Iteration 260: Loss = 137292.468750
|Xk-Y|_F:  136191.093750, |X-X0|:  1101.381592
rounded |X_k-Y|_0 = 111782, f1 =  0.415397, approx slack: 71008
rounded before pow |X_k-Y|_0 = 143642, f1 =  0.375126

Iteration 280: Loss = 129258.031250
|Xk-Y|_F:  128157.992188, |X-X0|:  1100.039307
rounded |X_k-Y|_0 = 106805, f1 =  0.424446, approx slack: 83241
rounded before pow |X_k-Y|_0 = 143874, f1 =  0.374903

Iteration 300: Loss = 119700.968750
|Xk-Y|_F:  118605.890625, |X-X0|:  1095.077515
rounded |X_k-Y|_0 = 100723, f1 =  0.436249, approx slack: 99331
rounded before pow |X_k-Y|_0 = 143490, f1 =  0.375246

Iteration 320: Loss = 109198.210938
|Xk-Y|_F:  108106.140625, |X-X0|:  1092.072144
rounded |X_k-Y|_0 = 92921, f1 =  0.453221, approx slack: 118477
rounded before pow |X_k-Y|_0 = 143294, f1 =  0.375409

Iteration 340: Loss = 98648.648438
|Xk-Y|_F:  97561.781250, |X-X0|:  1086.863403
rounded |X_k-Y|_0 = 84739, f1 =  0.474126, approx slack: 141853
rounded before pow |X_k-Y|_0 = 143930, f1 =  0.374814

Iteration 360: Loss = 88908.835938
|Xk-Y|_F:  87828.007812, |X-X0|:  1080.826782
rounded |X_k-Y|_0 = 77189, f1 =  0.497654, approx slack: 163859
rounded before pow |X_k-Y|_0 = 143758, f1 =  0.374945

Iteration 380: Loss = 80871.164062
|Xk-Y|_F:  79790.492188, |X-X0|:  1080.672363
rounded |X_k-Y|_0 = 71046, f1 =  0.522047, approx slack: 183903
rounded before pow |X_k-Y|_0 = 144043, f1 =  0.374733

Iteration 400: Loss = 75089.937500
|Xk-Y|_F:  74003.273438, |X-X0|:  1086.662109
rounded |X_k-Y|_0 = 66329, f1 =  0.545545, approx slack: 201678
rounded before pow |X_k-Y|_0 = 144617, f1 =  0.374222

Iteration 420: Loss = 71289.914062
|Xk-Y|_F:  70200.320312, |X-X0|:  1089.595337
rounded |X_k-Y|_0 = 63755, f1 =  0.560813, approx slack: 213736
rounded before pow |X_k-Y|_0 = 144773, f1 =  0.374195

Iteration 440: Loss = 68832.257812
|Xk-Y|_F:  67745.789062, |X-X0|:  1086.472412
rounded |X_k-Y|_0 = 62393, f1 =  0.570191, approx slack: 221563
rounded before pow |X_k-Y|_0 = 144773, f1 =  0.374195

Iteration 460: Loss = 67206.523438
|Xk-Y|_F:  66121.789062, |X-X0|:  1084.730957
rounded |X_k-Y|_0 = 61704, f1 =  0.575323, approx slack: 227320
rounded before pow |X_k-Y|_0 = 144873, f1 =  0.374202

Iteration 480: Loss = 66117.289062
|Xk-Y|_F:  65028.441406, |X-X0|:  1088.849731
rounded |X_k-Y|_0 = 61150, f1 =  0.579428, approx slack: 231387
rounded before pow |X_k-Y|_0 = 144859, f1 =  0.374262

Iteration 500: Loss = 65339.515625
|Xk-Y|_F:  64250.476562, |X-X0|:  1089.037964
rounded |X_k-Y|_0 = 60784, f1 =  0.582171, approx slack: 234441
rounded before pow |X_k-Y|_0 = 144859, f1 =  0.374262

Iteration 520: Loss = 64772.464844
|Xk-Y|_F:  63684.375000, |X-X0|:  1088.089844
rounded |X_k-Y|_0 = 60608, f1 =  0.583642, approx slack: 236525
rounded before pow |X_k-Y|_0 = 144859, f1 =  0.374262

Iteration 540: Loss = 64345.078125
|Xk-Y|_F:  63257.714844, |X-X0|:  1087.361572
rounded |X_k-Y|_0 = 60439, f1 =  0.584885, approx slack: 238235
rounded before pow |X_k-Y|_0 = 144859, f1 =  0.374262

Iteration 560: Loss = 63977.851562
|Xk-Y|_F:  62900.343750, |X-X0|:  1077.507446
rounded |X_k-Y|_0 = 60277, f1 =  0.586030, approx slack: 239692
rounded before pow |X_k-Y|_0 = 144885, f1 =  0.374244

Iteration 580: Loss = 63675.546875
|Xk-Y|_F:  62596.960938, |X-X0|:  1078.587646
rounded |X_k-Y|_0 = 60063, f1 =  0.587593, approx slack: 240392
rounded before pow |X_k-Y|_0 = 144667, f1 =  0.374517

Iteration 600: Loss = 63469.910156
|Xk-Y|_F:  62393.644531, |X-X0|:  1076.266357
rounded |X_k-Y|_0 = 60019, f1 =  0.587975, approx slack: 240950
rounded before pow |X_k-Y|_0 = 144667, f1 =  0.374517

Iteration 620: Loss = 63298.023438
|Xk-Y|_F:  62221.851562, |X-X0|:  1076.170898
rounded |X_k-Y|_0 = 59962, f1 =  0.588467, approx slack: 241329
rounded before pow |X_k-Y|_0 = 144488, f1 =  0.374657

Iteration 640: Loss = 63144.359375
|Xk-Y|_F:  62071.675781, |X-X0|:  1072.684326
rounded |X_k-Y|_0 = 59905, f1 =  0.588951, approx slack: 241854
rounded before pow |X_k-Y|_0 = 144488, f1 =  0.374657

Iteration 660: Loss = 63003.230469
|Xk-Y|_F:  61933.769531, |X-X0|:  1069.461304
rounded |X_k-Y|_0 = 59870, f1 =  0.589264, approx slack: 242229
rounded before pow |X_k-Y|_0 = 144488, f1 =  0.374657

Iteration 680: Loss = 62879.480469
|Xk-Y|_F:  61813.214844, |X-X0|:  1066.266846
rounded |X_k-Y|_0 = 59838, f1 =  0.589556, approx slack: 242506
rounded before pow |X_k-Y|_0 = 144437, f1 =  0.374790

Iteration 700: Loss = 62769.238281
|Xk-Y|_F:  61705.816406, |X-X0|:  1063.423096
rounded |X_k-Y|_0 = 59792, f1 =  0.589941, approx slack: 242799
rounded before pow |X_k-Y|_0 = 144437, f1 =  0.374790

Iteration 720: Loss = 62667.867188
|Xk-Y|_F:  61607.527344, |X-X0|:  1060.341309
rounded |X_k-Y|_0 = 59764, f1 =  0.590154, approx slack: 242911
rounded before pow |X_k-Y|_0 = 144260, f1 =  0.374930

Iteration 740: Loss = 62582.378906
|Xk-Y|_F:  61520.953125, |X-X0|:  1061.425415
rounded |X_k-Y|_0 = 59726, f1 =  0.590464, approx slack: 242814
rounded before pow |X_k-Y|_0 = 144036, f1 =  0.375202

Iteration 760: Loss = 62502.308594
|Xk-Y|_F:  61443.960938, |X-X0|:  1058.346924
rounded |X_k-Y|_0 = 59716, f1 =  0.590539, approx slack: 242782
rounded before pow |X_k-Y|_0 = 143934, f1 =  0.375203

Iteration 780: Loss = 62427.683594
|Xk-Y|_F:  61373.296875, |X-X0|:  1054.387207
rounded |X_k-Y|_0 = 59694, f1 =  0.590720, approx slack: 242959
rounded before pow |X_k-Y|_0 = 143930, f1 =  0.375220

Iteration 800: Loss = 62356.140625
|Xk-Y|_F:  61307.003906, |X-X0|:  1049.136108
rounded |X_k-Y|_0 = 59678, f1 =  0.590819, approx slack: 243108
rounded before pow |X_k-Y|_0 = 143928, f1 =  0.375228

Iteration 820: Loss = 62289.203125
|Xk-Y|_F:  61244.914062, |X-X0|:  1044.290283
rounded |X_k-Y|_0 = 59653, f1 =  0.591021, approx slack: 243194
rounded before pow |X_k-Y|_0 = 143926, f1 =  0.375236

Iteration 840: Loss = 62229.726562
|Xk-Y|_F:  61185.988281, |X-X0|:  1043.738770
rounded |X_k-Y|_0 = 59623, f1 =  0.591251, approx slack: 243283
rounded before pow |X_k-Y|_0 = 143926, f1 =  0.375236

Iteration 860: Loss = 62175.808594
|Xk-Y|_F:  61132.148438, |X-X0|:  1043.661133
rounded |X_k-Y|_0 = 59598, f1 =  0.591436, approx slack: 243553
rounded before pow |X_k-Y|_0 = 144101, f1 =  0.375099

Iteration 880: Loss = 62125.457031
|Xk-Y|_F:  61084.582031, |X-X0|:  1040.874268
rounded |X_k-Y|_0 = 59578, f1 =  0.591594, approx slack: 243632
rounded before pow |X_k-Y|_0 = 144105, f1 =  0.375088

Iteration 900: Loss = 62077.921875
|Xk-Y|_F:  61038.875000, |X-X0|:  1039.048584
rounded |X_k-Y|_0 = 59553, f1 =  0.591800, approx slack: 243675
rounded before pow |X_k-Y|_0 = 144084, f1 =  0.375113

Iteration 920: Loss = 62033.695312
|Xk-Y|_F:  60995.093750, |X-X0|:  1038.600464
rounded |X_k-Y|_0 = 59526, f1 =  0.592024, approx slack: 243579
rounded before pow |X_k-Y|_0 = 143921, f1 =  0.375192

Iteration 940: Loss = 61989.253906
|Xk-Y|_F:  60953.097656, |X-X0|:  1036.157227
rounded |X_k-Y|_0 = 59503, f1 =  0.592212, approx slack: 243783
rounded before pow |X_k-Y|_0 = 143768, f1 =  0.375284

Iteration 960: Loss = 61943.753906
|Xk-Y|_F:  60909.957031, |X-X0|:  1033.795410
rounded |X_k-Y|_0 = 59464, f1 =  0.592532, approx slack: 243778
rounded before pow |X_k-Y|_0 = 143768, f1 =  0.375284

Iteration 980: Loss = 61899.253906
|Xk-Y|_F:  60867.207031, |X-X0|:  1032.046631
rounded |X_k-Y|_0 = 59442, f1 =  0.592721, approx slack: 243809
rounded before pow |X_k-Y|_0 = 143768, f1 =  0.375284

Iteration 1000: Loss = 61859.324219
|Xk-Y|_F:  60825.425781, |X-X0|:  1033.898071
rounded |X_k-Y|_0 = 59417, f1 =  0.592926, approx slack: 243837
rounded before pow |X_k-Y|_0 = 143761, f1 =  0.375292

Iteration 1020: Loss = 61813.984375
|Xk-Y|_F:  60784.917969, |X-X0|:  1029.067383
rounded |X_k-Y|_0 = 59392, f1 =  0.593157, approx slack: 243831
rounded before pow |X_k-Y|_0 = 143761, f1 =  0.375292

Iteration 1040: Loss = 61774.500000
|Xk-Y|_F:  60742.167969, |X-X0|:  1032.333252
rounded |X_k-Y|_0 = 59339, f1 =  0.593604, approx slack: 248483
rounded before pow |X_k-Y|_0 = 143823, f1 =  0.375219

Iteration 1060: Loss = 61731.144531
|Xk-Y|_F:  60696.964844, |X-X0|:  1034.181030
rounded |X_k-Y|_0 = 59314, f1 =  0.593811, approx slack: 271996
rounded before pow |X_k-Y|_0 = 143975, f1 =  0.375129

Iteration 1080: Loss = 61684.160156
|Xk-Y|_F:  60650.515625, |X-X0|:  1033.644287
rounded |X_k-Y|_0 = 59277, f1 =  0.594123, approx slack: 274409
rounded before pow |X_k-Y|_0 = 142435, f1 =  0.376900

Iteration 1100: Loss = 61637.722656
|Xk-Y|_F:  60599.121094, |X-X0|:  1038.600342
rounded |X_k-Y|_0 = 59239, f1 =  0.594450, approx slack: 301912
rounded before pow |X_k-Y|_0 = 144964, f1 =  0.373899

Iteration 1120: Loss = 61586.109375
|Xk-Y|_F:  60542.195312, |X-X0|:  1043.915894
rounded |X_k-Y|_0 = 59192, f1 =  0.594880, approx slack: 302478
rounded before pow |X_k-Y|_0 = 145133, f1 =  0.373738

Iteration 1140: Loss = 61526.859375
|Xk-Y|_F:  60482.175781, |X-X0|:  1044.682861
rounded |X_k-Y|_0 = 59136, f1 =  0.595383, approx slack: 309892
rounded before pow |X_k-Y|_0 = 145385, f1 =  0.373447

Iteration 1160: Loss = 61467.765625
|Xk-Y|_F:  60422.335938, |X-X0|:  1045.429443
rounded |X_k-Y|_0 = 59059, f1 =  0.596057, approx slack: 315326
rounded before pow |X_k-Y|_0 = 145385, f1 =  0.373447

Iteration 1180: Loss = 61409.933594
|Xk-Y|_F:  60365.609375, |X-X0|:  1044.324707
rounded |X_k-Y|_0 = 58988, f1 =  0.596675, approx slack: 315033
rounded before pow |X_k-Y|_0 = 145385, f1 =  0.373447

Iteration 1200: Loss = 61356.375000
|Xk-Y|_F:  60311.277344, |X-X0|:  1045.098755
rounded |X_k-Y|_0 = 58935, f1 =  0.597148, approx slack: 316415
rounded before pow |X_k-Y|_0 = 145779, f1 =  0.372887

Iteration 1220: Loss = 61304.851562
|Xk-Y|_F:  60259.312500, |X-X0|:  1045.538818
rounded |X_k-Y|_0 = 58892, f1 =  0.597545, approx slack: 318351
rounded before pow |X_k-Y|_0 = 145225, f1 =  0.373426

Iteration 1240: Loss = 61253.941406
|Xk-Y|_F:  60209.585938, |X-X0|:  1044.356445
rounded |X_k-Y|_0 = 58816, f1 =  0.598221, approx slack: 317929
rounded before pow |X_k-Y|_0 = 145046, f1 =  0.373588

Iteration 1260: Loss = 61198.449219
|Xk-Y|_F:  60160.652344, |X-X0|:  1037.798584
rounded |X_k-Y|_0 = 58767, f1 =  0.598635, approx slack: 313903
rounded before pow |X_k-Y|_0 = 144526, f1 =  0.374092

Iteration 1280: Loss = 61151.207031
|Xk-Y|_F:  60111.972656, |X-X0|:  1039.234375
rounded |X_k-Y|_0 = 58733, f1 =  0.598966, approx slack: 321213
rounded before pow |X_k-Y|_0 = 146154, f1 =  0.372117

Iteration 1300: Loss = 61104.386719
|Xk-Y|_F:  60064.222656, |X-X0|:  1040.163818
rounded |X_k-Y|_0 = 58696, f1 =  0.599285, approx slack: 319719
rounded before pow |X_k-Y|_0 = 145934, f1 =  0.372239

Iteration 1320: Loss = 61058.734375
|Xk-Y|_F:  60019.468750, |X-X0|:  1039.267578
rounded |X_k-Y|_0 = 58639, f1 =  0.599799, approx slack: 319828
rounded before pow |X_k-Y|_0 = 145928, f1 =  0.372246

Iteration 1340: Loss = 61016.406250
|Xk-Y|_F:  59977.390625, |X-X0|:  1039.015259
rounded |X_k-Y|_0 = 58608, f1 =  0.600074, approx slack: 327505
rounded before pow |X_k-Y|_0 = 147681, f1 =  0.370103

Iteration 1360: Loss = 60975.769531
|Xk-Y|_F:  59936.792969, |X-X0|:  1038.975952
rounded |X_k-Y|_0 = 58589, f1 =  0.600246, approx slack: 327449
rounded before pow |X_k-Y|_0 = 147681, f1 =  0.370103

Iteration 1380: Loss = 60934.945312
|Xk-Y|_F:  59897.843750, |X-X0|:  1037.100098
rounded |X_k-Y|_0 = 58521, f1 =  0.600853, approx slack: 326681
rounded before pow |X_k-Y|_0 = 147195, f1 =  0.370375

Iteration 1400: Loss = 60896.683594
|Xk-Y|_F:  59858.585938, |X-X0|:  1038.098511
rounded |X_k-Y|_0 = 58510, f1 =  0.600975, approx slack: 331290
rounded before pow |X_k-Y|_0 = 147757, f1 =  0.369718

Iteration 1420: Loss = 60859.437500
|Xk-Y|_F:  59821.316406, |X-X0|:  1038.122803
rounded |X_k-Y|_0 = 58461, f1 =  0.601388, approx slack: 331036
rounded before pow |X_k-Y|_0 = 147724, f1 =  0.369628

Iteration 1440: Loss = 60822.648438
|Xk-Y|_F:  59784.218750, |X-X0|:  1038.430908
rounded |X_k-Y|_0 = 58432, f1 =  0.601656, approx slack: 330962
rounded before pow |X_k-Y|_0 = 147724, f1 =  0.369628

Iteration 1460: Loss = 60781.546875
|Xk-Y|_F:  59748.640625, |X-X0|:  1032.904541
rounded |X_k-Y|_0 = 58414, f1 =  0.601808, approx slack: 330295
rounded before pow |X_k-Y|_0 = 147197, f1 =  0.369929

Iteration 1480: Loss = 60746.007812
|Xk-Y|_F:  59713.367188, |X-X0|:  1032.640503
rounded |X_k-Y|_0 = 58359, f1 =  0.602281, approx slack: 336081
rounded before pow |X_k-Y|_0 = 147197, f1 =  0.369929

Iteration 1500: Loss = 60709.714844
|Xk-Y|_F:  59678.046875, |X-X0|:  1031.667969
rounded |X_k-Y|_0 = 58324, f1 =  0.602606, approx slack: 338727
rounded before pow |X_k-Y|_0 = 147033, f1 =  0.370049

Iteration 1520: Loss = 60668.105469
|Xk-Y|_F:  59642.894531, |X-X0|:  1025.209839
rounded |X_k-Y|_0 = 58279, f1 =  0.602975, approx slack: 339302
rounded before pow |X_k-Y|_0 = 147975, f1 =  0.368949

Iteration 1540: Loss = 60624.113281
|Xk-Y|_F:  59606.941406, |X-X0|:  1017.171875
rounded |X_k-Y|_0 = 58260, f1 =  0.603152, approx slack: 339052
rounded before pow |X_k-Y|_0 = 147816, f1 =  0.369056

Iteration 1560: Loss = 60586.875000
|Xk-Y|_F:  59572.730469, |X-X0|:  1014.144897
rounded |X_k-Y|_0 = 58228, f1 =  0.603426, approx slack: 338529
rounded before pow |X_k-Y|_0 = 147542, f1 =  0.369324

Iteration 1580: Loss = 60554.113281
|Xk-Y|_F:  59538.660156, |X-X0|:  1015.452148
rounded |X_k-Y|_0 = 58174, f1 =  0.603894, approx slack: 335357
rounded before pow |X_k-Y|_0 = 146398, f1 =  0.370589

Iteration 1600: Loss = 60518.656250
|Xk-Y|_F:  59504.492188, |X-X0|:  1014.166016
rounded |X_k-Y|_0 = 58146, f1 =  0.604141, approx slack: 330398
rounded before pow |X_k-Y|_0 = 144964, f1 =  0.372252

Iteration 1620: Loss = 60488.613281
|Xk-Y|_F:  59472.542969, |X-X0|:  1016.068970
rounded |X_k-Y|_0 = 58101, f1 =  0.604537, approx slack: 330299
rounded before pow |X_k-Y|_0 = 144905, f1 =  0.372267

Iteration 1640: Loss = 60457.652344
|Xk-Y|_F:  59440.792969, |X-X0|:  1016.860352
rounded |X_k-Y|_0 = 58081, f1 =  0.604718, approx slack: 329829
rounded before pow |X_k-Y|_0 = 144642, f1 =  0.372379

Iteration 1660: Loss = 60427.792969
|Xk-Y|_F:  59411.011719, |X-X0|:  1016.781433
rounded |X_k-Y|_0 = 58055, f1 =  0.604940, approx slack: 329732
rounded before pow |X_k-Y|_0 = 144642, f1 =  0.372371

Iteration 1680: Loss = 60399.511719
|Xk-Y|_F:  59382.503906, |X-X0|:  1017.008972
rounded |X_k-Y|_0 = 58029, f1 =  0.605150, approx slack: 329577
rounded before pow |X_k-Y|_0 = 144582, f1 =  0.372382

Iteration 1700: Loss = 60372.429688
|Xk-Y|_F:  59355.453125, |X-X0|:  1016.976318
rounded |X_k-Y|_0 = 58006, f1 =  0.605358, approx slack: 329792
rounded before pow |X_k-Y|_0 = 144701, f1 =  0.372308

Iteration 1720: Loss = 60346.820312
|Xk-Y|_F:  59329.835938, |X-X0|:  1016.983765
rounded |X_k-Y|_0 = 57958, f1 =  0.605771, approx slack: 329192
rounded before pow |X_k-Y|_0 = 144240, f1 =  0.372508

Iteration 1740: Loss = 60321.136719
|Xk-Y|_F:  59304.109375, |X-X0|:  1017.028381
rounded |X_k-Y|_0 = 57933, f1 =  0.605988, approx slack: 329077
rounded before pow |X_k-Y|_0 = 144181, f1 =  0.372521

Iteration 1760: Loss = 60297.292969
|Xk-Y|_F:  59278.296875, |X-X0|:  1018.996582
rounded |X_k-Y|_0 = 57928, f1 =  0.606043, approx slack: 328224
rounded before pow |X_k-Y|_0 = 143865, f1 =  0.372776

Iteration 1780: Loss = 60274.054688
|Xk-Y|_F:  59252.218750, |X-X0|:  1021.836487
rounded |X_k-Y|_0 = 57913, f1 =  0.606197, approx slack: 321780
rounded before pow |X_k-Y|_0 = 143466, f1 =  0.373097

Iteration 1800: Loss = 60249.164062
|Xk-Y|_F:  59228.644531, |X-X0|:  1020.520325
rounded |X_k-Y|_0 = 57871, f1 =  0.606555, approx slack: 321977
rounded before pow |X_k-Y|_0 = 143619, f1 =  0.373004

Iteration 1820: Loss = 60226.910156
|Xk-Y|_F:  59207.046875, |X-X0|:  1019.863281
rounded |X_k-Y|_0 = 57853, f1 =  0.606702, approx slack: 321607
rounded before pow |X_k-Y|_0 = 143414, f1 =  0.373131

Iteration 1840: Loss = 60198.218750
|Xk-Y|_F:  59183.628906, |X-X0|:  1014.591125
rounded |X_k-Y|_0 = 57820, f1 =  0.606980, approx slack: 325974
rounded before pow |X_k-Y|_0 = 143820, f1 =  0.372390

Iteration 1860: Loss = 60172.921875
|Xk-Y|_F:  59160.769531, |X-X0|:  1012.154053
rounded |X_k-Y|_0 = 57813, f1 =  0.607057, approx slack: 328539
rounded before pow |X_k-Y|_0 = 143583, f1 =  0.372324

Iteration 1880: Loss = 60151.304688
|Xk-Y|_F:  59139.988281, |X-X0|:  1011.315674
rounded |X_k-Y|_0 = 57783, f1 =  0.607320, approx slack: 327628
rounded before pow |X_k-Y|_0 = 143414, f1 =  0.372462

Iteration 1900: Loss = 60128.820312
|Xk-Y|_F:  59120.339844, |X-X0|:  1008.480225
rounded |X_k-Y|_0 = 57765, f1 =  0.607480, approx slack: 326963
rounded before pow |X_k-Y|_0 = 143098, f1 =  0.372606

Iteration 1920: Loss = 60111.757812
|Xk-Y|_F:  59102.011719, |X-X0|:  1009.745911
rounded |X_k-Y|_0 = 57747, f1 =  0.607637, approx slack: 326727
rounded before pow |X_k-Y|_0 = 142967, f1 =  0.372642

Iteration 1940: Loss = 60088.976562
|Xk-Y|_F:  59081.765625, |X-X0|:  1007.212830
rounded |X_k-Y|_0 = 57733, f1 =  0.607747, approx slack: 326651
rounded before pow |X_k-Y|_0 = 142970, f1 =  0.372633

Iteration 1960: Loss = 60067.027344
|Xk-Y|_F:  59061.554688, |X-X0|:  1005.473328
rounded |X_k-Y|_0 = 57719, f1 =  0.607873, approx slack: 326542
rounded before pow |X_k-Y|_0 = 142847, f1 =  0.372684

Iteration 1980: Loss = 60050.234375
|Xk-Y|_F:  59043.222656, |X-X0|:  1007.011353
rounded |X_k-Y|_0 = 57723, f1 =  0.607846, approx slack: 326501
rounded before pow |X_k-Y|_0 = 142845, f1 =  0.372692

Iteration 2000: Loss = 60033.703125
|Xk-Y|_F:  59024.054688, |X-X0|:  1009.649658
rounded |X_k-Y|_0 = 57694, f1 =  0.608089, approx slack: 326393
rounded before pow |X_k-Y|_0 = 142768, f1 =  0.372675

Iteration 2020: Loss = 60006.613281
|Xk-Y|_F:  59005.003906, |X-X0|:  1001.610291
rounded |X_k-Y|_0 = 57666, f1 =  0.608307, approx slack: 326137
rounded before pow |X_k-Y|_0 = 142648, f1 =  0.372594

Iteration 2040: Loss = 59988.324219
|Xk-Y|_F:  58985.410156, |X-X0|:  1002.913513
rounded |X_k-Y|_0 = 57669, f1 =  0.608295, approx slack: 322197
rounded before pow |X_k-Y|_0 = 141417, f1 =  0.374136

Iteration 2060: Loss = 59968.179688
|Xk-Y|_F:  58968.039062, |X-X0|:  1000.141113
rounded |X_k-Y|_0 = 57643, f1 =  0.608505, approx slack: 322098
rounded before pow |X_k-Y|_0 = 141359, f1 =  0.374025

Converged at iteration 2064
------ ABL 0 after refine ------
--- eval ---
prediction result:
f1 on test:    0.3521
f1 on test:    0.6308 (micro)
f1 on KB:      0.4913
integrated f1: 0.4149, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3452
f1 on test:    0.6468 (micro)
f1 on KB:      0.5960
integrated f1: 0.4895, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.4149
Epoch 100, Total loss: 16298019.0000, CE loss: 2.8563, RL loss: 162980.1875, Reward: -51506.8203
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18146, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 200, Total loss: -130914096.0000, CE loss: 2.8567, RL loss: -1309141.0000, Reward: -51652.6318
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 17935, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 300, Total loss: -245348752.0000, CE loss: 2.8562, RL loss: -2453487.5000, Reward: -51634.5781
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18289, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 400, Total loss: -142376256.0000, CE loss: 2.8581, RL loss: -1423762.5000, Reward: -51571.5576
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18284, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 500, Total loss: 31442750.0000, CE loss: 2.8576, RL loss: 314427.5000, Reward: -51540.1172
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18375, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 600, Total loss: -44613848.0000, CE loss: 2.8571, RL loss: -446138.5000, Reward: -51554.1484
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 17998, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 700, Total loss: 469122464.0000, CE loss: 2.8580, RL loss: 4691224.5000, Reward: -51357.8379
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18112, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 800, Total loss: 145845760.0000, CE loss: 2.8578, RL loss: 1458457.6250, Reward: -51438.3945
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18148, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 900, Total loss: -445401344.0000, CE loss: 2.8573, RL loss: -4454013.5000, Reward: -51759.1074
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18180, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1000, Total loss: -236164944.0000, CE loss: 2.8572, RL loss: -2361649.5000, Reward: -51659.6826
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18190, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1100, Total loss: -45787836.0000, CE loss: 2.8575, RL loss: -457878.3750, Reward: -51637.2793
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 17981, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1200, Total loss: 210309792.0000, CE loss: 2.8569, RL loss: 2103098.0000, Reward: -51502.4268
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18275, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1300, Total loss: -162448272.0000, CE loss: 2.8580, RL loss: -1624482.7500, Reward: -51623.9648
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18189, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1400, Total loss: 120255104.0000, CE loss: 2.8571, RL loss: 1202551.0000, Reward: -51526.3457
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18186, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1500, Total loss: 438651840.0000, CE loss: 2.8576, RL loss: 4386518.5000, Reward: -51329.2725
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18115, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1600, Total loss: 68577800.0000, CE loss: 2.8575, RL loss: 685778.0000, Reward: -51464.3535
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18325, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1700, Total loss: 81846096.0000, CE loss: 2.8581, RL loss: 818460.9375, Reward: -51585.2412
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18104, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1800, Total loss: -445044096.0000, CE loss: 2.8569, RL loss: -4450441.0000, Reward: -51763.6318
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18218, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 1900, Total loss: -88976912.0000, CE loss: 2.8579, RL loss: -889769.1250, Reward: -51585.4023
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18306, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
--- eval ---
prediction result:
f1 on test:    0.3526
f1 on test:    0.6310 (micro)
f1 on KB:      0.4910
integrated f1: 0.4337, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3452
f1 on test:    0.6469 (micro)
f1 on KB:      0.5960
integrated f1: 0.5208, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: 208935024.0000, CE loss: 2.8576, RL loss: 2089350.2500, Reward: -51416.8818
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18023, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 2100, Total loss: 91440896.0000, CE loss: 2.8577, RL loss: 914408.9375, Reward: -51489.7285
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18354, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 2200, Total loss: 311485504.0000, CE loss: 2.8578, RL loss: 3114855.0000, Reward: -51398.5322
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18033, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 2300, Total loss: 25583496.0000, CE loss: 2.8569, RL loss: 255834.9688, Reward: -51420.6631
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18169, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 2400, Total loss: 34606016.0000, CE loss: 2.8581, RL loss: 346060.1562, Reward: -51528.1846
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18343, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 2500, Total loss: 206762560.0000, CE loss: 2.8572, RL loss: 2067625.6250, Reward: -51420.6719
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18152, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 2600, Total loss: 103662672.0000, CE loss: 2.8580, RL loss: 1036626.6875, Reward: -51508.8438
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18106, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 2700, Total loss: 266761728.0000, CE loss: 2.8577, RL loss: 2667617.2500, Reward: -51419.3994
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 17713, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 2800, Total loss: -290741312.0000, CE loss: 2.8566, RL loss: -2907413.2500, Reward: -51738.3340
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18019, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 2900, Total loss: -309050144.0000, CE loss: 2.8574, RL loss: -3090501.5000, Reward: -51619.6885
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18083, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3000, Total loss: -3743606.2500, CE loss: 2.8578, RL loss: -37436.0625, Reward: -51539.2090
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18148, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3100, Total loss: 253327104.0000, CE loss: 2.8576, RL loss: 2533271.0000, Reward: -51412.6475
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18191, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3200, Total loss: 327902432.0000, CE loss: 2.8568, RL loss: 3279024.2500, Reward: -51424.6895
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18313, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3300, Total loss: 26908260.0000, CE loss: 2.8578, RL loss: 269082.5938, Reward: -51547.5586
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 17986, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3400, Total loss: 258984448.0000, CE loss: 2.8571, RL loss: 2589844.5000, Reward: -51424.7139
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18145, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3500, Total loss: 453556512.0000, CE loss: 2.8583, RL loss: 4535565.0000, Reward: -51367.5625
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18312, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3600, Total loss: 412749856.0000, CE loss: 2.8570, RL loss: 4127498.5000, Reward: -51349.2148
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18080, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3700, Total loss: -90486520.0000, CE loss: 2.8575, RL loss: -904865.1875, Reward: -51594.6484
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18399, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3800, Total loss: 417595200.0000, CE loss: 2.8582, RL loss: 4175952.0000, Reward: -51323.4443
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18245, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 3900, Total loss: -374536448.0000, CE loss: 2.8582, RL loss: -3745364.5000, Reward: -51750.9863
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18041, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
--- eval ---
prediction result:
f1 on test:    0.3526
f1 on test:    0.6310 (micro)
f1 on KB:      0.4910
integrated f1: 0.4337, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3452
f1 on test:    0.6469 (micro)
f1 on KB:      0.5960
integrated f1: 0.5208, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: -124686776.0000, CE loss: 2.8572, RL loss: -1246867.7500, Reward: -51558.0078
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18288, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 4100, Total loss: -145886304.0000, CE loss: 2.8576, RL loss: -1458863.0000, Reward: -51625.5732
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18151, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 4200, Total loss: 295578816.0000, CE loss: 2.8582, RL loss: 2955788.2500, Reward: -51390.2969
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 17790, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 4300, Total loss: -698662528.0000, CE loss: 2.8586, RL loss: -6986625.5000, Reward: -51812.0010
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18072, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 4400, Total loss: 177480416.0000, CE loss: 2.8586, RL loss: 1774804.1250, Reward: -51417.4707
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 17992, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 4500, Total loss: 132481072.0000, CE loss: 2.8582, RL loss: 1324810.7500, Reward: -51471.0986
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18033, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 4600, Total loss: 122094384.0000, CE loss: 2.8571, RL loss: 1220943.8750, Reward: -51482.7568
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18076, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 4700, Total loss: 312744416.0000, CE loss: 2.8576, RL loss: 3127444.2500, Reward: -51362.8486
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 17927, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 4800, Total loss: 312057408.0000, CE loss: 2.8579, RL loss: 3120574.0000, Reward: -51387.1777
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18300, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 4900, Total loss: 744331264.0000, CE loss: 2.8574, RL loss: 7443312.5000, Reward: -51203.8340
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18037, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5000, Total loss: 740156992.0000, CE loss: 2.8583, RL loss: 7401570.0000, Reward: -51241.3193
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18197, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5100, Total loss: -247205072.0000, CE loss: 2.8583, RL loss: -2472050.7500, Reward: -51667.5576
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18022, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5200, Total loss: -161028768.0000, CE loss: 2.8568, RL loss: -1610287.7500, Reward: -51610.3047
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18410, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5300, Total loss: -111313616.0000, CE loss: 2.8579, RL loss: -1113136.1250, Reward: -51575.8535
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18159, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5400, Total loss: 93875824.0000, CE loss: 2.8571, RL loss: 938758.2500, Reward: -51431.3369
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18289, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5500, Total loss: -147150464.0000, CE loss: 2.8584, RL loss: -1471504.6250, Reward: -51613.1094
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18152, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5600, Total loss: -461381184.0000, CE loss: 2.8577, RL loss: -4613812.0000, Reward: -51753.7344
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18344, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5700, Total loss: 391731264.0000, CE loss: 2.8574, RL loss: 3917312.7500, Reward: -51317.0322
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18404, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5800, Total loss: -36342776.0000, CE loss: 2.8582, RL loss: -363427.7500, Reward: -51499.1592
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 17877, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 5900, Total loss: 210158880.0000, CE loss: 2.8575, RL loss: 2101588.7500, Reward: -51456.0879
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18488, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
--- eval ---
prediction result:
f1 on test:    0.3526
f1 on test:    0.6310 (micro)
f1 on KB:      0.4910
integrated f1: 0.4337, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3452
f1 on test:    0.6469 (micro)
f1 on KB:      0.5960
integrated f1: 0.5208, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: -334918080.0000, CE loss: 2.8573, RL loss: -3349180.7500, Reward: -51664.7568
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 17826, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 6100, Total loss: -26972868.0000, CE loss: 2.8569, RL loss: -269728.6875, Reward: -51596.0557
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18148, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 6200, Total loss: 188423104.0000, CE loss: 2.8577, RL loss: 1884231.0000, Reward: -51523.3154
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18194, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 6300, Total loss: -154479376.0000, CE loss: 2.8574, RL loss: -1544793.7500, Reward: -51609.4980
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 17894, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 6400, Total loss: 243308624.0000, CE loss: 2.8572, RL loss: 2433086.2500, Reward: -51475.6719
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 17934, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 6500, Total loss: 252089248.0000, CE loss: 2.8578, RL loss: 2520892.5000, Reward: -51420.2891
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18267, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 6600, Total loss: -336244864.0000, CE loss: 2.8576, RL loss: -3362448.5000, Reward: -51690.0381
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18311, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 6700, Total loss: -239205856.0000, CE loss: 2.8581, RL loss: -2392058.5000, Reward: -51697.1885
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18173, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 6800, Total loss: 500475104.0000, CE loss: 2.8584, RL loss: 5004751.0000, Reward: -51331.1709
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18359, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 6900, Total loss: -24158828.0000, CE loss: 2.8575, RL loss: -241588.2812, Reward: -51575.9531
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18206, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7000, Total loss: -44943624.0000, CE loss: 2.8573, RL loss: -449436.2500, Reward: -51533.3350
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18044, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7100, Total loss: 66324476.0000, CE loss: 2.8571, RL loss: 663244.7500, Reward: -51502.2725
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18151, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7200, Total loss: -74574640.0000, CE loss: 2.8574, RL loss: -745746.3750, Reward: -51593.0771
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18068, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7300, Total loss: -8129381.0000, CE loss: 2.8574, RL loss: -81293.8125, Reward: -51467.3340
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18098, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7400, Total loss: 259509168.0000, CE loss: 2.8573, RL loss: 2595091.7500, Reward: -51395.1816
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18171, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7500, Total loss: 9535041.0000, CE loss: 2.8575, RL loss: 95350.4062, Reward: -51586.3672
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18084, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7600, Total loss: -373486144.0000, CE loss: 2.8577, RL loss: -3734861.5000, Reward: -51704.1367
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18091, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7700, Total loss: -357604640.0000, CE loss: 2.8578, RL loss: -3576046.5000, Reward: -51712.8604
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18184, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7800, Total loss: -294643040.0000, CE loss: 2.8568, RL loss: -2946430.5000, Reward: -51606.3604
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18616, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
Epoch 7900, Total loss: 203109952.0000, CE loss: 2.8584, RL loss: 2031099.5000, Reward: -51441.9785
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18480, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
--- eval ---
prediction result:
f1 on test:    0.3526
f1 on test:    0.6310 (micro)
f1 on KB:      0.4910
integrated f1: 0.4337, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3452
f1 on test:    0.6469 (micro)
f1 on KB:      0.5960
integrated f1: 0.5208, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: -161045136.0000, CE loss: 2.8581, RL loss: -1610451.3750, Reward: -51621.4570
    full cols: 171, non-full cols: 0
   r - labels: 13, labels - r: 3
    violated: 18088, weighted: 216.4705810546875, len: 0.0, nonzero: 0.11294583976268768
------ ABL Loop 1 ------
--- eval ---
prediction result:
f1 on test:    0.3526
f1 on test:    0.6310 (micro)
f1 on KB:      0.4910
integrated f1: 0.4151, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3452
f1 on test:    0.6469 (micro)
f1 on KB:      0.5960
integrated f1: 0.4895, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.4151
Iteration 0: Loss = 107940.484375
|Xk-Y|_F:  107940.484375, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 107948, f1 =  0.301263, approx slack: 51675
rounded before pow |X_k-Y|_0 = 107948, f1 =  0.301263

Iteration 20: Loss = 87716.031250
|Xk-Y|_F:  77381.273438, |X-X0|:  10334.757812
rounded |X_k-Y|_0 = 75251, f1 =  0.620775, approx slack: 1185769
rounded before pow |X_k-Y|_0 = 119406, f1 =  0.482045

Iteration 40: Loss = 82064.875000
|Xk-Y|_F:  73794.828125, |X-X0|:  8270.049805
rounded |X_k-Y|_0 = 73620, f1 =  0.629333, approx slack: 988824
rounded before pow |X_k-Y|_0 = 115564, f1 =  0.490756

Iteration 60: Loss = 80457.093750
|Xk-Y|_F:  73382.890625, |X-X0|:  7074.205078
rounded |X_k-Y|_0 = 73367, f1 =  0.630775, approx slack: 853358
rounded before pow |X_k-Y|_0 = 114830, f1 =  0.492566

Iteration 80: Loss = 79772.625000
|Xk-Y|_F:  73240.679688, |X-X0|:  6531.947266
rounded |X_k-Y|_0 = 73242, f1 =  0.631405, approx slack: 764412
rounded before pow |X_k-Y|_0 = 112736, f1 =  0.498242

Iteration 100: Loss = 79353.000000
|Xk-Y|_F:  73136.968750, |X-X0|:  6216.032227
rounded |X_k-Y|_0 = 73182, f1 =  0.631707, approx slack: 746185
rounded before pow |X_k-Y|_0 = 112614, f1 =  0.498540

Iteration 120: Loss = 79023.007812
|Xk-Y|_F:  73064.656250, |X-X0|:  5958.354492
rounded |X_k-Y|_0 = 73134, f1 =  0.631949, approx slack: 699397
rounded before pow |X_k-Y|_0 = 111098, f1 =  0.502198

Iteration 140: Loss = 78797.765625
|Xk-Y|_F:  73006.015625, |X-X0|:  5791.748047
rounded |X_k-Y|_0 = 73061, f1 =  0.632318, approx slack: 673850
rounded before pow |X_k-Y|_0 = 108166, f1 =  0.509498

Iteration 160: Loss = 78623.421875
|Xk-Y|_F:  72961.929688, |X-X0|:  5661.493164
rounded |X_k-Y|_0 = 73002, f1 =  0.632613, approx slack: 697533
rounded before pow |X_k-Y|_0 = 110995, f1 =  0.502449

Iteration 180: Loss = 78491.710938
|Xk-Y|_F:  72928.695312, |X-X0|:  5563.016602
rounded |X_k-Y|_0 = 72948, f1 =  0.632883, approx slack: 686212
rounded before pow |X_k-Y|_0 = 110815, f1 =  0.502889

Iteration 200: Loss = 78377.843750
|Xk-Y|_F:  72904.398438, |X-X0|:  5473.444824
rounded |X_k-Y|_0 = 72931, f1 =  0.632968, approx slack: 360447
rounded before pow |X_k-Y|_0 = 101989, f1 =  0.525930

Iteration 220: Loss = 78271.242188
|Xk-Y|_F:  72885.515625, |X-X0|:  5385.727539
rounded |X_k-Y|_0 = 72909, f1 =  0.633078, approx slack: 353531
rounded before pow |X_k-Y|_0 = 101494, f1 =  0.527313

Iteration 240: Loss = 78182.421875
|Xk-Y|_F:  72868.460938, |X-X0|:  5313.957031
rounded |X_k-Y|_0 = 72891, f1 =  0.633168, approx slack: 343319
rounded before pow |X_k-Y|_0 = 101148, f1 =  0.528288

Iteration 260: Loss = 78092.476562
|Xk-Y|_F:  72854.242188, |X-X0|:  5238.233398
rounded |X_k-Y|_0 = 72868, f1 =  0.633283, approx slack: 313944
rounded before pow |X_k-Y|_0 = 100274, f1 =  0.530765

Iteration 280: Loss = 78004.679688
|Xk-Y|_F:  72842.414062, |X-X0|:  5162.267578
rounded |X_k-Y|_0 = 72868, f1 =  0.633283, approx slack: 311700
rounded before pow |X_k-Y|_0 = 100271, f1 =  0.530773

Iteration 300: Loss = 77899.898438
|Xk-Y|_F:  72832.250000, |X-X0|:  5067.648926
rounded |X_k-Y|_0 = 72859, f1 =  0.633328, approx slack: 308591
rounded before pow |X_k-Y|_0 = 99898, f1 =  0.531835

Iteration 320: Loss = 77823.421875
|Xk-Y|_F:  72822.304688, |X-X0|:  5001.118164
rounded |X_k-Y|_0 = 72844, f1 =  0.633402, approx slack: 307705
rounded before pow |X_k-Y|_0 = 100136, f1 =  0.531161

Iteration 340: Loss = 77729.546875
|Xk-Y|_F:  72813.804688, |X-X0|:  4915.744141
rounded |X_k-Y|_0 = 72827, f1 =  0.633487, approx slack: 305117
rounded before pow |X_k-Y|_0 = 99823, f1 =  0.532052

Iteration 360: Loss = 77635.765625
|Xk-Y|_F:  72806.148438, |X-X0|:  4829.621094
rounded |X_k-Y|_0 = 72813, f1 =  0.633557, approx slack: 301927
rounded before pow |X_k-Y|_0 = 99736, f1 =  0.532303

Iteration 380: Loss = 77528.851562
|Xk-Y|_F:  72799.578125, |X-X0|:  4729.270508
rounded |X_k-Y|_0 = 72803, f1 =  0.633607, approx slack: 273747
rounded before pow |X_k-Y|_0 = 92913, f1 =  0.553201

Iteration 400: Loss = 77446.531250
|Xk-Y|_F:  72792.531250, |X-X0|:  4654.000977
rounded |X_k-Y|_0 = 72793, f1 =  0.633657, approx slack: 269732
rounded before pow |X_k-Y|_0 = 92909, f1 =  0.553214

Iteration 420: Loss = 77390.500000
|Xk-Y|_F:  72785.296875, |X-X0|:  4605.207031
rounded |X_k-Y|_0 = 72784, f1 =  0.633702, approx slack: 261101
rounded before pow |X_k-Y|_0 = 91462, f1 =  0.557968

Iteration 440: Loss = 77300.906250
|Xk-Y|_F:  72779.585938, |X-X0|:  4521.322266
rounded |X_k-Y|_0 = 72778, f1 =  0.633732, approx slack: 258671
rounded before pow |X_k-Y|_0 = 91338, f1 =  0.558382

Iteration 460: Loss = 77239.906250
|Xk-Y|_F:  72771.796875, |X-X0|:  4468.112305
rounded |X_k-Y|_0 = 72769, f1 =  0.633777, approx slack: 256337
rounded before pow |X_k-Y|_0 = 91063, f1 =  0.559302

Iteration 480: Loss = 77211.390625
|Xk-Y|_F:  72763.945312, |X-X0|:  4447.442383
rounded |X_k-Y|_0 = 72766, f1 =  0.633791, approx slack: 255358
rounded before pow |X_k-Y|_0 = 91061, f1 =  0.559309

Iteration 500: Loss = 77181.976562
|Xk-Y|_F:  72756.945312, |X-X0|:  4425.027832
rounded |X_k-Y|_0 = 72762, f1 =  0.633811, approx slack: 254135
rounded before pow |X_k-Y|_0 = 91061, f1 =  0.559309

Iteration 520: Loss = 77072.312500
|Xk-Y|_F:  72751.085938, |X-X0|:  4321.227539
rounded |X_k-Y|_0 = 72744, f1 =  0.633901, approx slack: 252217
rounded before pow |X_k-Y|_0 = 90964, f1 =  0.559635

Iteration 540: Loss = 77024.273438
|Xk-Y|_F:  72745.375000, |X-X0|:  4278.896973
rounded |X_k-Y|_0 = 72745, f1 =  0.633896, approx slack: 250164
rounded before pow |X_k-Y|_0 = 90910, f1 =  0.559817

Iteration 560: Loss = 76964.570312
|Xk-Y|_F:  72740.648438, |X-X0|:  4223.923828
rounded |X_k-Y|_0 = 72738, f1 =  0.633931, approx slack: 249161
rounded before pow |X_k-Y|_0 = 90906, f1 =  0.559830

Iteration 580: Loss = 76940.726562
|Xk-Y|_F:  72735.015625, |X-X0|:  4205.711426
rounded |X_k-Y|_0 = 72735, f1 =  0.633946, approx slack: 248357
rounded before pow |X_k-Y|_0 = 90898, f1 =  0.559857

Iteration 600: Loss = 76855.296875
|Xk-Y|_F:  72729.210938, |X-X0|:  4126.087402
rounded |X_k-Y|_0 = 72733, f1 =  0.633956, approx slack: 248047
rounded before pow |X_k-Y|_0 = 90896, f1 =  0.559864

Iteration 620: Loss = 76822.015625
|Xk-Y|_F:  72724.289062, |X-X0|:  4097.725098
rounded |X_k-Y|_0 = 72728, f1 =  0.633981, approx slack: 245874
rounded before pow |X_k-Y|_0 = 90687, f1 =  0.560570

Iteration 640: Loss = 76795.921875
|Xk-Y|_F:  72719.234375, |X-X0|:  4076.688477
rounded |X_k-Y|_0 = 72725, f1 =  0.633996, approx slack: 241499
rounded before pow |X_k-Y|_0 = 90685, f1 =  0.560577

Iteration 660: Loss = 76779.742188
|Xk-Y|_F:  72713.687500, |X-X0|:  4066.057373
rounded |X_k-Y|_0 = 72722, f1 =  0.634011, approx slack: 242007
rounded before pow |X_k-Y|_0 = 90988, f1 =  0.559563

Iteration 680: Loss = 76760.070312
|Xk-Y|_F:  72708.421875, |X-X0|:  4051.651367
rounded |X_k-Y|_0 = 72722, f1 =  0.634011, approx slack: 242296
rounded before pow |X_k-Y|_0 = 90988, f1 =  0.559563

Iteration 700: Loss = 76737.429688
|Xk-Y|_F:  72702.695312, |X-X0|:  4034.732422
rounded |X_k-Y|_0 = 72709, f1 =  0.634076, approx slack: 211676
rounded before pow |X_k-Y|_0 = 90059, f1 =  0.562715

Iteration 720: Loss = 76711.328125
|Xk-Y|_F:  72697.281250, |X-X0|:  4014.048828
rounded |X_k-Y|_0 = 72713, f1 =  0.634056, approx slack: 211146
rounded before pow |X_k-Y|_0 = 89609, f1 =  0.564262

Iteration 740: Loss = 76675.914062
|Xk-Y|_F:  72690.382812, |X-X0|:  3985.531738
rounded |X_k-Y|_0 = 72700, f1 =  0.634121, approx slack: 210482
rounded before pow |X_k-Y|_0 = 89609, f1 =  0.564262

Iteration 760: Loss = 76640.328125
|Xk-Y|_F:  72683.468750, |X-X0|:  3956.857910
rounded |X_k-Y|_0 = 72690, f1 =  0.634171, approx slack: 208930
rounded before pow |X_k-Y|_0 = 89509, f1 =  0.564607

Iteration 780: Loss = 76575.062500
|Xk-Y|_F:  72676.148438, |X-X0|:  3898.913086
rounded |X_k-Y|_0 = 72690, f1 =  0.634171, approx slack: 208722
rounded before pow |X_k-Y|_0 = 89509, f1 =  0.564607

Iteration 800: Loss = 76546.078125
|Xk-Y|_F:  72668.265625, |X-X0|:  3877.813965
rounded |X_k-Y|_0 = 72686, f1 =  0.634190, approx slack: 208330
rounded before pow |X_k-Y|_0 = 89509, f1 =  0.564607

Iteration 820: Loss = 76524.187500
|Xk-Y|_F:  72661.476562, |X-X0|:  3862.708740
rounded |X_k-Y|_0 = 72671, f1 =  0.634265, approx slack: 212226
rounded before pow |X_k-Y|_0 = 89531, f1 =  0.564537

Iteration 840: Loss = 76497.445312
|Xk-Y|_F:  72656.320312, |X-X0|:  3841.124512
rounded |X_k-Y|_0 = 72662, f1 =  0.634310, approx slack: 211434
rounded before pow |X_k-Y|_0 = 89491, f1 =  0.564675

Iteration 860: Loss = 76472.992188
|Xk-Y|_F:  72650.468750, |X-X0|:  3822.522705
rounded |X_k-Y|_0 = 72659, f1 =  0.634325, approx slack: 210225
rounded before pow |X_k-Y|_0 = 89399, f1 =  0.564993

Iteration 880: Loss = 76443.195312
|Xk-Y|_F:  72646.750000, |X-X0|:  3796.443848
rounded |X_k-Y|_0 = 72658, f1 =  0.634330, approx slack: 208656
rounded before pow |X_k-Y|_0 = 89247, f1 =  0.565521

Iteration 900: Loss = 76365.140625
|Xk-Y|_F:  72643.132812, |X-X0|:  3722.005859
rounded |X_k-Y|_0 = 72657, f1 =  0.634335, approx slack: 199682
rounded before pow |X_k-Y|_0 = 88689, f1 =  0.567465

Converged at iteration 903
------ ABL 1 after refine ------
--- eval ---
prediction result:
f1 on test:    0.3526
f1 on test:    0.6310 (micro)
f1 on KB:      0.5348
integrated f1: 0.4292, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3427
f1 on test:    0.6461 (micro)
f1 on KB:      0.6327
integrated f1: 0.5095, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.4292
