GNN_eco_Sep3_1
log/EGOAL-eco-2025-09-03-15:26:14.464241.txt
random seed: 42
train shape: torch.Size([434, 1514]), test shape: torch.Size([72, 1514])
cuda availability: True
/home/u-xiangyf/anaconda3/envs/egoal/lib/python3.13/site-packages/torch/nn/modules/loss.py:608: UserWarning: Using a target size (torch.Size([1514])) that is different to the input size (torch.Size([4639, 1514])). This will likely lead to incorrect results due to broadcasting. Please ensure they have the same size.
  return F.mse_loss(input, target, reduction=self.reduction)
Epoch 0, Loss: 0.2187
Epoch 100, Loss: 0.1885
Epoch 200, Loss: 0.1160
Epoch 300, Loss: 0.0546
Epoch 400, Loss: 0.0255
Epoch 500, Loss: 0.0136
Epoch 600, Loss: 0.0082
Epoch 700, Loss: 0.0054
Epoch 800, Loss: 0.0039
Epoch 900, Loss: 0.0029
Final loss: 0.002231838181614876
Achieved outputs: tensor([[0.2045, 0.0367, 0.0336,  ..., 0.0380, 0.0283, 0.0265],
        [0.2305, 0.0550, 0.0503,  ..., 0.0547, 0.0440, 0.0408],
        [0.2544, 0.0711, 0.0632,  ..., 0.0699, 0.0570, 0.0520],
        ...,
        [0.2596, 0.0757, 0.0688,  ..., 0.0747, 0.0614, 0.0562],
        [0.2426, 0.0651, 0.0590,  ..., 0.0640, 0.0518, 0.0479],
        [0.2402, 0.0584, 0.0526,  ..., 0.0580, 0.0464, 0.0421]],
       device='cuda:1')
Eval weight w_data: 0.4246200244007528
Before pretrain: integrated f1 0.2367
Epoch 100, Total loss: 193468336.0000, CE loss: 6.4044, RL loss: 19346834.0000, Reward: -140352.5557
    full cols: 113, non-full cols: 362
   r - labels: 315, labels - r: 1
    violated: 12684, weighted: 5696.4658203125, len: 0.0, nonzero: 0.2051684409379959
Epoch 200, Total loss: 32160888.0000, CE loss: 6.3730, RL loss: 3216088.2500, Reward: -122847.1699
    full cols: 143, non-full cols: 52
   r - labels: 36, labels - r: 2
    violated: 14897, weighted: 59.89411163330078, len: 0.0, nonzero: 0.1053500697016716
Epoch 300, Total loss: -16554702.0000, CE loss: 6.3180, RL loss: -1655470.7500, Reward: -123337.4551
    full cols: 141, non-full cols: 57
   r - labels: 37, labels - r: 0
    violated: 12924, weighted: 51.57579040527344, len: 0.0, nonzero: 0.10566999763250351
Epoch 400, Total loss: 11263398.0000, CE loss: 6.2510, RL loss: 1126339.2500, Reward: -123009.2002
    full cols: 141, non-full cols: 57
   r - labels: 37, labels - r: 0
    violated: 17623, weighted: 75.80270385742188, len: 0.0, nonzero: 0.10660915076732635
Epoch 500, Total loss: -20482838.0000, CE loss: 6.2173, RL loss: -2048284.5000, Reward: -123212.8418
    full cols: 140, non-full cols: 56
   r - labels: 35, labels - r: 0
    violated: 16640, weighted: 68.35338592529297, len: 0.0, nonzero: 0.10617569833993912
------ Before ABL ------
--- eval ---
prediction result:
f1 on test:    0.3747
f1 on test:    0.6467 (micro)
f1 on KB:      0.3629
integrated f1: 0.3678, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3756
f1 on test:    0.6510 (micro)
f1 on KB:      0.4875
integrated f1: 0.4400, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3678

Epoch 100, Total loss: 39643944.0000, CE loss: 3.6145, RL loss: 396439.4375, Reward: -59772.5000
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 36242, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 200, Total loss: 218836224.0000, CE loss: 3.5955, RL loss: 2188362.2500, Reward: -58170.2217
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32478, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 300, Total loss: 158326144.0000, CE loss: 3.5987, RL loss: 1583261.5000, Reward: -58538.6680
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 34052, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 400, Total loss: 344137568.0000, CE loss: 3.5949, RL loss: 3441375.7500, Reward: -59406.6465
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 36705, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 500, Total loss: -169528032.0000, CE loss: 3.5943, RL loss: -1695280.3750, Reward: -57956.9385
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 31613, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 600, Total loss: -421751904.0000, CE loss: 3.6011, RL loss: -4217519.0000, Reward: -58138.5986
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 31669, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 700, Total loss: 358490336.0000, CE loss: 3.6029, RL loss: 3584903.5000, Reward: -57640.3252
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 31420, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 800, Total loss: 94741952.0000, CE loss: 3.5912, RL loss: 947419.5000, Reward: -57832.1904
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 31959, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 900, Total loss: -171295632.0000, CE loss: 3.5812, RL loss: -1712956.2500, Reward: -58283.0146
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32733, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 1000, Total loss: 61181936.0000, CE loss: 3.5832, RL loss: 611819.3750, Reward: -58620.5332
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33919, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 1100, Total loss: 148939296.0000, CE loss: 3.8524, RL loss: 1489393.0000, Reward: -59821.7119
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 36757, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 1200, Total loss: -497887040.0000, CE loss: 3.6429, RL loss: -4978870.5000, Reward: -57433.9482
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 31677, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 1300, Total loss: -466267904.0000, CE loss: 3.6030, RL loss: -4662679.0000, Reward: -57980.3252
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32119, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 1400, Total loss: 222092080.0000, CE loss: 3.5772, RL loss: 2220920.7500, Reward: -57996.1426
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32230, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 1500, Total loss: 498186816.0000, CE loss: 3.5876, RL loss: 4981868.0000, Reward: -57716.4805
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32081, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 1600, Total loss: 43145592.0000, CE loss: 3.5887, RL loss: 431455.9375, Reward: -57781.2314
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32221, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 1700, Total loss: -54112344.0000, CE loss: 3.5869, RL loss: -541123.4375, Reward: -57904.4189
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32652, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 1800, Total loss: 249771344.0000, CE loss: 3.5877, RL loss: 2497713.5000, Reward: -57865.0303
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32264, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 1900, Total loss: 5221679.5000, CE loss: 3.5903, RL loss: 52216.7969, Reward: -58044.6436
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33206, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
--- eval ---
prediction result:
f1 on test:    0.3916
f1 on test:    0.5969 (micro)
f1 on KB:      0.3400
integrated f1: 0.3533, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3927
f1 on test:    0.6026 (micro)
f1 on KB:      0.4350
integrated f1: 0.4223, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: 230680256.0000, CE loss: 3.5819, RL loss: 2306802.5000, Reward: -58120.9873
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33172, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 2100, Total loss: 336360512.0000, CE loss: 3.5836, RL loss: 3363605.2500, Reward: -57927.2695
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33628, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 2200, Total loss: -171970672.0000, CE loss: 3.5846, RL loss: -1719706.7500, Reward: -58192.3027
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33405, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 2300, Total loss: 94580856.0000, CE loss: 3.5885, RL loss: 945808.5625, Reward: -58034.4854
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33276, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 2400, Total loss: -131991728.0000, CE loss: 3.5873, RL loss: -1319917.2500, Reward: -58116.1553
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32473, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 2500, Total loss: 313577664.0000, CE loss: 3.5868, RL loss: 3135776.5000, Reward: -57893.0645
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33311, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 2600, Total loss: 138975632.0000, CE loss: 3.5832, RL loss: 1389756.2500, Reward: -57964.5527
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33913, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 2700, Total loss: 380786464.0000, CE loss: 3.5919, RL loss: 3807864.5000, Reward: -57723.2646
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32092, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 2800, Total loss: 175626000.0000, CE loss: 3.5904, RL loss: 1756260.0000, Reward: -57760.6475
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32368, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 2900, Total loss: 119175336.0000, CE loss: 3.5927, RL loss: 1191753.3750, Reward: -57744.1240
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 31757, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 3000, Total loss: -116187848.0000, CE loss: 3.5846, RL loss: -1161878.5000, Reward: -58079.4082
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32791, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 3100, Total loss: -163277088.0000, CE loss: 3.5897, RL loss: -1632770.8750, Reward: -58068.7334
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32990, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 3200, Total loss: 392665312.0000, CE loss: 3.5826, RL loss: 3926653.2500, Reward: -57839.2822
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33526, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 3300, Total loss: -189963904.0000, CE loss: 3.5796, RL loss: -1899639.0000, Reward: -58371.1670
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33230, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 3400, Total loss: -112760824.0000, CE loss: 3.5774, RL loss: -1127608.2500, Reward: -58326.5234
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33859, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 3500, Total loss: -591017408.0000, CE loss: 3.5794, RL loss: -5910174.0000, Reward: -58356.7393
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33128, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 3600, Total loss: 91327520.0000, CE loss: 3.5829, RL loss: 913275.1875, Reward: -57979.1064
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32967, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 3700, Total loss: -29837428.0000, CE loss: 3.5858, RL loss: -298374.2812, Reward: -57813.0850
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 30833, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 3800, Total loss: 196706496.0000, CE loss: 3.5802, RL loss: 1967065.0000, Reward: -57766.1494
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32228, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 3900, Total loss: 133950704.0000, CE loss: 3.5844, RL loss: 1339507.0000, Reward: -57841.5752
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33141, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
--- eval ---
prediction result:
f1 on test:    0.3913
f1 on test:    0.5987 (micro)
f1 on KB:      0.3398
integrated f1: 0.3531, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3914
f1 on test:    0.6042 (micro)
f1 on KB:      0.4359
integrated f1: 0.4226, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: 247563008.0000, CE loss: 3.5894, RL loss: 2475630.0000, Reward: -57697.1260
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32127, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 4100, Total loss: 199722576.0000, CE loss: 3.5856, RL loss: 1997225.7500, Reward: -57844.4707
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 31935, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 4200, Total loss: 32128946.0000, CE loss: 3.5801, RL loss: 321289.4688, Reward: -58210.8564
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33040, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 4300, Total loss: 39374568.0000, CE loss: 3.5819, RL loss: 393745.6875, Reward: -58029.4541
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33207, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 4400, Total loss: 416732096.0000, CE loss: 3.5885, RL loss: 4167321.0000, Reward: -58006.8525
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33543, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 4500, Total loss: 168759280.0000, CE loss: 3.5845, RL loss: 1687592.7500, Reward: -58278.1436
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32930, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 4600, Total loss: -81074728.0000, CE loss: 3.6092, RL loss: -810747.3125, Reward: -58551.7598
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 34050, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 4700, Total loss: 438609504.0000, CE loss: 3.6006, RL loss: 4386095.0000, Reward: -58653.2617
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 35975, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 4800, Total loss: -515048992.0000, CE loss: 3.5980, RL loss: -5150490.0000, Reward: -58801.6182
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 34637, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 4900, Total loss: 212362000.0000, CE loss: 3.5962, RL loss: 2123620.0000, Reward: -58446.3877
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33845, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 5000, Total loss: 167124704.0000, CE loss: 3.5861, RL loss: 1671247.0000, Reward: -58198.5928
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33553, weighted: 379.81536865234375, len: 0.0, nonzero: 0.11756935715675354
Epoch 5100, Total loss: -219007280.0000, CE loss: 3.5963, RL loss: -2190072.7500, Reward: -57633.7695
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32828, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 5200, Total loss: -140027088.0000, CE loss: 3.5945, RL loss: -1400270.8750, Reward: -57903.4521
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32822, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 5300, Total loss: -237355632.0000, CE loss: 3.5930, RL loss: -2373556.2500, Reward: -58300.1357
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33497, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 5400, Total loss: -295809312.0000, CE loss: 3.5877, RL loss: -2958093.0000, Reward: -58497.5420
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33676, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 5500, Total loss: 156398928.0000, CE loss: 3.5933, RL loss: 1563989.2500, Reward: -58122.9473
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33166, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 5600, Total loss: -72580272.0000, CE loss: 3.5942, RL loss: -725802.6875, Reward: -58160.1533
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33084, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 5700, Total loss: 208093376.0000, CE loss: 3.5960, RL loss: 2080933.7500, Reward: -58033.7051
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33659, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 5800, Total loss: -19716340.0000, CE loss: 3.5986, RL loss: -197163.4062, Reward: -57990.0146
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33369, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 5900, Total loss: -396905120.0000, CE loss: 3.5976, RL loss: -3969051.2500, Reward: -57857.7754
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33117, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
--- eval ---
prediction result:
f1 on test:    0.3917
f1 on test:    0.6036 (micro)
f1 on KB:      0.3416
integrated f1: 0.3545, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3900
f1 on test:    0.6077 (micro)
f1 on KB:      0.4378
integrated f1: 0.4234, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: 654362304.0000, CE loss: 3.6176, RL loss: 6543623.0000, Reward: -57124.9424
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 30680, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 6100, Total loss: -52724448.0000, CE loss: 3.6122, RL loss: -527244.5000, Reward: -57750.4102
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 31287, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 6200, Total loss: -225444496.0000, CE loss: 3.6182, RL loss: -2254445.0000, Reward: -57466.4268
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 31317, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 6300, Total loss: -184901296.0000, CE loss: 3.5907, RL loss: -1849013.0000, Reward: -58229.2920
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32691, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 6400, Total loss: 110409000.0000, CE loss: 3.5897, RL loss: 1104090.0000, Reward: -58222.8271
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33964, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 6500, Total loss: -92053808.0000, CE loss: 3.5926, RL loss: -920538.0625, Reward: -58268.2979
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33350, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 6600, Total loss: 31499146.0000, CE loss: 3.5827, RL loss: 314991.4688, Reward: -58187.8027
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33124, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 6700, Total loss: -82815800.0000, CE loss: 3.5868, RL loss: -828158.0000, Reward: -58246.2285
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33505, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 6800, Total loss: 229599024.0000, CE loss: 3.5814, RL loss: 2295990.2500, Reward: -58139.2617
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33584, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 6900, Total loss: 84975968.0000, CE loss: 3.5820, RL loss: 849759.6875, Reward: -58160.0049
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33257, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7000, Total loss: 295934208.0000, CE loss: 3.5807, RL loss: 2959342.0000, Reward: -58100.5840
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32926, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7100, Total loss: -99083288.0000, CE loss: 3.5860, RL loss: -990832.8750, Reward: -58231.3955
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32734, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7200, Total loss: 518060960.0000, CE loss: 3.5807, RL loss: 5180609.5000, Reward: -57862.9570
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33706, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7300, Total loss: -165394144.0000, CE loss: 3.5830, RL loss: -1653941.5000, Reward: -58296.0537
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32051, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7400, Total loss: -148728544.0000, CE loss: 3.5866, RL loss: -1487285.5000, Reward: -58191.5986
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32972, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7500, Total loss: -317848832.0000, CE loss: 3.5817, RL loss: -3178488.2500, Reward: -58312.7764
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33084, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7600, Total loss: 44105024.0000, CE loss: 3.5803, RL loss: 441050.2500, Reward: -58141.0742
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33781, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7700, Total loss: -305839552.0000, CE loss: 3.5807, RL loss: -3058395.5000, Reward: -58358.9385
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32751, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7800, Total loss: 352014208.0000, CE loss: 3.5819, RL loss: 3520142.0000, Reward: -57946.3867
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33493, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7900, Total loss: 193730032.0000, CE loss: 3.5819, RL loss: 1937300.3750, Reward: -58058.8535
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 33929, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
--- eval ---
prediction result:
f1 on test:    0.3932
f1 on test:    0.5971 (micro)
f1 on KB:      0.3445
integrated f1: 0.3572, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3905
f1 on test:    0.6019 (micro)
f1 on KB:      0.4367
integrated f1: 0.4229, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: 535617248.0000, CE loss: 3.5817, RL loss: 5356172.5000, Reward: -57989.9766
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 32719, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
------ ABL Loop 0 ------
--- eval ---
prediction result:
f1 on test:    0.3932
f1 on test:    0.5971 (micro)
f1 on KB:      0.3445
integrated f1: 0.3629, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3905
f1 on test:    0.6019 (micro)
f1 on KB:      0.4367
integrated f1: 0.4171, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3629
Iteration 0: Loss = 180350.406250
|Xk-Y|_F:  180350.406250, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 160237, f1 =  0.309917, approx slack: 351113
rounded before pow |X_k-Y|_0 = 160237, f1 =  0.309917

Iteration 20: Loss = 180400.406250
|Xk-Y|_F:  177804.187500, |X-X0|:  2596.223877
rounded |X_k-Y|_0 = 159257, f1 =  0.316382, approx slack: 53491
rounded before pow |X_k-Y|_0 = 166286, f1 =  0.328981

Iteration 40: Loss = 177537.656250
|Xk-Y|_F:  176428.781250, |X-X0|:  1108.876953
rounded |X_k-Y|_0 = 159052, f1 =  0.317206, approx slack: 89052
rounded before pow |X_k-Y|_0 = 166980, f1 =  0.347726

Iteration 60: Loss = 175500.359375
|Xk-Y|_F:  174542.046875, |X-X0|:  958.312378
rounded |X_k-Y|_0 = 158859, f1 =  0.318208, approx slack: 101714
rounded before pow |X_k-Y|_0 = 170159, f1 =  0.350019

Iteration 80: Loss = 173014.468750
|Xk-Y|_F:  171899.234375, |X-X0|:  1115.231445
rounded |X_k-Y|_0 = 157671, f1 =  0.325448, approx slack: 110989
rounded before pow |X_k-Y|_0 = 175175, f1 =  0.349103

Iteration 100: Loss = 169354.500000
|Xk-Y|_F:  167985.578125, |X-X0|:  1368.926025
rounded |X_k-Y|_0 = 155459, f1 =  0.338072, approx slack: 123174
rounded before pow |X_k-Y|_0 = 179140, f1 =  0.352620

Iteration 120: Loss = 164784.281250
|Xk-Y|_F:  163343.093750, |X-X0|:  1441.180786
rounded |X_k-Y|_0 = 145462, f1 =  0.364104, approx slack: 129507
rounded before pow |X_k-Y|_0 = 179472, f1 =  0.354525

Iteration 140: Loss = 161146.531250
|Xk-Y|_F:  159701.828125, |X-X0|:  1444.704712
rounded |X_k-Y|_0 = 141321, f1 =  0.380794, approx slack: 134331
rounded before pow |X_k-Y|_0 = 177764, f1 =  0.357196

Iteration 160: Loss = 157993.250000
|Xk-Y|_F:  156528.203125, |X-X0|:  1465.049927
rounded |X_k-Y|_0 = 139904, f1 =  0.386354, approx slack: 125071
rounded before pow |X_k-Y|_0 = 173717, f1 =  0.363062

Iteration 180: Loss = 154466.343750
|Xk-Y|_F:  153053.765625, |X-X0|:  1412.573486
rounded |X_k-Y|_0 = 137576, f1 =  0.395147, approx slack: 95215
rounded before pow |X_k-Y|_0 = 168068, f1 =  0.370436

Iteration 200: Loss = 151259.406250
|Xk-Y|_F:  149913.171875, |X-X0|:  1346.230713
rounded |X_k-Y|_0 = 134111, f1 =  0.402199, approx slack: 82770
rounded before pow |X_k-Y|_0 = 162688, f1 =  0.376585

Iteration 220: Loss = 148198.156250
|Xk-Y|_F:  146862.453125, |X-X0|:  1335.696289
rounded |X_k-Y|_0 = 131271, f1 =  0.407624, approx slack: 80036
rounded before pow |X_k-Y|_0 = 161693, f1 =  0.378773

Iteration 240: Loss = 145001.046875
|Xk-Y|_F:  143685.203125, |X-X0|:  1315.837524
rounded |X_k-Y|_0 = 129769, f1 =  0.411094, approx slack: 83281
rounded before pow |X_k-Y|_0 = 160779, f1 =  0.380103

Iteration 260: Loss = 141556.890625
|Xk-Y|_F:  140265.843750, |X-X0|:  1291.052979
rounded |X_k-Y|_0 = 127115, f1 =  0.415287, approx slack: 85663
rounded before pow |X_k-Y|_0 = 159667, f1 =  0.381212

Iteration 280: Loss = 137815.359375
|Xk-Y|_F:  136536.562500, |X-X0|:  1278.800659
rounded |X_k-Y|_0 = 124664, f1 =  0.419225, approx slack: 90383
rounded before pow |X_k-Y|_0 = 159173, f1 =  0.381826

Iteration 300: Loss = 133683.156250
|Xk-Y|_F:  132412.906250, |X-X0|:  1270.249634
rounded |X_k-Y|_0 = 121425, f1 =  0.424524, approx slack: 96504
rounded before pow |X_k-Y|_0 = 158734, f1 =  0.382256

Iteration 320: Loss = 129069.031250
|Xk-Y|_F:  127805.421875, |X-X0|:  1263.613037
rounded |X_k-Y|_0 = 117825, f1 =  0.430640, approx slack: 104943
rounded before pow |X_k-Y|_0 = 158952, f1 =  0.382112

Iteration 340: Loss = 123838.203125
|Xk-Y|_F:  122589.820312, |X-X0|:  1248.380859
rounded |X_k-Y|_0 = 113892, f1 =  0.437552, approx slack: 113368
rounded before pow |X_k-Y|_0 = 158487, f1 =  0.382598

Iteration 360: Loss = 117906.640625
|Xk-Y|_F:  116670.757812, |X-X0|:  1235.880737
rounded |X_k-Y|_0 = 109610, f1 =  0.445401, approx slack: 126402
rounded before pow |X_k-Y|_0 = 158794, f1 =  0.382326

Iteration 380: Loss = 111322.414062
|Xk-Y|_F:  110092.367188, |X-X0|:  1230.049194
rounded |X_k-Y|_0 = 104599, f1 =  0.454942, approx slack: 137864
rounded before pow |X_k-Y|_0 = 158628, f1 =  0.382509

Iteration 400: Loss = 104318.484375
|Xk-Y|_F:  103096.156250, |X-X0|:  1222.327393
rounded |X_k-Y|_0 = 98428, f1 =  0.467652, approx slack: 153562
rounded before pow |X_k-Y|_0 = 158625, f1 =  0.382513

Iteration 420: Loss = 97389.523438
|Xk-Y|_F:  96172.312500, |X-X0|:  1217.212158
rounded |X_k-Y|_0 = 92455, f1 =  0.481081, approx slack: 170113
rounded before pow |X_k-Y|_0 = 158640, f1 =  0.382519

Iteration 440: Loss = 91122.054688
|Xk-Y|_F:  89907.554688, |X-X0|:  1214.498291
rounded |X_k-Y|_0 = 86649, f1 =  0.495765, approx slack: 187027
rounded before pow |X_k-Y|_0 = 158672, f1 =  0.382462

Iteration 460: Loss = 85881.468750
|Xk-Y|_F:  84675.867188, |X-X0|:  1205.602051
rounded |X_k-Y|_0 = 81714, f1 =  0.509324, approx slack: 201409
rounded before pow |X_k-Y|_0 = 158604, f1 =  0.382615

Iteration 480: Loss = 81673.960938
|Xk-Y|_F:  80477.609375, |X-X0|:  1196.348877
rounded |X_k-Y|_0 = 77800, f1 =  0.521087, approx slack: 213972
rounded before pow |X_k-Y|_0 = 158398, f1 =  0.382959

Iteration 500: Loss = 78303.101562
|Xk-Y|_F:  77110.343750, |X-X0|:  1192.760254
rounded |X_k-Y|_0 = 75050, f1 =  0.530049, approx slack: 224475
rounded before pow |X_k-Y|_0 = 158384, f1 =  0.382980

Iteration 520: Loss = 75576.000000
|Xk-Y|_F:  74384.320312, |X-X0|:  1191.680176
rounded |X_k-Y|_0 = 72773, f1 =  0.538318, approx slack: 234255
rounded before pow |X_k-Y|_0 = 158654, f1 =  0.382759

Iteration 540: Loss = 73402.468750
|Xk-Y|_F:  72212.031250, |X-X0|:  1190.437866
rounded |X_k-Y|_0 = 70828, f1 =  0.545872, approx slack: 241509
rounded before pow |X_k-Y|_0 = 158662, f1 =  0.382749

Iteration 560: Loss = 71724.289062
|Xk-Y|_F:  70541.062500, |X-X0|:  1183.228760
rounded |X_k-Y|_0 = 69313, f1 =  0.552170, approx slack: 247894
rounded before pow |X_k-Y|_0 = 158697, f1 =  0.382707

Iteration 580: Loss = 70522.312500
|Xk-Y|_F:  69342.007812, |X-X0|:  1180.302002
rounded |X_k-Y|_0 = 68313, f1 =  0.556631, approx slack: 251877
rounded before pow |X_k-Y|_0 = 158697, f1 =  0.382701

Iteration 600: Loss = 69662.656250
|Xk-Y|_F:  68486.062500, |X-X0|:  1176.591431
rounded |X_k-Y|_0 = 67730, f1 =  0.559325, approx slack: 255400
rounded before pow |X_k-Y|_0 = 158710, f1 =  0.382691

Iteration 620: Loss = 69041.656250
|Xk-Y|_F:  67870.492188, |X-X0|:  1171.166260
rounded |X_k-Y|_0 = 67177, f1 =  0.561932, approx slack: 258309
rounded before pow |X_k-Y|_0 = 158639, f1 =  0.382777

Iteration 640: Loss = 68600.828125
|Xk-Y|_F:  67431.351562, |X-X0|:  1169.479248
rounded |X_k-Y|_0 = 66746, f1 =  0.563968, approx slack: 260280
rounded before pow |X_k-Y|_0 = 158636, f1 =  0.382781

Iteration 660: Loss = 68277.054688
|Xk-Y|_F:  67107.179688, |X-X0|:  1169.874390
rounded |X_k-Y|_0 = 66423, f1 =  0.565493, approx slack: 261768
rounded before pow |X_k-Y|_0 = 158625, f1 =  0.382794

Iteration 680: Loss = 68040.656250
|Xk-Y|_F:  66871.031250, |X-X0|:  1169.627930
rounded |X_k-Y|_0 = 66240, f1 =  0.566423, approx slack: 263333
rounded before pow |X_k-Y|_0 = 158792, f1 =  0.382614

Iteration 700: Loss = 67848.546875
|Xk-Y|_F:  66683.906250, |X-X0|:  1164.644043
rounded |X_k-Y|_0 = 66102, f1 =  0.567095, approx slack: 264081
rounded before pow |X_k-Y|_0 = 158774, f1 =  0.382635

Iteration 720: Loss = 67699.718750
|Xk-Y|_F:  66541.218750, |X-X0|:  1158.501221
rounded |X_k-Y|_0 = 66022, f1 =  0.567504, approx slack: 264488
rounded before pow |X_k-Y|_0 = 158614, f1 =  0.382697

Iteration 740: Loss = 67579.515625
|Xk-Y|_F:  66423.062500, |X-X0|:  1156.453735
rounded |X_k-Y|_0 = 65957, f1 =  0.567853, approx slack: 264707
rounded before pow |X_k-Y|_0 = 158458, f1 =  0.382868

Iteration 760: Loss = 67475.968750
|Xk-Y|_F:  66316.984375, |X-X0|:  1158.984619
rounded |X_k-Y|_0 = 65910, f1 =  0.568093, approx slack: 277349
rounded before pow |X_k-Y|_0 = 158588, f1 =  0.382712

Iteration 780: Loss = 67375.687500
|Xk-Y|_F:  66218.593750, |X-X0|:  1157.096436
rounded |X_k-Y|_0 = 65839, f1 =  0.568485, approx slack: 278376
rounded before pow |X_k-Y|_0 = 158584, f1 =  0.382715

Iteration 800: Loss = 67289.937500
|Xk-Y|_F:  66130.546875, |X-X0|:  1159.392334
rounded |X_k-Y|_0 = 65791, f1 =  0.568750, approx slack: 278511
rounded before pow |X_k-Y|_0 = 158587, f1 =  0.382713

Iteration 820: Loss = 67207.421875
|Xk-Y|_F:  66050.742188, |X-X0|:  1156.682373
rounded |X_k-Y|_0 = 65776, f1 =  0.568819, approx slack: 278340
rounded before pow |X_k-Y|_0 = 158411, f1 =  0.382902

Iteration 840: Loss = 67133.546875
|Xk-Y|_F:  65978.695312, |X-X0|:  1154.847900
rounded |X_k-Y|_0 = 65724, f1 =  0.569133, approx slack: 278408
rounded before pow |X_k-Y|_0 = 158572, f1 =  0.382735

Iteration 860: Loss = 67062.148438
|Xk-Y|_F:  65913.273438, |X-X0|:  1148.876831
rounded |X_k-Y|_0 = 65662, f1 =  0.569490, approx slack: 277948
rounded before pow |X_k-Y|_0 = 158219, f1 =  0.383154

Iteration 880: Loss = 66994.968750
|Xk-Y|_F:  65853.085938, |X-X0|:  1141.881592
rounded |X_k-Y|_0 = 65622, f1 =  0.569734, approx slack: 280827
rounded before pow |X_k-Y|_0 = 158219, f1 =  0.383154

Iteration 900: Loss = 66937.835938
|Xk-Y|_F:  65794.507812, |X-X0|:  1143.330322
rounded |X_k-Y|_0 = 65580, f1 =  0.569984, approx slack: 280734
rounded before pow |X_k-Y|_0 = 158219, f1 =  0.383154

Iteration 920: Loss = 66878.585938
|Xk-Y|_F:  65735.617188, |X-X0|:  1142.967407
rounded |X_k-Y|_0 = 65532, f1 =  0.570288, approx slack: 280539
rounded before pow |X_k-Y|_0 = 158209, f1 =  0.383171

Iteration 940: Loss = 66819.468750
|Xk-Y|_F:  65677.000000, |X-X0|:  1142.466675
rounded |X_k-Y|_0 = 65488, f1 =  0.570583, approx slack: 280160
rounded before pow |X_k-Y|_0 = 158208, f1 =  0.383172

Iteration 960: Loss = 66760.890625
|Xk-Y|_F:  65617.804688, |X-X0|:  1143.089478
rounded |X_k-Y|_0 = 65418, f1 =  0.570995, approx slack: 280998
rounded before pow |X_k-Y|_0 = 158457, f1 =  0.382866

Iteration 980: Loss = 66701.593750
|Xk-Y|_F:  65561.187500, |X-X0|:  1140.406494
rounded |X_k-Y|_0 = 65375, f1 =  0.571260, approx slack: 286316
rounded before pow |X_k-Y|_0 = 158352, f1 =  0.382994

Iteration 1000: Loss = 66648.734375
|Xk-Y|_F:  65508.222656, |X-X0|:  1140.514771
rounded |X_k-Y|_0 = 65319, f1 =  0.571611, approx slack: 294967
rounded before pow |X_k-Y|_0 = 158351, f1 =  0.382999

Iteration 1020: Loss = 66593.882812
|Xk-Y|_F:  65453.839844, |X-X0|:  1140.042358
rounded |X_k-Y|_0 = 65284, f1 =  0.571835, approx slack: 324146
rounded before pow |X_k-Y|_0 = 158350, f1 =  0.383005

Iteration 1040: Loss = 66533.171875
|Xk-Y|_F:  65398.308594, |X-X0|:  1134.862427
rounded |X_k-Y|_0 = 65228, f1 =  0.572189, approx slack: 329790
rounded before pow |X_k-Y|_0 = 158348, f1 =  0.383011

Iteration 1060: Loss = 66482.078125
|Xk-Y|_F:  65346.292969, |X-X0|:  1135.784180
rounded |X_k-Y|_0 = 65177, f1 =  0.572512, approx slack: 332985
rounded before pow |X_k-Y|_0 = 158490, f1 =  0.382832

Iteration 1080: Loss = 66426.968750
|Xk-Y|_F:  65290.972656, |X-X0|:  1135.994873
rounded |X_k-Y|_0 = 65135, f1 =  0.572811, approx slack: 332789
rounded before pow |X_k-Y|_0 = 158490, f1 =  0.382836

Iteration 1100: Loss = 66361.640625
|Xk-Y|_F:  65228.222656, |X-X0|:  1133.420166
rounded |X_k-Y|_0 = 65056, f1 =  0.573346, approx slack: 332265
rounded before pow |X_k-Y|_0 = 158489, f1 =  0.382842

Iteration 1120: Loss = 66297.890625
|Xk-Y|_F:  65165.554688, |X-X0|:  1132.336670
rounded |X_k-Y|_0 = 65012, f1 =  0.573641, approx slack: 334685
rounded before pow |X_k-Y|_0 = 158451, f1 =  0.382754

Iteration 1140: Loss = 66233.210938
|Xk-Y|_F:  65104.019531, |X-X0|:  1129.191406
rounded |X_k-Y|_0 = 64975, f1 =  0.573903, approx slack: 334252
rounded before pow |X_k-Y|_0 = 158445, f1 =  0.382765

Iteration 1160: Loss = 66169.671875
|Xk-Y|_F:  65041.429688, |X-X0|:  1128.243408
rounded |X_k-Y|_0 = 64913, f1 =  0.574314, approx slack: 310471
rounded before pow |X_k-Y|_0 = 158449, f1 =  0.382761

Iteration 1180: Loss = 66105.320312
|Xk-Y|_F:  64974.085938, |X-X0|:  1131.235474
rounded |X_k-Y|_0 = 64840, f1 =  0.574759, approx slack: 309791
rounded before pow |X_k-Y|_0 = 158456, f1 =  0.382752

Iteration 1200: Loss = 66010.671875
|Xk-Y|_F:  64880.203125, |X-X0|:  1130.470215
rounded |X_k-Y|_0 = 64803, f1 =  0.574922, approx slack: 312046
rounded before pow |X_k-Y|_0 = 158351, f1 =  0.382801

Iteration 1220: Loss = 65571.429688
|Xk-Y|_F:  64439.492188, |X-X0|:  1131.935059
rounded |X_k-Y|_0 = 64731, f1 =  0.576043, approx slack: 310585
rounded before pow |X_k-Y|_0 = 157810, f1 =  0.383217

Iteration 1240: Loss = 65523.792969
|Xk-Y|_F:  64392.601562, |X-X0|:  1131.192871
rounded |X_k-Y|_0 = 64619, f1 =  0.576831, approx slack: 307287
rounded before pow |X_k-Y|_0 = 157684, f1 =  0.383270

Iteration 1260: Loss = 65474.359375
|Xk-Y|_F:  64343.171875, |X-X0|:  1131.188477
rounded |X_k-Y|_0 = 64568, f1 =  0.577183, approx slack: 314971
rounded before pow |X_k-Y|_0 = 158450, f1 =  0.382341

Iteration 1280: Loss = 65424.796875
|Xk-Y|_F:  64289.453125, |X-X0|:  1135.345459
rounded |X_k-Y|_0 = 64508, f1 =  0.577619, approx slack: 324525
rounded before pow |X_k-Y|_0 = 159973, f1 =  0.380528

Iteration 1300: Loss = 65372.953125
|Xk-Y|_F:  64224.632812, |X-X0|:  1148.322021
rounded |X_k-Y|_0 = 64436, f1 =  0.578099, approx slack: 329830
rounded before pow |X_k-Y|_0 = 161937, f1 =  0.378131

Iteration 1320: Loss = 65314.070312
|Xk-Y|_F:  64141.089844, |X-X0|:  1172.981689
rounded |X_k-Y|_0 = 64386, f1 =  0.578433, approx slack: 329752
rounded before pow |X_k-Y|_0 = 161989, f1 =  0.378073

Iteration 1340: Loss = 65253.597656
|Xk-Y|_F:  64077.046875, |X-X0|:  1176.550293
rounded |X_k-Y|_0 = 64228, f1 =  0.579514, approx slack: 326883
rounded before pow |X_k-Y|_0 = 162199, f1 =  0.377937

Iteration 1360: Loss = 65198.558594
|Xk-Y|_F:  64026.859375, |X-X0|:  1171.697998
rounded |X_k-Y|_0 = 64165, f1 =  0.579941, approx slack: 327523
rounded before pow |X_k-Y|_0 = 162158, f1 =  0.377947

Iteration 1380: Loss = 65138.062500
|Xk-Y|_F:  63971.359375, |X-X0|:  1166.703125
rounded |X_k-Y|_0 = 64098, f1 =  0.580404, approx slack: 330205
rounded before pow |X_k-Y|_0 = 162158, f1 =  0.377947

Iteration 1400: Loss = 65078.179688
|Xk-Y|_F:  63917.152344, |X-X0|:  1161.026367
rounded |X_k-Y|_0 = 64045, f1 =  0.580786, approx slack: 334468
rounded before pow |X_k-Y|_0 = 162826, f1 =  0.377137

Iteration 1420: Loss = 65020.660156
|Xk-Y|_F:  63858.667969, |X-X0|:  1161.993286
rounded |X_k-Y|_0 = 64016, f1 =  0.580980, approx slack: 334242
rounded before pow |X_k-Y|_0 = 162826, f1 =  0.377137

Iteration 1440: Loss = 64960.671875
|Xk-Y|_F:  63798.968750, |X-X0|:  1161.704224
rounded |X_k-Y|_0 = 63973, f1 =  0.581256, approx slack: 336778
rounded before pow |X_k-Y|_0 = 162858, f1 =  0.377241

Iteration 1460: Loss = 64897.527344
|Xk-Y|_F:  63733.210938, |X-X0|:  1164.317139
rounded |X_k-Y|_0 = 63929, f1 =  0.581572, approx slack: 336155
rounded before pow |X_k-Y|_0 = 162842, f1 =  0.377260

Iteration 1480: Loss = 64831.773438
|Xk-Y|_F:  63667.511719, |X-X0|:  1164.262695
rounded |X_k-Y|_0 = 63866, f1 =  0.581997, approx slack: 343725
rounded before pow |X_k-Y|_0 = 164608, f1 =  0.375299

Iteration 1500: Loss = 64768.171875
|Xk-Y|_F:  63609.371094, |X-X0|:  1158.799316
rounded |X_k-Y|_0 = 63787, f1 =  0.582517, approx slack: 343253
rounded before pow |X_k-Y|_0 = 164608, f1 =  0.375299

Iteration 1520: Loss = 64712.257812
|Xk-Y|_F:  63553.453125, |X-X0|:  1158.806519
rounded |X_k-Y|_0 = 63743, f1 =  0.582813, approx slack: 343311
rounded before pow |X_k-Y|_0 = 164966, f1 =  0.375109

Iteration 1540: Loss = 64661.144531
|Xk-Y|_F:  63499.300781, |X-X0|:  1161.842896
rounded |X_k-Y|_0 = 63693, f1 =  0.583141, approx slack: 346136
rounded before pow |X_k-Y|_0 = 166126, f1 =  0.373840

Iteration 1560: Loss = 64604.304688
|Xk-Y|_F:  63443.660156, |X-X0|:  1160.644287
rounded |X_k-Y|_0 = 63660, f1 =  0.583377, approx slack: 345950
rounded before pow |X_k-Y|_0 = 166255, f1 =  0.373772

Iteration 1580: Loss = 64550.914062
|Xk-Y|_F:  63386.359375, |X-X0|:  1164.552734
rounded |X_k-Y|_0 = 63638, f1 =  0.583532, approx slack: 349299
rounded before pow |X_k-Y|_0 = 166630, f1 =  0.373511

Iteration 1600: Loss = 64492.785156
|Xk-Y|_F:  63325.722656, |X-X0|:  1167.061890
rounded |X_k-Y|_0 = 63594, f1 =  0.583833, approx slack: 349190
rounded before pow |X_k-Y|_0 = 166747, f1 =  0.373454

Iteration 1620: Loss = 64431.246094
|Xk-Y|_F:  63264.355469, |X-X0|:  1166.890869
rounded |X_k-Y|_0 = 63528, f1 =  0.584269, approx slack: 361372
rounded before pow |X_k-Y|_0 = 169757, f1 =  0.370215

Iteration 1640: Loss = 64366.644531
|Xk-Y|_F:  63198.105469, |X-X0|:  1168.538330
rounded |X_k-Y|_0 = 63475, f1 =  0.584607, approx slack: 361214
rounded before pow |X_k-Y|_0 = 169757, f1 =  0.370215

Iteration 1660: Loss = 64295.261719
|Xk-Y|_F:  63122.191406, |X-X0|:  1173.069092
rounded |X_k-Y|_0 = 63417, f1 =  0.584997, approx slack: 361487
rounded before pow |X_k-Y|_0 = 169923, f1 =  0.370026

Iteration 1680: Loss = 64212.808594
|Xk-Y|_F:  63030.656250, |X-X0|:  1182.152222
rounded |X_k-Y|_0 = 63368, f1 =  0.585357, approx slack: 370873
rounded before pow |X_k-Y|_0 = 172139, f1 =  0.367528

Iteration 1700: Loss = 64113.507812
|Xk-Y|_F:  62914.527344, |X-X0|:  1198.978516
rounded |X_k-Y|_0 = 63258, f1 =  0.586040, approx slack: 385664
rounded before pow |X_k-Y|_0 = 177140, f1 =  0.361900

Iteration 1720: Loss = 64006.800781
|Xk-Y|_F:  62781.375000, |X-X0|:  1225.426758
rounded |X_k-Y|_0 = 63070, f1 =  0.587233, approx slack: 386057
rounded before pow |X_k-Y|_0 = 177465, f1 =  0.361714

Iteration 1740: Loss = 63915.496094
|Xk-Y|_F:  62678.226562, |X-X0|:  1237.268066
rounded |X_k-Y|_0 = 62972, f1 =  0.587896, approx slack: 391028
rounded before pow |X_k-Y|_0 = 179048, f1 =  0.359992

Iteration 1760: Loss = 63782.613281
|Xk-Y|_F:  62524.964844, |X-X0|:  1257.650146
rounded |X_k-Y|_0 = 62820, f1 =  0.588860, approx slack: 399448
rounded before pow |X_k-Y|_0 = 182047, f1 =  0.358282

Iteration 1780: Loss = 63486.656250
|Xk-Y|_F:  62207.898438, |X-X0|:  1278.759033
rounded |X_k-Y|_0 = 62552, f1 =  0.590711, approx slack: 401541
rounded before pow |X_k-Y|_0 = 183148, f1 =  0.357194

Iteration 1800: Loss = 63194.226562
|Xk-Y|_F:  61893.250000, |X-X0|:  1300.975830
rounded |X_k-Y|_0 = 62086, f1 =  0.593655, approx slack: 409883
rounded before pow |X_k-Y|_0 = 184058, f1 =  0.356262

Iteration 1820: Loss = 62871.410156
|Xk-Y|_F:  61547.910156, |X-X0|:  1323.498779
rounded |X_k-Y|_0 = 61696, f1 =  0.596073, approx slack: 410605
rounded before pow |X_k-Y|_0 = 184232, f1 =  0.356071

Iteration 1840: Loss = 62592.554688
|Xk-Y|_F:  61260.375000, |X-X0|:  1332.178955
rounded |X_k-Y|_0 = 61268, f1 =  0.598716, approx slack: 415697
rounded before pow |X_k-Y|_0 = 186247, f1 =  0.353876

Iteration 1860: Loss = 62482.542969
|Xk-Y|_F:  61149.871094, |X-X0|:  1332.671143
rounded |X_k-Y|_0 = 61131, f1 =  0.599629, approx slack: 441439
rounded before pow |X_k-Y|_0 = 185766, f1 =  0.354396

Iteration 1880: Loss = 62414.097656
|Xk-Y|_F:  61079.257812, |X-X0|:  1334.838623
rounded |X_k-Y|_0 = 61076, f1 =  0.599951, approx slack: 443354
rounded before pow |X_k-Y|_0 = 186433, f1 =  0.353692

Iteration 1900: Loss = 62354.781250
|Xk-Y|_F:  61023.957031, |X-X0|:  1330.823242
rounded |X_k-Y|_0 = 61033, f1 =  0.600225, approx slack: 443199
rounded before pow |X_k-Y|_0 = 186433, f1 =  0.353692

Iteration 1920: Loss = 62306.515625
|Xk-Y|_F:  60972.664062, |X-X0|:  1333.852295
rounded |X_k-Y|_0 = 60949, f1 =  0.600743, approx slack: 442961
rounded before pow |X_k-Y|_0 = 186433, f1 =  0.353692

Iteration 1940: Loss = 62262.667969
|Xk-Y|_F:  60927.046875, |X-X0|:  1335.619385
rounded |X_k-Y|_0 = 60913, f1 =  0.600968, approx slack: 443464
rounded before pow |X_k-Y|_0 = 186528, f1 =  0.353715

Iteration 1960: Loss = 62217.605469
|Xk-Y|_F:  60880.812500, |X-X0|:  1336.794312
rounded |X_k-Y|_0 = 60894, f1 =  0.601084, approx slack: 450286
rounded before pow |X_k-Y|_0 = 188094, f1 =  0.352003

Iteration 1980: Loss = 62171.062500
|Xk-Y|_F:  60830.542969, |X-X0|:  1340.518555
rounded |X_k-Y|_0 = 60872, f1 =  0.601244, approx slack: 450954
rounded before pow |X_k-Y|_0 = 188507, f1 =  0.351577

Iteration 2000: Loss = 62129.800781
|Xk-Y|_F:  60785.578125, |X-X0|:  1344.221191
rounded |X_k-Y|_0 = 60834, f1 =  0.601469, approx slack: 448209
rounded before pow |X_k-Y|_0 = 187602, f1 =  0.352621

Iteration 2020: Loss = 62090.460938
|Xk-Y|_F:  60743.007812, |X-X0|:  1347.454224
rounded |X_k-Y|_0 = 60786, f1 =  0.601760, approx slack: 450072
rounded before pow |X_k-Y|_0 = 188384, f1 =  0.351800

Iteration 2040: Loss = 62047.640625
|Xk-Y|_F:  60697.289062, |X-X0|:  1350.352295
rounded |X_k-Y|_0 = 60709, f1 =  0.602230, approx slack: 449764
rounded before pow |X_k-Y|_0 = 188381, f1 =  0.351803

Iteration 2060: Loss = 62008.644531
|Xk-Y|_F:  60659.281250, |X-X0|:  1349.361572
rounded |X_k-Y|_0 = 60662, f1 =  0.602530, approx slack: 449451
rounded before pow |X_k-Y|_0 = 188321, f1 =  0.351879

Iteration 2080: Loss = 61976.710938
|Xk-Y|_F:  60626.046875, |X-X0|:  1350.664307
rounded |X_k-Y|_0 = 60612, f1 =  0.602824, approx slack: 447157
rounded before pow |X_k-Y|_0 = 187622, f1 =  0.352649

Iteration 2100: Loss = 61945.738281
|Xk-Y|_F:  60593.957031, |X-X0|:  1351.780029
rounded |X_k-Y|_0 = 60565, f1 =  0.603105, approx slack: 448128
rounded before pow |X_k-Y|_0 = 188083, f1 =  0.352161

Iteration 2120: Loss = 61915.652344
|Xk-Y|_F:  60564.167969, |X-X0|:  1351.484375
rounded |X_k-Y|_0 = 60526, f1 =  0.603345, approx slack: 447865
rounded before pow |X_k-Y|_0 = 188083, f1 =  0.352164

Iteration 2140: Loss = 61888.257812
|Xk-Y|_F:  60533.546875, |X-X0|:  1354.712891
rounded |X_k-Y|_0 = 60474, f1 =  0.603654, approx slack: 448237
rounded before pow |X_k-Y|_0 = 188405, f1 =  0.351816

Iteration 2160: Loss = 61860.484375
|Xk-Y|_F:  60502.496094, |X-X0|:  1357.987305
rounded |X_k-Y|_0 = 60454, f1 =  0.603779, approx slack: 443527
rounded before pow |X_k-Y|_0 = 190055, f1 =  0.350017

Iteration 2180: Loss = 61829.710938
|Xk-Y|_F:  60468.707031, |X-X0|:  1361.005249
rounded |X_k-Y|_0 = 60395, f1 =  0.604119, approx slack: 445434
rounded before pow |X_k-Y|_0 = 190665, f1 =  0.349363

Iteration 2200: Loss = 61800.113281
|Xk-Y|_F:  60438.968750, |X-X0|:  1361.144409
rounded |X_k-Y|_0 = 60368, f1 =  0.604289, approx slack: 447351
rounded before pow |X_k-Y|_0 = 191651, f1 =  0.348294

Iteration 2220: Loss = 61774.320312
|Xk-Y|_F:  60410.394531, |X-X0|:  1363.927490
rounded |X_k-Y|_0 = 60347, f1 =  0.604414, approx slack: 450922
rounded before pow |X_k-Y|_0 = 192566, f1 =  0.347227

Iteration 2240: Loss = 61741.867188
|Xk-Y|_F:  60382.250000, |X-X0|:  1359.619141
rounded |X_k-Y|_0 = 60330, f1 =  0.604512, approx slack: 451565
rounded before pow |X_k-Y|_0 = 192825, f1 =  0.347030

Iteration 2260: Loss = 61714.703125
|Xk-Y|_F:  60352.699219, |X-X0|:  1362.005737
rounded |X_k-Y|_0 = 60288, f1 =  0.604743, approx slack: 451049
rounded before pow |X_k-Y|_0 = 192788, f1 =  0.347071

Iteration 2280: Loss = 61694.078125
|Xk-Y|_F:  60323.957031, |X-X0|:  1370.121948
rounded |X_k-Y|_0 = 60249, f1 =  0.604957, approx slack: 451872
rounded before pow |X_k-Y|_0 = 192927, f1 =  0.346838

Iteration 2300: Loss = 61661.718750
|Xk-Y|_F:  60294.421875, |X-X0|:  1367.298096
rounded |X_k-Y|_0 = 60223, f1 =  0.605110, approx slack: 452055
rounded before pow |X_k-Y|_0 = 192915, f1 =  0.346847

Iteration 2320: Loss = 61640.925781
|Xk-Y|_F:  60267.296875, |X-X0|:  1373.629517
rounded |X_k-Y|_0 = 60185, f1 =  0.605343, approx slack: 459687
rounded before pow |X_k-Y|_0 = 194839, f1 =  0.344764

Iteration 2340: Loss = 61617.910156
|Xk-Y|_F:  60240.898438, |X-X0|:  1377.011963
rounded |X_k-Y|_0 = 60124, f1 =  0.605703, approx slack: 459623
rounded before pow |X_k-Y|_0 = 194550, f1 =  0.345071

Iteration 2360: Loss = 61592.339844
|Xk-Y|_F:  60217.261719, |X-X0|:  1375.079102
rounded |X_k-Y|_0 = 60096, f1 =  0.605870, approx slack: 464770
rounded before pow |X_k-Y|_0 = 196061, f1 =  0.343491

Iteration 2380: Loss = 61571.449219
|Xk-Y|_F:  60192.351562, |X-X0|:  1379.097290
rounded |X_k-Y|_0 = 60070, f1 =  0.606025, approx slack: 464596
rounded before pow |X_k-Y|_0 = 196077, f1 =  0.343474

Iteration 2400: Loss = 61552.000000
|Xk-Y|_F:  60165.273438, |X-X0|:  1386.725586
rounded |X_k-Y|_0 = 60025, f1 =  0.606280, approx slack: 465277
rounded before pow |X_k-Y|_0 = 196355, f1 =  0.343100

Iteration 2420: Loss = 61530.687500
|Xk-Y|_F:  60141.179688, |X-X0|:  1389.508789
rounded |X_k-Y|_0 = 59986, f1 =  0.606515, approx slack: 464590
rounded before pow |X_k-Y|_0 = 196447, f1 =  0.343017

Iteration 2440: Loss = 61505.980469
|Xk-Y|_F:  60119.003906, |X-X0|:  1386.977783
rounded |X_k-Y|_0 = 59972, f1 =  0.606597, approx slack: 464675
rounded before pow |X_k-Y|_0 = 196585, f1 =  0.342954

Iteration 2460: Loss = 61486.921875
|Xk-Y|_F:  60095.632812, |X-X0|:  1391.287842
rounded |X_k-Y|_0 = 59936, f1 =  0.606812, approx slack: 464743
rounded before pow |X_k-Y|_0 = 196669, f1 =  0.342883

Iteration 2480: Loss = 61466.406250
|Xk-Y|_F:  60070.542969, |X-X0|:  1395.861938
rounded |X_k-Y|_0 = 59908, f1 =  0.606972, approx slack: 467264
rounded before pow |X_k-Y|_0 = 197503, f1 =  0.341988

Iteration 2500: Loss = 61448.871094
|Xk-Y|_F:  60050.886719, |X-X0|:  1397.985718
rounded |X_k-Y|_0 = 59868, f1 =  0.607201, approx slack: 466873
rounded before pow |X_k-Y|_0 = 197517, f1 =  0.341970

Iteration 2520: Loss = 61435.730469
|Xk-Y|_F:  60032.050781, |X-X0|:  1403.680786
rounded |X_k-Y|_0 = 59850, f1 =  0.607319, approx slack: 471731
rounded before pow |X_k-Y|_0 = 199021, f1 =  0.340358

Iteration 2540: Loss = 61415.292969
|Xk-Y|_F:  60013.570312, |X-X0|:  1401.721191
rounded |X_k-Y|_0 = 59827, f1 =  0.607428, approx slack: 470749
rounded before pow |X_k-Y|_0 = 198642, f1 =  0.340751

Iteration 2560: Loss = 61401.832031
|Xk-Y|_F:  59995.187500, |X-X0|:  1406.644043
rounded |X_k-Y|_0 = 59810, f1 =  0.607532, approx slack: 471165
rounded before pow |X_k-Y|_0 = 198963, f1 =  0.340421

Iteration 2580: Loss = 61384.199219
|Xk-Y|_F:  59975.335938, |X-X0|:  1408.863403
rounded |X_k-Y|_0 = 59780, f1 =  0.607697, approx slack: 471591
rounded before pow |X_k-Y|_0 = 199090, f1 =  0.340286

Iteration 2600: Loss = 61370.230469
|Xk-Y|_F:  59957.363281, |X-X0|:  1412.866699
rounded |X_k-Y|_0 = 59771, f1 =  0.607749, approx slack: 462385
rounded before pow |X_k-Y|_0 = 197486, f1 =  0.341945

Iteration 2620: Loss = 61356.683594
|Xk-Y|_F:  59939.531250, |X-X0|:  1417.153442
rounded |X_k-Y|_0 = 59739, f1 =  0.607933, approx slack: 462244
rounded before pow |X_k-Y|_0 = 197406, f1 =  0.341947

Iteration 2640: Loss = 61341.902344
|Xk-Y|_F:  59919.167969, |X-X0|:  1422.734009
rounded |X_k-Y|_0 = 59729, f1 =  0.607990, approx slack: 459239
rounded before pow |X_k-Y|_0 = 197423, f1 =  0.341929

Iteration 2660: Loss = 61324.167969
|Xk-Y|_F:  59898.082031, |X-X0|:  1426.084473
rounded |X_k-Y|_0 = 59703, f1 =  0.608147, approx slack: 459055
rounded before pow |X_k-Y|_0 = 197460, f1 =  0.341975

Iteration 2680: Loss = 61306.355469
|Xk-Y|_F:  59874.808594, |X-X0|:  1431.548462
rounded |X_k-Y|_0 = 59681, f1 =  0.608282, approx slack: 460257
rounded before pow |X_k-Y|_0 = 197764, f1 =  0.341650

Iteration 2700: Loss = 61289.441406
|Xk-Y|_F:  59851.804688, |X-X0|:  1437.635986
rounded |X_k-Y|_0 = 59644, f1 =  0.608503, approx slack: 458940
rounded before pow |X_k-Y|_0 = 197193, f1 =  0.342239

Iteration 2720: Loss = 61274.050781
|Xk-Y|_F:  59827.929688, |X-X0|:  1446.122070
rounded |X_k-Y|_0 = 59624, f1 =  0.608622, approx slack: 460050
rounded before pow |X_k-Y|_0 = 197758, f1 =  0.341564

Iteration 2740: Loss = 61254.656250
|Xk-Y|_F:  59800.964844, |X-X0|:  1453.691528
rounded |X_k-Y|_0 = 59574, f1 =  0.608923, approx slack: 460040
rounded before pow |X_k-Y|_0 = 197909, f1 =  0.341502

Iteration 2760: Loss = 61232.476562
|Xk-Y|_F:  59776.652344, |X-X0|:  1455.825928
rounded |X_k-Y|_0 = 59542, f1 =  0.609122, approx slack: 463388
rounded before pow |X_k-Y|_0 = 198862, f1 =  0.340548

Iteration 2780: Loss = 61215.496094
|Xk-Y|_F:  59757.007812, |X-X0|:  1458.489502
rounded |X_k-Y|_0 = 59507, f1 =  0.609319, approx slack: 463225
rounded before pow |X_k-Y|_0 = 198862, f1 =  0.340548

Iteration 2800: Loss = 61201.640625
|Xk-Y|_F:  59739.226562, |X-X0|:  1462.415283
rounded |X_k-Y|_0 = 59481, f1 =  0.609470, approx slack: 458565
rounded before pow |X_k-Y|_0 = 197510, f1 =  0.341984

Converged at iteration 2804
------ ABL 0 after refine ------
--- eval ---
prediction result:
f1 on test:    0.3932
f1 on test:    0.5971 (micro)
f1 on KB:      0.4450
integrated f1: 0.4206, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3844
f1 on test:    0.6026 (micro)
f1 on KB:      0.5114
integrated f1: 0.4575, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.4206
Epoch 100, Total loss: -384179840.0000, CE loss: 2.8930, RL loss: -3841798.5000, Reward: -55427.0264
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 26684, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 200, Total loss: 526644192.0000, CE loss: 2.8933, RL loss: 5266442.0000, Reward: -55032.6357
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25824, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 300, Total loss: 250813152.0000, CE loss: 2.8930, RL loss: 2508131.5000, Reward: -55141.5586
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 26325, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 400, Total loss: -212410496.0000, CE loss: 2.8932, RL loss: -2124105.0000, Reward: -55279.5137
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25249, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 500, Total loss: 38374080.0000, CE loss: 2.8935, RL loss: 383740.7812, Reward: -55258.9512
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25407, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 600, Total loss: 274096128.0000, CE loss: 2.8932, RL loss: 2740961.2500, Reward: -55104.1660
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25998, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 700, Total loss: -159509616.0000, CE loss: 2.8932, RL loss: -1595096.1250, Reward: -55342.3926
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25824, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 800, Total loss: 335185440.0000, CE loss: 2.8932, RL loss: 3351854.2500, Reward: -55072.4658
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 26062, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 900, Total loss: -336475392.0000, CE loss: 2.8931, RL loss: -3364754.0000, Reward: -55325.0078
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 26463, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 1000, Total loss: -307810240.0000, CE loss: 2.8932, RL loss: -3078102.5000, Reward: -55368.0010
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25729, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 1100, Total loss: -119176760.0000, CE loss: 2.8932, RL loss: -1191767.6250, Reward: -55328.4014
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25509, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 1200, Total loss: 411001824.0000, CE loss: 2.8932, RL loss: 4110018.2500, Reward: -55117.0449
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25669, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 1300, Total loss: 536316800.0000, CE loss: 2.8934, RL loss: 5363168.0000, Reward: -55002.4746
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25853, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 1400, Total loss: -427901408.0000, CE loss: 2.8931, RL loss: -4279014.0000, Reward: -55430.7500
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25650, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 1500, Total loss: 763390336.0000, CE loss: 2.8933, RL loss: 7633903.5000, Reward: -54967.6279
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25973, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 1600, Total loss: 180987568.0000, CE loss: 2.8928, RL loss: 1809875.6250, Reward: -55137.2305
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25345, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 1700, Total loss: -44363764.0000, CE loss: 2.8933, RL loss: -443637.6250, Reward: -55248.6562
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25643, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 1800, Total loss: -399852960.0000, CE loss: 2.8930, RL loss: -3998529.7500, Reward: -55453.9561
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25131, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 1900, Total loss: 133970184.0000, CE loss: 2.8929, RL loss: 1339701.8750, Reward: -55203.0977
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 26045, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
--- eval ---
prediction result:
f1 on test:    0.3942
f1 on test:    0.5964 (micro)
f1 on KB:      0.4433
integrated f1: 0.4267, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3856
f1 on test:    0.6021 (micro)
f1 on KB:      0.5093
integrated f1: 0.4722, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: 146243280.0000, CE loss: 2.8928, RL loss: 1462432.7500, Reward: -55161.1357
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25385, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 2100, Total loss: -114554216.0000, CE loss: 2.8931, RL loss: -1145542.1250, Reward: -55177.3115
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25780, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 2200, Total loss: -720027712.0000, CE loss: 2.8934, RL loss: -7200277.0000, Reward: -55575.6035
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 26122, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 2300, Total loss: 155976688.0000, CE loss: 2.8936, RL loss: 1559766.8750, Reward: -55128.2002
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25504, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 2400, Total loss: -467149696.0000, CE loss: 2.8932, RL loss: -4671497.0000, Reward: -55432.1553
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25743, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 2500, Total loss: 248591344.0000, CE loss: 2.8927, RL loss: 2485913.5000, Reward: -55175.9863
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 24970, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 2600, Total loss: 129485272.0000, CE loss: 2.8931, RL loss: 1294852.7500, Reward: -55180.5000
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25574, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 2700, Total loss: 362243584.0000, CE loss: 2.8931, RL loss: 3622436.0000, Reward: -55071.0703
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25741, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 2800, Total loss: 51310360.0000, CE loss: 2.8928, RL loss: 513103.5938, Reward: -55227.0391
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25857, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 2900, Total loss: -39838820.0000, CE loss: 2.8930, RL loss: -398388.1875, Reward: -55314.8623
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25065, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 3000, Total loss: 57236624.0000, CE loss: 2.8928, RL loss: 572366.2500, Reward: -55244.6592
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25837, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 3100, Total loss: -83614240.0000, CE loss: 2.8934, RL loss: -836142.4375, Reward: -55321.9873
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25962, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 3200, Total loss: -211784400.0000, CE loss: 2.8930, RL loss: -2117844.0000, Reward: -55299.5430
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 26606, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 3300, Total loss: -47469412.0000, CE loss: 2.8932, RL loss: -474694.1250, Reward: -55325.8311
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25192, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 3400, Total loss: -206385232.0000, CE loss: 2.8931, RL loss: -2063852.2500, Reward: -55344.1338
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25622, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 3500, Total loss: 332087040.0000, CE loss: 2.8935, RL loss: 3320870.5000, Reward: -55109.7109
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25738, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 3600, Total loss: -86841440.0000, CE loss: 2.8935, RL loss: -868414.3750, Reward: -55285.5791
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 26126, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 3700, Total loss: 309697472.0000, CE loss: 2.8928, RL loss: 3096974.7500, Reward: -55134.3730
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25938, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 3800, Total loss: -147252816.0000, CE loss: 2.8934, RL loss: -1472528.1250, Reward: -55299.5479
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 24884, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 3900, Total loss: -375279200.0000, CE loss: 2.8930, RL loss: -3752792.0000, Reward: -55461.5908
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 26005, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
--- eval ---
prediction result:
f1 on test:    0.3942
f1 on test:    0.5964 (micro)
f1 on KB:      0.4433
integrated f1: 0.4267, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3856
f1 on test:    0.6021 (micro)
f1 on KB:      0.5093
integrated f1: 0.4722, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: -172013872.0000, CE loss: 2.8935, RL loss: -1720138.7500, Reward: -55367.5801
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25874, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 4100, Total loss: -268687072.0000, CE loss: 2.8931, RL loss: -2686870.7500, Reward: -55377.1670
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25927, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 4200, Total loss: -350502336.0000, CE loss: 2.8931, RL loss: -3505023.5000, Reward: -55438.7891
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25659, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 4300, Total loss: -156945456.0000, CE loss: 2.8931, RL loss: -1569454.5000, Reward: -55269.3486
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25476, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 4400, Total loss: -314310176.0000, CE loss: 2.8930, RL loss: -3143101.7500, Reward: -55388.0645
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 26360, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 4500, Total loss: 5143252.0000, CE loss: 2.8931, RL loss: 51432.5195, Reward: -55273.0146
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25409, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 4600, Total loss: -423718848.0000, CE loss: 2.8931, RL loss: -4237188.5000, Reward: -55495.7764
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25643, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 4700, Total loss: -246553680.0000, CE loss: 2.8931, RL loss: -2465536.7500, Reward: -55332.8154
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25870, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 4800, Total loss: 557638720.0000, CE loss: 2.8930, RL loss: 5576387.0000, Reward: -54962.6357
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25899, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 4900, Total loss: -533988544.0000, CE loss: 2.8930, RL loss: -5339885.5000, Reward: -55459.5576
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25750, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 5000, Total loss: -726088320.0000, CE loss: 2.8931, RL loss: -7260883.0000, Reward: -55543.2998
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25747, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 5100, Total loss: -256102752.0000, CE loss: 2.8934, RL loss: -2561027.5000, Reward: -55409.6074
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25695, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 5200, Total loss: 73313744.0000, CE loss: 2.8929, RL loss: 733137.4375, Reward: -55210.7754
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 26138, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 5300, Total loss: 273810112.0000, CE loss: 2.8932, RL loss: 2738101.2500, Reward: -55263.3447
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25862, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 5400, Total loss: 96384616.0000, CE loss: 2.8931, RL loss: 963846.1250, Reward: -55167.3584
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25998, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 5500, Total loss: 521133088.0000, CE loss: 2.8933, RL loss: 5211331.0000, Reward: -55107.1143
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 26662, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 5600, Total loss: -296155648.0000, CE loss: 2.8931, RL loss: -2961556.5000, Reward: -55411.7939
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25810, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 5700, Total loss: 114083024.0000, CE loss: 2.8930, RL loss: 1140830.2500, Reward: -55197.1426
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25880, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 5800, Total loss: 84488544.0000, CE loss: 2.8932, RL loss: 844885.4375, Reward: -55228.6230
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25905, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 5900, Total loss: 210573600.0000, CE loss: 2.8935, RL loss: 2105736.0000, Reward: -55249.5342
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25406, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
--- eval ---
prediction result:
f1 on test:    0.3942
f1 on test:    0.5964 (micro)
f1 on KB:      0.4433
integrated f1: 0.4267, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3856
f1 on test:    0.6021 (micro)
f1 on KB:      0.5093
integrated f1: 0.4722, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: -346900800.0000, CE loss: 2.8935, RL loss: -3469008.0000, Reward: -55376.7627
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25492, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 6100, Total loss: 443967648.0000, CE loss: 2.8929, RL loss: 4439676.5000, Reward: -55040.2480
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25780, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 6200, Total loss: -24629822.0000, CE loss: 2.8934, RL loss: -246298.2188, Reward: -55223.8223
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25554, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 6300, Total loss: -115865672.0000, CE loss: 2.8935, RL loss: -1158656.7500, Reward: -55316.6455
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25348, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 6400, Total loss: 93094576.0000, CE loss: 2.8928, RL loss: 930945.7500, Reward: -55224.9229
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25884, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 6500, Total loss: -11943810.0000, CE loss: 2.8931, RL loss: -119438.1016, Reward: -55208.0947
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25935, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 6600, Total loss: -29544000.0000, CE loss: 2.8934, RL loss: -295440.0000, Reward: -55303.3291
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 26028, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 6700, Total loss: -98098400.0000, CE loss: 2.8932, RL loss: -980984.0000, Reward: -55263.7334
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25514, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 6800, Total loss: -234984704.0000, CE loss: 2.8931, RL loss: -2349847.0000, Reward: -55320.7402
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25562, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 6900, Total loss: 633136512.0000, CE loss: 2.8931, RL loss: 6331365.0000, Reward: -54958.7441
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25934, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7000, Total loss: 65764732.0000, CE loss: 2.8934, RL loss: 657647.3125, Reward: -55254.4102
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25437, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7100, Total loss: -242523776.0000, CE loss: 2.8931, RL loss: -2425237.7500, Reward: -55340.7998
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25960, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7200, Total loss: 114761912.0000, CE loss: 2.8934, RL loss: 1147619.1250, Reward: -55193.8125
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25376, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7300, Total loss: 306188000.0000, CE loss: 2.8928, RL loss: 3061880.0000, Reward: -55113.5195
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25958, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7400, Total loss: 331060992.0000, CE loss: 2.8933, RL loss: 3310610.0000, Reward: -55071.6543
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 26338, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7500, Total loss: -76752672.0000, CE loss: 2.8929, RL loss: -767526.7500, Reward: -55307.5723
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 27314, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7600, Total loss: -2663010.2500, CE loss: 2.8928, RL loss: -26630.1016, Reward: -55199.4570
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25618, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7700, Total loss: 78074536.0000, CE loss: 2.8931, RL loss: 780745.3750, Reward: -55224.0762
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25584, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7800, Total loss: -414499808.0000, CE loss: 2.8929, RL loss: -4144998.0000, Reward: -55349.2773
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 26397, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
Epoch 7900, Total loss: 67468872.0000, CE loss: 2.8930, RL loss: 674688.7500, Reward: -55212.2188
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 25213, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
--- eval ---
prediction result:
f1 on test:    0.3942
f1 on test:    0.5964 (micro)
f1 on KB:      0.4433
integrated f1: 0.4267, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3856
f1 on test:    0.6021 (micro)
f1 on KB:      0.5093
integrated f1: 0.4722, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: 202828048.0000, CE loss: 2.8931, RL loss: 2028280.5000, Reward: -55143.4307
    full cols: 178, non-full cols: 0
   r - labels: 36, labels - r: 19
    violated: 26442, weighted: 382.42169189453125, len: 0.0, nonzero: 0.11756935715675354
------ ABL Loop 1 ------
--- eval ---
prediction result:
f1 on test:    0.3942
f1 on test:    0.5964 (micro)
f1 on KB:      0.4433
integrated f1: 0.4203, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3856
f1 on test:    0.6021 (micro)
f1 on KB:      0.5093
integrated f1: 0.4568, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.4203
Iteration 0: Loss = 155614.593750
|Xk-Y|_F:  155614.593750, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 155613, f1 =  0.276833, approx slack: 42529
rounded before pow |X_k-Y|_0 = 155613, f1 =  0.276833

Iteration 20: Loss = 112075.867188
|Xk-Y|_F:  94204.765625, |X-X0|:  17871.101562
rounded |X_k-Y|_0 = 93131, f1 =  0.620544, approx slack: 1506626
rounded before pow |X_k-Y|_0 = 132655, f1 =  0.519698

Iteration 40: Loss = 106228.351562
|Xk-Y|_F:  92966.390625, |X-X0|:  13261.958984
rounded |X_k-Y|_0 = 92714, f1 =  0.621805, approx slack: 1252624
rounded before pow |X_k-Y|_0 = 132344, f1 =  0.520448

Iteration 60: Loss = 104195.218750
|Xk-Y|_F:  92764.007812, |X-X0|:  11431.210938
rounded |X_k-Y|_0 = 92642, f1 =  0.622023, approx slack: 969951
rounded before pow |X_k-Y|_0 = 127435, f1 =  0.532289

Iteration 80: Loss = 103027.539062
|Xk-Y|_F:  92635.093750, |X-X0|:  10392.443359
rounded |X_k-Y|_0 = 92600, f1 =  0.622144, approx slack: 796415
rounded before pow |X_k-Y|_0 = 126825, f1 =  0.533784

Iteration 100: Loss = 102066.039062
|Xk-Y|_F:  92583.179688, |X-X0|:  9482.861328
rounded |X_k-Y|_0 = 92553, f1 =  0.622285, approx slack: 597107
rounded before pow |X_k-Y|_0 = 121251, f1 =  0.546359

Iteration 120: Loss = 101023.054688
|Xk-Y|_F:  92541.828125, |X-X0|:  8481.228516
rounded |X_k-Y|_0 = 92484, f1 =  0.622493, approx slack: 541799
rounded before pow |X_k-Y|_0 = 119423, f1 =  0.550935

Iteration 140: Loss = 100181.390625
|Xk-Y|_F:  92434.890625, |X-X0|:  7746.498535
rounded |X_k-Y|_0 = 92351, f1 =  0.622892, approx slack: 361609
rounded before pow |X_k-Y|_0 = 109361, f1 =  0.575247

Iteration 160: Loss = 99339.898438
|Xk-Y|_F:  92419.023438, |X-X0|:  6920.871582
rounded |X_k-Y|_0 = 92334, f1 =  0.622945, approx slack: 343806
rounded before pow |X_k-Y|_0 = 108769, f1 =  0.576762

Iteration 180: Loss = 98768.054688
|Xk-Y|_F:  92354.796875, |X-X0|:  6413.256348
rounded |X_k-Y|_0 = 92310, f1 =  0.623017, approx slack: 333312
rounded before pow |X_k-Y|_0 = 108638, f1 =  0.577098

Iteration 200: Loss = 98475.828125
|Xk-Y|_F:  92300.757812, |X-X0|:  6175.071289
rounded |X_k-Y|_0 = 92304, f1 =  0.623035, approx slack: 326589
rounded before pow |X_k-Y|_0 = 108428, f1 =  0.577638

Iteration 220: Loss = 98240.820312
|Xk-Y|_F:  92280.304688, |X-X0|:  5960.518066
rounded |X_k-Y|_0 = 92295, f1 =  0.623063, approx slack: 322010
rounded before pow |X_k-Y|_0 = 108402, f1 =  0.577704

Iteration 240: Loss = 97761.265625
|Xk-Y|_F:  92271.609375, |X-X0|:  5489.654297
rounded |X_k-Y|_0 = 92283, f1 =  0.623099, approx slack: 305956
rounded before pow |X_k-Y|_0 = 107948, f1 =  0.578876

Iteration 260: Loss = 97404.625000
|Xk-Y|_F:  92256.125000, |X-X0|:  5148.499023
rounded |X_k-Y|_0 = 92281, f1 =  0.623107, approx slack: 300641
rounded before pow |X_k-Y|_0 = 107662, f1 =  0.579613

Iteration 280: Loss = 97327.703125
|Xk-Y|_F:  92242.023438, |X-X0|:  5085.683594
rounded |X_k-Y|_0 = 92277, f1 =  0.623119, approx slack: 297683
rounded before pow |X_k-Y|_0 = 107565, f1 =  0.579865

Iteration 300: Loss = 97255.812500
|Xk-Y|_F:  92231.750000, |X-X0|:  5024.058594
rounded |X_k-Y|_0 = 92271, f1 =  0.623138, approx slack: 285101
rounded before pow |X_k-Y|_0 = 106499, f1 =  0.582638

Iteration 320: Loss = 97127.609375
|Xk-Y|_F:  92224.984375, |X-X0|:  4902.625977
rounded |X_k-Y|_0 = 92268, f1 =  0.623147, approx slack: 257014
rounded before pow |X_k-Y|_0 = 105520, f1 =  0.585206

Iteration 340: Loss = 97079.546875
|Xk-Y|_F:  92218.812500, |X-X0|:  4860.736328
rounded |X_k-Y|_0 = 92265, f1 =  0.623158, approx slack: 249054
rounded before pow |X_k-Y|_0 = 104454, f1 =  0.588041

Iteration 360: Loss = 97031.781250
|Xk-Y|_F:  92215.437500, |X-X0|:  4816.343750
rounded |X_k-Y|_0 = 92265, f1 =  0.623158, approx slack: 238452
rounded before pow |X_k-Y|_0 = 103484, f1 =  0.590658

Iteration 380: Loss = 96996.718750
|Xk-Y|_F:  92206.265625, |X-X0|:  4790.453613
rounded |X_k-Y|_0 = 92264, f1 =  0.623161, approx slack: 235058
rounded before pow |X_k-Y|_0 = 103281, f1 =  0.591209

Iteration 400: Loss = 96970.578125
|Xk-Y|_F:  92199.093750, |X-X0|:  4771.484863
rounded |X_k-Y|_0 = 92265, f1 =  0.623158, approx slack: 224336
rounded before pow |X_k-Y|_0 = 102491, f1 =  0.593357

Iteration 420: Loss = 96953.523438
|Xk-Y|_F:  92192.367188, |X-X0|:  4761.156250
rounded |X_k-Y|_0 = 92259, f1 =  0.623176, approx slack: 225483
rounded before pow |X_k-Y|_0 = 102758, f1 =  0.592641

Iteration 440: Loss = 96932.382812
|Xk-Y|_F:  92186.179688, |X-X0|:  4746.200195
rounded |X_k-Y|_0 = 92247, f1 =  0.623213, approx slack: 225500
rounded before pow |X_k-Y|_0 = 102758, f1 =  0.592641

Iteration 460: Loss = 96913.921875
|Xk-Y|_F:  92181.007812, |X-X0|:  4732.913086
rounded |X_k-Y|_0 = 92240, f1 =  0.623235, approx slack: 216795
rounded before pow |X_k-Y|_0 = 102060, f1 =  0.594556

Iteration 480: Loss = 96890.554688
|Xk-Y|_F:  92176.265625, |X-X0|:  4714.286621
rounded |X_k-Y|_0 = 92240, f1 =  0.623234, approx slack: 210982
rounded before pow |X_k-Y|_0 = 101473, f1 =  0.596179

Iteration 500: Loss = 96873.968750
|Xk-Y|_F:  92171.718750, |X-X0|:  4702.247559
rounded |X_k-Y|_0 = 92234, f1 =  0.623253, approx slack: 208612
rounded before pow |X_k-Y|_0 = 101256, f1 =  0.596781

Iteration 520: Loss = 96853.257812
|Xk-Y|_F:  92167.312500, |X-X0|:  4685.945312
rounded |X_k-Y|_0 = 92234, f1 =  0.623253, approx slack: 196136
rounded before pow |X_k-Y|_0 = 100799, f1 =  0.598053

Iteration 540: Loss = 96833.437500
|Xk-Y|_F:  92163.515625, |X-X0|:  4669.925781
rounded |X_k-Y|_0 = 92225, f1 =  0.623280, approx slack: 194533
rounded before pow |X_k-Y|_0 = 100697, f1 =  0.598338

Iteration 560: Loss = 96804.296875
|Xk-Y|_F:  92159.679688, |X-X0|:  4644.616211
rounded |X_k-Y|_0 = 92223, f1 =  0.623286, approx slack: 185913
rounded before pow |X_k-Y|_0 = 99939, f1 =  0.600580

Iteration 580: Loss = 96789.367188
|Xk-Y|_F:  92155.804688, |X-X0|:  4633.563965
rounded |X_k-Y|_0 = 92219, f1 =  0.623299, approx slack: 184796
rounded before pow |X_k-Y|_0 = 99850, f1 =  0.600829

Iteration 600: Loss = 96777.039062
|Xk-Y|_F:  92152.210938, |X-X0|:  4624.827637
rounded |X_k-Y|_0 = 92216, f1 =  0.623308, approx slack: 184891
rounded before pow |X_k-Y|_0 = 99760, f1 =  0.601082

Iteration 620: Loss = 96755.335938
|Xk-Y|_F:  92148.687500, |X-X0|:  4606.649414
rounded |X_k-Y|_0 = 92210, f1 =  0.623326, approx slack: 181359
rounded before pow |X_k-Y|_0 = 99399, f1 =  0.602099

Iteration 640: Loss = 96738.328125
|Xk-Y|_F:  92145.171875, |X-X0|:  4593.156250
rounded |X_k-Y|_0 = 92209, f1 =  0.623329, approx slack: 119327
rounded before pow |X_k-Y|_0 = 95088, f1 =  0.614574

Iteration 660: Loss = 96721.710938
|Xk-Y|_F:  92141.703125, |X-X0|:  4580.008789
rounded |X_k-Y|_0 = 92201, f1 =  0.623353, approx slack: 112221
rounded before pow |X_k-Y|_0 = 95050, f1 =  0.614687

Iteration 680: Loss = 96706.984375
|Xk-Y|_F:  92138.257812, |X-X0|:  4568.729980
rounded |X_k-Y|_0 = 92198, f1 =  0.623362, approx slack: 111605
rounded before pow |X_k-Y|_0 = 95021, f1 =  0.614773

Iteration 700: Loss = 96698.562500
|Xk-Y|_F:  92134.648438, |X-X0|:  4563.916992
rounded |X_k-Y|_0 = 92195, f1 =  0.623371, approx slack: 111636
rounded before pow |X_k-Y|_0 = 95020, f1 =  0.614776

Iteration 720: Loss = 96686.398438
|Xk-Y|_F:  92130.976562, |X-X0|:  4555.422852
rounded |X_k-Y|_0 = 92193, f1 =  0.623377, approx slack: 109844
rounded before pow |X_k-Y|_0 = 94985, f1 =  0.614880

Iteration 740: Loss = 96676.562500
|Xk-Y|_F:  92127.367188, |X-X0|:  4549.193848
rounded |X_k-Y|_0 = 92186, f1 =  0.623399, approx slack: 108544
rounded before pow |X_k-Y|_0 = 94975, f1 =  0.614910

Iteration 760: Loss = 96663.601562
|Xk-Y|_F:  92123.531250, |X-X0|:  4540.067383
rounded |X_k-Y|_0 = 92179, f1 =  0.623420, approx slack: 107421
rounded before pow |X_k-Y|_0 = 94965, f1 =  0.614939

Iteration 780: Loss = 96652.843750
|Xk-Y|_F:  92119.585938, |X-X0|:  4533.261719
rounded |X_k-Y|_0 = 92173, f1 =  0.623438, approx slack: 104552
rounded before pow |X_k-Y|_0 = 94855, f1 =  0.615267

Iteration 800: Loss = 96645.296875
|Xk-Y|_F:  92115.546875, |X-X0|:  4529.746094
rounded |X_k-Y|_0 = 92172, f1 =  0.623441, approx slack: 104193
rounded before pow |X_k-Y|_0 = 94855, f1 =  0.615267

Iteration 820: Loss = 96638.773438
|Xk-Y|_F:  92112.265625, |X-X0|:  4526.510742
rounded |X_k-Y|_0 = 92168, f1 =  0.623453, approx slack: 103384
rounded before pow |X_k-Y|_0 = 94855, f1 =  0.615267

Iteration 840: Loss = 96624.679688
|Xk-Y|_F:  92110.023438, |X-X0|:  4514.655762
rounded |X_k-Y|_0 = 92166, f1 =  0.623459, approx slack: 101953
rounded before pow |X_k-Y|_0 = 94762, f1 =  0.615546

Iteration 860: Loss = 96612.812500
|Xk-Y|_F:  92107.023438, |X-X0|:  4505.786133
rounded |X_k-Y|_0 = 92165, f1 =  0.623462, approx slack: 100279
rounded before pow |X_k-Y|_0 = 94752, f1 =  0.615575

Iteration 880: Loss = 96599.703125
|Xk-Y|_F:  92103.859375, |X-X0|:  4495.845703
rounded |X_k-Y|_0 = 92164, f1 =  0.623465, approx slack: 98820
rounded before pow |X_k-Y|_0 = 94722, f1 =  0.615665

Iteration 900: Loss = 96590.984375
|Xk-Y|_F:  92100.804688, |X-X0|:  4490.175781
rounded |X_k-Y|_0 = 92163, f1 =  0.623468, approx slack: 97538
rounded before pow |X_k-Y|_0 = 94702, f1 =  0.615724

Iteration 920: Loss = 96582.437500
|Xk-Y|_F:  92095.765625, |X-X0|:  4486.673828
rounded |X_k-Y|_0 = 92152, f1 =  0.623502, approx slack: 96493
rounded before pow |X_k-Y|_0 = 94690, f1 =  0.615760

Iteration 940: Loss = 96567.101562
|Xk-Y|_F:  92084.039062, |X-X0|:  4483.059082
rounded |X_k-Y|_0 = 92147, f1 =  0.623517, approx slack: 94349
rounded before pow |X_k-Y|_0 = 94654, f1 =  0.615900

Iteration 960: Loss = 96537.531250
|Xk-Y|_F:  92055.296875, |X-X0|:  4482.238281
rounded |X_k-Y|_0 = 92139, f1 =  0.623540, approx slack: 93138
rounded before pow |X_k-Y|_0 = 94624, f1 =  0.615990

Iteration 980: Loss = 96493.140625
|Xk-Y|_F:  92014.414062, |X-X0|:  4478.725098
rounded |X_k-Y|_0 = 92115, f1 =  0.623612, approx slack: 90988
rounded before pow |X_k-Y|_0 = 94654, f1 =  0.615900

Iteration 1000: Loss = 96443.492188
|Xk-Y|_F:  91965.523438, |X-X0|:  4477.971680
rounded |X_k-Y|_0 = 92071, f1 =  0.623744, approx slack: 88893
rounded before pow |X_k-Y|_0 = 94420, f1 =  0.616597

Iteration 1020: Loss = 96404.117188
|Xk-Y|_F:  91930.453125, |X-X0|:  4473.660645
rounded |X_k-Y|_0 = 92019, f1 =  0.623900, approx slack: 88299
rounded before pow |X_k-Y|_0 = 94404, f1 =  0.616645

Iteration 1040: Loss = 96378.226562
|Xk-Y|_F:  91915.203125, |X-X0|:  4463.022461
rounded |X_k-Y|_0 = 91968, f1 =  0.624052, approx slack: 86384
rounded before pow |X_k-Y|_0 = 94344, f1 =  0.616824

Iteration 1060: Loss = 96364.523438
|Xk-Y|_F:  91907.984375, |X-X0|:  4456.536621
rounded |X_k-Y|_0 = 91956, f1 =  0.624088, approx slack: 85154
rounded before pow |X_k-Y|_0 = 94320, f1 =  0.616896

Iteration 1080: Loss = 96347.726562
|Xk-Y|_F:  91904.007812, |X-X0|:  4443.721191
rounded |X_k-Y|_0 = 91937, f1 =  0.624144, approx slack: 84568
rounded before pow |X_k-Y|_0 = 94307, f1 =  0.616935

Converged at iteration 1092
------ ABL 1 after refine ------
--- eval ---
prediction result:
f1 on test:    0.3942
f1 on test:    0.5964 (micro)
f1 on KB:      0.5331
integrated f1: 0.4585, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3838
f1 on test:    0.6015 (micro)
f1 on KB:      0.5928
integrated f1: 0.5040, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.4585
