MLP_eco_Sep3_2
log/EGOAL-eco-2025-09-04-07:27:16.443689.txt
random seed: 0
train shape: torch.Size([434, 1514]), test shape: torch.Size([72, 1514])
cuda availability: True
/home/u-xiangyf/anaconda3/envs/egoal/lib/python3.13/site-packages/torch/nn/modules/loss.py:608: UserWarning: Using a target size (torch.Size([1514])) that is different to the input size (torch.Size([4639, 1514])). This will likely lead to incorrect results due to broadcasting. Please ensure they have the same size.
  return F.mse_loss(input, target, reduction=self.reduction)
Epoch 0, Loss: 0.2197
Epoch 100, Loss: 0.2129
Epoch 200, Loss: 0.2063
Epoch 300, Loss: 0.1998
Epoch 400, Loss: 0.1935
Epoch 500, Loss: 0.1874
Epoch 600, Loss: 0.1815
Epoch 700, Loss: 0.1757
Epoch 800, Loss: 0.1700
Epoch 900, Loss: 0.1646
Final loss: 0.1593148410320282
Achieved outputs: tensor([[0.4326, 0.4566, 0.4028,  ..., 0.4383, 0.4110, 0.4440],
        [0.4328, 0.4567, 0.4030,  ..., 0.4387, 0.4111, 0.4439],
        [0.4329, 0.4571, 0.4032,  ..., 0.4389, 0.4115, 0.4444],
        ...,
        [0.4324, 0.4567, 0.4028,  ..., 0.4383, 0.4107, 0.4439],
        [0.4330, 0.4570, 0.4030,  ..., 0.4386, 0.4111, 0.4443],
        [0.4329, 0.4573, 0.4031,  ..., 0.4390, 0.4115, 0.4444]],
       device='cuda:4')
Eval weight w_data: 0.4246200244007528
Before pretrain: integrated f1 0.2472
Epoch 100, Total loss: 3747194.7500, CE loss: 7.2351, RL loss: 374718.7500, Reward: -129685.3096
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 12083, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 200, Total loss: 974159.2500, CE loss: 6.9027, RL loss: 97415.2344, Reward: -128825.3604
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 10113, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 300, Total loss: 7898917.5000, CE loss: 6.7147, RL loss: 789891.1250, Reward: -127733.9150
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 11076, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 400, Total loss: 9160011.0000, CE loss: 6.6115, RL loss: 916000.3750, Reward: -126067.0410
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 13528, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 500, Total loss: 10687587.0000, CE loss: 6.5539, RL loss: 1068758.0000, Reward: -123264.7559
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 10247, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
------ Before ABL ------
--- eval ---
prediction result:
f1 on test:    0.3314
f1 on test:    0.6636 (micro)
f1 on KB:      0.3362
integrated f1: 0.3341, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3614
f1 on test:    0.6730 (micro)
f1 on KB:      0.5245
integrated f1: 0.4552, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3341

Epoch 100, Total loss: 143150992.0000, CE loss: 4.4985, RL loss: 1431509.8750, Reward: -89057.3242
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 10296, weighted: 0.8253402709960938, len: 0.0, nonzero: 0.10568031668663025
Epoch 200, Total loss: -9950602.0000, CE loss: 4.4243, RL loss: -99506.0156, Reward: -87950.4707
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 10001, weighted: 0.8253402709960938, len: 0.0, nonzero: 0.10568031668663025
Epoch 300, Total loss: 824880.8750, CE loss: 4.3307, RL loss: 8248.8086, Reward: -86420.9697
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 7876, weighted: 0.8253402709960938, len: 0.0, nonzero: 0.10568031668663025
Epoch 400, Total loss: 149868336.0000, CE loss: 4.2076, RL loss: 1498683.3750, Reward: -83125.5820
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 8710, weighted: 0.8253402709960938, len: 0.0, nonzero: 0.10568031668663025
Epoch 500, Total loss: 60774056.0000, CE loss: 3.8976, RL loss: 607740.5625, Reward: -67366.1650
    full cols: 159, non-full cols: 1
   r - labels: 0, labels - r: 1
    violated: 7927, weighted: 2.4929842948913574, len: 0.0, nonzero: 0.10503014177083969
Epoch 600, Total loss: -12824745.0000, CE loss: 3.7850, RL loss: -128247.4453, Reward: -61602.9961
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 12292, weighted: 2.5194549560546875, len: 0.0, nonzero: 0.10501981526613235
Epoch 700, Total loss: 8527937.0000, CE loss: 3.7119, RL loss: 85279.3672, Reward: -59331.6719
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 9413, weighted: 2.5194549560546875, len: 0.0, nonzero: 0.10501981526613235
Epoch 800, Total loss: 69173936.0000, CE loss: 3.6745, RL loss: 691739.3750, Reward: -57888.3359
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 8455, weighted: 2.5194549560546875, len: 0.0, nonzero: 0.10501981526613235
Epoch 900, Total loss: 58906268.0000, CE loss: 3.6384, RL loss: 589062.6875, Reward: -56655.7861
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 6721, weighted: 2.5194549560546875, len: 0.0, nonzero: 0.10501981526613235
Epoch 1000, Total loss: 39771708.0000, CE loss: 3.6111, RL loss: 397717.0938, Reward: -55993.2646
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 11090, weighted: 2.5194549560546875, len: 0.0, nonzero: 0.10501981526613235
Epoch 1100, Total loss: 104221976.0000, CE loss: 3.5891, RL loss: 1042219.7500, Reward: -54973.9307
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 7996, weighted: 2.5194549560546875, len: 0.0, nonzero: 0.10501981526613235
Epoch 1200, Total loss: -35549412.0000, CE loss: 3.5417, RL loss: -355494.1250, Reward: -54691.7217
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 10178, weighted: 2.5194549560546875, len: 0.0, nonzero: 0.10501981526613235
Epoch 1300, Total loss: 17325134.0000, CE loss: 3.5371, RL loss: 173251.3438, Reward: -53896.1895
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 7694, weighted: 2.5194549560546875, len: 0.0, nonzero: 0.10501981526613235
Epoch 1400, Total loss: -41012100.0000, CE loss: 3.5348, RL loss: -410121.0000, Reward: -53646.7021
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 9967, weighted: 2.5194549560546875, len: 0.0, nonzero: 0.10501981526613235
Epoch 1500, Total loss: 141415184.0000, CE loss: 3.5208, RL loss: 1414151.8750, Reward: -52781.4248
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 10537, weighted: 2.5194549560546875, len: 0.0, nonzero: 0.10501981526613235
Epoch 1600, Total loss: -116201184.0000, CE loss: 3.4989, RL loss: -1162011.8750, Reward: -53273.7168
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 10843, weighted: 2.5194549560546875, len: 0.0, nonzero: 0.10501981526613235
Epoch 1700, Total loss: -53386864.0000, CE loss: 3.5014, RL loss: -533868.6250, Reward: -53150.6650
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 10673, weighted: 2.5194549560546875, len: 0.0, nonzero: 0.10501981526613235
Epoch 1800, Total loss: -39478580.0000, CE loss: 3.4962, RL loss: -394785.8125, Reward: -53038.1348
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 9155, weighted: 2.5194549560546875, len: 0.0, nonzero: 0.10501981526613235
Epoch 1900, Total loss: -16166264.0000, CE loss: 3.4799, RL loss: -161662.6406, Reward: -53019.3877
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 8146, weighted: 2.5194549560546875, len: 0.0, nonzero: 0.10501981526613235
--- eval ---
prediction result:
f1 on test:    0.3622
f1 on test:    0.6613 (micro)
f1 on KB:      0.3619
integrated f1: 0.3620, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3612
f1 on test:    0.6727 (micro)
f1 on KB:      0.5226
integrated f1: 0.4742, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: 73859904.0000, CE loss: 3.4654, RL loss: 738599.0625, Reward: -52698.1416
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 7569, weighted: 1.6941146850585938, len: 0.0, nonzero: 0.10568031668663025
Epoch 2100, Total loss: -110841488.0000, CE loss: 3.4643, RL loss: -1108414.8750, Reward: -52969.0488
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 8026, weighted: 1.6941146850585938, len: 0.0, nonzero: 0.10568031668663025
Epoch 2200, Total loss: 122229160.0000, CE loss: 3.4553, RL loss: 1222291.6250, Reward: -52372.9980
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 8119, weighted: 1.6941146850585938, len: 0.0, nonzero: 0.10568031668663025
Epoch 2300, Total loss: -64615380.0000, CE loss: 3.4404, RL loss: -646153.8125, Reward: -52728.2783
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 10136, weighted: 1.6941146850585938, len: 0.0, nonzero: 0.10568031668663025
Epoch 2400, Total loss: -20461712.0000, CE loss: 3.4332, RL loss: -204617.1250, Reward: -52561.6455
    full cols: 161, non-full cols: 0
   r - labels: 1, labels - r: 1
    violated: 8860, weighted: 2.0271453857421875, len: 0.0, nonzero: 0.10634082555770874
Epoch 2500, Total loss: 8652596.0000, CE loss: 3.4192, RL loss: 86525.9609, Reward: -52598.6475
    full cols: 161, non-full cols: 0
   r - labels: 1, labels - r: 1
    violated: 7476, weighted: 2.0271453857421875, len: 0.0, nonzero: 0.10634082555770874
Epoch 2600, Total loss: 117248760.0000, CE loss: 3.4134, RL loss: 1172487.6250, Reward: -52308.9766
    full cols: 161, non-full cols: 0
   r - labels: 1, labels - r: 1
    violated: 6594, weighted: 2.0271453857421875, len: 0.0, nonzero: 0.10634082555770874
Epoch 2700, Total loss: 61255000.0000, CE loss: 3.4017, RL loss: 612550.0000, Reward: -52523.5908
    full cols: 161, non-full cols: 0
   r - labels: 1, labels - r: 1
    violated: 8904, weighted: 2.0271453857421875, len: 0.0, nonzero: 0.10634082555770874
Epoch 2800, Total loss: -14956506.0000, CE loss: 3.3942, RL loss: -149565.0625, Reward: -52886.6035
    full cols: 161, non-full cols: 0
   r - labels: 1, labels - r: 1
    violated: 8967, weighted: 2.0271453857421875, len: 0.0, nonzero: 0.10634082555770874
Epoch 2900, Total loss: 90803184.0000, CE loss: 3.3778, RL loss: 908031.8125, Reward: -52558.1523
    full cols: 161, non-full cols: 0
   r - labels: 1, labels - r: 1
    violated: 10389, weighted: 2.0271453857421875, len: 0.0, nonzero: 0.10634082555770874
Epoch 3000, Total loss: -6482230.5000, CE loss: 3.3600, RL loss: -64822.3047, Reward: -52883.8799
    full cols: 161, non-full cols: 0
   r - labels: 1, labels - r: 1
    violated: 10657, weighted: 2.0271453857421875, len: 0.0, nonzero: 0.10634082555770874
Epoch 3100, Total loss: 34135416.0000, CE loss: 3.3559, RL loss: 341354.1562, Reward: -52819.6924
    full cols: 161, non-full cols: 0
   r - labels: 1, labels - r: 1
    violated: 7945, weighted: 2.0271453857421875, len: 0.0, nonzero: 0.10634082555770874
Epoch 3200, Total loss: -116150472.0000, CE loss: 3.3293, RL loss: -1161504.7500, Reward: -53200.8389
    full cols: 161, non-full cols: 0
   r - labels: 1, labels - r: 1
    violated: 8764, weighted: 2.0271453857421875, len: 0.0, nonzero: 0.10634082555770874
Epoch 3300, Total loss: -5224094.0000, CE loss: 3.3308, RL loss: -52240.9375, Reward: -53006.9326
    full cols: 161, non-full cols: 0
   r - labels: 1, labels - r: 1
    violated: 7926, weighted: 2.0271453857421875, len: 0.0, nonzero: 0.10634082555770874
Epoch 3400, Total loss: 47854116.0000, CE loss: 3.3198, RL loss: 478541.1562, Reward: -52885.8135
    full cols: 161, non-full cols: 0
   r - labels: 1, labels - r: 1
    violated: 9059, weighted: 2.0271453857421875, len: 0.0, nonzero: 0.10634082555770874
Epoch 3500, Total loss: -96189384.0000, CE loss: 3.3020, RL loss: -961893.8750, Reward: -53200.2217
    full cols: 161, non-full cols: 1
   r - labels: 2, labels - r: 1
    violated: 9574, weighted: 7.947734355926514, len: 0.0, nonzero: 0.10668139159679413
Epoch 3600, Total loss: -126581504.0000, CE loss: 3.2881, RL loss: -1265815.0000, Reward: -53348.4727
    full cols: 161, non-full cols: 2
   r - labels: 3, labels - r: 1
    violated: 10346, weighted: 17.535968780517578, len: 0.0, nonzero: 0.10701164603233337
Epoch 3700, Total loss: 74531816.0000, CE loss: 3.2751, RL loss: 745318.1875, Reward: -52821.6055
    full cols: 162, non-full cols: 0
   r - labels: 2, labels - r: 1
    violated: 9734, weighted: 34.02714538574219, len: 0.0, nonzero: 0.10700132697820663
Epoch 3800, Total loss: -57179112.0000, CE loss: 3.2589, RL loss: -571791.1250, Reward: -53307.2002
    full cols: 160, non-full cols: 0
   r - labels: 1, labels - r: 2
    violated: 9756, weighted: 2.8524856567382812, len: 0.0, nonzero: 0.10568031668663025
Epoch 3900, Total loss: 84035872.0000, CE loss: 3.2460, RL loss: 840358.7500, Reward: -52983.0850
    full cols: 160, non-full cols: 0
   r - labels: 1, labels - r: 2
    violated: 7627, weighted: 2.8524856567382812, len: 0.0, nonzero: 0.10568031668663025
--- eval ---
prediction result:
f1 on test:    0.3914
f1 on test:    0.6543 (micro)
f1 on KB:      0.3743
integrated f1: 0.3792, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3625
f1 on test:    0.6727 (micro)
f1 on KB:      0.5235
integrated f1: 0.4752, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: -96223224.0000, CE loss: 3.2351, RL loss: -962232.2500, Reward: -53571.1182
    full cols: 161, non-full cols: 0
   r - labels: 1, labels - r: 1
    violated: 9523, weighted: 1.1583709716796875, len: 0.0, nonzero: 0.10634082555770874
Epoch 4100, Total loss: 40090188.0000, CE loss: 3.2213, RL loss: 400901.8750, Reward: -53207.5908
    full cols: 161, non-full cols: 0
   r - labels: 1, labels - r: 1
    violated: 8662, weighted: 1.1583709716796875, len: 0.0, nonzero: 0.10634082555770874
Epoch 4200, Total loss: -173012784.0000, CE loss: 3.2099, RL loss: -1730127.8750, Reward: -53869.1816
    full cols: 162, non-full cols: 0
   r - labels: 2, labels - r: 1
    violated: 7343, weighted: 2.5049781799316406, len: 0.0, nonzero: 0.10700132697820663
Epoch 4300, Total loss: -11894683.0000, CE loss: 3.1992, RL loss: -118946.8281, Reward: -53581.3281
    full cols: 159, non-full cols: 1
   r - labels: 1, labels - r: 2
    violated: 7393, weighted: 4.4981889724731445, len: 0.0, nonzero: 0.10565967857837677
Epoch 4400, Total loss: 3287024.2500, CE loss: 3.1889, RL loss: 32870.2422, Reward: -53547.5127
    full cols: 159, non-full cols: 1
   r - labels: 1, labels - r: 2
    violated: 10109, weighted: 5.292304992675781, len: 0.0, nonzero: 0.1053500697016716
Epoch 4500, Total loss: -1053693.3750, CE loss: 3.1765, RL loss: -10536.9336, Reward: -53780.5518
    full cols: 160, non-full cols: 0
   r - labels: 1, labels - r: 2
    violated: 8025, weighted: 4.590045928955078, len: 0.0, nonzero: 0.10568031668663025
Epoch 4600, Total loss: -57112400.0000, CE loss: 3.1710, RL loss: -571124.0000, Reward: -53980.9668
    full cols: 160, non-full cols: 0
   r - labels: 1, labels - r: 2
    violated: 8208, weighted: 4.590045928955078, len: 0.0, nonzero: 0.10568031668663025
Epoch 4700, Total loss: -92086984.0000, CE loss: 3.1628, RL loss: -920869.8750, Reward: -54233.8672
    full cols: 159, non-full cols: 1
   r - labels: 1, labels - r: 2
    violated: 11454, weighted: 4.615839004516602, len: 0.0, nonzero: 0.10504046082496643
Epoch 4800, Total loss: 1970154.7500, CE loss: 3.1533, RL loss: 19701.5469, Reward: -54051.5098
    full cols: 159, non-full cols: 1
   r - labels: 2, labels - r: 3
    violated: 8110, weighted: 40.194339752197266, len: 0.0, nonzero: 0.10554615408182144
Epoch 4900, Total loss: -94043296.0000, CE loss: 3.1479, RL loss: -940433.0000, Reward: -54361.0615
    full cols: 159, non-full cols: 0
   r - labels: 1, labels - r: 3
    violated: 9289, weighted: 31.044342041015625, len: 0.0, nonzero: 0.10501981526613235
Epoch 5000, Total loss: 93387176.0000, CE loss: 3.1368, RL loss: 933871.7500, Reward: -53983.6611
    full cols: 160, non-full cols: 1
   r - labels: 2, labels - r: 2
    violated: 9749, weighted: 31.165607452392578, len: 0.0, nonzero: 0.10576288402080536
Epoch 5100, Total loss: -85919952.0000, CE loss: 3.1337, RL loss: -859199.5000, Reward: -54480.8594
    full cols: 160, non-full cols: 0
   r - labels: 1, labels - r: 2
    violated: 10228, weighted: 4.590045928955078, len: 0.0, nonzero: 0.10568031668663025
Epoch 5200, Total loss: -177324400.0000, CE loss: 3.1247, RL loss: -1773244.0000, Reward: -54712.9697
    full cols: 160, non-full cols: 0
   r - labels: 1, labels - r: 2
    violated: 8249, weighted: 4.590045928955078, len: 0.0, nonzero: 0.10568031668663025
Epoch 5300, Total loss: -64879976.0000, CE loss: 3.1212, RL loss: -648799.7500, Reward: -54404.9736
    full cols: 160, non-full cols: 0
   r - labels: 1, labels - r: 2
    violated: 7803, weighted: 4.590045928955078, len: 0.0, nonzero: 0.10568031668663025
Epoch 5400, Total loss: 48841060.0000, CE loss: 3.1158, RL loss: 488410.5938, Reward: -54233.3721
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 8964, weighted: 4.257015228271484, len: 0.0, nonzero: 0.10501981526613235
Epoch 5500, Total loss: 22933470.0000, CE loss: 3.1110, RL loss: 229334.7031, Reward: -54283.1729
    full cols: 160, non-full cols: 0
   r - labels: 1, labels - r: 2
    violated: 7510, weighted: 26.743892669677734, len: 0.0, nonzero: 0.10568031668663025
Epoch 5600, Total loss: -95712824.0000, CE loss: 3.1094, RL loss: -957128.2500, Reward: -54590.8691
    full cols: 159, non-full cols: 1
   r - labels: 1, labels - r: 2
    violated: 8516, weighted: 24.987106323242188, len: 0.0, nonzero: 0.10562872141599655
Epoch 5700, Total loss: -7200102.5000, CE loss: 3.1068, RL loss: -72001.0234, Reward: -54293.2520
    full cols: 159, non-full cols: 1
   r - labels: 1, labels - r: 2
    violated: 9478, weighted: 36.54819107055664, len: 0.0, nonzero: 0.10556679964065552
Epoch 5800, Total loss: -29078710.0000, CE loss: 3.1038, RL loss: -290787.0938, Reward: -54469.0469
    full cols: 158, non-full cols: 1
   r - labels: 1, labels - r: 3
    violated: 8599, weighted: 36.95112991333008, len: 0.0, nonzero: 0.10499917715787888
Epoch 5900, Total loss: 86337928.0000, CE loss: 3.1019, RL loss: 863379.3125, Reward: -54159.5361
    full cols: 160, non-full cols: 1
   r - labels: 2, labels - r: 2
    violated: 10127, weighted: 59.857688903808594, len: 0.0, nonzero: 0.1061447337269783
--- eval ---
prediction result:
f1 on test:    0.3880
f1 on test:    0.6443 (micro)
f1 on KB:      0.3702
integrated f1: 0.3753, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3621
f1 on test:    0.6722 (micro)
f1 on KB:      0.5222
integrated f1: 0.4742, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: -68045048.0000, CE loss: 3.1014, RL loss: -680450.5000, Reward: -54628.8740
    full cols: 161, non-full cols: 1
   r - labels: 3, labels - r: 2
    violated: 7401, weighted: 59.64909362792969, len: 0.0, nonzero: 0.10641306638717651
Epoch 6100, Total loss: 89717744.0000, CE loss: 3.0984, RL loss: 897177.4375, Reward: -54279.3877
    full cols: 161, non-full cols: 1
   r - labels: 4, labels - r: 3
    violated: 9721, weighted: 72.33573913574219, len: 0.0, nonzero: 0.10687748342752457
Epoch 6200, Total loss: -70464752.0000, CE loss: 3.0976, RL loss: -704647.5000, Reward: -54663.9492
    full cols: 161, non-full cols: 2
   r - labels: 5, labels - r: 3
    violated: 9125, weighted: 107.629638671875, len: 0.0, nonzero: 0.10702196508646011
Epoch 6300, Total loss: 35912540.0000, CE loss: 3.0963, RL loss: 359125.4062, Reward: -54383.0674
    full cols: 160, non-full cols: 1
   r - labels: 3, labels - r: 3
    violated: 10069, weighted: 52.065155029296875, len: 0.0, nonzero: 0.10592801123857498
Epoch 6400, Total loss: -32982568.0000, CE loss: 3.0982, RL loss: -329825.6875, Reward: -54516.0859
    full cols: 159, non-full cols: 0
   r - labels: 2, labels - r: 4
    violated: 8129, weighted: 40.89049530029297, len: 0.0, nonzero: 0.10501981526613235
Epoch 6500, Total loss: -51454684.0000, CE loss: 3.0963, RL loss: -514546.8438, Reward: -54624.7354
    full cols: 159, non-full cols: 1
   r - labels: 3, labels - r: 4
    violated: 8998, weighted: 73.31809997558594, len: 0.0, nonzero: 0.10536038875579834
Epoch 6600, Total loss: 50761988.0000, CE loss: 3.0942, RL loss: 507619.8750, Reward: -54299.9326
    full cols: 160, non-full cols: 1
   r - labels: 3, labels - r: 3
    violated: 9415, weighted: 86.99275207519531, len: 0.0, nonzero: 0.10632017999887466
Epoch 6700, Total loss: 55873732.0000, CE loss: 3.0946, RL loss: 558737.3125, Reward: -54277.8965
    full cols: 161, non-full cols: 0
   r - labels: 3, labels - r: 3
    violated: 8635, weighted: 87.99275207519531, len: 0.0, nonzero: 0.10634082555770874
Epoch 6800, Total loss: -66671820.0000, CE loss: 3.0931, RL loss: -666718.1875, Reward: -54675.7256
    full cols: 161, non-full cols: 2
   r - labels: 6, labels - r: 4
    violated: 9253, weighted: 88.48551940917969, len: 0.0, nonzero: 0.10679491609334946
Epoch 6900, Total loss: -115871400.0000, CE loss: 3.0947, RL loss: -1158714.0000, Reward: -54688.5000
    full cols: 161, non-full cols: 1
   r - labels: 4, labels - r: 3
    violated: 8647, weighted: 97.82488250732422, len: 0.0, nonzero: 0.10640274733304977
Epoch 7000, Total loss: 27961540.0000, CE loss: 3.0948, RL loss: 279615.4062, Reward: -54430.5850
    full cols: 161, non-full cols: 2
   r - labels: 6, labels - r: 4
    violated: 10040, weighted: 105.68754577636719, len: 0.0, nonzero: 0.10744509845972061
Epoch 7100, Total loss: -22729760.0000, CE loss: 3.0945, RL loss: -227297.5938, Reward: -54510.0674
    full cols: 161, non-full cols: 2
   r - labels: 6, labels - r: 4
    violated: 12411, weighted: 107.82579040527344, len: 0.0, nonzero: 0.10652659088373184
Epoch 7200, Total loss: -64181300.0000, CE loss: 3.0952, RL loss: -641813.0000, Reward: -54725.8379
    full cols: 164, non-full cols: 2
   r - labels: 8, labels - r: 3
    violated: 7738, weighted: 148.09027099609375, len: 0.0, nonzero: 0.10917891561985016
Epoch 7300, Total loss: 33622124.0000, CE loss: 3.0907, RL loss: 336221.2500, Reward: -54416.4385
    full cols: 164, non-full cols: 0
   r - labels: 7, labels - r: 4
    violated: 7189, weighted: 141.32125854492188, len: 0.0, nonzero: 0.10832232981920242
Epoch 7400, Total loss: -10806620.0000, CE loss: 3.0925, RL loss: -108066.2031, Reward: -54594.8330
    full cols: 165, non-full cols: 1
   r - labels: 9, labels - r: 4
    violated: 10369, weighted: 173.72012329101562, len: 0.0, nonzero: 0.10899315029382706
Epoch 7500, Total loss: 61529588.0000, CE loss: 3.0918, RL loss: 615295.8750, Reward: -54317.8008
    full cols: 165, non-full cols: 0
   r - labels: 8, labels - r: 4
    violated: 8383, weighted: 173.32125854492188, len: 0.0, nonzero: 0.10898283123970032
Epoch 7600, Total loss: 56564112.0000, CE loss: 3.0913, RL loss: 565641.1250, Reward: -54309.4082
    full cols: 163, non-full cols: 2
   r - labels: 8, labels - r: 4
    violated: 8284, weighted: 130.32919311523438, len: 0.0, nonzero: 0.10878674685955048
Epoch 7700, Total loss: 59954624.0000, CE loss: 3.0911, RL loss: 599546.2500, Reward: -54376.7656
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 8150, weighted: 142.47964477539062, len: 0.0, nonzero: 0.10832232981920242
Epoch 7800, Total loss: -7128078.0000, CE loss: 3.0935, RL loss: -71280.7812, Reward: -54426.3799
    full cols: 167, non-full cols: 0
   r - labels: 9, labels - r: 3
    violated: 10327, weighted: 184.12307739257812, len: 0.0, nonzero: 0.1103038340806961
Epoch 7900, Total loss: -54073836.0000, CE loss: 3.0905, RL loss: -540738.3750, Reward: -54681.7568
    full cols: 165, non-full cols: 0
   r - labels: 7, labels - r: 3
    violated: 9781, weighted: 134.4144744873047, len: 0.0, nonzero: 0.10898283123970032
--- eval ---
prediction result:
f1 on test:    0.3880
f1 on test:    0.6443 (micro)
f1 on KB:      0.3702
integrated f1: 0.3753, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3613
f1 on test:    0.6718 (micro)
f1 on KB:      0.5242
integrated f1: 0.4754, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: -68421040.0000, CE loss: 3.0905, RL loss: -684210.3750, Reward: -54626.6582
    full cols: 166, non-full cols: 0
   r - labels: 8, labels - r: 3
    violated: 10887, weighted: 136.52850341796875, len: 0.0, nonzero: 0.10964333266019821
------ ABL Loop 0 ------
--- eval ---
prediction result:
f1 on test:    0.3880
f1 on test:    0.6443 (micro)
f1 on KB:      0.3702
integrated f1: 0.3775, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3613
f1 on test:    0.6718 (micro)
f1 on KB:      0.5242
integrated f1: 0.4550, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3775
Iteration 0: Loss = 129299.414062
|Xk-Y|_F:  129299.414062, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 113507, f1 =  0.314469, approx slack: 1004
rounded before pow |X_k-Y|_0 = 113507, f1 =  0.314469

Iteration 20: Loss = 128818.492188
|Xk-Y|_F:  127873.203125, |X-X0|:  945.290283
rounded |X_k-Y|_0 = 113115, f1 =  0.316997, approx slack: 249
rounded before pow |X_k-Y|_0 = 113150, f1 =  0.316772

Iteration 40: Loss = 127039.757812
|Xk-Y|_F:  126800.929688, |X-X0|:  238.827789
rounded |X_k-Y|_0 = 113109, f1 =  0.317035, approx slack: 217
rounded before pow |X_k-Y|_0 = 113117, f1 =  0.316984

Iteration 60: Loss = 125713.507812
|Xk-Y|_F:  125594.921875, |X-X0|:  118.582657
rounded |X_k-Y|_0 = 113116, f1 =  0.316990, approx slack: 141
rounded before pow |X_k-Y|_0 = 113119, f1 =  0.316971

Iteration 80: Loss = 124304.085938
|Xk-Y|_F:  124200.015625, |X-X0|:  104.071014
rounded |X_k-Y|_0 = 113117, f1 =  0.316984, approx slack: 146
rounded before pow |X_k-Y|_0 = 113121, f1 =  0.316958

Iteration 100: Loss = 122707.773438
|Xk-Y|_F:  122602.664062, |X-X0|:  105.109940
rounded |X_k-Y|_0 = 113067, f1 =  0.317111, approx slack: 301
rounded before pow |X_k-Y|_0 = 112986, f1 =  0.317824

Iteration 120: Loss = 120885.804688
|Xk-Y|_F:  120778.859375, |X-X0|:  106.941841
rounded |X_k-Y|_0 = 103345, f1 =  0.324182, approx slack: 12579
rounded before pow |X_k-Y|_0 = 112986, f1 =  0.317824

Iteration 140: Loss = 118788.117188
|Xk-Y|_F:  118679.054688, |X-X0|:  109.065887
rounded |X_k-Y|_0 = 103341, f1 =  0.324191, approx slack: 24019
rounded before pow |X_k-Y|_0 = 112986, f1 =  0.317824

Iteration 160: Loss = 116347.203125
|Xk-Y|_F:  116238.070312, |X-X0|:  109.136215
rounded |X_k-Y|_0 = 103346, f1 =  0.324156, approx slack: 25230
rounded before pow |X_k-Y|_0 = 112986, f1 =  0.317824

Iteration 180: Loss = 113472.812500
|Xk-Y|_F:  113364.656250, |X-X0|:  108.153168
rounded |X_k-Y|_0 = 102466, f1 =  0.324725, approx slack: 27621
rounded before pow |X_k-Y|_0 = 112983, f1 =  0.317844

Iteration 200: Loss = 110055.046875
|Xk-Y|_F:  109946.765625, |X-X0|:  108.282593
rounded |X_k-Y|_0 = 97834, f1 =  0.328297, approx slack: 34329
rounded before pow |X_k-Y|_0 = 113395, f1 =  0.317813

Iteration 220: Loss = 105961.750000
|Xk-Y|_F:  105850.242188, |X-X0|:  111.511162
rounded |X_k-Y|_0 = 95663, f1 =  0.330047, approx slack: 41339
rounded before pow |X_k-Y|_0 = 113395, f1 =  0.317813

Iteration 240: Loss = 100997.500000
|Xk-Y|_F:  100884.921875, |X-X0|:  112.574844
rounded |X_k-Y|_0 = 92085, f1 =  0.332879, approx slack: 50116
rounded before pow |X_k-Y|_0 = 113749, f1 =  0.317697

Iteration 260: Loss = 94872.734375
|Xk-Y|_F:  94755.414062, |X-X0|:  117.322456
rounded |X_k-Y|_0 = 87131, f1 =  0.336994, approx slack: 60897
rounded before pow |X_k-Y|_0 = 113978, f1 =  0.317664

Iteration 280: Loss = 87285.890625
|Xk-Y|_F:  87161.375000, |X-X0|:  124.514679
rounded |X_k-Y|_0 = 80959, f1 =  0.342354, approx slack: 83279
rounded before pow |X_k-Y|_0 = 116549, f1 =  0.317067

Iteration 300: Loss = 78245.421875
|Xk-Y|_F:  78116.835938, |X-X0|:  128.588593
rounded |X_k-Y|_0 = 73638, f1 =  0.349482, approx slack: 100381
rounded before pow |X_k-Y|_0 = 116549, f1 =  0.317067

Iteration 320: Loss = 68370.531250
|Xk-Y|_F:  68237.148438, |X-X0|:  133.385925
rounded |X_k-Y|_0 = 64394, f1 =  0.359738, approx slack: 121123
rounded before pow |X_k-Y|_0 = 116778, f1 =  0.317030

Iteration 340: Loss = 58599.925781
|Xk-Y|_F:  58458.070312, |X-X0|:  141.854904
rounded |X_k-Y|_0 = 54695, f1 =  0.372135, approx slack: 145286
rounded before pow |X_k-Y|_0 = 117007, f1 =  0.316992

Iteration 360: Loss = 49748.562500
|Xk-Y|_F:  49593.304688, |X-X0|:  155.256882
rounded |X_k-Y|_0 = 46082, f1 =  0.385727, approx slack: 170387
rounded before pow |X_k-Y|_0 = 117252, f1 =  0.317287

Iteration 380: Loss = 42557.867188
|Xk-Y|_F:  42386.632812, |X-X0|:  171.233185
rounded |X_k-Y|_0 = 39080, f1 =  0.402176, approx slack: 221705
rounded before pow |X_k-Y|_0 = 128547, f1 =  0.310425

Iteration 400: Loss = 37422.078125
|Xk-Y|_F:  37230.554688, |X-X0|:  191.521790
rounded |X_k-Y|_0 = 33904, f1 =  0.420389, approx slack: 335260
rounded before pow |X_k-Y|_0 = 165630, f1 =  0.287767

Iteration 420: Loss = 34122.863281
|Xk-Y|_F:  33896.707031, |X-X0|:  226.156921
rounded |X_k-Y|_0 = 30886, f1 =  0.437689, approx slack: 364869
rounded before pow |X_k-Y|_0 = 169488, f1 =  0.285962

Iteration 440: Loss = 32046.804688
|Xk-Y|_F:  31785.619141, |X-X0|:  261.185242
rounded |X_k-Y|_0 = 29364, f1 =  0.452354, approx slack: 390349
rounded before pow |X_k-Y|_0 = 174583, f1 =  0.283397

Iteration 460: Loss = 30700.167969
|Xk-Y|_F:  30398.019531, |X-X0|:  302.149048
rounded |X_k-Y|_0 = 28596, f1 =  0.467467, approx slack: 407952
rounded before pow |X_k-Y|_0 = 178533, f1 =  0.281506

Iteration 480: Loss = 29724.812500
|Xk-Y|_F:  29335.484375, |X-X0|:  389.328125
rounded |X_k-Y|_0 = 27976, f1 =  0.486685, approx slack: 449409
rounded before pow |X_k-Y|_0 = 192205, f1 =  0.273972

Iteration 500: Loss = 28795.087891
|Xk-Y|_F:  28337.126953, |X-X0|:  457.961823
rounded |X_k-Y|_0 = 27017, f1 =  0.528639, approx slack: 471157
rounded before pow |X_k-Y|_0 = 199667, f1 =  0.269719

Iteration 520: Loss = 28253.597656
|Xk-Y|_F:  27794.988281, |X-X0|:  458.609253
rounded |X_k-Y|_0 = 26587, f1 =  0.545623, approx slack: 442700
rounded before pow |X_k-Y|_0 = 188048, f1 =  0.277531

Iteration 540: Loss = 27897.574219
|Xk-Y|_F:  27447.478516, |X-X0|:  450.096344
rounded |X_k-Y|_0 = 26384, f1 =  0.553628, approx slack: 438331
rounded before pow |X_k-Y|_0 = 185900, f1 =  0.278973

Iteration 560: Loss = 27636.361328
|Xk-Y|_F:  27190.839844, |X-X0|:  445.521912
rounded |X_k-Y|_0 = 26239, f1 =  0.558023, approx slack: 428303
rounded before pow |X_k-Y|_0 = 181581, f1 =  0.281872

Iteration 580: Loss = 27443.146484
|Xk-Y|_F:  26999.400391, |X-X0|:  443.746582
rounded |X_k-Y|_0 = 26183, f1 =  0.559903, approx slack: 425520
rounded before pow |X_k-Y|_0 = 180031, f1 =  0.282915

Iteration 600: Loss = 27305.296875
|Xk-Y|_F:  26861.142578, |X-X0|:  444.154633
rounded |X_k-Y|_0 = 26161, f1 =  0.560378, approx slack: 425763
rounded before pow |X_k-Y|_0 = 179842, f1 =  0.283045

Iteration 620: Loss = 27194.812500
|Xk-Y|_F:  26751.099609, |X-X0|:  443.712646
rounded |X_k-Y|_0 = 26145, f1 =  0.560813, approx slack: 423699
rounded before pow |X_k-Y|_0 = 178765, f1 =  0.283768

Iteration 640: Loss = 27110.212891
|Xk-Y|_F:  26668.042969, |X-X0|:  442.170074
rounded |X_k-Y|_0 = 26150, f1 =  0.560605, approx slack: 421557
rounded before pow |X_k-Y|_0 = 177683, f1 =  0.284495

Iteration 660: Loss = 27039.447266
|Xk-Y|_F:  26599.287109, |X-X0|:  440.161011
rounded |X_k-Y|_0 = 26150, f1 =  0.560599, approx slack: 419148
rounded before pow |X_k-Y|_0 = 176604, f1 =  0.285221

Iteration 680: Loss = 26980.330078
|Xk-Y|_F:  26541.121094, |X-X0|:  439.209229
rounded |X_k-Y|_0 = 26126, f1 =  0.561085, approx slack: 419170
rounded before pow |X_k-Y|_0 = 176587, f1 =  0.285230

Iteration 700: Loss = 26927.865234
|Xk-Y|_F:  26490.041016, |X-X0|:  437.823669
rounded |X_k-Y|_0 = 26125, f1 =  0.561108, approx slack: 419524
rounded before pow |X_k-Y|_0 = 176587, f1 =  0.285230

Iteration 720: Loss = 26883.023438
|Xk-Y|_F:  26444.474609, |X-X0|:  438.549072
rounded |X_k-Y|_0 = 26125, f1 =  0.561129, approx slack: 417070
rounded before pow |X_k-Y|_0 = 175514, f1 =  0.285952

Iteration 740: Loss = 26842.003906
|Xk-Y|_F:  26402.902344, |X-X0|:  439.100830
rounded |X_k-Y|_0 = 26128, f1 =  0.561012, approx slack: 414599
rounded before pow |X_k-Y|_0 = 174433, f1 =  0.286680

Iteration 760: Loss = 26802.714844
|Xk-Y|_F:  26364.853516, |X-X0|:  437.861267
rounded |X_k-Y|_0 = 26127, f1 =  0.561039, approx slack: 414310
rounded before pow |X_k-Y|_0 = 174433, f1 =  0.286680

Iteration 780: Loss = 26767.503906
|Xk-Y|_F:  26329.539062, |X-X0|:  437.964844
rounded |X_k-Y|_0 = 26123, f1 =  0.561168, approx slack: 414566
rounded before pow |X_k-Y|_0 = 174433, f1 =  0.286680

Iteration 800: Loss = 26733.611328
|Xk-Y|_F:  26296.154297, |X-X0|:  437.456543
rounded |X_k-Y|_0 = 26115, f1 =  0.561348, approx slack: 406082
rounded before pow |X_k-Y|_0 = 171026, f1 =  0.288976

Iteration 820: Loss = 26702.792969
|Xk-Y|_F:  26264.867188, |X-X0|:  437.925598
rounded |X_k-Y|_0 = 26112, f1 =  0.561401, approx slack: 406274
rounded before pow |X_k-Y|_0 = 171026, f1 =  0.288976

Iteration 840: Loss = 26674.390625
|Xk-Y|_F:  26233.509766, |X-X0|:  440.881439
rounded |X_k-Y|_0 = 26101, f1 =  0.561706, approx slack: 406467
rounded before pow |X_k-Y|_0 = 171026, f1 =  0.288976

Iteration 860: Loss = 26646.910156
|Xk-Y|_F:  26203.357422, |X-X0|:  443.552917
rounded |X_k-Y|_0 = 26100, f1 =  0.561768, approx slack: 406559
rounded before pow |X_k-Y|_0 = 171026, f1 =  0.288976

Iteration 880: Loss = 26619.671875
|Xk-Y|_F:  26175.197266, |X-X0|:  444.475037
rounded |X_k-Y|_0 = 26093, f1 =  0.561926, approx slack: 406853
rounded before pow |X_k-Y|_0 = 171143, f1 =  0.288896

Iteration 900: Loss = 26593.716797
|Xk-Y|_F:  26147.599609, |X-X0|:  446.118134
rounded |X_k-Y|_0 = 26083, f1 =  0.562298, approx slack: 406956
rounded before pow |X_k-Y|_0 = 171143, f1 =  0.288896

Iteration 920: Loss = 26568.443359
|Xk-Y|_F:  26120.085938, |X-X0|:  448.357605
rounded |X_k-Y|_0 = 26074, f1 =  0.562537, approx slack: 407028
rounded before pow |X_k-Y|_0 = 171143, f1 =  0.288896

Iteration 940: Loss = 26544.996094
|Xk-Y|_F:  26093.287109, |X-X0|:  451.709290
rounded |X_k-Y|_0 = 26069, f1 =  0.562690, approx slack: 407057
rounded before pow |X_k-Y|_0 = 171143, f1 =  0.288896

Iteration 960: Loss = 26521.341797
|Xk-Y|_F:  26065.476562, |X-X0|:  455.864319
rounded |X_k-Y|_0 = 26052, f1 =  0.563295, approx slack: 407088
rounded before pow |X_k-Y|_0 = 171143, f1 =  0.288896

Iteration 980: Loss = 26498.707031
|Xk-Y|_F:  26038.689453, |X-X0|:  460.017090
rounded |X_k-Y|_0 = 26037, f1 =  0.563724, approx slack: 407085
rounded before pow |X_k-Y|_0 = 171143, f1 =  0.288896

Iteration 1000: Loss = 26474.839844
|Xk-Y|_F:  26010.248047, |X-X0|:  464.592712
rounded |X_k-Y|_0 = 26025, f1 =  0.564215, approx slack: 407360
rounded before pow |X_k-Y|_0 = 171426, f1 =  0.288702

Iteration 1020: Loss = 26450.783203
|Xk-Y|_F:  25981.296875, |X-X0|:  469.486816
rounded |X_k-Y|_0 = 26017, f1 =  0.564575, approx slack: 418886
rounded before pow |X_k-Y|_0 = 171426, f1 =  0.288702

Iteration 1040: Loss = 26424.621094
|Xk-Y|_F:  25948.482422, |X-X0|:  476.138062
rounded |X_k-Y|_0 = 26000, f1 =  0.565152, approx slack: 418836
rounded before pow |X_k-Y|_0 = 171496, f1 =  0.288654

Iteration 1060: Loss = 26396.708984
|Xk-Y|_F:  25914.794922, |X-X0|:  481.914673
rounded |X_k-Y|_0 = 25986, f1 =  0.565563, approx slack: 441959
rounded before pow |X_k-Y|_0 = 171496, f1 =  0.288654

Iteration 1080: Loss = 26367.191406
|Xk-Y|_F:  25879.980469, |X-X0|:  487.211121
rounded |X_k-Y|_0 = 25956, f1 =  0.566490, approx slack: 441955
rounded before pow |X_k-Y|_0 = 171633, f1 =  0.288560

Iteration 1100: Loss = 26336.216797
|Xk-Y|_F:  25846.160156, |X-X0|:  490.057587
rounded |X_k-Y|_0 = 25942, f1 =  0.567037, approx slack: 440954
rounded before pow |X_k-Y|_0 = 171721, f1 =  0.288499

Iteration 1120: Loss = 26305.943359
|Xk-Y|_F:  25813.146484, |X-X0|:  492.796265
rounded |X_k-Y|_0 = 25918, f1 =  0.567924, approx slack: 438089
rounded before pow |X_k-Y|_0 = 170718, f1 =  0.289176

Iteration 1140: Loss = 26275.666016
|Xk-Y|_F:  25780.982422, |X-X0|:  494.684113
rounded |X_k-Y|_0 = 25902, f1 =  0.568541, approx slack: 449752
rounded before pow |X_k-Y|_0 = 172207, f1 =  0.288155

Iteration 1160: Loss = 26244.080078
|Xk-Y|_F:  25748.769531, |X-X0|:  495.309631
rounded |X_k-Y|_0 = 25877, f1 =  0.569463, approx slack: 449333
rounded before pow |X_k-Y|_0 = 172206, f1 =  0.288156

Iteration 1180: Loss = 26210.859375
|Xk-Y|_F:  25714.722656, |X-X0|:  496.136719
rounded |X_k-Y|_0 = 25845, f1 =  0.570734, approx slack: 448715
rounded before pow |X_k-Y|_0 = 172078, f1 =  0.288242

Iteration 1200: Loss = 26177.904297
|Xk-Y|_F:  25681.294922, |X-X0|:  496.609802
rounded |X_k-Y|_0 = 25817, f1 =  0.571897, approx slack: 461964
rounded before pow |X_k-Y|_0 = 173910, f1 =  0.287007

Iteration 1220: Loss = 26144.720703
|Xk-Y|_F:  25647.189453, |X-X0|:  497.531769
rounded |X_k-Y|_0 = 25773, f1 =  0.573591, approx slack: 461975
rounded before pow |X_k-Y|_0 = 174124, f1 =  0.286861

Iteration 1240: Loss = 26109.933594
|Xk-Y|_F:  25612.150391, |X-X0|:  497.782532
rounded |X_k-Y|_0 = 25747, f1 =  0.574634, approx slack: 465780
rounded before pow |X_k-Y|_0 = 175390, f1 =  0.286039

Iteration 1260: Loss = 26075.148438
|Xk-Y|_F:  25576.650391, |X-X0|:  498.498291
rounded |X_k-Y|_0 = 25702, f1 =  0.576309, approx slack: 465551
rounded before pow |X_k-Y|_0 = 175390, f1 =  0.286039

Iteration 1280: Loss = 26040.093750
|Xk-Y|_F:  25541.191406, |X-X0|:  498.902588
rounded |X_k-Y|_0 = 25653, f1 =  0.578184, approx slack: 465388
rounded before pow |X_k-Y|_0 = 175495, f1 =  0.285967

Iteration 1300: Loss = 26006.197266
|Xk-Y|_F:  25507.160156, |X-X0|:  499.036926
rounded |X_k-Y|_0 = 25601, f1 =  0.580249, approx slack: 465155
rounded before pow |X_k-Y|_0 = 175495, f1 =  0.285967

Iteration 1320: Loss = 25972.962891
|Xk-Y|_F:  25472.673828, |X-X0|:  500.288605
rounded |X_k-Y|_0 = 25547, f1 =  0.582321, approx slack: 464916
rounded before pow |X_k-Y|_0 = 175495, f1 =  0.285967

Iteration 1340: Loss = 25939.433594
|Xk-Y|_F:  25439.287109, |X-X0|:  500.147278
rounded |X_k-Y|_0 = 25503, f1 =  0.584031, approx slack: 464804
rounded before pow |X_k-Y|_0 = 175495, f1 =  0.285967

Iteration 1360: Loss = 25908.093750
|Xk-Y|_F:  25406.630859, |X-X0|:  501.463531
rounded |X_k-Y|_0 = 25456, f1 =  0.585805, approx slack: 460574
rounded before pow |X_k-Y|_0 = 174229, f1 =  0.286789

Iteration 1380: Loss = 25877.900391
|Xk-Y|_F:  25376.306641, |X-X0|:  501.594482
rounded |X_k-Y|_0 = 25418, f1 =  0.587186, approx slack: 460502
rounded before pow |X_k-Y|_0 = 174229, f1 =  0.286789

Iteration 1400: Loss = 25850.541016
|Xk-Y|_F:  25346.304688, |X-X0|:  504.237152
rounded |X_k-Y|_0 = 25386, f1 =  0.588354, approx slack: 460398
rounded before pow |X_k-Y|_0 = 174229, f1 =  0.286789

Iteration 1420: Loss = 25823.919922
|Xk-Y|_F:  25318.357422, |X-X0|:  505.562500
rounded |X_k-Y|_0 = 25350, f1 =  0.589672, approx slack: 460480
rounded before pow |X_k-Y|_0 = 174241, f1 =  0.286781

Iteration 1440: Loss = 25795.980469
|Xk-Y|_F:  25288.662109, |X-X0|:  507.318176
rounded |X_k-Y|_0 = 25330, f1 =  0.590397, approx slack: 460584
rounded before pow |X_k-Y|_0 = 174376, f1 =  0.286689

Iteration 1460: Loss = 25768.125000
|Xk-Y|_F:  25261.332031, |X-X0|:  506.792877
rounded |X_k-Y|_0 = 25320, f1 =  0.590741, approx slack: 459622
rounded before pow |X_k-Y|_0 = 174122, f1 =  0.286860

Iteration 1480: Loss = 25744.466797
|Xk-Y|_F:  25236.107422, |X-X0|:  508.358551
rounded |X_k-Y|_0 = 25296, f1 =  0.591662, approx slack: 459484
rounded before pow |X_k-Y|_0 = 174122, f1 =  0.286860

Iteration 1500: Loss = 25720.533203
|Xk-Y|_F:  25211.320312, |X-X0|:  509.213409
rounded |X_k-Y|_0 = 25273, f1 =  0.592474, approx slack: 466712
rounded before pow |X_k-Y|_0 = 176121, f1 =  0.285520

Iteration 1520: Loss = 25697.701172
|Xk-Y|_F:  25186.648438, |X-X0|:  511.051971
rounded |X_k-Y|_0 = 25256, f1 =  0.593083, approx slack: 464069
rounded before pow |X_k-Y|_0 = 175148, f1 =  0.286153

Iteration 1540: Loss = 25675.894531
|Xk-Y|_F:  25162.171875, |X-X0|:  513.723145
rounded |X_k-Y|_0 = 25227, f1 =  0.594155, approx slack: 464042
rounded before pow |X_k-Y|_0 = 175148, f1 =  0.286153

Iteration 1560: Loss = 25653.142578
|Xk-Y|_F:  25137.841797, |X-X0|:  515.301697
rounded |X_k-Y|_0 = 25198, f1 =  0.595199, approx slack: 463786
rounded before pow |X_k-Y|_0 = 175027, f1 =  0.286236

Iteration 1580: Loss = 25629.871094
|Xk-Y|_F:  25112.992188, |X-X0|:  516.878113
rounded |X_k-Y|_0 = 25166, f1 =  0.596318, approx slack: 464742
rounded before pow |X_k-Y|_0 = 175416, f1 =  0.285971

Iteration 1600: Loss = 25607.277344
|Xk-Y|_F:  25088.140625, |X-X0|:  519.136597
rounded |X_k-Y|_0 = 25143, f1 =  0.597108, approx slack: 464651
rounded before pow |X_k-Y|_0 = 175416, f1 =  0.285971

Iteration 1620: Loss = 25585.958984
|Xk-Y|_F:  25062.833984, |X-X0|:  523.125244
rounded |X_k-Y|_0 = 25108, f1 =  0.598328, approx slack: 455964
rounded before pow |X_k-Y|_0 = 172315, f1 =  0.287897

Iteration 1640: Loss = 25564.466797
|Xk-Y|_F:  25040.671875, |X-X0|:  523.794128
rounded |X_k-Y|_0 = 25082, f1 =  0.599275, approx slack: 455868
rounded before pow |X_k-Y|_0 = 172362, f1 =  0.287865

Iteration 1660: Loss = 25545.228516
|Xk-Y|_F:  25020.460938, |X-X0|:  524.767578
rounded |X_k-Y|_0 = 25047, f1 =  0.600509, approx slack: 464474
rounded before pow |X_k-Y|_0 = 174665, f1 =  0.286312

Iteration 1680: Loss = 25525.640625
|Xk-Y|_F:  25000.740234, |X-X0|:  524.900757
rounded |X_k-Y|_0 = 24995, f1 =  0.602285, approx slack: 463800
rounded before pow |X_k-Y|_0 = 174427, f1 =  0.286473

Iteration 1700: Loss = 25508.269531
|Xk-Y|_F:  24982.673828, |X-X0|:  525.596375
rounded |X_k-Y|_0 = 24964, f1 =  0.603402, approx slack: 434467
rounded before pow |X_k-Y|_0 = 162765, f1 =  0.294421

Iteration 1720: Loss = 25492.035156
|Xk-Y|_F:  24965.808594, |X-X0|:  526.226196
rounded |X_k-Y|_0 = 24922, f1 =  0.604784, approx slack: 434435
rounded before pow |X_k-Y|_0 = 162765, f1 =  0.294421

Iteration 1740: Loss = 25475.691406
|Xk-Y|_F:  24949.666016, |X-X0|:  526.025269
rounded |X_k-Y|_0 = 24911, f1 =  0.605187, approx slack: 434460
rounded before pow |X_k-Y|_0 = 162765, f1 =  0.294421

Iteration 1760: Loss = 25460.816406
|Xk-Y|_F:  24933.718750, |X-X0|:  527.097168
rounded |X_k-Y|_0 = 24906, f1 =  0.605396, approx slack: 434429
rounded before pow |X_k-Y|_0 = 162765, f1 =  0.294421

Iteration 1780: Loss = 25445.705078
|Xk-Y|_F:  24918.806641, |X-X0|:  526.899292
rounded |X_k-Y|_0 = 24899, f1 =  0.605643, approx slack: 434079
rounded before pow |X_k-Y|_0 = 162568, f1 =  0.294555

Iteration 1800: Loss = 25429.810547
|Xk-Y|_F:  24903.513672, |X-X0|:  526.297729
rounded |X_k-Y|_0 = 24883, f1 =  0.606196, approx slack: 434039
rounded before pow |X_k-Y|_0 = 162568, f1 =  0.294555

Iteration 1820: Loss = 25416.113281
|Xk-Y|_F:  24888.716797, |X-X0|:  527.395508
rounded |X_k-Y|_0 = 24858, f1 =  0.607006, approx slack: 433938
rounded before pow |X_k-Y|_0 = 162568, f1 =  0.294555

Iteration 1840: Loss = 25402.005859
|Xk-Y|_F:  24874.886719, |X-X0|:  527.118835
rounded |X_k-Y|_0 = 24852, f1 =  0.607251, approx slack: 437742
rounded before pow |X_k-Y|_0 = 162813, f1 =  0.294387

Iteration 1860: Loss = 25388.726562
|Xk-Y|_F:  24860.150391, |X-X0|:  528.576538
rounded |X_k-Y|_0 = 24841, f1 =  0.607650, approx slack: 437889
rounded before pow |X_k-Y|_0 = 162913, f1 =  0.294319

Iteration 1880: Loss = 25375.113281
|Xk-Y|_F:  24846.232422, |X-X0|:  528.880737
rounded |X_k-Y|_0 = 24828, f1 =  0.608096, approx slack: 458876
rounded before pow |X_k-Y|_0 = 169885, f1 =  0.289529

Iteration 1900: Loss = 25362.617188
|Xk-Y|_F:  24832.466797, |X-X0|:  530.150635
rounded |X_k-Y|_0 = 24805, f1 =  0.608837, approx slack: 459544
rounded before pow |X_k-Y|_0 = 170163, f1 =  0.289341

Iteration 1920: Loss = 25349.863281
|Xk-Y|_F:  24818.898438, |X-X0|:  530.964233
rounded |X_k-Y|_0 = 24814, f1 =  0.608547, approx slack: 459586
rounded before pow |X_k-Y|_0 = 170163, f1 =  0.289341

Iteration 1940: Loss = 25337.373047
|Xk-Y|_F:  24806.322266, |X-X0|:  531.049927
rounded |X_k-Y|_0 = 24800, f1 =  0.609038, approx slack: 459582
rounded before pow |X_k-Y|_0 = 170163, f1 =  0.289341

Iteration 1960: Loss = 25325.476562
|Xk-Y|_F:  24793.716797, |X-X0|:  531.760376
rounded |X_k-Y|_0 = 24791, f1 =  0.609367, approx slack: 458087
rounded before pow |X_k-Y|_0 = 168456, f1 =  0.290495

Iteration 1980: Loss = 25314.066406
|Xk-Y|_F:  24780.123047, |X-X0|:  533.942688
rounded |X_k-Y|_0 = 24779, f1 =  0.609744, approx slack: 458153
rounded before pow |X_k-Y|_0 = 168569, f1 =  0.290417

Iteration 2000: Loss = 25301.820312
|Xk-Y|_F:  24767.187500, |X-X0|:  534.632324
rounded |X_k-Y|_0 = 24773, f1 =  0.609967, approx slack: 457979
rounded before pow |X_k-Y|_0 = 168465, f1 =  0.290488

Iteration 2020: Loss = 25290.871094
|Xk-Y|_F:  24754.621094, |X-X0|:  536.250488
rounded |X_k-Y|_0 = 24767, f1 =  0.610182, approx slack: 458216
rounded before pow |X_k-Y|_0 = 168634, f1 =  0.290373

Iteration 2040: Loss = 25279.810547
|Xk-Y|_F:  24743.867188, |X-X0|:  535.942627
rounded |X_k-Y|_0 = 24751, f1 =  0.610645, approx slack: 458188
rounded before pow |X_k-Y|_0 = 168634, f1 =  0.290373

Iteration 2060: Loss = 25268.802734
|Xk-Y|_F:  24732.535156, |X-X0|:  536.266785
rounded |X_k-Y|_0 = 24740, f1 =  0.611010, approx slack: 458176
rounded before pow |X_k-Y|_0 = 168634, f1 =  0.290373

Iteration 2080: Loss = 25258.341797
|Xk-Y|_F:  24720.849609, |X-X0|:  537.492859
rounded |X_k-Y|_0 = 24734, f1 =  0.611239, approx slack: 458241
rounded before pow |X_k-Y|_0 = 168706, f1 =  0.290324

Iteration 2100: Loss = 25247.361328
|Xk-Y|_F:  24709.138672, |X-X0|:  538.222656
rounded |X_k-Y|_0 = 24712, f1 =  0.611896, approx slack: 457864
rounded before pow |X_k-Y|_0 = 168429, f1 =  0.290512

Iteration 2120: Loss = 25236.769531
|Xk-Y|_F:  24695.867188, |X-X0|:  540.902283
rounded |X_k-Y|_0 = 24692, f1 =  0.612479, approx slack: 458528
rounded before pow |X_k-Y|_0 = 168968, f1 =  0.290145

Iteration 2140: Loss = 25225.781250
|Xk-Y|_F:  24685.398438, |X-X0|:  540.381897
rounded |X_k-Y|_0 = 24695, f1 =  0.612430, approx slack: 458528
rounded before pow |X_k-Y|_0 = 168968, f1 =  0.290145

Iteration 2160: Loss = 25214.888672
|Xk-Y|_F:  24674.486328, |X-X0|:  540.402344
rounded |X_k-Y|_0 = 24679, f1 =  0.612932, approx slack: 460464
rounded before pow |X_k-Y|_0 = 169884, f1 =  0.289524

Iteration 2180: Loss = 25204.925781
|Xk-Y|_F:  24664.804688, |X-X0|:  540.121643
rounded |X_k-Y|_0 = 24659, f1 =  0.613573, approx slack: 459718
rounded before pow |X_k-Y|_0 = 169842, f1 =  0.289552

Iteration 2200: Loss = 25193.984375
|Xk-Y|_F:  24655.234375, |X-X0|:  538.749390
rounded |X_k-Y|_0 = 24640, f1 =  0.614151, approx slack: 462019
rounded before pow |X_k-Y|_0 = 169546, f1 =  0.289753

Iteration 2220: Loss = 25183.974609
|Xk-Y|_F:  24645.535156, |X-X0|:  538.439087
rounded |X_k-Y|_0 = 24631, f1 =  0.614481, approx slack: 461737
rounded before pow |X_k-Y|_0 = 169468, f1 =  0.289806

Iteration 2240: Loss = 25174.701172
|Xk-Y|_F:  24636.773438, |X-X0|:  537.927246
rounded |X_k-Y|_0 = 24622, f1 =  0.614761, approx slack: 461433
rounded before pow |X_k-Y|_0 = 169184, f1 =  0.290000

Iteration 2260: Loss = 25167.019531
|Xk-Y|_F:  24627.433594, |X-X0|:  539.586914
rounded |X_k-Y|_0 = 24607, f1 =  0.615202, approx slack: 460907
rounded before pow |X_k-Y|_0 = 168912, f1 =  0.290184

Iteration 2280: Loss = 25158.240234
|Xk-Y|_F:  24619.431641, |X-X0|:  538.809021
rounded |X_k-Y|_0 = 24592, f1 =  0.615653, approx slack: 460750
rounded before pow |X_k-Y|_0 = 168749, f1 =  0.290296

Iteration 2300: Loss = 25150.574219
|Xk-Y|_F:  24611.599609, |X-X0|:  538.974487
rounded |X_k-Y|_0 = 24574, f1 =  0.616261, approx slack: 458305
rounded before pow |X_k-Y|_0 = 167736, f1 =  0.290983

Iteration 2320: Loss = 25142.228516
|Xk-Y|_F:  24603.332031, |X-X0|:  538.897034
rounded |X_k-Y|_0 = 24558, f1 =  0.616734, approx slack: 458280
rounded before pow |X_k-Y|_0 = 167736, f1 =  0.290983

Iteration 2340: Loss = 25133.460938
|Xk-Y|_F:  24594.994141, |X-X0|:  538.467529
rounded |X_k-Y|_0 = 24533, f1 =  0.617448, approx slack: 436819
rounded before pow |X_k-Y|_0 = 160743, f1 =  0.295798

Iteration 2360: Loss = 25124.839844
|Xk-Y|_F:  24585.619141, |X-X0|:  539.221313
rounded |X_k-Y|_0 = 24524, f1 =  0.617723, approx slack: 436586
rounded before pow |X_k-Y|_0 = 160568, f1 =  0.295918

Iteration 2380: Loss = 25113.732422
|Xk-Y|_F:  24575.916016, |X-X0|:  537.816223
rounded |X_k-Y|_0 = 24512, f1 =  0.618156, approx slack: 436503
rounded before pow |X_k-Y|_0 = 160568, f1 =  0.295918

Iteration 2400: Loss = 25104.667969
|Xk-Y|_F:  24567.578125, |X-X0|:  537.088867
rounded |X_k-Y|_0 = 24492, f1 =  0.618752, approx slack: 436379
rounded before pow |X_k-Y|_0 = 160473, f1 =  0.295983

Iteration 2420: Loss = 25096.759766
|Xk-Y|_F:  24560.460938, |X-X0|:  536.299561
rounded |X_k-Y|_0 = 24480, f1 =  0.619136, approx slack: 436750
rounded before pow |X_k-Y|_0 = 160478, f1 =  0.295980

Iteration 2440: Loss = 25088.373047
|Xk-Y|_F:  24552.857422, |X-X0|:  535.515503
rounded |X_k-Y|_0 = 24458, f1 =  0.619802, approx slack: 436601
rounded before pow |X_k-Y|_0 = 160373, f1 =  0.296052

Iteration 2460: Loss = 25081.466797
|Xk-Y|_F:  24545.617188, |X-X0|:  535.848877
rounded |X_k-Y|_0 = 24460, f1 =  0.619754, approx slack: 436564
rounded before pow |X_k-Y|_0 = 160373, f1 =  0.296052

Iteration 2480: Loss = 25074.355469
|Xk-Y|_F:  24538.078125, |X-X0|:  536.277344
rounded |X_k-Y|_0 = 24450, f1 =  0.620074, approx slack: 436529
rounded before pow |X_k-Y|_0 = 160373, f1 =  0.296052

Iteration 2500: Loss = 25066.408203
|Xk-Y|_F:  24530.687500, |X-X0|:  535.721375
rounded |X_k-Y|_0 = 24439, f1 =  0.620418, approx slack: 436500
rounded before pow |X_k-Y|_0 = 160373, f1 =  0.296052

Iteration 2520: Loss = 25057.714844
|Xk-Y|_F:  24523.681641, |X-X0|:  534.034180
rounded |X_k-Y|_0 = 24433, f1 =  0.620586, approx slack: 436460
rounded before pow |X_k-Y|_0 = 160373, f1 =  0.296052

Iteration 2540: Loss = 25050.847656
|Xk-Y|_F:  24516.996094, |X-X0|:  533.851440
rounded |X_k-Y|_0 = 24433, f1 =  0.620604, approx slack: 436410
rounded before pow |X_k-Y|_0 = 160373, f1 =  0.296052

Iteration 2560: Loss = 25044.462891
|Xk-Y|_F:  24510.378906, |X-X0|:  534.084106
rounded |X_k-Y|_0 = 24419, f1 =  0.621025, approx slack: 436292
rounded before pow |X_k-Y|_0 = 160373, f1 =  0.296052

Iteration 2580: Loss = 25037.097656
|Xk-Y|_F:  24503.537109, |X-X0|:  533.560913
rounded |X_k-Y|_0 = 24423, f1 =  0.620911, approx slack: 436268
rounded before pow |X_k-Y|_0 = 160367, f1 =  0.296056

Iteration 2600: Loss = 25030.292969
|Xk-Y|_F:  24497.041016, |X-X0|:  533.252197
rounded |X_k-Y|_0 = 24417, f1 =  0.621091, approx slack: 436258
rounded before pow |X_k-Y|_0 = 160357, f1 =  0.296063

Iteration 2620: Loss = 25023.662109
|Xk-Y|_F:  24490.224609, |X-X0|:  533.437012
rounded |X_k-Y|_0 = 24406, f1 =  0.621420, approx slack: 436094
rounded before pow |X_k-Y|_0 = 160257, f1 =  0.296131

Iteration 2640: Loss = 25017.722656
|Xk-Y|_F:  24484.083984, |X-X0|:  533.639160
rounded |X_k-Y|_0 = 24410, f1 =  0.621289, approx slack: 436025
rounded before pow |X_k-Y|_0 = 160257, f1 =  0.296131

Iteration 2660: Loss = 25010.173828
|Xk-Y|_F:  24478.644531, |X-X0|:  531.529541
rounded |X_k-Y|_0 = 24400, f1 =  0.621600, approx slack: 436007
rounded before pow |X_k-Y|_0 = 160257, f1 =  0.296131

Iteration 2680: Loss = 25005.259766
|Xk-Y|_F:  24473.498047, |X-X0|:  531.761719
rounded |X_k-Y|_0 = 24392, f1 =  0.621828, approx slack: 435952
rounded before pow |X_k-Y|_0 = 160209, f1 =  0.296165

Iteration 2700: Loss = 24998.984375
|Xk-Y|_F:  24468.324219, |X-X0|:  530.660522
rounded |X_k-Y|_0 = 24390, f1 =  0.621882, approx slack: 436689
rounded before pow |X_k-Y|_0 = 160502, f1 =  0.295963

Iteration 2720: Loss = 24993.470703
|Xk-Y|_F:  24462.074219, |X-X0|:  531.396729
rounded |X_k-Y|_0 = 24385, f1 =  0.622043, approx slack: 436702
rounded before pow |X_k-Y|_0 = 160503, f1 =  0.295962

Iteration 2740: Loss = 24985.488281
|Xk-Y|_F:  24454.558594, |X-X0|:  530.929016
rounded |X_k-Y|_0 = 24381, f1 =  0.622139, approx slack: 436414
rounded before pow |X_k-Y|_0 = 160249, f1 =  0.296136

Iteration 2760: Loss = 24977.316406
|Xk-Y|_F:  24448.574219, |X-X0|:  528.742920
rounded |X_k-Y|_0 = 24366, f1 =  0.622591, approx slack: 435874
rounded before pow |X_k-Y|_0 = 160079, f1 =  0.296251

Iteration 2780: Loss = 24972.076172
|Xk-Y|_F:  24442.929688, |X-X0|:  529.146362
rounded |X_k-Y|_0 = 24361, f1 =  0.622751, approx slack: 436081
rounded before pow |X_k-Y|_0 = 160135, f1 =  0.296212

Iteration 2800: Loss = 24965.373047
|Xk-Y|_F:  24437.599609, |X-X0|:  527.773193
rounded |X_k-Y|_0 = 24355, f1 =  0.622907, approx slack: 443674
rounded before pow |X_k-Y|_0 = 161336, f1 =  0.295388

Iteration 2820: Loss = 24958.925781
|Xk-Y|_F:  24431.441406, |X-X0|:  527.483643
rounded |X_k-Y|_0 = 24338, f1 =  0.623417, approx slack: 443158
rounded before pow |X_k-Y|_0 = 161170, f1 =  0.295502

Iteration 2840: Loss = 24951.578125
|Xk-Y|_F:  24426.460938, |X-X0|:  525.117432
rounded |X_k-Y|_0 = 24340, f1 =  0.623352, approx slack: 442353
rounded before pow |X_k-Y|_0 = 160888, f1 =  0.295696

Iteration 2860: Loss = 24945.257812
|Xk-Y|_F:  24421.029297, |X-X0|:  524.228394
rounded |X_k-Y|_0 = 24320, f1 =  0.623962, approx slack: 433630
rounded before pow |X_k-Y|_0 = 158630, f1 =  0.297241

Iteration 2880: Loss = 24940.238281
|Xk-Y|_F:  24416.923828, |X-X0|:  523.314087
rounded |X_k-Y|_0 = 24318, f1 =  0.623974, approx slack: 433603
rounded before pow |X_k-Y|_0 = 158630, f1 =  0.297241

Iteration 2900: Loss = 24934.070312
|Xk-Y|_F:  24411.974609, |X-X0|:  522.095764
rounded |X_k-Y|_0 = 24302, f1 =  0.624388, approx slack: 432654
rounded before pow |X_k-Y|_0 = 158399, f1 =  0.297400

Iteration 2920: Loss = 24928.714844
|Xk-Y|_F:  24407.554688, |X-X0|:  521.161011
rounded |X_k-Y|_0 = 24306, f1 =  0.624292, approx slack: 432650
rounded before pow |X_k-Y|_0 = 158399, f1 =  0.297400

Iteration 2940: Loss = 24923.867188
|Xk-Y|_F:  24402.992188, |X-X0|:  520.875244
rounded |X_k-Y|_0 = 24304, f1 =  0.624345, approx slack: 432523
rounded before pow |X_k-Y|_0 = 158303, f1 =  0.297466

Iteration 2960: Loss = 24919.691406
|Xk-Y|_F:  24398.548828, |X-X0|:  521.142883
rounded |X_k-Y|_0 = 24302, f1 =  0.624391, approx slack: 432710
rounded before pow |X_k-Y|_0 = 158469, f1 =  0.297351

Iteration 2980: Loss = 24914.472656
|Xk-Y|_F:  24394.125000, |X-X0|:  520.347290
rounded |X_k-Y|_0 = 24301, f1 =  0.624405, approx slack: 432759
rounded before pow |X_k-Y|_0 = 158519, f1 =  0.297317

Iteration 3000: Loss = 24911.167969
|Xk-Y|_F:  24389.412109, |X-X0|:  521.755249
rounded |X_k-Y|_0 = 24296, f1 =  0.624553, approx slack: 427745
rounded before pow |X_k-Y|_0 = 155951, f1 =  0.299101

Iteration 3020: Loss = 24906.167969
|Xk-Y|_F:  24384.541016, |X-X0|:  521.627869
rounded |X_k-Y|_0 = 24293, f1 =  0.624641, approx slack: 427755
rounded before pow |X_k-Y|_0 = 155951, f1 =  0.299101

Iteration 3040: Loss = 24902.765625
|Xk-Y|_F:  24380.099609, |X-X0|:  522.666870
rounded |X_k-Y|_0 = 24293, f1 =  0.624636, approx slack: 431768
rounded before pow |X_k-Y|_0 = 156420, f1 =  0.298777

Iteration 3060: Loss = 24897.808594
|Xk-Y|_F:  24373.482422, |X-X0|:  524.326904
rounded |X_k-Y|_0 = 24286, f1 =  0.624842, approx slack: 435957
rounded before pow |X_k-Y|_0 = 156852, f1 =  0.298478

Iteration 3080: Loss = 24892.269531
|Xk-Y|_F:  24367.669922, |X-X0|:  524.600281
rounded |X_k-Y|_0 = 24291, f1 =  0.624700, approx slack: 435993
rounded before pow |X_k-Y|_0 = 156852, f1 =  0.298478

Iteration 3100: Loss = 24885.447266
|Xk-Y|_F:  24361.671875, |X-X0|:  523.775085
rounded |X_k-Y|_0 = 24288, f1 =  0.624778, approx slack: 436174
rounded before pow |X_k-Y|_0 = 157007, f1 =  0.298371

Iteration 3120: Loss = 24880.269531
|Xk-Y|_F:  24355.199219, |X-X0|:  525.069824
rounded |X_k-Y|_0 = 24272, f1 =  0.625252, approx slack: 436160
rounded before pow |X_k-Y|_0 = 157007, f1 =  0.298371

Iteration 3140: Loss = 24874.923828
|Xk-Y|_F:  24349.789062, |X-X0|:  525.134705
rounded |X_k-Y|_0 = 24266, f1 =  0.625438, approx slack: 436174
rounded before pow |X_k-Y|_0 = 157007, f1 =  0.298371

Iteration 3160: Loss = 24867.917969
|Xk-Y|_F:  24345.669922, |X-X0|:  522.248535
rounded |X_k-Y|_0 = 24263, f1 =  0.625589, approx slack: 436177
rounded before pow |X_k-Y|_0 = 157007, f1 =  0.298371

Iteration 3180: Loss = 24862.994141
|Xk-Y|_F:  24340.904297, |X-X0|:  522.089417
rounded |X_k-Y|_0 = 24254, f1 =  0.625819, approx slack: 436153
rounded before pow |X_k-Y|_0 = 157007, f1 =  0.298371

Iteration 3200: Loss = 24858.417969
|Xk-Y|_F:  24337.076172, |X-X0|:  521.342651
rounded |X_k-Y|_0 = 24255, f1 =  0.625813, approx slack: 436121
rounded before pow |X_k-Y|_0 = 157007, f1 =  0.298371

Iteration 3220: Loss = 24853.931641
|Xk-Y|_F:  24330.916016, |X-X0|:  523.015442
rounded |X_k-Y|_0 = 24243, f1 =  0.626135, approx slack: 435349
rounded before pow |X_k-Y|_0 = 156728, f1 =  0.298562

Iteration 3240: Loss = 24845.355469
|Xk-Y|_F:  24326.408203, |X-X0|:  518.946899
rounded |X_k-Y|_0 = 24240, f1 =  0.626212, approx slack: 434234
rounded before pow |X_k-Y|_0 = 156356, f1 =  0.298819

Iteration 3260: Loss = 24840.001953
|Xk-Y|_F:  24322.419922, |X-X0|:  517.582397
rounded |X_k-Y|_0 = 24231, f1 =  0.626476, approx slack: 428001
rounded before pow |X_k-Y|_0 = 156260, f1 =  0.298885

Iteration 3280: Loss = 24833.998047
|Xk-Y|_F:  24317.703125, |X-X0|:  516.294312
rounded |X_k-Y|_0 = 24231, f1 =  0.626481, approx slack: 428231
rounded before pow |X_k-Y|_0 = 156452, f1 =  0.298752

Iteration 3300: Loss = 24829.572266
|Xk-Y|_F:  24313.505859, |X-X0|:  516.066101
rounded |X_k-Y|_0 = 24227, f1 =  0.626593, approx slack: 427911
rounded before pow |X_k-Y|_0 = 156241, f1 =  0.298899

Iteration 3320: Loss = 24824.435547
|Xk-Y|_F:  24309.751953, |X-X0|:  514.683777
rounded |X_k-Y|_0 = 24218, f1 =  0.626841, approx slack: 427874
rounded before pow |X_k-Y|_0 = 156241, f1 =  0.298899

Iteration 3340: Loss = 24820.697266
|Xk-Y|_F:  24305.027344, |X-X0|:  515.670471
rounded |X_k-Y|_0 = 24215, f1 =  0.626933, approx slack: 427857
rounded before pow |X_k-Y|_0 = 156241, f1 =  0.298899

Iteration 3360: Loss = 24816.652344
|Xk-Y|_F:  24301.064453, |X-X0|:  515.588623
rounded |X_k-Y|_0 = 24217, f1 =  0.626875, approx slack: 427870
rounded before pow |X_k-Y|_0 = 156241, f1 =  0.298899

Iteration 3380: Loss = 24812.128906
|Xk-Y|_F:  24297.082031, |X-X0|:  515.046387
rounded |X_k-Y|_0 = 24219, f1 =  0.626840, approx slack: 427828
rounded before pow |X_k-Y|_0 = 156241, f1 =  0.298899

Iteration 3400: Loss = 24806.822266
|Xk-Y|_F:  24292.857422, |X-X0|:  513.964478
rounded |X_k-Y|_0 = 24217, f1 =  0.626889, approx slack: 427786
rounded before pow |X_k-Y|_0 = 156241, f1 =  0.298899

Iteration 3420: Loss = 24804.041016
|Xk-Y|_F:  24289.025391, |X-X0|:  515.016357
rounded |X_k-Y|_0 = 24222, f1 =  0.626753, approx slack: 427791
rounded before pow |X_k-Y|_0 = 156279, f1 =  0.298872

Iteration 3440: Loss = 24800.138672
|Xk-Y|_F:  24285.947266, |X-X0|:  514.191345
rounded |X_k-Y|_0 = 24227, f1 =  0.626636, approx slack: 419820
rounded before pow |X_k-Y|_0 = 154983, f1 =  0.299769

Iteration 3460: Loss = 24794.697266
|Xk-Y|_F:  24280.568359, |X-X0|:  514.129761
rounded |X_k-Y|_0 = 24223, f1 =  0.626738, approx slack: 419784
rounded before pow |X_k-Y|_0 = 154983, f1 =  0.299769

Iteration 3480: Loss = 24790.931641
|Xk-Y|_F:  24276.564453, |X-X0|:  514.366760
rounded |X_k-Y|_0 = 24225, f1 =  0.626789, approx slack: 416265
rounded before pow |X_k-Y|_0 = 154858, f1 =  0.299855

Iteration 3500: Loss = 24786.496094
|Xk-Y|_F:  24272.214844, |X-X0|:  514.281738
rounded |X_k-Y|_0 = 24222, f1 =  0.626905, approx slack: 421816
rounded before pow |X_k-Y|_0 = 156200, f1 =  0.298921

Iteration 3520: Loss = 24782.271484
|Xk-Y|_F:  24267.845703, |X-X0|:  514.426392
rounded |X_k-Y|_0 = 24215, f1 =  0.627081, approx slack: 421791
rounded before pow |X_k-Y|_0 = 156200, f1 =  0.298921

Iteration 3540: Loss = 24779.806641
|Xk-Y|_F:  24263.595703, |X-X0|:  516.211487
rounded |X_k-Y|_0 = 24214, f1 =  0.627110, approx slack: 421670
rounded before pow |X_k-Y|_0 = 156082, f1 =  0.299002

Iteration 3560: Loss = 24774.873047
|Xk-Y|_F:  24260.376953, |X-X0|:  514.496338
rounded |X_k-Y|_0 = 24214, f1 =  0.627119, approx slack: 412601
rounded before pow |X_k-Y|_0 = 151415, f1 =  0.302242

Iteration 3580: Loss = 24770.638672
|Xk-Y|_F:  24256.759766, |X-X0|:  513.878662
rounded |X_k-Y|_0 = 24210, f1 =  0.627245, approx slack: 413119
rounded before pow |X_k-Y|_0 = 151861, f1 =  0.301930

Iteration 3600: Loss = 24767.222656
|Xk-Y|_F:  24253.218750, |X-X0|:  514.003662
rounded |X_k-Y|_0 = 24205, f1 =  0.627386, approx slack: 412557
rounded before pow |X_k-Y|_0 = 151411, f1 =  0.302245

Iteration 3620: Loss = 24762.476562
|Xk-Y|_F:  24249.498047, |X-X0|:  512.978760
rounded |X_k-Y|_0 = 24210, f1 =  0.627260, approx slack: 412517
rounded before pow |X_k-Y|_0 = 151411, f1 =  0.302245

Iteration 3640: Loss = 24753.404297
|Xk-Y|_F:  24246.162109, |X-X0|:  507.243011
rounded |X_k-Y|_0 = 24194, f1 =  0.627715, approx slack: 405560
rounded before pow |X_k-Y|_0 = 151194, f1 =  0.302396

Iteration 3660: Loss = 24749.195312
|Xk-Y|_F:  24243.791016, |X-X0|:  505.405273
rounded |X_k-Y|_0 = 24193, f1 =  0.627730, approx slack: 404721
rounded before pow |X_k-Y|_0 = 150900, f1 =  0.302600

Iteration 3680: Loss = 24744.750000
|Xk-Y|_F:  24239.400391, |X-X0|:  505.348633
rounded |X_k-Y|_0 = 24191, f1 =  0.627803, approx slack: 404719
rounded before pow |X_k-Y|_0 = 150900, f1 =  0.302600

Iteration 3700: Loss = 24737.433594
|Xk-Y|_F:  24236.787109, |X-X0|:  500.646759
rounded |X_k-Y|_0 = 24190, f1 =  0.627846, approx slack: 404659
rounded before pow |X_k-Y|_0 = 150900, f1 =  0.302600

Iteration 3720: Loss = 24733.171875
|Xk-Y|_F:  24232.986328, |X-X0|:  500.184937
rounded |X_k-Y|_0 = 24185, f1 =  0.627972, approx slack: 404685
rounded before pow |X_k-Y|_0 = 150900, f1 =  0.302600

Iteration 3740: Loss = 24728.988281
|Xk-Y|_F:  24228.906250, |X-X0|:  500.082642
rounded |X_k-Y|_0 = 24174, f1 =  0.628315, approx slack: 407281
rounded before pow |X_k-Y|_0 = 150901, f1 =  0.302600

Iteration 3760: Loss = 24719.537109
|Xk-Y|_F:  24222.925781, |X-X0|:  496.611572
rounded |X_k-Y|_0 = 24174, f1 =  0.628277, approx slack: 407146
rounded before pow |X_k-Y|_0 = 150901, f1 =  0.302600

Iteration 3780: Loss = 24716.812500
|Xk-Y|_F:  24217.222656, |X-X0|:  499.590240
rounded |X_k-Y|_0 = 24164, f1 =  0.628566, approx slack: 406818
rounded before pow |X_k-Y|_0 = 150743, f1 =  0.302710

Iteration 3800: Loss = 24706.589844
|Xk-Y|_F:  24212.976562, |X-X0|:  493.612427
rounded |X_k-Y|_0 = 24160, f1 =  0.628645, approx slack: 406120
rounded before pow |X_k-Y|_0 = 150533, f1 =  0.302809

Iteration 3820: Loss = 24701.900391
|Xk-Y|_F:  24208.029297, |X-X0|:  493.871155
rounded |X_k-Y|_0 = 24170, f1 =  0.628369, approx slack: 408955
rounded before pow |X_k-Y|_0 = 150778, f1 =  0.302638

Iteration 3840: Loss = 24698.021484
|Xk-Y|_F:  24203.722656, |X-X0|:  494.298218
rounded |X_k-Y|_0 = 24166, f1 =  0.628481, approx slack: 408948
rounded before pow |X_k-Y|_0 = 150778, f1 =  0.302638

Iteration 3860: Loss = 24694.046875
|Xk-Y|_F:  24199.833984, |X-X0|:  494.212860
rounded |X_k-Y|_0 = 24146, f1 =  0.629054, approx slack: 408913
rounded before pow |X_k-Y|_0 = 150778, f1 =  0.302638

Iteration 3880: Loss = 24688.382812
|Xk-Y|_F:  24195.261719, |X-X0|:  493.120361
rounded |X_k-Y|_0 = 24155, f1 =  0.628818, approx slack: 408762
rounded before pow |X_k-Y|_0 = 150629, f1 =  0.302742

Iteration 3900: Loss = 24684.986328
|Xk-Y|_F:  24191.146484, |X-X0|:  493.840363
rounded |X_k-Y|_0 = 24137, f1 =  0.629305, approx slack: 408630
rounded before pow |X_k-Y|_0 = 150536, f1 =  0.302808

Iteration 3920: Loss = 24681.515625
|Xk-Y|_F:  24187.373047, |X-X0|:  494.142090
rounded |X_k-Y|_0 = 24142, f1 =  0.629203, approx slack: 407830
rounded before pow |X_k-Y|_0 = 150289, f1 =  0.302980

Iteration 3940: Loss = 24677.515625
|Xk-Y|_F:  24182.361328, |X-X0|:  495.153320
rounded |X_k-Y|_0 = 24133, f1 =  0.629458, approx slack: 407876
rounded before pow |X_k-Y|_0 = 150289, f1 =  0.302980

Iteration 3960: Loss = 24671.421875
|Xk-Y|_F:  24179.177734, |X-X0|:  492.243927
rounded |X_k-Y|_0 = 24122, f1 =  0.629757, approx slack: 407862
rounded before pow |X_k-Y|_0 = 150289, f1 =  0.302980

Iteration 3980: Loss = 24669.652344
|Xk-Y|_F:  24177.625000, |X-X0|:  492.027069
rounded |X_k-Y|_0 = 24125, f1 =  0.629673, approx slack: 407838
rounded before pow |X_k-Y|_0 = 150288, f1 =  0.302980

Iteration 4000: Loss = 24663.333984
|Xk-Y|_F:  24172.558594, |X-X0|:  490.774475
rounded |X_k-Y|_0 = 24123, f1 =  0.629728, approx slack: 407802
rounded before pow |X_k-Y|_0 = 150288, f1 =  0.302980

Iteration 4020: Loss = 24659.796875
|Xk-Y|_F:  24170.736328, |X-X0|:  489.060608
rounded |X_k-Y|_0 = 24106, f1 =  0.630216, approx slack: 407776
rounded before pow |X_k-Y|_0 = 150288, f1 =  0.302980

Iteration 4040: Loss = 24654.927734
|Xk-Y|_F:  24165.062500, |X-X0|:  489.866089
rounded |X_k-Y|_0 = 24095, f1 =  0.630536, approx slack: 407770
rounded before pow |X_k-Y|_0 = 150288, f1 =  0.302980

Iteration 4060: Loss = 24651.958984
|Xk-Y|_F:  24161.888672, |X-X0|:  490.069946
rounded |X_k-Y|_0 = 24102, f1 =  0.630370, approx slack: 408022
rounded before pow |X_k-Y|_0 = 150318, f1 =  0.302912

Iteration 4080: Loss = 24649.167969
|Xk-Y|_F:  24160.521484, |X-X0|:  488.645630
rounded |X_k-Y|_0 = 24099, f1 =  0.630482, approx slack: 408032
rounded before pow |X_k-Y|_0 = 150351, f1 =  0.302749

Iteration 4100: Loss = 24638.742188
|Xk-Y|_F:  24157.154297, |X-X0|:  481.587921
rounded |X_k-Y|_0 = 24101, f1 =  0.630424, approx slack: 408031
rounded before pow |X_k-Y|_0 = 150376, f1 =  0.302622

Iteration 4120: Loss = 24632.453125
|Xk-Y|_F:  24152.923828, |X-X0|:  479.528320
rounded |X_k-Y|_0 = 24077, f1 =  0.631078, approx slack: 407424
rounded before pow |X_k-Y|_0 = 150179, f1 =  0.302665

Iteration 4140: Loss = 24626.814453
|Xk-Y|_F:  24148.451172, |X-X0|:  478.363678
rounded |X_k-Y|_0 = 24086, f1 =  0.630841, approx slack: 407450
rounded before pow |X_k-Y|_0 = 150212, f1 =  0.302501

Iteration 4160: Loss = 24621.830078
|Xk-Y|_F:  24145.050781, |X-X0|:  476.779114
rounded |X_k-Y|_0 = 24077, f1 =  0.631078, approx slack: 407445
rounded before pow |X_k-Y|_0 = 150212, f1 =  0.302501

Iteration 4180: Loss = 24619.716797
|Xk-Y|_F:  24144.246094, |X-X0|:  475.470184
rounded |X_k-Y|_0 = 24069, f1 =  0.631335, approx slack: 407451
rounded before pow |X_k-Y|_0 = 150234, f1 =  0.302391

Iteration 4200: Loss = 24616.667969
|Xk-Y|_F:  24140.304688, |X-X0|:  476.362915
rounded |X_k-Y|_0 = 24057, f1 =  0.631682, approx slack: 407426
rounded before pow |X_k-Y|_0 = 150256, f1 =  0.302282

Iteration 4220: Loss = 24611.332031
|Xk-Y|_F:  24135.947266, |X-X0|:  475.383850
rounded |X_k-Y|_0 = 24061, f1 =  0.631543, approx slack: 407421
rounded before pow |X_k-Y|_0 = 150267, f1 =  0.302227

Iteration 4240: Loss = 24608.666016
|Xk-Y|_F:  24136.392578, |X-X0|:  472.272949
rounded |X_k-Y|_0 = 24072, f1 =  0.631250, approx slack: 407470
rounded before pow |X_k-Y|_0 = 150267, f1 =  0.302227

Iteration 4260: Loss = 24601.386719
|Xk-Y|_F:  24131.291016, |X-X0|:  470.094849
rounded |X_k-Y|_0 = 24062, f1 =  0.631519, approx slack: 407558
rounded before pow |X_k-Y|_0 = 150311, f1 =  0.302008

Iteration 4280: Loss = 24599.714844
|Xk-Y|_F:  24126.410156, |X-X0|:  473.305359
rounded |X_k-Y|_0 = 24054, f1 =  0.631734, approx slack: 406521
rounded before pow |X_k-Y|_0 = 149906, f1 =  0.302145

Iteration 4300: Loss = 24595.400391
|Xk-Y|_F:  24124.636719, |X-X0|:  470.763062
rounded |X_k-Y|_0 = 24042, f1 =  0.632084, approx slack: 406478
rounded before pow |X_k-Y|_0 = 149917, f1 =  0.302090

Iteration 4320: Loss = 24586.029297
|Xk-Y|_F:  24120.431641, |X-X0|:  465.598267
rounded |X_k-Y|_0 = 24032, f1 =  0.632368, approx slack: 406391
rounded before pow |X_k-Y|_0 = 149917, f1 =  0.302090

Iteration 4340: Loss = 24582.447266
|Xk-Y|_F:  24118.332031, |X-X0|:  464.114319
rounded |X_k-Y|_0 = 24039, f1 =  0.632161, approx slack: 406278
rounded before pow |X_k-Y|_0 = 149917, f1 =  0.302090

Iteration 4360: Loss = 24581.660156
|Xk-Y|_F:  24115.740234, |X-X0|:  465.919312
rounded |X_k-Y|_0 = 24045, f1 =  0.632003, approx slack: 406289
rounded before pow |X_k-Y|_0 = 149928, f1 =  0.302035

Iteration 4380: Loss = 24577.179688
|Xk-Y|_F:  24111.494141, |X-X0|:  465.685883
rounded |X_k-Y|_0 = 24047, f1 =  0.631946, approx slack: 403942
rounded before pow |X_k-Y|_0 = 148927, f1 =  0.302718

Iteration 4400: Loss = 24574.816406
|Xk-Y|_F:  24108.128906, |X-X0|:  466.687378
rounded |X_k-Y|_0 = 24021, f1 =  0.632680, approx slack: 403919
rounded before pow |X_k-Y|_0 = 148927, f1 =  0.302718

Iteration 4420: Loss = 24569.005859
|Xk-Y|_F:  24105.457031, |X-X0|:  463.548126
rounded |X_k-Y|_0 = 24029, f1 =  0.632457, approx slack: 403973
rounded before pow |X_k-Y|_0 = 148949, f1 =  0.302607

Converged at iteration 4432
------ ABL 0 after refine ------
--- eval ---
prediction result:
f1 on test:    0.3880
f1 on test:    0.6443 (micro)
f1 on KB:      0.3880
integrated f1: 0.3880, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3539
f1 on test:    0.6727 (micro)
f1 on KB:      0.5978
integrated f1: 0.4943, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3880
Epoch 100, Total loss: 84524856.0000, CE loss: 2.9345, RL loss: 845248.5625, Reward: -47716.5205
    full cols: 164, non-full cols: 2
   r - labels: 8, labels - r: 3
    violated: 4347, weighted: 121.36198425292969, len: 0.0, nonzero: 0.10860097408294678
Epoch 200, Total loss: 9254602.0000, CE loss: 2.9338, RL loss: 92546.0234, Reward: -47786.7168
    full cols: 164, non-full cols: 1
   r - labels: 7, labels - r: 3
    violated: 4339, weighted: 122.49592590332031, len: 0.0, nonzero: 0.10861130058765411
Epoch 300, Total loss: -15917736.0000, CE loss: 2.9338, RL loss: -159177.3594, Reward: -47890.2344
    full cols: 164, non-full cols: 1
   r - labels: 7, labels - r: 3
    violated: 4343, weighted: 117.99592590332031, len: 0.0, nonzero: 0.10851841419935226
Epoch 400, Total loss: -12072820.0000, CE loss: 2.9327, RL loss: -120728.2031, Reward: -47860.6992
    full cols: 164, non-full cols: 1
   r - labels: 7, labels - r: 3
    violated: 4347, weighted: 108.99592590332031, len: 0.0, nonzero: 0.10833264887332916
Epoch 500, Total loss: -127480952.0000, CE loss: 2.9317, RL loss: -1274809.5000, Reward: -48167.9111
    full cols: 164, non-full cols: 1
   r - labels: 7, labels - r: 3
    violated: 4345, weighted: 108.89027404785156, len: 0.0, nonzero: 0.10833264887332916
Epoch 600, Total loss: -17103410.0000, CE loss: 2.9302, RL loss: -171034.1094, Reward: -47836.8799
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 4347, weighted: 108.49592590332031, len: 0.0, nonzero: 0.10832232981920242
Epoch 700, Total loss: 25389694.0000, CE loss: 2.9285, RL loss: 253896.9375, Reward: -47832.3867
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 4346, weighted: 108.49592590332031, len: 0.0, nonzero: 0.10832232981920242
Epoch 800, Total loss: 64522532.0000, CE loss: 2.9275, RL loss: 645225.3125, Reward: -47733.8330
    full cols: 164, non-full cols: 1
   r - labels: 7, labels - r: 3
    violated: 4345, weighted: 110.99592590332031, len: 0.0, nonzero: 0.10837393254041672
Epoch 900, Total loss: 37144720.0000, CE loss: 2.9259, RL loss: 371447.2188, Reward: -47790.9893
    full cols: 164, non-full cols: 1
   r - labels: 7, labels - r: 3
    violated: 4342, weighted: 108.99592590332031, len: 0.0, nonzero: 0.10833264887332916
Epoch 1000, Total loss: 65042756.0000, CE loss: 2.9249, RL loss: 650427.5625, Reward: -47686.8242
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 4337, weighted: 108.49592590332031, len: 0.0, nonzero: 0.10832232981920242
Epoch 1100, Total loss: 64278056.0000, CE loss: 2.9243, RL loss: 642780.5625, Reward: -47704.1182
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 4347, weighted: 108.49592590332031, len: 0.0, nonzero: 0.10832232981920242
Epoch 1200, Total loss: 12372605.0000, CE loss: 2.9240, RL loss: 123726.0547, Reward: -47726.4961
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 4341, weighted: 108.49592590332031, len: 0.0, nonzero: 0.10832232981920242
Epoch 1300, Total loss: 5129103.5000, CE loss: 2.9240, RL loss: 51291.0352, Reward: -47812.7051
    full cols: 163, non-full cols: 1
   r - labels: 6, labels - r: 3
    violated: 4338, weighted: 101.99592590332031, len: 0.0, nonzero: 0.10818816721439362
Epoch 1400, Total loss: 58184836.0000, CE loss: 2.9234, RL loss: 581848.3750, Reward: -47686.3154
    full cols: 163, non-full cols: 0
   r - labels: 5, labels - r: 3
    violated: 4339, weighted: 76.49592590332031, len: 0.0, nonzero: 0.10766182839870453
Epoch 1500, Total loss: 76251712.0000, CE loss: 2.9224, RL loss: 762517.1250, Reward: -47548.2061
    full cols: 163, non-full cols: 0
   r - labels: 5, labels - r: 3
    violated: 4349, weighted: 76.49592590332031, len: 0.0, nonzero: 0.10766182839870453
Epoch 1600, Total loss: -34963836.0000, CE loss: 2.9216, RL loss: -349638.3750, Reward: -47879.8779
    full cols: 163, non-full cols: 0
   r - labels: 5, labels - r: 3
    violated: 4343, weighted: 76.49592590332031, len: 0.0, nonzero: 0.10766182839870453
Epoch 1700, Total loss: -27250534.0000, CE loss: 2.9207, RL loss: -272505.3438, Reward: -47868.6797
    full cols: 163, non-full cols: 0
   r - labels: 5, labels - r: 3
    violated: 4346, weighted: 76.49592590332031, len: 0.0, nonzero: 0.10766182839870453
Epoch 1800, Total loss: -24409494.0000, CE loss: 2.9193, RL loss: -244094.9375, Reward: -47798.9297
    full cols: 163, non-full cols: 0
   r - labels: 5, labels - r: 3
    violated: 4346, weighted: 76.49592590332031, len: 0.0, nonzero: 0.10766182839870453
Epoch 1900, Total loss: 58472212.0000, CE loss: 2.9187, RL loss: 584722.1250, Reward: -47687.6201
    full cols: 163, non-full cols: 0
   r - labels: 5, labels - r: 3
    violated: 4342, weighted: 76.49592590332031, len: 0.0, nonzero: 0.10766182839870453
--- eval ---
prediction result:
f1 on test:    0.3860
f1 on test:    0.6482 (micro)
f1 on KB:      0.3997
integrated f1: 0.3955, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3539
f1 on test:    0.6727 (micro)
f1 on KB:      0.5978
integrated f1: 0.5247, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: -42016868.0000, CE loss: 2.9182, RL loss: -420168.6875, Reward: -47809.7910
    full cols: 163, non-full cols: 0
   r - labels: 5, labels - r: 3
    violated: 4345, weighted: 76.49592590332031, len: 0.0, nonzero: 0.10766182839870453
Epoch 2100, Total loss: 9511493.0000, CE loss: 2.9181, RL loss: 95114.9297, Reward: -47730.9932
    full cols: 163, non-full cols: 0
   r - labels: 5, labels - r: 3
    violated: 4348, weighted: 76.49592590332031, len: 0.0, nonzero: 0.10766182839870453
Epoch 2200, Total loss: -47992212.0000, CE loss: 2.9174, RL loss: -479922.1250, Reward: -47964.7197
    full cols: 162, non-full cols: 1
   r - labels: 5, labels - r: 3
    violated: 4349, weighted: 76.48031616210938, len: 0.0, nonzero: 0.10763086378574371
Epoch 2300, Total loss: 65173612.0000, CE loss: 2.9170, RL loss: 651736.1250, Reward: -47633.1992
    full cols: 162, non-full cols: 0
   r - labels: 4, labels - r: 3
    violated: 4338, weighted: 76.16288757324219, len: 0.0, nonzero: 0.10700132697820663
Epoch 2400, Total loss: -40514556.0000, CE loss: 2.9171, RL loss: -405145.5625, Reward: -47900.8359
    full cols: 162, non-full cols: 1
   r - labels: 5, labels - r: 3
    violated: 4345, weighted: 76.48551940917969, len: 0.0, nonzero: 0.10764118283987045
Epoch 2500, Total loss: -82234256.0000, CE loss: 2.9169, RL loss: -822342.5625, Reward: -47987.1055
    full cols: 162, non-full cols: 0
   r - labels: 4, labels - r: 3
    violated: 4344, weighted: 67.33030700683594, len: 0.0, nonzero: 0.10700132697820663
Epoch 2600, Total loss: 25728576.0000, CE loss: 2.9170, RL loss: 257285.7656, Reward: -47771.2432
    full cols: 163, non-full cols: 0
   r - labels: 4, labels - r: 2
    violated: 4280, weighted: 63.89863586425781, len: 0.0, nonzero: 0.10766182839870453
Epoch 2700, Total loss: 36705364.0000, CE loss: 2.9170, RL loss: 367053.6562, Reward: -47700.8398
    full cols: 162, non-full cols: 1
   r - labels: 4, labels - r: 2
    violated: 4278, weighted: 66.27284240722656, len: 0.0, nonzero: 0.10764118283987045
Epoch 2800, Total loss: 64206908.0000, CE loss: 2.9166, RL loss: 642069.0625, Reward: -47645.8633
    full cols: 163, non-full cols: 2
   r - labels: 6, labels - r: 2
    violated: 4221, weighted: 80.18777465820312, len: 0.0, nonzero: 0.1083429679274559
Epoch 2900, Total loss: -76938320.0000, CE loss: 2.9168, RL loss: -769383.1875, Reward: -48025.2305
    full cols: 163, non-full cols: 1
   r - labels: 5, labels - r: 2
    violated: 4284, weighted: 56.40361404418945, len: 0.0, nonzero: 0.10790951550006866
Epoch 3000, Total loss: -55554064.0000, CE loss: 2.9168, RL loss: -555540.6250, Reward: -47960.5020
    full cols: 164, non-full cols: 1
   r - labels: 6, labels - r: 2
    violated: 4219, weighted: 81.10383605957031, len: 0.0, nonzero: 0.10847713053226471
Epoch 3100, Total loss: 42036804.0000, CE loss: 2.9166, RL loss: 420368.0312, Reward: -47780.6523
    full cols: 165, non-full cols: 0
   r - labels: 6, labels - r: 2
    violated: 4219, weighted: 83.24342346191406, len: 0.0, nonzero: 0.10898283123970032
Epoch 3200, Total loss: -9412525.0000, CE loss: 2.9167, RL loss: -94125.2500, Reward: -47938.9531
    full cols: 165, non-full cols: 0
   r - labels: 6, labels - r: 2
    violated: 4281, weighted: 72.23890686035156, len: 0.0, nonzero: 0.10898283123970032
Epoch 3300, Total loss: -55932992.0000, CE loss: 2.9165, RL loss: -559329.9375, Reward: -48023.7178
    full cols: 164, non-full cols: 0
   r - labels: 5, labels - r: 2
    violated: 4347, weighted: 47.14569091796875, len: 0.0, nonzero: 0.10832232981920242
Epoch 3400, Total loss: 23733946.0000, CE loss: 2.9167, RL loss: 237339.4688, Reward: -47807.7637
    full cols: 164, non-full cols: 0
   r - labels: 5, labels - r: 2
    violated: 4352, weighted: 72.34027099609375, len: 0.0, nonzero: 0.10832232981920242
Epoch 3500, Total loss: 6090111.0000, CE loss: 2.9166, RL loss: 60901.1094, Reward: -47883.7988
    full cols: 163, non-full cols: 1
   r - labels: 5, labels - r: 2
    violated: 4386, weighted: 54.84026336669922, len: 0.0, nonzero: 0.10796111822128296
Epoch 3600, Total loss: -161519776.0000, CE loss: 2.9172, RL loss: -1615197.7500, Reward: -48295.0703
    full cols: 165, non-full cols: 0
   r - labels: 5, labels - r: 1
    violated: 4287, weighted: 38.399993896484375, len: 0.0, nonzero: 0.10898283123970032
Epoch 3700, Total loss: -54185008.0000, CE loss: 2.9166, RL loss: -541850.0625, Reward: -48039.3594
    full cols: 166, non-full cols: 0
   r - labels: 6, labels - r: 1
    violated: 4287, weighted: 38.73302459716797, len: 0.0, nonzero: 0.10964333266019821
Epoch 3800, Total loss: -58547280.0000, CE loss: 2.9166, RL loss: -585472.8125, Reward: -48065.0908
    full cols: 163, non-full cols: 1
   r - labels: 4, labels - r: 1
    violated: 4349, weighted: 15.115606307983398, len: 0.0, nonzero: 0.10775470733642578
Epoch 3900, Total loss: -38224724.0000, CE loss: 2.9164, RL loss: -382247.2500, Reward: -48032.5127
    full cols: 163, non-full cols: 0
   r - labels: 3, labels - r: 1
    violated: 4350, weighted: 11.525787353515625, len: 0.0, nonzero: 0.10766182839870453
--- eval ---
prediction result:
f1 on test:    0.3855
f1 on test:    0.6482 (micro)
f1 on KB:      0.4003
integrated f1: 0.3957, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3544
f1 on test:    0.6732 (micro)
f1 on KB:      0.6067
integrated f1: 0.5310, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: -42071912.0000, CE loss: 2.9162, RL loss: -420719.1250, Reward: -48032.5889
    full cols: 162, non-full cols: 0
   r - labels: 2, labels - r: 1
    violated: 4350, weighted: 5.9800872802734375, len: 0.0, nonzero: 0.10700132697820663
Epoch 4100, Total loss: 125742512.0000, CE loss: 2.9162, RL loss: 1257425.1250, Reward: -47614.5000
    full cols: 162, non-full cols: 0
   r - labels: 2, labels - r: 1
    violated: 4350, weighted: 5.9800872802734375, len: 0.0, nonzero: 0.10700132697820663
Epoch 4200, Total loss: 17912518.0000, CE loss: 2.9157, RL loss: 179125.1875, Reward: -47899.3203
    full cols: 160, non-full cols: 1
   r - labels: 2, labels - r: 2
    violated: 4412, weighted: 6.281445503234863, len: 0.0, nonzero: 0.10621698200702667
Epoch 4300, Total loss: -15608806.0000, CE loss: 2.9159, RL loss: -156088.0625, Reward: -47786.8789
    full cols: 161, non-full cols: 0
   r - labels: 1, labels - r: 1
    violated: 4283, weighted: 3.185516357421875, len: 0.0, nonzero: 0.10634082555770874
Epoch 4400, Total loss: -712110.9375, CE loss: 2.9156, RL loss: -7121.1094, Reward: -47945.8926
    full cols: 161, non-full cols: 0
   r - labels: 2, labels - r: 2
    violated: 4347, weighted: 9.556556701660156, len: 0.0, nonzero: 0.10634082555770874
Epoch 4500, Total loss: -96420136.0000, CE loss: 2.9155, RL loss: -964201.3750, Reward: -48167.5625
    full cols: 162, non-full cols: 0
   r - labels: 3, labels - r: 2
    violated: 4276, weighted: 10.90316390991211, len: 0.0, nonzero: 0.10700132697820663
Epoch 4600, Total loss: 25526432.0000, CE loss: 2.9161, RL loss: 255264.3125, Reward: -47839.3262
    full cols: 163, non-full cols: 1
   r - labels: 5, labels - r: 2
    violated: 4220, weighted: 50.18800354003906, len: 0.0, nonzero: 0.10796111822128296
Epoch 4700, Total loss: 27102538.0000, CE loss: 2.9154, RL loss: 271025.3750, Reward: -47918.7334
    full cols: 162, non-full cols: 2
   r - labels: 5, labels - r: 2
    violated: 4283, weighted: 12.458593368530273, len: 0.0, nonzero: 0.10705292969942093
Epoch 4800, Total loss: 25964642.0000, CE loss: 2.9151, RL loss: 259646.4219, Reward: -47978.6338
    full cols: 163, non-full cols: 0
   r - labels: 4, labels - r: 2
    violated: 4278, weighted: 13.697734832763672, len: 0.0, nonzero: 0.10766182839870453
Epoch 4900, Total loss: 74826416.0000, CE loss: 2.9158, RL loss: 748264.1875, Reward: -47818.9961
    full cols: 163, non-full cols: 0
   r - labels: 4, labels - r: 2
    violated: 4343, weighted: 12.684158325195312, len: 0.0, nonzero: 0.10766182839870453
Epoch 5000, Total loss: 26378954.0000, CE loss: 2.9152, RL loss: 263789.5312, Reward: -47988.5723
    full cols: 164, non-full cols: 0
   r - labels: 5, labels - r: 2
    violated: 4346, weighted: 21.849769592285156, len: 0.0, nonzero: 0.10832232981920242
Epoch 5100, Total loss: 51155808.0000, CE loss: 2.9150, RL loss: 511558.0625, Reward: -47902.3965
    full cols: 163, non-full cols: 0
   r - labels: 5, labels - r: 3
    violated: 4411, weighted: 21.37194061279297, len: 0.0, nonzero: 0.10766182839870453
Epoch 5200, Total loss: 1995125.0000, CE loss: 2.9151, RL loss: 19951.2500, Reward: -47957.7559
    full cols: 164, non-full cols: 1
   r - labels: 6, labels - r: 2
    violated: 4281, weighted: 49.44139862060547, len: 0.0, nonzero: 0.10868354141712189
Epoch 5300, Total loss: -7480707.0000, CE loss: 2.9150, RL loss: -74807.0703, Reward: -48085.9658
    full cols: 162, non-full cols: 0
   r - labels: 3, labels - r: 2
    violated: 4346, weighted: 7.138458251953125, len: 0.0, nonzero: 0.10700132697820663
Epoch 5400, Total loss: 3219131.7500, CE loss: 2.9149, RL loss: 32191.3164, Reward: -48067.6973
    full cols: 162, non-full cols: 1
   r - labels: 4, labels - r: 2
    violated: 4347, weighted: 23.468097686767578, len: 0.0, nonzero: 0.10750702023506165
Epoch 5500, Total loss: 1104460.3750, CE loss: 2.9149, RL loss: 11044.6035, Reward: -48030.1797
    full cols: 163, non-full cols: 0
   r - labels: 4, labels - r: 2
    violated: 4282, weighted: 8.485065460205078, len: 0.0, nonzero: 0.10766182839870453
Epoch 5600, Total loss: -62366320.0000, CE loss: 2.9149, RL loss: -623663.1875, Reward: -48247.7158
    full cols: 165, non-full cols: 0
   r - labels: 6, labels - r: 2
    violated: 4221, weighted: 61.813575744628906, len: 0.0, nonzero: 0.10898283123970032
Epoch 5700, Total loss: 17724536.0000, CE loss: 2.9152, RL loss: 177245.3594, Reward: -48062.5107
    full cols: 167, non-full cols: 1
   r - labels: 9, labels - r: 2
    violated: 4151, weighted: 92.48641967773438, len: 0.0, nonzero: 0.11058248579502106
Epoch 5800, Total loss: -56465868.0000, CE loss: 2.9146, RL loss: -564658.6875, Reward: -48278.9062
    full cols: 168, non-full cols: 0
   r - labels: 9, labels - r: 2
    violated: 4151, weighted: 110.98641967773438, len: 0.0, nonzero: 0.110964335501194
Epoch 5900, Total loss: -11888866.0000, CE loss: 2.9143, RL loss: -118888.6562, Reward: -48170.2764
    full cols: 166, non-full cols: 0
   r - labels: 7, labels - r: 2
    violated: 4212, weighted: 70.97918701171875, len: 0.0, nonzero: 0.10964333266019821
--- eval ---
prediction result:
f1 on test:    0.3841
f1 on test:    0.6481 (micro)
f1 on KB:      0.4006
integrated f1: 0.3954, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3520
f1 on test:    0.6729 (micro)
f1 on KB:      0.6030
integrated f1: 0.5277, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: -107650640.0000, CE loss: 2.9141, RL loss: -1076506.3750, Reward: -48435.3359
    full cols: 167, non-full cols: 0
   r - labels: 8, labels - r: 2
    violated: 4154, weighted: 95.73936462402344, len: 0.0, nonzero: 0.1103038340806961
Epoch 6100, Total loss: 62017408.0000, CE loss: 2.9142, RL loss: 620174.0625, Reward: -48015.0527
    full cols: 162, non-full cols: 1
   r - labels: 5, labels - r: 3
    violated: 4279, weighted: 51.28122329711914, len: 0.0, nonzero: 0.10701164603233337
Epoch 6200, Total loss: -43610060.0000, CE loss: 2.9139, RL loss: -436100.5938, Reward: -48316.8057
    full cols: 166, non-full cols: 1
   r - labels: 8, labels - r: 2
    violated: 4218, weighted: 76.70135498046875, len: 0.0, nonzero: 0.10968461632728577
Epoch 6300, Total loss: 77781504.0000, CE loss: 2.9139, RL loss: 777815.0625, Reward: -48041.2500
    full cols: 166, non-full cols: 0
   r - labels: 7, labels - r: 2
    violated: 4284, weighted: 74.88868713378906, len: 0.0, nonzero: 0.10964333266019821
Epoch 6400, Total loss: -39005872.0000, CE loss: 2.9138, RL loss: -390058.7188, Reward: -48331.4883
    full cols: 166, non-full cols: 0
   r - labels: 8, labels - r: 3
    violated: 4343, weighted: 120.31130981445312, len: 0.0, nonzero: 0.10964333266019821
Epoch 6500, Total loss: 27876578.0000, CE loss: 2.9141, RL loss: 278765.7812, Reward: -48155.8574
    full cols: 167, non-full cols: 0
   r - labels: 8, labels - r: 2
    violated: 4285, weighted: 136.0941162109375, len: 0.0, nonzero: 0.1103038340806961
Epoch 6600, Total loss: -49185532.0000, CE loss: 2.9146, RL loss: -491855.3125, Reward: -48351.6797
    full cols: 164, non-full cols: 1
   r - labels: 6, labels - r: 2
    violated: 4283, weighted: 69.03347778320312, len: 0.0, nonzero: 0.10857001692056656
Epoch 6700, Total loss: 58356720.0000, CE loss: 2.9141, RL loss: 583567.1875, Reward: -48131.1865
    full cols: 164, non-full cols: 1
   r - labels: 6, labels - r: 2
    violated: 4281, weighted: 84.34478759765625, len: 0.0, nonzero: 0.1083429679274559
Epoch 6800, Total loss: 16900350.0000, CE loss: 2.9139, RL loss: 169003.5000, Reward: -48226.4639
    full cols: 165, non-full cols: 1
   r - labels: 7, labels - r: 2
    violated: 4281, weighted: 102.7685546875, len: 0.0, nonzero: 0.10936468094587326
Epoch 6900, Total loss: -79305096.0000, CE loss: 2.9139, RL loss: -793050.9375, Reward: -48444.1758
    full cols: 167, non-full cols: 0
   r - labels: 8, labels - r: 2
    violated: 4222, weighted: 117.9366455078125, len: 0.0, nonzero: 0.1103038340806961
Epoch 7000, Total loss: 40120664.0000, CE loss: 2.9139, RL loss: 401206.6562, Reward: -48150.3145
    full cols: 163, non-full cols: 1
   r - labels: 5, labels - r: 2
    violated: 4285, weighted: 39.70361328125, len: 0.0, nonzero: 0.10768246650695801
Epoch 7100, Total loss: -20543462.0000, CE loss: 2.9141, RL loss: -205434.6250, Reward: -48334.1768
    full cols: 166, non-full cols: 1
   r - labels: 8, labels - r: 2
    violated: 4216, weighted: 86.68302917480469, len: 0.0, nonzero: 0.10992198437452316
Epoch 7200, Total loss: 65064300.0000, CE loss: 2.9138, RL loss: 650643.0000, Reward: -48231.6592
    full cols: 167, non-full cols: 0
   r - labels: 8, labels - r: 2
    violated: 4279, weighted: 86.805419921875, len: 0.0, nonzero: 0.1103038340806961
Epoch 7300, Total loss: -48853664.0000, CE loss: 2.9136, RL loss: -488536.6562, Reward: -48438.7402
    full cols: 165, non-full cols: 1
   r - labels: 7, labels - r: 2
    violated: 4284, weighted: 46.814476013183594, len: 0.0, nonzero: 0.10923051834106445
Epoch 7400, Total loss: 45929992.0000, CE loss: 2.9139, RL loss: 459299.9062, Reward: -48168.3662
    full cols: 165, non-full cols: 0
   r - labels: 6, labels - r: 2
    violated: 4274, weighted: 42.01990509033203, len: 0.0, nonzero: 0.10898283123970032
Epoch 7500, Total loss: -91028744.0000, CE loss: 2.9137, RL loss: -910287.4375, Reward: -48525.2354
    full cols: 163, non-full cols: 1
   r - labels: 6, labels - r: 3
    violated: 4342, weighted: 38.39637756347656, len: 0.0, nonzero: 0.10782695561647415
Epoch 7600, Total loss: -32871260.0000, CE loss: 2.9137, RL loss: -328712.5938, Reward: -48427.1670
    full cols: 163, non-full cols: 1
   r - labels: 6, labels - r: 3
    violated: 4279, weighted: 35.8857421875, len: 0.0, nonzero: 0.10814688354730606
Epoch 7700, Total loss: 17081204.0000, CE loss: 2.9137, RL loss: 170812.0312, Reward: -48275.7852
    full cols: 160, non-full cols: 1
   r - labels: 3, labels - r: 3
    violated: 4372, weighted: 28.04184913635254, len: 0.0, nonzero: 0.10587640851736069
Epoch 7800, Total loss: 46673268.0000, CE loss: 2.9138, RL loss: 466732.6875, Reward: -48252.4697
    full cols: 161, non-full cols: 3
   r - labels: 6, labels - r: 3
    violated: 4342, weighted: 24.152484893798828, len: 0.0, nonzero: 0.10704260319471359
Epoch 7900, Total loss: -73512976.0000, CE loss: 2.9136, RL loss: -735129.7500, Reward: -48507.7383
    full cols: 161, non-full cols: 2
   r - labels: 4, labels - r: 2
    violated: 4335, weighted: 18.483478546142578, len: 0.0, nonzero: 0.10694972425699234
--- eval ---
prediction result:
f1 on test:    0.3841
f1 on test:    0.6481 (micro)
f1 on KB:      0.4006
integrated f1: 0.3954, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3546
f1 on test:    0.6735 (micro)
f1 on KB:      0.6027
integrated f1: 0.5283, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: -32774510.0000, CE loss: 2.9135, RL loss: -327745.0938, Reward: -48424.1006
    full cols: 162, non-full cols: 1
   r - labels: 4, labels - r: 2
    violated: 4283, weighted: 20.498641967773438, len: 0.0, nonzero: 0.10704260319471359
------ ABL Loop 1 ------
--- eval ---
prediction result:
f1 on test:    0.3841
f1 on test:    0.6481 (micro)
f1 on KB:      0.4006
integrated f1: 0.3933, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3546
f1 on test:    0.6735 (micro)
f1 on KB:      0.6027
integrated f1: 0.4973, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3933
Iteration 0: Loss = 27147.052734
|Xk-Y|_F:  27147.052734, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 27155, f1 =  0.349512, approx slack: 42148
rounded before pow |X_k-Y|_0 = 27155, f1 =  0.349512

Iteration 20: Loss = 24059.292969
|Xk-Y|_F:  22965.119141, |X-X0|:  1094.174072
rounded |X_k-Y|_0 = 23499, f1 =  0.568889, approx slack: 562104
rounded before pow |X_k-Y|_0 = 63637, f1 =  0.387266

Iteration 40: Loss = 23102.695312
|Xk-Y|_F:  22177.384766, |X-X0|:  925.309631
rounded |X_k-Y|_0 = 23122, f1 =  0.582665, approx slack: 574292
rounded before pow |X_k-Y|_0 = 65833, f1 =  0.385498

Iteration 60: Loss = 22522.324219
|Xk-Y|_F:  21695.789062, |X-X0|:  826.534424
rounded |X_k-Y|_0 = 21743, f1 =  0.626378, approx slack: 554476
rounded before pow |X_k-Y|_0 = 67423, f1 =  0.383452

Iteration 80: Loss = 22219.111328
|Xk-Y|_F:  21478.253906, |X-X0|:  740.857666
rounded |X_k-Y|_0 = 21499, f1 =  0.633171, approx slack: 522501
rounded before pow |X_k-Y|_0 = 67403, f1 =  0.383561

Iteration 100: Loss = 22033.259766
|Xk-Y|_F:  21357.693359, |X-X0|:  675.566772
rounded |X_k-Y|_0 = 21370, f1 =  0.636727, approx slack: 483518
rounded before pow |X_k-Y|_0 = 61877, f1 =  0.393419

Iteration 120: Loss = 21940.761719
|Xk-Y|_F:  21289.128906, |X-X0|:  651.632019
rounded |X_k-Y|_0 = 21337, f1 =  0.637616, approx slack: 464905
rounded before pow |X_k-Y|_0 = 60447, f1 =  0.396201

Iteration 140: Loss = 21872.677734
|Xk-Y|_F:  21241.207031, |X-X0|:  631.470581
rounded |X_k-Y|_0 = 21310, f1 =  0.638304, approx slack: 452354
rounded before pow |X_k-Y|_0 = 60309, f1 =  0.396477

Iteration 160: Loss = 21823.820312
|Xk-Y|_F:  21203.960938, |X-X0|:  619.859619
rounded |X_k-Y|_0 = 21256, f1 =  0.639696, approx slack: 449453
rounded before pow |X_k-Y|_0 = 60106, f1 =  0.396868

Iteration 180: Loss = 21787.464844
|Xk-Y|_F:  21174.974609, |X-X0|:  612.490173
rounded |X_k-Y|_0 = 21217, f1 =  0.640714, approx slack: 434804
rounded before pow |X_k-Y|_0 = 59576, f1 =  0.397900

Iteration 200: Loss = 21755.207031
|Xk-Y|_F:  21153.269531, |X-X0|:  601.936646
rounded |X_k-Y|_0 = 21194, f1 =  0.641305, approx slack: 433397
rounded before pow |X_k-Y|_0 = 59428, f1 =  0.398204

Iteration 220: Loss = 21725.445312
|Xk-Y|_F:  21133.074219, |X-X0|:  592.371948
rounded |X_k-Y|_0 = 21179, f1 =  0.641693, approx slack: 423738
rounded before pow |X_k-Y|_0 = 58997, f1 =  0.399097

Iteration 240: Loss = 21703.359375
|Xk-Y|_F:  21115.859375, |X-X0|:  587.500977
rounded |X_k-Y|_0 = 21166, f1 =  0.642033, approx slack: 413589
rounded before pow |X_k-Y|_0 = 58212, f1 =  0.400754

Iteration 260: Loss = 21682.687500
|Xk-Y|_F:  21100.607422, |X-X0|:  582.079224
rounded |X_k-Y|_0 = 21169, f1 =  0.641960, approx slack: 417409
rounded before pow |X_k-Y|_0 = 58044, f1 =  0.401114

Iteration 280: Loss = 21665.212891
|Xk-Y|_F:  21087.417969, |X-X0|:  577.795654
rounded |X_k-Y|_0 = 21163, f1 =  0.642117, approx slack: 413818
rounded before pow |X_k-Y|_0 = 57707, f1 =  0.401842

Iteration 300: Loss = 21646.679688
|Xk-Y|_F:  21075.732422, |X-X0|:  570.947876
rounded |X_k-Y|_0 = 21152, f1 =  0.642397, approx slack: 405260
rounded before pow |X_k-Y|_0 = 56884, f1 =  0.403652

Iteration 320: Loss = 21631.406250
|Xk-Y|_F:  21065.332031, |X-X0|:  566.074036
rounded |X_k-Y|_0 = 21150, f1 =  0.642444, approx slack: 403120
rounded before pow |X_k-Y|_0 = 56688, f1 =  0.404090

Iteration 340: Loss = 21616.712891
|Xk-Y|_F:  21056.292969, |X-X0|:  560.419556
rounded |X_k-Y|_0 = 21150, f1 =  0.642439, approx slack: 391800
rounded before pow |X_k-Y|_0 = 55459, f1 =  0.406903

Iteration 360: Loss = 21603.400391
|Xk-Y|_F:  21046.041016, |X-X0|:  557.360046
rounded |X_k-Y|_0 = 21149, f1 =  0.642473, approx slack: 391746
rounded before pow |X_k-Y|_0 = 55459, f1 =  0.406903

Iteration 380: Loss = 21591.091797
|Xk-Y|_F:  21036.458984, |X-X0|:  554.632812
rounded |X_k-Y|_0 = 21124, f1 =  0.643119, approx slack: 391874
rounded before pow |X_k-Y|_0 = 55723, f1 =  0.406289

Iteration 400: Loss = 21578.978516
|Xk-Y|_F:  21028.199219, |X-X0|:  550.779785
rounded |X_k-Y|_0 = 21117, f1 =  0.643299, approx slack: 389558
rounded before pow |X_k-Y|_0 = 55587, f1 =  0.406595

Iteration 420: Loss = 21567.375000
|Xk-Y|_F:  21020.287109, |X-X0|:  547.088501
rounded |X_k-Y|_0 = 21102, f1 =  0.643684, approx slack: 382307
rounded before pow |X_k-Y|_0 = 55360, f1 =  0.407125

Iteration 440: Loss = 21559.068359
|Xk-Y|_F:  21013.513672, |X-X0|:  545.554932
rounded |X_k-Y|_0 = 21088, f1 =  0.644044, approx slack: 382423
rounded before pow |X_k-Y|_0 = 55360, f1 =  0.407125

Iteration 460: Loss = 21549.996094
|Xk-Y|_F:  21007.050781, |X-X0|:  542.944946
rounded |X_k-Y|_0 = 21084, f1 =  0.644150, approx slack: 379828
rounded before pow |X_k-Y|_0 = 55121, f1 =  0.407668

Iteration 480: Loss = 21541.007812
|Xk-Y|_F:  21000.337891, |X-X0|:  540.670776
rounded |X_k-Y|_0 = 21077, f1 =  0.644333, approx slack: 379600
rounded before pow |X_k-Y|_0 = 55078, f1 =  0.407769

Iteration 500: Loss = 21533.992188
|Xk-Y|_F:  20994.013672, |X-X0|:  539.978516
rounded |X_k-Y|_0 = 21070, f1 =  0.644518, approx slack: 379563
rounded before pow |X_k-Y|_0 = 55078, f1 =  0.407769

Iteration 520: Loss = 21525.251953
|Xk-Y|_F:  20988.398438, |X-X0|:  536.853027
rounded |X_k-Y|_0 = 21060, f1 =  0.644772, approx slack: 377083
rounded before pow |X_k-Y|_0 = 54989, f1 =  0.407980

Iteration 540: Loss = 21517.615234
|Xk-Y|_F:  20983.845703, |X-X0|:  533.768799
rounded |X_k-Y|_0 = 21053, f1 =  0.644948, approx slack: 358714
rounded before pow |X_k-Y|_0 = 54676, f1 =  0.408727

Iteration 560: Loss = 21510.515625
|Xk-Y|_F:  20978.615234, |X-X0|:  531.900757
rounded |X_k-Y|_0 = 21057, f1 =  0.644855, approx slack: 357123
rounded before pow |X_k-Y|_0 = 54516, f1 =  0.409111

Iteration 580: Loss = 21504.724609
|Xk-Y|_F:  20973.417969, |X-X0|:  531.306091
rounded |X_k-Y|_0 = 21050, f1 =  0.645031, approx slack: 355684
rounded before pow |X_k-Y|_0 = 54383, f1 =  0.409433

Iteration 600: Loss = 21496.603516
|Xk-Y|_F:  20968.839844, |X-X0|:  527.763550
rounded |X_k-Y|_0 = 21052, f1 =  0.644988, approx slack: 353863
rounded before pow |X_k-Y|_0 = 54358, f1 =  0.409474

Iteration 620: Loss = 21489.750000
|Xk-Y|_F:  20964.472656, |X-X0|:  525.276367
rounded |X_k-Y|_0 = 21050, f1 =  0.645044, approx slack: 351421
rounded before pow |X_k-Y|_0 = 54078, f1 =  0.410156

Iteration 640: Loss = 21484.091797
|Xk-Y|_F:  20960.121094, |X-X0|:  523.970642
rounded |X_k-Y|_0 = 21034, f1 =  0.645447, approx slack: 351413
rounded before pow |X_k-Y|_0 = 54078, f1 =  0.410156

Iteration 660: Loss = 21477.939453
|Xk-Y|_F:  20955.755859, |X-X0|:  522.183105
rounded |X_k-Y|_0 = 21021, f1 =  0.645757, approx slack: 347919
rounded before pow |X_k-Y|_0 = 53679, f1 =  0.411139

Iteration 680: Loss = 21471.396484
|Xk-Y|_F:  20951.679688, |X-X0|:  519.716431
rounded |X_k-Y|_0 = 21017, f1 =  0.645858, approx slack: 342447
rounded before pow |X_k-Y|_0 = 53127, f1 =  0.412523

Iteration 700: Loss = 21465.480469
|Xk-Y|_F:  20947.230469, |X-X0|:  518.250977
rounded |X_k-Y|_0 = 21016, f1 =  0.645883, approx slack: 342362
rounded before pow |X_k-Y|_0 = 53127, f1 =  0.412523

Iteration 720: Loss = 21459.777344
|Xk-Y|_F:  20943.167969, |X-X0|:  516.609741
rounded |X_k-Y|_0 = 21001, f1 =  0.646264, approx slack: 339969
rounded before pow |X_k-Y|_0 = 52875, f1 =  0.413164

Iteration 740: Loss = 21453.914062
|Xk-Y|_F:  20939.095703, |X-X0|:  514.819092
rounded |X_k-Y|_0 = 20993, f1 =  0.646461, approx slack: 339947
rounded before pow |X_k-Y|_0 = 52875, f1 =  0.413164

Iteration 760: Loss = 21449.681641
|Xk-Y|_F:  20934.490234, |X-X0|:  515.192322
rounded |X_k-Y|_0 = 20992, f1 =  0.646489, approx slack: 339908
rounded before pow |X_k-Y|_0 = 52875, f1 =  0.413164

Iteration 780: Loss = 21443.650391
|Xk-Y|_F:  20930.441406, |X-X0|:  513.209717
rounded |X_k-Y|_0 = 20989, f1 =  0.646562, approx slack: 339882
rounded before pow |X_k-Y|_0 = 52875, f1 =  0.413164

Iteration 800: Loss = 21437.056641
|Xk-Y|_F:  20926.539062, |X-X0|:  510.517883
rounded |X_k-Y|_0 = 20987, f1 =  0.646615, approx slack: 337514
rounded before pow |X_k-Y|_0 = 52618, f1 =  0.413824

Iteration 820: Loss = 21431.675781
|Xk-Y|_F:  20923.046875, |X-X0|:  508.628723
rounded |X_k-Y|_0 = 20982, f1 =  0.646739, approx slack: 327891
rounded before pow |X_k-Y|_0 = 52181, f1 =  0.414960

Iteration 840: Loss = 21425.902344
|Xk-Y|_F:  20919.183594, |X-X0|:  506.718384
rounded |X_k-Y|_0 = 20968, f1 =  0.647091, approx slack: 327723
rounded before pow |X_k-Y|_0 = 52147, f1 =  0.415049

Iteration 860: Loss = 21421.019531
|Xk-Y|_F:  20915.451172, |X-X0|:  505.567963
rounded |X_k-Y|_0 = 20967, f1 =  0.647119, approx slack: 326550
rounded before pow |X_k-Y|_0 = 52023, f1 =  0.415375

Iteration 880: Loss = 21416.480469
|Xk-Y|_F:  20911.972656, |X-X0|:  504.508148
rounded |X_k-Y|_0 = 20961, f1 =  0.647267, approx slack: 326552
rounded before pow |X_k-Y|_0 = 52023, f1 =  0.415375

Iteration 900: Loss = 21412.546875
|Xk-Y|_F:  20908.548828, |X-X0|:  503.997314
rounded |X_k-Y|_0 = 20963, f1 =  0.647221, approx slack: 326518
rounded before pow |X_k-Y|_0 = 52023, f1 =  0.415375

Iteration 920: Loss = 21408.085938
|Xk-Y|_F:  20905.248047, |X-X0|:  502.838074
rounded |X_k-Y|_0 = 20953, f1 =  0.647467, approx slack: 326529
rounded before pow |X_k-Y|_0 = 52023, f1 =  0.415375

Iteration 940: Loss = 21402.722656
|Xk-Y|_F:  20901.933594, |X-X0|:  500.788177
rounded |X_k-Y|_0 = 20952, f1 =  0.647494, approx slack: 325703
rounded before pow |X_k-Y|_0 = 52023, f1 =  0.415375

Iteration 960: Loss = 21398.294922
|Xk-Y|_F:  20898.974609, |X-X0|:  499.319824
rounded |X_k-Y|_0 = 20953, f1 =  0.647469, approx slack: 325101
rounded before pow |X_k-Y|_0 = 51686, f1 =  0.416177

Iteration 980: Loss = 21394.244141
|Xk-Y|_F:  20896.269531, |X-X0|:  497.975525
rounded |X_k-Y|_0 = 20948, f1 =  0.647593, approx slack: 325083
rounded before pow |X_k-Y|_0 = 51686, f1 =  0.416177

Iteration 1000: Loss = 21390.304688
|Xk-Y|_F:  20893.525391, |X-X0|:  496.779236
rounded |X_k-Y|_0 = 20944, f1 =  0.647691, approx slack: 323458
rounded before pow |X_k-Y|_0 = 51528, f1 =  0.416600

Iteration 1020: Loss = 21384.755859
|Xk-Y|_F:  20890.703125, |X-X0|:  494.052368
rounded |X_k-Y|_0 = 20939, f1 =  0.647820, approx slack: 323411
rounded before pow |X_k-Y|_0 = 51527, f1 =  0.416603

Iteration 1040: Loss = 21380.763672
|Xk-Y|_F:  20887.707031, |X-X0|:  493.056488
rounded |X_k-Y|_0 = 20931, f1 =  0.648027, approx slack: 322654
rounded before pow |X_k-Y|_0 = 51527, f1 =  0.416603

Iteration 1060: Loss = 21376.859375
|Xk-Y|_F:  20885.007812, |X-X0|:  491.851257
rounded |X_k-Y|_0 = 20925, f1 =  0.648176, approx slack: 322663
rounded before pow |X_k-Y|_0 = 51527, f1 =  0.416603

Iteration 1080: Loss = 21371.583984
|Xk-Y|_F:  20882.662109, |X-X0|:  488.921997
rounded |X_k-Y|_0 = 20919, f1 =  0.648325, approx slack: 321443
rounded before pow |X_k-Y|_0 = 51527, f1 =  0.416603

Iteration 1100: Loss = 21367.664062
|Xk-Y|_F:  20879.832031, |X-X0|:  487.831116
rounded |X_k-Y|_0 = 20921, f1 =  0.648284, approx slack: 321418
rounded before pow |X_k-Y|_0 = 51527, f1 =  0.416603

Iteration 1120: Loss = 21361.572266
|Xk-Y|_F:  20877.789062, |X-X0|:  483.782593
rounded |X_k-Y|_0 = 20920, f1 =  0.648303, approx slack: 318660
rounded before pow |X_k-Y|_0 = 51542, f1 =  0.416562

Iteration 1140: Loss = 21357.652344
|Xk-Y|_F:  20874.945312, |X-X0|:  482.706970
rounded |X_k-Y|_0 = 20917, f1 =  0.648379, approx slack: 318682
rounded before pow |X_k-Y|_0 = 51556, f1 =  0.416525

Iteration 1160: Loss = 21349.785156
|Xk-Y|_F:  20872.066406, |X-X0|:  477.717865
rounded |X_k-Y|_0 = 20918, f1 =  0.648352, approx slack: 315008
rounded before pow |X_k-Y|_0 = 51557, f1 =  0.416522

Iteration 1180: Loss = 21341.699219
|Xk-Y|_F:  20869.064453, |X-X0|:  472.635742
rounded |X_k-Y|_0 = 20921, f1 =  0.648284, approx slack: 314912
rounded before pow |X_k-Y|_0 = 51528, f1 =  0.416600

Iteration 1200: Loss = 21335.783203
|Xk-Y|_F:  20866.806641, |X-X0|:  468.976746
rounded |X_k-Y|_0 = 20922, f1 =  0.648258, approx slack: 314830
rounded before pow |X_k-Y|_0 = 51528, f1 =  0.416600

Iteration 1220: Loss = 21331.755859
|Xk-Y|_F:  20864.453125, |X-X0|:  467.302612
rounded |X_k-Y|_0 = 20914, f1 =  0.648459, approx slack: 314837
rounded before pow |X_k-Y|_0 = 51528, f1 =  0.416600

Iteration 1240: Loss = 21326.044922
|Xk-Y|_F:  20862.226562, |X-X0|:  463.818848
rounded |X_k-Y|_0 = 20908, f1 =  0.648605, approx slack: 314413
rounded before pow |X_k-Y|_0 = 51527, f1 =  0.416603

Converged at iteration 1259
------ ABL 1 after refine ------
--- eval ---
prediction result:
f1 on test:    0.3841
f1 on test:    0.6481 (micro)
f1 on KB:      0.4007
integrated f1: 0.3934, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3537
f1 on test:    0.6730 (micro)
f1 on KB:      0.6028
integrated f1: 0.4970, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3934
