MLP_eco_Sep3_1
log/EGOAL-eco-2025-09-03-15:25:59.015707.txt
random seed: 42
train shape: torch.Size([434, 1514]), test shape: torch.Size([72, 1514])
cuda availability: True
/home/u-xiangyf/anaconda3/envs/egoal/lib/python3.13/site-packages/torch/nn/modules/loss.py:608: UserWarning: Using a target size (torch.Size([1514])) that is different to the input size (torch.Size([4639, 1514])). This will likely lead to incorrect results due to broadcasting. Please ensure they have the same size.
  return F.mse_loss(input, target, reduction=self.reduction)
Epoch 0, Loss: 0.2185
Epoch 100, Loss: 0.2111
Epoch 200, Loss: 0.2038
Epoch 300, Loss: 0.1967
Epoch 400, Loss: 0.1898
Epoch 500, Loss: 0.1832
Epoch 600, Loss: 0.1767
Epoch 700, Loss: 0.1705
Epoch 800, Loss: 0.1644
Epoch 900, Loss: 0.1585
Final loss: 0.15291734039783478
Achieved outputs: tensor([[0.4401, 0.4444, 0.4231,  ..., 0.4027, 0.4258, 0.4491],
        [0.4398, 0.4441, 0.4227,  ..., 0.4024, 0.4252, 0.4488],
        [0.4400, 0.4441, 0.4227,  ..., 0.4026, 0.4255, 0.4488],
        ...,
        [0.4402, 0.4445, 0.4231,  ..., 0.4025, 0.4256, 0.4489],
        [0.4401, 0.4444, 0.4230,  ..., 0.4025, 0.4256, 0.4487],
        [0.4400, 0.4444, 0.4230,  ..., 0.4022, 0.4255, 0.4491]],
       device='cuda:0')
Eval weight w_data: 0.4246200244007528
Before pretrain: integrated f1 0.2321
Epoch 100, Total loss: 23599550.0000, CE loss: 7.3412, RL loss: 2359954.2500, Reward: -134923.4971
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 12326, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 200, Total loss: 18154622.0000, CE loss: 7.0313, RL loss: 1815461.3750, Reward: -133812.1670
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 13956, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 300, Total loss: -20835358.0000, CE loss: 6.8031, RL loss: -2083536.3750, Reward: -133174.8184
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 12180, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 400, Total loss: -1501303.5000, CE loss: 6.6660, RL loss: -150131.0156, Reward: -131524.9277
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 11553, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 500, Total loss: -13799701.0000, CE loss: 6.6020, RL loss: -1379970.7500, Reward: -130328.5967
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 9554, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
------ Before ABL ------
--- eval ---
prediction result:
f1 on test:    0.3308
f1 on test:    0.6640 (micro)
f1 on KB:      0.3370
integrated f1: 0.3343, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3606
f1 on test:    0.6734 (micro)
f1 on KB:      0.5259
integrated f1: 0.4557, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3343

Epoch 100, Total loss: 65376512.0000, CE loss: 4.5843, RL loss: 653765.1250, Reward: -94666.0996
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 8697, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 200, Total loss: -15408920.0000, CE loss: 4.5324, RL loss: -154089.2031, Reward: -94302.7051
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 9077, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 300, Total loss: -98998256.0000, CE loss: 4.4552, RL loss: -989982.5625, Reward: -93568.0234
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 7979, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 400, Total loss: 54581012.0000, CE loss: 4.3766, RL loss: 545810.1250, Reward: -92235.6738
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 7685, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 500, Total loss: 5163026.0000, CE loss: 4.2884, RL loss: 51630.2578, Reward: -91154.5176
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 9616, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 600, Total loss: 96244136.0000, CE loss: 4.1407, RL loss: 962441.3750, Reward: -87435.8662
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 7828, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 700, Total loss: 252021696.0000, CE loss: 3.9719, RL loss: 2520217.0000, Reward: -81337.7520
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 8294, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 800, Total loss: 185801904.0000, CE loss: 3.8238, RL loss: 1858019.0000, Reward: -75219.1611
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 7752, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 900, Total loss: -74265696.0000, CE loss: 3.6646, RL loss: -742656.9375, Reward: -64784.6367
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 9250, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 1000, Total loss: 105326152.0000, CE loss: 3.6189, RL loss: 1053261.5000, Reward: -58855.5205
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 7349, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 1100, Total loss: -23285164.0000, CE loss: 3.5959, RL loss: -232851.6406, Reward: -57737.4531
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 8912, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 1200, Total loss: -187183408.0000, CE loss: 3.5704, RL loss: -1871834.1250, Reward: -56878.8486
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 8622, weighted: 0.6805419921875, len: 0.0, nonzero: 0.10568031668663025
Epoch 1300, Total loss: -43843320.0000, CE loss: 3.5421, RL loss: -438433.1875, Reward: -55852.4482
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 10128, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 1400, Total loss: 71635784.0000, CE loss: 3.5458, RL loss: 716357.8750, Reward: -54855.5811
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 9017, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 1500, Total loss: 53793724.0000, CE loss: 3.5238, RL loss: 537937.2500, Reward: -54242.6748
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 6970, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 1600, Total loss: -110989312.0000, CE loss: 3.4991, RL loss: -1109893.1250, Reward: -54382.9941
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 7983, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 1700, Total loss: -81402832.0000, CE loss: 3.5068, RL loss: -814028.3125, Reward: -53916.2363
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 7387, weighted: 2.3746604919433594, len: 0.0, nonzero: 0.10501981526613235
Epoch 1800, Total loss: 123023216.0000, CE loss: 3.5007, RL loss: 1230232.1250, Reward: -53208.5977
    full cols: 161, non-full cols: 0
   r - labels: 0, labels - r: 0
    violated: 8523, weighted: 0.0, len: 0.0, nonzero: 0.10634082555770874
Epoch 1900, Total loss: 7079090.0000, CE loss: 3.4907, RL loss: 70790.8984, Reward: -53408.3574
    full cols: 160, non-full cols: 1
   r - labels: 0, labels - r: 0
    violated: 7965, weighted: 1.5352948904037476, len: 0.0, nonzero: 0.10574224591255188
--- eval ---
prediction result:
f1 on test:    0.3598
f1 on test:    0.6627 (micro)
f1 on KB:      0.3605
integrated f1: 0.3603, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3608
f1 on test:    0.6733 (micro)
f1 on KB:      0.5252
integrated f1: 0.4759, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: 135064272.0000, CE loss: 3.4805, RL loss: 1350642.7500, Reward: -52830.8926
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 8934, weighted: 1.6941184997558594, len: 0.0, nonzero: 0.10568031668663025
Epoch 2100, Total loss: -29109862.0000, CE loss: 3.4719, RL loss: -291098.6250, Reward: -53045.4365
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 7130, weighted: 1.6941184997558594, len: 0.0, nonzero: 0.10568031668663025
Epoch 2200, Total loss: -27112196.0000, CE loss: 3.4656, RL loss: -271121.9688, Reward: -52919.6748
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 8406, weighted: 1.6941184997558594, len: 0.0, nonzero: 0.10568031668663025
Epoch 2300, Total loss: 68413040.0000, CE loss: 3.4576, RL loss: 684130.3750, Reward: -52500.3652
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 9306, weighted: 1.6941184997558594, len: 0.0, nonzero: 0.10568031668663025
Epoch 2400, Total loss: -55518312.0000, CE loss: 3.4447, RL loss: -555183.1250, Reward: -52684.9463
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 8985, weighted: 1.6941184997558594, len: 0.0, nonzero: 0.10568031668663025
Epoch 2500, Total loss: 55380444.0000, CE loss: 3.4424, RL loss: 553804.4375, Reward: -52279.2100
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 8040, weighted: 1.6941184997558594, len: 0.0, nonzero: 0.10568031668663025
Epoch 2600, Total loss: -30754362.0000, CE loss: 3.4235, RL loss: -307543.6250, Reward: -52391.8555
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 8654, weighted: 1.6941184997558594, len: 0.0, nonzero: 0.10568031668663025
Epoch 2700, Total loss: 74724584.0000, CE loss: 3.4216, RL loss: 747245.8750, Reward: -52080.4961
    full cols: 160, non-full cols: 1
   r - labels: 0, labels - r: 0
    violated: 9211, weighted: 1.1382358074188232, len: 0.0, nonzero: 0.10589704662561417
Epoch 2800, Total loss: 25354270.0000, CE loss: 3.4090, RL loss: 253542.7031, Reward: -52161.3311
    full cols: 160, non-full cols: 0
   r - labels: 0, labels - r: 1
    violated: 8307, weighted: 0.9701347351074219, len: 0.0, nonzero: 0.10568031668663025
Epoch 2900, Total loss: 11175795.0000, CE loss: 3.4011, RL loss: 111757.9453, Reward: -52278.4551
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 9044, weighted: 2.6642532348632812, len: 0.0, nonzero: 0.10501981526613235
Epoch 3000, Total loss: -39259284.0000, CE loss: 3.3888, RL loss: -392592.8438, Reward: -52334.5713
    full cols: 158, non-full cols: 1
   r - labels: 0, labels - r: 2
    violated: 8884, weighted: 3.3348422050476074, len: 0.0, nonzero: 0.10448315739631653
Epoch 3100, Total loss: -129378400.0000, CE loss: 3.3837, RL loss: -1293784.0000, Reward: -52658.3447
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 7741, weighted: 2.6642532348632812, len: 0.0, nonzero: 0.10501981526613235
Epoch 3200, Total loss: 57435508.0000, CE loss: 3.3750, RL loss: 574355.0625, Reward: -52033.5322
    full cols: 158, non-full cols: 1
   r - labels: 0, labels - r: 2
    violated: 6723, weighted: 3.2597274780273438, len: 0.0, nonzero: 0.10444188117980957
Epoch 3300, Total loss: -45768380.0000, CE loss: 3.3594, RL loss: -457683.8125, Reward: -52297.2891
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 9828, weighted: 2.3746604919433594, len: 0.0, nonzero: 0.10501981526613235
Epoch 3400, Total loss: -13880419.0000, CE loss: 3.3573, RL loss: -138804.1875, Reward: -52337.9521
    full cols: 161, non-full cols: 0
   r - labels: 1, labels - r: 1
    violated: 8424, weighted: 4.343893051147461, len: 0.0, nonzero: 0.10634082555770874
Epoch 3500, Total loss: -95492160.0000, CE loss: 3.3478, RL loss: -954921.6250, Reward: -52643.2266
    full cols: 160, non-full cols: 0
   r - labels: 1, labels - r: 2
    violated: 7747, weighted: 5.314027786254883, len: 0.0, nonzero: 0.10568031668663025
Epoch 3600, Total loss: 721231.5625, CE loss: 3.3436, RL loss: 7212.3154, Reward: -52323.0186
    full cols: 161, non-full cols: 0
   r - labels: 2, labels - r: 2
    violated: 6887, weighted: 6.660634994506836, len: 0.0, nonzero: 0.10634082555770874
Epoch 3700, Total loss: -91667016.0000, CE loss: 3.3285, RL loss: -916670.1250, Reward: -52621.0859
    full cols: 161, non-full cols: 1
   r - labels: 3, labels - r: 2
    violated: 9807, weighted: 8.603395462036133, len: 0.0, nonzero: 0.10664011538028717
Epoch 3800, Total loss: -45766656.0000, CE loss: 3.3167, RL loss: -457666.5625, Reward: -52601.3398
    full cols: 160, non-full cols: 0
   r - labels: 1, labels - r: 2
    violated: 7576, weighted: 4.010860443115234, len: 0.0, nonzero: 0.10568031668663025
Epoch 3900, Total loss: 45406492.0000, CE loss: 3.3077, RL loss: 454064.9062, Reward: -52434.3418
    full cols: 161, non-full cols: 0
   r - labels: 2, labels - r: 2
    violated: 9083, weighted: 5.502262115478516, len: 0.0, nonzero: 0.10634082555770874
--- eval ---
prediction result:
f1 on test:    0.3858
f1 on test:    0.6571 (micro)
f1 on KB:      0.3709
integrated f1: 0.3752, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3617
f1 on test:    0.6729 (micro)
f1 on KB:      0.5234
integrated f1: 0.4749, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: 78749136.0000, CE loss: 3.2953, RL loss: 787491.3750, Reward: -52443.3174
    full cols: 161, non-full cols: 0
   r - labels: 3, labels - r: 3
    violated: 9632, weighted: 38.327598571777344, len: 0.0, nonzero: 0.10634082555770874
Epoch 4100, Total loss: 153930352.0000, CE loss: 3.2842, RL loss: 1539303.5000, Reward: -52319.7119
    full cols: 160, non-full cols: 1
   r - labels: 3, labels - r: 3
    violated: 7233, weighted: 36.999324798583984, len: 0.0, nonzero: 0.10575256496667862
Epoch 4200, Total loss: -8225869.0000, CE loss: 3.2605, RL loss: -82258.6875, Reward: -52678.4434
    full cols: 160, non-full cols: 0
   r - labels: 2, labels - r: 3
    violated: 8505, weighted: 36.980995178222656, len: 0.0, nonzero: 0.10568031668663025
Epoch 4300, Total loss: 20196686.0000, CE loss: 3.2628, RL loss: 201966.8594, Reward: -52606.6504
    full cols: 160, non-full cols: 0
   r - labels: 2, labels - r: 3
    violated: 11116, weighted: 36.980995178222656, len: 0.0, nonzero: 0.10568031668663025
Epoch 4400, Total loss: 95199848.0000, CE loss: 3.2529, RL loss: 951998.5000, Reward: -52379.5723
    full cols: 161, non-full cols: 0
   r - labels: 2, labels - r: 2
    violated: 9224, weighted: 41.223533630371094, len: 0.0, nonzero: 0.10634082555770874
Epoch 4500, Total loss: 107591960.0000, CE loss: 3.2367, RL loss: 1075919.6250, Reward: -52378.9971
    full cols: 161, non-full cols: 0
   r - labels: 3, labels - r: 3
    violated: 10155, weighted: 43.54027557373047, len: 0.0, nonzero: 0.10634082555770874
Epoch 4600, Total loss: -21943934.0000, CE loss: 3.2297, RL loss: -219439.3438, Reward: -52690.9590
    full cols: 159, non-full cols: 1
   r - labels: 2, labels - r: 3
    violated: 8466, weighted: 37.06085968017578, len: 0.0, nonzero: 0.10517462342977524
Epoch 4700, Total loss: 100610976.0000, CE loss: 3.2185, RL loss: 1006109.7500, Reward: -52466.9219
    full cols: 161, non-full cols: 0
   r - labels: 3, labels - r: 3
    violated: 9310, weighted: 43.54027557373047, len: 0.0, nonzero: 0.10634082555770874
Epoch 4800, Total loss: -100455728.0000, CE loss: 3.2043, RL loss: -1004557.3125, Reward: -53065.6602
    full cols: 159, non-full cols: 0
   r - labels: 1, labels - r: 3
    violated: 7875, weighted: 4.836200714111328, len: 0.0, nonzero: 0.10501981526613235
Epoch 4900, Total loss: -59762812.0000, CE loss: 3.1968, RL loss: -597628.1250, Reward: -52895.7100
    full cols: 161, non-full cols: 0
   r - labels: 3, labels - r: 3
    violated: 8621, weighted: 43.54027557373047, len: 0.0, nonzero: 0.10634082555770874
Epoch 5000, Total loss: 65335124.0000, CE loss: 3.1853, RL loss: 653351.2500, Reward: -52706.9199
    full cols: 159, non-full cols: 0
   r - labels: 0, labels - r: 2
    violated: 9172, weighted: 1.7954750061035156, len: 0.0, nonzero: 0.10501981526613235
Epoch 5100, Total loss: -22621490.0000, CE loss: 3.1696, RL loss: -226214.9062, Reward: -52940.3867
    full cols: 159, non-full cols: 2
   r - labels: 1, labels - r: 1
    violated: 8315, weighted: 7.646378517150879, len: 0.0, nonzero: 0.10560807585716248
Epoch 5200, Total loss: 29547866.0000, CE loss: 3.1637, RL loss: 295478.6562, Reward: -52865.2070
    full cols: 160, non-full cols: 1
   r - labels: 2, labels - r: 2
    violated: 9267, weighted: 9.531900405883789, len: 0.0, nonzero: 0.10630986094474792
Epoch 5300, Total loss: 31637076.0000, CE loss: 3.1533, RL loss: 316370.7500, Reward: -52948.0762
    full cols: 161, non-full cols: 0
   r - labels: 2, labels - r: 2
    violated: 7542, weighted: 8.253393173217773, len: 0.0, nonzero: 0.10634082555770874
Epoch 5400, Total loss: -84648360.0000, CE loss: 3.1451, RL loss: -846483.6250, Reward: -53221.4619
    full cols: 160, non-full cols: 1
   r - labels: 1, labels - r: 1
    violated: 11442, weighted: 3.0518107414245605, len: 0.0, nonzero: 0.10575256496667862
Epoch 5500, Total loss: 52355724.0000, CE loss: 3.1368, RL loss: 523557.2500, Reward: -52869.1973
    full cols: 162, non-full cols: 1
   r - labels: 3, labels - r: 1
    violated: 9179, weighted: 56.816741943359375, len: 0.0, nonzero: 0.10746573656797409
Epoch 5600, Total loss: -12546848.0000, CE loss: 3.1324, RL loss: -125468.4844, Reward: -53051.8271
    full cols: 161, non-full cols: 2
   r - labels: 4, labels - r: 2
    violated: 7324, weighted: 71.51084899902344, len: 0.0, nonzero: 0.10707356780767441
Epoch 5700, Total loss: 84154128.0000, CE loss: 3.1262, RL loss: 841541.3125, Reward: -52794.8516
    full cols: 161, non-full cols: 3
   r - labels: 5, labels - r: 2
    violated: 9337, weighted: 39.154293060302734, len: 0.0, nonzero: 0.10723869502544403
Epoch 5800, Total loss: -75186704.0000, CE loss: 3.1228, RL loss: -751867.0000, Reward: -53229.9297
    full cols: 160, non-full cols: 2
   r - labels: 3, labels - r: 2
    violated: 8820, weighted: 5.182801723480225, len: 0.0, nonzero: 0.10588672757148743
Epoch 5900, Total loss: -136484048.0000, CE loss: 3.1204, RL loss: -1364840.5000, Reward: -53383.1494
    full cols: 161, non-full cols: 1
   r - labels: 2, labels - r: 1
    violated: 7258, weighted: 5.564026355743408, len: 0.0, nonzero: 0.10666075348854065
--- eval ---
prediction result:
f1 on test:    0.3878
f1 on test:    0.6461 (micro)
f1 on KB:      0.3711
integrated f1: 0.3758, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3624
f1 on test:    0.6730 (micro)
f1 on KB:      0.5234
integrated f1: 0.4751, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: 112794240.0000, CE loss: 3.1162, RL loss: 1127942.3750, Reward: -52734.5879
    full cols: 160, non-full cols: 1
   r - labels: 3, labels - r: 3
    violated: 7652, weighted: 37.04570007324219, len: 0.0, nonzero: 0.10570096224546432
Epoch 6100, Total loss: 1518478.2500, CE loss: 3.1131, RL loss: 15184.7822, Reward: -53071.6084
    full cols: 159, non-full cols: 1
   r - labels: 1, labels - r: 2
    violated: 9479, weighted: 4.821038246154785, len: 0.0, nonzero: 0.10503014177083969
Epoch 6200, Total loss: -18531846.0000, CE loss: 3.1104, RL loss: -185318.4531, Reward: -53151.8691
    full cols: 161, non-full cols: 1
   r - labels: 3, labels - r: 2
    violated: 7914, weighted: 15.74411392211914, len: 0.0, nonzero: 0.1069910004734993
Epoch 6300, Total loss: -19742292.0000, CE loss: 3.1063, RL loss: -197422.9219, Reward: -53188.3232
    full cols: 161, non-full cols: 0
   r - labels: 2, labels - r: 2
    violated: 7041, weighted: 9.846153259277344, len: 0.0, nonzero: 0.10634082555770874
Epoch 6400, Total loss: 50593944.0000, CE loss: 3.1055, RL loss: 505939.4375, Reward: -52976.3848
    full cols: 160, non-full cols: 0
   r - labels: 2, labels - r: 3
    violated: 7182, weighted: 9.223531723022461, len: 0.0, nonzero: 0.10568031668663025
Epoch 6500, Total loss: 25830832.0000, CE loss: 3.1036, RL loss: 258308.3125, Reward: -53042.7793
    full cols: 161, non-full cols: 1
   r - labels: 4, labels - r: 3
    violated: 9131, weighted: 41.386653900146484, len: 0.0, nonzero: 0.10641306638717651
Epoch 6600, Total loss: 10263180.0000, CE loss: 3.1028, RL loss: 102631.7969, Reward: -53029.0107
    full cols: 161, non-full cols: 1
   r - labels: 4, labels - r: 3
    violated: 9276, weighted: 15.155430793762207, len: 0.0, nonzero: 0.10664011538028717
Epoch 6700, Total loss: 7039728.0000, CE loss: 3.1019, RL loss: 70397.2812, Reward: -53080.1416
    full cols: 161, non-full cols: 1
   r - labels: 4, labels - r: 3
    violated: 6995, weighted: 15.194345474243164, len: 0.0, nonzero: 0.10637178272008896
Epoch 6800, Total loss: 54480168.0000, CE loss: 3.1021, RL loss: 544801.6875, Reward: -52901.0986
    full cols: 162, non-full cols: 0
   r - labels: 5, labels - r: 4
    violated: 8861, weighted: 27.844341278076172, len: 0.0, nonzero: 0.10700132697820663
Epoch 6900, Total loss: 54662464.0000, CE loss: 3.0973, RL loss: 546624.6250, Reward: -52954.1152
    full cols: 162, non-full cols: 3
   r - labels: 7, labels - r: 3
    violated: 7818, weighted: 43.979637145996094, len: 0.0, nonzero: 0.10781662911176682
Epoch 7000, Total loss: 64616780.0000, CE loss: 3.0986, RL loss: 646167.8125, Reward: -52913.6924
    full cols: 163, non-full cols: 2
   r - labels: 7, labels - r: 3
    violated: 7530, weighted: 80.81787109375, len: 0.0, nonzero: 0.1081055998802185
Epoch 7100, Total loss: -22868496.0000, CE loss: 3.0996, RL loss: -228684.9688, Reward: -53089.5459
    full cols: 165, non-full cols: 0
   r - labels: 7, labels - r: 3
    violated: 6877, weighted: 90.15022277832031, len: 0.0, nonzero: 0.10898283123970032
Epoch 7200, Total loss: 42725224.0000, CE loss: 3.1003, RL loss: 427252.2500, Reward: -52818.2031
    full cols: 163, non-full cols: 2
   r - labels: 7, labels - r: 3
    violated: 8011, weighted: 59.595245361328125, len: 0.0, nonzero: 0.10831201076507568
Epoch 7300, Total loss: -26154836.0000, CE loss: 3.0982, RL loss: -261548.3594, Reward: -53069.4902
    full cols: 161, non-full cols: 2
   r - labels: 6, labels - r: 4
    violated: 9435, weighted: 59.86334228515625, len: 0.0, nonzero: 0.10650594532489777
Epoch 7400, Total loss: -28540328.0000, CE loss: 3.0961, RL loss: -285403.2812, Reward: -53047.9648
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 7489, weighted: 77.11854553222656, len: 0.0, nonzero: 0.10832232981920242
Epoch 7500, Total loss: -10917930.0000, CE loss: 3.0972, RL loss: -109179.2969, Reward: -52988.1406
    full cols: 165, non-full cols: 1
   r - labels: 7, labels - r: 2
    violated: 8824, weighted: 66.49502563476562, len: 0.0, nonzero: 0.10941628366708755
Epoch 7600, Total loss: -38368132.0000, CE loss: 3.0953, RL loss: -383681.3125, Reward: -53058.1836
    full cols: 166, non-full cols: 0
   r - labels: 7, labels - r: 2
    violated: 8802, weighted: 77.49502563476562, len: 0.0, nonzero: 0.10964333266019821
Epoch 7700, Total loss: -58652544.0000, CE loss: 3.0953, RL loss: -586525.4375, Reward: -53131.1992
    full cols: 166, non-full cols: 0
   r - labels: 7, labels - r: 2
    violated: 8328, weighted: 77.49502563476562, len: 0.0, nonzero: 0.10964333266019821
Epoch 7800, Total loss: 81592960.0000, CE loss: 3.0957, RL loss: 815929.5625, Reward: -52628.1719
    full cols: 164, non-full cols: 0
   r - labels: 8, labels - r: 5
    violated: 8812, weighted: 93.48052978515625, len: 0.0, nonzero: 0.10832232981920242
Epoch 7900, Total loss: 39996832.0000, CE loss: 3.0957, RL loss: 399968.3125, Reward: -52750.6055
    full cols: 163, non-full cols: 0
   r - labels: 7, labels - r: 5
    violated: 7581, weighted: 90.83076477050781, len: 0.0, nonzero: 0.10766182839870453
--- eval ---
prediction result:
f1 on test:    0.3871
f1 on test:    0.6447 (micro)
f1 on KB:      0.3707
integrated f1: 0.3754, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3624
f1 on test:    0.6736 (micro)
f1 on KB:      0.5249
integrated f1: 0.4762, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: 105197672.0000, CE loss: 3.0948, RL loss: 1051976.7500, Reward: -52568.2852
    full cols: 165, non-full cols: 0
   r - labels: 8, labels - r: 4
    violated: 7958, weighted: 110.85609436035156, len: 0.0, nonzero: 0.10898283123970032
------ ABL Loop 0 ------
--- eval ---
prediction result:
f1 on test:    0.3871
f1 on test:    0.6447 (micro)
f1 on KB:      0.3707
integrated f1: 0.3774, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3624
f1 on test:    0.6736 (micro)
f1 on KB:      0.5249
integrated f1: 0.4559, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3774
Iteration 0: Loss = 128575.625000
|Xk-Y|_F:  128575.625000, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 113039, f1 =  0.314651, approx slack: 1004
rounded before pow |X_k-Y|_0 = 113039, f1 =  0.314651

Iteration 20: Loss = 128096.359375
|Xk-Y|_F:  127150.984375, |X-X0|:  945.374084
rounded |X_k-Y|_0 = 112647, f1 =  0.317179, approx slack: 249
rounded before pow |X_k-Y|_0 = 112682, f1 =  0.316954

Iteration 40: Loss = 126319.265625
|Xk-Y|_F:  126080.453125, |X-X0|:  238.809601
rounded |X_k-Y|_0 = 112641, f1 =  0.317217, approx slack: 217
rounded before pow |X_k-Y|_0 = 112649, f1 =  0.317166

Iteration 60: Loss = 124994.890625
|Xk-Y|_F:  124876.351562, |X-X0|:  118.542366
rounded |X_k-Y|_0 = 112648, f1 =  0.317172, approx slack: 141
rounded before pow |X_k-Y|_0 = 112651, f1 =  0.317153

Iteration 80: Loss = 123587.429688
|Xk-Y|_F:  123483.304688, |X-X0|:  104.123840
rounded |X_k-Y|_0 = 112649, f1 =  0.317166, approx slack: 146
rounded before pow |X_k-Y|_0 = 112653, f1 =  0.317140

Iteration 100: Loss = 121993.343750
|Xk-Y|_F:  121888.265625, |X-X0|:  105.076057
rounded |X_k-Y|_0 = 112599, f1 =  0.317293, approx slack: 303
rounded before pow |X_k-Y|_0 = 112518, f1 =  0.318007

Iteration 120: Loss = 120173.671875
|Xk-Y|_F:  120066.820312, |X-X0|:  106.849632
rounded |X_k-Y|_0 = 102860, f1 =  0.324373, approx slack: 12567
rounded before pow |X_k-Y|_0 = 112518, f1 =  0.318007

Iteration 140: Loss = 118078.742188
|Xk-Y|_F:  117969.546875, |X-X0|:  109.193481
rounded |X_k-Y|_0 = 102856, f1 =  0.324382, approx slack: 24016
rounded before pow |X_k-Y|_0 = 112518, f1 =  0.318007

Iteration 160: Loss = 115640.765625
|Xk-Y|_F:  115532.007812, |X-X0|:  108.754761
rounded |X_k-Y|_0 = 102861, f1 =  0.324347, approx slack: 25229
rounded before pow |X_k-Y|_0 = 112518, f1 =  0.318007

Iteration 180: Loss = 112770.476562
|Xk-Y|_F:  112662.351562, |X-X0|:  108.124939
rounded |X_k-Y|_0 = 101985, f1 =  0.324913, approx slack: 27619
rounded before pow |X_k-Y|_0 = 112515, f1 =  0.318026

Iteration 200: Loss = 109357.898438
|Xk-Y|_F:  109249.414062, |X-X0|:  108.485352
rounded |X_k-Y|_0 = 97348, f1 =  0.328486, approx slack: 34326
rounded before pow |X_k-Y|_0 = 112927, f1 =  0.317995

Iteration 220: Loss = 105270.882812
|Xk-Y|_F:  105159.117188, |X-X0|:  111.765305
rounded |X_k-Y|_0 = 95177, f1 =  0.330235, approx slack: 41340
rounded before pow |X_k-Y|_0 = 112927, f1 =  0.317995

Iteration 240: Loss = 100314.328125
|Xk-Y|_F:  100201.734375, |X-X0|:  112.589981
rounded |X_k-Y|_0 = 91604, f1 =  0.333053, approx slack: 50117
rounded before pow |X_k-Y|_0 = 113281, f1 =  0.317880

Iteration 260: Loss = 94199.679688
|Xk-Y|_F:  94082.343750, |X-X0|:  117.334343
rounded |X_k-Y|_0 = 86654, f1 =  0.337169, approx slack: 60882
rounded before pow |X_k-Y|_0 = 113510, f1 =  0.317847

Iteration 280: Loss = 86626.023438
|Xk-Y|_F:  86501.492188, |X-X0|:  124.527496
rounded |X_k-Y|_0 = 80447, f1 =  0.342556, approx slack: 81676
rounded before pow |X_k-Y|_0 = 115875, f1 =  0.317098

Iteration 300: Loss = 77601.046875
|Xk-Y|_F:  77471.335938, |X-X0|:  129.709747
rounded |X_k-Y|_0 = 73136, f1 =  0.349670, approx slack: 101549
rounded before pow |X_k-Y|_0 = 116437, f1 =  0.317130

Iteration 320: Loss = 67736.429688
|Xk-Y|_F:  67601.843750, |X-X0|:  134.583694
rounded |X_k-Y|_0 = 63887, f1 =  0.359928, approx slack: 121473
rounded before pow |X_k-Y|_0 = 116437, f1 =  0.317130

Iteration 340: Loss = 57973.714844
|Xk-Y|_F:  57830.070312, |X-X0|:  143.644653
rounded |X_k-Y|_0 = 54166, f1 =  0.372336, approx slack: 145667
rounded before pow |X_k-Y|_0 = 116666, f1 =  0.317092

Iteration 360: Loss = 49133.585938
|Xk-Y|_F:  48976.277344, |X-X0|:  157.306824
rounded |X_k-Y|_0 = 45468, f1 =  0.386266, approx slack: 170693
rounded before pow |X_k-Y|_0 = 116912, f1 =  0.317380

Iteration 380: Loss = 41960.878906
|Xk-Y|_F:  41787.964844, |X-X0|:  172.913696
rounded |X_k-Y|_0 = 38546, f1 =  0.402314, approx slack: 222048
rounded before pow |X_k-Y|_0 = 128218, f1 =  0.310519

Iteration 400: Loss = 36838.500000
|Xk-Y|_F:  36644.226562, |X-X0|:  194.272018
rounded |X_k-Y|_0 = 33363, f1 =  0.420763, approx slack: 338158
rounded before pow |X_k-Y|_0 = 166408, f1 =  0.287210

Iteration 420: Loss = 33538.628906
|Xk-Y|_F:  33313.996094, |X-X0|:  224.632141
rounded |X_k-Y|_0 = 30330, f1 =  0.438239, approx slack: 365235
rounded before pow |X_k-Y|_0 = 169197, f1 =  0.286050

Iteration 440: Loss = 31466.142578
|Xk-Y|_F:  31205.009766, |X-X0|:  261.133118
rounded |X_k-Y|_0 = 28800, f1 =  0.453284, approx slack: 392154
rounded before pow |X_k-Y|_0 = 174779, f1 =  0.283252

Iteration 460: Loss = 30121.667969
|Xk-Y|_F:  29812.978516, |X-X0|:  308.689880
rounded |X_k-Y|_0 = 28032, f1 =  0.468138, approx slack: 420586
rounded before pow |X_k-Y|_0 = 182875, f1 =  0.278677

Iteration 480: Loss = 29100.484375
|Xk-Y|_F:  28691.498047, |X-X0|:  408.986786
rounded |X_k-Y|_0 = 27354, f1 =  0.490901, approx slack: 454463
rounded before pow |X_k-Y|_0 = 193647, f1 =  0.273554

Iteration 500: Loss = 28170.494141
|Xk-Y|_F:  27709.878906, |X-X0|:  460.614471
rounded |X_k-Y|_0 = 26420, f1 =  0.530954, approx slack: 457097
rounded before pow |X_k-Y|_0 = 193778, f1 =  0.273586

Iteration 520: Loss = 27658.046875
|Xk-Y|_F:  27206.498047, |X-X0|:  451.549255
rounded |X_k-Y|_0 = 25945, f1 =  0.549409, approx slack: 439112
rounded before pow |X_k-Y|_0 = 186322, f1 =  0.278591

Iteration 540: Loss = 27312.146484
|Xk-Y|_F:  26865.449219, |X-X0|:  446.697632
rounded |X_k-Y|_0 = 25815, f1 =  0.554301, approx slack: 434823
rounded before pow |X_k-Y|_0 = 184157, f1 =  0.280043

Iteration 560: Loss = 27056.300781
|Xk-Y|_F:  26612.050781, |X-X0|:  444.249023
rounded |X_k-Y|_0 = 25638, f1 =  0.559975, approx slack: 424010
rounded before pow |X_k-Y|_0 = 179546, f1 =  0.283140

Iteration 580: Loss = 26869.978516
|Xk-Y|_F:  26425.281250, |X-X0|:  444.696655
rounded |X_k-Y|_0 = 25615, f1 =  0.560428, approx slack: 424802
rounded before pow |X_k-Y|_0 = 179366, f1 =  0.283263

Iteration 600: Loss = 26733.664062
|Xk-Y|_F:  26289.636719, |X-X0|:  444.027039
rounded |X_k-Y|_0 = 25590, f1 =  0.561157, approx slack: 422830
rounded before pow |X_k-Y|_0 = 178288, f1 =  0.283987

Iteration 620: Loss = 26627.371094
|Xk-Y|_F:  26183.705078, |X-X0|:  443.666870
rounded |X_k-Y|_0 = 25583, f1 =  0.561118, approx slack: 423497
rounded before pow |X_k-Y|_0 = 178288, f1 =  0.283987

Iteration 640: Loss = 26542.919922
|Xk-Y|_F:  26102.628906, |X-X0|:  440.291626
rounded |X_k-Y|_0 = 25588, f1 =  0.560928, approx slack: 418633
rounded before pow |X_k-Y|_0 = 176125, f1 =  0.285440

Iteration 660: Loss = 26473.449219
|Xk-Y|_F:  26033.642578, |X-X0|:  439.806824
rounded |X_k-Y|_0 = 25588, f1 =  0.560940, approx slack: 418982
rounded before pow |X_k-Y|_0 = 176125, f1 =  0.285440

Iteration 680: Loss = 26414.107422
|Xk-Y|_F:  25975.871094, |X-X0|:  438.235718
rounded |X_k-Y|_0 = 25564, f1 =  0.561462, approx slack: 414124
rounded before pow |X_k-Y|_0 = 174216, f1 =  0.286724

Iteration 700: Loss = 26361.664062
|Xk-Y|_F:  25926.031250, |X-X0|:  435.633545
rounded |X_k-Y|_0 = 25565, f1 =  0.561404, approx slack: 408987
rounded before pow |X_k-Y|_0 = 172058, f1 =  0.288177

Iteration 720: Loss = 26317.691406
|Xk-Y|_F:  25880.833984, |X-X0|:  436.857941
rounded |X_k-Y|_0 = 25564, f1 =  0.561448, approx slack: 409313
rounded before pow |X_k-Y|_0 = 172058, f1 =  0.288177

Iteration 740: Loss = 26276.613281
|Xk-Y|_F:  25839.841797, |X-X0|:  436.772461
rounded |X_k-Y|_0 = 25569, f1 =  0.561233, approx slack: 409575
rounded before pow |X_k-Y|_0 = 172058, f1 =  0.288177

Iteration 760: Loss = 26238.652344
|Xk-Y|_F:  25801.234375, |X-X0|:  437.417175
rounded |X_k-Y|_0 = 25567, f1 =  0.561339, approx slack: 407577
rounded before pow |X_k-Y|_0 = 171214, f1 =  0.288744

Iteration 780: Loss = 26203.457031
|Xk-Y|_F:  25765.833984, |X-X0|:  437.622375
rounded |X_k-Y|_0 = 25563, f1 =  0.561447, approx slack: 406957
rounded before pow |X_k-Y|_0 = 170963, f1 =  0.288913

Iteration 800: Loss = 26170.451172
|Xk-Y|_F:  25732.445312, |X-X0|:  438.005798
rounded |X_k-Y|_0 = 25555, f1 =  0.561609, approx slack: 404462
rounded before pow |X_k-Y|_0 = 169883, f1 =  0.289641

Iteration 820: Loss = 26139.923828
|Xk-Y|_F:  25700.744141, |X-X0|:  439.179596
rounded |X_k-Y|_0 = 25546, f1 =  0.561873, approx slack: 404639
rounded before pow |X_k-Y|_0 = 169883, f1 =  0.289641

Iteration 840: Loss = 26111.347656
|Xk-Y|_F:  25670.517578, |X-X0|:  440.830994
rounded |X_k-Y|_0 = 25544, f1 =  0.561958, approx slack: 404811
rounded before pow |X_k-Y|_0 = 169883, f1 =  0.289641

Iteration 860: Loss = 26084.070312
|Xk-Y|_F:  25641.378906, |X-X0|:  442.691589
rounded |X_k-Y|_0 = 25542, f1 =  0.562038, approx slack: 404920
rounded before pow |X_k-Y|_0 = 169883, f1 =  0.289641

Iteration 880: Loss = 26058.035156
|Xk-Y|_F:  25612.716797, |X-X0|:  445.318909
rounded |X_k-Y|_0 = 25538, f1 =  0.562129, approx slack: 405234
rounded before pow |X_k-Y|_0 = 170001, f1 =  0.289561

Iteration 900: Loss = 26031.943359
|Xk-Y|_F:  25585.388672, |X-X0|:  446.554291
rounded |X_k-Y|_0 = 25531, f1 =  0.562379, approx slack: 405303
rounded before pow |X_k-Y|_0 = 170001, f1 =  0.289561

Iteration 920: Loss = 26006.636719
|Xk-Y|_F:  25557.400391, |X-X0|:  449.237183
rounded |X_k-Y|_0 = 25519, f1 =  0.562726, approx slack: 404381
rounded before pow |X_k-Y|_0 = 169875, f1 =  0.289646

Iteration 940: Loss = 25983.193359
|Xk-Y|_F:  25530.457031, |X-X0|:  452.735779
rounded |X_k-Y|_0 = 25512, f1 =  0.562924, approx slack: 404432
rounded before pow |X_k-Y|_0 = 169875, f1 =  0.289646

Iteration 960: Loss = 25959.216797
|Xk-Y|_F:  25503.943359, |X-X0|:  455.274048
rounded |X_k-Y|_0 = 25498, f1 =  0.563387, approx slack: 404452
rounded before pow |X_k-Y|_0 = 169875, f1 =  0.289646

Iteration 980: Loss = 25935.908203
|Xk-Y|_F:  25476.638672, |X-X0|:  459.269531
rounded |X_k-Y|_0 = 25480, f1 =  0.563958, approx slack: 404563
rounded before pow |X_k-Y|_0 = 169981, f1 =  0.289573

Iteration 1000: Loss = 25911.486328
|Xk-Y|_F:  25448.013672, |X-X0|:  463.473328
rounded |X_k-Y|_0 = 25475, f1 =  0.564164, approx slack: 404473
rounded before pow |X_k-Y|_0 = 169981, f1 =  0.289573

Iteration 1020: Loss = 25887.269531
|Xk-Y|_F:  25418.214844, |X-X0|:  469.053772
rounded |X_k-Y|_0 = 25458, f1 =  0.564855, approx slack: 416173
rounded before pow |X_k-Y|_0 = 170115, f1 =  0.289481

Iteration 1040: Loss = 25862.025391
|Xk-Y|_F:  25385.845703, |X-X0|:  476.179108
rounded |X_k-Y|_0 = 25449, f1 =  0.565164, approx slack: 416177
rounded before pow |X_k-Y|_0 = 170225, f1 =  0.289406

Iteration 1060: Loss = 25833.974609
|Xk-Y|_F:  25351.402344, |X-X0|:  482.573120
rounded |X_k-Y|_0 = 25427, f1 =  0.565851, approx slack: 439503
rounded before pow |X_k-Y|_0 = 170361, f1 =  0.289313

Iteration 1080: Loss = 25805.398438
|Xk-Y|_F:  25317.001953, |X-X0|:  488.396851
rounded |X_k-Y|_0 = 25403, f1 =  0.566611, approx slack: 439634
rounded before pow |X_k-Y|_0 = 170585, f1 =  0.289160

Iteration 1100: Loss = 25775.892578
|Xk-Y|_F:  25283.712891, |X-X0|:  492.179413
rounded |X_k-Y|_0 = 25382, f1 =  0.567369, approx slack: 439393
rounded before pow |X_k-Y|_0 = 170585, f1 =  0.289160

Iteration 1120: Loss = 25746.105469
|Xk-Y|_F:  25250.419922, |X-X0|:  495.685120
rounded |X_k-Y|_0 = 25366, f1 =  0.567972, approx slack: 439069
rounded before pow |X_k-Y|_0 = 170585, f1 =  0.289160

Iteration 1140: Loss = 25716.048828
|Xk-Y|_F:  25218.953125, |X-X0|:  497.094879
rounded |X_k-Y|_0 = 25350, f1 =  0.568590, approx slack: 443503
rounded before pow |X_k-Y|_0 = 170398, f1 =  0.289272

Iteration 1160: Loss = 25684.951172
|Xk-Y|_F:  25186.662109, |X-X0|:  498.289917
rounded |X_k-Y|_0 = 25324, f1 =  0.569536, approx slack: 446004
rounded before pow |X_k-Y|_0 = 170397, f1 =  0.289273

Iteration 1180: Loss = 25652.552734
|Xk-Y|_F:  25154.208984, |X-X0|:  498.343323
rounded |X_k-Y|_0 = 25297, f1 =  0.570672, approx slack: 446035
rounded before pow |X_k-Y|_0 = 170617, f1 =  0.289122

Iteration 1200: Loss = 25619.734375
|Xk-Y|_F:  25120.857422, |X-X0|:  498.877838
rounded |X_k-Y|_0 = 25265, f1 =  0.571946, approx slack: 458918
rounded before pow |X_k-Y|_0 = 172316, f1 =  0.287976

Iteration 1220: Loss = 25586.574219
|Xk-Y|_F:  25087.154297, |X-X0|:  499.419281
rounded |X_k-Y|_0 = 25228, f1 =  0.573356, approx slack: 460287
rounded before pow |X_k-Y|_0 = 172584, f1 =  0.287827

Iteration 1240: Loss = 25552.345703
|Xk-Y|_F:  25053.021484, |X-X0|:  499.324707
rounded |X_k-Y|_0 = 25195, f1 =  0.574656, approx slack: 459971
rounded before pow |X_k-Y|_0 = 172584, f1 =  0.287827

Iteration 1260: Loss = 25517.068359
|Xk-Y|_F:  25017.845703, |X-X0|:  499.222473
rounded |X_k-Y|_0 = 25151, f1 =  0.576348, approx slack: 459845
rounded before pow |X_k-Y|_0 = 172691, f1 =  0.287753

Iteration 1280: Loss = 25482.759766
|Xk-Y|_F:  24983.048828, |X-X0|:  499.711456
rounded |X_k-Y|_0 = 25096, f1 =  0.578489, approx slack: 459505
rounded before pow |X_k-Y|_0 = 172691, f1 =  0.287753

Iteration 1300: Loss = 25448.166016
|Xk-Y|_F:  24947.619141, |X-X0|:  500.546265
rounded |X_k-Y|_0 = 25056, f1 =  0.580042, approx slack: 458315
rounded before pow |X_k-Y|_0 = 172366, f1 =  0.287972

Iteration 1320: Loss = 25414.289062
|Xk-Y|_F:  24914.480469, |X-X0|:  499.809570
rounded |X_k-Y|_0 = 25005, f1 =  0.582061, approx slack: 458123
rounded before pow |X_k-Y|_0 = 172366, f1 =  0.287972

Iteration 1340: Loss = 25382.083984
|Xk-Y|_F:  24880.642578, |X-X0|:  501.440521
rounded |X_k-Y|_0 = 24963, f1 =  0.583695, approx slack: 458044
rounded before pow |X_k-Y|_0 = 172366, f1 =  0.287972

Iteration 1360: Loss = 25350.960938
|Xk-Y|_F:  24848.501953, |X-X0|:  502.458527
rounded |X_k-Y|_0 = 24914, f1 =  0.585462, approx slack: 453836
rounded before pow |X_k-Y|_0 = 171100, f1 =  0.288795

Iteration 1380: Loss = 25320.451172
|Xk-Y|_F:  24817.392578, |X-X0|:  503.058563
rounded |X_k-Y|_0 = 24865, f1 =  0.587284, approx slack: 453820
rounded before pow |X_k-Y|_0 = 171233, f1 =  0.288704

Iteration 1400: Loss = 25292.720703
|Xk-Y|_F:  24788.251953, |X-X0|:  504.468109
rounded |X_k-Y|_0 = 24827, f1 =  0.588681, approx slack: 453715
rounded before pow |X_k-Y|_0 = 171233, f1 =  0.288704

Iteration 1420: Loss = 25265.259766
|Xk-Y|_F:  24760.162109, |X-X0|:  505.097046
rounded |X_k-Y|_0 = 24799, f1 =  0.589700, approx slack: 453667
rounded before pow |X_k-Y|_0 = 171233, f1 =  0.288704

Iteration 1440: Loss = 25239.916016
|Xk-Y|_F:  24732.121094, |X-X0|:  507.794739
rounded |X_k-Y|_0 = 24778, f1 =  0.590474, approx slack: 453772
rounded before pow |X_k-Y|_0 = 171245, f1 =  0.288696

Iteration 1460: Loss = 25213.058594
|Xk-Y|_F:  24703.050781, |X-X0|:  510.007263
rounded |X_k-Y|_0 = 24758, f1 =  0.591150, approx slack: 453760
rounded before pow |X_k-Y|_0 = 171292, f1 =  0.288664

Iteration 1480: Loss = 25188.535156
|Xk-Y|_F:  24677.683594, |X-X0|:  510.851501
rounded |X_k-Y|_0 = 24725, f1 =  0.592399, approx slack: 453661
rounded before pow |X_k-Y|_0 = 171292, f1 =  0.288664

Iteration 1500: Loss = 25164.607422
|Xk-Y|_F:  24653.009766, |X-X0|:  511.597565
rounded |X_k-Y|_0 = 24715, f1 =  0.592774, approx slack: 453748
rounded before pow |X_k-Y|_0 = 171418, f1 =  0.288578

Iteration 1520: Loss = 25142.468750
|Xk-Y|_F:  24628.406250, |X-X0|:  514.062256
rounded |X_k-Y|_0 = 24685, f1 =  0.593827, approx slack: 461107
rounded before pow |X_k-Y|_0 = 173575, f1 =  0.287129

Iteration 1540: Loss = 25119.851562
|Xk-Y|_F:  24604.154297, |X-X0|:  515.697266
rounded |X_k-Y|_0 = 24666, f1 =  0.594559, approx slack: 460965
rounded before pow |X_k-Y|_0 = 173483, f1 =  0.287192

Iteration 1560: Loss = 25096.257812
|Xk-Y|_F:  24580.054688, |X-X0|:  516.203491
rounded |X_k-Y|_0 = 24643, f1 =  0.595371, approx slack: 458840
rounded before pow |X_k-Y|_0 = 172509, f1 =  0.287827

Iteration 1580: Loss = 25073.585938
|Xk-Y|_F:  24554.115234, |X-X0|:  519.471069
rounded |X_k-Y|_0 = 24603, f1 =  0.596777, approx slack: 458676
rounded before pow |X_k-Y|_0 = 172702, f1 =  0.287694

Iteration 1600: Loss = 25050.318359
|Xk-Y|_F:  24527.796875, |X-X0|:  522.521484
rounded |X_k-Y|_0 = 24579, f1 =  0.597603, approx slack: 458715
rounded before pow |X_k-Y|_0 = 172803, f1 =  0.287625

Iteration 1620: Loss = 25027.861328
|Xk-Y|_F:  24503.847656, |X-X0|:  524.013977
rounded |X_k-Y|_0 = 24553, f1 =  0.598491, approx slack: 449984
rounded before pow |X_k-Y|_0 = 169647, f1 =  0.289592

Iteration 1640: Loss = 25007.582031
|Xk-Y|_F:  24481.189453, |X-X0|:  526.392334
rounded |X_k-Y|_0 = 24527, f1 =  0.599448, approx slack: 458384
rounded before pow |X_k-Y|_0 = 171786, f1 =  0.288149

Iteration 1660: Loss = 24988.398438
|Xk-Y|_F:  24461.267578, |X-X0|:  527.130798
rounded |X_k-Y|_0 = 24484, f1 =  0.600982, approx slack: 458344
rounded before pow |X_k-Y|_0 = 171834, f1 =  0.288116

Iteration 1680: Loss = 24969.529297
|Xk-Y|_F:  24441.587891, |X-X0|:  527.942322
rounded |X_k-Y|_0 = 24431, f1 =  0.602745, approx slack: 458235
rounded before pow |X_k-Y|_0 = 171834, f1 =  0.288116

Iteration 1700: Loss = 24952.328125
|Xk-Y|_F:  24424.187500, |X-X0|:  528.140503
rounded |X_k-Y|_0 = 24395, f1 =  0.604022, approx slack: 431723
rounded before pow |X_k-Y|_0 = 161286, f1 =  0.295313

Iteration 1720: Loss = 24935.908203
|Xk-Y|_F:  24406.996094, |X-X0|:  528.912659
rounded |X_k-Y|_0 = 24373, f1 =  0.604768, approx slack: 431757
rounded before pow |X_k-Y|_0 = 161334, f1 =  0.295280

Iteration 1740: Loss = 24920.046875
|Xk-Y|_F:  24390.951172, |X-X0|:  529.096375
rounded |X_k-Y|_0 = 24353, f1 =  0.605478, approx slack: 431457
rounded before pow |X_k-Y|_0 = 161098, f1 =  0.295442

Iteration 1760: Loss = 24905.062500
|Xk-Y|_F:  24374.740234, |X-X0|:  530.321289
rounded |X_k-Y|_0 = 24341, f1 =  0.605899, approx slack: 431446
rounded before pow |X_k-Y|_0 = 161145, f1 =  0.295409

Iteration 1780: Loss = 24889.853516
|Xk-Y|_F:  24359.371094, |X-X0|:  530.482788
rounded |X_k-Y|_0 = 24333, f1 =  0.606178, approx slack: 431578
rounded before pow |X_k-Y|_0 = 161258, f1 =  0.295332

Iteration 1800: Loss = 24874.998047
|Xk-Y|_F:  24344.103516, |X-X0|:  530.895142
rounded |X_k-Y|_0 = 24322, f1 =  0.606550, approx slack: 431337
rounded before pow |X_k-Y|_0 = 161153, f1 =  0.295404

Iteration 1820: Loss = 24860.794922
|Xk-Y|_F:  24329.773438, |X-X0|:  531.022339
rounded |X_k-Y|_0 = 24312, f1 =  0.606887, approx slack: 431289
rounded before pow |X_k-Y|_0 = 161153, f1 =  0.295404

Iteration 1840: Loss = 24846.712891
|Xk-Y|_F:  24314.152344, |X-X0|:  532.560486
rounded |X_k-Y|_0 = 24308, f1 =  0.607060, approx slack: 457838
rounded before pow |X_k-Y|_0 = 168824, f1 =  0.290141

Iteration 1860: Loss = 24831.857422
|Xk-Y|_F:  24298.275391, |X-X0|:  533.582336
rounded |X_k-Y|_0 = 24287, f1 =  0.607784, approx slack: 457800
rounded before pow |X_k-Y|_0 = 168819, f1 =  0.290145

Iteration 1880: Loss = 24819.283203
|Xk-Y|_F:  24284.101562, |X-X0|:  535.181580
rounded |X_k-Y|_0 = 24271, f1 =  0.608327, approx slack: 457737
rounded before pow |X_k-Y|_0 = 168819, f1 =  0.290145

Iteration 1900: Loss = 24806.562500
|Xk-Y|_F:  24271.277344, |X-X0|:  535.284424
rounded |X_k-Y|_0 = 24252, f1 =  0.608923, approx slack: 457360
rounded before pow |X_k-Y|_0 = 168665, f1 =  0.290249

Iteration 1920: Loss = 24793.607422
|Xk-Y|_F:  24256.421875, |X-X0|:  537.185486
rounded |X_k-Y|_0 = 24242, f1 =  0.609269, approx slack: 458633
rounded before pow |X_k-Y|_0 = 169244, f1 =  0.289855

Iteration 1940: Loss = 24779.683594
|Xk-Y|_F:  24241.373047, |X-X0|:  538.310425
rounded |X_k-Y|_0 = 24237, f1 =  0.609454, approx slack: 458090
rounded before pow |X_k-Y|_0 = 169344, f1 =  0.289787

Iteration 1960: Loss = 24767.626953
|Xk-Y|_F:  24228.123047, |X-X0|:  539.503906
rounded |X_k-Y|_0 = 24230, f1 =  0.609719, approx slack: 458242
rounded before pow |X_k-Y|_0 = 169490, f1 =  0.289688

Iteration 1980: Loss = 24754.478516
|Xk-Y|_F:  24216.101562, |X-X0|:  538.376160
rounded |X_k-Y|_0 = 24222, f1 =  0.609991, approx slack: 461697
rounded before pow |X_k-Y|_0 = 169706, f1 =  0.289541

Iteration 2000: Loss = 24743.767578
|Xk-Y|_F:  24203.845703, |X-X0|:  539.922546
rounded |X_k-Y|_0 = 24210, f1 =  0.610374, approx slack: 456733
rounded before pow |X_k-Y|_0 = 167786, f1 =  0.290839

Iteration 2020: Loss = 24732.945312
|Xk-Y|_F:  24191.640625, |X-X0|:  541.304138
rounded |X_k-Y|_0 = 24198, f1 =  0.610811, approx slack: 456659
rounded before pow |X_k-Y|_0 = 167757, f1 =  0.290859

Iteration 2040: Loss = 24721.511719
|Xk-Y|_F:  24179.333984, |X-X0|:  542.178650
rounded |X_k-Y|_0 = 24194, f1 =  0.610946, approx slack: 458918
rounded before pow |X_k-Y|_0 = 168630, f1 =  0.290266

Iteration 2060: Loss = 24710.027344
|Xk-Y|_F:  24166.218750, |X-X0|:  543.808350
rounded |X_k-Y|_0 = 24165, f1 =  0.611859, approx slack: 458919
rounded before pow |X_k-Y|_0 = 168630, f1 =  0.290266

Iteration 2080: Loss = 24698.439453
|Xk-Y|_F:  24153.996094, |X-X0|:  544.442810
rounded |X_k-Y|_0 = 24160, f1 =  0.612047, approx slack: 458803
rounded before pow |X_k-Y|_0 = 168546, f1 =  0.290323

Iteration 2100: Loss = 24686.341797
|Xk-Y|_F:  24141.789062, |X-X0|:  544.552307
rounded |X_k-Y|_0 = 24135, f1 =  0.612803, approx slack: 458928
rounded before pow |X_k-Y|_0 = 168668, f1 =  0.290241

Iteration 2120: Loss = 24675.814453
|Xk-Y|_F:  24131.490234, |X-X0|:  544.323425
rounded |X_k-Y|_0 = 24134, f1 =  0.612779, approx slack: 458625
rounded before pow |X_k-Y|_0 = 168372, f1 =  0.290442

Iteration 2140: Loss = 24666.003906
|Xk-Y|_F:  24121.720703, |X-X0|:  544.282898
rounded |X_k-Y|_0 = 24112, f1 =  0.613477, approx slack: 460978
rounded before pow |X_k-Y|_0 = 169327, f1 =  0.289796

Iteration 2160: Loss = 24656.187500
|Xk-Y|_F:  24111.593750, |X-X0|:  544.593384
rounded |X_k-Y|_0 = 24103, f1 =  0.613819, approx slack: 460976
rounded before pow |X_k-Y|_0 = 169327, f1 =  0.289796

Iteration 2180: Loss = 24645.998047
|Xk-Y|_F:  24101.625000, |X-X0|:  544.373840
rounded |X_k-Y|_0 = 24082, f1 =  0.614489, approx slack: 460417
rounded before pow |X_k-Y|_0 = 168979, f1 =  0.290033

Iteration 2200: Loss = 24636.376953
|Xk-Y|_F:  24092.107422, |X-X0|:  544.268799
rounded |X_k-Y|_0 = 24068, f1 =  0.614917, approx slack: 462483
rounded before pow |X_k-Y|_0 = 168863, f1 =  0.290112

Iteration 2220: Loss = 24626.228516
|Xk-Y|_F:  24082.644531, |X-X0|:  543.583557
rounded |X_k-Y|_0 = 24052, f1 =  0.615388, approx slack: 462471
rounded before pow |X_k-Y|_0 = 168863, f1 =  0.290112

Iteration 2240: Loss = 24615.070312
|Xk-Y|_F:  24073.041016, |X-X0|:  542.030090
rounded |X_k-Y|_0 = 24036, f1 =  0.615890, approx slack: 461428
rounded before pow |X_k-Y|_0 = 168415, f1 =  0.290416

Iteration 2260: Loss = 24605.253906
|Xk-Y|_F:  24063.978516, |X-X0|:  541.275513
rounded |X_k-Y|_0 = 24032, f1 =  0.615997, approx slack: 460558
rounded before pow |X_k-Y|_0 = 168039, f1 =  0.290671

Iteration 2280: Loss = 24596.789062
|Xk-Y|_F:  24055.974609, |X-X0|:  540.815063
rounded |X_k-Y|_0 = 24018, f1 =  0.616422, approx slack: 435346
rounded before pow |X_k-Y|_0 = 159584, f1 =  0.296470

Iteration 2300: Loss = 24588.470703
|Xk-Y|_F:  24047.455078, |X-X0|:  541.016357
rounded |X_k-Y|_0 = 24000, f1 =  0.617016, approx slack: 437387
rounded before pow |X_k-Y|_0 = 160348, f1 =  0.295949

Iteration 2320: Loss = 24579.884766
|Xk-Y|_F:  24037.876953, |X-X0|:  542.007690
rounded |X_k-Y|_0 = 23975, f1 =  0.617793, approx slack: 437329
rounded before pow |X_k-Y|_0 = 160348, f1 =  0.295949

Iteration 2340: Loss = 24568.376953
|Xk-Y|_F:  24028.652344, |X-X0|:  539.723938
rounded |X_k-Y|_0 = 23972, f1 =  0.617897, approx slack: 436662
rounded before pow |X_k-Y|_0 = 160148, f1 =  0.296085

Iteration 2360: Loss = 24559.933594
|Xk-Y|_F:  24019.457031, |X-X0|:  540.475891
rounded |X_k-Y|_0 = 23957, f1 =  0.618343, approx slack: 436543
rounded before pow |X_k-Y|_0 = 160069, f1 =  0.296140

Iteration 2380: Loss = 24550.832031
|Xk-Y|_F:  24010.343750, |X-X0|:  540.487915
rounded |X_k-Y|_0 = 23923, f1 =  0.619384, approx slack: 436363
rounded before pow |X_k-Y|_0 = 159973, f1 =  0.296206

Iteration 2400: Loss = 24542.218750
|Xk-Y|_F:  24001.708984, |X-X0|:  540.509521
rounded |X_k-Y|_0 = 23915, f1 =  0.619664, approx slack: 436859
rounded before pow |X_k-Y|_0 = 160016, f1 =  0.296176

Iteration 2420: Loss = 24533.929688
|Xk-Y|_F:  23994.167969, |X-X0|:  539.760803
rounded |X_k-Y|_0 = 23911, f1 =  0.619766, approx slack: 436817
rounded before pow |X_k-Y|_0 = 160016, f1 =  0.296176

Iteration 2440: Loss = 24524.394531
|Xk-Y|_F:  23986.888672, |X-X0|:  537.506531
rounded |X_k-Y|_0 = 23911, f1 =  0.619797, approx slack: 436821
rounded before pow |X_k-Y|_0 = 160016, f1 =  0.296176

Iteration 2460: Loss = 24516.750000
|Xk-Y|_F:  23978.882812, |X-X0|:  537.867004
rounded |X_k-Y|_0 = 23887, f1 =  0.620540, approx slack: 436542
rounded before pow |X_k-Y|_0 = 159863, f1 =  0.296281

Iteration 2480: Loss = 24509.853516
|Xk-Y|_F:  23971.568359, |X-X0|:  538.285583
rounded |X_k-Y|_0 = 23899, f1 =  0.620190, approx slack: 436478
rounded before pow |X_k-Y|_0 = 159864, f1 =  0.296281

Iteration 2500: Loss = 24502.156250
|Xk-Y|_F:  23964.482422, |X-X0|:  537.674377
rounded |X_k-Y|_0 = 23877, f1 =  0.620859, approx slack: 436454
rounded before pow |X_k-Y|_0 = 159864, f1 =  0.296281

Iteration 2520: Loss = 24493.640625
|Xk-Y|_F:  23956.427734, |X-X0|:  537.213745
rounded |X_k-Y|_0 = 23872, f1 =  0.621003, approx slack: 436459
rounded before pow |X_k-Y|_0 = 159961, f1 =  0.296214

Iteration 2540: Loss = 24486.515625
|Xk-Y|_F:  23950.179688, |X-X0|:  536.335266
rounded |X_k-Y|_0 = 23872, f1 =  0.620985, approx slack: 435673
rounded before pow |X_k-Y|_0 = 159684, f1 =  0.296403

Iteration 2560: Loss = 24478.646484
|Xk-Y|_F:  23942.966797, |X-X0|:  535.678894
rounded |X_k-Y|_0 = 23860, f1 =  0.621363, approx slack: 435549
rounded before pow |X_k-Y|_0 = 159684, f1 =  0.296403

Iteration 2580: Loss = 24472.310547
|Xk-Y|_F:  23935.917969, |X-X0|:  536.393066
rounded |X_k-Y|_0 = 23854, f1 =  0.621543, approx slack: 435531
rounded before pow |X_k-Y|_0 = 159684, f1 =  0.296403

Iteration 2600: Loss = 24463.851562
|Xk-Y|_F:  23929.322266, |X-X0|:  534.529480
rounded |X_k-Y|_0 = 23847, f1 =  0.621747, approx slack: 434651
rounded before pow |X_k-Y|_0 = 159406, f1 =  0.296593

Iteration 2620: Loss = 24457.181641
|Xk-Y|_F:  23923.232422, |X-X0|:  533.949829
rounded |X_k-Y|_0 = 23852, f1 =  0.621620, approx slack: 434584
rounded before pow |X_k-Y|_0 = 159406, f1 =  0.296593

Iteration 2640: Loss = 24451.791016
|Xk-Y|_F:  23917.357422, |X-X0|:  534.434448
rounded |X_k-Y|_0 = 23839, f1 =  0.621985, approx slack: 434356
rounded before pow |X_k-Y|_0 = 159303, f1 =  0.296663

Iteration 2660: Loss = 24446.003906
|Xk-Y|_F:  23912.490234, |X-X0|:  533.514282
rounded |X_k-Y|_0 = 23830, f1 =  0.622248, approx slack: 434273
rounded before pow |X_k-Y|_0 = 159303, f1 =  0.296663

Iteration 2680: Loss = 24438.658203
|Xk-Y|_F:  23907.083984, |X-X0|:  531.574585
rounded |X_k-Y|_0 = 23826, f1 =  0.622356, approx slack: 433738
rounded before pow |X_k-Y|_0 = 159134, f1 =  0.296778

Iteration 2700: Loss = 24432.955078
|Xk-Y|_F:  23902.666016, |X-X0|:  530.289185
rounded |X_k-Y|_0 = 23826, f1 =  0.622351, approx slack: 433723
rounded before pow |X_k-Y|_0 = 159134, f1 =  0.296778

Iteration 2720: Loss = 24428.097656
|Xk-Y|_F:  23898.119141, |X-X0|:  529.978149
rounded |X_k-Y|_0 = 23823, f1 =  0.622457, approx slack: 431407
rounded before pow |X_k-Y|_0 = 158177, f1 =  0.297433

Iteration 2740: Loss = 24423.757812
|Xk-Y|_F:  23893.306641, |X-X0|:  530.450256
rounded |X_k-Y|_0 = 23818, f1 =  0.622612, approx slack: 431361
rounded before pow |X_k-Y|_0 = 158177, f1 =  0.297433

Iteration 2760: Loss = 24417.218750
|Xk-Y|_F:  23887.136719, |X-X0|:  530.081482
rounded |X_k-Y|_0 = 23817, f1 =  0.622619, approx slack: 431912
rounded before pow |X_k-Y|_0 = 158150, f1 =  0.297452

Iteration 2780: Loss = 24409.396484
|Xk-Y|_F:  23878.591797, |X-X0|:  530.804504
rounded |X_k-Y|_0 = 23810, f1 =  0.622815, approx slack: 439716
rounded before pow |X_k-Y|_0 = 159453, f1 =  0.296556

Iteration 2800: Loss = 24403.349609
|Xk-Y|_F:  23872.400391, |X-X0|:  530.949463
rounded |X_k-Y|_0 = 23792, f1 =  0.623344, approx slack: 439565
rounded before pow |X_k-Y|_0 = 159453, f1 =  0.296556

Iteration 2820: Loss = 24397.167969
|Xk-Y|_F:  23866.388672, |X-X0|:  530.779541
rounded |X_k-Y|_0 = 23783, f1 =  0.623649, approx slack: 439067
rounded before pow |X_k-Y|_0 = 159286, f1 =  0.296671

Iteration 2840: Loss = 24390.537109
|Xk-Y|_F:  23860.892578, |X-X0|:  529.643921
rounded |X_k-Y|_0 = 23771, f1 =  0.623959, approx slack: 439205
rounded before pow |X_k-Y|_0 = 159425, f1 =  0.296575

Iteration 2860: Loss = 24383.750000
|Xk-Y|_F:  23856.070312, |X-X0|:  527.680115
rounded |X_k-Y|_0 = 23770, f1 =  0.623976, approx slack: 439414
rounded before pow |X_k-Y|_0 = 159584, f1 =  0.296466

Iteration 2880: Loss = 24377.902344
|Xk-Y|_F:  23851.634766, |X-X0|:  526.267700
rounded |X_k-Y|_0 = 23764, f1 =  0.624141, approx slack: 430674
rounded before pow |X_k-Y|_0 = 157324, f1 =  0.298013

Iteration 2900: Loss = 24371.314453
|Xk-Y|_F:  23847.232422, |X-X0|:  524.082153
rounded |X_k-Y|_0 = 23762, f1 =  0.624182, approx slack: 430660
rounded before pow |X_k-Y|_0 = 157324, f1 =  0.298013

Iteration 2920: Loss = 24365.646484
|Xk-Y|_F:  23842.232422, |X-X0|:  523.414429
rounded |X_k-Y|_0 = 23755, f1 =  0.624388, approx slack: 430763
rounded before pow |X_k-Y|_0 = 157417, f1 =  0.297949

Iteration 2940: Loss = 24361.300781
|Xk-Y|_F:  23837.929688, |X-X0|:  523.370422
rounded |X_k-Y|_0 = 23759, f1 =  0.624299, approx slack: 429559
rounded before pow |X_k-Y|_0 = 156998, f1 =  0.298238

Iteration 2960: Loss = 24355.996094
|Xk-Y|_F:  23833.728516, |X-X0|:  522.268066
rounded |X_k-Y|_0 = 23756, f1 =  0.624382, approx slack: 429539
rounded before pow |X_k-Y|_0 = 156998, f1 =  0.298238

Iteration 2980: Loss = 24352.107422
|Xk-Y|_F:  23829.224609, |X-X0|:  522.883362
rounded |X_k-Y|_0 = 23752, f1 =  0.624482, approx slack: 429513
rounded before pow |X_k-Y|_0 = 156998, f1 =  0.298238

Iteration 3000: Loss = 24348.414062
|Xk-Y|_F:  23825.384766, |X-X0|:  523.028931
rounded |X_k-Y|_0 = 23755, f1 =  0.624381, approx slack: 424521
rounded before pow |X_k-Y|_0 = 154464, f1 =  0.300001

Iteration 3020: Loss = 24344.210938
|Xk-Y|_F:  23820.753906, |X-X0|:  523.457520
rounded |X_k-Y|_0 = 23753, f1 =  0.624481, approx slack: 424496
rounded before pow |X_k-Y|_0 = 154464, f1 =  0.300001

Iteration 3040: Loss = 24338.880859
|Xk-Y|_F:  23815.791016, |X-X0|:  523.089600
rounded |X_k-Y|_0 = 23753, f1 =  0.624463, approx slack: 424505
rounded before pow |X_k-Y|_0 = 154468, f1 =  0.299998

Iteration 3060: Loss = 24334.011719
|Xk-Y|_F:  23809.277344, |X-X0|:  524.733887
rounded |X_k-Y|_0 = 23742, f1 =  0.624779, approx slack: 424532
rounded before pow |X_k-Y|_0 = 154516, f1 =  0.299965

Iteration 3080: Loss = 24329.763672
|Xk-Y|_F:  23802.218750, |X-X0|:  527.545105
rounded |X_k-Y|_0 = 23734, f1 =  0.625033, approx slack: 428712
rounded before pow |X_k-Y|_0 = 154958, f1 =  0.299659

Iteration 3100: Loss = 24324.951172
|Xk-Y|_F:  23796.833984, |X-X0|:  528.116455
rounded |X_k-Y|_0 = 23716, f1 =  0.625516, approx slack: 432814
rounded before pow |X_k-Y|_0 = 155502, f1 =  0.299282

Iteration 3120: Loss = 24320.468750
|Xk-Y|_F:  23790.855469, |X-X0|:  529.614258
rounded |X_k-Y|_0 = 23725, f1 =  0.625272, approx slack: 432805
rounded before pow |X_k-Y|_0 = 155502, f1 =  0.299282

Iteration 3140: Loss = 24314.640625
|Xk-Y|_F:  23786.125000, |X-X0|:  528.515869
rounded |X_k-Y|_0 = 23718, f1 =  0.625467, approx slack: 433051
rounded before pow |X_k-Y|_0 = 155688, f1 =  0.299154

Iteration 3160: Loss = 24309.994141
|Xk-Y|_F:  23781.107422, |X-X0|:  528.887146
rounded |X_k-Y|_0 = 23715, f1 =  0.625600, approx slack: 433055
rounded before pow |X_k-Y|_0 = 155688, f1 =  0.299154

Iteration 3180: Loss = 24304.099609
|Xk-Y|_F:  23776.345703, |X-X0|:  527.753174
rounded |X_k-Y|_0 = 23709, f1 =  0.625771, approx slack: 433050
rounded before pow |X_k-Y|_0 = 155688, f1 =  0.299154

Iteration 3200: Loss = 24299.773438
|Xk-Y|_F:  23771.380859, |X-X0|:  528.391724
rounded |X_k-Y|_0 = 23703, f1 =  0.625947, approx slack: 432205
rounded before pow |X_k-Y|_0 = 155358, f1 =  0.299381

Iteration 3220: Loss = 24294.628906
|Xk-Y|_F:  23766.007812, |X-X0|:  528.620483
rounded |X_k-Y|_0 = 23699, f1 =  0.626106, approx slack: 431087
rounded before pow |X_k-Y|_0 = 154983, f1 =  0.299640

Iteration 3240: Loss = 24289.343750
|Xk-Y|_F:  23761.214844, |X-X0|:  528.128235
rounded |X_k-Y|_0 = 23698, f1 =  0.626135, approx slack: 431039
rounded before pow |X_k-Y|_0 = 154983, f1 =  0.299640

Iteration 3260: Loss = 24283.566406
|Xk-Y|_F:  23757.046875, |X-X0|:  526.520264
rounded |X_k-Y|_0 = 23690, f1 =  0.626365, approx slack: 425500
rounded before pow |X_k-Y|_0 = 154933, f1 =  0.299674

Iteration 3280: Loss = 24278.763672
|Xk-Y|_F:  23752.234375, |X-X0|:  526.529053
rounded |X_k-Y|_0 = 23685, f1 =  0.626576, approx slack: 425477
rounded before pow |X_k-Y|_0 = 154977, f1 =  0.299644

Iteration 3300: Loss = 24274.152344
|Xk-Y|_F:  23748.349609, |X-X0|:  525.803711
rounded |X_k-Y|_0 = 23679, f1 =  0.626752, approx slack: 425452
rounded before pow |X_k-Y|_0 = 154977, f1 =  0.299644

Iteration 3320: Loss = 24270.835938
|Xk-Y|_F:  23743.613281, |X-X0|:  527.222229
rounded |X_k-Y|_0 = 23683, f1 =  0.626655, approx slack: 425153
rounded before pow |X_k-Y|_0 = 154798, f1 =  0.299768

Iteration 3340: Loss = 24266.505859
|Xk-Y|_F:  23739.650391, |X-X0|:  526.856262
rounded |X_k-Y|_0 = 23666, f1 =  0.627088, approx slack: 425103
rounded before pow |X_k-Y|_0 = 154798, f1 =  0.299768

Iteration 3360: Loss = 24262.255859
|Xk-Y|_F:  23735.427734, |X-X0|:  526.828613
rounded |X_k-Y|_0 = 23670, f1 =  0.627005, approx slack: 425039
rounded before pow |X_k-Y|_0 = 154798, f1 =  0.299768

Iteration 3380: Loss = 24258.453125
|Xk-Y|_F:  23731.257812, |X-X0|:  527.195251
rounded |X_k-Y|_0 = 23663, f1 =  0.627214, approx slack: 425018
rounded before pow |X_k-Y|_0 = 154798, f1 =  0.299768

Iteration 3400: Loss = 24255.367188
|Xk-Y|_F:  23726.703125, |X-X0|:  528.663696
rounded |X_k-Y|_0 = 23665, f1 =  0.627146, approx slack: 417040
rounded before pow |X_k-Y|_0 = 153461, f1 =  0.300694

Iteration 3420: Loss = 24250.197266
|Xk-Y|_F:  23723.525391, |X-X0|:  526.672424
rounded |X_k-Y|_0 = 23666, f1 =  0.627122, approx slack: 417069
rounded before pow |X_k-Y|_0 = 153505, f1 =  0.300663

Iteration 3440: Loss = 24246.880859
|Xk-Y|_F:  23719.007812, |X-X0|:  527.872803
rounded |X_k-Y|_0 = 23663, f1 =  0.627204, approx slack: 418932
rounded before pow |X_k-Y|_0 = 154534, f1 =  0.299945

Iteration 3460: Loss = 24242.312500
|Xk-Y|_F:  23715.050781, |X-X0|:  527.262634
rounded |X_k-Y|_0 = 23663, f1 =  0.627233, approx slack: 418891
rounded before pow |X_k-Y|_0 = 154534, f1 =  0.299945

Iteration 3480: Loss = 24239.869141
|Xk-Y|_F:  23710.558594, |X-X0|:  529.310242
rounded |X_k-Y|_0 = 23665, f1 =  0.627170, approx slack: 418757
rounded before pow |X_k-Y|_0 = 154431, f1 =  0.300017

Iteration 3500: Loss = 24234.093750
|Xk-Y|_F:  23706.671875, |X-X0|:  527.421875
rounded |X_k-Y|_0 = 23664, f1 =  0.627204, approx slack: 418751
rounded before pow |X_k-Y|_0 = 154431, f1 =  0.300017

Iteration 3520: Loss = 24229.939453
|Xk-Y|_F:  23702.339844, |X-X0|:  527.598999
rounded |X_k-Y|_0 = 23660, f1 =  0.627301, approx slack: 418916
rounded before pow |X_k-Y|_0 = 154534, f1 =  0.299945

Iteration 3540: Loss = 24224.396484
|Xk-Y|_F:  23699.267578, |X-X0|:  525.128906
rounded |X_k-Y|_0 = 23653, f1 =  0.627505, approx slack: 418885
rounded before pow |X_k-Y|_0 = 154534, f1 =  0.299945

Iteration 3560: Loss = 24222.804688
|Xk-Y|_F:  23695.302734, |X-X0|:  527.502808
rounded |X_k-Y|_0 = 23655, f1 =  0.627466, approx slack: 418788
rounded before pow |X_k-Y|_0 = 154475, f1 =  0.299986

Iteration 3580: Loss = 24218.802734
|Xk-Y|_F:  23691.619141, |X-X0|:  527.183594
rounded |X_k-Y|_0 = 23648, f1 =  0.627641, approx slack: 410916
rounded before pow |X_k-Y|_0 = 150720, f1 =  0.302593

Iteration 3600: Loss = 24215.333984
|Xk-Y|_F:  23688.416016, |X-X0|:  526.917969
rounded |X_k-Y|_0 = 23653, f1 =  0.627505, approx slack: 410712
rounded before pow |X_k-Y|_0 = 150575, f1 =  0.302694

Iteration 3620: Loss = 24212.218750
|Xk-Y|_F:  23683.390625, |X-X0|:  528.828125
rounded |X_k-Y|_0 = 23642, f1 =  0.627820, approx slack: 410776
rounded before pow |X_k-Y|_0 = 150619, f1 =  0.302663

Iteration 3640: Loss = 24208.960938
|Xk-Y|_F:  23679.568359, |X-X0|:  529.391602
rounded |X_k-Y|_0 = 23632, f1 =  0.628097, approx slack: 410763
rounded before pow |X_k-Y|_0 = 150618, f1 =  0.302664

Iteration 3660: Loss = 24205.082031
|Xk-Y|_F:  23677.576172, |X-X0|:  527.505554
rounded |X_k-Y|_0 = 23635, f1 =  0.628024, approx slack: 446741
rounded before pow |X_k-Y|_0 = 164660, f1 =  0.292978

Iteration 3680: Loss = 24201.900391
|Xk-Y|_F:  23674.021484, |X-X0|:  527.879456
rounded |X_k-Y|_0 = 23634, f1 =  0.628053, approx slack: 410769
rounded before pow |X_k-Y|_0 = 150618, f1 =  0.302664

Iteration 3700: Loss = 24198.960938
|Xk-Y|_F:  23670.017578, |X-X0|:  528.943359
rounded |X_k-Y|_0 = 23627, f1 =  0.628270, approx slack: 410718
rounded before pow |X_k-Y|_0 = 150618, f1 =  0.302664

Iteration 3720: Loss = 24196.009766
|Xk-Y|_F:  23666.851562, |X-X0|:  529.158081
rounded |X_k-Y|_0 = 23627, f1 =  0.628284, approx slack: 410719
rounded before pow |X_k-Y|_0 = 150618, f1 =  0.302664

Iteration 3740: Loss = 24193.169922
|Xk-Y|_F:  23664.035156, |X-X0|:  529.135254
rounded |X_k-Y|_0 = 23616, f1 =  0.628599, approx slack: 410680
rounded before pow |X_k-Y|_0 = 150618, f1 =  0.302664

Iteration 3760: Loss = 24188.650391
|Xk-Y|_F:  23660.111328, |X-X0|:  528.538940
rounded |X_k-Y|_0 = 23622, f1 =  0.628439, approx slack: 410657
rounded before pow |X_k-Y|_0 = 150618, f1 =  0.302664

Iteration 3780: Loss = 24186.425781
|Xk-Y|_F:  23657.218750, |X-X0|:  529.207886
rounded |X_k-Y|_0 = 23609, f1 =  0.628820, approx slack: 410645
rounded before pow |X_k-Y|_0 = 150618, f1 =  0.302664

Iteration 3800: Loss = 24182.269531
|Xk-Y|_F:  23653.193359, |X-X0|:  529.076538
rounded |X_k-Y|_0 = 23610, f1 =  0.628778, approx slack: 410587
rounded before pow |X_k-Y|_0 = 150618, f1 =  0.302664

Iteration 3820: Loss = 24181.210938
|Xk-Y|_F:  23648.728516, |X-X0|:  532.482178
rounded |X_k-Y|_0 = 23611, f1 =  0.628795, approx slack: 410585
rounded before pow |X_k-Y|_0 = 150620, f1 =  0.302663

Iteration 3840: Loss = 24176.333984
|Xk-Y|_F:  23645.777344, |X-X0|:  530.556396
rounded |X_k-Y|_0 = 23600, f1 =  0.629063, approx slack: 412894
rounded before pow |X_k-Y|_0 = 150643, f1 =  0.302600

Iteration 3860: Loss = 24173.552734
|Xk-Y|_F:  23642.173828, |X-X0|:  531.377991
rounded |X_k-Y|_0 = 23600, f1 =  0.629048, approx slack: 412608
rounded before pow |X_k-Y|_0 = 150449, f1 =  0.302782

Iteration 3880: Loss = 24169.082031
|Xk-Y|_F:  23638.710938, |X-X0|:  530.370300
rounded |X_k-Y|_0 = 23602, f1 =  0.629000, approx slack: 412781
rounded before pow |X_k-Y|_0 = 150587, f1 =  0.302685

Iteration 3900: Loss = 24167.230469
|Xk-Y|_F:  23636.101562, |X-X0|:  531.128784
rounded |X_k-Y|_0 = 23592, f1 =  0.629325, approx slack: 412594
rounded before pow |X_k-Y|_0 = 150449, f1 =  0.302782

Iteration 3920: Loss = 24161.240234
|Xk-Y|_F:  23632.912109, |X-X0|:  528.327209
rounded |X_k-Y|_0 = 23598, f1 =  0.629139, approx slack: 412563
rounded before pow |X_k-Y|_0 = 150449, f1 =  0.302782

Iteration 3940: Loss = 24161.832031
|Xk-Y|_F:  23629.421875, |X-X0|:  532.410767
rounded |X_k-Y|_0 = 23585, f1 =  0.629477, approx slack: 412540
rounded before pow |X_k-Y|_0 = 150405, f1 =  0.302813

Iteration 3960: Loss = 24159.257812
|Xk-Y|_F:  23625.396484, |X-X0|:  533.860413
rounded |X_k-Y|_0 = 23567, f1 =  0.629985, approx slack: 412405
rounded before pow |X_k-Y|_0 = 150313, f1 =  0.302877

Iteration 3980: Loss = 24153.267578
|Xk-Y|_F:  23622.943359, |X-X0|:  530.324707
rounded |X_k-Y|_0 = 23582, f1 =  0.629605, approx slack: 412443
rounded before pow |X_k-Y|_0 = 150325, f1 =  0.302822

Iteration 4000: Loss = 24147.519531
|Xk-Y|_F:  23620.480469, |X-X0|:  527.038940
rounded |X_k-Y|_0 = 23582, f1 =  0.629596, approx slack: 404766
rounded before pow |X_k-Y|_0 = 149553, f1 =  0.303221

Iteration 4020: Loss = 24140.218750
|Xk-Y|_F:  23616.357422, |X-X0|:  523.860901
rounded |X_k-Y|_0 = 23570, f1 =  0.629915, approx slack: 405062
rounded before pow |X_k-Y|_0 = 149537, f1 =  0.303373

Iteration 4040: Loss = 24136.818359
|Xk-Y|_F:  23614.369141, |X-X0|:  522.450073
rounded |X_k-Y|_0 = 23575, f1 =  0.629784, approx slack: 404429
rounded before pow |X_k-Y|_0 = 149315, f1 =  0.303527

Iteration 4060: Loss = 24135.406250
|Xk-Y|_F:  23609.675781, |X-X0|:  525.729858
rounded |X_k-Y|_0 = 23558, f1 =  0.630245, approx slack: 404449
rounded before pow |X_k-Y|_0 = 149315, f1 =  0.303527

Iteration 4080: Loss = 24128.906250
|Xk-Y|_F:  23606.271484, |X-X0|:  522.635376
rounded |X_k-Y|_0 = 23554, f1 =  0.630356, approx slack: 404441
rounded before pow |X_k-Y|_0 = 149315, f1 =  0.303527

Iteration 4100: Loss = 24125.574219
|Xk-Y|_F:  23602.300781, |X-X0|:  523.272522
rounded |X_k-Y|_0 = 23556, f1 =  0.630281, approx slack: 404410
rounded before pow |X_k-Y|_0 = 149315, f1 =  0.303527

Iteration 4120: Loss = 24124.708984
|Xk-Y|_F:  23599.816406, |X-X0|:  524.893188
rounded |X_k-Y|_0 = 23549, f1 =  0.630528, approx slack: 404410
rounded before pow |X_k-Y|_0 = 149315, f1 =  0.303527

Converged at iteration 4139
------ ABL 0 after refine ------
--- eval ---
prediction result:
f1 on test:    0.3871
f1 on test:    0.6447 (micro)
f1 on KB:      0.3872
integrated f1: 0.3872, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3550
f1 on test:    0.6746 (micro)
f1 on KB:      0.5936
integrated f1: 0.4923, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3872
Epoch 100, Total loss: -51171272.0000, CE loss: 2.9484, RL loss: -511712.7188, Reward: -47707.6221
    full cols: 165, non-full cols: 2
   r - labels: 10, labels - r: 4
    violated: 4148, weighted: 128.48416137695312, len: 0.0, nonzero: 0.10951948910951614
Epoch 200, Total loss: 96154240.0000, CE loss: 2.9450, RL loss: 961542.3750, Reward: -47359.3408
    full cols: 165, non-full cols: 2
   r - labels: 10, labels - r: 4
    violated: 4146, weighted: 128.28529357910156, len: 0.0, nonzero: 0.10948852449655533
Epoch 300, Total loss: 33759124.0000, CE loss: 2.9423, RL loss: 337591.2500, Reward: -47452.8174
    full cols: 165, non-full cols: 1
   r - labels: 9, labels - r: 4
    violated: 4148, weighted: 126.5416259765625, len: 0.0, nonzero: 0.1090860366821289
Epoch 400, Total loss: -39121048.0000, CE loss: 2.9402, RL loss: -391210.5000, Reward: -47579.5596
    full cols: 165, non-full cols: 1
   r - labels: 9, labels - r: 4
    violated: 4133, weighted: 126.16493225097656, len: 0.0, nonzero: 0.10903443396091461
Epoch 500, Total loss: 5950466.5000, CE loss: 2.9377, RL loss: 59504.6641, Reward: -47552.5508
    full cols: 165, non-full cols: 2
   r - labels: 10, labels - r: 4
    violated: 4137, weighted: 126.86673736572266, len: 0.0, nonzero: 0.10917891561985016
Epoch 600, Total loss: 53521932.0000, CE loss: 2.9359, RL loss: 535219.3125, Reward: -47348.5195
    full cols: 165, non-full cols: 2
   r - labels: 10, labels - r: 4
    violated: 4144, weighted: 127.40293884277344, len: 0.0, nonzero: 0.10928212106227875
Epoch 700, Total loss: -36360248.0000, CE loss: 2.9339, RL loss: -363602.5000, Reward: -47626.9502
    full cols: 165, non-full cols: 1
   r - labels: 9, labels - r: 4
    violated: 4149, weighted: 129.095703125, len: 0.0, nonzero: 0.10963301360607147
Epoch 800, Total loss: 35610684.0000, CE loss: 2.9323, RL loss: 356106.8438, Reward: -47388.4355
    full cols: 165, non-full cols: 1
   r - labels: 9, labels - r: 4
    violated: 4154, weighted: 128.42103576660156, len: 0.0, nonzero: 0.10948852449655533
Epoch 900, Total loss: -64557436.0000, CE loss: 2.9309, RL loss: -645574.3750, Reward: -47553.2842
    full cols: 165, non-full cols: 0
   r - labels: 8, labels - r: 4
    violated: 4149, weighted: 126.05972290039062, len: 0.0, nonzero: 0.10898283123970032
Epoch 1000, Total loss: -73020360.0000, CE loss: 2.9291, RL loss: -730203.6250, Reward: -47656.3887
    full cols: 165, non-full cols: 1
   r - labels: 9, labels - r: 4
    violated: 4147, weighted: 129.04751586914062, len: 0.0, nonzero: 0.10962269455194473
Epoch 1100, Total loss: -20979164.0000, CE loss: 2.9273, RL loss: -209791.6406, Reward: -47569.7266
    full cols: 165, non-full cols: 1
   r - labels: 9, labels - r: 4
    violated: 4149, weighted: 126.83076477050781, len: 0.0, nonzero: 0.10914795845746994
Epoch 1200, Total loss: 80418480.0000, CE loss: 2.9261, RL loss: 804184.8125, Reward: -47325.3838
    full cols: 165, non-full cols: 0
   r - labels: 8, labels - r: 4
    violated: 4157, weighted: 126.05972290039062, len: 0.0, nonzero: 0.10898283123970032
Epoch 1300, Total loss: 93436016.0000, CE loss: 2.9262, RL loss: 934360.1250, Reward: -47185.6777
    full cols: 165, non-full cols: 0
   r - labels: 8, labels - r: 4
    violated: 4157, weighted: 126.05972290039062, len: 0.0, nonzero: 0.10898283123970032
Epoch 1400, Total loss: -84597896.0000, CE loss: 2.9242, RL loss: -845978.9375, Reward: -47660.1250
    full cols: 164, non-full cols: 1
   r - labels: 8, labels - r: 4
    violated: 4145, weighted: 120.55972290039062, len: 0.0, nonzero: 0.10886930674314499
Epoch 1500, Total loss: 132284128.0000, CE loss: 2.9234, RL loss: 1322841.2500, Reward: -47152.3389
    full cols: 164, non-full cols: 0
   r - labels: 7, labels - r: 4
    violated: 4159, weighted: 94.05972290039062, len: 0.0, nonzero: 0.10832232981920242
Epoch 1600, Total loss: -193994.5781, CE loss: 2.9225, RL loss: -1939.9458, Reward: -47404.3154
    full cols: 164, non-full cols: 0
   r - labels: 7, labels - r: 4
    violated: 4154, weighted: 94.05972290039062, len: 0.0, nonzero: 0.10832232981920242
Epoch 1700, Total loss: -16539734.0000, CE loss: 2.9216, RL loss: -165397.3438, Reward: -47418.7393
    full cols: 164, non-full cols: 0
   r - labels: 7, labels - r: 4
    violated: 4157, weighted: 94.05972290039062, len: 0.0, nonzero: 0.10832232981920242
Epoch 1800, Total loss: -68181488.0000, CE loss: 2.9209, RL loss: -681814.8750, Reward: -47638.6504
    full cols: 164, non-full cols: 1
   r - labels: 8, labels - r: 4
    violated: 4154, weighted: 94.44524383544922, len: 0.0, nonzero: 0.10840488970279694
Epoch 1900, Total loss: 39551936.0000, CE loss: 2.9201, RL loss: 395519.3438, Reward: -47323.4883
    full cols: 165, non-full cols: 1
   r - labels: 9, labels - r: 4
    violated: 4144, weighted: 97.24411010742188, len: 0.0, nonzero: 0.10899315029382706
--- eval ---
prediction result:
f1 on test:    0.3840
f1 on test:    0.6486 (micro)
f1 on KB:      0.3994
integrated f1: 0.3946, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3557
f1 on test:    0.6751 (micro)
f1 on KB:      0.5936
integrated f1: 0.5222, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: 25702854.0000, CE loss: 2.9195, RL loss: 257028.5312, Reward: -47303.1328
    full cols: 165, non-full cols: 1
   r - labels: 9, labels - r: 4
    violated: 4147, weighted: 101.35338592529297, len: 0.0, nonzero: 0.10941628366708755
Epoch 2100, Total loss: -46636908.0000, CE loss: 2.9188, RL loss: -466369.0625, Reward: -47408.7412
    full cols: 166, non-full cols: 0
   r - labels: 9, labels - r: 4
    violated: 4089, weighted: 98.49049377441406, len: 0.0, nonzero: 0.10964333266019821
Epoch 2200, Total loss: -108100552.0000, CE loss: 2.9183, RL loss: -1081005.5000, Reward: -47672.5527
    full cols: 165, non-full cols: 0
   r - labels: 8, labels - r: 4
    violated: 4146, weighted: 97.14387512207031, len: 0.0, nonzero: 0.10898283123970032
Epoch 2300, Total loss: 18788876.0000, CE loss: 2.9182, RL loss: 187888.7656, Reward: -47254.9053
    full cols: 166, non-full cols: 0
   r - labels: 8, labels - r: 3
    violated: 4087, weighted: 95.44976806640625, len: 0.0, nonzero: 0.10964333266019821
Epoch 2400, Total loss: -83038536.0000, CE loss: 2.9178, RL loss: -830385.3750, Reward: -47559.0000
    full cols: 166, non-full cols: 0
   r - labels: 8, labels - r: 3
    violated: 4084, weighted: 95.44976806640625, len: 0.0, nonzero: 0.10964333266019821
Epoch 2500, Total loss: 32421268.0000, CE loss: 2.9181, RL loss: 324212.6875, Reward: -47340.3438
    full cols: 166, non-full cols: 0
   r - labels: 8, labels - r: 3
    violated: 4085, weighted: 95.44976806640625, len: 0.0, nonzero: 0.10964333266019821
Epoch 2600, Total loss: 22340288.0000, CE loss: 2.9175, RL loss: 223402.8750, Reward: -47342.0967
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 4156, weighted: 46.89954376220703, len: 0.0, nonzero: 0.10832232981920242
Epoch 2700, Total loss: 53109364.0000, CE loss: 2.9176, RL loss: 531093.6250, Reward: -47194.9180
    full cols: 164, non-full cols: 1
   r - labels: 7, labels - r: 3
    violated: 4148, weighted: 48.6033935546875, len: 0.0, nonzero: 0.10849777609109879
Epoch 2800, Total loss: 12224738.0000, CE loss: 2.9176, RL loss: 122247.3828, Reward: -47345.5469
    full cols: 164, non-full cols: 1
   r - labels: 7, labels - r: 3
    violated: 4152, weighted: 48.10226058959961, len: 0.0, nonzero: 0.10844617336988449
Epoch 2900, Total loss: -7811804.0000, CE loss: 2.9170, RL loss: -78118.0391, Reward: -47426.0000
    full cols: 164, non-full cols: 2
   r - labels: 8, labels - r: 3
    violated: 4114, weighted: 48.3115348815918, len: 0.0, nonzero: 0.10870417952537537
Epoch 3000, Total loss: 25465892.0000, CE loss: 2.9165, RL loss: 254658.9219, Reward: -47293.4160
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 4150, weighted: 50.2298583984375, len: 0.0, nonzero: 0.10832232981920242
Epoch 3100, Total loss: -18263822.0000, CE loss: 2.9164, RL loss: -182638.2188, Reward: -47435.2861
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 4124, weighted: 50.2298583984375, len: 0.0, nonzero: 0.10832232981920242
Epoch 3200, Total loss: -33258750.0000, CE loss: 2.9159, RL loss: -332587.5000, Reward: -47424.9180
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 4089, weighted: 50.2298583984375, len: 0.0, nonzero: 0.10832232981920242
Epoch 3300, Total loss: -2302689.5000, CE loss: 2.9160, RL loss: -23026.8945, Reward: -47412.2305
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 4089, weighted: 50.2298583984375, len: 0.0, nonzero: 0.10832232981920242
Epoch 3400, Total loss: -30389084.0000, CE loss: 2.9158, RL loss: -303890.8438, Reward: -47448.5225
    full cols: 165, non-full cols: 0
   r - labels: 7, labels - r: 3
    violated: 4094, weighted: 51.57646942138672, len: 0.0, nonzero: 0.10898283123970032
Epoch 3500, Total loss: 54923788.0000, CE loss: 2.9160, RL loss: 549237.8750, Reward: -47243.0107
    full cols: 164, non-full cols: 1
   r - labels: 7, labels - r: 3
    violated: 4085, weighted: 50.77692413330078, len: 0.0, nonzero: 0.10859065502882004
Epoch 3600, Total loss: -4266871.5000, CE loss: 2.9156, RL loss: -42668.7148, Reward: -47403.5010
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 4093, weighted: 50.2298583984375, len: 0.0, nonzero: 0.10832232981920242
Epoch 3700, Total loss: 77379224.0000, CE loss: 2.9156, RL loss: 773792.2500, Reward: -47248.9248
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 4088, weighted: 50.2298583984375, len: 0.0, nonzero: 0.10832232981920242
Epoch 3800, Total loss: -32526784.0000, CE loss: 2.9148, RL loss: -325267.8438, Reward: -47448.3066
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 4083, weighted: 50.2298583984375, len: 0.0, nonzero: 0.10832232981920242
Epoch 3900, Total loss: -70787008.0000, CE loss: 2.9147, RL loss: -707870.0625, Reward: -47584.0967
    full cols: 165, non-full cols: 0
   r - labels: 6, labels - r: 2
    violated: 4029, weighted: 46.798187255859375, len: 0.0, nonzero: 0.10898283123970032
--- eval ---
prediction result:
f1 on test:    0.3831
f1 on test:    0.6491 (micro)
f1 on KB:      0.4003
integrated f1: 0.3949, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3541
f1 on test:    0.6749 (micro)
f1 on KB:      0.6017
integrated f1: 0.5274, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: -33860064.0000, CE loss: 2.9143, RL loss: -338600.6562, Reward: -47511.0498
    full cols: 163, non-full cols: 2
   r - labels: 6, labels - r: 2
    violated: 4032, weighted: 46.98008728027344, len: 0.0, nonzero: 0.10885898768901825
Epoch 4100, Total loss: -41530912.0000, CE loss: 2.9140, RL loss: -415309.1250, Reward: -47570.0059
    full cols: 163, non-full cols: 1
   r - labels: 6, labels - r: 3
    violated: 4088, weighted: 46.922393798828125, len: 0.0, nonzero: 0.10798175632953644
Epoch 4200, Total loss: -65226536.0000, CE loss: 2.9135, RL loss: -652265.3750, Reward: -47590.5352
    full cols: 163, non-full cols: 0
   r - labels: 5, labels - r: 3
    violated: 4091, weighted: 43.81538391113281, len: 0.0, nonzero: 0.10766182839870453
Epoch 4300, Total loss: -43711276.0000, CE loss: 2.9132, RL loss: -437112.7500, Reward: -47463.0264
    full cols: 163, non-full cols: 0
   r - labels: 5, labels - r: 3
    violated: 4090, weighted: 43.81538391113281, len: 0.0, nonzero: 0.10766182839870453
Epoch 4400, Total loss: -49198176.0000, CE loss: 2.9133, RL loss: -491981.7500, Reward: -47522.7256
    full cols: 165, non-full cols: 0
   r - labels: 6, labels - r: 2
    violated: 4027, weighted: 46.798187255859375, len: 0.0, nonzero: 0.10898283123970032
Epoch 4500, Total loss: -1510249.7500, CE loss: 2.9133, RL loss: -15102.4980, Reward: -47474.2334
    full cols: 166, non-full cols: 0
   r - labels: 7, labels - r: 2
    violated: 4029, weighted: 48.14479064941406, len: 0.0, nonzero: 0.10964333266019821
Epoch 4600, Total loss: -79572000.0000, CE loss: 2.9134, RL loss: -795720.0000, Reward: -47661.8760
    full cols: 165, non-full cols: 0
   r - labels: 6, labels - r: 2
    violated: 4021, weighted: 46.798187255859375, len: 0.0, nonzero: 0.10898283123970032
Epoch 4700, Total loss: -22896696.0000, CE loss: 2.9132, RL loss: -228966.9531, Reward: -47492.1484
    full cols: 164, non-full cols: 1
   r - labels: 6, labels - r: 2
    violated: 4073, weighted: 49.15746307373047, len: 0.0, nonzero: 0.108528733253479
Epoch 4800, Total loss: 84494728.0000, CE loss: 2.9131, RL loss: 844947.2500, Reward: -47188.7354
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 4092, weighted: 50.2298583984375, len: 0.0, nonzero: 0.10832232981920242
Epoch 4900, Total loss: -95745376.0000, CE loss: 2.9133, RL loss: -957453.7500, Reward: -47748.4424
    full cols: 165, non-full cols: 0
   r - labels: 7, labels - r: 3
    violated: 4088, weighted: 53.31402587890625, len: 0.0, nonzero: 0.10898283123970032
Epoch 5000, Total loss: -143946160.0000, CE loss: 2.9131, RL loss: -1439461.6250, Reward: -47803.8994
    full cols: 164, non-full cols: 1
   r - labels: 7, labels - r: 3
    violated: 4082, weighted: 51.09728240966797, len: 0.0, nonzero: 0.10850809514522552
Epoch 5100, Total loss: -42908860.0000, CE loss: 2.9130, RL loss: -429088.5938, Reward: -47577.2412
    full cols: 165, non-full cols: 0
   r - labels: 7, labels - r: 3
    violated: 4091, weighted: 53.31402587890625, len: 0.0, nonzero: 0.10898283123970032
Epoch 5200, Total loss: 3734339.0000, CE loss: 2.9127, RL loss: 37343.3906, Reward: -47410.3994
    full cols: 166, non-full cols: 0
   r - labels: 8, labels - r: 3
    violated: 4021, weighted: 69.86424255371094, len: 0.0, nonzero: 0.10964333266019821
Epoch 5300, Total loss: 90663664.0000, CE loss: 2.9127, RL loss: 906636.6250, Reward: -47335.5127
    full cols: 166, non-full cols: 1
   r - labels: 9, labels - r: 3
    violated: 4026, weighted: 72.31356811523438, len: 0.0, nonzero: 0.11028319597244263
Epoch 5400, Total loss: 14634095.0000, CE loss: 2.9129, RL loss: 146340.9531, Reward: -47407.1318
    full cols: 166, non-full cols: 1
   r - labels: 9, labels - r: 3
    violated: 4026, weighted: 71.51176452636719, len: 0.0, nonzero: 0.11020062863826752
Epoch 5500, Total loss: 130500688.0000, CE loss: 2.9130, RL loss: 1305006.8750, Reward: -47130.3623
    full cols: 164, non-full cols: 2
   r - labels: 8, labels - r: 3
    violated: 4074, weighted: 50.203163146972656, len: 0.0, nonzero: 0.10846681147813797
Epoch 5600, Total loss: -49538084.0000, CE loss: 2.9127, RL loss: -495380.8438, Reward: -47618.7178
    full cols: 165, non-full cols: 0
   r - labels: 7, labels - r: 3
    violated: 4020, weighted: 64.60813903808594, len: 0.0, nonzero: 0.10898283123970032
Epoch 5700, Total loss: 29561268.0000, CE loss: 2.9130, RL loss: 295612.6875, Reward: -47442.6836
    full cols: 165, non-full cols: 0
   r - labels: 7, labels - r: 3
    violated: 4028, weighted: 64.60813903808594, len: 0.0, nonzero: 0.10898283123970032
Epoch 5800, Total loss: 42291180.0000, CE loss: 2.9127, RL loss: 422911.8125, Reward: -47415.2207
    full cols: 165, non-full cols: 1
   r - labels: 8, labels - r: 3
    violated: 4019, weighted: 68.05745697021484, len: 0.0, nonzero: 0.10941628366708755
Epoch 5900, Total loss: 45778612.0000, CE loss: 2.9127, RL loss: 457786.1250, Reward: -47449.3047
    full cols: 167, non-full cols: 0
   r - labels: 9, labels - r: 3
    violated: 4022, weighted: 72.51402282714844, len: 0.0, nonzero: 0.1103038340806961
--- eval ---
prediction result:
f1 on test:    0.3827
f1 on test:    0.6491 (micro)
f1 on KB:      0.4005
integrated f1: 0.3949, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3546
f1 on test:    0.6752 (micro)
f1 on KB:      0.5977
integrated f1: 0.5248, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: -66701288.0000, CE loss: 2.9133, RL loss: -667012.8750, Reward: -47638.9873
    full cols: 166, non-full cols: 1
   r - labels: 9, labels - r: 3
    violated: 4028, weighted: 66.92964172363281, len: 0.0, nonzero: 0.10967428982257843
Epoch 6100, Total loss: 92278344.0000, CE loss: 2.9125, RL loss: 922783.4375, Reward: -47250.9170
    full cols: 165, non-full cols: 1
   r - labels: 8, labels - r: 3
    violated: 4019, weighted: 65.68891906738281, len: 0.0, nonzero: 0.10959172993898392
Epoch 6200, Total loss: -1655493.7500, CE loss: 2.9129, RL loss: -16554.9375, Reward: -47498.5234
    full cols: 166, non-full cols: 1
   r - labels: 8, labels - r: 2
    violated: 3963, weighted: 62.58574295043945, len: 0.0, nonzero: 0.11029351502656937
Epoch 6300, Total loss: -31052182.0000, CE loss: 2.9125, RL loss: -310521.8125, Reward: -47606.2393
    full cols: 167, non-full cols: 1
   r - labels: 9, labels - r: 2
    violated: 3962, weighted: 66.97759246826172, len: 0.0, nonzero: 0.11074760556221008
Epoch 6400, Total loss: 11978612.0000, CE loss: 2.9125, RL loss: 119786.1172, Reward: -47492.5361
    full cols: 167, non-full cols: 0
   r - labels: 8, labels - r: 2
    violated: 3963, weighted: 64.26063537597656, len: 0.0, nonzero: 0.1103038340806961
Epoch 6500, Total loss: -9485848.0000, CE loss: 2.9125, RL loss: -94858.4844, Reward: -47532.2812
    full cols: 166, non-full cols: 1
   r - labels: 8, labels - r: 2
    violated: 4027, weighted: 48.22760009765625, len: 0.0, nonzero: 0.10966397076845169
Epoch 6600, Total loss: -8751311.0000, CE loss: 2.9127, RL loss: -87513.1094, Reward: -47574.9199
    full cols: 165, non-full cols: 2
   r - labels: 8, labels - r: 2
    violated: 4026, weighted: 51.159271240234375, len: 0.0, nonzero: 0.11013870686292648
Epoch 6700, Total loss: -22943372.0000, CE loss: 2.9127, RL loss: -229433.7188, Reward: -47612.1680
    full cols: 164, non-full cols: 0
   r - labels: 6, labels - r: 3
    violated: 4084, weighted: 44.293212890625, len: 0.0, nonzero: 0.10832232981920242
Epoch 6800, Total loss: -41323428.0000, CE loss: 2.9122, RL loss: -413234.2812, Reward: -47646.6865
    full cols: 164, non-full cols: 1
   r - labels: 7, labels - r: 3
    violated: 4085, weighted: 50.507240295410156, len: 0.0, nonzero: 0.10896219313144684
Epoch 6900, Total loss: 111235776.0000, CE loss: 2.9120, RL loss: 1112357.7500, Reward: -47295.2363
    full cols: 165, non-full cols: 0
   r - labels: 8, labels - r: 4
    violated: 4150, weighted: 55.05158233642578, len: 0.0, nonzero: 0.10898283123970032
Epoch 7000, Total loss: 12322181.0000, CE loss: 2.9117, RL loss: 123221.8125, Reward: -47550.0488
    full cols: 165, non-full cols: 0
   r - labels: 7, labels - r: 3
    violated: 4088, weighted: 48.970130920410156, len: 0.0, nonzero: 0.10898283123970032
Epoch 7100, Total loss: -41601904.0000, CE loss: 2.9119, RL loss: -416019.0312, Reward: -47701.4043
    full cols: 163, non-full cols: 1
   r - labels: 6, labels - r: 3
    violated: 4149, weighted: 47.98800277709961, len: 0.0, nonzero: 0.10767214745283127
Epoch 7200, Total loss: 31460488.0000, CE loss: 2.9115, RL loss: 314604.8750, Reward: -47518.7393
    full cols: 164, non-full cols: 0
   r - labels: 7, labels - r: 4
    violated: 4074, weighted: 80.01446533203125, len: 0.0, nonzero: 0.10832232981920242
Epoch 7300, Total loss: 49289172.0000, CE loss: 2.9116, RL loss: 492891.7188, Reward: -47457.1709
    full cols: 163, non-full cols: 1
   r - labels: 6, labels - r: 3
    violated: 4111, weighted: 46.982120513916016, len: 0.0, nonzero: 0.10806431621313095
Epoch 7400, Total loss: 64354008.0000, CE loss: 2.9118, RL loss: 643540.0625, Reward: -47466.5938
    full cols: 162, non-full cols: 1
   r - labels: 7, labels - r: 5
    violated: 4180, weighted: 58.161529541015625, len: 0.0, nonzero: 0.10735221952199936
Epoch 7500, Total loss: -15120906.0000, CE loss: 2.9114, RL loss: -151209.0625, Reward: -47717.1855
    full cols: 163, non-full cols: 1
   r - labels: 8, labels - r: 5
    violated: 4108, weighted: 90.08686828613281, len: 0.0, nonzero: 0.10819848626852036
Epoch 7600, Total loss: -3770361.7500, CE loss: 2.9115, RL loss: -37703.6172, Reward: -47630.6621
    full cols: 165, non-full cols: 0
   r - labels: 8, labels - r: 4
    violated: 4025, weighted: 94.39276123046875, len: 0.0, nonzero: 0.10898283123970032
Epoch 7700, Total loss: 4276851.5000, CE loss: 2.9117, RL loss: 42768.5156, Reward: -47626.1973
    full cols: 164, non-full cols: 1
   r - labels: 8, labels - r: 4
    violated: 4083, weighted: 62.89275360107422, len: 0.0, nonzero: 0.10833264887332916
Epoch 7800, Total loss: -119418336.0000, CE loss: 2.9113, RL loss: -1194183.3750, Reward: -47899.2646
    full cols: 164, non-full cols: 0
   r - labels: 7, labels - r: 4
    violated: 4086, weighted: 62.39275360107422, len: 0.0, nonzero: 0.10832232981920242
Epoch 7900, Total loss: 17702428.0000, CE loss: 2.9118, RL loss: 177024.2812, Reward: -47586.1543
    full cols: 165, non-full cols: 0
   r - labels: 8, labels - r: 4
    violated: 4026, weighted: 94.39276123046875, len: 0.0, nonzero: 0.10898283123970032
--- eval ---
prediction result:
f1 on test:    0.3825
f1 on test:    0.6494 (micro)
f1 on KB:      0.4006
integrated f1: 0.3949, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.3553
f1 on test:    0.6752 (micro)
f1 on KB:      0.5937
integrated f1: 0.5222, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: 14255756.0000, CE loss: 2.9113, RL loss: 142557.5625, Reward: -47584.8760
    full cols: 164, non-full cols: 1
   r - labels: 8, labels - r: 4
    violated: 4090, weighted: 59.269683837890625, len: 0.0, nonzero: 0.10844617336988449
------ ABL Loop 1 ------
--- eval ---
prediction result:
f1 on test:    0.3825
f1 on test:    0.6494 (micro)
f1 on KB:      0.4006
integrated f1: 0.3926, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3553
f1 on test:    0.6752 (micro)
f1 on KB:      0.5937
integrated f1: 0.4925, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3926
Iteration 0: Loss = 26200.779297
|Xk-Y|_F:  26200.779297, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 26209, f1 =  0.341260, approx slack: 39307
rounded before pow |X_k-Y|_0 = 26209, f1 =  0.341260

Iteration 20: Loss = 23042.150391
|Xk-Y|_F:  21858.089844, |X-X0|:  1184.061279
rounded |X_k-Y|_0 = 22475, f1 =  0.564025, approx slack: 517719
rounded before pow |X_k-Y|_0 = 60704, f1 =  0.393007

Iteration 40: Loss = 21981.378906
|Xk-Y|_F:  20989.777344, |X-X0|:  991.601685
rounded |X_k-Y|_0 = 22119, f1 =  0.577085, approx slack: 588213
rounded before pow |X_k-Y|_0 = 63538, f1 =  0.389368

Iteration 60: Loss = 21254.623047
|Xk-Y|_F:  20439.619141, |X-X0|:  815.003296
rounded |X_k-Y|_0 = 20382, f1 =  0.630672, approx slack: 568873
rounded before pow |X_k-Y|_0 = 65042, f1 =  0.387388

Iteration 80: Loss = 20959.412109
|Xk-Y|_F:  20216.429688, |X-X0|:  742.982666
rounded |X_k-Y|_0 = 20229, f1 =  0.634737, approx slack: 531207
rounded before pow |X_k-Y|_0 = 64936, f1 =  0.388017

Iteration 100: Loss = 20810.333984
|Xk-Y|_F:  20115.533203, |X-X0|:  694.800049
rounded |X_k-Y|_0 = 20160, f1 =  0.636600, approx slack: 502995
rounded before pow |X_k-Y|_0 = 60686, f1 =  0.395802

Iteration 120: Loss = 20723.916016
|Xk-Y|_F:  20050.492188, |X-X0|:  673.423706
rounded |X_k-Y|_0 = 20102, f1 =  0.638107, approx slack: 493571
rounded before pow |X_k-Y|_0 = 60552, f1 =  0.396062

Iteration 140: Loss = 20667.365234
|Xk-Y|_F:  20004.359375, |X-X0|:  663.006531
rounded |X_k-Y|_0 = 20067, f1 =  0.639020, approx slack: 490992
rounded before pow |X_k-Y|_0 = 60373, f1 =  0.396411

Iteration 160: Loss = 20620.056641
|Xk-Y|_F:  19967.031250, |X-X0|:  653.024597
rounded |X_k-Y|_0 = 20005, f1 =  0.640539, approx slack: 486982
rounded before pow |X_k-Y|_0 = 60198, f1 =  0.396754

Iteration 180: Loss = 20578.800781
|Xk-Y|_F:  19936.181641, |X-X0|:  642.620117
rounded |X_k-Y|_0 = 19980, f1 =  0.641152, approx slack: 477903
rounded before pow |X_k-Y|_0 = 59929, f1 =  0.397285

Iteration 200: Loss = 20543.558594
|Xk-Y|_F:  19910.775391, |X-X0|:  632.783691
rounded |X_k-Y|_0 = 19955, f1 =  0.641777, approx slack: 475262
rounded before pow |X_k-Y|_0 = 59797, f1 =  0.397547

Iteration 220: Loss = 20514.912109
|Xk-Y|_F:  19890.566406, |X-X0|:  624.345337
rounded |X_k-Y|_0 = 19945, f1 =  0.642019, approx slack: 470722
rounded before pow |X_k-Y|_0 = 58265, f1 =  0.400660

Iteration 240: Loss = 20489.005859
|Xk-Y|_F:  19874.722656, |X-X0|:  614.283691
rounded |X_k-Y|_0 = 19936, f1 =  0.642249, approx slack: 461943
rounded before pow |X_k-Y|_0 = 57916, f1 =  0.401389

Iteration 260: Loss = 20467.515625
|Xk-Y|_F:  19858.781250, |X-X0|:  608.734314
rounded |X_k-Y|_0 = 19931, f1 =  0.642400, approx slack: 458514
rounded before pow |X_k-Y|_0 = 56747, f1 =  0.403628

Iteration 280: Loss = 20450.062500
|Xk-Y|_F:  19845.515625, |X-X0|:  604.547485
rounded |X_k-Y|_0 = 19921, f1 =  0.642647, approx slack: 459393
rounded before pow |X_k-Y|_0 = 57635, f1 =  0.401972

Iteration 300: Loss = 20432.185547
|Xk-Y|_F:  19833.158203, |X-X0|:  599.026978
rounded |X_k-Y|_0 = 19908, f1 =  0.642978, approx slack: 454340
rounded before pow |X_k-Y|_0 = 57334, f1 =  0.402539

Iteration 320: Loss = 20417.748047
|Xk-Y|_F:  19822.330078, |X-X0|:  595.417358
rounded |X_k-Y|_0 = 19906, f1 =  0.643020, approx slack: 452223
rounded before pow |X_k-Y|_0 = 57325, f1 =  0.402623

Iteration 340: Loss = 20405.365234
|Xk-Y|_F:  19812.091797, |X-X0|:  593.273193
rounded |X_k-Y|_0 = 19899, f1 =  0.643204, approx slack: 450918
rounded before pow |X_k-Y|_0 = 57204, f1 =  0.402882

Iteration 360: Loss = 20392.822266
|Xk-Y|_F:  19803.634766, |X-X0|:  589.187378
rounded |X_k-Y|_0 = 19889, f1 =  0.643454, approx slack: 450174
rounded before pow |X_k-Y|_0 = 57130, f1 =  0.403041

Iteration 380: Loss = 20381.501953
|Xk-Y|_F:  19795.240234, |X-X0|:  586.261108
rounded |X_k-Y|_0 = 19878, f1 =  0.643725, approx slack: 448065
rounded before pow |X_k-Y|_0 = 57000, f1 =  0.403303

Iteration 400: Loss = 20370.800781
|Xk-Y|_F:  19787.000000, |X-X0|:  583.801270
rounded |X_k-Y|_0 = 19859, f1 =  0.644203, approx slack: 444094
rounded before pow |X_k-Y|_0 = 56933, f1 =  0.403438

Iteration 420: Loss = 20360.681641
|Xk-Y|_F:  19778.824219, |X-X0|:  581.858032
rounded |X_k-Y|_0 = 19853, f1 =  0.644348, approx slack: 444041
rounded before pow |X_k-Y|_0 = 56933, f1 =  0.403438

Iteration 440: Loss = 20352.482422
|Xk-Y|_F:  19771.433594, |X-X0|:  581.048462
rounded |X_k-Y|_0 = 19850, f1 =  0.644421, approx slack: 444066
rounded before pow |X_k-Y|_0 = 56933, f1 =  0.403438

Iteration 460: Loss = 20343.214844
|Xk-Y|_F:  19765.066406, |X-X0|:  578.147461
rounded |X_k-Y|_0 = 19841, f1 =  0.644643, approx slack: 429112
rounded before pow |X_k-Y|_0 = 56505, f1 =  0.404296

Iteration 480: Loss = 20336.603516
|Xk-Y|_F:  19758.519531, |X-X0|:  578.084106
rounded |X_k-Y|_0 = 19830, f1 =  0.644913, approx slack: 429504
rounded before pow |X_k-Y|_0 = 56800, f1 =  0.403727

Iteration 500: Loss = 20329.304688
|Xk-Y|_F:  19752.703125, |X-X0|:  576.602539
rounded |X_k-Y|_0 = 19827, f1 =  0.644986, approx slack: 428863
rounded before pow |X_k-Y|_0 = 56502, f1 =  0.404302

Iteration 520: Loss = 20322.011719
|Xk-Y|_F:  19746.451172, |X-X0|:  575.560913
rounded |X_k-Y|_0 = 19812, f1 =  0.645350, approx slack: 426837
rounded before pow |X_k-Y|_0 = 55792, f1 =  0.405698

Iteration 540: Loss = 20314.925781
|Xk-Y|_F:  19741.365234, |X-X0|:  573.559570
rounded |X_k-Y|_0 = 19808, f1 =  0.645444, approx slack: 423964
rounded before pow |X_k-Y|_0 = 56013, f1 =  0.405345

Iteration 560: Loss = 20308.185547
|Xk-Y|_F:  19735.589844, |X-X0|:  572.595886
rounded |X_k-Y|_0 = 19800, f1 =  0.645644, approx slack: 422666
rounded before pow |X_k-Y|_0 = 55411, f1 =  0.406518

Iteration 580: Loss = 20300.251953
|Xk-Y|_F:  19730.488281, |X-X0|:  569.764526
rounded |X_k-Y|_0 = 19797, f1 =  0.645716, approx slack: 422083
rounded before pow |X_k-Y|_0 = 56001, f1 =  0.405372

Iteration 600: Loss = 20293.562500
|Xk-Y|_F:  19725.189453, |X-X0|:  568.373718
rounded |X_k-Y|_0 = 19795, f1 =  0.645764, approx slack: 421193
rounded before pow |X_k-Y|_0 = 56177, f1 =  0.405056

Iteration 620: Loss = 20286.193359
|Xk-Y|_F:  19719.490234, |X-X0|:  566.702515
rounded |X_k-Y|_0 = 19780, f1 =  0.646125, approx slack: 418558
rounded before pow |X_k-Y|_0 = 54991, f1 =  0.407401

Iteration 640: Loss = 20279.912109
|Xk-Y|_F:  19714.287109, |X-X0|:  565.625610
rounded |X_k-Y|_0 = 19775, f1 =  0.646252, approx slack: 418295
rounded before pow |X_k-Y|_0 = 56083, f1 =  0.405264

Iteration 660: Loss = 20274.470703
|Xk-Y|_F:  19710.402344, |X-X0|:  564.067688
rounded |X_k-Y|_0 = 19771, f1 =  0.646348, approx slack: 417741
rounded before pow |X_k-Y|_0 = 55785, f1 =  0.405854

Iteration 680: Loss = 20269.091797
|Xk-Y|_F:  19704.875000, |X-X0|:  564.217041
rounded |X_k-Y|_0 = 19769, f1 =  0.646393, approx slack: 417173
rounded before pow |X_k-Y|_0 = 55012, f1 =  0.407352

Converged at iteration 688
------ ABL 1 after refine ------
--- eval ---
prediction result:
f1 on test:    0.3825
f1 on test:    0.6494 (micro)
f1 on KB:      0.4014
integrated f1: 0.3931, w_data: 0.4246, w_klg: 0.5754

integrated result:
f1 on test:    0.3529
f1 on test:    0.6746 (micro)
f1 on KB:      0.5981
integrated f1: 0.4940, w_data: 0.4246, w_klg: 0.5754
------------
integrated f1 0.3931
