MLP_adamson_Sep20_3
log/EGOAL-hsa-2025-09-21-06:52:21.777570.txt
random seed: 666999
test perts: ["['DARS', 'ctrl']", "['SAMM50', 'ctrl']", "['MRGBP', 'ctrl']", "['TMEM167A', 'ctrl']", "['NEDD8', 'ctrl']", "['HSPA9', 'ctrl']", "['MRPL39', 'ctrl']", "['FARSB', 'ctrl']", "['HSD17B12', 'ctrl']", "['SEC61B', 'ctrl']", "['ASCC3', 'ctrl']", "['ARHGAP22', 'ctrl']", "['HSPA5', 'ctrl']", "['CHERP', 'ctrl']"]
train: torch.Size([58514, 5060])
unlabel: torch.Size([3737, 5060])
cuda availability: True
/home/u-xiangyf/anaconda3/envs/egoal/lib/python3.13/site-packages/torch/nn/modules/loss.py:608: UserWarning: Using a target size (torch.Size([5060])) that is different to the input size (torch.Size([5060, 5060])). This will likely lead to incorrect results due to broadcasting. Please ensure they have the same size.
  return F.mse_loss(input, target, reduction=self.reduction)
Epoch 0, Loss: 0.1521
Epoch 100, Loss: 0.1472
Epoch 200, Loss: 0.1424
Epoch 300, Loss: 0.1377
Epoch 400, Loss: 0.1332
Epoch 500, Loss: 0.1288
Epoch 600, Loss: 0.1245
Epoch 700, Loss: 0.1204
Epoch 800, Loss: 0.1164
Epoch 900, Loss: 0.1125
Final loss: 0.10875401645898819
Achieved outputs: tensor([[0.4504, 0.4161, 0.4159,  ..., 0.4427, 0.4358, 0.4674],
        [0.4502, 0.4159, 0.4157,  ..., 0.4426, 0.4355, 0.4676],
        [0.4500, 0.4158, 0.4156,  ..., 0.4423, 0.4354, 0.4675],
        ...,
        [0.4501, 0.4157, 0.4154,  ..., 0.4425, 0.4355, 0.4673],
        [0.4503, 0.4158, 0.4156,  ..., 0.4427, 0.4357, 0.4675],
        [0.4507, 0.4165, 0.4160,  ..., 0.4431, 0.4357, 0.4677]],
       device='cuda:2')
Eval weight w_data: 0.2861966410242203
Before pretrain: integrated f1 0.2997
Epoch 100, Total loss: -14076855296.0000, CE loss: 943.4675, RL loss: -1407685632.0000, Reward: -286134238.2734
    full cols: 661, non-full cols: 4
   r - labels: 2, labels - r: 2
    violated: 102043, weighted: 1.4983558654785156, len: 0.0, nonzero: 0.13090723752975464
Epoch 200, Total loss: 6556019712.0000, CE loss: 885.7090, RL loss: 655601856.0000, Reward: -286112087.1562
    full cols: 661, non-full cols: 4
   r - labels: 2, labels - r: 2
    violated: 98477, weighted: 1.466207504272461, len: 0.0, nonzero: 0.130876362323761
Epoch 300, Total loss: -15028822016.0000, CE loss: 839.6129, RL loss: -1502882304.0000, Reward: -285148258.3047
    full cols: 662, non-full cols: 2
   r - labels: 1, labels - r: 2
    violated: 86292, weighted: 1.0527000427246094, len: 0.0, nonzero: 0.1309998780488968
------ Before ABL ------
--- eval ---
prediction result:
f1 on test:    0.4939
f1 on test:    0.7701 (micro)
f1 on KB:      0.2719
f1 on orig KB: 0.2719
integrated f1: 0.3039, w_data: 0.2862, w_klg: 0.7138

integrated result:
f1 on test:    0.4875
f1 on test:    0.7477 (micro)
f1 on KB:      0.4040
f1 on orig KB: 0.4040
integrated f1: 0.4234, w_data: 0.2862, w_klg: 0.7138
------------
integrated f1 0.3039

Epoch 100, Total loss: 208955359232.0000, CE loss: 55.9078, RL loss: 2089553536.0000, Reward: -18428248.8516
    full cols: 666, non-full cols: 2
   r - labels: 3, labels - r: 0
    violated: 158333, weighted: 0.9127659201622009, len: 0.0, nonzero: 0.1318521499633789
Epoch 200, Total loss: -68366835712.0000, CE loss: 55.1258, RL loss: -683668352.0000, Reward: -18239545.2812
    full cols: 665, non-full cols: 3
   r - labels: 3, labels - r: 0
    violated: 151852, weighted: 0.7644176483154297, len: 0.0, nonzero: 0.13183052837848663
Epoch 300, Total loss: -127540248576.0000, CE loss: 53.8763, RL loss: -1275402496.0000, Reward: -17762348.8594
    full cols: 663, non-full cols: 3
   r - labels: 3, labels - r: 2
    violated: 147883, weighted: 1.0020396709442139, len: 0.0, nonzero: 0.13133028149604797
Epoch 400, Total loss: -75661811712.0000, CE loss: 52.7802, RL loss: -756618112.0000, Reward: -17463139.9453
    full cols: 664, non-full cols: 2
   r - labels: 4, labels - r: 3
    violated: 163790, weighted: 1.784214973449707, len: 0.0, nonzero: 0.13150012493133545
Epoch 500, Total loss: -148434894848.0000, CE loss: 51.5595, RL loss: -1484348928.0000, Reward: -17087596.3984
    full cols: 666, non-full cols: 1
   r - labels: 5, labels - r: 3
    violated: 167790, weighted: 2.3823165893554688, len: 0.0, nonzero: 0.13162672519683838
Epoch 600, Total loss: -83056549888.0000, CE loss: 50.0365, RL loss: -830565504.0000, Reward: -16527737.1641
    full cols: 664, non-full cols: 2
   r - labels: 4, labels - r: 3
    violated: 165562, weighted: 1.912597417831421, len: 0.0, nonzero: 0.13135498762130737
Epoch 700, Total loss: 122319355904.0000, CE loss: 48.4396, RL loss: 1223193600.0000, Reward: -15853200.3672
    full cols: 665, non-full cols: 4
   r - labels: 6, labels - r: 2
    violated: 159725, weighted: 2.877619981765747, len: 0.0, nonzero: 0.13164524734020233
Epoch 800, Total loss: 23758444544.0000, CE loss: 46.5584, RL loss: 237584448.0000, Reward: -14897238.5000
    full cols: 665, non-full cols: 1
   r - labels: 7, labels - r: 6
    violated: 166742, weighted: 4.670884609222412, len: 0.0, nonzero: 0.13144144415855408
Epoch 900, Total loss: 61027700736.0000, CE loss: 45.3136, RL loss: 610276992.0000, Reward: -14364353.8516
    full cols: 659, non-full cols: 2
   r - labels: 6, labels - r: 10
    violated: 165445, weighted: 10.114116668701172, len: 0.0, nonzero: 0.13050271570682526
Epoch 1000, Total loss: -20792958976.0000, CE loss: 43.3712, RL loss: -207929600.0000, Reward: -12886411.3828
    full cols: 663, non-full cols: 4
   r - labels: 11, labels - r: 9
    violated: 160539, weighted: 16.162342071533203, len: 0.0, nonzero: 0.13153716921806335
Epoch 1100, Total loss: 195697246208.0000, CE loss: 42.0678, RL loss: 1956972416.0000, Reward: -11681105.9375
    full cols: 664, non-full cols: 3
   r - labels: 11, labels - r: 9
    violated: 157452, weighted: 14.142112731933594, len: 0.0, nonzero: 0.13148468732833862
Epoch 1200, Total loss: 330912694272.0000, CE loss: 40.7578, RL loss: 3309126912.0000, Reward: -9475171.1094
    full cols: 665, non-full cols: 2
   r - labels: 15, labels - r: 13
    violated: 153912, weighted: 113.3816909790039, len: 0.0, nonzero: 0.13162364065647125
Epoch 1300, Total loss: 157476945920.0000, CE loss: 40.0762, RL loss: 1574769408.0000, Reward: -8019648.6016
    full cols: 665, non-full cols: 1
   r - labels: 14, labels - r: 13
    violated: 161173, weighted: 71.17250061035156, len: 0.0, nonzero: 0.13160820305347443
Epoch 1400, Total loss: -94954913792.0000, CE loss: 39.6348, RL loss: -949549120.0000, Reward: -7142879.0859
    full cols: 663, non-full cols: 0
   r - labels: 13, labels - r: 15
    violated: 156919, weighted: 86.22334289550781, len: 0.0, nonzero: 0.13102766871452332
Epoch 1500, Total loss: -152395300864.0000, CE loss: 39.3309, RL loss: -1523953024.0000, Reward: -6683172.0391
    full cols: 666, non-full cols: 1
   r - labels: 15, labels - r: 13
    violated: 147184, weighted: 121.09407043457031, len: 0.0, nonzero: 0.1318150907754898
Epoch 1600, Total loss: -218357989376.0000, CE loss: 39.0578, RL loss: -2183579904.0000, Reward: -6638443.5195
    full cols: 674, non-full cols: 0
   r - labels: 21, labels - r: 12
    violated: 150342, weighted: 232.36209106445312, len: 0.0, nonzero: 0.13320158421993256
Epoch 1700, Total loss: -94834171904.0000, CE loss: 38.7765, RL loss: -948341696.0000, Reward: -6542001.2227
    full cols: 678, non-full cols: 3
   r - labels: 29, labels - r: 13
    violated: 146376, weighted: 291.6650390625, len: 0.0, nonzero: 0.13406310975551605
Epoch 1800, Total loss: -148737949696.0000, CE loss: 38.5206, RL loss: -1487379456.0000, Reward: -6435758.1719
    full cols: 681, non-full cols: 0
   r - labels: 31, labels - r: 15
    violated: 167049, weighted: 382.256591796875, len: 0.0, nonzero: 0.13458497822284698
Epoch 1900, Total loss: -11423299584.0000, CE loss: 38.1847, RL loss: -114233000.0000, Reward: -6457718.6602
    full cols: 687, non-full cols: 1
   r - labels: 38, labels - r: 15
    violated: 149710, weighted: 523.352783203125, len: 0.0, nonzero: 0.13588808476924896
--- eval ---
prediction result:
f1 on test:    0.5028
f1 on test:    0.7696 (micro)
f1 on KB:      0.3061
integrated f1: 0.3399, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4851
f1 on test:    0.7439 (micro)
f1 on KB:      0.4116
integrated f1: 0.4300, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: -1529686272.0000, CE loss: 37.9357, RL loss: -15296863.0000, Reward: -6393228.6016
    full cols: 685, non-full cols: 3
   r - labels: 39, labels - r: 16
    violated: 158777, weighted: 535.5162963867188, len: 0.0, nonzero: 0.1356472373008728
Epoch 2100, Total loss: 98968313856.0000, CE loss: 37.6130, RL loss: 989683136.0000, Reward: -6370911.9453
    full cols: 682, non-full cols: 3
   r - labels: 39, labels - r: 19
    violated: 156720, weighted: 551.6307983398438, len: 0.0, nonzero: 0.13502345979213715
Epoch 2200, Total loss: 122182860800.0000, CE loss: 37.3286, RL loss: 1221828608.0000, Reward: -6305272.3320
    full cols: 683, non-full cols: 2
   r - labels: 39, labels - r: 19
    violated: 149562, weighted: 608.861572265625, len: 0.0, nonzero: 0.13517478108406067
Epoch 2300, Total loss: 173532856320.0000, CE loss: 37.0718, RL loss: 1735328640.0000, Reward: -6257121.5625
    full cols: 679, non-full cols: 3
   r - labels: 37, labels - r: 20
    violated: 146714, weighted: 640.54736328125, len: 0.0, nonzero: 0.1344398409128189
Epoch 2400, Total loss: -128628580352.0000, CE loss: 36.8373, RL loss: -1286285824.0000, Reward: -6210490.4180
    full cols: 677, non-full cols: 4
   r - labels: 38, labels - r: 22
    violated: 144291, weighted: 740.63037109375, len: 0.0, nonzero: 0.13409708440303802
Epoch 2500, Total loss: 133687500800.0000, CE loss: 36.6472, RL loss: 1336875008.0000, Reward: -6164081.2812
    full cols: 668, non-full cols: 3
   r - labels: 35, labels - r: 29
    violated: 159145, weighted: 736.9177856445312, len: 0.0, nonzero: 0.13224123418331146
Epoch 2600, Total loss: -75410423808.0000, CE loss: 36.4946, RL loss: -754104256.0000, Reward: -6152398.9062
    full cols: 672, non-full cols: 5
   r - labels: 42, labels - r: 30
    violated: 133486, weighted: 978.5814208984375, len: 0.0, nonzero: 0.13356904685497284
Epoch 2700, Total loss: -70558031872.0000, CE loss: 36.3668, RL loss: -705580352.0000, Reward: -6170294.6094
    full cols: 675, non-full cols: 1
   r - labels: 40, labels - r: 29
    violated: 167874, weighted: 931.8771362304688, len: 0.0, nonzero: 0.1334300935268402
Epoch 2800, Total loss: -82805424128.0000, CE loss: 36.2997, RL loss: -828054272.0000, Reward: -6193796.4648
    full cols: 676, non-full cols: 6
   r - labels: 47, labels - r: 30
    violated: 152384, weighted: 1085.60498046875, len: 0.0, nonzero: 0.13394886255264282
Epoch 2900, Total loss: -157274374144.0000, CE loss: 36.1885, RL loss: -1572743808.0000, Reward: -6206790.6836
    full cols: 683, non-full cols: 3
   r - labels: 51, labels - r: 30
    violated: 161416, weighted: 1186.6009521484375, len: 0.0, nonzero: 0.1353631466627121
Epoch 3000, Total loss: -205305364480.0000, CE loss: 36.1036, RL loss: -2053053568.0000, Reward: -6259517.4219
    full cols: 684, non-full cols: 3
   r - labels: 56, labels - r: 34
    violated: 148655, weighted: 1400.8798828125, len: 0.0, nonzero: 0.13557620346546173
Epoch 3100, Total loss: 114679758848.0000, CE loss: 36.0493, RL loss: 1146797568.0000, Reward: -6249369.3516
    full cols: 681, non-full cols: 6
   r - labels: 59, labels - r: 37
    violated: 144502, weighted: 1451.77783203125, len: 0.0, nonzero: 0.13510993123054504
Epoch 3200, Total loss: 197796052992.0000, CE loss: 35.9964, RL loss: 1977960576.0000, Reward: -6243623.6562
    full cols: 687, non-full cols: 9
   r - labels: 62, labels - r: 31
    violated: 161252, weighted: 1480.35986328125, len: 0.0, nonzero: 0.13654273748397827
Epoch 3300, Total loss: 29664550912.0000, CE loss: 35.9697, RL loss: 296645504.0000, Reward: -6292552.8281
    full cols: 691, non-full cols: 6
   r - labels: 65, labels - r: 33
    violated: 145574, weighted: 1553.11669921875, len: 0.0, nonzero: 0.1371263563632965
Epoch 3400, Total loss: -408361336832.0000, CE loss: 35.9117, RL loss: -4083613440.0000, Reward: -6344119.0234
    full cols: 692, non-full cols: 8
   r - labels: 70, labels - r: 35
    violated: 154797, weighted: 1723.0706787109375, len: 0.0, nonzero: 0.13771305978298187
Epoch 3500, Total loss: -13441435648.0000, CE loss: 35.8407, RL loss: -134414352.0000, Reward: -6284807.2422
    full cols: 693, non-full cols: 8
   r - labels: 73, labels - r: 37
    violated: 158590, weighted: 1783.3809814453125, len: 0.0, nonzero: 0.13794775307178497
Epoch 3600, Total loss: 108677955584.0000, CE loss: 35.8323, RL loss: 1086779520.0000, Reward: -6273574.9023
    full cols: 697, non-full cols: 9
   r - labels: 75, labels - r: 34
    violated: 136109, weighted: 1830.3658447265625, len: 0.0, nonzero: 0.13864871859550476
Epoch 3700, Total loss: 134297690112.0000, CE loss: 35.7859, RL loss: 1342976896.0000, Reward: -6267460.9531
    full cols: 694, non-full cols: 8
   r - labels: 80, labels - r: 43
    violated: 157001, weighted: 2075.673828125, len: 0.0, nonzero: 0.1378767192363739
Epoch 3800, Total loss: 40327340032.0000, CE loss: 35.7521, RL loss: 403273408.0000, Reward: -6265709.4727
    full cols: 694, non-full cols: 7
   r - labels: 80, labels - r: 44
    violated: 153018, weighted: 2133.7998046875, len: 0.0, nonzero: 0.1379878968000412
Epoch 3900, Total loss: -123307851776.0000, CE loss: 35.7280, RL loss: -1233078528.0000, Reward: -6287107.2969
    full cols: 692, non-full cols: 6
   r - labels: 78, labels - r: 45
    violated: 146990, weighted: 2013.4495849609375, len: 0.0, nonzero: 0.1373826563358307
--- eval ---
prediction result:
f1 on test:    0.4909
f1 on test:    0.7509 (micro)
f1 on KB:      0.3248
integrated f1: 0.3562, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4836
f1 on test:    0.7407 (micro)
f1 on KB:      0.4168
integrated f1: 0.4339, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: -64382656512.0000, CE loss: 35.7237, RL loss: -643826560.0000, Reward: -6285928.8203
    full cols: 695, non-full cols: 9
   r - labels: 84, labels - r: 45
    violated: 151793, weighted: 2099.40576171875, len: 0.0, nonzero: 0.1381608247756958
Epoch 4100, Total loss: 81530175488.0000, CE loss: 35.7023, RL loss: 815301760.0000, Reward: -6268563.4297
    full cols: 695, non-full cols: 13
   r - labels: 86, labels - r: 43
    violated: 149180, weighted: 2034.8409423828125, len: 0.0, nonzero: 0.1393435001373291
Epoch 4200, Total loss: 7560274432.0000, CE loss: 35.6582, RL loss: 75602744.0000, Reward: -6272905.4922
    full cols: 701, non-full cols: 10
   r - labels: 92, labels - r: 46
    violated: 159587, weighted: 2134.156494140625, len: 0.0, nonzero: 0.1395905315876007
Epoch 4300, Total loss: 28711049216.0000, CE loss: 35.6955, RL loss: 287110496.0000, Reward: -6244522.6914
    full cols: 703, non-full cols: 2
   r - labels: 88, labels - r: 48
    violated: 150263, weighted: 2067.2958984375, len: 0.0, nonzero: 0.13901618123054504
Epoch 4400, Total loss: 119528873984.0000, CE loss: 35.6263, RL loss: 1195288704.0000, Reward: -6219238.6328
    full cols: 701, non-full cols: 4
   r - labels: 88, labels - r: 48
    violated: 163612, weighted: 2024.474853515625, len: 0.0, nonzero: 0.1389111876487732
Epoch 4500, Total loss: -23328983040.0000, CE loss: 35.6199, RL loss: -233289840.0000, Reward: -6232587.0430
    full cols: 703, non-full cols: 4
   r - labels: 89, labels - r: 47
    violated: 150925, weighted: 2150.36083984375, len: 0.0, nonzero: 0.13916131854057312
Epoch 4600, Total loss: 81314275328.0000, CE loss: 35.5956, RL loss: 813142720.0000, Reward: -6225084.6367
    full cols: 710, non-full cols: 6
   r - labels: 100, labels - r: 49
    violated: 141845, weighted: 2381.220458984375, len: 0.0, nonzero: 0.14063426852226257
Epoch 4700, Total loss: 98891120640.0000, CE loss: 35.5831, RL loss: 988911168.0000, Reward: -6206888.2891
    full cols: 709, non-full cols: 9
   r - labels: 107, labels - r: 54
    violated: 153706, weighted: 2577.395751953125, len: 0.0, nonzero: 0.14088746905326843
Epoch 4800, Total loss: 238437531648.0000, CE loss: 35.5925, RL loss: 2384375296.0000, Reward: -6197758.6484
    full cols: 705, non-full cols: 11
   r - labels: 104, labels - r: 53
    violated: 154750, weighted: 2540.35400390625, len: 0.0, nonzero: 0.14045824110507965
Epoch 4900, Total loss: 70313238528.0000, CE loss: 35.5838, RL loss: 703132416.0000, Reward: -6196325.7266
    full cols: 700, non-full cols: 3
   r - labels: 102, labels - r: 64
    violated: 149875, weighted: 2724.93212890625, len: 0.0, nonzero: 0.1384943127632141
Epoch 5000, Total loss: -65391050752.0000, CE loss: 35.5931, RL loss: -653910528.0000, Reward: -6227804.1953
    full cols: 696, non-full cols: 6
   r - labels: 101, labels - r: 64
    violated: 153273, weighted: 2785.471435546875, len: 0.0, nonzero: 0.13838931918144226
Epoch 5100, Total loss: 124494823424.0000, CE loss: 35.5391, RL loss: 1244948224.0000, Reward: -6213320.7188
    full cols: 695, non-full cols: 9
   r - labels: 107, labels - r: 68
    violated: 150546, weighted: 2953.023193359375, len: 0.0, nonzero: 0.13824109733104706
Epoch 5200, Total loss: 114010882048.0000, CE loss: 35.5311, RL loss: 1140108800.0000, Reward: -6196035.4766
    full cols: 708, non-full cols: 10
   r - labels: 119, labels - r: 66
    violated: 150801, weighted: 3096.629638671875, len: 0.0, nonzero: 0.14077630639076233
Epoch 5300, Total loss: -44532060160.0000, CE loss: 35.5119, RL loss: -445320608.0000, Reward: -6213394.4883
    full cols: 697, non-full cols: 13
   r - labels: 117, labels - r: 72
    violated: 152748, weighted: 3207.04345703125, len: 0.0, nonzero: 0.13875988125801086
Epoch 5400, Total loss: -254871732224.0000, CE loss: 35.5031, RL loss: -2548717312.0000, Reward: -6246505.8281
    full cols: 705, non-full cols: 6
   r - labels: 118, labels - r: 72
    violated: 159122, weighted: 3354.8134765625, len: 0.0, nonzero: 0.13979743421077728
Epoch 5500, Total loss: 95276007424.0000, CE loss: 35.4879, RL loss: 952760064.0000, Reward: -6236613.8281
    full cols: 702, non-full cols: 11
   r - labels: 121, labels - r: 73
    violated: 153065, weighted: 3466.065673828125, len: 0.0, nonzero: 0.13985301554203033
Epoch 5600, Total loss: 32739624960.0000, CE loss: 35.4846, RL loss: 327396256.0000, Reward: -6273684.0156
    full cols: 715, non-full cols: 17
   r - labels: 140, labels - r: 73
    violated: 149207, weighted: 3880.486328125, len: 0.0, nonzero: 0.1427680253982544
Epoch 5700, Total loss: -18352840704.0000, CE loss: 35.5375, RL loss: -183528416.0000, Reward: -6278532.8750
    full cols: 722, non-full cols: 9
   r - labels: 140, labels - r: 74
    violated: 151455, weighted: 4037.395751953125, len: 0.0, nonzero: 0.14339180290699005
Epoch 5800, Total loss: -20160710656.0000, CE loss: 35.4867, RL loss: -201607104.0000, Reward: -6285668.6406
    full cols: 716, non-full cols: 19
   r - labels: 151, labels - r: 81
    violated: 160897, weighted: 4454.681640625, len: 0.0, nonzero: 0.14370985329151154
Epoch 5900, Total loss: -100768636928.0000, CE loss: 35.4783, RL loss: -1007686400.0000, Reward: -6294731.1562
    full cols: 741, non-full cols: 10
   r - labels: 166, labels - r: 80
    violated: 152566, weighted: 4594.21875, len: 0.0, nonzero: 0.1477828472852707
--- eval ---
prediction result:
f1 on test:    0.4909
f1 on test:    0.7509 (micro)
f1 on KB:      0.3248
integrated f1: 0.3562, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4815
f1 on test:    0.7360 (micro)
f1 on KB:      0.4271
integrated f1: 0.4415, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: -117459927040.0000, CE loss: 35.4611, RL loss: -1174599296.0000, Reward: -6333093.7891
    full cols: 736, non-full cols: 16
   r - labels: 168, labels - r: 81
    violated: 158808, weighted: 4551.15234375, len: 0.0, nonzero: 0.14789710938930511
Epoch 6100, Total loss: 193411956736.0000, CE loss: 35.4808, RL loss: 1934119552.0000, Reward: -6316219.1172
    full cols: 743, non-full cols: 13
   r - labels: 176, labels - r: 85
    violated: 149919, weighted: 4661.0859375, len: 0.0, nonzero: 0.1478199064731598
Epoch 6200, Total loss: 30183350272.0000, CE loss: 35.5099, RL loss: 301833504.0000, Reward: -6333057.1484
    full cols: 743, non-full cols: 27
   r - labels: 189, labels - r: 84
    violated: 147646, weighted: 4975.9951171875, len: 0.0, nonzero: 0.14956459403038025
Epoch 6300, Total loss: 316826943488.0000, CE loss: 35.4398, RL loss: 3168269568.0000, Reward: -6300604.9141
    full cols: 729, non-full cols: 20
   r - labels: 170, labels - r: 86
    violated: 152191, weighted: 4756.50244140625, len: 0.0, nonzero: 0.14635930955410004
Epoch 6400, Total loss: 103013507072.0000, CE loss: 35.4526, RL loss: 1030135104.0000, Reward: -6338628.1289
    full cols: 734, non-full cols: 7
   r - labels: 170, labels - r: 94
    violated: 148051, weighted: 4842.123046875, len: 0.0, nonzero: 0.14585289359092712
Epoch 6500, Total loss: -217459965952.0000, CE loss: 35.4579, RL loss: -2174599680.0000, Reward: -6379760.7812
    full cols: 726, non-full cols: 26
   r - labels: 178, labels - r: 91
    violated: 163097, weighted: 4874.986328125, len: 0.0, nonzero: 0.1461091935634613
Epoch 6600, Total loss: 16045393920.0000, CE loss: 35.4548, RL loss: 160453936.0000, Reward: -6367583.2188
    full cols: 735, non-full cols: 20
   r - labels: 183, labels - r: 93
    violated: 149065, weighted: 5180.40625, len: 0.0, nonzero: 0.14729805290699005
Epoch 6700, Total loss: -72539676672.0000, CE loss: 35.4573, RL loss: -725396736.0000, Reward: -6383369.1211
    full cols: 730, non-full cols: 15
   r - labels: 178, labels - r: 98
    violated: 145705, weighted: 5354.12890625, len: 0.0, nonzero: 0.1462419629096985
Epoch 6800, Total loss: 214728687616.0000, CE loss: 35.4303, RL loss: 2147286912.0000, Reward: -6346770.5547
    full cols: 727, non-full cols: 15
   r - labels: 176, labels - r: 99
    violated: 150875, weighted: 5352.0537109375, len: 0.0, nonzero: 0.1452198624610901
Epoch 6900, Total loss: -127268093952.0000, CE loss: 35.4260, RL loss: -1272680960.0000, Reward: -6390962.3867
    full cols: 724, non-full cols: 26
   r - labels: 187, labels - r: 102
    violated: 135836, weighted: 5482.759765625, len: 0.0, nonzero: 0.14606595039367676
Epoch 7000, Total loss: 64884326400.0000, CE loss: 35.4123, RL loss: 648843264.0000, Reward: -6384096.9258
    full cols: 725, non-full cols: 16
   r - labels: 185, labels - r: 109
    violated: 145302, weighted: 5688.87841796875, len: 0.0, nonzero: 0.14531250298023224
Epoch 7100, Total loss: 48257925120.0000, CE loss: 35.4385, RL loss: 482579264.0000, Reward: -6365486.9141
    full cols: 724, non-full cols: 13
   r - labels: 183, labels - r: 111
    violated: 149920, weighted: 5869.728515625, len: 0.0, nonzero: 0.14416378736495972
Epoch 7200, Total loss: -92570263552.0000, CE loss: 35.4279, RL loss: -925702656.0000, Reward: -6383088.6367
    full cols: 714, non-full cols: 16
   r - labels: 177, labels - r: 112
    violated: 151686, weighted: 5775.7353515625, len: 0.0, nonzero: 0.14230792224407196
Epoch 7300, Total loss: -92776841216.0000, CE loss: 35.4365, RL loss: -927768448.0000, Reward: -6376762.6406
    full cols: 724, non-full cols: 10
   r - labels: 186, labels - r: 117
    violated: 139065, weighted: 5963.52197265625, len: 0.0, nonzero: 0.1445065438747406
Epoch 7400, Total loss: 50512457728.0000, CE loss: 35.4173, RL loss: 505124576.0000, Reward: -6380453.0977
    full cols: 722, non-full cols: 15
   r - labels: 191, labels - r: 119
    violated: 157534, weighted: 6135.9765625, len: 0.0, nonzero: 0.14458683133125305
Epoch 7500, Total loss: -283636137984.0000, CE loss: 35.4133, RL loss: -2836361216.0000, Reward: -6383983.7695
    full cols: 733, non-full cols: 18
   r - labels: 205, labels - r: 119
    violated: 153842, weighted: 6410.77001953125, len: 0.0, nonzero: 0.1471436470746994
Epoch 7600, Total loss: 199711277056.0000, CE loss: 35.3941, RL loss: 1997112704.0000, Reward: -6343568.0000
    full cols: 721, non-full cols: 22
   r - labels: 198, labels - r: 120
    violated: 162330, weighted: 6370.29443359375, len: 0.0, nonzero: 0.14404335618019104
Epoch 7700, Total loss: 153805504512.0000, CE loss: 35.4384, RL loss: 1538055040.0000, Reward: -6380310.0781
    full cols: 735, non-full cols: 8
   r - labels: 200, labels - r: 122
    violated: 152511, weighted: 6627.8701171875, len: 0.0, nonzero: 0.1458374410867691
Epoch 7800, Total loss: -209009311744.0000, CE loss: 35.3945, RL loss: -2090093056.0000, Reward: -6423330.9141
    full cols: 738, non-full cols: 16
   r - labels: 211, labels - r: 122
    violated: 154554, weighted: 6730.97314453125, len: 0.0, nonzero: 0.14779211580753326
Epoch 7900, Total loss: 96927563776.0000, CE loss: 35.4194, RL loss: 969275648.0000, Reward: -6384562.9727
    full cols: 727, non-full cols: 18
   r - labels: 205, labels - r: 125
    violated: 153393, weighted: 6630.8095703125, len: 0.0, nonzero: 0.1456274688243866
--- eval ---
prediction result:
f1 on test:    0.4909
f1 on test:    0.7509 (micro)
f1 on KB:      0.3248
integrated f1: 0.3562, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4809
f1 on test:    0.7337 (micro)
f1 on KB:      0.4260
integrated f1: 0.4405, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: -117062000640.0000, CE loss: 35.3802, RL loss: -1170620032.0000, Reward: -6389302.4062
    full cols: 723, non-full cols: 24
   r - labels: 209, labels - r: 127
    violated: 145648, weighted: 6649.447265625, len: 0.0, nonzero: 0.14523838460445404
Epoch 8100, Total loss: -90155794432.0000, CE loss: 35.3804, RL loss: -901557952.0000, Reward: -6380388.9219
    full cols: 719, non-full cols: 26
   r - labels: 205, labels - r: 125
    violated: 144980, weighted: 6910.369140625, len: 0.0, nonzero: 0.14401865005493164
Epoch 8200, Total loss: 37377937408.0000, CE loss: 35.4086, RL loss: 373779392.0000, Reward: -6398125.8906
    full cols: 714, non-full cols: 28
   r - labels: 204, labels - r: 127
    violated: 148407, weighted: 6722.2734375, len: 0.0, nonzero: 0.14383645355701447
Epoch 8300, Total loss: 102898147328.0000, CE loss: 35.3953, RL loss: 1028981440.0000, Reward: -6378903.0547
    full cols: 709, non-full cols: 21
   r - labels: 200, labels - r: 135
    violated: 151802, weighted: 6711.23974609375, len: 0.0, nonzero: 0.14227396249771118
Epoch 8400, Total loss: 22243508224.0000, CE loss: 35.4197, RL loss: 222435088.0000, Reward: -6371028.0820
    full cols: 713, non-full cols: 19
   r - labels: 206, labels - r: 139
    violated: 162787, weighted: 6777.5048828125, len: 0.0, nonzero: 0.1422523409128189
Epoch 8500, Total loss: -100063264768.0000, CE loss: 35.4080, RL loss: -1000632640.0000, Reward: -6370504.8281
    full cols: 720, non-full cols: 16
   r - labels: 208, labels - r: 137
    violated: 147213, weighted: 6880.9345703125, len: 0.0, nonzero: 0.14411437511444092
Epoch 8600, Total loss: -29322162176.0000, CE loss: 35.3902, RL loss: -293221632.0000, Reward: -6355757.6562
    full cols: 728, non-full cols: 16
   r - labels: 216, labels - r: 137
    violated: 153768, weighted: 7156.484375, len: 0.0, nonzero: 0.14464858174324036
Epoch 8700, Total loss: -165565906944.0000, CE loss: 35.3977, RL loss: -1655659008.0000, Reward: -6357685.0625
    full cols: 719, non-full cols: 22
   r - labels: 217, labels - r: 141
    violated: 151414, weighted: 7197.67724609375, len: 0.0, nonzero: 0.1441359966993332
Epoch 8800, Total loss: 41044930560.0000, CE loss: 35.3780, RL loss: 410449312.0000, Reward: -6331373.4766
    full cols: 723, non-full cols: 18
   r - labels: 220, labels - r: 144
    violated: 153704, weighted: 7377.6787109375, len: 0.0, nonzero: 0.14400321245193481
Epoch 8900, Total loss: -19767994368.0000, CE loss: 35.3490, RL loss: -197679936.0000, Reward: -6350502.8242
    full cols: 722, non-full cols: 20
   r - labels: 224, labels - r: 147
    violated: 149408, weighted: 7551.5791015625, len: 0.0, nonzero: 0.14478446543216705
Epoch 9000, Total loss: -169344401408.0000, CE loss: 35.3689, RL loss: -1693443968.0000, Reward: -6356482.7109
    full cols: 718, non-full cols: 16
   r - labels: 221, labels - r: 152
    violated: 144275, weighted: 7656.7939453125, len: 0.0, nonzero: 0.14367279410362244
Epoch 9100, Total loss: 10019480576.0000, CE loss: 35.3596, RL loss: 100194808.0000, Reward: -6321622.9766
    full cols: 720, non-full cols: 8
   r - labels: 219, labels - r: 156
    violated: 148693, weighted: 7885.31298828125, len: 0.0, nonzero: 0.1430644690990448
Epoch 9200, Total loss: -102550528000.0000, CE loss: 35.3565, RL loss: -1025505280.0000, Reward: -6350030.4492
    full cols: 729, non-full cols: 12
   r - labels: 232, labels - r: 156
    violated: 140178, weighted: 8004.16748046875, len: 0.0, nonzero: 0.14551939070224762
Epoch 9300, Total loss: -115000549376.0000, CE loss: 35.3529, RL loss: -1150005504.0000, Reward: -6337616.7344
    full cols: 720, non-full cols: 23
   r - labels: 231, labels - r: 153
    violated: 154108, weighted: 7876.4287109375, len: 0.0, nonzero: 0.1452847123146057
Epoch 9400, Total loss: -48064606208.0000, CE loss: 35.4029, RL loss: -480646080.0000, Reward: -6342232.4219
    full cols: 719, non-full cols: 21
   r - labels: 232, labels - r: 157
    violated: 136601, weighted: 8232.470703125, len: 0.0, nonzero: 0.14369750022888184
Epoch 9500, Total loss: -211390906368.0000, CE loss: 35.3853, RL loss: -2113909120.0000, Reward: -6353750.5078
    full cols: 713, non-full cols: 16
   r - labels: 225, labels - r: 161
    violated: 147886, weighted: 8051.1552734375, len: 0.0, nonzero: 0.14189723134040833
Epoch 9600, Total loss: 19356215296.0000, CE loss: 35.4024, RL loss: 193562144.0000, Reward: -6318033.7266
    full cols: 713, non-full cols: 24
   r - labels: 235, labels - r: 163
    violated: 149179, weighted: 8275.3388671875, len: 0.0, nonzero: 0.14369750022888184
Epoch 9700, Total loss: 155587231744.0000, CE loss: 35.3810, RL loss: 1555872256.0000, Reward: -6316509.5859
    full cols: 716, non-full cols: 18
   r - labels: 234, labels - r: 165
    violated: 151560, weighted: 8274.9287109375, len: 0.0, nonzero: 0.14320960640907288
Epoch 9800, Total loss: 49717903360.0000, CE loss: 35.3544, RL loss: 497179040.0000, Reward: -6324251.1641
    full cols: 720, non-full cols: 17
   r - labels: 241, labels - r: 169
    violated: 147532, weighted: 8584.0, len: 0.0, nonzero: 0.143864244222641
Epoch 9900, Total loss: -164845355008.0000, CE loss: 35.3475, RL loss: -1648453632.0000, Reward: -6344098.7500
    full cols: 719, non-full cols: 9
   r - labels: 240, labels - r: 177
    violated: 158282, weighted: 8656.966796875, len: 0.0, nonzero: 0.14283595979213715
--- eval ---
prediction result:
f1 on test:    0.4909
f1 on test:    0.7509 (micro)
f1 on KB:      0.3248
integrated f1: 0.3562, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4795
f1 on test:    0.7295 (micro)
f1 on KB:      0.4302
integrated f1: 0.4433, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 10000, Total loss: 118780379136.0000, CE loss: 35.3690, RL loss: 1187803776.0000, Reward: -6293506.4648
    full cols: 707, non-full cols: 21
   r - labels: 246, labels - r: 183
    violated: 157835, weighted: 8783.009765625, len: 0.0, nonzero: 0.14204545319080353
Epoch 10100, Total loss: -16157550592.0000, CE loss: 35.3502, RL loss: -161575504.0000, Reward: -6285807.1094
    full cols: 710, non-full cols: 21
   r - labels: 250, labels - r: 184
    violated: 154023, weighted: 8977.0986328125, len: 0.0, nonzero: 0.14281435310840607
Epoch 10200, Total loss: -82361122816.0000, CE loss: 35.3689, RL loss: -823611200.0000, Reward: -6278112.8633
    full cols: 717, non-full cols: 23
   r - labels: 264, labels - r: 189
    violated: 149045, weighted: 9453.162109375, len: 0.0, nonzero: 0.14383645355701447
Epoch 10300, Total loss: -55858290688.0000, CE loss: 35.3782, RL loss: -558582912.0000, Reward: -6270084.5547
    full cols: 719, non-full cols: 14
   r - labels: 261, labels - r: 193
    violated: 156237, weighted: 9436.451171875, len: 0.0, nonzero: 0.14320960640907288
Epoch 10400, Total loss: 3855975168.0000, CE loss: 35.3783, RL loss: 38559752.0000, Reward: -6266095.8984
    full cols: 723, non-full cols: 15
   r - labels: 262, labels - r: 189
    violated: 146455, weighted: 9410.58203125, len: 0.0, nonzero: 0.14421628415584564
Epoch 10500, Total loss: 245513928704.0000, CE loss: 35.3704, RL loss: 2455139328.0000, Reward: -6236988.2148
    full cols: 713, non-full cols: 25
   r - labels: 262, labels - r: 189
    violated: 153778, weighted: 9283.947265625, len: 0.0, nonzero: 0.14268465340137482
Epoch 10600, Total loss: 101120319488.0000, CE loss: 35.3794, RL loss: 1011203200.0000, Reward: -6247669.1680
    full cols: 709, non-full cols: 13
   r - labels: 252, labels - r: 195
    violated: 144681, weighted: 9487.26953125, len: 0.0, nonzero: 0.14170269668102264
Epoch 10700, Total loss: 64933183488.0000, CE loss: 35.3252, RL loss: 649331840.0000, Reward: -6248812.3203
    full cols: 708, non-full cols: 12
   r - labels: 252, labels - r: 197
    violated: 151841, weighted: 9443.1103515625, len: 0.0, nonzero: 0.14120861887931824
Epoch 10800, Total loss: -80834985984.0000, CE loss: 35.3439, RL loss: -808349824.0000, Reward: -6274023.7422
    full cols: 714, non-full cols: 28
   r - labels: 266, labels - r: 189
    violated: 156242, weighted: 9756.4462890625, len: 0.0, nonzero: 0.14366044104099274
Epoch 10900, Total loss: -33009836032.0000, CE loss: 35.3298, RL loss: -330098368.0000, Reward: -6277019.6328
    full cols: 721, non-full cols: 18
   r - labels: 272, labels - r: 198
    violated: 160309, weighted: 9965.337890625, len: 0.0, nonzero: 0.14401865005493164
Epoch 11000, Total loss: 204131500032.0000, CE loss: 35.3330, RL loss: 2041314944.0000, Reward: -6260996.6211
    full cols: 716, non-full cols: 28
   r - labels: 284, labels - r: 205
    violated: 152736, weighted: 10206.1943359375, len: 0.0, nonzero: 0.14355546236038208
Epoch 11100, Total loss: -185376440320.0000, CE loss: 35.3516, RL loss: -1853764352.0000, Reward: -6303008.8242
    full cols: 726, non-full cols: 18
   r - labels: 283, labels - r: 204
    violated: 159924, weighted: 10345.0341796875, len: 0.0, nonzero: 0.14542366564273834
Epoch 11200, Total loss: 28115394560.0000, CE loss: 35.3361, RL loss: 281153952.0000, Reward: -6277674.1406
    full cols: 729, non-full cols: 14
   r - labels: 281, labels - r: 203
    violated: 149722, weighted: 10212.8623046875, len: 0.0, nonzero: 0.1454668939113617
Epoch 11300, Total loss: -23881420800.0000, CE loss: 35.3278, RL loss: -238814208.0000, Reward: -6277474.4062
    full cols: 718, non-full cols: 27
   r - labels: 289, labels - r: 209
    violated: 143876, weighted: 10381.12890625, len: 0.0, nonzero: 0.1453063189983368
Epoch 11400, Total loss: 139320131584.0000, CE loss: 35.3551, RL loss: 1393201280.0000, Reward: -6289128.6914
    full cols: 723, non-full cols: 13
   r - labels: 285, labels - r: 214
    violated: 150798, weighted: 10524.80078125, len: 0.0, nonzero: 0.14470107853412628
Epoch 11500, Total loss: -12944421888.0000, CE loss: 35.3618, RL loss: -129444216.0000, Reward: -6302188.1445
    full cols: 712, non-full cols: 19
   r - labels: 284, labels - r: 218
    violated: 149644, weighted: 10651.8876953125, len: 0.0, nonzero: 0.14238204061985016
Epoch 11600, Total loss: 845326208.0000, CE loss: 35.3465, RL loss: 8453262.0000, Reward: -6312877.9453
    full cols: 724, non-full cols: 14
   r - labels: 295, labels - r: 222
    violated: 146609, weighted: 11036.8115234375, len: 0.0, nonzero: 0.14498208463191986
Epoch 11700, Total loss: -177377198080.0000, CE loss: 35.3346, RL loss: -1773772032.0000, Reward: -6331627.1836
    full cols: 710, non-full cols: 27
   r - labels: 290, labels - r: 218
    violated: 139319, weighted: 10850.1171875, len: 0.0, nonzero: 0.14264759421348572
Epoch 11800, Total loss: 69469208576.0000, CE loss: 35.3525, RL loss: 694692096.0000, Reward: -6303584.4570
    full cols: 723, non-full cols: 20
   r - labels: 294, labels - r: 216
    violated: 148108, weighted: 10961.6064453125, len: 0.0, nonzero: 0.14521677792072296
Epoch 11900, Total loss: -24469229568.0000, CE loss: 35.3156, RL loss: -244692304.0000, Reward: -6310837.2656
    full cols: 718, non-full cols: 22
   r - labels: 290, labels - r: 215
    violated: 142133, weighted: 10788.037109375, len: 0.0, nonzero: 0.1440279185771942
--- eval ---
prediction result:
f1 on test:    0.4909
f1 on test:    0.7509 (micro)
f1 on KB:      0.3248
integrated f1: 0.3562, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4777
f1 on test:    0.7289 (micro)
f1 on KB:      0.4277
integrated f1: 0.4410, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 12000, Total loss: 45216948224.0000, CE loss: 35.3367, RL loss: 452169472.0000, Reward: -6298634.5234
    full cols: 720, non-full cols: 20
   r - labels: 295, labels - r: 220
    violated: 153153, weighted: 11116.830078125, len: 0.0, nonzero: 0.1443830281496048
Epoch 12100, Total loss: -133243772928.0000, CE loss: 35.3617, RL loss: -1332437760.0000, Reward: -6341160.2305
    full cols: 714, non-full cols: 17
   r - labels: 294, labels - r: 228
    violated: 152649, weighted: 11233.580078125, len: 0.0, nonzero: 0.1424376219511032
Epoch 12200, Total loss: -190572380160.0000, CE loss: 35.3451, RL loss: -1905723776.0000, Reward: -6345172.3359
    full cols: 718, non-full cols: 22
   r - labels: 303, labels - r: 228
    violated: 145699, weighted: 11279.408203125, len: 0.0, nonzero: 0.1441853940486908
Epoch 12300, Total loss: -159441780736.0000, CE loss: 35.3641, RL loss: -1594417792.0000, Reward: -6365596.1016
    full cols: 698, non-full cols: 25
   r - labels: 296, labels - r: 238
    violated: 144880, weighted: 11546.9912109375, len: 0.0, nonzero: 0.14048294723033905
Epoch 12400, Total loss: -8817408000.0000, CE loss: 35.3219, RL loss: -88174080.0000, Reward: -6347454.6289
    full cols: 711, non-full cols: 10
   r - labels: 302, labels - r: 246
    violated: 144081, weighted: 11721.689453125, len: 0.0, nonzero: 0.14131978154182434
Epoch 12500, Total loss: -126845157376.0000, CE loss: 35.3688, RL loss: -1268451584.0000, Reward: -6371989.6992
    full cols: 713, non-full cols: 16
   r - labels: 306, labels - r: 242
    violated: 146026, weighted: 11828.89453125, len: 0.0, nonzero: 0.1427062749862671
Epoch 12600, Total loss: -308574093312.0000, CE loss: 35.3263, RL loss: -3085740800.0000, Reward: -6400913.1719
    full cols: 702, non-full cols: 19
   r - labels: 295, labels - r: 239
    violated: 148037, weighted: 11682.0546875, len: 0.0, nonzero: 0.14055706560611725
Epoch 12700, Total loss: -258464530432.0000, CE loss: 35.3708, RL loss: -2584645376.0000, Reward: -6392047.2656
    full cols: 691, non-full cols: 31
   r - labels: 303, labels - r: 246
    violated: 157657, weighted: 11822.0556640625, len: 0.0, nonzero: 0.13904088735580444
Epoch 12800, Total loss: 80955613184.0000, CE loss: 35.3435, RL loss: 809556096.0000, Reward: -6364239.2812
    full cols: 712, non-full cols: 17
   r - labels: 306, labels - r: 242
    violated: 139478, weighted: 11837.17578125, len: 0.0, nonzero: 0.14243453741073608
Epoch 12900, Total loss: -32006559744.0000, CE loss: 35.3269, RL loss: -320065600.0000, Reward: -6390026.7734
    full cols: 717, non-full cols: 24
   r - labels: 319, labels - r: 243
    violated: 147440, weighted: 12389.8623046875, len: 0.0, nonzero: 0.14459609985351562
Epoch 13000, Total loss: -92713779200.0000, CE loss: 35.3207, RL loss: -927137792.0000, Reward: -6402401.7500
    full cols: 715, non-full cols: 21
   r - labels: 315, labels - r: 244
    violated: 154099, weighted: 12247.482421875, len: 0.0, nonzero: 0.14341340959072113
Epoch 13100, Total loss: 125002768384.0000, CE loss: 35.3205, RL loss: 1250027648.0000, Reward: -6389475.2109
    full cols: 715, non-full cols: 31
   r - labels: 325, labels - r: 244
    violated: 137245, weighted: 12449.6875, len: 0.0, nonzero: 0.145074725151062
Epoch 13200, Total loss: -22150871040.0000, CE loss: 35.3335, RL loss: -221508704.0000, Reward: -6402424.2461
    full cols: 710, non-full cols: 29
   r - labels: 324, labels - r: 250
    violated: 151602, weighted: 12446.3740234375, len: 0.0, nonzero: 0.14339488744735718
Epoch 13300, Total loss: -160709738496.0000, CE loss: 35.3215, RL loss: -1607097344.0000, Reward: -6416111.7070
    full cols: 716, non-full cols: 24
   r - labels: 328, labels - r: 253
    violated: 153965, weighted: 12657.4912109375, len: 0.0, nonzero: 0.14407114684581757
Epoch 13400, Total loss: -33409087488.0000, CE loss: 35.3163, RL loss: -334090880.0000, Reward: -6403168.3828
    full cols: 720, non-full cols: 28
   r - labels: 332, labels - r: 249
    violated: 149154, weighted: 12763.22265625, len: 0.0, nonzero: 0.1447659283876419
Epoch 13500, Total loss: -89498861568.0000, CE loss: 35.3630, RL loss: -894988608.0000, Reward: -6408523.5156
    full cols: 730, non-full cols: 25
   r - labels: 331, labels - r: 241
    violated: 149265, weighted: 12559.58203125, len: 0.0, nonzero: 0.14691822230815887
Epoch 13600, Total loss: -44207448064.0000, CE loss: 35.3202, RL loss: -442074464.0000, Reward: -6380719.3672
    full cols: 720, non-full cols: 23
   r - labels: 333, labels - r: 255
    violated: 148713, weighted: 12883.314453125, len: 0.0, nonzero: 0.1445930004119873
Epoch 13700, Total loss: -71390412800.0000, CE loss: 35.3301, RL loss: -713904128.0000, Reward: -6393415.2773
    full cols: 725, non-full cols: 14
   r - labels: 332, labels - r: 258
    violated: 150748, weighted: 12989.5908203125, len: 0.0, nonzero: 0.14482150971889496
Epoch 13800, Total loss: -39702069248.0000, CE loss: 35.3662, RL loss: -397020704.0000, Reward: -6397407.9648
    full cols: 717, non-full cols: 23
   r - labels: 330, labels - r: 255
    violated: 152272, weighted: 12934.599609375, len: 0.0, nonzero: 0.14390438795089722
Epoch 13900, Total loss: 189800005632.0000, CE loss: 35.3148, RL loss: 1898000000.0000, Reward: -6381673.2656
    full cols: 712, non-full cols: 27
   r - labels: 325, labels - r: 251
    violated: 147372, weighted: 12535.05078125, len: 0.0, nonzero: 0.143484428524971
--- eval ---
prediction result:
f1 on test:    0.4909
f1 on test:    0.7509 (micro)
f1 on KB:      0.3248
integrated f1: 0.3562, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4774
f1 on test:    0.7261 (micro)
f1 on KB:      0.4316
integrated f1: 0.4440, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 14000, Total loss: 135973994496.0000, CE loss: 35.3189, RL loss: 1359739904.0000, Reward: -6356890.1094
    full cols: 709, non-full cols: 19
   r - labels: 318, labels - r: 255
    violated: 156260, weighted: 12494.9599609375, len: 0.0, nonzero: 0.14159151911735535
Epoch 14100, Total loss: -113151344640.0000, CE loss: 35.3488, RL loss: -1131513472.0000, Reward: -6327778.1250
    full cols: 703, non-full cols: 11
   r - labels: 312, labels - r: 263
    violated: 148123, weighted: 12574.556640625, len: 0.0, nonzero: 0.139973446726799
Epoch 14200, Total loss: 94909521920.0000, CE loss: 35.3524, RL loss: 949095232.0000, Reward: -6314708.5547
    full cols: 706, non-full cols: 10
   r - labels: 319, labels - r: 268
    violated: 152380, weighted: 12898.896484375, len: 0.0, nonzero: 0.1409090906381607
Epoch 14300, Total loss: 135995342848.0000, CE loss: 35.3121, RL loss: 1359953408.0000, Reward: -6307440.2461
    full cols: 708, non-full cols: 20
   r - labels: 328, labels - r: 265
    violated: 152155, weighted: 12919.65625, len: 0.0, nonzero: 0.14250247180461884
Epoch 14400, Total loss: 119184220160.0000, CE loss: 35.3636, RL loss: 1191842176.0000, Reward: -6305644.1016
    full cols: 706, non-full cols: 15
   r - labels: 319, labels - r: 263
    violated: 147022, weighted: 12683.880859375, len: 0.0, nonzero: 0.14105422794818878
Epoch 14500, Total loss: -81540554752.0000, CE loss: 35.3157, RL loss: -815405568.0000, Reward: -6350544.2852
    full cols: 700, non-full cols: 21
   r - labels: 319, labels - r: 263
    violated: 154591, weighted: 12862.361328125, len: 0.0, nonzero: 0.14088129997253418
Epoch 14600, Total loss: 24826269696.0000, CE loss: 35.3094, RL loss: 248262688.0000, Reward: -6305346.6797
    full cols: 705, non-full cols: 13
   r - labels: 320, labels - r: 267
    violated: 141694, weighted: 12924.283203125, len: 0.0, nonzero: 0.14101098477840424
Epoch 14700, Total loss: -109825474560.0000, CE loss: 35.3400, RL loss: -1098254720.0000, Reward: -6296838.2656
    full cols: 686, non-full cols: 25
   r - labels: 310, labels - r: 264
    violated: 151171, weighted: 12606.837890625, len: 0.0, nonzero: 0.13806818425655365
Epoch 14800, Total loss: 115285286912.0000, CE loss: 35.3289, RL loss: 1152852864.0000, Reward: -6309395.8125
    full cols: 687, non-full cols: 19
   r - labels: 318, labels - r: 277
    violated: 152683, weighted: 13087.66796875, len: 0.0, nonzero: 0.13698740303516388
Epoch 14900, Total loss: -159636062208.0000, CE loss: 35.3157, RL loss: -1596360704.0000, Reward: -6338238.6562
    full cols: 689, non-full cols: 26
   r - labels: 329, labels - r: 279
    violated: 144504, weighted: 13413.40625, len: 0.0, nonzero: 0.13958436250686646
Epoch 15000, Total loss: -81189847040.0000, CE loss: 35.3382, RL loss: -811898432.0000, Reward: -6296647.8438
    full cols: 681, non-full cols: 16
   r - labels: 317, labels - r: 285
    violated: 145303, weighted: 13277.06640625, len: 0.0, nonzero: 0.1359560191631317
------ ABL Loop 0 ------
--- eval ---
prediction result:
f1 on test:    0.4909
f1 on test:    0.7509 (micro)
f1 on KB:      0.3248
f1 on orig KB: 0.3248
integrated f1: 0.3545, w_data: 0.2862, w_klg: 0.7138

integrated result:
f1 on test:    0.4784
f1 on test:    0.7258 (micro)
f1 on KB:      0.4300
f1 on orig KB: 0.4300
integrated f1: 0.4424, w_data: 0.2862, w_klg: 0.7138
------------
integrated f1 0.3545

KB before refine:
num_nodes: 5060.0000
num_edges: 173493.0000
density: 0.0068
avg_degree: 34.2872
avg_clustering: 0.2880
degree_assortativity: 0.1845
modularity: 0.4495
avg_betweenness: 0.0002
avg_closeness: 0.1414
Iteration 0: Loss = 10851329.000000
|Xk-Y|_F:  10851329.000000, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 9456273, f1 =  0.365786, approx slack: 2119943
rounded before pow |X_k-Y|_0 = 9311181, f1 =  0.315109

Iteration 20: Loss = 13108002.000000
|Xk-Y|_F:  12853913.000000, |X-X0|:  254088.687500
rounded |X_k-Y|_0 = 10933006, f1 =  0.272644, approx slack: 1990100
rounded before pow |X_k-Y|_0 = 9311181, f1 =  0.315109

Iteration 40: Loss = 12932817.000000
|Xk-Y|_F:  12711512.000000, |X-X0|:  221305.312500
rounded |X_k-Y|_0 = 10828980, f1 =  0.275630, approx slack: 269992
rounded before pow |X_k-Y|_0 = 11031049, f1 =  0.269832

Iteration 60: Loss = 12518201.000000
|Xk-Y|_F:  12325960.000000, |X-X0|:  192240.625000
rounded |X_k-Y|_0 = 10519865, f1 =  0.284399, approx slack: 671025
rounded before pow |X_k-Y|_0 = 10986930, f1 =  0.271108

Iteration 80: Loss = 11823325.000000
|Xk-Y|_F:  11651669.000000, |X-X0|:  171655.578125
rounded |X_k-Y|_0 = 9904393, f1 =  0.301294, approx slack: 428502
rounded before pow |X_k-Y|_0 = 9953521, f1 =  0.300129

Iteration 100: Loss = 11548673.000000
|Xk-Y|_F:  11390836.000000, |X-X0|:  157837.281250
rounded |X_k-Y|_0 = 9649187, f1 =  0.308301, approx slack: 328525
rounded before pow |X_k-Y|_0 = 9826053, f1 =  0.303563

Iteration 120: Loss = 11454235.000000
|Xk-Y|_F:  11306611.000000, |X-X0|:  147624.078125
rounded |X_k-Y|_0 = 9565935, f1 =  0.310563, approx slack: 315405
rounded before pow |X_k-Y|_0 = 9737807, f1 =  0.305993

Iteration 140: Loss = 11389179.000000
|Xk-Y|_F:  11249576.000000, |X-X0|:  139602.968750
rounded |X_k-Y|_0 = 9512510, f1 =  0.312003, approx slack: 297424
rounded before pow |X_k-Y|_0 = 9655827, f1 =  0.308241

Iteration 160: Loss = 11318566.000000
|Xk-Y|_F:  11185466.000000, |X-X0|:  133099.625000
rounded |X_k-Y|_0 = 9459197, f1 =  0.313444, approx slack: 282025
rounded before pow |X_k-Y|_0 = 9604480, f1 =  0.309661

Iteration 180: Loss = 11239977.000000
|Xk-Y|_F:  11112204.000000, |X-X0|:  127773.171875
rounded |X_k-Y|_0 = 9400160, f1 =  0.315050, approx slack: 227802
rounded before pow |X_k-Y|_0 = 9543985, f1 =  0.311315

Iteration 200: Loss = 11191954.000000
|Xk-Y|_F:  11068594.000000, |X-X0|:  123359.578125
rounded |X_k-Y|_0 = 9367253, f1 =  0.315943, approx slack: 246553
rounded before pow |X_k-Y|_0 = 9519051, f1 =  0.312166

Iteration 220: Loss = 11148652.000000
|Xk-Y|_F:  11028932.000000, |X-X0|:  119719.703125
rounded |X_k-Y|_0 = 9338423, f1 =  0.316750, approx slack: 253943
rounded before pow |X_k-Y|_0 = 9503886, f1 =  0.312603

Iteration 240: Loss = 11106521.000000
|Xk-Y|_F:  10990017.000000, |X-X0|:  116504.414062
rounded |X_k-Y|_0 = 9310125, f1 =  0.317691, approx slack: 276237
rounded before pow |X_k-Y|_0 = 9515683, f1 =  0.312307

Iteration 260: Loss = 11072425.000000
|Xk-Y|_F:  10959085.000000, |X-X0|:  113339.742188
rounded |X_k-Y|_0 = 9286460, f1 =  0.318488, approx slack: 488074
rounded before pow |X_k-Y|_0 = 9678433, f1 =  0.307848

Iteration 280: Loss = 11036856.000000
|Xk-Y|_F:  10926434.000000, |X-X0|:  110422.367188
rounded |X_k-Y|_0 = 9265319, f1 =  0.319085, approx slack: 489854
rounded before pow |X_k-Y|_0 = 9667364, f1 =  0.308150

Iteration 300: Loss = 10997058.000000
|Xk-Y|_F:  10889368.000000, |X-X0|:  107690.257812
rounded |X_k-Y|_0 = 9241867, f1 =  0.319726, approx slack: 494200
rounded before pow |X_k-Y|_0 = 9646045, f1 =  0.308736

Iteration 320: Loss = 10957273.000000
|Xk-Y|_F:  10852093.000000, |X-X0|:  105179.585938
rounded |X_k-Y|_0 = 9219801, f1 =  0.320323, approx slack: 509285
rounded before pow |X_k-Y|_0 = 9640338, f1 =  0.308894

Iteration 340: Loss = 10917376.000000
|Xk-Y|_F:  10814472.000000, |X-X0|:  102904.328125
rounded |X_k-Y|_0 = 9195578, f1 =  0.320964, approx slack: 493755
rounded before pow |X_k-Y|_0 = 9607707, f1 =  0.309739

Iteration 360: Loss = 10878575.000000
|Xk-Y|_F:  10777788.000000, |X-X0|:  100787.117188
rounded |X_k-Y|_0 = 9171990, f1 =  0.321580, approx slack: 647669
rounded before pow |X_k-Y|_0 = 9727349, f1 =  0.306446

Iteration 380: Loss = 10834364.000000
|Xk-Y|_F:  10735534.000000, |X-X0|:  98830.437500
rounded |X_k-Y|_0 = 9144175, f1 =  0.322296, approx slack: 672161
rounded before pow |X_k-Y|_0 = 9719282, f1 =  0.306669

Iteration 400: Loss = 10782282.000000
|Xk-Y|_F:  10685269.000000, |X-X0|:  97012.515625
rounded |X_k-Y|_0 = 9111139, f1 =  0.323140, approx slack: 703444
rounded before pow |X_k-Y|_0 = 9706026, f1 =  0.307033

Iteration 420: Loss = 10724578.000000
|Xk-Y|_F:  10629206.000000, |X-X0|:  95372.468750
rounded |X_k-Y|_0 = 9070709, f1 =  0.324182, approx slack: 739152
rounded before pow |X_k-Y|_0 = 9688992, f1 =  0.307503

Iteration 440: Loss = 10648802.000000
|Xk-Y|_F:  10554859.000000, |X-X0|:  93942.593750
rounded |X_k-Y|_0 = 9020133, f1 =  0.325483, approx slack: 784934
rounded before pow |X_k-Y|_0 = 9680841, f1 =  0.307753

Iteration 460: Loss = 10576225.000000
|Xk-Y|_F:  10483582.000000, |X-X0|:  92643.343750
rounded |X_k-Y|_0 = 8970392, f1 =  0.326740, approx slack: 895919
rounded before pow |X_k-Y|_0 = 9719801, f1 =  0.306689

Iteration 480: Loss = 10466373.000000
|Xk-Y|_F:  10374858.000000, |X-X0|:  91515.414062
rounded |X_k-Y|_0 = 8887382, f1 =  0.328845, approx slack: 989098
rounded before pow |X_k-Y|_0 = 9711505, f1 =  0.306918

Iteration 500: Loss = 10332732.000000
|Xk-Y|_F:  10241972.000000, |X-X0|:  90759.968750
rounded |X_k-Y|_0 = 8786167, f1 =  0.331367, approx slack: 1125542
rounded before pow |X_k-Y|_0 = 9710671, f1 =  0.306942

Iteration 520: Loss = 10082122.000000
|Xk-Y|_F:  9991155.000000, |X-X0|:  90966.718750
rounded |X_k-Y|_0 = 8593811, f1 =  0.336065, approx slack: 1439824
rounded before pow |X_k-Y|_0 = 9765859, f1 =  0.305430

Iteration 540: Loss = 9565934.000000
|Xk-Y|_F:  9469081.000000, |X-X0|:  96853.234375
rounded |X_k-Y|_0 = 8186290, f1 =  0.345136, approx slack: 2218298
rounded before pow |X_k-Y|_0 = 9920852, f1 =  0.301066

Iteration 560: Loss = 9025470.000000
|Xk-Y|_F:  8915541.000000, |X-X0|:  109928.625000
rounded |X_k-Y|_0 = 7740352, f1 =  0.355183, approx slack: 3515458
rounded before pow |X_k-Y|_0 = 10602509, f1 =  0.282084

Iteration 580: Loss = 8524806.000000
|Xk-Y|_F:  8400488.000000, |X-X0|:  124318.453125
rounded |X_k-Y|_0 = 7319589, f1 =  0.365004, approx slack: 4087582
rounded before pow |X_k-Y|_0 = 10621066, f1 =  0.281572

Iteration 600: Loss = 7929996.000000
|Xk-Y|_F:  7788525.500000, |X-X0|:  141470.296875
rounded |X_k-Y|_0 = 6810019, f1 =  0.379006, approx slack: 4755251
rounded before pow |X_k-Y|_0 = 10737062, f1 =  0.278274

Iteration 620: Loss = 7175290.000000
|Xk-Y|_F:  7024728.500000, |X-X0|:  150561.296875
rounded |X_k-Y|_0 = 6142635, f1 =  0.398779, approx slack: 4816909
rounded before pow |X_k-Y|_0 = 10189600, f1 =  0.293691

Iteration 640: Loss = 6271966.500000
|Xk-Y|_F:  6114583.000000, |X-X0|:  157383.609375
rounded |X_k-Y|_0 = 5374658, f1 =  0.420716, approx slack: 5578162
rounded before pow |X_k-Y|_0 = 10079536, f1 =  0.296781

Iteration 660: Loss = 5230304.500000
|Xk-Y|_F:  5061597.000000, |X-X0|:  168707.484375
rounded |X_k-Y|_0 = 4479734, f1 =  0.449109, approx slack: 6542385
rounded before pow |X_k-Y|_0 = 10063119, f1 =  0.297227

Iteration 680: Loss = 4037900.250000
|Xk-Y|_F:  3852745.500000, |X-X0|:  185154.843750
rounded |X_k-Y|_0 = 3446882, f1 =  0.486202, approx slack: 8002548
rounded before pow |X_k-Y|_0 = 10337880, f1 =  0.289564

Iteration 700: Loss = 2844520.000000
|Xk-Y|_F:  2638169.750000, |X-X0|:  206350.296875
rounded |X_k-Y|_0 = 2382709, f1 =  0.535912, approx slack: 9018655
rounded before pow |X_k-Y|_0 = 10275193, f1 =  0.291319

Iteration 720: Loss = 1856239.375000
|Xk-Y|_F:  1631577.750000, |X-X0|:  224661.593750
rounded |X_k-Y|_0 = 1466111, f1 =  0.594182, approx slack: 9762011
rounded before pow |X_k-Y|_0 = 10279961, f1 =  0.291174

Iteration 740: Loss = 1337681.000000
|Xk-Y|_F:  1110554.250000, |X-X0|:  227126.765625
rounded |X_k-Y|_0 = 982001, f1 =  0.631670, approx slack: 10106112
rounded before pow |X_k-Y|_0 = 10301497, f1 =  0.290573

Iteration 760: Loss = 1179525.375000
|Xk-Y|_F:  968504.875000, |X-X0|:  211020.453125
rounded |X_k-Y|_0 = 868538, f1 =  0.641174, approx slack: 10210135
rounded before pow |X_k-Y|_0 = 10330109, f1 =  0.289761

Iteration 780: Loss = 1118557.750000
|Xk-Y|_F:  921353.250000, |X-X0|:  197204.500000
rounded |X_k-Y|_0 = 832582, f1 =  0.644264, approx slack: 10478312
rounded before pow |X_k-Y|_0 = 10555492, f1 =  0.283416

Iteration 800: Loss = 1086189.875000
|Xk-Y|_F:  896433.437500, |X-X0|:  189756.406250
rounded |X_k-Y|_0 = 811702, f1 =  0.646091, approx slack: 10513005
rounded before pow |X_k-Y|_0 = 10575740, f1 =  0.282844

Iteration 820: Loss = 1063984.625000
|Xk-Y|_F:  879303.875000, |X-X0|:  184680.718750
rounded |X_k-Y|_0 = 802239, f1 =  0.647073, approx slack: 10539605
rounded before pow |X_k-Y|_0 = 10592527, f1 =  0.282369

Iteration 840: Loss = 1046440.437500
|Xk-Y|_F:  865558.437500, |X-X0|:  180882.015625
rounded |X_k-Y|_0 = 793710, f1 =  0.647881, approx slack: 10569024
rounded before pow |X_k-Y|_0 = 10618811, f1 =  0.281620

Iteration 860: Loss = 1032087.000000
|Xk-Y|_F:  854383.750000, |X-X0|:  177703.265625
rounded |X_k-Y|_0 = 786696, f1 =  0.648534, approx slack: 10611836
rounded before pow |X_k-Y|_0 = 10655998, f1 =  0.280561

Iteration 880: Loss = 1019943.687500
|Xk-Y|_F:  844943.562500, |X-X0|:  175000.125000
rounded |X_k-Y|_0 = 778629, f1 =  0.649260, approx slack: 10607957
rounded before pow |X_k-Y|_0 = 10645968, f1 =  0.280846

Iteration 900: Loss = 1010787.562500
|Xk-Y|_F:  838189.062500, |X-X0|:  172598.500000
rounded |X_k-Y|_0 = 774665, f1 =  0.649652, approx slack: 10628622
rounded before pow |X_k-Y|_0 = 10664771, f1 =  0.280310

Iteration 920: Loss = 1003720.500000
|Xk-Y|_F:  833366.500000, |X-X0|:  170353.984375
rounded |X_k-Y|_0 = 772496, f1 =  0.649892, approx slack: 10611674
rounded before pow |X_k-Y|_0 = 10646593, f1 =  0.280828

Iteration 940: Loss = 997706.500000
|Xk-Y|_F:  829385.062500, |X-X0|:  168321.437500
rounded |X_k-Y|_0 = 770689, f1 =  0.650095, approx slack: 10619331
rounded before pow |X_k-Y|_0 = 10653627, f1 =  0.280627

Iteration 960: Loss = 992424.812500
|Xk-Y|_F:  825922.875000, |X-X0|:  166501.937500
rounded |X_k-Y|_0 = 769307, f1 =  0.650256, approx slack: 10624031
rounded before pow |X_k-Y|_0 = 10653872, f1 =  0.280626

Iteration 980: Loss = 987669.000000
|Xk-Y|_F:  822860.250000, |X-X0|:  164808.765625
rounded |X_k-Y|_0 = 768088, f1 =  0.650399, approx slack: 10624565
rounded before pow |X_k-Y|_0 = 10654061, f1 =  0.280615

Iteration 1000: Loss = 983276.875000
|Xk-Y|_F:  820032.250000, |X-X0|:  163244.593750
rounded |X_k-Y|_0 = 767042, f1 =  0.650533, approx slack: 10627773
rounded before pow |X_k-Y|_0 = 10656246, f1 =  0.280553

Iteration 1020: Loss = 979226.125000
|Xk-Y|_F:  817466.500000, |X-X0|:  161759.609375
rounded |X_k-Y|_0 = 766058, f1 =  0.650658, approx slack: 10631829
rounded before pow |X_k-Y|_0 = 10659406, f1 =  0.280463

Iteration 1040: Loss = 975452.062500
|Xk-Y|_F:  815087.187500, |X-X0|:  160364.859375
rounded |X_k-Y|_0 = 764696, f1 =  0.650806, approx slack: 10624210
rounded before pow |X_k-Y|_0 = 10652991, f1 =  0.280641

Iteration 1060: Loss = 971934.625000
|Xk-Y|_F:  812901.125000, |X-X0|:  159033.531250
rounded |X_k-Y|_0 = 764024, f1 =  0.650896, approx slack: 10635884
rounded before pow |X_k-Y|_0 = 10663427, f1 =  0.280345

Iteration 1080: Loss = 968568.437500
|Xk-Y|_F:  810789.250000, |X-X0|:  157779.203125
rounded |X_k-Y|_0 = 763211, f1 =  0.650993, approx slack: 10634051
rounded before pow |X_k-Y|_0 = 10661006, f1 =  0.280413

Iteration 1100: Loss = 965192.625000
|Xk-Y|_F:  808623.687500, |X-X0|:  156568.906250
rounded |X_k-Y|_0 = 762656, f1 =  0.651066, approx slack: 10634189
rounded before pow |X_k-Y|_0 = 10660807, f1 =  0.280418

Iteration 1120: Loss = 961428.875000
|Xk-Y|_F:  806010.937500, |X-X0|:  155417.968750
rounded |X_k-Y|_0 = 761783, f1 =  0.651167, approx slack: 10632105
rounded before pow |X_k-Y|_0 = 10657871, f1 =  0.280502

Iteration 1140: Loss = 957199.625000
|Xk-Y|_F:  802942.562500, |X-X0|:  154257.093750
rounded |X_k-Y|_0 = 758572, f1 =  0.651453, approx slack: 10639986
rounded before pow |X_k-Y|_0 = 10658707, f1 =  0.280485

Iteration 1160: Loss = 954223.250000
|Xk-Y|_F:  801070.875000, |X-X0|:  153152.343750
rounded |X_k-Y|_0 = 757924, f1 =  0.651527, approx slack: 10637211
rounded before pow |X_k-Y|_0 = 10656661, f1 =  0.280542

Iteration 1180: Loss = 951555.125000
|Xk-Y|_F:  799435.375000, |X-X0|:  152119.750000
rounded |X_k-Y|_0 = 757469, f1 =  0.651595, approx slack: 10628574
rounded before pow |X_k-Y|_0 = 10651090, f1 =  0.280694

Iteration 1200: Loss = 948984.875000
|Xk-Y|_F:  797892.812500, |X-X0|:  151092.046875
rounded |X_k-Y|_0 = 756976, f1 =  0.651664, approx slack: 10621457
rounded before pow |X_k-Y|_0 = 10643384, f1 =  0.280915

Iteration 1220: Loss = 946550.187500
|Xk-Y|_F:  796440.312500, |X-X0|:  150109.859375
rounded |X_k-Y|_0 = 756591, f1 =  0.651717, approx slack: 10623873
rounded before pow |X_k-Y|_0 = 10645461, f1 =  0.280856

Iteration 1240: Loss = 944230.937500
|Xk-Y|_F:  795056.437500, |X-X0|:  149174.500000
rounded |X_k-Y|_0 = 755947, f1 =  0.651787, approx slack: 10621266
rounded before pow |X_k-Y|_0 = 10642703, f1 =  0.280934

Iteration 1260: Loss = 942027.375000
|Xk-Y|_F:  793776.250000, |X-X0|:  148251.125000
rounded |X_k-Y|_0 = 755370, f1 =  0.651849, approx slack: 10463829
rounded before pow |X_k-Y|_0 = 10507125, f1 =  0.284749

Iteration 1280: Loss = 940030.250000
|Xk-Y|_F:  792650.500000, |X-X0|:  147379.718750
rounded |X_k-Y|_0 = 754911, f1 =  0.651904, approx slack: 10472338
rounded before pow |X_k-Y|_0 = 10515809, f1 =  0.284501

Iteration 1300: Loss = 938130.625000
|Xk-Y|_F:  791574.500000, |X-X0|:  146556.156250
rounded |X_k-Y|_0 = 754549, f1 =  0.651948, approx slack: 10466047
rounded before pow |X_k-Y|_0 = 10509760, f1 =  0.284671

Iteration 1320: Loss = 936309.750000
|Xk-Y|_F:  790536.437500, |X-X0|:  145773.281250
rounded |X_k-Y|_0 = 754157, f1 =  0.651995, approx slack: 10461780
rounded before pow |X_k-Y|_0 = 10505307, f1 =  0.284798

Iteration 1340: Loss = 934560.812500
|Xk-Y|_F:  789561.875000, |X-X0|:  144998.921875
rounded |X_k-Y|_0 = 753798, f1 =  0.652043, approx slack: 10460145
rounded before pow |X_k-Y|_0 = 10503223, f1 =  0.284857

Iteration 1360: Loss = 932877.562500
|Xk-Y|_F:  788620.750000, |X-X0|:  144256.828125
rounded |X_k-Y|_0 = 753526, f1 =  0.652081, approx slack: 10465127
rounded before pow |X_k-Y|_0 = 10507896, f1 =  0.284725

Iteration 1380: Loss = 931273.125000
|Xk-Y|_F:  787720.187500, |X-X0|:  143552.906250
rounded |X_k-Y|_0 = 753248, f1 =  0.652117, approx slack: 10464938
rounded before pow |X_k-Y|_0 = 10507553, f1 =  0.284734

Iteration 1400: Loss = 929742.250000
|Xk-Y|_F:  786883.687500, |X-X0|:  142858.546875
rounded |X_k-Y|_0 = 752937, f1 =  0.652153, approx slack: 10462285
rounded before pow |X_k-Y|_0 = 10504823, f1 =  0.284811

Iteration 1420: Loss = 928277.750000
|Xk-Y|_F:  786091.437500, |X-X0|:  142186.312500
rounded |X_k-Y|_0 = 752690, f1 =  0.652184, approx slack: 10346637
rounded before pow |X_k-Y|_0 = 10402864, f1 =  0.287673

Iteration 1440: Loss = 926869.312500
|Xk-Y|_F:  785328.625000, |X-X0|:  141540.687500
rounded |X_k-Y|_0 = 752496, f1 =  0.652208, approx slack: 10344845
rounded before pow |X_k-Y|_0 = 10401093, f1 =  0.287722

Iteration 1460: Loss = 925496.562500
|Xk-Y|_F:  784584.437500, |X-X0|:  140912.109375
rounded |X_k-Y|_0 = 752267, f1 =  0.652236, approx slack: 10342981
rounded before pow |X_k-Y|_0 = 10399585, f1 =  0.287764

Iteration 1480: Loss = 924140.187500
|Xk-Y|_F:  783839.187500, |X-X0|:  140301.000000
rounded |X_k-Y|_0 = 751924, f1 =  0.652273, approx slack: 10222574
rounded before pow |X_k-Y|_0 = 10285080, f1 =  0.290980

Iteration 1500: Loss = 922805.437500
|Xk-Y|_F:  783101.750000, |X-X0|:  139703.687500
rounded |X_k-Y|_0 = 751633, f1 =  0.652306, approx slack: 10181496
rounded before pow |X_k-Y|_0 = 10275059, f1 =  0.291215

Iteration 1520: Loss = 921508.875000
|Xk-Y|_F:  782390.875000, |X-X0|:  139118.000000
rounded |X_k-Y|_0 = 751356, f1 =  0.652337, approx slack: 10177811
rounded before pow |X_k-Y|_0 = 10271612, f1 =  0.291311

Iteration 1540: Loss = 920253.062500
|Xk-Y|_F:  781694.312500, |X-X0|:  138558.750000
rounded |X_k-Y|_0 = 751070, f1 =  0.652368, approx slack: 10175942
rounded before pow |X_k-Y|_0 = 10269627, f1 =  0.291367

Iteration 1560: Loss = 919043.312500
|Xk-Y|_F:  781029.250000, |X-X0|:  138014.046875
rounded |X_k-Y|_0 = 750798, f1 =  0.652398, approx slack: 10161579
rounded before pow |X_k-Y|_0 = 10255810, f1 =  0.291754

Iteration 1580: Loss = 917866.750000
|Xk-Y|_F:  780389.375000, |X-X0|:  137477.343750
rounded |X_k-Y|_0 = 750482, f1 =  0.652433, approx slack: 10154011
rounded before pow |X_k-Y|_0 = 10248616, f1 =  0.291955

Iteration 1600: Loss = 916724.250000
|Xk-Y|_F:  779765.125000, |X-X0|:  136959.156250
rounded |X_k-Y|_0 = 750157, f1 =  0.652467, approx slack: 10153653
rounded before pow |X_k-Y|_0 = 10248457, f1 =  0.291958

Iteration 1620: Loss = 915594.250000
|Xk-Y|_F:  779148.875000, |X-X0|:  136445.390625
rounded |X_k-Y|_0 = 749851, f1 =  0.652502, approx slack: 10147583
rounded before pow |X_k-Y|_0 = 10242635, f1 =  0.292121

Iteration 1640: Loss = 914470.875000
|Xk-Y|_F:  778531.437500, |X-X0|:  135939.468750
rounded |X_k-Y|_0 = 749531, f1 =  0.652537, approx slack: 10147782
rounded before pow |X_k-Y|_0 = 10242696, f1 =  0.292119

Iteration 1660: Loss = 913367.000000
|Xk-Y|_F:  777919.250000, |X-X0|:  135447.734375
rounded |X_k-Y|_0 = 749174, f1 =  0.652573, approx slack: 10133932
rounded before pow |X_k-Y|_0 = 10229430, f1 =  0.292491

Iteration 1680: Loss = 912293.750000
|Xk-Y|_F:  777321.312500, |X-X0|:  134972.406250
rounded |X_k-Y|_0 = 748837, f1 =  0.652609, approx slack: 10128685
rounded before pow |X_k-Y|_0 = 10224188, f1 =  0.292637

Iteration 1700: Loss = 911258.062500
|Xk-Y|_F:  776749.562500, |X-X0|:  134508.500000
rounded |X_k-Y|_0 = 748511, f1 =  0.652645, approx slack: 10127000
rounded before pow |X_k-Y|_0 = 10222398, f1 =  0.292688

Iteration 1720: Loss = 910238.125000
|Xk-Y|_F:  776188.187500, |X-X0|:  134049.953125
rounded |X_k-Y|_0 = 748153, f1 =  0.652682, approx slack: 10123716
rounded before pow |X_k-Y|_0 = 10219699, f1 =  0.292763

Iteration 1740: Loss = 909227.875000
|Xk-Y|_F:  775626.250000, |X-X0|:  133601.593750
rounded |X_k-Y|_0 = 747850, f1 =  0.652715, approx slack: 10110418
rounded before pow |X_k-Y|_0 = 10207174, f1 =  0.293112

Iteration 1760: Loss = 908226.750000
|Xk-Y|_F:  775062.812500, |X-X0|:  133163.921875
rounded |X_k-Y|_0 = 747555, f1 =  0.652746, approx slack: 10102315
rounded before pow |X_k-Y|_0 = 10199406, f1 =  0.293330

Iteration 1780: Loss = 907251.437500
|Xk-Y|_F:  774517.937500, |X-X0|:  132733.515625
rounded |X_k-Y|_0 = 747236, f1 =  0.652780, approx slack: 10098129
rounded before pow |X_k-Y|_0 = 10195357, f1 =  0.293441

Iteration 1800: Loss = 906289.437500
|Xk-Y|_F:  773970.562500, |X-X0|:  132318.875000
rounded |X_k-Y|_0 = 746827, f1 =  0.652820, approx slack: 10087629
rounded before pow |X_k-Y|_0 = 10186162, f1 =  0.293697

Iteration 1820: Loss = 905343.062500
|Xk-Y|_F:  773430.687500, |X-X0|:  131912.375000
rounded |X_k-Y|_0 = 746512, f1 =  0.652853, approx slack: 10079942
rounded before pow |X_k-Y|_0 = 10178937, f1 =  0.293900

Iteration 1840: Loss = 904404.937500
|Xk-Y|_F:  772892.437500, |X-X0|:  131512.500000
rounded |X_k-Y|_0 = 746101, f1 =  0.652893, approx slack: 10076050
rounded before pow |X_k-Y|_0 = 10175296, f1 =  0.294002

Iteration 1860: Loss = 903478.875000
|Xk-Y|_F:  772353.375000, |X-X0|:  131125.468750
rounded |X_k-Y|_0 = 745809, f1 =  0.652925, approx slack: 10070305
rounded before pow |X_k-Y|_0 = 10170005, f1 =  0.294149

Iteration 1880: Loss = 902557.000000
|Xk-Y|_F:  771815.000000, |X-X0|:  130741.984375
rounded |X_k-Y|_0 = 745502, f1 =  0.652957, approx slack: 9966575
rounded before pow |X_k-Y|_0 = 10074300, f1 =  0.296818

Iteration 1900: Loss = 901628.687500
|Xk-Y|_F:  771270.187500, |X-X0|:  130358.500000
rounded |X_k-Y|_0 = 745164, f1 =  0.652992, approx slack: 9967939
rounded before pow |X_k-Y|_0 = 10075547, f1 =  0.296784

Iteration 1920: Loss = 900701.375000
|Xk-Y|_F:  770720.125000, |X-X0|:  129981.273438
rounded |X_k-Y|_0 = 744840, f1 =  0.653024, approx slack: 9965836
rounded before pow |X_k-Y|_0 = 10076743, f1 =  0.296751

Iteration 1940: Loss = 899777.562500
|Xk-Y|_F:  770166.000000, |X-X0|:  129611.554688
rounded |X_k-Y|_0 = 744501, f1 =  0.653057, approx slack: 9964158
rounded before pow |X_k-Y|_0 = 10075984, f1 =  0.296771

Iteration 1960: Loss = 898830.437500
|Xk-Y|_F:  769587.062500, |X-X0|:  129243.367188
rounded |X_k-Y|_0 = 744163, f1 =  0.653090, approx slack: 9956873
rounded before pow |X_k-Y|_0 = 10069079, f1 =  0.296964

Iteration 1980: Loss = 897891.687500
|Xk-Y|_F:  769015.937500, |X-X0|:  128875.757812
rounded |X_k-Y|_0 = 743916, f1 =  0.653117, approx slack: 9948525
rounded before pow |X_k-Y|_0 = 10061358, f1 =  0.297179

Iteration 2000: Loss = 896960.062500
|Xk-Y|_F:  768440.125000, |X-X0|:  128519.921875
rounded |X_k-Y|_0 = 743688, f1 =  0.653144, approx slack: 9947240
rounded before pow |X_k-Y|_0 = 10059921, f1 =  0.297219

Iteration 2020: Loss = 896036.687500
|Xk-Y|_F:  767864.750000, |X-X0|:  128171.945312
rounded |X_k-Y|_0 = 743422, f1 =  0.653173, approx slack: 9940223
rounded before pow |X_k-Y|_0 = 10052970, f1 =  0.297413

Iteration 2040: Loss = 895123.437500
|Xk-Y|_F:  767309.687500, |X-X0|:  127813.750000
rounded |X_k-Y|_0 = 743221, f1 =  0.653195, approx slack: 9934300
rounded before pow |X_k-Y|_0 = 10047080, f1 =  0.297577

Iteration 2060: Loss = 894195.437500
|Xk-Y|_F:  766739.437500, |X-X0|:  127456.000000
rounded |X_k-Y|_0 = 742962, f1 =  0.653222, approx slack: 9930743
rounded before pow |X_k-Y|_0 = 10043436, f1 =  0.297679

Iteration 2080: Loss = 893316.687500
|Xk-Y|_F:  766208.625000, |X-X0|:  127108.078125
rounded |X_k-Y|_0 = 742732, f1 =  0.653248, approx slack: 9876144
rounded before pow |X_k-Y|_0 = 9991275, f1 =  0.299131

Iteration 2100: Loss = 892474.562500
|Xk-Y|_F:  765697.437500, |X-X0|:  126777.140625
rounded |X_k-Y|_0 = 742487, f1 =  0.653275, approx slack: 9867121
rounded before pow |X_k-Y|_0 = 9982230, f1 =  0.299383

Iteration 2120: Loss = 891636.875000
|Xk-Y|_F:  765197.250000, |X-X0|:  126439.648438
rounded |X_k-Y|_0 = 742296, f1 =  0.653296, approx slack: 9868044
rounded before pow |X_k-Y|_0 = 9983510, f1 =  0.299346

Iteration 2140: Loss = 890822.375000
|Xk-Y|_F:  764708.375000, |X-X0|:  126114.000000
rounded |X_k-Y|_0 = 742019, f1 =  0.653325, approx slack: 9860921
rounded before pow |X_k-Y|_0 = 9976466, f1 =  0.299543

Iteration 2160: Loss = 890024.000000
|Xk-Y|_F:  764234.500000, |X-X0|:  125789.515625
rounded |X_k-Y|_0 = 741806, f1 =  0.653348, approx slack: 9856452
rounded before pow |X_k-Y|_0 = 9971941, f1 =  0.299669

Iteration 2180: Loss = 889241.250000
|Xk-Y|_F:  763765.500000, |X-X0|:  125475.781250
rounded |X_k-Y|_0 = 741569, f1 =  0.653373, approx slack: 9851288
rounded before pow |X_k-Y|_0 = 9967049, f1 =  0.299805

Iteration 2200: Loss = 888471.500000
|Xk-Y|_F:  763303.625000, |X-X0|:  125167.859375
rounded |X_k-Y|_0 = 741358, f1 =  0.653396, approx slack: 9850549
rounded before pow |X_k-Y|_0 = 9966299, f1 =  0.299825

Iteration 2220: Loss = 887701.875000
|Xk-Y|_F:  762839.562500, |X-X0|:  124862.281250
rounded |X_k-Y|_0 = 741129, f1 =  0.653420, approx slack: 9850982
rounded before pow |X_k-Y|_0 = 9967255, f1 =  0.299798

Iteration 2240: Loss = 886940.812500
|Xk-Y|_F:  762381.187500, |X-X0|:  124559.625000
rounded |X_k-Y|_0 = 740945, f1 =  0.653441, approx slack: 9842375
rounded before pow |X_k-Y|_0 = 9959030, f1 =  0.300026

Iteration 2260: Loss = 886183.687500
|Xk-Y|_F:  761935.375000, |X-X0|:  124248.328125
rounded |X_k-Y|_0 = 740723, f1 =  0.653466, approx slack: 9840158
rounded before pow |X_k-Y|_0 = 9957974, f1 =  0.300054

Iteration 2280: Loss = 885437.875000
|Xk-Y|_F:  761484.500000, |X-X0|:  123953.406250
rounded |X_k-Y|_0 = 740531, f1 =  0.653487, approx slack: 9832618
rounded before pow |X_k-Y|_0 = 9950703, f1 =  0.300256

Iteration 2300: Loss = 884691.750000
|Xk-Y|_F:  761032.500000, |X-X0|:  123659.242188
rounded |X_k-Y|_0 = 740321, f1 =  0.653508, approx slack: 9825117
rounded before pow |X_k-Y|_0 = 9943596, f1 =  0.300454

Iteration 2320: Loss = 883950.812500
|Xk-Y|_F:  760580.312500, |X-X0|:  123370.515625
rounded |X_k-Y|_0 = 740057, f1 =  0.653536, approx slack: 9809491
rounded before pow |X_k-Y|_0 = 9928280, f1 =  0.300880

Iteration 2340: Loss = 883206.625000
|Xk-Y|_F:  760139.000000, |X-X0|:  123067.593750
rounded |X_k-Y|_0 = 739837, f1 =  0.653559, approx slack: 9809130
rounded before pow |X_k-Y|_0 = 9927513, f1 =  0.300903

Iteration 2360: Loss = 882478.375000
|Xk-Y|_F:  759704.062500, |X-X0|:  122774.296875
rounded |X_k-Y|_0 = 739630, f1 =  0.653581, approx slack: 9806996
rounded before pow |X_k-Y|_0 = 9925436, f1 =  0.300961

Iteration 2380: Loss = 881747.250000
|Xk-Y|_F:  759268.125000, |X-X0|:  122479.156250
rounded |X_k-Y|_0 = 739350, f1 =  0.653610, approx slack: 9795128
rounded before pow |X_k-Y|_0 = 9914035, f1 =  0.301278

Iteration 2400: Loss = 881023.375000
|Xk-Y|_F:  758840.500000, |X-X0|:  122182.890625
rounded |X_k-Y|_0 = 739121, f1 =  0.653634, approx slack: 9795505
rounded before pow |X_k-Y|_0 = 9914133, f1 =  0.301275

Iteration 2420: Loss = 880296.187500
|Xk-Y|_F:  758412.500000, |X-X0|:  121883.695312
rounded |X_k-Y|_0 = 738807, f1 =  0.653665, approx slack: 9793925
rounded before pow |X_k-Y|_0 = 9909625, f1 =  0.301404

Iteration 2440: Loss = 879570.625000
|Xk-Y|_F:  757983.625000, |X-X0|:  121586.968750
rounded |X_k-Y|_0 = 738605, f1 =  0.653687, approx slack: 9785721
rounded before pow |X_k-Y|_0 = 9901703, f1 =  0.301624

Iteration 2460: Loss = 878853.625000
|Xk-Y|_F:  757558.562500, |X-X0|:  121295.031250
rounded |X_k-Y|_0 = 738319, f1 =  0.653715, approx slack: 9639641
rounded before pow |X_k-Y|_0 = 9762844, f1 =  0.305470

Iteration 2480: Loss = 878139.687500
|Xk-Y|_F:  757140.062500, |X-X0|:  120999.632812
rounded |X_k-Y|_0 = 738050, f1 =  0.653743, approx slack: 9633868
rounded before pow |X_k-Y|_0 = 9757355, f1 =  0.305622

Iteration 2500: Loss = 877421.875000
|Xk-Y|_F:  756702.375000, |X-X0|:  120719.531250
rounded |X_k-Y|_0 = 737793, f1 =  0.653771, approx slack: 9627973
rounded before pow |X_k-Y|_0 = 9752105, f1 =  0.305766

Iteration 2520: Loss = 876712.187500
|Xk-Y|_F:  756278.562500, |X-X0|:  120433.601562
rounded |X_k-Y|_0 = 737557, f1 =  0.653798, approx slack: 9624036
rounded before pow |X_k-Y|_0 = 9748327, f1 =  0.305870

Iteration 2540: Loss = 876003.312500
|Xk-Y|_F:  755856.750000, |X-X0|:  120146.546875
rounded |X_k-Y|_0 = 737301, f1 =  0.653825, approx slack: 9621758
rounded before pow |X_k-Y|_0 = 9746347, f1 =  0.305925

Iteration 2560: Loss = 875318.687500
|Xk-Y|_F:  755456.687500, |X-X0|:  119862.000000
rounded |X_k-Y|_0 = 737078, f1 =  0.653847, approx slack: 9619437
rounded before pow |X_k-Y|_0 = 9744049, f1 =  0.305988

Iteration 2580: Loss = 874619.062500
|Xk-Y|_F:  755051.187500, |X-X0|:  119567.859375
rounded |X_k-Y|_0 = 736953, f1 =  0.653865, approx slack: 9612684
rounded before pow |X_k-Y|_0 = 9737539, f1 =  0.306168

Iteration 2600: Loss = 873890.937500
|Xk-Y|_F:  754615.750000, |X-X0|:  119275.164062
rounded |X_k-Y|_0 = 736754, f1 =  0.653888, approx slack: 9612459
rounded before pow |X_k-Y|_0 = 9737811, f1 =  0.306159

Iteration 2620: Loss = 873276.937500
|Xk-Y|_F:  754278.875000, |X-X0|:  118998.046875
rounded |X_k-Y|_0 = 736578, f1 =  0.653907, approx slack: 9609408
rounded before pow |X_k-Y|_0 = 9734582, f1 =  0.306249

Iteration 2640: Loss = 872663.500000
|Xk-Y|_F:  753953.125000, |X-X0|:  118710.351562
rounded |X_k-Y|_0 = 736401, f1 =  0.653926, approx slack: 9606216
rounded before pow |X_k-Y|_0 = 9731321, f1 =  0.306339

Iteration 2660: Loss = 872071.562500
|Xk-Y|_F:  753634.125000, |X-X0|:  118437.445312
rounded |X_k-Y|_0 = 736256, f1 =  0.653943, approx slack: 9603402
rounded before pow |X_k-Y|_0 = 9728082, f1 =  0.306430

Iteration 2680: Loss = 871495.000000
|Xk-Y|_F:  753320.375000, |X-X0|:  118174.640625
rounded |X_k-Y|_0 = 736080, f1 =  0.653960, approx slack: 9589724
rounded before pow |X_k-Y|_0 = 9715954, f1 =  0.306764

Iteration 2700: Loss = 870925.562500
|Xk-Y|_F:  753014.625000, |X-X0|:  117910.937500
rounded |X_k-Y|_0 = 735959, f1 =  0.653974, approx slack: 9581119
rounded before pow |X_k-Y|_0 = 9707341, f1 =  0.307003

Iteration 2720: Loss = 870355.000000
|Xk-Y|_F:  752710.125000, |X-X0|:  117644.882812
rounded |X_k-Y|_0 = 735833, f1 =  0.653987, approx slack: 9567365
rounded before pow |X_k-Y|_0 = 9694948, f1 =  0.307343

Iteration 2740: Loss = 869796.187500
|Xk-Y|_F:  752415.625000, |X-X0|:  117380.562500
rounded |X_k-Y|_0 = 735711, f1 =  0.653999, approx slack: 9559996
rounded before pow |X_k-Y|_0 = 9688058, f1 =  0.307533

Iteration 2760: Loss = 869230.937500
|Xk-Y|_F:  752111.000000, |X-X0|:  117119.937500
rounded |X_k-Y|_0 = 735572, f1 =  0.654012, approx slack: 9558689
rounded before pow |X_k-Y|_0 = 9687131, f1 =  0.307559

Iteration 2780: Loss = 868556.562500
|Xk-Y|_F:  751827.625000, |X-X0|:  116728.953125
rounded |X_k-Y|_0 = 735417, f1 =  0.654026, approx slack: 9530158
rounded before pow |X_k-Y|_0 = 9659476, f1 =  0.308323

Iteration 2800: Loss = 868008.375000
|Xk-Y|_F:  751525.937500, |X-X0|:  116482.406250
rounded |X_k-Y|_0 = 735213, f1 =  0.654045, approx slack: 9527555
rounded before pow |X_k-Y|_0 = 9657125, f1 =  0.308388

Iteration 2820: Loss = 867497.625000
|Xk-Y|_F:  751249.437500, |X-X0|:  116248.179688
rounded |X_k-Y|_0 = 735093, f1 =  0.654057, approx slack: 9529606
rounded before pow |X_k-Y|_0 = 9659283, f1 =  0.308328

Iteration 2840: Loss = 866965.750000
|Xk-Y|_F:  750976.250000, |X-X0|:  115989.500000
rounded |X_k-Y|_0 = 734998, f1 =  0.654067, approx slack: 9527758
rounded before pow |X_k-Y|_0 = 9657399, f1 =  0.308380

Iteration 2860: Loss = 866483.125000
|Xk-Y|_F:  750715.937500, |X-X0|:  115767.203125
rounded |X_k-Y|_0 = 734758, f1 =  0.654089, approx slack: 9526483
rounded before pow |X_k-Y|_0 = 9656341, f1 =  0.308409

Iteration 2880: Loss = 865994.000000
|Xk-Y|_F:  750456.750000, |X-X0|:  115537.218750
rounded |X_k-Y|_0 = 734531, f1 =  0.654109, approx slack: 9519870
rounded before pow |X_k-Y|_0 = 9650072, f1 =  0.308582

Iteration 2900: Loss = 865510.875000
|Xk-Y|_F:  750207.500000, |X-X0|:  115303.398438
rounded |X_k-Y|_0 = 734370, f1 =  0.654124, approx slack: 9516365
rounded before pow |X_k-Y|_0 = 9646786, f1 =  0.308673

Iteration 2920: Loss = 865039.937500
|Xk-Y|_F:  749969.437500, |X-X0|:  115070.500000
rounded |X_k-Y|_0 = 734204, f1 =  0.654139, approx slack: 9515537
rounded before pow |X_k-Y|_0 = 9645448, f1 =  0.308711

Iteration 2940: Loss = 864602.000000
|Xk-Y|_F:  749742.062500, |X-X0|:  114859.945312
rounded |X_k-Y|_0 = 734011, f1 =  0.654156, approx slack: 9507902
rounded before pow |X_k-Y|_0 = 9636921, f1 =  0.308947

Iteration 2960: Loss = 864116.312500
|Xk-Y|_F:  749500.250000, |X-X0|:  114616.039062
rounded |X_k-Y|_0 = 733834, f1 =  0.654173, approx slack: 9502427
rounded before pow |X_k-Y|_0 = 9631364, f1 =  0.309101

Iteration 2980: Loss = 863659.000000
|Xk-Y|_F:  749275.062500, |X-X0|:  114383.937500
rounded |X_k-Y|_0 = 733652, f1 =  0.654190, approx slack: 9496767
rounded before pow |X_k-Y|_0 = 9626447, f1 =  0.309236

Iteration 3000: Loss = 863217.750000
|Xk-Y|_F:  749061.437500, |X-X0|:  114156.320312
rounded |X_k-Y|_0 = 733490, f1 =  0.654205, approx slack: 9493317
rounded before pow |X_k-Y|_0 = 9623443, f1 =  0.309318

Iteration 3020: Loss = 862762.312500
|Xk-Y|_F:  748848.250000, |X-X0|:  113914.046875
rounded |X_k-Y|_0 = 733364, f1 =  0.654216, approx slack: 9485169
rounded before pow |X_k-Y|_0 = 9615993, f1 =  0.309523

Iteration 3040: Loss = 862331.000000
|Xk-Y|_F:  748645.437500, |X-X0|:  113685.585938
rounded |X_k-Y|_0 = 733182, f1 =  0.654233, approx slack: 9484620
rounded before pow |X_k-Y|_0 = 9615475, f1 =  0.309538

Iteration 3060: Loss = 861893.187500
|Xk-Y|_F:  748438.500000, |X-X0|:  113454.710938
rounded |X_k-Y|_0 = 733044, f1 =  0.654246, approx slack: 9484253
rounded before pow |X_k-Y|_0 = 9615307, f1 =  0.309542

Iteration 3080: Loss = 861461.062500
|Xk-Y|_F:  748240.500000, |X-X0|:  113220.554688
rounded |X_k-Y|_0 = 732868, f1 =  0.654262, approx slack: 9481722
rounded before pow |X_k-Y|_0 = 9613193, f1 =  0.309600

Iteration 3100: Loss = 861045.375000
|Xk-Y|_F:  748049.000000, |X-X0|:  112996.351562
rounded |X_k-Y|_0 = 732741, f1 =  0.654273, approx slack: 9479637
rounded before pow |X_k-Y|_0 = 9611193, f1 =  0.309655

Iteration 3120: Loss = 860655.250000
|Xk-Y|_F:  747868.062500, |X-X0|:  112787.164062
rounded |X_k-Y|_0 = 732575, f1 =  0.654289, approx slack: 9479301
rounded before pow |X_k-Y|_0 = 9611034, f1 =  0.309659

Iteration 3140: Loss = 860207.437500
|Xk-Y|_F:  747670.625000, |X-X0|:  112536.796875
rounded |X_k-Y|_0 = 732439, f1 =  0.654301, approx slack: 9474141
rounded before pow |X_k-Y|_0 = 9605916, f1 =  0.309800

Iteration 3160: Loss = 859813.437500
|Xk-Y|_F:  747492.812500, |X-X0|:  112320.617188
rounded |X_k-Y|_0 = 732300, f1 =  0.654314, approx slack: 9475071
rounded before pow |X_k-Y|_0 = 9607016, f1 =  0.309770

Iteration 3180: Loss = 859412.125000
|Xk-Y|_F:  747315.812500, |X-X0|:  112096.304688
rounded |X_k-Y|_0 = 732180, f1 =  0.654324, approx slack: 9479315
rounded before pow |X_k-Y|_0 = 9610813, f1 =  0.309665

Iteration 3200: Loss = 858996.125000
|Xk-Y|_F:  747132.000000, |X-X0|:  111864.132812
rounded |X_k-Y|_0 = 732050, f1 =  0.654338, approx slack: 9482533
rounded before pow |X_k-Y|_0 = 9611060, f1 =  0.309662

Iteration 3220: Loss = 858623.937500
|Xk-Y|_F:  746979.125000, |X-X0|:  111644.828125
rounded |X_k-Y|_0 = 731916, f1 =  0.654350, approx slack: 9483225
rounded before pow |X_k-Y|_0 = 9611656, f1 =  0.309645

Iteration 3240: Loss = 858256.000000
|Xk-Y|_F:  746830.812500, |X-X0|:  111425.218750
rounded |X_k-Y|_0 = 731768, f1 =  0.654363, approx slack: 9486083
rounded before pow |X_k-Y|_0 = 9613989, f1 =  0.309582

Iteration 3260: Loss = 857854.812500
|Xk-Y|_F:  746650.625000, |X-X0|:  111204.203125
rounded |X_k-Y|_0 = 731634, f1 =  0.654375, approx slack: 9479823
rounded before pow |X_k-Y|_0 = 9608057, f1 =  0.309746

Iteration 3280: Loss = 857442.000000
|Xk-Y|_F:  746454.312500, |X-X0|:  110987.671875
rounded |X_k-Y|_0 = 731517, f1 =  0.654387, approx slack: 9476798
rounded before pow |X_k-Y|_0 = 9605350, f1 =  0.309820

Iteration 3300: Loss = 857023.875000
|Xk-Y|_F:  746227.062500, |X-X0|:  110796.843750
rounded |X_k-Y|_0 = 731390, f1 =  0.654399, approx slack: 9474793
rounded before pow |X_k-Y|_0 = 9603543, f1 =  0.309869

Iteration 3320: Loss = 856595.750000
|Xk-Y|_F:  746031.500000, |X-X0|:  110564.250000
rounded |X_k-Y|_0 = 731289, f1 =  0.654410, approx slack: 9470685
rounded before pow |X_k-Y|_0 = 9599446, f1 =  0.309982

Iteration 3340: Loss = 856169.187500
|Xk-Y|_F:  745819.125000, |X-X0|:  110350.078125
rounded |X_k-Y|_0 = 731146, f1 =  0.654425, approx slack: 9466245
rounded before pow |X_k-Y|_0 = 9594788, f1 =  0.310111

Iteration 3360: Loss = 855727.875000
|Xk-Y|_F:  745601.875000, |X-X0|:  110125.968750
rounded |X_k-Y|_0 = 730966, f1 =  0.654441, approx slack: 9455551
rounded before pow |X_k-Y|_0 = 9584824, f1 =  0.310385

Iteration 3380: Loss = 855334.187500
|Xk-Y|_F:  745406.687500, |X-X0|:  109927.484375
rounded |X_k-Y|_0 = 730797, f1 =  0.654456, approx slack: 9453357
rounded before pow |X_k-Y|_0 = 9582471, f1 =  0.310451

Iteration 3400: Loss = 854913.000000
|Xk-Y|_F:  745205.000000, |X-X0|:  109708.015625
rounded |X_k-Y|_0 = 730638, f1 =  0.654471, approx slack: 9451465
rounded before pow |X_k-Y|_0 = 9581107, f1 =  0.310488

Iteration 3420: Loss = 854545.062500
|Xk-Y|_F:  745039.687500, |X-X0|:  109505.375000
rounded |X_k-Y|_0 = 730504, f1 =  0.654483, approx slack: 9450957
rounded before pow |X_k-Y|_0 = 9579749, f1 =  0.310525

Iteration 3440: Loss = 854170.687500
|Xk-Y|_F:  744883.437500, |X-X0|:  109287.234375
rounded |X_k-Y|_0 = 730357, f1 =  0.654497, approx slack: 9450913
rounded before pow |X_k-Y|_0 = 9579725, f1 =  0.310526

Iteration 3460: Loss = 853813.000000
|Xk-Y|_F:  744721.187500, |X-X0|:  109091.796875
rounded |X_k-Y|_0 = 730190, f1 =  0.654513, approx slack: 9452269
rounded before pow |X_k-Y|_0 = 9581221, f1 =  0.310485

Iteration 3480: Loss = 853405.250000
|Xk-Y|_F:  744519.875000, |X-X0|:  108885.367188
rounded |X_k-Y|_0 = 730060, f1 =  0.654525, approx slack: 9445892
rounded before pow |X_k-Y|_0 = 9574919, f1 =  0.310659

Iteration 3500: Loss = 853075.125000
|Xk-Y|_F:  744381.812500, |X-X0|:  108693.289062
rounded |X_k-Y|_0 = 729922, f1 =  0.654537, approx slack: 9444847
rounded before pow |X_k-Y|_0 = 9574139, f1 =  0.310680

Iteration 3520: Loss = 852674.625000
|Xk-Y|_F:  744201.625000, |X-X0|:  108472.984375
rounded |X_k-Y|_0 = 729800, f1 =  0.654549, approx slack: 9448397
rounded before pow |X_k-Y|_0 = 9577456, f1 =  0.310588

Iteration 3540: Loss = 852305.687500
|Xk-Y|_F:  744035.000000, |X-X0|:  108270.687500
rounded |X_k-Y|_0 = 729655, f1 =  0.654563, approx slack: 9449615
rounded before pow |X_k-Y|_0 = 9578779, f1 =  0.310552

Iteration 3560: Loss = 851941.875000
|Xk-Y|_F:  743884.750000, |X-X0|:  108057.156250
rounded |X_k-Y|_0 = 729524, f1 =  0.654575, approx slack: 9449571
rounded before pow |X_k-Y|_0 = 9578652, f1 =  0.310555

Iteration 3580: Loss = 851604.312500
|Xk-Y|_F:  743737.187500, |X-X0|:  107867.132812
rounded |X_k-Y|_0 = 729358, f1 =  0.654590, approx slack: 9449053
rounded before pow |X_k-Y|_0 = 9578098, f1 =  0.310571

Iteration 3600: Loss = 851327.875000
|Xk-Y|_F:  743637.375000, |X-X0|:  107690.523438
rounded |X_k-Y|_0 = 729292, f1 =  0.654598, approx slack: 9450410
rounded before pow |X_k-Y|_0 = 9582705, f1 =  0.310440

Iteration 3620: Loss = 850842.062500
|Xk-Y|_F:  743380.937500, |X-X0|:  107461.125000
rounded |X_k-Y|_0 = 729144, f1 =  0.654611, approx slack: 9449595
rounded before pow |X_k-Y|_0 = 9581901, f1 =  0.310462

Iteration 3640: Loss = 850476.062500
|Xk-Y|_F:  743213.000000, |X-X0|:  107263.078125
rounded |X_k-Y|_0 = 729019, f1 =  0.654624, approx slack: 9447483
rounded before pow |X_k-Y|_0 = 9579861, f1 =  0.310518

Iteration 3660: Loss = 850084.375000
|Xk-Y|_F:  743016.625000, |X-X0|:  107067.781250
rounded |X_k-Y|_0 = 728938, f1 =  0.654632, approx slack: 9448673
rounded before pow |X_k-Y|_0 = 9580908, f1 =  0.310489

Iteration 3680: Loss = 849680.812500
|Xk-Y|_F:  742794.875000, |X-X0|:  106885.945312
rounded |X_k-Y|_0 = 728843, f1 =  0.654642, approx slack: 9449689
rounded before pow |X_k-Y|_0 = 9582005, f1 =  0.310459

Iteration 3700: Loss = 849266.000000
|Xk-Y|_F:  742547.000000, |X-X0|:  106718.984375
rounded |X_k-Y|_0 = 728742, f1 =  0.654653, approx slack: 9433943
rounded before pow |X_k-Y|_0 = 9566547, f1 =  0.310885

Iteration 3720: Loss = 848780.187500
|Xk-Y|_F:  742267.312500, |X-X0|:  106512.851562
rounded |X_k-Y|_0 = 728541, f1 =  0.654670, approx slack: 9431771
rounded before pow |X_k-Y|_0 = 9564357, f1 =  0.310945

Iteration 3740: Loss = 848275.187500
|Xk-Y|_F:  741963.125000, |X-X0|:  106312.062500
rounded |X_k-Y|_0 = 728375, f1 =  0.654692, approx slack: 9431642
rounded before pow |X_k-Y|_0 = 9564013, f1 =  0.310955

Iteration 3760: Loss = 847643.375000
|Xk-Y|_F:  741529.625000, |X-X0|:  106113.742188
rounded |X_k-Y|_0 = 728281, f1 =  0.654714, approx slack: 9425343
rounded before pow |X_k-Y|_0 = 9557563, f1 =  0.311133

Iteration 3780: Loss = 847234.187500
|Xk-Y|_F:  741325.000000, |X-X0|:  105909.187500
rounded |X_k-Y|_0 = 728176, f1 =  0.654727, approx slack: 9420985
rounded before pow |X_k-Y|_0 = 9553384, f1 =  0.311248

Iteration 3800: Loss = 846836.000000
|Xk-Y|_F:  741139.812500, |X-X0|:  105696.179688
rounded |X_k-Y|_0 = 728103, f1 =  0.654735, approx slack: 9422153
rounded before pow |X_k-Y|_0 = 9553837, f1 =  0.311237

Iteration 3820: Loss = 846456.500000
|Xk-Y|_F:  740958.625000, |X-X0|:  105497.898438
rounded |X_k-Y|_0 = 727977, f1 =  0.654747, approx slack: 9421563
rounded before pow |X_k-Y|_0 = 9553109, f1 =  0.311257

Iteration 3840: Loss = 846083.625000
|Xk-Y|_F:  740773.750000, |X-X0|:  105309.906250
rounded |X_k-Y|_0 = 727891, f1 =  0.654757, approx slack: 9419121
rounded before pow |X_k-Y|_0 = 9550820, f1 =  0.311320

Iteration 3860: Loss = 845645.750000
|Xk-Y|_F:  740565.000000, |X-X0|:  105080.781250
rounded |X_k-Y|_0 = 727804, f1 =  0.654766, approx slack: 9411491
rounded before pow |X_k-Y|_0 = 9543359, f1 =  0.311525

Iteration 3880: Loss = 845345.000000
|Xk-Y|_F:  740417.937500, |X-X0|:  104927.062500
rounded |X_k-Y|_0 = 727633, f1 =  0.654782, approx slack: 9408967
rounded before pow |X_k-Y|_0 = 9540973, f1 =  0.311591

Iteration 3900: Loss = 844935.187500
|Xk-Y|_F:  740235.500000, |X-X0|:  104699.710938
rounded |X_k-Y|_0 = 727550, f1 =  0.654791, approx slack: 9395996
rounded before pow |X_k-Y|_0 = 9528120, f1 =  0.311946

Iteration 3920: Loss = 844588.687500
|Xk-Y|_F:  740071.875000, |X-X0|:  104516.812500
rounded |X_k-Y|_0 = 727426, f1 =  0.654803, approx slack: 9390451
rounded before pow |X_k-Y|_0 = 9522534, f1 =  0.312100

Iteration 3940: Loss = 844325.000000
|Xk-Y|_F:  739956.125000, |X-X0|:  104368.859375
rounded |X_k-Y|_0 = 727331, f1 =  0.654811, approx slack: 9387545
rounded before pow |X_k-Y|_0 = 9520051, f1 =  0.312167

Iteration 3960: Loss = 844016.625000
|Xk-Y|_F:  739815.937500, |X-X0|:  104200.687500
rounded |X_k-Y|_0 = 727247, f1 =  0.654820, approx slack: 9386829
rounded before pow |X_k-Y|_0 = 9519354, f1 =  0.312186

Iteration 3980: Loss = 843621.250000
|Xk-Y|_F:  739642.750000, |X-X0|:  103978.500000
rounded |X_k-Y|_0 = 727193, f1 =  0.654825, approx slack: 9385138
rounded before pow |X_k-Y|_0 = 9517896, f1 =  0.312226

Iteration 4000: Loss = 843246.875000
|Xk-Y|_F:  739491.375000, |X-X0|:  103755.500000
rounded |X_k-Y|_0 = 727110, f1 =  0.654834, approx slack: 9379959
rounded before pow |X_k-Y|_0 = 9512873, f1 =  0.312364

Iteration 4020: Loss = 842751.750000
|Xk-Y|_F:  739338.625000, |X-X0|:  103413.109375
rounded |X_k-Y|_0 = 727001, f1 =  0.654844, approx slack: 9178294
rounded before pow |X_k-Y|_0 = 9314587, f1 =  0.317819

Iteration 4040: Loss = 842424.000000
|Xk-Y|_F:  739192.812500, |X-X0|:  103231.195312
rounded |X_k-Y|_0 = 726860, f1 =  0.654857, approx slack: 9183244
rounded before pow |X_k-Y|_0 = 9319004, f1 =  0.317698

Iteration 4060: Loss = 842133.562500
|Xk-Y|_F:  739054.187500, |X-X0|:  103079.375000
rounded |X_k-Y|_0 = 726822, f1 =  0.654862, approx slack: 9184163
rounded before pow |X_k-Y|_0 = 9319773, f1 =  0.317677

Iteration 4080: Loss = 841741.687500
|Xk-Y|_F:  738884.500000, |X-X0|:  102857.171875
rounded |X_k-Y|_0 = 726708, f1 =  0.654872, approx slack: 9181836
rounded before pow |X_k-Y|_0 = 9317691, f1 =  0.317734

Iteration 4100: Loss = 841392.812500
|Xk-Y|_F:  738714.875000, |X-X0|:  102677.945312
rounded |X_k-Y|_0 = 726624, f1 =  0.654879, approx slack: 9180876
rounded before pow |X_k-Y|_0 = 9316767, f1 =  0.317759

Iteration 4120: Loss = 841058.812500
|Xk-Y|_F:  738552.250000, |X-X0|:  102506.585938
rounded |X_k-Y|_0 = 726538, f1 =  0.654888, approx slack: 9179286
rounded before pow |X_k-Y|_0 = 9315116, f1 =  0.317804

Iteration 4140: Loss = 840692.937500
|Xk-Y|_F:  738365.750000, |X-X0|:  102327.210938
rounded |X_k-Y|_0 = 726402, f1 =  0.654902, approx slack: 9173196
rounded before pow |X_k-Y|_0 = 9309327, f1 =  0.317963

Iteration 4160: Loss = 840386.812500
|Xk-Y|_F:  738213.125000, |X-X0|:  102173.679688
rounded |X_k-Y|_0 = 726274, f1 =  0.654914, approx slack: 9171401
rounded before pow |X_k-Y|_0 = 9307628, f1 =  0.318009

Iteration 4180: Loss = 839988.812500
|Xk-Y|_F:  737996.875000, |X-X0|:  101991.921875
rounded |X_k-Y|_0 = 726183, f1 =  0.654924, approx slack: 9168449
rounded before pow |X_k-Y|_0 = 9306582, f1 =  0.318036

Iteration 4200: Loss = 839682.312500
|Xk-Y|_F:  737843.875000, |X-X0|:  101838.437500
rounded |X_k-Y|_0 = 726031, f1 =  0.654938, approx slack: 9160835
rounded before pow |X_k-Y|_0 = 9299337, f1 =  0.318235

Iteration 4220: Loss = 839355.312500
|Xk-Y|_F:  737674.937500, |X-X0|:  101680.375000
rounded |X_k-Y|_0 = 725923, f1 =  0.654949, approx slack: 9156503
rounded before pow |X_k-Y|_0 = 9295081, f1 =  0.318351

Iteration 4240: Loss = 839048.687500
|Xk-Y|_F:  737524.125000, |X-X0|:  101524.578125
rounded |X_k-Y|_0 = 725790, f1 =  0.654961, approx slack: 9154998
rounded before pow |X_k-Y|_0 = 9294098, f1 =  0.318378

Iteration 4260: Loss = 838703.562500
|Xk-Y|_F:  737368.562500, |X-X0|:  101335.015625
rounded |X_k-Y|_0 = 725700, f1 =  0.654970, approx slack: 9152490
rounded before pow |X_k-Y|_0 = 9293112, f1 =  0.318404

Iteration 4280: Loss = 838354.375000
|Xk-Y|_F:  737160.812500, |X-X0|:  101193.554688
rounded |X_k-Y|_0 = 725496, f1 =  0.654988, approx slack: 9143457
rounded before pow |X_k-Y|_0 = 9284281, f1 =  0.318646

Iteration 4300: Loss = 838040.750000
|Xk-Y|_F:  737018.187500, |X-X0|:  101022.578125
rounded |X_k-Y|_0 = 725340, f1 =  0.655002, approx slack: 9145894
rounded before pow |X_k-Y|_0 = 9286647, f1 =  0.318580

Iteration 4320: Loss = 837792.250000
|Xk-Y|_F:  736915.437500, |X-X0|:  100876.812500
rounded |X_k-Y|_0 = 725163, f1 =  0.655017, approx slack: 9153149
rounded before pow |X_k-Y|_0 = 9293689, f1 =  0.318387

Iteration 4340: Loss = 837421.500000
|Xk-Y|_F:  736730.125000, |X-X0|:  100691.382812
rounded |X_k-Y|_0 = 725001, f1 =  0.655033, approx slack: 9137155
rounded before pow |X_k-Y|_0 = 9279630, f1 =  0.318771

Iteration 4360: Loss = 837092.812500
|Xk-Y|_F:  736540.875000, |X-X0|:  100551.937500
rounded |X_k-Y|_0 = 724806, f1 =  0.655051, approx slack: 9137261
rounded before pow |X_k-Y|_0 = 9279770, f1 =  0.318767

Iteration 4380: Loss = 836821.062500
|Xk-Y|_F:  736399.437500, |X-X0|:  100421.609375
rounded |X_k-Y|_0 = 724705, f1 =  0.655060, approx slack: 9133591
rounded before pow |X_k-Y|_0 = 9276080, f1 =  0.318869

Iteration 4400: Loss = 836483.937500
|Xk-Y|_F:  736241.937500, |X-X0|:  100242.007812
rounded |X_k-Y|_0 = 724556, f1 =  0.655074, approx slack: 9128852
rounded before pow |X_k-Y|_0 = 9272729, f1 =  0.318959

Iteration 4420: Loss = 836194.125000
|Xk-Y|_F:  736111.500000, |X-X0|:  100082.656250
rounded |X_k-Y|_0 = 724367, f1 =  0.655091, approx slack: 9131073
rounded before pow |X_k-Y|_0 = 9274756, f1 =  0.318904

Iteration 4440: Loss = 835864.750000
|Xk-Y|_F:  735944.375000, |X-X0|:  99920.382812
rounded |X_k-Y|_0 = 724221, f1 =  0.655105, approx slack: 9132573
rounded before pow |X_k-Y|_0 = 9276559, f1 =  0.318854

Iteration 4460: Loss = 835553.687500
|Xk-Y|_F:  735821.250000, |X-X0|:  99732.437500
rounded |X_k-Y|_0 = 724039, f1 =  0.655122, approx slack: 9132723
rounded before pow |X_k-Y|_0 = 9276686, f1 =  0.318850

Iteration 4480: Loss = 835337.312500
|Xk-Y|_F:  735714.750000, |X-X0|:  99622.570312
rounded |X_k-Y|_0 = 723951, f1 =  0.655130, approx slack: 9128408
rounded before pow |X_k-Y|_0 = 9273022, f1 =  0.318950

Iteration 4500: Loss = 835058.062500
|Xk-Y|_F:  735589.437500, |X-X0|:  99468.625000
rounded |X_k-Y|_0 = 723782, f1 =  0.655145, approx slack: 9127552
rounded before pow |X_k-Y|_0 = 9272255, f1 =  0.318971

Iteration 4520: Loss = 834755.312500
|Xk-Y|_F:  735427.375000, |X-X0|:  99327.960938
rounded |X_k-Y|_0 = 723696, f1 =  0.655154, approx slack: 9120182
rounded before pow |X_k-Y|_0 = 9265073, f1 =  0.319167

Iteration 4540: Loss = 834494.437500
|Xk-Y|_F:  735336.375000, |X-X0|:  99158.054688
rounded |X_k-Y|_0 = 723555, f1 =  0.655166, approx slack: 9110141
rounded before pow |X_k-Y|_0 = 9255678, f1 =  0.319425

Iteration 4560: Loss = 834119.625000
|Xk-Y|_F:  735180.625000, |X-X0|:  98938.984375
rounded |X_k-Y|_0 = 723397, f1 =  0.655180, approx slack: 9109226
rounded before pow |X_k-Y|_0 = 9254793, f1 =  0.319449

Iteration 4580: Loss = 833817.875000
|Xk-Y|_F:  735029.750000, |X-X0|:  98788.125000
rounded |X_k-Y|_0 = 723309, f1 =  0.655190, approx slack: 9108698
rounded before pow |X_k-Y|_0 = 9254412, f1 =  0.319459

Iteration 4600: Loss = 833517.875000
|Xk-Y|_F:  734914.062500, |X-X0|:  98603.781250
rounded |X_k-Y|_0 = 723107, f1 =  0.655206, approx slack: 9107079
rounded before pow |X_k-Y|_0 = 9252703, f1 =  0.319506

Iteration 4620: Loss = 833222.687500
|Xk-Y|_F:  734780.750000, |X-X0|:  98441.953125
rounded |X_k-Y|_0 = 722982, f1 =  0.655218, approx slack: 9107050
rounded before pow |X_k-Y|_0 = 9252676, f1 =  0.319507

Iteration 4640: Loss = 833004.750000
|Xk-Y|_F:  734686.000000, |X-X0|:  98318.750000
rounded |X_k-Y|_0 = 722865, f1 =  0.655229, approx slack: 9096608
rounded before pow |X_k-Y|_0 = 9242528, f1 =  0.319780

Iteration 4660: Loss = 832747.625000
|Xk-Y|_F:  734580.312500, |X-X0|:  98167.281250
rounded |X_k-Y|_0 = 722723, f1 =  0.655241, approx slack: 9105196
rounded before pow |X_k-Y|_0 = 9250958, f1 =  0.319549

Iteration 4680: Loss = 832486.625000
|Xk-Y|_F:  734463.250000, |X-X0|:  98023.375000
rounded |X_k-Y|_0 = 722603, f1 =  0.655253, approx slack: 9103794
rounded before pow |X_k-Y|_0 = 9249562, f1 =  0.319587

Iteration 4700: Loss = 832212.937500
|Xk-Y|_F:  734367.312500, |X-X0|:  97845.625000
rounded |X_k-Y|_0 = 722551, f1 =  0.655258, approx slack: 9099604
rounded before pow |X_k-Y|_0 = 9245465, f1 =  0.319699

Iteration 4720: Loss = 831913.437500
|Xk-Y|_F:  734255.375000, |X-X0|:  97658.046875
rounded |X_k-Y|_0 = 722438, f1 =  0.655268, approx slack: 9102460
rounded before pow |X_k-Y|_0 = 9248325, f1 =  0.319621

Iteration 4740: Loss = 831710.562500
|Xk-Y|_F:  734193.687500, |X-X0|:  97516.875000
rounded |X_k-Y|_0 = 722313, f1 =  0.655278, approx slack: 9101338
rounded before pow |X_k-Y|_0 = 9247253, f1 =  0.319650

Iteration 4760: Loss = 831377.875000
|Xk-Y|_F:  734059.125000, |X-X0|:  97318.781250
rounded |X_k-Y|_0 = 722262, f1 =  0.655284, approx slack: 9096040
rounded before pow |X_k-Y|_0 = 9241695, f1 =  0.319802

Iteration 4780: Loss = 831173.687500
|Xk-Y|_F:  733981.250000, |X-X0|:  97192.437500
rounded |X_k-Y|_0 = 722135, f1 =  0.655295, approx slack: 9093466
rounded before pow |X_k-Y|_0 = 9239103, f1 =  0.319876

Iteration 4800: Loss = 830919.000000
|Xk-Y|_F:  733912.875000, |X-X0|:  97006.093750
rounded |X_k-Y|_0 = 722079, f1 =  0.655299, approx slack: 9091145
rounded before pow |X_k-Y|_0 = 9236988, f1 =  0.319934

Iteration 4820: Loss = 830566.375000
|Xk-Y|_F:  733782.937500, |X-X0|:  96783.437500
rounded |X_k-Y|_0 = 722028, f1 =  0.655305, approx slack: 9092146
rounded before pow |X_k-Y|_0 = 9237816, f1 =  0.319911

Iteration 4840: Loss = 830369.000000
|Xk-Y|_F:  733756.750000, |X-X0|:  96612.242188
rounded |X_k-Y|_0 = 722026, f1 =  0.655305, approx slack: 9091976
rounded before pow |X_k-Y|_0 = 9237617, f1 =  0.319917

Iteration 4860: Loss = 830037.750000
|Xk-Y|_F:  733601.375000, |X-X0|:  96436.382812
rounded |X_k-Y|_0 = 721833, f1 =  0.655323, approx slack: 9090967
rounded before pow |X_k-Y|_0 = 9237154, f1 =  0.319929

Iteration 4880: Loss = 829742.812500
|Xk-Y|_F:  733447.437500, |X-X0|:  96295.390625
rounded |X_k-Y|_0 = 721701, f1 =  0.655335, approx slack: 9085838
rounded before pow |X_k-Y|_0 = 9231833, f1 =  0.320074

Iteration 4900: Loss = 829438.500000
|Xk-Y|_F:  733336.937500, |X-X0|:  96101.578125
rounded |X_k-Y|_0 = 721557, f1 =  0.655347, approx slack: 9081514
rounded before pow |X_k-Y|_0 = 9226359, f1 =  0.320225

Iteration 4920: Loss = 829163.500000
|Xk-Y|_F:  733226.375000, |X-X0|:  95937.140625
rounded |X_k-Y|_0 = 721476, f1 =  0.655356, approx slack: 9075936
rounded before pow |X_k-Y|_0 = 9221388, f1 =  0.320363

Iteration 4940: Loss = 828857.937500
|Xk-Y|_F:  733117.750000, |X-X0|:  95740.195312
rounded |X_k-Y|_0 = 721325, f1 =  0.655369, approx slack: 9075717
rounded before pow |X_k-Y|_0 = 9221019, f1 =  0.320365

Iteration 4960: Loss = 828606.500000
|Xk-Y|_F:  733038.125000, |X-X0|:  95568.406250
rounded |X_k-Y|_0 = 721205, f1 =  0.655377, approx slack: 9074921
rounded before pow |X_k-Y|_0 = 9220495, f1 =  0.320379

Iteration 4980: Loss = 828285.125000
|Xk-Y|_F:  732884.625000, |X-X0|:  95400.531250
rounded |X_k-Y|_0 = 721169, f1 =  0.655384, approx slack: 9068819
rounded before pow |X_k-Y|_0 = 9215770, f1 =  0.320506

Iteration 4999: Loss = 828027.875000
|Xk-Y|_F:  732786.875000, |X-X0|:  95241.031250
rounded |X_k-Y|_0 = 721024, f1 =  0.655397, approx slack: 9065028
rounded before pow |X_k-Y|_0 = 9212019, f1 =  0.320609


KB after refine:
num_nodes: 5060.0000
num_edges: 4317.0000
density: 0.0002
avg_degree: 0.8532
avg_clustering: 0.0260
degree_assortativity: -0.2108
modularity: 0.7770
avg_betweenness: 0.0000
avg_closeness: 0.0026
------ ABL 0 after refine ------
--- eval ---
prediction result:
f1 on test:    0.4909
f1 on test:    0.7509 (micro)
f1 on KB:      0.6185
f1 on orig KB: 0.3248
integrated f1: 0.3545, w_data: 0.2862, w_klg: 0.7138

integrated result:
f1 on test:    0.4758
f1 on test:    0.7481 (micro)
f1 on KB:      0.6411
f1 on orig KB: 0.3224
integrated f1: 0.3507, w_data: 0.2862, w_klg: 0.7138
------------
integrated f1 0.3545
Epoch 100, Total loss: 101343158272.0000, CE loss: 33.0420, RL loss: 1013431616.0000, Reward: -4968012.4922
    full cols: 683, non-full cols: 27
   r - labels: 324, labels - r: 279
    violated: 12329, weighted: 13178.9697265625, len: 0.0, nonzero: 0.13723134994506836
Epoch 200, Total loss: 250376224768.0000, CE loss: 33.0368, RL loss: 2503762176.0000, Reward: -4950054.5801
    full cols: 682, non-full cols: 25
   r - labels: 321, labels - r: 279
    violated: 12998, weighted: 13180.501953125, len: 0.0, nonzero: 0.13725295662879944
Epoch 300, Total loss: -16903337984.0000, CE loss: 33.0291, RL loss: -169033376.0000, Reward: -4964836.9258
    full cols: 685, non-full cols: 20
   r - labels: 319, labels - r: 279
    violated: 12368, weighted: 13127.47265625, len: 0.0, nonzero: 0.13707385957241058
Epoch 400, Total loss: 83935109120.0000, CE loss: 33.0233, RL loss: 839351104.0000, Reward: -4944657.5039
    full cols: 683, non-full cols: 19
   r - labels: 316, labels - r: 279
    violated: 12228, weighted: 13084.173828125, len: 0.0, nonzero: 0.1362987905740738
Epoch 500, Total loss: -56195596288.0000, CE loss: 33.0152, RL loss: -561955968.0000, Reward: -4943773.0234
    full cols: 685, non-full cols: 21
   r - labels: 320, labels - r: 279
    violated: 10652, weighted: 13138.775390625, len: 0.0, nonzero: 0.13685770332813263
Epoch 600, Total loss: 41223434240.0000, CE loss: 33.0074, RL loss: 412234336.0000, Reward: -4955364.6562
    full cols: 686, non-full cols: 19
   r - labels: 319, labels - r: 279
    violated: 13077, weighted: 13111.74609375, len: 0.0, nonzero: 0.13822875916957855
Epoch 700, Total loss: 13307580416.0000, CE loss: 33.0045, RL loss: 133075808.0000, Reward: -4939764.3750
    full cols: 686, non-full cols: 23
   r - labels: 321, labels - r: 277
    violated: 13442, weighted: 13104.6865234375, len: 0.0, nonzero: 0.13739192485809326
Epoch 800, Total loss: -107370512384.0000, CE loss: 32.9976, RL loss: -1073705152.0000, Reward: -4942612.4922
    full cols: 692, non-full cols: 19
   r - labels: 324, labels - r: 278
    violated: 12071, weighted: 13238.013671875, len: 0.0, nonzero: 0.13851284980773926
Epoch 900, Total loss: 199555481600.0000, CE loss: 32.9915, RL loss: 1995554816.0000, Reward: -4914087.2383
    full cols: 694, non-full cols: 17
   r - labels: 326, labels - r: 280
    violated: 12430, weighted: 13404.326171875, len: 0.0, nonzero: 0.13875988125801086
Epoch 1000, Total loss: 66010189824.0000, CE loss: 32.9894, RL loss: 660101888.0000, Reward: -4918095.9492
    full cols: 684, non-full cols: 26
   r - labels: 326, labels - r: 281
    violated: 11514, weighted: 13375.462890625, len: 0.0, nonzero: 0.13810832798480988
Epoch 1100, Total loss: 20082200576.0000, CE loss: 32.9856, RL loss: 200822016.0000, Reward: -4908615.4805
    full cols: 689, non-full cols: 22
   r - labels: 325, labels - r: 279
    violated: 14359, weighted: 13415.8740234375, len: 0.0, nonzero: 0.138185515999794
Epoch 1200, Total loss: -70825263104.0000, CE loss: 32.9796, RL loss: -708252608.0000, Reward: -4912479.7480
    full cols: 688, non-full cols: 20
   r - labels: 327, labels - r: 284
    violated: 14433, weighted: 13599.8251953125, len: 0.0, nonzero: 0.1377532035112381
Epoch 1300, Total loss: 78151925760.0000, CE loss: 32.9776, RL loss: 781519296.0000, Reward: -4893086.0469
    full cols: 687, non-full cols: 17
   r - labels: 325, labels - r: 286
    violated: 12498, weighted: 13518.2509765625, len: 0.0, nonzero: 0.1376914530992508
Epoch 1400, Total loss: -77941178368.0000, CE loss: 32.9739, RL loss: -779411776.0000, Reward: -4911379.0547
    full cols: 689, non-full cols: 20
   r - labels: 327, labels - r: 283
    violated: 13305, weighted: 13526.474609375, len: 0.0, nonzero: 0.13836771249771118
Epoch 1500, Total loss: -151118151680.0000, CE loss: 32.9697, RL loss: -1511181568.0000, Reward: -4901441.7949
    full cols: 695, non-full cols: 14
   r - labels: 324, labels - r: 280
    violated: 12255, weighted: 13431.2744140625, len: 0.0, nonzero: 0.13879075646400452
Epoch 1600, Total loss: -67625222144.0000, CE loss: 32.9677, RL loss: -676252224.0000, Reward: -4900091.7852
    full cols: 697, non-full cols: 17
   r - labels: 327, labels - r: 278
    violated: 12353, weighted: 13340.859375, len: 0.0, nonzero: 0.13881546258926392
Epoch 1700, Total loss: 104952217600.0000, CE loss: 32.9661, RL loss: 1049522176.0000, Reward: -4880108.8555
    full cols: 692, non-full cols: 8
   r - labels: 319, labels - r: 284
    violated: 14217, weighted: 13227.14453125, len: 0.0, nonzero: 0.13768526911735535
Epoch 1800, Total loss: -233265758208.0000, CE loss: 32.9618, RL loss: -2332657664.0000, Reward: -4890420.4570
    full cols: 687, non-full cols: 24
   r - labels: 327, labels - r: 281
    violated: 13639, weighted: 13263.9365234375, len: 0.0, nonzero: 0.13826890289783478
Epoch 1900, Total loss: -16692867072.0000, CE loss: 32.9577, RL loss: -166928672.0000, Reward: -4875210.0156
    full cols: 688, non-full cols: 22
   r - labels: 327, labels - r: 282
    violated: 12778, weighted: 13367.607421875, len: 0.0, nonzero: 0.13780878484249115
--- eval ---
prediction result:
f1 on test:    0.4908
f1 on test:    0.7509 (micro)
f1 on KB:      0.6186
integrated f1: 0.5703, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4761
f1 on test:    0.7482 (micro)
f1 on KB:      0.6413
integrated f1: 0.5749, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 2000, Total loss: 89987358720.0000, CE loss: 32.9550, RL loss: 899873600.0000, Reward: -4867554.0938
    full cols: 684, non-full cols: 20
   r - labels: 319, labels - r: 280
    violated: 12779, weighted: 13251.705078125, len: 0.0, nonzero: 0.136792853474617
Epoch 2100, Total loss: -14995902464.0000, CE loss: 32.9551, RL loss: -149959024.0000, Reward: -4865031.1680
    full cols: 691, non-full cols: 12
   r - labels: 318, labels - r: 280
    violated: 12510, weighted: 13286.08203125, len: 0.0, nonzero: 0.1376296877861023
Epoch 2200, Total loss: 183878942720.0000, CE loss: 32.9494, RL loss: 1838789504.0000, Reward: -4830997.0547
    full cols: 686, non-full cols: 18
   r - labels: 319, labels - r: 280
    violated: 12697, weighted: 13236.8876953125, len: 0.0, nonzero: 0.13729001581668854
Epoch 2300, Total loss: -122605756416.0000, CE loss: 32.9499, RL loss: -1226057600.0000, Reward: -4864447.9336
    full cols: 690, non-full cols: 9
   r - labels: 316, labels - r: 282
    violated: 12622, weighted: 13245.51953125, len: 0.0, nonzero: 0.13736103475093842
Epoch 2400, Total loss: 95135367168.0000, CE loss: 32.9462, RL loss: 951353664.0000, Reward: -4843702.1953
    full cols: 689, non-full cols: 7
   r - labels: 314, labels - r: 283
    violated: 14566, weighted: 13206.798828125, len: 0.0, nonzero: 0.13697504997253418
Epoch 2500, Total loss: -27909376000.0000, CE loss: 32.9438, RL loss: -279093760.0000, Reward: -4852813.6914
    full cols: 684, non-full cols: 18
   r - labels: 319, labels - r: 282
    violated: 12704, weighted: 13349.130859375, len: 0.0, nonzero: 0.13748455047607422
Epoch 2600, Total loss: 201707454464.0000, CE loss: 32.9409, RL loss: 2017074560.0000, Reward: -4833992.1602
    full cols: 678, non-full cols: 23
   r - labels: 320, labels - r: 284
    violated: 13369, weighted: 13441.462890625, len: 0.0, nonzero: 0.13651494681835175
Epoch 2700, Total loss: -39072743424.0000, CE loss: 32.9389, RL loss: -390727424.0000, Reward: -4859847.0781
    full cols: 681, non-full cols: 18
   r - labels: 318, labels - r: 284
    violated: 11592, weighted: 13334.8154296875, len: 0.0, nonzero: 0.13696269690990448
Epoch 2800, Total loss: -58798055424.0000, CE loss: 32.9364, RL loss: -587980544.0000, Reward: -4856733.4805
    full cols: 682, non-full cols: 16
   r - labels: 322, labels - r: 289
    violated: 13682, weighted: 13481.3046875, len: 0.0, nonzero: 0.13697504997253418
Epoch 2900, Total loss: 213912535040.0000, CE loss: 32.9352, RL loss: 2139125376.0000, Reward: -4830023.4570
    full cols: 686, non-full cols: 16
   r - labels: 319, labels - r: 282
    violated: 11924, weighted: 13258.623046875, len: 0.0, nonzero: 0.1370151937007904
Epoch 3000, Total loss: 49869828096.0000, CE loss: 32.9321, RL loss: 498698272.0000, Reward: -4845247.2070
    full cols: 683, non-full cols: 13
   r - labels: 315, labels - r: 284
    violated: 12918, weighted: 13249.978515625, len: 0.0, nonzero: 0.13602395355701447
Epoch 3100, Total loss: -9051792384.0000, CE loss: 32.9294, RL loss: -90517928.0000, Reward: -4858112.0898
    full cols: 681, non-full cols: 17
   r - labels: 319, labels - r: 286
    violated: 15235, weighted: 13352.0380859375, len: 0.0, nonzero: 0.13642539083957672
Epoch 3200, Total loss: 121407324160.0000, CE loss: 32.9288, RL loss: 1214073216.0000, Reward: -4843425.6758
    full cols: 676, non-full cols: 30
   r - labels: 325, labels - r: 284
    violated: 13123, weighted: 13410.1279296875, len: 0.0, nonzero: 0.13786746561527252
Epoch 3300, Total loss: 135057268736.0000, CE loss: 32.9261, RL loss: 1350572672.0000, Reward: -4830185.4512
    full cols: 678, non-full cols: 16
   r - labels: 318, labels - r: 289
    violated: 11493, weighted: 13571.822265625, len: 0.0, nonzero: 0.13636364042758942
Epoch 3400, Total loss: -36839153664.0000, CE loss: 32.9245, RL loss: -368391552.0000, Reward: -4842672.1328
    full cols: 677, non-full cols: 17
   r - labels: 315, labels - r: 286
    violated: 13573, weighted: 13428.498046875, len: 0.0, nonzero: 0.135326087474823
Epoch 3500, Total loss: -23747485696.0000, CE loss: 32.9217, RL loss: -237474848.0000, Reward: -4837637.3340
    full cols: 682, non-full cols: 12
   r - labels: 314, labels - r: 285
    violated: 12096, weighted: 13416.673828125, len: 0.0, nonzero: 0.13582941889762878
Epoch 3600, Total loss: 24529885184.0000, CE loss: 32.9204, RL loss: 245298848.0000, Reward: -4828296.3594
    full cols: 670, non-full cols: 18
   r - labels: 315, labels - r: 292
    violated: 12774, weighted: 13485.30078125, len: 0.0, nonzero: 0.1340322345495224
Epoch 3700, Total loss: -3426646528.0000, CE loss: 32.9165, RL loss: -34266464.0000, Reward: -4825056.8711
    full cols: 670, non-full cols: 18
   r - labels: 315, labels - r: 292
    violated: 12147, weighted: 13501.2763671875, len: 0.0, nonzero: 0.13424839079380035
Epoch 3800, Total loss: -1023852800.0000, CE loss: 32.9114, RL loss: -10238528.0000, Reward: -4807741.1055
    full cols: 678, non-full cols: 16
   r - labels: 320, labels - r: 291
    violated: 12959, weighted: 13636.4658203125, len: 0.0, nonzero: 0.13601161539554596
Epoch 3900, Total loss: 14578997248.0000, CE loss: 32.9117, RL loss: 145789968.0000, Reward: -4805187.2188
    full cols: 663, non-full cols: 29
   r - labels: 315, labels - r: 288
    violated: 11276, weighted: 13467.4853515625, len: 0.0, nonzero: 0.13453556597232819
--- eval ---
prediction result:
f1 on test:    0.4905
f1 on test:    0.7509 (micro)
f1 on KB:      0.6182
integrated f1: 0.5699, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4764
f1 on test:    0.7482 (micro)
f1 on KB:      0.6406
integrated f1: 0.5747, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 4000, Total loss: 34432094208.0000, CE loss: 32.9084, RL loss: 344320928.0000, Reward: -4796977.0312
    full cols: 665, non-full cols: 28
   r - labels: 319, labels - r: 291
    violated: 14523, weighted: 13529.3291015625, len: 0.0, nonzero: 0.1341433972120285
Epoch 4100, Total loss: -173162676224.0000, CE loss: 32.9039, RL loss: -1731626752.0000, Reward: -4850874.5430
    full cols: 673, non-full cols: 16
   r - labels: 319, labels - r: 295
    violated: 12189, weighted: 13705.59375, len: 0.0, nonzero: 0.13426382839679718
Epoch 4200, Total loss: 84103356416.0000, CE loss: 32.9002, RL loss: 841033600.0000, Reward: -4817131.5977
    full cols: 661, non-full cols: 13
   r - labels: 312, labels - r: 303
    violated: 12495, weighted: 13738.12890625, len: 0.0, nonzero: 0.13184906542301178
Epoch 4300, Total loss: -183431692288.0000, CE loss: 32.8943, RL loss: -1834316928.0000, Reward: -4822628.7422
    full cols: 660, non-full cols: 19
   r - labels: 319, labels - r: 305
    violated: 12548, weighted: 13758.33203125, len: 0.0, nonzero: 0.1320991814136505
Epoch 4400, Total loss: -246270738432.0000, CE loss: 32.8915, RL loss: -2462707456.0000, Reward: -4802480.8750
    full cols: 671, non-full cols: 21
   r - labels: 321, labels - r: 294
    violated: 12815, weighted: 13720.79296875, len: 0.0, nonzero: 0.13486598432064056
Epoch 4500, Total loss: -13308823552.0000, CE loss: 32.8855, RL loss: -133088240.0000, Reward: -4789275.7383
    full cols: 671, non-full cols: 18
   r - labels: 321, labels - r: 297
    violated: 12956, weighted: 13837.2197265625, len: 0.0, nonzero: 0.1343039721250534
Epoch 4600, Total loss: 66614513664.0000, CE loss: 32.8837, RL loss: 666145152.0000, Reward: -4768329.3008
    full cols: 673, non-full cols: 12
   r - labels: 319, labels - r: 299
    violated: 12450, weighted: 13749.298828125, len: 0.0, nonzero: 0.13446146249771118
Epoch 4700, Total loss: -11714966528.0000, CE loss: 32.8790, RL loss: -117149664.0000, Reward: -4787874.7539
    full cols: 661, non-full cols: 17
   r - labels: 314, labels - r: 301
    violated: 14295, weighted: 13663.166015625, len: 0.0, nonzero: 0.13280941545963287
Epoch 4800, Total loss: -86163693568.0000, CE loss: 32.8738, RL loss: -861636928.0000, Reward: -4771263.1836
    full cols: 650, non-full cols: 20
   r - labels: 312, labels - r: 307
    violated: 11924, weighted: 13812.79296875, len: 0.0, nonzero: 0.1303853690624237
Epoch 4900, Total loss: 82351939584.0000, CE loss: 32.8704, RL loss: 823519424.0000, Reward: -4747556.0566
    full cols: 652, non-full cols: 13
   r - labels: 308, labels - r: 308
    violated: 12751, weighted: 13678.8642578125, len: 0.0, nonzero: 0.12982337176799774
Epoch 5000, Total loss: 31015919616.0000, CE loss: 32.8663, RL loss: 310159200.0000, Reward: -4753213.0312
    full cols: 642, non-full cols: 18
   r - labels: 302, labels - r: 307
    violated: 13395, weighted: 13592.349609375, len: 0.0, nonzero: 0.12873023748397827
Epoch 5100, Total loss: 142208598016.0000, CE loss: 32.8668, RL loss: 1422086016.0000, Reward: -4723065.2285
    full cols: 644, non-full cols: 15
   r - labels: 302, labels - r: 308
    violated: 10984, weighted: 13776.39453125, len: 0.0, nonzero: 0.1286221593618393
Epoch 5200, Total loss: 4704846848.0000, CE loss: 32.8613, RL loss: 47048468.0000, Reward: -4737713.5215
    full cols: 638, non-full cols: 22
   r - labels: 304, labels - r: 309
    violated: 13224, weighted: 13637.025390625, len: 0.0, nonzero: 0.12873950600624084
Epoch 5300, Total loss: -98278891520.0000, CE loss: 32.8588, RL loss: -982788928.0000, Reward: -4734477.1758
    full cols: 635, non-full cols: 19
   r - labels: 298, labels - r: 309
    violated: 13252, weighted: 13428.564453125, len: 0.0, nonzero: 0.12689290940761566
Epoch 5400, Total loss: 91635302400.0000, CE loss: 32.8558, RL loss: 916353024.0000, Reward: -4711667.3438
    full cols: 636, non-full cols: 16
   r - labels: 304, labels - r: 317
    violated: 13164, weighted: 13626.865234375, len: 0.0, nonzero: 0.126846581697464
Epoch 5500, Total loss: 120831606784.0000, CE loss: 32.8561, RL loss: 1208316032.0000, Reward: -4707676.1055
    full cols: 626, non-full cols: 15
   r - labels: 296, labels - r: 320
    violated: 12642, weighted: 13704.8291015625, len: 0.0, nonzero: 0.12550951540470123
Epoch 5600, Total loss: 23797735424.0000, CE loss: 32.8533, RL loss: 237977344.0000, Reward: -4703402.4102
    full cols: 629, non-full cols: 18
   r - labels: 305, labels - r: 323
    violated: 11823, weighted: 14008.7568359375, len: 0.0, nonzero: 0.1257133185863495
Epoch 5700, Total loss: 187080671232.0000, CE loss: 32.8507, RL loss: 1870806784.0000, Reward: -4695184.6133
    full cols: 633, non-full cols: 13
   r - labels: 306, labels - r: 325
    violated: 13312, weighted: 14023.283203125, len: 0.0, nonzero: 0.12599122524261475
Epoch 5800, Total loss: -40792465408.0000, CE loss: 32.8508, RL loss: -407924672.0000, Reward: -4692686.0000
    full cols: 630, non-full cols: 14
   r - labels: 305, labels - r: 326
    violated: 12562, weighted: 13976.5654296875, len: 0.0, nonzero: 0.1260591596364975
Epoch 5900, Total loss: -27626143744.0000, CE loss: 32.8488, RL loss: -276261440.0000, Reward: -4701599.6797
    full cols: 632, non-full cols: 10
   r - labels: 303, labels - r: 326
    violated: 12312, weighted: 14070.3564453125, len: 0.0, nonzero: 0.1260097622871399
--- eval ---
prediction result:
f1 on test:    0.4846
f1 on test:    0.7497 (micro)
f1 on KB:      0.6188
integrated f1: 0.5675, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4745
f1 on test:    0.7476 (micro)
f1 on KB:      0.6388
integrated f1: 0.5728, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 6000, Total loss: 96497672192.0000, CE loss: 32.8513, RL loss: 964976704.0000, Reward: -4689419.6836
    full cols: 634, non-full cols: 19
   r - labels: 308, labels - r: 320
    violated: 13020, weighted: 14151.453125, len: 0.0, nonzero: 0.12672924995422363
Epoch 6100, Total loss: 65559355392.0000, CE loss: 32.8467, RL loss: 655593536.0000, Reward: -4704280.6172
    full cols: 635, non-full cols: 13
   r - labels: 305, labels - r: 322
    violated: 12081, weighted: 14033.158203125, len: 0.0, nonzero: 0.12711215019226074
Epoch 6200, Total loss: -30377891840.0000, CE loss: 32.8453, RL loss: -303778912.0000, Reward: -4714810.9727
    full cols: 630, non-full cols: 10
   r - labels: 296, labels - r: 321
    violated: 11999, weighted: 13849.80078125, len: 0.0, nonzero: 0.1256886124610901
Epoch 6300, Total loss: -51062415360.0000, CE loss: 32.8447, RL loss: -510624160.0000, Reward: -4704891.5352
    full cols: 644, non-full cols: 10
   r - labels: 309, labels - r: 320
    violated: 13326, weighted: 14105.515625, len: 0.0, nonzero: 0.12815897166728973
Epoch 6400, Total loss: 14440185856.0000, CE loss: 32.8424, RL loss: 144401856.0000, Reward: -4689123.5664
    full cols: 628, non-full cols: 13
   r - labels: 304, labels - r: 328
    violated: 14020, weighted: 14044.01953125, len: 0.0, nonzero: 0.12539216876029968
Epoch 6500, Total loss: 30712815616.0000, CE loss: 32.8424, RL loss: 307128160.0000, Reward: -4682644.6797
    full cols: 630, non-full cols: 18
   r - labels: 306, labels - r: 323
    violated: 12258, weighted: 13912.8837890625, len: 0.0, nonzero: 0.12644515931606293
Epoch 6600, Total loss: -222752587776.0000, CE loss: 32.8437, RL loss: -2227525888.0000, Reward: -4700313.7773
    full cols: 626, non-full cols: 17
   r - labels: 305, labels - r: 327
    violated: 11329, weighted: 14024.140625, len: 0.0, nonzero: 0.12540452182292938
Epoch 6700, Total loss: 28180402176.0000, CE loss: 32.8413, RL loss: 281804032.0000, Reward: -4683044.5469
    full cols: 621, non-full cols: 20
   r - labels: 306, labels - r: 330
    violated: 12999, weighted: 14082.1064453125, len: 0.0, nonzero: 0.12484250962734222
Epoch 6800, Total loss: 80437403648.0000, CE loss: 32.8416, RL loss: 804374016.0000, Reward: -4685873.1738
    full cols: 623, non-full cols: 9
   r - labels: 302, labels - r: 335
    violated: 14205, weighted: 14170.1796875, len: 0.0, nonzero: 0.12411066889762878
Epoch 6900, Total loss: 23365240832.0000, CE loss: 32.8406, RL loss: 233652400.0000, Reward: -4696131.5215
    full cols: 622, non-full cols: 19
   r - labels: 309, labels - r: 333
    violated: 13673, weighted: 14240.5322265625, len: 0.0, nonzero: 0.12490735948085785
Epoch 7000, Total loss: 57848127488.0000, CE loss: 32.8405, RL loss: 578481280.0000, Reward: -4691004.0117
    full cols: 628, non-full cols: 8
   r - labels: 305, labels - r: 334
    violated: 12190, weighted: 14235.763671875, len: 0.0, nonzero: 0.12489500641822815
Epoch 7100, Total loss: -28111433728.0000, CE loss: 32.8397, RL loss: -281114336.0000, Reward: -4700972.1406
    full cols: 618, non-full cols: 18
   r - labels: 309, labels - r: 338
    violated: 13705, weighted: 14346.771484375, len: 0.0, nonzero: 0.12440093606710434
Epoch 7200, Total loss: 128655523840.0000, CE loss: 32.8406, RL loss: 1286555264.0000, Reward: -4673563.9883
    full cols: 620, non-full cols: 16
   r - labels: 309, labels - r: 338
    violated: 12458, weighted: 14387.46875, len: 0.0, nonzero: 0.12403038144111633
Epoch 7300, Total loss: 74280648704.0000, CE loss: 32.8406, RL loss: 742806528.0000, Reward: -4703371.6602
    full cols: 611, non-full cols: 19
   r - labels: 313, labels - r: 348
    violated: 14231, weighted: 14683.2109375, len: 0.0, nonzero: 0.12265933305025101
Epoch 7400, Total loss: 11994807296.0000, CE loss: 32.8378, RL loss: 119948072.0000, Reward: -4722536.3828
    full cols: 619, non-full cols: 15
   r - labels: 315, labels - r: 346
    violated: 12117, weighted: 14702.666015625, len: 0.0, nonzero: 0.12389760464429855
Epoch 7500, Total loss: -95801737216.0000, CE loss: 32.8396, RL loss: -958017408.0000, Reward: -4746743.9492
    full cols: 617, non-full cols: 9
   r - labels: 309, labels - r: 348
    violated: 15184, weighted: 14477.1796875, len: 0.0, nonzero: 0.12301753461360931
Epoch 7600, Total loss: -97922301952.0000, CE loss: 32.8370, RL loss: -979223040.0000, Reward: -4734205.4355
    full cols: 620, non-full cols: 14
   r - labels: 316, labels - r: 347
    violated: 12724, weighted: 14608.2041015625, len: 0.0, nonzero: 0.12350543588399887
Epoch 7700, Total loss: -19883714560.0000, CE loss: 32.8370, RL loss: -198837152.0000, Reward: -4747053.7812
    full cols: 615, non-full cols: 24
   r - labels: 324, labels - r: 350
    violated: 12918, weighted: 14734.9296875, len: 0.0, nonzero: 0.12352395802736282
Epoch 7800, Total loss: -116177084416.0000, CE loss: 32.8373, RL loss: -1161770880.0000, Reward: -4758557.1367
    full cols: 601, non-full cols: 25
   r - labels: 316, labels - r: 355
    violated: 12818, weighted: 14707.916015625, len: 0.0, nonzero: 0.12133152037858963
Epoch 7900, Total loss: -39652057088.0000, CE loss: 32.8371, RL loss: -396520576.0000, Reward: -4735804.6699
    full cols: 618, non-full cols: 12
   r - labels: 319, labels - r: 354
    violated: 12626, weighted: 14908.337890625, len: 0.0, nonzero: 0.12320590019226074
--- eval ---
prediction result:
f1 on test:    0.4846
f1 on test:    0.7497 (micro)
f1 on KB:      0.6188
integrated f1: 0.5675, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4745
f1 on test:    0.7474 (micro)
f1 on KB:      0.6367
integrated f1: 0.5717, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 8000, Total loss: 123599093760.0000, CE loss: 32.8356, RL loss: 1235990912.0000, Reward: -4717724.0469
    full cols: 609, non-full cols: 14
   r - labels: 320, labels - r: 362
    violated: 13918, weighted: 14964.0478515625, len: 0.0, nonzero: 0.12133460491895676
Epoch 8100, Total loss: 103250608128.0000, CE loss: 32.8380, RL loss: 1032506048.0000, Reward: -4714485.8730
    full cols: 609, non-full cols: 13
   r - labels: 318, labels - r: 361
    violated: 12683, weighted: 15103.6259765625, len: 0.0, nonzero: 0.12162178754806519
Epoch 8200, Total loss: 72043929600.0000, CE loss: 32.8354, RL loss: 720439296.0000, Reward: -4707310.1719
    full cols: 604, non-full cols: 15
   r - labels: 309, labels - r: 355
    violated: 13572, weighted: 14746.4921875, len: 0.0, nonzero: 0.1210319921374321
Epoch 8300, Total loss: 41220452352.0000, CE loss: 32.8369, RL loss: 412204512.0000, Reward: -4716335.4453
    full cols: 602, non-full cols: 19
   r - labels: 320, labels - r: 364
    violated: 14358, weighted: 15198.4443359375, len: 0.0, nonzero: 0.120723195374012
Epoch 8400, Total loss: -87408582656.0000, CE loss: 32.8350, RL loss: -874085824.0000, Reward: -4719275.4102
    full cols: 608, non-full cols: 10
   r - labels: 315, labels - r: 362
    violated: 13127, weighted: 15097.470703125, len: 0.0, nonzero: 0.1212049126625061
Epoch 8500, Total loss: 24338233344.0000, CE loss: 32.8359, RL loss: 243382336.0000, Reward: -4709873.1289
    full cols: 610, non-full cols: 21
   r - labels: 329, labels - r: 363
    violated: 13703, weighted: 15187.783203125, len: 0.0, nonzero: 0.1223134845495224
Epoch 8600, Total loss: 34244063232.0000, CE loss: 32.8357, RL loss: 342440640.0000, Reward: -4702704.6406
    full cols: 606, non-full cols: 23
   r - labels: 325, labels - r: 361
    violated: 13292, weighted: 15090.294921875, len: 0.0, nonzero: 0.12197689712047577
Epoch 8700, Total loss: 87138574336.0000, CE loss: 32.8349, RL loss: 871385728.0000, Reward: -4701415.8555
    full cols: 616, non-full cols: 14
   r - labels: 324, labels - r: 359
    violated: 14347, weighted: 15176.1474609375, len: 0.0, nonzero: 0.12315340340137482
Epoch 8800, Total loss: 14775377920.0000, CE loss: 32.8368, RL loss: 147753776.0000, Reward: -4701747.0156
    full cols: 601, non-full cols: 20
   r - labels: 318, labels - r: 362
    violated: 14468, weighted: 15188.1796875, len: 0.0, nonzero: 0.12072010338306427
Epoch 8900, Total loss: -193796374528.0000, CE loss: 32.8348, RL loss: -1937963776.0000, Reward: -4703675.4316
    full cols: 606, non-full cols: 17
   r - labels: 324, labels - r: 366
    violated: 13356, weighted: 15270.5751953125, len: 0.0, nonzero: 0.12173295021057129
Epoch 9000, Total loss: -102098214912.0000, CE loss: 32.8375, RL loss: -1020982144.0000, Reward: -4698669.5645
    full cols: 602, non-full cols: 17
   r - labels: 319, labels - r: 365
    violated: 12742, weighted: 15191.439453125, len: 0.0, nonzero: 0.12106595933437347
Epoch 9100, Total loss: 136896012288.0000, CE loss: 32.8346, RL loss: 1368960128.0000, Reward: -4681451.0352
    full cols: 601, non-full cols: 18
   r - labels: 322, labels - r: 368
    violated: 13805, weighted: 15232.03515625, len: 0.0, nonzero: 0.12093008309602737
Epoch 9200, Total loss: 87970693120.0000, CE loss: 32.8351, RL loss: 879706944.0000, Reward: -4677804.9609
    full cols: 604, non-full cols: 14
   r - labels: 322, labels - r: 369
    violated: 12637, weighted: 15281.0185546875, len: 0.0, nonzero: 0.12078803777694702
Epoch 9300, Total loss: -29121007616.0000, CE loss: 32.8356, RL loss: -291210080.0000, Reward: -4695230.8828
    full cols: 597, non-full cols: 19
   r - labels: 323, labels - r: 372
    violated: 14601, weighted: 15465.83984375, len: 0.0, nonzero: 0.12000679224729538
Epoch 9400, Total loss: -18010968064.0000, CE loss: 32.8353, RL loss: -180109680.0000, Reward: -4695791.9844
    full cols: 590, non-full cols: 20
   r - labels: 317, labels - r: 372
    violated: 12794, weighted: 15222.9921875, len: 0.0, nonzero: 0.11852458119392395
Epoch 9500, Total loss: -163521019904.0000, CE loss: 32.8353, RL loss: -1635210240.0000, Reward: -4698004.1797
    full cols: 591, non-full cols: 17
   r - labels: 315, labels - r: 372
    violated: 14959, weighted: 15216.0244140625, len: 0.0, nonzero: 0.11845355480909348
Epoch 9600, Total loss: -6999284736.0000, CE loss: 32.8344, RL loss: -69992848.0000, Reward: -4687563.5762
    full cols: 591, non-full cols: 18
   r - labels: 315, labels - r: 371
    violated: 13448, weighted: 15252.0908203125, len: 0.0, nonzero: 0.11922553926706314
Epoch 9700, Total loss: 242394464256.0000, CE loss: 32.8331, RL loss: 2423944704.0000, Reward: -4651370.7344
    full cols: 593, non-full cols: 12
   r - labels: 315, labels - r: 375
    violated: 12653, weighted: 15259.517578125, len: 0.0, nonzero: 0.11898159235715866
Epoch 9800, Total loss: 10417956864.0000, CE loss: 32.8350, RL loss: 104179568.0000, Reward: -4662614.7969
    full cols: 591, non-full cols: 11
   r - labels: 309, labels - r: 372
    violated: 12486, weighted: 15158.97265625, len: 0.0, nonzero: 0.11812623590230942
Epoch 9900, Total loss: 15456553984.0000, CE loss: 32.8343, RL loss: 154565536.0000, Reward: -4658424.4023
    full cols: 589, non-full cols: 15
   r - labels: 311, labels - r: 372
    violated: 14017, weighted: 15075.37890625, len: 0.0, nonzero: 0.11823122203350067
--- eval ---
prediction result:
f1 on test:    0.4846
f1 on test:    0.7497 (micro)
f1 on KB:      0.6188
integrated f1: 0.5675, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4759
f1 on test:    0.7478 (micro)
f1 on KB:      0.6359
integrated f1: 0.5720, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 10000, Total loss: 100197548032.0000, CE loss: 32.8348, RL loss: 1001975488.0000, Reward: -4650737.9062
    full cols: 586, non-full cols: 15
   r - labels: 310, labels - r: 374
    violated: 14264, weighted: 15190.5869140625, len: 0.0, nonzero: 0.11755496263504028
Epoch 10100, Total loss: 183000236032.0000, CE loss: 32.8355, RL loss: 1830002432.0000, Reward: -4644361.1230
    full cols: 591, non-full cols: 18
   r - labels: 320, labels - r: 376
    violated: 13255, weighted: 15181.97265625, len: 0.0, nonzero: 0.11841650307178497
Epoch 10200, Total loss: -17386979328.0000, CE loss: 32.8361, RL loss: -173869792.0000, Reward: -4690065.5312
    full cols: 589, non-full cols: 15
   r - labels: 314, labels - r: 375
    violated: 14936, weighted: 15069.017578125, len: 0.0, nonzero: 0.11798109859228134
Epoch 10300, Total loss: 84019650560.0000, CE loss: 32.8340, RL loss: 840196544.0000, Reward: -4669167.1875
    full cols: 587, non-full cols: 18
   r - labels: 321, labels - r: 381
    violated: 13509, weighted: 15460.8115234375, len: 0.0, nonzero: 0.11749011278152466
Epoch 10400, Total loss: -26429347840.0000, CE loss: 32.8344, RL loss: -264293472.0000, Reward: -4690206.7793
    full cols: 590, non-full cols: 16
   r - labels: 324, labels - r: 383
    violated: 14365, weighted: 15623.451171875, len: 0.0, nonzero: 0.11811696738004684
Epoch 10500, Total loss: -31781558272.0000, CE loss: 32.8363, RL loss: -317815584.0000, Reward: -4705882.0840
    full cols: 589, non-full cols: 18
   r - labels: 325, labels - r: 383
    violated: 13534, weighted: 15688.814453125, len: 0.0, nonzero: 0.1183701828122139
Epoch 10600, Total loss: 59908292608.0000, CE loss: 32.8341, RL loss: 599082944.0000, Reward: -4703205.1680
    full cols: 586, non-full cols: 20
   r - labels: 323, labels - r: 382
    violated: 13740, weighted: 15606.923828125, len: 0.0, nonzero: 0.11757040023803711
Epoch 10700, Total loss: 5139136512.0000, CE loss: 32.8357, RL loss: 51391364.0000, Reward: -4708499.4023
    full cols: 587, non-full cols: 17
   r - labels: 322, labels - r: 383
    violated: 13501, weighted: 15502.0048828125, len: 0.0, nonzero: 0.11704853922128677
Epoch 10800, Total loss: -80507166720.0000, CE loss: 32.8329, RL loss: -805071680.0000, Reward: -4725069.5176
    full cols: 595, non-full cols: 17
   r - labels: 328, labels - r: 381
    violated: 16219, weighted: 15826.2744140625, len: 0.0, nonzero: 0.11901247501373291
Epoch 10900, Total loss: -129470873600.0000, CE loss: 32.8352, RL loss: -1294708736.0000, Reward: -4745615.6250
    full cols: 595, non-full cols: 17
   r - labels: 330, labels - r: 383
    violated: 15062, weighted: 15821.25390625, len: 0.0, nonzero: 0.11944478750228882
Epoch 11000, Total loss: -221358899200.0000, CE loss: 32.8347, RL loss: -2213588992.0000, Reward: -4761419.2266
    full cols: 593, non-full cols: 15
   r - labels: 329, labels - r: 386
    violated: 11511, weighted: 15906.6640625, len: 0.0, nonzero: 0.11833621561527252
Epoch 11100, Total loss: -8705636352.0000, CE loss: 32.8327, RL loss: -87056360.0000, Reward: -4760767.4629
    full cols: 592, non-full cols: 16
   r - labels: 330, labels - r: 387
    violated: 14596, weighted: 15956.4765625, len: 0.0, nonzero: 0.11840415000915527
Epoch 11200, Total loss: -185100255232.0000, CE loss: 32.8338, RL loss: -1851002624.0000, Reward: -4752689.4883
    full cols: 598, non-full cols: 18
   r - labels: 330, labels - r: 379
    violated: 12572, weighted: 15793.21875, len: 0.0, nonzero: 0.11978137493133545
Epoch 11300, Total loss: -153756893184.0000, CE loss: 32.8320, RL loss: -1537568896.0000, Reward: -4721981.5898
    full cols: 591, non-full cols: 11
   r - labels: 318, labels - r: 381
    violated: 14281, weighted: 15658.70703125, len: 0.0, nonzero: 0.11758275330066681
Epoch 11400, Total loss: -157822648320.0000, CE loss: 32.8343, RL loss: -1578226560.0000, Reward: -4726643.4121
    full cols: 587, non-full cols: 17
   r - labels: 321, labels - r: 382
    violated: 15571, weighted: 15786.6259765625, len: 0.0, nonzero: 0.11807373911142349
Epoch 11500, Total loss: 128219095040.0000, CE loss: 32.8354, RL loss: 1282190976.0000, Reward: -4694012.4297
    full cols: 587, non-full cols: 25
   r - labels: 328, labels - r: 381
    violated: 14036, weighted: 15846.828125, len: 0.0, nonzero: 0.1186048611998558
Epoch 11600, Total loss: -48035491840.0000, CE loss: 32.8332, RL loss: -480354912.0000, Reward: -4722476.9316
    full cols: 595, non-full cols: 25
   r - labels: 335, labels - r: 380
    violated: 12900, weighted: 15888.6201171875, len: 0.0, nonzero: 0.11965785175561905
Epoch 11700, Total loss: 88000028672.0000, CE loss: 32.8375, RL loss: 880000320.0000, Reward: -4716632.8008
    full cols: 585, non-full cols: 19
   r - labels: 322, labels - r: 383
    violated: 13757, weighted: 15878.78125, len: 0.0, nonzero: 0.11770009994506836
Epoch 11800, Total loss: 113330266112.0000, CE loss: 32.8353, RL loss: 1133302656.0000, Reward: -4726125.1348
    full cols: 581, non-full cols: 15
   r - labels: 318, labels - r: 387
    violated: 13642, weighted: 15764.486328125, len: 0.0, nonzero: 0.11586277186870575
Epoch 11900, Total loss: 175474032640.0000, CE loss: 32.8345, RL loss: 1754740352.0000, Reward: -4753278.7031
    full cols: 579, non-full cols: 25
   r - labels: 322, labels - r: 383
    violated: 13877, weighted: 15780.009765625, len: 0.0, nonzero: 0.11659461259841919
--- eval ---
prediction result:
f1 on test:    0.4846
f1 on test:    0.7497 (micro)
f1 on KB:      0.6188
integrated f1: 0.5675, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4758
f1 on test:    0.7478 (micro)
f1 on KB:      0.6349
integrated f1: 0.5715, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 12000, Total loss: 125447856128.0000, CE loss: 32.8327, RL loss: 1254478592.0000, Reward: -4738619.1445
    full cols: 572, non-full cols: 39
   r - labels: 329, labels - r: 383
    violated: 12319, weighted: 15750.69140625, len: 0.0, nonzero: 0.11683547496795654
Epoch 12100, Total loss: 159563202560.0000, CE loss: 32.8328, RL loss: 1595632000.0000, Reward: -4723084.3984
    full cols: 579, non-full cols: 24
   r - labels: 318, labels - r: 380
    violated: 13411, weighted: 15828.583984375, len: 0.0, nonzero: 0.11697442829608917
Epoch 12200, Total loss: -28796995584.0000, CE loss: 32.8337, RL loss: -287969952.0000, Reward: -4764685.2441
    full cols: 577, non-full cols: 29
   r - labels: 324, labels - r: 383
    violated: 14443, weighted: 15933.578125, len: 0.0, nonzero: 0.11767230182886124
Epoch 12300, Total loss: -10071177216.0000, CE loss: 32.8331, RL loss: -100711768.0000, Reward: -4751851.3867
    full cols: 576, non-full cols: 28
   r - labels: 325, labels - r: 386
    violated: 14109, weighted: 15959.6279296875, len: 0.0, nonzero: 0.11720911413431168
Epoch 12400, Total loss: 48473362432.0000, CE loss: 32.8307, RL loss: 484733632.0000, Reward: -4738504.0273
    full cols: 580, non-full cols: 22
   r - labels: 325, labels - r: 388
    violated: 13089, weighted: 16042.1875, len: 0.0, nonzero: 0.11676444858312607
Epoch 12500, Total loss: -107938750464.0000, CE loss: 32.8332, RL loss: -1079387520.0000, Reward: -4742087.6816
    full cols: 582, non-full cols: 19
   r - labels: 321, labels - r: 385
    violated: 12588, weighted: 15973.44140625, len: 0.0, nonzero: 0.11693737655878067
Epoch 12600, Total loss: 130544975872.0000, CE loss: 32.8327, RL loss: 1305449728.0000, Reward: -4734200.8164
    full cols: 588, non-full cols: 17
   r - labels: 323, labels - r: 383
    violated: 14522, weighted: 16093.5703125, len: 0.0, nonzero: 0.11848443746566772
Epoch 12700, Total loss: -120817303552.0000, CE loss: 32.8348, RL loss: -1208173056.0000, Reward: -4756349.2441
    full cols: 588, non-full cols: 19
   r - labels: 326, labels - r: 384
    violated: 14303, weighted: 16147.166015625, len: 0.0, nonzero: 0.117558054625988
Epoch 12800, Total loss: -174660681728.0000, CE loss: 32.8317, RL loss: -1746606848.0000, Reward: -4769154.0273
    full cols: 582, non-full cols: 22
   r - labels: 320, labels - r: 381
    violated: 12848, weighted: 15879.888671875, len: 0.0, nonzero: 0.11684473603963852
Epoch 12900, Total loss: -52193374208.0000, CE loss: 32.8360, RL loss: -521933728.0000, Reward: -4749459.2656
    full cols: 584, non-full cols: 25
   r - labels: 325, labels - r: 381
    violated: 13769, weighted: 15940.2783203125, len: 0.0, nonzero: 0.11755187809467316
Epoch 13000, Total loss: -46010535936.0000, CE loss: 32.8333, RL loss: -460105344.0000, Reward: -4773106.1641
    full cols: 578, non-full cols: 32
   r - labels: 328, labels - r: 383
    violated: 13395, weighted: 15970.78125, len: 0.0, nonzero: 0.11816637963056564
Epoch 13100, Total loss: -261976522752.0000, CE loss: 32.8355, RL loss: -2619765248.0000, Reward: -4762826.4883
    full cols: 584, non-full cols: 26
   r - labels: 330, labels - r: 385
    violated: 16270, weighted: 16104.474609375, len: 0.0, nonzero: 0.11705471575260162
Epoch 13200, Total loss: -63172575232.0000, CE loss: 32.8340, RL loss: -631725760.0000, Reward: -4755042.8008
    full cols: 592, non-full cols: 24
   r - labels: 334, labels - r: 383
    violated: 12896, weighted: 16182.4580078125, len: 0.0, nonzero: 0.11905879527330399
Epoch 13300, Total loss: 163878060032.0000, CE loss: 32.8355, RL loss: 1638780672.0000, Reward: -4692078.5938
    full cols: 585, non-full cols: 17
   r - labels: 327, labels - r: 390
    violated: 14212, weighted: 16128.18359375, len: 0.0, nonzero: 0.1171875
Epoch 13400, Total loss: 97443037184.0000, CE loss: 32.8326, RL loss: 974430400.0000, Reward: -4689958.0156
    full cols: 583, non-full cols: 14
   r - labels: 328, labels - r: 396
    violated: 13212, weighted: 16363.55078125, len: 0.0, nonzero: 0.11656372994184494
Epoch 13500, Total loss: -29661843456.0000, CE loss: 32.8326, RL loss: -296618432.0000, Reward: -4698815.6797
    full cols: 586, non-full cols: 12
   r - labels: 332, labels - r: 399
    violated: 11440, weighted: 16512.41015625, len: 0.0, nonzero: 0.1169404610991478
Epoch 13600, Total loss: -28707135488.0000, CE loss: 32.8333, RL loss: -287071360.0000, Reward: -4673336.6797
    full cols: 575, non-full cols: 16
   r - labels: 325, labels - r: 399
    violated: 14188, weighted: 16394.173828125, len: 0.0, nonzero: 0.1148962453007698
Epoch 13700, Total loss: 54083448832.0000, CE loss: 32.8337, RL loss: 540834496.0000, Reward: -4647361.9199
    full cols: 573, non-full cols: 20
   r - labels: 323, labels - r: 395
    violated: 13264, weighted: 16156.3369140625, len: 0.0, nonzero: 0.11619318276643753
Epoch 13800, Total loss: -40900616192.0000, CE loss: 32.8340, RL loss: -409006144.0000, Reward: -4652964.7891
    full cols: 576, non-full cols: 14
   r - labels: 321, labels - r: 396
    violated: 12629, weighted: 16216.64453125, len: 0.0, nonzero: 0.11539031565189362
Epoch 13900, Total loss: -67646939136.0000, CE loss: 32.8319, RL loss: -676469376.0000, Reward: -4644944.0508
    full cols: 572, non-full cols: 15
   r - labels: 316, labels - r: 394
    violated: 13970, weighted: 16162.75390625, len: 0.0, nonzero: 0.11451951414346695
--- eval ---
prediction result:
f1 on test:    0.4846
f1 on test:    0.7497 (micro)
f1 on KB:      0.6188
integrated f1: 0.5675, w_data: 0.3000, w_klg: 0.7000

integrated result:
f1 on test:    0.4760
f1 on test:    0.7480 (micro)
f1 on KB:      0.6341
integrated f1: 0.5712, w_data: 0.3000, w_klg: 0.7000
------------
Epoch 14000, Total loss: -12762836992.0000, CE loss: 32.8330, RL loss: -127628368.0000, Reward: -4637708.8750
    full cols: 571, non-full cols: 14
   r - labels: 318, labels - r: 398
    violated: 14842, weighted: 16303.427734375, len: 0.0, nonzero: 0.11403162032365799
Epoch 14100, Total loss: 75110834176.0000, CE loss: 32.8345, RL loss: 751108352.0000, Reward: -4607186.5742
    full cols: 569, non-full cols: 16
   r - labels: 316, labels - r: 396
    violated: 14760, weighted: 16221.462890625, len: 0.0, nonzero: 0.11461523920297623
Epoch 14200, Total loss: -34490417152.0000, CE loss: 32.8349, RL loss: -344904192.0000, Reward: -4616431.8789
    full cols: 578, non-full cols: 14
   r - labels: 324, labels - r: 397
    violated: 13509, weighted: 16469.283203125, len: 0.0, nonzero: 0.11563117057085037
Epoch 14300, Total loss: 77643235328.0000, CE loss: 32.8330, RL loss: 776432320.0000, Reward: -4589376.8438
    full cols: 573, non-full cols: 13
   r - labels: 321, labels - r: 400
    violated: 14209, weighted: 16469.75, len: 0.0, nonzero: 0.11485300958156586
Epoch 14400, Total loss: -119277887488.0000, CE loss: 32.8330, RL loss: -1192778880.0000, Reward: -4613922.0352
    full cols: 570, non-full cols: 14
   r - labels: 321, labels - r: 402
    violated: 13359, weighted: 16506.91015625, len: 0.0, nonzero: 0.11444231867790222
Epoch 14500, Total loss: 129538048000.0000, CE loss: 32.8311, RL loss: 1295380480.0000, Reward: -4593319.6641
    full cols: 570, non-full cols: 17
   r - labels: 323, labels - r: 401
    violated: 15183, weighted: 16551.64453125, len: 0.0, nonzero: 0.11464302986860275
Epoch 14600, Total loss: -171537940480.0000, CE loss: 32.8311, RL loss: -1715379328.0000, Reward: -4607740.0352
    full cols: 572, non-full cols: 11
   r - labels: 320, labels - r: 402
    violated: 12188, weighted: 16403.5703125, len: 0.0, nonzero: 0.11402235180139542
Epoch 14700, Total loss: 89344942080.0000, CE loss: 32.8319, RL loss: 893449408.0000, Reward: -4577934.5293
    full cols: 569, non-full cols: 22
   r - labels: 327, labels - r: 401
    violated: 14472, weighted: 16372.18359375, len: 0.0, nonzero: 0.11460288614034653
Epoch 14800, Total loss: -54674661376.0000, CE loss: 32.8324, RL loss: -546746624.0000, Reward: -4575263.1191
    full cols: 564, non-full cols: 22
   r - labels: 329, labels - r: 408
    violated: 14616, weighted: 16649.078125, len: 0.0, nonzero: 0.11321331560611725
Epoch 14900, Total loss: 75847049216.0000, CE loss: 32.8325, RL loss: 758470464.0000, Reward: -4574559.4980
    full cols: 551, non-full cols: 22
   r - labels: 318, labels - r: 410
    violated: 12106, weighted: 16324.5087890625, len: 0.0, nonzero: 0.11066884547472
Epoch 15000, Total loss: -114957795328.0000, CE loss: 32.8340, RL loss: -1149577984.0000, Reward: -4597824.0000
    full cols: 558, non-full cols: 17
   r - labels: 321, labels - r: 411
    violated: 15027, weighted: 16440.537109375, len: 0.0, nonzero: 0.1121356189250946
------ ABL Loop 1 ------
--- eval ---
prediction result:
f1 on test:    0.4846
f1 on test:    0.7497 (micro)
f1 on KB:      0.6188
f1 on orig KB: 0.3200
integrated f1: 0.3494, w_data: 0.2862, w_klg: 0.7138

integrated result:
f1 on test:    0.4750
f1 on test:    0.7477 (micro)
f1 on KB:      0.6335
f1 on orig KB: 0.3204
integrated f1: 0.3488, w_data: 0.2862, w_klg: 0.7138
------------
integrated f1 0.3494

KB before refine:
num_nodes: 5060.0000
num_edges: 4317.0000
density: 0.0002
avg_degree: 0.8532
avg_clustering: 0.0260
degree_assortativity: -0.2108
modularity: 0.7770
avg_betweenness: 0.0000
avg_closeness: 0.0026
Iteration 0: Loss = 2877782.250000
|Xk-Y|_F:  2877782.250000, |X-X0|:  0.000000
rounded |X_k-Y|_0 = 2876134, f1 =  0.325523, approx slack: 2223609
rounded before pow |X_k-Y|_0 = 2876134, f1 =  0.325523

Iteration 20: Loss = 856068.375000
|Xk-Y|_F:  673299.250000, |X-X0|:  182769.093750
rounded |X_k-Y|_0 = 633562, f1 =  0.653614, approx slack: 248016
rounded before pow |X_k-Y|_0 = 862005, f1 =  0.636502

Iteration 40: Loss = 739550.750000
|Xk-Y|_F:  621915.125000, |X-X0|:  117635.656250
rounded |X_k-Y|_0 = 612014, f1 =  0.655283, approx slack: 279925
rounded before pow |X_k-Y|_0 = 860490, f1 =  0.636219

Iteration 60: Loss = 690055.875000
|Xk-Y|_F:  607657.375000, |X-X0|:  82398.500000
rounded |X_k-Y|_0 = 604910, f1 =  0.655838, approx slack: 317723
rounded before pow |X_k-Y|_0 = 895392, f1 =  0.633924

Iteration 80: Loss = 669297.312500
|Xk-Y|_F:  603039.375000, |X-X0|:  66257.921875
rounded |X_k-Y|_0 = 602550, f1 =  0.656022, approx slack: 317575
rounded before pow |X_k-Y|_0 = 892020, f1 =  0.634163

Iteration 100: Loss = 655809.062500
|Xk-Y|_F:  599671.875000, |X-X0|:  56137.183594
rounded |X_k-Y|_0 = 599952, f1 =  0.656226, approx slack: 319209
rounded before pow |X_k-Y|_0 = 891842, f1 =  0.634176

Iteration 120: Loss = 648495.312500
|Xk-Y|_F:  597210.875000, |X-X0|:  51284.414062
rounded |X_k-Y|_0 = 598497, f1 =  0.656340, approx slack: 323430
rounded before pow |X_k-Y|_0 = 891826, f1 =  0.634042

Iteration 140: Loss = 643217.687500
|Xk-Y|_F:  595496.250000, |X-X0|:  47721.429688
rounded |X_k-Y|_0 = 597010, f1 =  0.656457, approx slack: 321057
rounded before pow |X_k-Y|_0 = 888027, f1 =  0.634312

Iteration 160: Loss = 638866.625000
|Xk-Y|_F:  594057.187500, |X-X0|:  44809.406250
rounded |X_k-Y|_0 = 595860, f1 =  0.656547, approx slack: 297173
rounded before pow |X_k-Y|_0 = 863795, f1 =  0.636058

Iteration 180: Loss = 635251.750000
|Xk-Y|_F:  592712.375000, |X-X0|:  42539.347656
rounded |X_k-Y|_0 = 594792, f1 =  0.656631, approx slack: 297808
rounded before pow |X_k-Y|_0 = 863795, f1 =  0.636058

Iteration 200: Loss = 632205.750000
|Xk-Y|_F:  591400.625000, |X-X0|:  40805.148438
rounded |X_k-Y|_0 = 593004, f1 =  0.656772, approx slack: 298590
rounded before pow |X_k-Y|_0 = 863612, f1 =  0.636076

Iteration 220: Loss = 629303.937500
|Xk-Y|_F:  590085.937500, |X-X0|:  39218.007812
rounded |X_k-Y|_0 = 591374, f1 =  0.656900, approx slack: 299713
rounded before pow |X_k-Y|_0 = 863546, f1 =  0.636083

Iteration 240: Loss = 626553.937500
|Xk-Y|_F:  588775.125000, |X-X0|:  37778.820312
rounded |X_k-Y|_0 = 590043, f1 =  0.657006, approx slack: 300132
rounded before pow |X_k-Y|_0 = 863507, f1 =  0.636087

Iteration 260: Loss = 624289.937500
|Xk-Y|_F:  587486.312500, |X-X0|:  36803.640625
rounded |X_k-Y|_0 = 589230, f1 =  0.657070, approx slack: 296827
rounded before pow |X_k-Y|_0 = 859740, f1 =  0.636356

Iteration 280: Loss = 622070.625000
|Xk-Y|_F:  586227.875000, |X-X0|:  35842.742188
rounded |X_k-Y|_0 = 587050, f1 =  0.657241, approx slack: 295242
rounded before pow |X_k-Y|_0 = 856071, f1 =  0.636618

Iteration 300: Loss = 620143.375000
|Xk-Y|_F:  585038.437500, |X-X0|:  35104.921875
rounded |X_k-Y|_0 = 585931, f1 =  0.657330, approx slack: 295779
rounded before pow |X_k-Y|_0 = 855990, f1 =  0.636625

Iteration 320: Loss = 618294.812500
|Xk-Y|_F:  583951.875000, |X-X0|:  34342.929688
rounded |X_k-Y|_0 = 585028, f1 =  0.657401, approx slack: 296672
rounded before pow |X_k-Y|_0 = 856000, f1 =  0.636624

Iteration 340: Loss = 616613.500000
|Xk-Y|_F:  582971.562500, |X-X0|:  33641.953125
rounded |X_k-Y|_0 = 584326, f1 =  0.657456, approx slack: 297236
rounded before pow |X_k-Y|_0 = 855963, f1 =  0.636627

Iteration 360: Loss = 615094.750000
|Xk-Y|_F:  582081.937500, |X-X0|:  33012.808594
rounded |X_k-Y|_0 = 583425, f1 =  0.657528, approx slack: 301369
rounded before pow |X_k-Y|_0 = 859820, f1 =  0.636351

Iteration 380: Loss = 613623.750000
|Xk-Y|_F:  581288.312500, |X-X0|:  32335.464844
rounded |X_k-Y|_0 = 582960, f1 =  0.657564, approx slack: 293850
rounded before pow |X_k-Y|_0 = 852326, f1 =  0.636887

Iteration 400: Loss = 612469.187500
|Xk-Y|_F:  580663.375000, |X-X0|:  31805.841797
rounded |X_k-Y|_0 = 582674, f1 =  0.657587, approx slack: 293962
rounded before pow |X_k-Y|_0 = 852325, f1 =  0.636888

Iteration 420: Loss = 611466.562500
|Xk-Y|_F:  580149.625000, |X-X0|:  31316.925781
rounded |X_k-Y|_0 = 582358, f1 =  0.657612, approx slack: 292906
rounded before pow |X_k-Y|_0 = 852298, f1 =  0.636948

Iteration 440: Loss = 610609.937500
|Xk-Y|_F:  579734.812500, |X-X0|:  30875.138672
rounded |X_k-Y|_0 = 581880, f1 =  0.657651, approx slack: 291526
rounded before pow |X_k-Y|_0 = 851896, f1 =  0.637047

Iteration 460: Loss = 609861.750000
|Xk-Y|_F:  579363.000000, |X-X0|:  30498.742188
rounded |X_k-Y|_0 = 581629, f1 =  0.657672, approx slack: 290120
rounded before pow |X_k-Y|_0 = 850313, f1 =  0.637161

Iteration 480: Loss = 609112.937500
|Xk-Y|_F:  579042.812500, |X-X0|:  30070.111328
rounded |X_k-Y|_0 = 581373, f1 =  0.657706, approx slack: 290448
rounded before pow |X_k-Y|_0 = 850308, f1 =  0.637161

Iteration 500: Loss = 608452.687500
|Xk-Y|_F:  578771.187500, |X-X0|:  29681.472656
rounded |X_k-Y|_0 = 581173, f1 =  0.657723, approx slack: 290011
rounded before pow |X_k-Y|_0 = 850300, f1 =  0.637184

Iteration 520: Loss = 607883.562500
|Xk-Y|_F:  578545.000000, |X-X0|:  29338.564453
rounded |X_k-Y|_0 = 580943, f1 =  0.657742, approx slack: 290013
rounded before pow |X_k-Y|_0 = 850242, f1 =  0.637188

Iteration 540: Loss = 607286.000000
|Xk-Y|_F:  578303.062500, |X-X0|:  28982.910156
rounded |X_k-Y|_0 = 580758, f1 =  0.657757, approx slack: 290041
rounded before pow |X_k-Y|_0 = 850234, f1 =  0.637188

Iteration 560: Loss = 606633.187500
|Xk-Y|_F:  578080.375000, |X-X0|:  28552.791016
rounded |X_k-Y|_0 = 580605, f1 =  0.657769, approx slack: 290070
rounded before pow |X_k-Y|_0 = 850172, f1 =  0.637186

Iteration 580: Loss = 606094.250000
|Xk-Y|_F:  577859.312500, |X-X0|:  28234.937500
rounded |X_k-Y|_0 = 580290, f1 =  0.657794, approx slack: 290258
rounded before pow |X_k-Y|_0 = 850177, f1 =  0.637186

Iteration 600: Loss = 605598.125000
|Xk-Y|_F:  577655.375000, |X-X0|:  27942.753906
rounded |X_k-Y|_0 = 580126, f1 =  0.657808, approx slack: 290532
rounded before pow |X_k-Y|_0 = 850100, f1 =  0.637176

Converged at iteration 604

KB after refine:
num_nodes: 5060.0000
num_edges: 4313.0000
density: 0.0002
avg_degree: 0.8524
avg_clustering: 0.0260
degree_assortativity: -0.2108
modularity: 0.7851
avg_betweenness: 0.0000
avg_closeness: 0.0026
------ ABL 1 after refine ------
--- eval ---
prediction result:
f1 on test:    0.4846
f1 on test:    0.7497 (micro)
f1 on KB:      0.6374
f1 on orig KB: 0.3200
integrated f1: 0.3494, w_data: 0.2862, w_klg: 0.7138

integrated result:
f1 on test:    0.4756
f1 on test:    0.7477 (micro)
f1 on KB:      0.6504
f1 on orig KB: 0.3202
integrated f1: 0.3487, w_data: 0.2862, w_klg: 0.7138
------------
integrated f1 0.3494
