
=== Start adding workers ===
=> Add worker SGDMWorker(index=0, momentum=0.0)
=> Add worker SGDMWorker(index=1, momentum=0.0)
=> Add worker SGDMWorker(index=2, momentum=0.0)
=> Add worker SGDMWorker(index=3, momentum=0.0)
=> Add worker SGDMWorker(index=4, momentum=0.0)
=> Add worker SGDMWorker(index=5, momentum=0.0)
=> Add worker SGDMWorker(index=6, momentum=0.0)
=> Add worker SGDMWorker(index=7, momentum=0.0)
=> Add worker SGDMWorker(index=8, momentum=0.0)
=> Add worker SGDMWorker(index=9, momentum=0.0)
=> Add worker SGDMWorker(index=10, momentum=0.0)
=> Add worker ByzantineWorker(index=11)
=> Add worker ByzantineWorker(index=12)
=> Add worker ByzantineWorker(index=13)

=== Start adding graph ===
TwoCliquesWithByzantine(m=5,b=3)

Train epoch 1
[E 1B0  |    448/60000 (  1%) ] Loss: 2.3094 top1=  7.9545

=== Peeking data label distribution E1B0 ===
Worker 0 has targets: tensor([0, 0, 0, 0, 0], device='cuda:0')
Worker 1 has targets: tensor([1, 1, 0, 1, 1], device='cuda:0')
Worker 2 has targets: tensor([1, 1, 1, 1, 1], device='cuda:0')
Worker 3 has targets: tensor([2, 2, 2, 2, 2], device='cuda:0')
Worker 4 has targets: tensor([3, 3, 2, 3, 3], device='cuda:0')
Worker 5 has targets: tensor([3, 3, 3, 3, 3], device='cuda:0')
Worker 6 has targets: tensor([4, 4, 4, 4, 4], device='cuda:0')
Worker 7 has targets: tensor([5, 5, 5, 5, 5], device='cuda:0')
Worker 8 has targets: tensor([6, 6, 5, 6, 6], device='cuda:0')
Worker 9 has targets: tensor([6, 6, 6, 6, 6], device='cuda:0')
Worker 10 has targets: tensor([7, 7, 7, 7, 7], device='cuda:0')
Worker 11 has targets: tensor([8, 8, 8, 8, 8], device='cuda:0')
Worker 12 has targets: tensor([9, 9, 8, 9, 9], device='cuda:0')
Worker 13 has targets: tensor([9, 9, 9, 9, 9], device='cuda:0')



=== Log global consensus distance @ E1B0 ===
consensus_distance=0.000



=== Log clique consensus distance @ E1B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.000


[E 1B10 |   4928/60000 (  8%) ] Loss: 2.1818 top1= 26.4205

=== Log global consensus distance @ E1B10 ===
consensus_distance=0.002



=== Log clique consensus distance @ E1B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.002


[E 1B20 |   9408/60000 ( 16%) ] Loss: 2.0839 top1= 13.6364

=== Log global consensus distance @ E1B20 ===
consensus_distance=0.026



=== Log clique consensus distance @ E1B20 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=0.005



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.7987 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.7658 top1= 10.2865


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7829 top1= 10.2865

Train epoch 2
[E 2B0  |    448/60000 (  1%) ] Loss: 2.7627 top1= 10.5114

=== Log global consensus distance @ E2B0 ===
consensus_distance=0.229



=== Log clique consensus distance @ E2B0 ===
clique1_consensus_distance=0.009
clique2_consensus_distance=0.017


[E 2B10 |   4928/60000 (  8%) ] Loss: 9.6660 top1= 10.2273

=== Log global consensus distance @ E2B10 ===
consensus_distance=2.135



=== Log clique consensus distance @ E2B10 ===
clique1_consensus_distance=0.089
clique2_consensus_distance=0.109


[E 2B20 |   9408/60000 ( 16%) ] Loss: 58.1048 top1= 11.6477

=== Log global consensus distance @ E2B20 ===
consensus_distance=19.079



=== Log clique consensus distance @ E2B20 ===
clique1_consensus_distance=0.599
clique2_consensus_distance=0.751



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=13553.5108 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=11.3336 top1= 10.2865


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=20.0659 top1= 10.2865

Train epoch 3
[E 3B0  |    448/60000 (  1%) ] Loss: 66.1515 top1= 12.2159

=== Log global consensus distance @ E3B0 ===
consensus_distance=67.864



=== Log clique consensus distance @ E3B0 ===
clique1_consensus_distance=0.601
clique2_consensus_distance=1.199


[E 3B10 |   4928/60000 (  8%) ] Loss: 39.1424 top1= 26.4205

=== Log global consensus distance @ E3B10 ===
consensus_distance=147.357



=== Log clique consensus distance @ E3B10 ===
clique1_consensus_distance=0.597
clique2_consensus_distance=1.811


[E 3B20 |   9408/60000 ( 16%) ] Loss: 17.3005 top1= 36.0795

=== Log global consensus distance @ E3B20 ===
consensus_distance=255.098



=== Log clique consensus distance @ E3B20 ===
clique1_consensus_distance=0.598
clique2_consensus_distance=2.058



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=495316.5713 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=40.0424 top1= 10.5068


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=49.6998 top1=  9.5753

Train epoch 4
[E 4B0  |    448/60000 (  1%) ] Loss: 29.6515 top1= 36.3636

=== Log global consensus distance @ E4B0 ===
consensus_distance=391.923



=== Log clique consensus distance @ E4B0 ===
clique1_consensus_distance=0.595
clique2_consensus_distance=2.596


[E 4B10 |   4928/60000 (  8%) ] Loss: 66.4177 top1= 42.6136

=== Log global consensus distance @ E4B10 ===
consensus_distance=558.746



=== Log clique consensus distance @ E4B10 ===
clique1_consensus_distance=0.605
clique2_consensus_distance=3.801


[E 4B20 |   9408/60000 ( 16%) ] Loss: 84.5006 top1= 44.3182

=== Log global consensus distance @ E4B20 ===
consensus_distance=753.283



=== Log clique consensus distance @ E4B20 ===
clique1_consensus_distance=0.591
clique2_consensus_distance=4.831



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3473827.6058 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=713.2635 top1= 11.3482


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=328.4294 top1= 13.1310

Train epoch 5
[E 5B0  |    448/60000 (  1%) ] Loss: 317.5953 top1= 38.9205

=== Log global consensus distance @ E5B0 ===
consensus_distance=991.538



=== Log clique consensus distance @ E5B0 ===
clique1_consensus_distance=0.579
clique2_consensus_distance=17.254


[E 5B10 |   4928/60000 (  8%) ] Loss: 90.4698 top1= 46.3068

=== Log global consensus distance @ E5B10 ===
consensus_distance=1369.930



=== Log clique consensus distance @ E5B10 ===
clique1_consensus_distance=0.597
clique2_consensus_distance=255.044


[E 5B20 |   9408/60000 ( 16%) ] Loss: 6775.7001 top1= 40.0568

=== Log global consensus distance @ E5B20 ===
consensus_distance=1669.792



=== Log clique consensus distance @ E5B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=191.736



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=8877354.7949 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.1657 top1= 29.2668


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=5.2711 top1= 11.3782

Train epoch 6
[E 6B0  |    448/60000 (  1%) ] Loss: 4.1430 top1= 34.9432

=== Log global consensus distance @ E6B0 ===
consensus_distance=2065.848



=== Log clique consensus distance @ E6B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=204.914


[E 6B10 |   4928/60000 (  8%) ] Loss: 8.4828 top1= 50.5682

=== Log global consensus distance @ E6B10 ===
consensus_distance=2411.154



=== Log clique consensus distance @ E6B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=189.711


[E 6B20 |   9408/60000 ( 16%) ] Loss: 6.2522 top1= 55.1136

=== Log global consensus distance @ E6B20 ===
consensus_distance=2785.933



=== Log clique consensus distance @ E6B20 ===
clique1_consensus_distance=0.597
clique2_consensus_distance=177.795



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=33168432.1282 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=8.0036 top1= 28.5056


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.5424 top1= 35.2163

Train epoch 7
[E 7B0  |    448/60000 (  1%) ] Loss: 12.2143 top1= 58.5227

=== Log global consensus distance @ E7B0 ===
consensus_distance=3195.418



=== Log clique consensus distance @ E7B0 ===
clique1_consensus_distance=0.607
clique2_consensus_distance=170.134


[E 7B10 |   4928/60000 (  8%) ] Loss: 6.4881 top1= 57.1023

=== Log global consensus distance @ E7B10 ===
consensus_distance=3631.300



=== Log clique consensus distance @ E7B10 ===
clique1_consensus_distance=0.591
clique2_consensus_distance=164.127


[E 7B20 |   9408/60000 ( 16%) ] Loss: 2.0623 top1= 55.3977

=== Log global consensus distance @ E7B20 ===
consensus_distance=4097.326



=== Log clique consensus distance @ E7B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=161.188



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=83849506.4615 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=8.7032 top1= 26.2320


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=5.5438 top1= 36.6587

Train epoch 8
[E 8B0  |    448/60000 (  1%) ] Loss: 2.7196 top1= 53.6932

=== Log global consensus distance @ E8B0 ===
consensus_distance=4615.457



=== Log clique consensus distance @ E8B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=174.781


[E 8B10 |   4928/60000 (  8%) ] Loss: 6.9489 top1= 61.6477

=== Log global consensus distance @ E8B10 ===
consensus_distance=5148.035



=== Log clique consensus distance @ E8B10 ===
clique1_consensus_distance=0.591
clique2_consensus_distance=175.743


[E 8B20 |   9408/60000 ( 16%) ] Loss: 255.3554 top1= 49.1477

=== Log global consensus distance @ E8B20 ===
consensus_distance=5798.248



=== Log clique consensus distance @ E8B20 ===
clique1_consensus_distance=0.595
clique2_consensus_distance=285.750



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=172615466.8718 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=14.7486 top1= 26.4623


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.3143 top1= 23.5076

Train epoch 9
[E 9B0  |    448/60000 (  1%) ] Loss: 5.2784 top1= 46.0227

=== Log global consensus distance @ E9B0 ===
consensus_distance=6373.603



=== Log clique consensus distance @ E9B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=278.048


[E 9B10 |   4928/60000 (  8%) ] Loss: 98.7005 top1= 47.1591

=== Log global consensus distance @ E9B10 ===
consensus_distance=7013.812



=== Log clique consensus distance @ E9B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=269.422


[E 9B20 |   9408/60000 ( 16%) ] Loss: 513.9239 top1= 47.4432

=== Log global consensus distance @ E9B20 ===
consensus_distance=7767.387



=== Log clique consensus distance @ E9B20 ===
clique1_consensus_distance=0.783
clique2_consensus_distance=357.375



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=309472340.9231 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=9.2332 top1= 25.1803


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=5.3798 top1= 32.7324

Train epoch 10
[E10B0  |    448/60000 (  1%) ] Loss: 6.7846 top1= 39.7727

=== Log global consensus distance @ E10B0 ===
consensus_distance=8438.874



=== Log clique consensus distance @ E10B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=346.926


[E10B10 |   4928/60000 (  8%) ] Loss: 6.3827 top1= 40.6250

=== Log global consensus distance @ E10B10 ===
consensus_distance=9141.935



=== Log clique consensus distance @ E10B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=337.747


[E10B20 |   9408/60000 ( 16%) ] Loss: 7.0756 top1= 39.7727

=== Log global consensus distance @ E10B20 ===
consensus_distance=9891.057



=== Log clique consensus distance @ E10B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=333.806



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=545201902.7692 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=9.0492 top1= 27.2636


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.8199 top1= 29.1266

Train epoch 11
[E11B0  |    448/60000 (  1%) ] Loss: 7.2075 top1= 40.3409

=== Log global consensus distance @ E11B0 ===
consensus_distance=10639.960



=== Log clique consensus distance @ E11B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=327.211


[E11B10 |   4928/60000 (  8%) ] Loss: 24.9626 top1= 37.5000

=== Log global consensus distance @ E11B10 ===
consensus_distance=11448.861



=== Log clique consensus distance @ E11B10 ===
clique1_consensus_distance=0.591
clique2_consensus_distance=324.763


[E11B20 |   9408/60000 ( 16%) ] Loss: 5354.0344 top1= 32.3864

=== Log global consensus distance @ E11B20 ===
consensus_distance=12467.903



=== Log clique consensus distance @ E11B20 ===
clique1_consensus_distance=0.603
clique2_consensus_distance=579.646



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=869246851.2821 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=9.9391 top1= 27.7644


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=15.5589 top1= 19.6314

Train epoch 12
[E12B0  |    448/60000 (  1%) ] Loss: 9.2768 top1= 31.2500

=== Log global consensus distance @ E12B0 ===
consensus_distance=13309.390



=== Log clique consensus distance @ E12B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=549.565


[E12B10 |   4928/60000 (  8%) ] Loss: 34.3218 top1= 33.5227

=== Log global consensus distance @ E12B10 ===
consensus_distance=14229.183



=== Log clique consensus distance @ E12B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=537.463


[E12B20 |   9408/60000 ( 16%) ] Loss: 10.1861 top1= 28.6932

=== Log global consensus distance @ E12B20 ===
consensus_distance=15117.618



=== Log clique consensus distance @ E12B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=528.159



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1338547094.9744 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=13.0128 top1= 27.1534


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=11.0270 top1= 17.0272

Train epoch 13
[E13B0  |    448/60000 (  1%) ] Loss: 9.8374 top1= 32.3864

=== Log global consensus distance @ E13B0 ===
consensus_distance=16088.059



=== Log clique consensus distance @ E13B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=517.219


[E13B10 |   4928/60000 (  8%) ] Loss: 22391.9092 top1= 21.0227

=== Log global consensus distance @ E13B10 ===
consensus_distance=17000.879



=== Log clique consensus distance @ E13B10 ===
clique1_consensus_distance=6.133
clique2_consensus_distance=611.400


[E13B20 |   9408/60000 ( 16%) ] Loss: 13.5105 top1= 13.6364

=== Log global consensus distance @ E13B20 ===
consensus_distance=18019.330



=== Log clique consensus distance @ E13B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=706.858



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1972487694.7692 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=13.6938 top1= 13.7119


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=17.5168 top1= 14.2728

Train epoch 14
[E14B0  |    448/60000 (  1%) ] Loss: 255.5381 top1= 13.3523

=== Log global consensus distance @ E14B0 ===
consensus_distance=19055.799



=== Log clique consensus distance @ E14B0 ===
clique1_consensus_distance=0.906
clique2_consensus_distance=690.010


[E14B10 |   4928/60000 (  8%) ] Loss: 21.7546 top1= 18.1818

=== Log global consensus distance @ E14B10 ===
consensus_distance=20103.447



=== Log clique consensus distance @ E14B10 ===
clique1_consensus_distance=0.595
clique2_consensus_distance=691.050


[E14B20 |   9408/60000 ( 16%) ] Loss: 13.8835 top1= 17.8977

=== Log global consensus distance @ E14B20 ===
consensus_distance=21219.160



=== Log clique consensus distance @ E14B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=680.760



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2842371987.6923 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=15.1976 top1= 15.7652


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=60.8863 top1= 19.0304

Train epoch 15
[E15B0  |    448/60000 (  1%) ] Loss: 461.7063 top1= 17.3295

=== Log global consensus distance @ E15B0 ===
consensus_distance=22378.838



=== Log clique consensus distance @ E15B0 ===
clique1_consensus_distance=0.921
clique2_consensus_distance=686.638


[E15B10 |   4928/60000 (  8%) ] Loss: 36.8447 top1= 23.5795

=== Log global consensus distance @ E15B10 ===
consensus_distance=23575.500



=== Log clique consensus distance @ E15B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=702.491


[E15B20 |   9408/60000 ( 16%) ] Loss: 4388.3168 top1= 24.4318

=== Log global consensus distance @ E15B20 ===
consensus_distance=24818.730



=== Log clique consensus distance @ E15B20 ===
clique1_consensus_distance=1.962
clique2_consensus_distance=766.645



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3902958060.3077 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=19.5565 top1= 15.2644


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=41.8684 top1= 18.9904

Train epoch 16
[E16B0  |    448/60000 (  1%) ] Loss: 19.0150 top1= 21.3068

=== Log global consensus distance @ E16B0 ===
consensus_distance=25963.646



=== Log clique consensus distance @ E16B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=853.911


[E16B10 |   4928/60000 (  8%) ] Loss: 502.5266 top1= 11.9318

=== Log global consensus distance @ E16B10 ===
consensus_distance=27228.375



=== Log clique consensus distance @ E16B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=853.470


[E16B20 |   9408/60000 ( 16%) ] Loss: 15.2526 top1= 20.7386

=== Log global consensus distance @ E16B20 ===
consensus_distance=28382.725



=== Log clique consensus distance @ E16B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=840.824



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5401746123.4872 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=46.7709 top1= 12.0192


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=21.0555 top1= 26.9030

Train epoch 17
[E17B0  |    448/60000 (  1%) ] Loss: 65.3154 top1= 22.4432

=== Log global consensus distance @ E17B0 ===
consensus_distance=29740.393



=== Log clique consensus distance @ E17B0 ===
clique1_consensus_distance=0.896
clique2_consensus_distance=841.137


[E17B10 |   4928/60000 (  8%) ] Loss: 45.1043 top1= 25.0000

=== Log global consensus distance @ E17B10 ===
consensus_distance=31092.979



=== Log clique consensus distance @ E17B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=842.292


[E17B20 |   9408/60000 ( 16%) ] Loss: 9305.2899 top1= 40.0568

=== Log global consensus distance @ E17B20 ===
consensus_distance=32389.037



=== Log clique consensus distance @ E17B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=881.145



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6698626251.4872 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=19.0891 top1= 20.8033


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=5778.7519 top1= 10.2965

Train epoch 18
[E18B0  |    448/60000 (  1%) ] Loss: 22.5467 top1= 20.4545

=== Log global consensus distance @ E18B0 ===
consensus_distance=33306.523



=== Log clique consensus distance @ E18B0 ===
clique1_consensus_distance=0.593
clique2_consensus_distance=1154.971


[E18B10 |   4928/60000 (  8%) ] Loss: 26.5508 top1= 23.2955

=== Log global consensus distance @ E18B10 ===
consensus_distance=34629.574



=== Log clique consensus distance @ E18B10 ===
clique1_consensus_distance=0.625
clique2_consensus_distance=1119.301


[E18B20 |   9408/60000 ( 16%) ] Loss: 17.6830 top1= 26.1364

=== Log global consensus distance @ E18B20 ===
consensus_distance=36043.773



=== Log clique consensus distance @ E18B20 ===
clique1_consensus_distance=0.599
clique2_consensus_distance=1102.954



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=9032585353.8462 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=42.6350 top1= 25.1102


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=19.3268 top1= 10.2865

Train epoch 19
[E19B0  |    448/60000 (  1%) ] Loss: 31.5965 top1= 24.1477

=== Log global consensus distance @ E19B0 ===
consensus_distance=37548.812



=== Log clique consensus distance @ E19B0 ===
clique1_consensus_distance=0.630
clique2_consensus_distance=1090.406


[E19B10 |   4928/60000 (  8%) ] Loss: 27.4723 top1= 22.7273

=== Log global consensus distance @ E19B10 ===
consensus_distance=39026.113



=== Log clique consensus distance @ E19B10 ===
clique1_consensus_distance=0.601
clique2_consensus_distance=1080.016


[E19B20 |   9408/60000 ( 16%) ] Loss: 1534.9166 top1= 21.8750

=== Log global consensus distance @ E19B20 ===
consensus_distance=40531.789



=== Log clique consensus distance @ E19B20 ===
clique1_consensus_distance=1.071
clique2_consensus_distance=1076.958



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=11851487258.2564 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=19.4575 top1= 22.8365


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=20.3845 top1= 10.2865

Train epoch 20
[E20B0  |    448/60000 (  1%) ] Loss: 2057.1754 top1= 19.6023

=== Log global consensus distance @ E20B0 ===
consensus_distance=42168.387



=== Log clique consensus distance @ E20B0 ===
clique1_consensus_distance=0.920
clique2_consensus_distance=1060.060


[E20B10 |   4928/60000 (  8%) ] Loss: 197.7370 top1= 10.5114

=== Log global consensus distance @ E20B10 ===
consensus_distance=43305.102



=== Log clique consensus distance @ E20B10 ===
clique1_consensus_distance=0.960
clique2_consensus_distance=1229.044


[E20B20 |   9408/60000 ( 16%) ] Loss: 21.2816 top1= 11.9318

=== Log global consensus distance @ E20B20 ===
consensus_distance=44891.945



=== Log clique consensus distance @ E20B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=1225.798



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=14664099117.9487 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=21.5099 top1= 10.5669


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=539.4417 top1= 10.2865

Train epoch 21
[E21B0  |    448/60000 (  1%) ] Loss: 21.8407 top1= 11.0795

=== Log global consensus distance @ E21B0 ===
consensus_distance=46492.430



=== Log clique consensus distance @ E21B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=1208.937


[E21B10 |   4928/60000 (  8%) ] Loss: 21.4364 top1= 13.9205

=== Log global consensus distance @ E21B10 ===
consensus_distance=48155.570



=== Log clique consensus distance @ E21B10 ===
clique1_consensus_distance=0.595
clique2_consensus_distance=1197.094


[E21B20 |   9408/60000 ( 16%) ] Loss: 885.1602 top1= 13.3523

=== Log global consensus distance @ E21B20 ===
consensus_distance=49764.512



=== Log clique consensus distance @ E21B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=1182.633



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=18562674018.4615 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=25.8443 top1= 14.0224


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=23.6334 top1= 10.2865

Train epoch 22
[E22B0  |    448/60000 (  1%) ] Loss: 44.8915 top1= 14.7727

=== Log global consensus distance @ E22B0 ===
consensus_distance=51543.156



=== Log clique consensus distance @ E22B0 ===
clique1_consensus_distance=0.587
clique2_consensus_distance=1175.206


[E22B10 |   4928/60000 (  8%) ] Loss: 117280.2208 top1= 20.1705

=== Log global consensus distance @ E22B10 ===
consensus_distance=53208.762



=== Log clique consensus distance @ E22B10 ===
clique1_consensus_distance=0.628
clique2_consensus_distance=1376.664


[E22B20 |   9408/60000 ( 16%) ] Loss: 49.4928 top1= 12.7841

=== Log global consensus distance @ E22B20 ===
consensus_distance=54835.406



=== Log clique consensus distance @ E22B20 ===
clique1_consensus_distance=0.638
clique2_consensus_distance=1379.150



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=22492730000.4103 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=130543.2973 top1= 14.7636


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=120.1860 top1= 10.2865

Train epoch 23
[E23B0  |    448/60000 (  1%) ] Loss: 23932.3569 top1= 32.1023

=== Log global consensus distance @ E23B0 ===
consensus_distance=56508.082



=== Log clique consensus distance @ E23B0 ===
clique1_consensus_distance=6.132
clique2_consensus_distance=1482.404


[E23B10 |   4928/60000 (  8%) ] Loss: 40.2122 top1= 13.3523

=== Log global consensus distance @ E23B10 ===
consensus_distance=57938.430



=== Log clique consensus distance @ E23B10 ===
clique1_consensus_distance=0.596
clique2_consensus_distance=1459.741


[E23B20 |   9408/60000 ( 16%) ] Loss: 1751.6271 top1= 16.7614

=== Log global consensus distance @ E23B20 ===
consensus_distance=59791.160



=== Log clique consensus distance @ E23B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=1447.698



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=27724634768.4103 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=24.6482 top1= 10.3666


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=82.2373 top1= 10.2865

Train epoch 24
[E24B0  |    448/60000 (  1%) ] Loss: 166.2200 top1= 12.5000

=== Log global consensus distance @ E24B0 ===
consensus_distance=61751.660



=== Log clique consensus distance @ E24B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=1439.724


[E24B10 |   4928/60000 (  8%) ] Loss: 244.2029 top1= 13.3523

=== Log global consensus distance @ E24B10 ===
consensus_distance=63647.293



=== Log clique consensus distance @ E24B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=1425.916


[E24B20 |   9408/60000 ( 16%) ] Loss: 38.9184 top1= 25.2841

=== Log global consensus distance @ E24B20 ===
consensus_distance=65641.250



=== Log clique consensus distance @ E24B20 ===
clique1_consensus_distance=0.627
clique2_consensus_distance=1418.074



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=33824207530.6667 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=40.9639 top1= 28.8962


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=218.0206 top1= 10.2865

Train epoch 25
[E25B0  |    448/60000 (  1%) ] Loss: 21.8921 top1= 25.2841

=== Log global consensus distance @ E25B0 ===
consensus_distance=67636.594



=== Log clique consensus distance @ E25B0 ===
clique1_consensus_distance=0.606
clique2_consensus_distance=1411.193


[E25B10 |   4928/60000 (  8%) ] Loss: 1844986.3663 top1= 11.0795

=== Log global consensus distance @ E25B10 ===
consensus_distance=69525.164



=== Log clique consensus distance @ E25B10 ===
clique1_consensus_distance=4.081
clique2_consensus_distance=1511.622


[E25B20 |   9408/60000 ( 16%) ] Loss: 24.9772 top1= 21.5909

=== Log global consensus distance @ E25B20 ===
consensus_distance=71373.656



=== Log clique consensus distance @ E25B20 ===
clique1_consensus_distance=0.591
clique2_consensus_distance=1570.113



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=39588373425.2308 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3881.0236 top1= 17.4880


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=41.0391 top1= 10.2865

Train epoch 26
[E26B0  |    448/60000 (  1%) ] Loss: 966.9497 top1= 30.3977

=== Log global consensus distance @ E26B0 ===
consensus_distance=72914.133



=== Log clique consensus distance @ E26B0 ===
clique1_consensus_distance=1.628
clique2_consensus_distance=1886.656


[E26B10 |   4928/60000 (  8%) ] Loss: 4873.4500 top1= 14.7727

=== Log global consensus distance @ E26B10 ===
consensus_distance=74743.883



=== Log clique consensus distance @ E26B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=1870.787


[E26B20 |   9408/60000 ( 16%) ] Loss: 60.2682 top1= 16.1932

=== Log global consensus distance @ E26B20 ===
consensus_distance=76853.133



=== Log clique consensus distance @ E26B20 ===
clique1_consensus_distance=0.757
clique2_consensus_distance=1854.760



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=47830573318.5641 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=52.6218 top1= 15.9054


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=51448.5137 top1= 10.2865

Train epoch 27
[E27B0  |    448/60000 (  1%) ] Loss: 56093.4744 top1= 15.9091

=== Log global consensus distance @ E27B0 ===
consensus_distance=79149.367



=== Log clique consensus distance @ E27B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=1886.671


[E27B10 |   4928/60000 (  8%) ] Loss: 20669.4475 top1= 32.3864

=== Log global consensus distance @ E27B10 ===
consensus_distance=79843.188



=== Log clique consensus distance @ E27B10 ===
clique1_consensus_distance=0.597
clique2_consensus_distance=2231.829


[E27B20 |   9408/60000 ( 16%) ] Loss: 27.1042 top1= 15.0568

=== Log global consensus distance @ E27B20 ===
consensus_distance=81923.227



=== Log clique consensus distance @ E27B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=2218.736



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=54672071863.7949 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=37.1442 top1= 14.4832


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=127.5723 top1= 10.1362

Train epoch 28
[E28B0  |    448/60000 (  1%) ] Loss: 63.3489 top1= 14.7727

=== Log global consensus distance @ E28B0 ===
consensus_distance=84054.875



=== Log clique consensus distance @ E28B0 ===
clique1_consensus_distance=0.593
clique2_consensus_distance=2200.663


[E28B10 |   4928/60000 (  8%) ] Loss: 28.1428 top1= 20.1705

=== Log global consensus distance @ E28B10 ===
consensus_distance=86341.375



=== Log clique consensus distance @ E28B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=2183.962


[E28B20 |   9408/60000 ( 16%) ] Loss: 72.4975 top1= 21.5909

=== Log global consensus distance @ E28B20 ===
consensus_distance=88733.547



=== Log clique consensus distance @ E28B20 ===
clique1_consensus_distance=0.634
clique2_consensus_distance=2166.982



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=65119700361.8462 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=61.0030 top1= 17.1575


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=271.7085 top1= 10.2865

Train epoch 29
[E29B0  |    448/60000 (  1%) ] Loss: 356.6845 top1= 17.0455

=== Log global consensus distance @ E29B0 ===
consensus_distance=91072.945



=== Log clique consensus distance @ E29B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=2152.448


[E29B10 |   4928/60000 (  8%) ] Loss: 6085.0963 top1= 17.0455

=== Log global consensus distance @ E29B10 ===
consensus_distance=93251.297



=== Log clique consensus distance @ E29B10 ===
clique1_consensus_distance=0.597
clique2_consensus_distance=2140.569


[E29B20 |   9408/60000 ( 16%) ] Loss: 28.5575 top1= 16.1932

=== Log global consensus distance @ E29B20 ===
consensus_distance=95609.742



=== Log clique consensus distance @ E29B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=2127.480



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=76703601637.7436 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=64.2471 top1= 17.4980


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=55.0532 top1= 10.2865

Train epoch 30
[E30B0  |    448/60000 (  1%) ] Loss: 28.2536 top1= 17.8977

=== Log global consensus distance @ E30B0 ===
consensus_distance=98092.977



=== Log clique consensus distance @ E30B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=2127.449


[E30B10 |   4928/60000 (  8%) ] Loss: 64.7107 top1= 20.7386

=== Log global consensus distance @ E30B10 ===
consensus_distance=100511.648



=== Log clique consensus distance @ E30B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=2118.331


[E30B20 |   9408/60000 ( 16%) ] Loss: 10382.9726 top1= 16.1932

=== Log global consensus distance @ E30B20 ===
consensus_distance=103086.047



=== Log clique consensus distance @ E30B20 ===
clique1_consensus_distance=1.843
clique2_consensus_distance=2174.414



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=89809381008.4103 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=82.2473 top1= 16.3962


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=140.3310 top1= 10.2865

Train epoch 31
[E31B0  |    448/60000 (  1%) ] Loss: 29.2657 top1= 17.6136

=== Log global consensus distance @ E31B0 ===
consensus_distance=105509.586



=== Log clique consensus distance @ E31B0 ===
clique1_consensus_distance=0.595
clique2_consensus_distance=2177.591


[E31B10 |   4928/60000 (  8%) ] Loss: 45763727.7699 top1= 10.2273

=== Log global consensus distance @ E31B10 ===
consensus_distance=107402.734



=== Log clique consensus distance @ E31B10 ===
clique1_consensus_distance=9.979
clique2_consensus_distance=2388.014


[E31B20 |   9408/60000 ( 16%) ] Loss: 64.4239 top1= 14.2045

=== Log global consensus distance @ E31B20 ===
consensus_distance=108472.859



=== Log clique consensus distance @ E31B20 ===
clique1_consensus_distance=0.596
clique2_consensus_distance=3012.334



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=99552410177.6410 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=32.2955 top1= 10.8474


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=40.1059 top1= 10.2865

Train epoch 32
[E32B0  |    448/60000 (  1%) ] Loss: 32.5678 top1= 11.3636

=== Log global consensus distance @ E32B0 ===
consensus_distance=110752.773



=== Log clique consensus distance @ E32B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=3028.804


[E32B10 |   4928/60000 (  8%) ] Loss: 31.4223 top1= 15.0568

=== Log global consensus distance @ E32B10 ===
consensus_distance=113164.797



=== Log clique consensus distance @ E32B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=3005.368


[E32B20 |   9408/60000 ( 16%) ] Loss: 32.5365 top1= 13.0682

=== Log global consensus distance @ E32B20 ===
consensus_distance=115847.586



=== Log clique consensus distance @ E32B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=2995.484



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=116295174616.6154 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=33.0411 top1= 10.7472


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=38.2985 top1= 10.2865

Train epoch 33
[E33B0  |    448/60000 (  1%) ] Loss: 50.6897 top1= 11.0795

=== Log global consensus distance @ E33B0 ===
consensus_distance=118560.914



=== Log clique consensus distance @ E33B0 ===
clique1_consensus_distance=0.593
clique2_consensus_distance=2996.824


[E33B10 |   4928/60000 (  8%) ] Loss: 33.6093 top1= 11.9318

=== Log global consensus distance @ E33B10 ===
consensus_distance=120851.148



=== Log clique consensus distance @ E33B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=2981.770


[E33B20 |   9408/60000 ( 16%) ] Loss: 16636.9777 top1= 13.6364

=== Log global consensus distance @ E33B20 ===
consensus_distance=123412.266



=== Log clique consensus distance @ E33B20 ===
clique1_consensus_distance=0.912
clique2_consensus_distance=3027.695



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=131543594640.4103 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=34.0766 top1= 10.2865


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=36.3246 top1= 10.2865

Train epoch 34
[E34B0  |    448/60000 (  1%) ] Loss: 34.3252 top1= 11.6477

=== Log global consensus distance @ E34B0 ===
consensus_distance=125333.844



=== Log clique consensus distance @ E34B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=3168.621


[E34B10 |   4928/60000 (  8%) ] Loss: 1033.4564 top1= 11.6477

=== Log global consensus distance @ E34B10 ===
consensus_distance=128225.250



=== Log clique consensus distance @ E34B10 ===
clique1_consensus_distance=0.968
clique2_consensus_distance=3146.761


[E34B20 |   9408/60000 ( 16%) ] Loss: 69.7405 top1= 11.9318

=== Log global consensus distance @ E34B20 ===
consensus_distance=131028.891



=== Log clique consensus distance @ E34B20 ===
clique1_consensus_distance=0.748
clique2_consensus_distance=3138.387



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=151045511010.4615 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=34.9746 top1= 10.2865


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2084.7854 top1= 10.2865

Train epoch 35
[E35B0  |    448/60000 (  1%) ] Loss: 35.5772 top1= 10.7955

=== Log global consensus distance @ E35B0 ===
consensus_distance=133649.953



=== Log clique consensus distance @ E35B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=3126.726


[E35B10 |   4928/60000 (  8%) ] Loss: 965.5347 top1= 11.0795

=== Log global consensus distance @ E35B10 ===
consensus_distance=136362.719



=== Log clique consensus distance @ E35B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=3138.564


[E35B20 |   9408/60000 ( 16%) ] Loss: 1530.8299 top1= 11.9318

=== Log global consensus distance @ E35B20 ===
consensus_distance=139283.578



=== Log clique consensus distance @ E35B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=3124.071



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=171907459544.6154 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=35.8603 top1= 10.2865


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=159.2022 top1= 10.2865

Train epoch 36
[E36B0  |    448/60000 (  1%) ] Loss: 36.6202 top1= 11.0795

=== Log global consensus distance @ E36B0 ===
consensus_distance=142321.469



=== Log clique consensus distance @ E36B0 ===
clique1_consensus_distance=0.781
clique2_consensus_distance=3123.049


[E36B10 |   4928/60000 (  8%) ] Loss: 729.0424 top1= 12.7841

=== Log global consensus distance @ E36B10 ===
consensus_distance=145335.047



=== Log clique consensus distance @ E36B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=3121.845


[E36B20 |   9408/60000 ( 16%) ] Loss: 41.7658 top1= 15.3409

=== Log global consensus distance @ E36B20 ===
consensus_distance=147875.625



=== Log clique consensus distance @ E36B20 ===
clique1_consensus_distance=0.608
clique2_consensus_distance=3114.175



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=192416843198.3590 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=37.2693 top1= 17.3778


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=19481.5110 top1= 19.8017

Train epoch 37
[E37B0  |    448/60000 (  1%) ] Loss: 32039.6678 top1= 20.4545

=== Log global consensus distance @ E37B0 ===
consensus_distance=150572.984



=== Log clique consensus distance @ E37B0 ===
clique1_consensus_distance=0.594
clique2_consensus_distance=3364.684


[E37B10 |   4928/60000 (  8%) ] Loss: 37.4260 top1= 11.3636

=== Log global consensus distance @ E37B10 ===
consensus_distance=151735.750



=== Log clique consensus distance @ E37B10 ===
clique1_consensus_distance=0.791
clique2_consensus_distance=3772.496


[E37B20 |   9408/60000 ( 16%) ] Loss: 37.1266 top1= 12.7841

=== Log global consensus distance @ E37B20 ===
consensus_distance=154656.219



=== Log clique consensus distance @ E37B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=3759.210



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=214463229426.8718 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=42.6008 top1= 10.2865


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=95.1636 top1= 10.2865

Train epoch 38
[E38B0  |    448/60000 (  1%) ] Loss: 3585.6326 top1= 11.3636

=== Log global consensus distance @ E38B0 ===
consensus_distance=157653.031



=== Log clique consensus distance @ E38B0 ===
clique1_consensus_distance=1.260
clique2_consensus_distance=3749.165


[E38B10 |   4928/60000 (  8%) ] Loss: 38.3539 top1= 11.3636

=== Log global consensus distance @ E38B10 ===
consensus_distance=160539.125



=== Log clique consensus distance @ E38B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=3728.824


[E38B20 |   9408/60000 ( 16%) ] Loss: 38.3708 top1= 11.9318

=== Log global consensus distance @ E38B20 ===
consensus_distance=163681.578



=== Log clique consensus distance @ E38B20 ===
clique1_consensus_distance=0.635
clique2_consensus_distance=3721.984



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=242164164870.5641 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=64.2096 top1= 10.2865


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=56.4311 top1= 10.2865

Train epoch 39
[E39B0  |    448/60000 (  1%) ] Loss: 4666.3196 top1= 11.3636

=== Log global consensus distance @ E39B0 ===
consensus_distance=166905.375



=== Log clique consensus distance @ E39B0 ===
clique1_consensus_distance=1.051
clique2_consensus_distance=3734.495


[E39B10 |   4928/60000 (  8%) ] Loss: 94.0903 top1= 10.7955

=== Log global consensus distance @ E39B10 ===
consensus_distance=169816.625



=== Log clique consensus distance @ E39B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=3733.467


[E39B20 |   9408/60000 ( 16%) ] Loss: 4349.0704 top1= 11.6477

=== Log global consensus distance @ E39B20 ===
consensus_distance=172979.203



=== Log clique consensus distance @ E39B20 ===
clique1_consensus_distance=0.957
clique2_consensus_distance=3735.028



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=269221713867.4872 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=53.9747 top1= 13.0409


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=232.3780 top1= 10.2865

Train epoch 40
[E40B0  |    448/60000 (  1%) ] Loss: 1857.3453 top1= 13.3523

=== Log global consensus distance @ E40B0 ===
consensus_distance=175906.812



=== Log clique consensus distance @ E40B0 ===
clique1_consensus_distance=1.110
clique2_consensus_distance=3831.722


[E40B10 |   4928/60000 (  8%) ] Loss: 10832.2039 top1= 27.8409

=== Log global consensus distance @ E40B10 ===
consensus_distance=177551.719



=== Log clique consensus distance @ E40B10 ===
clique1_consensus_distance=4.521
clique2_consensus_distance=4434.837


[E40B20 |   9408/60000 ( 16%) ] Loss: 101.6442 top1= 16.1932

=== Log global consensus distance @ E40B20 ===
consensus_distance=180397.922



=== Log clique consensus distance @ E40B20 ===
clique1_consensus_distance=0.591
clique2_consensus_distance=4534.387



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=294648826958.7692 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=40.3411 top1= 10.6070


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=465.3734 top1= 10.2965

