
=== Start adding workers ===
=> Add worker SGDMWorker(index=0, momentum=0.9)
=> Add worker SGDMWorker(index=1, momentum=0.9)
=> Add worker SGDMWorker(index=2, momentum=0.9)
=> Add worker SGDMWorker(index=3, momentum=0.9)
=> Add worker SGDMWorker(index=4, momentum=0.9)
=> Add worker SGDMWorker(index=5, momentum=0.9)
=> Add worker SGDMWorker(index=6, momentum=0.9)
=> Add worker SGDMWorker(index=7, momentum=0.9)
=> Add worker SGDMWorker(index=8, momentum=0.9)
=> Add worker SGDMWorker(index=9, momentum=0.9)
=> Add worker SGDMWorker(index=10, momentum=0.9)
=> Add worker ByzantineWorker(index=11)
=> Add worker ByzantineWorker(index=12)
=> Add worker ByzantineWorker(index=13)

=== Start adding graph ===
TwoCliquesWithByzantine(m=5,b=3)

Train epoch 1
[E 1B0  |    448/60000 (  1%) ] Loss: 2.3094 top1=  7.9545

=== Peeking data label distribution E1B0 ===
Worker 0 has targets: tensor([0, 0, 0, 0, 0], device='cuda:0')
Worker 1 has targets: tensor([1, 1, 0, 1, 1], device='cuda:0')
Worker 2 has targets: tensor([1, 1, 1, 1, 1], device='cuda:0')
Worker 3 has targets: tensor([2, 2, 2, 2, 2], device='cuda:0')
Worker 4 has targets: tensor([3, 3, 2, 3, 3], device='cuda:0')
Worker 5 has targets: tensor([3, 3, 3, 3, 3], device='cuda:0')
Worker 6 has targets: tensor([4, 4, 4, 4, 4], device='cuda:0')
Worker 7 has targets: tensor([5, 5, 5, 5, 5], device='cuda:0')
Worker 8 has targets: tensor([6, 6, 5, 6, 6], device='cuda:0')
Worker 9 has targets: tensor([6, 6, 6, 6, 6], device='cuda:0')
Worker 10 has targets: tensor([7, 7, 7, 7, 7], device='cuda:0')
Worker 11 has targets: tensor([8, 8, 8, 8, 8], device='cuda:0')
Worker 12 has targets: tensor([9, 9, 8, 9, 9], device='cuda:0')
Worker 13 has targets: tensor([9, 9, 9, 9, 9], device='cuda:0')



=== Log global consensus distance @ E1B0 ===
consensus_distance=0.000



=== Log clique consensus distance @ E1B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.000


[E 1B10 |   4928/60000 (  8%) ] Loss: 1.8917 top1= 49.1477

=== Log global consensus distance @ E1B10 ===
consensus_distance=0.033



=== Log clique consensus distance @ E1B10 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=0.033


[E 1B20 |   9408/60000 ( 16%) ] Loss: 1.7121 top1= 38.0682

=== Log global consensus distance @ E1B20 ===
consensus_distance=0.374



=== Log clique consensus distance @ E1B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.193



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=39.7271 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.0482 top1= 37.1494


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.9520 top1= 31.2800

Train epoch 2
[E 2B0  |    448/60000 (  1%) ] Loss: 1.1520 top1= 54.8295

=== Log global consensus distance @ E2B0 ===
consensus_distance=1.255



=== Log clique consensus distance @ E2B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.641


[E 2B10 |   4928/60000 (  8%) ] Loss: 0.8565 top1= 69.6023

=== Log global consensus distance @ E2B10 ===
consensus_distance=2.536



=== Log clique consensus distance @ E2B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=1.141


[E 2B20 |   9408/60000 ( 16%) ] Loss: 0.6843 top1= 75.0000

=== Log global consensus distance @ E2B20 ===
consensus_distance=4.145



=== Log clique consensus distance @ E2B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=1.605



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=290.4857 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5.7634 top1= 36.4483


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=5.2854 top1= 39.4331

Train epoch 3
[E 3B0  |    448/60000 (  1%) ] Loss: 0.5073 top1= 84.9432

=== Log global consensus distance @ E3B0 ===
consensus_distance=6.171



=== Log clique consensus distance @ E3B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=2.206


[E 3B10 |   4928/60000 (  8%) ] Loss: 0.3823 top1= 89.7727

=== Log global consensus distance @ E3B10 ===
consensus_distance=8.540



=== Log clique consensus distance @ E3B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=2.802


[E 3B20 |   9408/60000 ( 16%) ] Loss: 0.3019 top1= 90.6250

=== Log global consensus distance @ E3B20 ===
consensus_distance=11.234



=== Log clique consensus distance @ E3B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=3.380



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=942.1536 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=10.2099 top1= 41.4864


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=9.8745 top1= 42.5781

Train epoch 4
[E 4B0  |    448/60000 (  1%) ] Loss: 0.2626 top1= 92.8977

=== Log global consensus distance @ E4B0 ===
consensus_distance=14.265



=== Log clique consensus distance @ E4B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=3.968


[E 4B10 |   4928/60000 (  8%) ] Loss: 0.2044 top1= 94.8864

=== Log global consensus distance @ E4B10 ===
consensus_distance=17.610



=== Log clique consensus distance @ E4B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=4.532


[E 4B20 |   9408/60000 ( 16%) ] Loss: 0.1927 top1= 94.3182

=== Log global consensus distance @ E4B20 ===
consensus_distance=21.274



=== Log clique consensus distance @ E4B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=5.082



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2196.5558 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=16.8140 top1= 39.1727


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=17.0210 top1= 43.4996

Train epoch 5
[E 5B0  |    448/60000 (  1%) ] Loss: 0.1606 top1= 95.7386

=== Log global consensus distance @ E5B0 ===
consensus_distance=25.265



=== Log clique consensus distance @ E5B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=5.625


[E 5B10 |   4928/60000 (  8%) ] Loss: 0.1550 top1= 96.5909

=== Log global consensus distance @ E5B10 ===
consensus_distance=29.563



=== Log clique consensus distance @ E5B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=6.149


[E 5B20 |   9408/60000 ( 16%) ] Loss: 0.1511 top1= 95.4545

=== Log global consensus distance @ E5B20 ===
consensus_distance=34.177



=== Log clique consensus distance @ E5B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=6.665



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4268.0391 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=25.2804 top1= 39.6434


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=26.8181 top1= 41.3762

Train epoch 6
[E 6B0  |    448/60000 (  1%) ] Loss: 0.1327 top1= 97.1591

=== Log global consensus distance @ E6B0 ===
consensus_distance=39.119



=== Log clique consensus distance @ E6B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=7.178


[E 6B10 |   4928/60000 (  8%) ] Loss: 0.1296 top1= 96.8750

=== Log global consensus distance @ E6B10 ===
consensus_distance=44.361



=== Log clique consensus distance @ E6B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=7.660


[E 6B20 |   9408/60000 ( 16%) ] Loss: 0.1394 top1= 96.0227

=== Log global consensus distance @ E6B20 ===
consensus_distance=49.926



=== Log clique consensus distance @ E6B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=8.153



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7380.4076 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=36.2887 top1= 39.5733


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=39.1680 top1= 44.1206

Train epoch 7
[E 7B0  |    448/60000 (  1%) ] Loss: 0.1028 top1= 97.1591

=== Log global consensus distance @ E7B0 ===
consensus_distance=55.818



=== Log clique consensus distance @ E7B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=8.640


[E 7B10 |   4928/60000 (  8%) ] Loss: 0.1248 top1= 96.0227

=== Log global consensus distance @ E7B10 ===
consensus_distance=62.014



=== Log clique consensus distance @ E7B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=9.120


[E 7B20 |   9408/60000 ( 16%) ] Loss: 0.1540 top1= 93.7500

=== Log global consensus distance @ E7B20 ===
consensus_distance=68.529



=== Log clique consensus distance @ E7B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=9.597



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=11760.5609 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=50.1620 top1= 34.8758


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=54.3149 top1= 41.0857

Train epoch 8
[E 8B0  |    448/60000 (  1%) ] Loss: 0.0875 top1= 97.1591

=== Log global consensus distance @ E8B0 ===
consensus_distance=75.384



=== Log clique consensus distance @ E8B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=10.098


[E 8B10 |   4928/60000 (  8%) ] Loss: 0.1338 top1= 95.7386

=== Log global consensus distance @ E8B10 ===
consensus_distance=82.550



=== Log clique consensus distance @ E8B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=10.592


[E 8B20 |   9408/60000 ( 16%) ] Loss: 0.1673 top1= 94.3182

=== Log global consensus distance @ E8B20 ===
consensus_distance=90.045



=== Log clique consensus distance @ E8B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=11.101



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=17577.4086 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=66.0679 top1= 37.8806


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=69.4013 top1= 41.4764

Train epoch 9
[E 9B0  |    448/60000 (  1%) ] Loss: 0.2211 top1= 92.6136

=== Log global consensus distance @ E9B0 ===
consensus_distance=97.894



=== Log clique consensus distance @ E9B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=11.666


[E 9B10 |   4928/60000 (  8%) ] Loss: 3.0232 top1= 77.8409

=== Log global consensus distance @ E9B10 ===
consensus_distance=106.076



=== Log clique consensus distance @ E9B10 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=12.243


[E 9B20 |   9408/60000 ( 16%) ] Loss: 0.7460 top1= 85.5114

=== Log global consensus distance @ E9B20 ===
consensus_distance=114.835



=== Log clique consensus distance @ E9B20 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=13.130



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=23239.0336 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=31.8659 top1= 39.5032


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=80.5032 top1= 39.6635

Train epoch 10
[E10B0  |    448/60000 (  1%) ] Loss: 0.1444 top1= 96.0227

=== Log global consensus distance @ E10B0 ===
consensus_distance=123.883



=== Log clique consensus distance @ E10B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=13.986


[E10B10 |   4928/60000 (  8%) ] Loss: 0.2122 top1= 93.7500

=== Log global consensus distance @ E10B10 ===
consensus_distance=133.061



=== Log clique consensus distance @ E10B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=14.593


[E10B20 |   9408/60000 ( 16%) ] Loss: 0.2732 top1= 92.3295

=== Log global consensus distance @ E10B20 ===
consensus_distance=142.546



=== Log clique consensus distance @ E10B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=15.108



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=31317.1105 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=24.1674 top1= 41.8570


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=71.4786 top1= 42.5681

Train epoch 11
[E11B0  |    448/60000 (  1%) ] Loss: 0.1441 top1= 94.8864

=== Log global consensus distance @ E11B0 ===
consensus_distance=152.321



=== Log clique consensus distance @ E11B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=15.594


[E11B10 |   4928/60000 (  8%) ] Loss: 0.1303 top1= 96.5909

=== Log global consensus distance @ E11B10 ===
consensus_distance=162.325



=== Log clique consensus distance @ E11B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=15.987


[E11B20 |   9408/60000 ( 16%) ] Loss: 0.2130 top1= 93.1818

=== Log global consensus distance @ E11B20 ===
consensus_distance=172.609



=== Log clique consensus distance @ E11B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=16.366



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=42612.7480 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=24.2818 top1= 41.3962


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=77.5614 top1= 42.8686

Train epoch 12
[E12B0  |    448/60000 (  1%) ] Loss: 0.0939 top1= 97.4432

=== Log global consensus distance @ E12B0 ===
consensus_distance=183.347



=== Log clique consensus distance @ E12B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=16.925


[E12B10 |   4928/60000 (  8%) ] Loss: 0.1234 top1= 96.3068

=== Log global consensus distance @ E12B10 ===
consensus_distance=194.246



=== Log clique consensus distance @ E12B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=17.288


[E12B20 |   9408/60000 ( 16%) ] Loss: 0.2088 top1= 93.4659

=== Log global consensus distance @ E12B20 ===
consensus_distance=205.482



=== Log clique consensus distance @ E12B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=17.711



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=56838.1183 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=25.1982 top1= 41.0056


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=82.8126 top1= 43.0088

Train epoch 13
[E13B0  |    448/60000 (  1%) ] Loss: 0.0935 top1= 96.5909

=== Log global consensus distance @ E13B0 ===
consensus_distance=217.181



=== Log clique consensus distance @ E13B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=18.315


[E13B10 |   4928/60000 (  8%) ] Loss: 0.1056 top1= 97.4432

=== Log global consensus distance @ E13B10 ===
consensus_distance=229.026



=== Log clique consensus distance @ E13B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=18.737


[E13B20 |   9408/60000 ( 16%) ] Loss: 0.1750 top1= 94.6023

=== Log global consensus distance @ E13B20 ===
consensus_distance=241.185



=== Log clique consensus distance @ E13B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=19.174



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=74353.7748 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=25.1339 top1= 40.3646


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=85.4576 top1= 42.9087

Train epoch 14
[E14B0  |    448/60000 (  1%) ] Loss: 0.0800 top1= 98.0114

=== Log global consensus distance @ E14B0 ===
consensus_distance=253.822



=== Log clique consensus distance @ E14B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=19.818


[E14B10 |   4928/60000 (  8%) ] Loss: 0.0943 top1= 98.0114

=== Log global consensus distance @ E14B10 ===
consensus_distance=266.641



=== Log clique consensus distance @ E14B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=20.302


[E14B20 |   9408/60000 ( 16%) ] Loss: 0.1364 top1= 95.7386

=== Log global consensus distance @ E14B20 ===
consensus_distance=279.780



=== Log clique consensus distance @ E14B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=20.834



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=95567.8900 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=23.9197 top1= 39.8738


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=88.4462 top1= 42.7083

Train epoch 15
[E15B0  |    448/60000 (  1%) ] Loss: 0.1429 top1= 96.0227

=== Log global consensus distance @ E15B0 ===
consensus_distance=293.356



=== Log clique consensus distance @ E15B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=21.509


[E15B10 |   4928/60000 (  8%) ] Loss: 0.1326 top1= 96.0227

=== Log global consensus distance @ E15B10 ===
consensus_distance=307.061



=== Log clique consensus distance @ E15B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=21.983


[E15B20 |   9408/60000 ( 16%) ] Loss: 0.1414 top1= 94.3182

=== Log global consensus distance @ E15B20 ===
consensus_distance=321.186



=== Log clique consensus distance @ E15B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=22.607



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=121111.4278 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=23.9835 top1= 39.8337


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=90.8553 top1= 42.5180

Train epoch 16
[E16B0  |    448/60000 (  1%) ] Loss: 0.1584 top1= 95.1705

=== Log global consensus distance @ E16B0 ===
consensus_distance=335.665



=== Log clique consensus distance @ E16B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=23.258


[E16B10 |   4928/60000 (  8%) ] Loss: 0.1086 top1= 96.8750

=== Log global consensus distance @ E16B10 ===
consensus_distance=350.262



=== Log clique consensus distance @ E16B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=23.686


[E16B20 |   9408/60000 ( 16%) ] Loss: 0.1843 top1= 94.6023

=== Log global consensus distance @ E16B20 ===
consensus_distance=365.341



=== Log clique consensus distance @ E16B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=24.353



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=151279.8482 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=23.9727 top1= 39.8838


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=87.0140 top1= 45.0321

Train epoch 17
[E17B0  |    448/60000 (  1%) ] Loss: 0.0764 top1= 97.1591

=== Log global consensus distance @ E17B0 ===
consensus_distance=380.729



=== Log clique consensus distance @ E17B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=24.995


[E17B10 |   4928/60000 (  8%) ] Loss: 0.1061 top1= 96.0227

=== Log global consensus distance @ E17B10 ===
consensus_distance=396.301



=== Log clique consensus distance @ E17B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=25.529


[E17B20 |   9408/60000 ( 16%) ] Loss: 0.1075 top1= 97.1591

=== Log global consensus distance @ E17B20 ===
consensus_distance=412.248



=== Log clique consensus distance @ E17B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=26.173



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=187106.7324 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=23.3963 top1= 39.5533


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=89.2389 top1= 44.8217

Train epoch 18
[E18B0  |    448/60000 (  1%) ] Loss: 0.0685 top1= 97.7273

=== Log global consensus distance @ E18B0 ===
consensus_distance=428.572



=== Log clique consensus distance @ E18B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=26.836


[E18B10 |   4928/60000 (  8%) ] Loss: 0.0818 top1= 97.4432

=== Log global consensus distance @ E18B10 ===
consensus_distance=445.073



=== Log clique consensus distance @ E18B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=27.390


[E18B20 |   9408/60000 ( 16%) ] Loss: 0.2262 top1= 96.3068

=== Log global consensus distance @ E18B20 ===
consensus_distance=461.976



=== Log clique consensus distance @ E18B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=28.084



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=228921.8017 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=22.0433 top1= 39.5733


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=86.7452 top1= 42.8486

Train epoch 19
[E19B0  |    448/60000 (  1%) ] Loss: 0.0738 top1= 97.7273

=== Log global consensus distance @ E19B0 ===
consensus_distance=479.246



=== Log clique consensus distance @ E19B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=28.856


[E19B10 |   4928/60000 (  8%) ] Loss: 0.0737 top1= 97.7273

=== Log global consensus distance @ E19B10 ===
consensus_distance=496.591



=== Log clique consensus distance @ E19B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=29.336


[E19B20 |   9408/60000 ( 16%) ] Loss: 0.1045 top1= 96.8750

=== Log global consensus distance @ E19B20 ===
consensus_distance=514.347



=== Log clique consensus distance @ E19B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=29.965



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=278561.1763 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=21.9938 top1= 39.0925


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=89.6576 top1= 43.9203

Train epoch 20
[E20B0  |    448/60000 (  1%) ] Loss: 0.0523 top1= 98.2955

=== Log global consensus distance @ E20B0 ===
consensus_distance=532.436



=== Log clique consensus distance @ E20B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=30.605


[E20B10 |   4928/60000 (  8%) ] Loss: 0.0963 top1= 96.5909

=== Log global consensus distance @ E20B10 ===
consensus_distance=550.720



=== Log clique consensus distance @ E20B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=31.158


[E20B20 |   9408/60000 ( 16%) ] Loss: 0.1004 top1= 95.4545

=== Log global consensus distance @ E20B20 ===
consensus_distance=569.445



=== Log clique consensus distance @ E20B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=31.875



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=336229.6486 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=21.2337 top1= 39.4431


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=90.5563 top1= 44.0405

Train epoch 21
[E21B0  |    448/60000 (  1%) ] Loss: 0.0395 top1= 99.1477

=== Log global consensus distance @ E21B0 ===
consensus_distance=588.448



=== Log clique consensus distance @ E21B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=32.571


[E21B10 |   4928/60000 (  8%) ] Loss: 0.0819 top1= 96.5909

=== Log global consensus distance @ E21B10 ===
consensus_distance=607.673



=== Log clique consensus distance @ E21B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=33.100


[E21B20 |   9408/60000 ( 16%) ] Loss: 0.1046 top1= 96.3068

=== Log global consensus distance @ E21B20 ===
consensus_distance=627.237



=== Log clique consensus distance @ E21B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=33.765



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=402691.7536 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=21.6353 top1= 39.6534


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=90.8134 top1= 42.8886

Train epoch 22
[E22B0  |    448/60000 (  1%) ] Loss: 0.0718 top1= 97.4432

=== Log global consensus distance @ E22B0 ===
consensus_distance=647.099



=== Log clique consensus distance @ E22B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=34.381


[E22B10 |   4928/60000 (  8%) ] Loss: 0.1044 top1= 96.3068

=== Log global consensus distance @ E22B10 ===
consensus_distance=667.240



=== Log clique consensus distance @ E22B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=34.949


[E22B20 |   9408/60000 ( 16%) ] Loss: 0.1013 top1= 96.5909

=== Log global consensus distance @ E22B20 ===
consensus_distance=687.758



=== Log clique consensus distance @ E22B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=35.795



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=478287.7764 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=22.8553 top1= 39.6434


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=85.9543 top1= 43.5697

Train epoch 23
[E23B0  |    448/60000 (  1%) ] Loss: 0.0594 top1= 98.5795

=== Log global consensus distance @ E23B0 ===
consensus_distance=708.811



=== Log clique consensus distance @ E23B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=36.805


[E23B10 |   4928/60000 (  8%) ] Loss: 0.1381 top1= 94.8864

=== Log global consensus distance @ E23B10 ===
consensus_distance=729.760



=== Log clique consensus distance @ E23B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=37.284


[E23B20 |   9408/60000 ( 16%) ] Loss: 0.0875 top1= 97.1591

=== Log global consensus distance @ E23B20 ===
consensus_distance=750.938



=== Log clique consensus distance @ E23B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=37.616



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=567123.9295 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=23.1105 top1= 39.5733


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=73.6043 top1= 45.0721

Train epoch 24
[E24B0  |    448/60000 (  1%) ] Loss: 0.0581 top1= 97.4432

=== Log global consensus distance @ E24B0 ===
consensus_distance=772.560



=== Log clique consensus distance @ E24B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=38.117


[E24B10 |   4928/60000 (  8%) ] Loss: 0.1066 top1= 96.8750

=== Log global consensus distance @ E24B10 ===
consensus_distance=794.507



=== Log clique consensus distance @ E24B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=38.739


[E24B20 |   9408/60000 ( 16%) ] Loss: 2.5726 top1= 94.0341

=== Log global consensus distance @ E24B20 ===
consensus_distance=818.065



=== Log clique consensus distance @ E24B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=41.118



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=659741.6386 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=24.2204 top1= 39.7035


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=60.0702 top1= 44.4010

Train epoch 25
[E25B0  |    448/60000 (  1%) ] Loss: 0.4813 top1= 92.8977

=== Log global consensus distance @ E25B0 ===
consensus_distance=840.965



=== Log clique consensus distance @ E25B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=42.741


[E25B10 |   4928/60000 (  8%) ] Loss: 0.2784 top1= 94.6023

=== Log global consensus distance @ E25B10 ===
consensus_distance=864.178



=== Log clique consensus distance @ E25B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=43.585


[E25B20 |   9408/60000 ( 16%) ] Loss: 0.2060 top1= 94.8864

=== Log global consensus distance @ E25B20 ===
consensus_distance=887.061



=== Log clique consensus distance @ E25B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=43.704



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=765656.6362 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=24.2241 top1= 39.5333


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=35.8514 top1= 45.2524

Train epoch 26
[E26B0  |    448/60000 (  1%) ] Loss: 0.0811 top1= 97.7273

=== Log global consensus distance @ E26B0 ===
consensus_distance=910.261



=== Log clique consensus distance @ E26B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=43.782


[E26B10 |   4928/60000 (  8%) ] Loss: 0.0868 top1= 96.8750

=== Log global consensus distance @ E26B10 ===
consensus_distance=933.782



=== Log clique consensus distance @ E26B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=43.888


[E26B20 |   9408/60000 ( 16%) ] Loss: 0.0671 top1= 97.4432

=== Log global consensus distance @ E26B20 ===
consensus_distance=957.474



=== Log clique consensus distance @ E26B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=43.894



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=898194.8333 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=25.1577 top1= 39.5933


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=32.0992 top1= 45.4828

Train epoch 27
[E27B0  |    448/60000 (  1%) ] Loss: 0.0755 top1= 96.8750

=== Log global consensus distance @ E27B0 ===
consensus_distance=981.633



=== Log clique consensus distance @ E27B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=44.004


[E27B10 |   4928/60000 (  8%) ] Loss: 0.0852 top1= 97.4432

=== Log global consensus distance @ E27B10 ===
consensus_distance=1006.004



=== Log clique consensus distance @ E27B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=44.141


[E27B20 |   9408/60000 ( 16%) ] Loss: 0.0712 top1= 98.0114

=== Log global consensus distance @ E27B20 ===
consensus_distance=1030.620



=== Log clique consensus distance @ E27B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=44.164



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1051397.8486 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=25.3975 top1= 39.8137


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=30.2134 top1= 45.2925

Train epoch 28
[E28B0  |    448/60000 (  1%) ] Loss: 0.0567 top1= 98.8636

=== Log global consensus distance @ E28B0 ===
consensus_distance=1055.573



=== Log clique consensus distance @ E28B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=44.239


[E28B10 |   4928/60000 (  8%) ] Loss: 0.0993 top1= 96.5909

=== Log global consensus distance @ E28B10 ===
consensus_distance=1081.013



=== Log clique consensus distance @ E28B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=44.465


[E28B20 |   9408/60000 ( 16%) ] Loss: 0.0694 top1= 98.0114

=== Log global consensus distance @ E28B20 ===
consensus_distance=1106.486



=== Log clique consensus distance @ E28B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=44.511



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1220589.2580 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=28.1057 top1= 39.5833


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=29.3772 top1= 45.1623

Train epoch 29
[E29B0  |    448/60000 (  1%) ] Loss: 0.0314 top1= 99.4318

=== Log global consensus distance @ E29B0 ===
consensus_distance=1132.271



=== Log clique consensus distance @ E29B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=44.548


[E29B10 |   4928/60000 (  8%) ] Loss: 0.0778 top1= 96.8750

=== Log global consensus distance @ E29B10 ===
consensus_distance=1158.549



=== Log clique consensus distance @ E29B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=44.675


[E29B20 |   9408/60000 ( 16%) ] Loss: 0.0446 top1= 99.1477

=== Log global consensus distance @ E29B20 ===
consensus_distance=1185.024



=== Log clique consensus distance @ E29B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=44.791



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1409397.7356 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=27.2910 top1= 40.0240


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=26.6643 top1= 43.9603

Train epoch 30
[E30B0  |    448/60000 (  1%) ] Loss: 0.0499 top1= 98.2955

=== Log global consensus distance @ E30B0 ===
consensus_distance=1211.783



=== Log clique consensus distance @ E30B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=44.928


[E30B10 |   4928/60000 (  8%) ] Loss: 0.0780 top1= 96.8750

=== Log global consensus distance @ E30B10 ===
consensus_distance=1239.056



=== Log clique consensus distance @ E30B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=45.287


[E30B20 |   9408/60000 ( 16%) ] Loss: 0.0646 top1= 97.7273

=== Log global consensus distance @ E30B20 ===
consensus_distance=1266.706



=== Log clique consensus distance @ E30B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=45.773



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1619366.6026 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=33.3930 top1= 40.1242


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=26.4188 top1= 44.1807

Train epoch 31
[E31B0  |    448/60000 (  1%) ] Loss: 0.0565 top1= 97.7273

=== Log global consensus distance @ E31B0 ===
consensus_distance=1294.398



=== Log clique consensus distance @ E31B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=45.994


[E31B10 |   4928/60000 (  8%) ] Loss: 0.1034 top1= 97.4432

=== Log global consensus distance @ E31B10 ===
consensus_distance=1322.396



=== Log clique consensus distance @ E31B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=46.087


[E31B20 |   9408/60000 ( 16%) ] Loss: 0.1150 top1= 97.7273

=== Log global consensus distance @ E31B20 ===
consensus_distance=1350.472



=== Log clique consensus distance @ E31B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=46.083



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1854966.0032 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=31.3297 top1= 40.0140


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=26.5024 top1= 44.5012

Train epoch 32
[E32B0  |    448/60000 (  1%) ] Loss: 0.0361 top1= 98.8636

=== Log global consensus distance @ E32B0 ===
consensus_distance=1378.954



=== Log clique consensus distance @ E32B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=46.124


[E32B10 |   4928/60000 (  8%) ] Loss: 0.0763 top1= 97.7273

=== Log global consensus distance @ E32B10 ===
consensus_distance=1407.857



=== Log clique consensus distance @ E32B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=46.192


[E32B20 |   9408/60000 ( 16%) ] Loss: 0.0841 top1= 98.0114

=== Log global consensus distance @ E32B20 ===
consensus_distance=1437.046



=== Log clique consensus distance @ E32B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=46.420



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2119512.2468 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=33.5766 top1= 40.1743


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=23.4195 top1= 43.6298

Train epoch 33
[E33B0  |    448/60000 (  1%) ] Loss: 0.0459 top1= 99.1477

=== Log global consensus distance @ E33B0 ===
consensus_distance=1466.599



=== Log clique consensus distance @ E33B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=46.627


[E33B10 |   4928/60000 (  8%) ] Loss: 0.1039 top1= 97.1591

=== Log global consensus distance @ E33B10 ===
consensus_distance=1496.270



=== Log clique consensus distance @ E33B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=46.713


[E33B20 |   9408/60000 ( 16%) ] Loss: 0.0621 top1= 97.4432

=== Log global consensus distance @ E33B20 ===
consensus_distance=1526.199



=== Log clique consensus distance @ E33B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=46.755



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2411939.5801 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=32.7606 top1= 38.9824


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=24.2424 top1= 43.9804

Train epoch 34
[E34B0  |    448/60000 (  1%) ] Loss: 0.0672 top1= 98.2955

=== Log global consensus distance @ E34B0 ===
consensus_distance=1556.636



=== Log clique consensus distance @ E34B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=46.924


[E34B10 |   4928/60000 (  8%) ] Loss: 0.0467 top1= 98.2955

=== Log global consensus distance @ E34B10 ===
consensus_distance=1587.253



=== Log clique consensus distance @ E34B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=47.243


[E34B20 |   9408/60000 ( 16%) ] Loss: 0.1849 top1= 96.0227

=== Log global consensus distance @ E34B20 ===
consensus_distance=1618.530



=== Log clique consensus distance @ E34B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=47.601



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2725104.1955 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=40.3548 top1= 40.0441


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=25.4942 top1= 42.7784

Train epoch 35
[E35B0  |    448/60000 (  1%) ] Loss: 0.0553 top1= 98.2955

=== Log global consensus distance @ E35B0 ===
consensus_distance=1649.826



=== Log clique consensus distance @ E35B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=47.992


[E35B10 |   4928/60000 (  8%) ] Loss: 0.0944 top1= 97.4432

=== Log global consensus distance @ E35B10 ===
consensus_distance=1681.483



=== Log clique consensus distance @ E35B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=48.233


[E35B20 |   9408/60000 ( 16%) ] Loss: 0.0659 top1= 98.0114

=== Log global consensus distance @ E35B20 ===
consensus_distance=1713.183



=== Log clique consensus distance @ E35B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=48.276



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3080679.5513 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=37.2056 top1= 40.2244


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=25.9635 top1= 37.4900

Train epoch 36
[E36B0  |    448/60000 (  1%) ] Loss: 0.1470 top1= 96.3068

=== Log global consensus distance @ E36B0 ===
consensus_distance=1745.307



=== Log clique consensus distance @ E36B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=48.508


[E36B10 |   4928/60000 (  8%) ] Loss: 0.1085 top1= 98.0114

=== Log global consensus distance @ E36B10 ===
consensus_distance=1778.001



=== Log clique consensus distance @ E36B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=48.805


[E36B20 |   9408/60000 ( 16%) ] Loss: 0.3535 top1= 96.3068

=== Log global consensus distance @ E36B20 ===
consensus_distance=1811.217



=== Log clique consensus distance @ E36B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=49.862



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3447817.0545 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=39.4406 top1= 40.7652


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=28.7155 top1= 42.2877

Train epoch 37
[E37B0  |    448/60000 (  1%) ] Loss: 0.0687 top1= 96.8750

=== Log global consensus distance @ E37B0 ===
consensus_distance=1844.588



=== Log clique consensus distance @ E37B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=50.687


[E37B10 |   4928/60000 (  8%) ] Loss: 0.1076 top1= 96.5909

=== Log global consensus distance @ E37B10 ===
consensus_distance=1878.431



=== Log clique consensus distance @ E37B10 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=51.312


[E37B20 |   9408/60000 ( 16%) ] Loss: 0.1164 top1= 97.4432

=== Log global consensus distance @ E37B20 ===
consensus_distance=1912.006



=== Log clique consensus distance @ E37B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=51.576



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3848329.5769 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=47.9741 top1= 40.0441


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=25.5017 top1= 44.8918

Train epoch 38
[E38B0  |    448/60000 (  1%) ] Loss: 0.2178 top1= 95.1705

=== Log global consensus distance @ E38B0 ===
consensus_distance=1946.153



=== Log clique consensus distance @ E38B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=51.959


[E38B10 |   4928/60000 (  8%) ] Loss: 0.1220 top1= 97.1591

=== Log global consensus distance @ E38B10 ===
consensus_distance=1980.365



=== Log clique consensus distance @ E38B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=52.170


[E38B20 |   9408/60000 ( 16%) ] Loss: 0.1058 top1= 97.1591

=== Log global consensus distance @ E38B20 ===
consensus_distance=2014.704



=== Log clique consensus distance @ E38B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=52.212



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4298480.0641 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=48.8616 top1= 38.3914


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=24.1134 top1= 45.4227

Train epoch 39
[E39B0  |    448/60000 (  1%) ] Loss: 0.2750 top1= 94.3182

=== Log global consensus distance @ E39B0 ===
consensus_distance=2049.796



=== Log clique consensus distance @ E39B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=52.524


[E39B10 |   4928/60000 (  8%) ] Loss: 0.1110 top1= 97.1591

=== Log global consensus distance @ E39B10 ===
consensus_distance=2084.760



=== Log clique consensus distance @ E39B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=52.750


[E39B20 |   9408/60000 ( 16%) ] Loss: 0.1054 top1= 97.4432

=== Log global consensus distance @ E39B20 ===
consensus_distance=2119.977



=== Log clique consensus distance @ E39B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=52.719



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4776295.1090 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=56.2194 top1= 38.4716


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=22.2536 top1= 44.7716

Train epoch 40
[E40B0  |    448/60000 (  1%) ] Loss: 0.1720 top1= 96.0227

=== Log global consensus distance @ E40B0 ===
consensus_distance=2156.250



=== Log clique consensus distance @ E40B0 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=53.267


[E40B10 |   4928/60000 (  8%) ] Loss: 0.2379 top1= 96.3068

=== Log global consensus distance @ E40B10 ===
consensus_distance=2192.715



=== Log clique consensus distance @ E40B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=54.211


[E40B20 |   9408/60000 ( 16%) ] Loss: 0.2850 top1= 94.8864

=== Log global consensus distance @ E40B20 ===
consensus_distance=2229.141



=== Log clique consensus distance @ E40B20 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=54.700



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7427049.6923 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=56.7547 top1= 40.2244


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4634602.4776 top1=  9.8157

