
=== Start adding workers ===
=> Add worker SGDMWorker(index=0, momentum=0.9)
=> Add worker SGDMWorker(index=1, momentum=0.9)
=> Add worker SGDMWorker(index=2, momentum=0.9)
=> Add worker SGDMWorker(index=3, momentum=0.9)
=> Add worker SGDMWorker(index=4, momentum=0.9)
=> Add worker SGDMWorker(index=5, momentum=0.9)
=> Add worker SGDMWorker(index=6, momentum=0.9)
=> Add worker SGDMWorker(index=7, momentum=0.9)
=> Add worker SGDMWorker(index=8, momentum=0.9)
=> Add worker SGDMWorker(index=9, momentum=0.9)
=> Add worker SGDMWorker(index=10, momentum=0.9)
=> Add worker ByzantineWorker(index=11)

=== Start adding graph ===
TwoCliquesWithByzantine(m=5,b=1)

Train epoch 1
[E 1B0  |    384/60000 (  1%) ] Loss: 2.3142 top1=  7.6705

=== Peeking data label distribution E1B0 ===
Worker 0 has targets: tensor([0, 0, 0, 0, 0], device='cuda:0')
Worker 1 has targets: tensor([1, 1, 1, 0, 1], device='cuda:0')
Worker 2 has targets: tensor([1, 1, 2, 1, 1], device='cuda:0')
Worker 3 has targets: tensor([2, 2, 3, 2, 2], device='cuda:0')
Worker 4 has targets: tensor([3, 3, 3, 3, 3], device='cuda:0')
Worker 5 has targets: tensor([4, 4, 4, 4, 4], device='cuda:0')
Worker 6 has targets: tensor([5, 5, 5, 5, 5], device='cuda:0')
Worker 7 has targets: tensor([6, 6, 6, 5, 6], device='cuda:0')
Worker 8 has targets: tensor([6, 7, 7, 6, 6], device='cuda:0')
Worker 9 has targets: tensor([7, 7, 8, 7, 7], device='cuda:0')
Worker 10 has targets: tensor([8, 8, 9, 8, 8], device='cuda:0')
Worker 11 has targets: tensor([9, 9, 9, 9, 9], device='cuda:0')



=== Log global consensus distance @ E1B0 ===
consensus_distance=0.001



=== Log clique consensus distance @ E1B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.002



=== Log mixing matrix @ E1B0 ===
[[0.167 0.167 0.167 0.167 0.167 0.    0.    0.    0.    0.    0.167 0.   ]
 [0.167 0.233 0.2   0.2   0.2   0.    0.    0.    0.    0.    0.    0.   ]
 [0.167 0.2   0.233 0.2   0.2   0.    0.    0.    0.    0.    0.    0.   ]
 [0.167 0.2   0.2   0.233 0.2   0.    0.    0.    0.    0.    0.    0.   ]
 [0.167 0.2   0.2   0.2   0.233 0.    0.    0.    0.    0.    0.    0.   ]
 [0.    0.    0.    0.    0.    0.233 0.2   0.2   0.2   0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.2   0.233 0.2   0.2   0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.2   0.2   0.233 0.2   0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.2   0.2   0.2   0.233 0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.167 0.167 0.167 0.167 0.167 0.167 0.   ]
 [0.167 0.    0.    0.    0.    0.    0.    0.    0.    0.167 0.292 0.375]
 [0.    0.    0.    0.    0.    0.    0.    0.    0.    0.    0.375 0.625]]


[E 1B10 |   4224/60000 (  7%) ] Loss: 0.7326 top1= 78.1250

=== Log global consensus distance @ E1B10 ===
consensus_distance=0.665



=== Log clique consensus distance @ E1B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=1.639


[E 1B20 |   8064/60000 ( 13%) ] Loss: 0.2578 top1= 93.4659

=== Log global consensus distance @ E1B20 ===
consensus_distance=1.758



=== Log clique consensus distance @ E1B20 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=4.121



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.2130 top1= 10.6971


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.8011 top1= 40.9956


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.4933 top1= 41.8570

Train epoch 2
[E 2B0  |    384/60000 (  1%) ] Loss: 0.1579 top1= 94.8864

=== Log global consensus distance @ E2B0 ===
consensus_distance=2.517



=== Log clique consensus distance @ E2B0 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=5.189


[E 2B10 |   4224/60000 (  7%) ] Loss: 0.1320 top1= 95.7386

=== Log global consensus distance @ E2B10 ===
consensus_distance=2.952



=== Log clique consensus distance @ E2B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=5.508


[E 2B20 |   8064/60000 ( 13%) ] Loss: 0.1500 top1= 94.8864

=== Log global consensus distance @ E2B20 ===
consensus_distance=3.273



=== Log clique consensus distance @ E2B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=5.629



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.6147 top1= 17.3478


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.2655 top1= 44.3209


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.3917 top1= 45.0721

Train epoch 3
[E 3B0  |    384/60000 (  1%) ] Loss: 0.0723 top1= 98.0114

=== Log global consensus distance @ E3B0 ===
consensus_distance=3.606



=== Log clique consensus distance @ E3B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=5.815


[E 3B10 |   4224/60000 (  7%) ] Loss: 0.0914 top1= 97.1591

=== Log global consensus distance @ E3B10 ===
consensus_distance=3.968



=== Log clique consensus distance @ E3B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=6.052


[E 3B20 |   8064/60000 ( 13%) ] Loss: 0.1119 top1= 96.3068

=== Log global consensus distance @ E3B20 ===
consensus_distance=4.328



=== Log clique consensus distance @ E3B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=6.317



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.4230 top1= 19.0104


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.2446 top1= 50.4107


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.5168 top1= 44.9619

Train epoch 4
[E 4B0  |    384/60000 (  1%) ] Loss: 0.0518 top1= 99.4318

=== Log global consensus distance @ E4B0 ===
consensus_distance=4.726



=== Log clique consensus distance @ E4B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=6.713


[E 4B10 |   4224/60000 (  7%) ] Loss: 0.0566 top1= 98.8636

=== Log global consensus distance @ E4B10 ===
consensus_distance=5.155



=== Log clique consensus distance @ E4B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=7.154


[E 4B20 |   8064/60000 ( 13%) ] Loss: 0.0754 top1= 98.0114

=== Log global consensus distance @ E4B20 ===
consensus_distance=5.552



=== Log clique consensus distance @ E4B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=7.535



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.1624 top1= 19.0705


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.4044 top1= 53.0148


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.9058 top1= 45.1823

Train epoch 5
[E 5B0  |    384/60000 (  1%) ] Loss: 0.0447 top1= 99.1477

=== Log global consensus distance @ E5B0 ===
consensus_distance=6.010



=== Log clique consensus distance @ E5B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=8.066


[E 5B10 |   4224/60000 (  7%) ] Loss: 0.0414 top1= 99.7159

=== Log global consensus distance @ E5B10 ===
consensus_distance=6.477



=== Log clique consensus distance @ E5B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=8.583


[E 5B20 |   8064/60000 ( 13%) ] Loss: 0.0587 top1= 98.8636

=== Log global consensus distance @ E5B20 ===
consensus_distance=6.911



=== Log clique consensus distance @ E5B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=9.032



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.8337 top1= 19.1607


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.5793 top1= 54.0465


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.1812 top1= 45.3926

Train epoch 6
[E 6B0  |    384/60000 (  1%) ] Loss: 0.0364 top1= 99.7159

=== Log global consensus distance @ E6B0 ===
consensus_distance=7.395



=== Log clique consensus distance @ E6B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=9.593


[E 6B10 |   4224/60000 (  7%) ] Loss: 0.0349 top1=100.0000

=== Log global consensus distance @ E6B10 ===
consensus_distance=7.897



=== Log clique consensus distance @ E6B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=10.172


[E 6B20 |   8064/60000 ( 13%) ] Loss: 0.0529 top1= 99.4318

=== Log global consensus distance @ E6B20 ===
consensus_distance=8.321



=== Log clique consensus distance @ E6B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=10.692



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=8.2843 top1= 19.1506


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.8228 top1= 54.2268


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.6242 top1= 45.6130

Train epoch 7
[E 7B0  |    384/60000 (  1%) ] Loss: 0.0318 top1= 99.7159

=== Log global consensus distance @ E7B0 ===
consensus_distance=8.895



=== Log clique consensus distance @ E7B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=11.352


[E 7B10 |   4224/60000 (  7%) ] Loss: 0.0897 top1= 97.7273

=== Log global consensus distance @ E7B10 ===
consensus_distance=9.501



=== Log clique consensus distance @ E7B10 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=12.003


[E 7B20 |   8064/60000 ( 13%) ] Loss: 0.0710 top1= 98.5795

=== Log global consensus distance @ E7B20 ===
consensus_distance=10.054



=== Log clique consensus distance @ E7B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=12.608



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=8.9390 top1= 19.2308


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.6833 top1= 54.1266


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.1179 top1= 45.9836

Train epoch 8
[E 8B0  |    384/60000 (  1%) ] Loss: 0.0358 top1= 99.1477

=== Log global consensus distance @ E8B0 ===
consensus_distance=10.656



=== Log clique consensus distance @ E8B0 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=13.323


[E 8B10 |   4224/60000 (  7%) ] Loss: 0.0759 top1= 97.4432

=== Log global consensus distance @ E8B10 ===
consensus_distance=11.304



=== Log clique consensus distance @ E8B10 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=14.217


[E 8B20 |   8064/60000 ( 13%) ] Loss: 0.0665 top1= 97.7273

=== Log global consensus distance @ E8B20 ===
consensus_distance=11.912



=== Log clique consensus distance @ E8B20 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=15.042



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=8.2636 top1= 19.3309


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.2767 top1= 53.8161


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.2355 top1= 46.3742

Train epoch 9
[E 9B0  |    384/60000 (  1%) ] Loss: 0.0538 top1= 98.2955

=== Log global consensus distance @ E9B0 ===
consensus_distance=12.550



=== Log clique consensus distance @ E9B0 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=15.966


[E 9B10 |   4224/60000 (  7%) ] Loss: 0.0321 top1= 98.8636

=== Log global consensus distance @ E9B10 ===
consensus_distance=13.191



=== Log clique consensus distance @ E9B10 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=16.878


[E 9B20 |   8064/60000 ( 13%) ] Loss: 0.0505 top1= 98.8636

=== Log global consensus distance @ E9B20 ===
consensus_distance=13.760



=== Log clique consensus distance @ E9B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=17.461



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=8.8440 top1= 19.3109


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.2867 top1= 53.2652


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.7814 top1= 47.9868

Train epoch 10
[E10B0  |    384/60000 (  1%) ] Loss: 0.0617 top1= 98.8636

=== Log global consensus distance @ E10B0 ===
consensus_distance=14.293



=== Log clique consensus distance @ E10B0 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=17.935


[E10B10 |   4224/60000 (  7%) ] Loss: 0.0298 top1= 99.4318

=== Log global consensus distance @ E10B10 ===
consensus_distance=14.863



=== Log clique consensus distance @ E10B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=18.505


[E10B20 |   8064/60000 ( 13%) ] Loss: 0.0681 top1= 98.0114

=== Log global consensus distance @ E10B20 ===
consensus_distance=15.380



=== Log clique consensus distance @ E10B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=18.987



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=9.2549 top1= 19.2608


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.5103 top1= 53.9363


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.6565 top1= 46.6146

Train epoch 11
[E11B0  |    384/60000 (  1%) ] Loss: 0.0318 top1= 99.4318

=== Log global consensus distance @ E11B0 ===
consensus_distance=15.948



=== Log clique consensus distance @ E11B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=19.623


[E11B10 |   4224/60000 (  7%) ] Loss: 0.0343 top1= 99.4318

=== Log global consensus distance @ E11B10 ===
consensus_distance=16.518



=== Log clique consensus distance @ E11B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=20.185


[E11B20 |   8064/60000 ( 13%) ] Loss: 0.0359 top1= 98.8636

=== Log global consensus distance @ E11B20 ===
consensus_distance=17.060



=== Log clique consensus distance @ E11B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=20.676



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=10.5600 top1= 19.3209


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.7043 top1= 53.5056


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.0710 top1= 45.8834

Train epoch 12
[E12B0  |    384/60000 (  1%) ] Loss: 0.0252 top1= 99.7159

=== Log global consensus distance @ E12B0 ===
consensus_distance=17.667



=== Log clique consensus distance @ E12B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=21.323


[E12B10 |   4224/60000 (  7%) ] Loss: 0.0477 top1= 99.1477

=== Log global consensus distance @ E12B10 ===
consensus_distance=18.248



=== Log clique consensus distance @ E12B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=21.854


[E12B20 |   8064/60000 ( 13%) ] Loss: 0.0703 top1= 98.5795

=== Log global consensus distance @ E12B20 ===
consensus_distance=18.792



=== Log clique consensus distance @ E12B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=22.204



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=11.1930 top1= 19.3309


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.2336 top1= 52.1334


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.8470 top1= 45.1122

Train epoch 13
[E13B0  |    384/60000 (  1%) ] Loss: 0.0227 top1=100.0000

=== Log global consensus distance @ E13B0 ===
consensus_distance=19.466



=== Log clique consensus distance @ E13B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=22.892


[E13B10 |   4224/60000 (  7%) ] Loss: 0.0415 top1= 98.8636

=== Log global consensus distance @ E13B10 ===
consensus_distance=20.059



=== Log clique consensus distance @ E13B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=23.296


[E13B20 |   8064/60000 ( 13%) ] Loss: 0.0241 top1= 99.7159

=== Log global consensus distance @ E13B20 ===
consensus_distance=20.628



=== Log clique consensus distance @ E13B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=23.728



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=12.7102 top1= 19.2909


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.3336 top1= 52.5040


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.6593 top1= 46.4643

Train epoch 14
[E14B0  |    384/60000 (  1%) ] Loss: 0.0256 top1= 99.1477

=== Log global consensus distance @ E14B0 ===
consensus_distance=21.288



=== Log clique consensus distance @ E14B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=24.333


[E14B10 |   4224/60000 (  7%) ] Loss: 0.0311 top1= 99.4318

=== Log global consensus distance @ E14B10 ===
consensus_distance=21.861



=== Log clique consensus distance @ E14B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=24.772


[E14B20 |   8064/60000 ( 13%) ] Loss: 0.0373 top1= 99.1477

=== Log global consensus distance @ E14B20 ===
consensus_distance=22.580



=== Log clique consensus distance @ E14B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=25.592



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=15.3360 top1= 19.2408


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.2398 top1= 52.2536


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.9495 top1= 48.4976

Train epoch 15
[E15B0  |    384/60000 (  1%) ] Loss: 0.0228 top1= 99.7159

=== Log global consensus distance @ E15B0 ===
consensus_distance=23.212



=== Log clique consensus distance @ E15B0 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=26.206


[E15B10 |   4224/60000 (  7%) ] Loss: 0.0297 top1= 99.4318

=== Log global consensus distance @ E15B10 ===
consensus_distance=23.812



=== Log clique consensus distance @ E15B10 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=26.598


[E15B20 |   8064/60000 ( 13%) ] Loss: 0.0436 top1= 98.8636

=== Log global consensus distance @ E15B20 ===
consensus_distance=24.438



=== Log clique consensus distance @ E15B20 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=27.116



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=16.3296 top1= 19.2408


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.3870 top1= 52.3738


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.9286 top1= 47.4760

Train epoch 16
[E16B0  |    384/60000 (  1%) ] Loss: 0.0239 top1= 99.7159

=== Log global consensus distance @ E16B0 ===
consensus_distance=25.086



=== Log clique consensus distance @ E16B0 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=27.788


[E16B10 |   4224/60000 (  7%) ] Loss: 0.0310 top1= 98.8636

=== Log global consensus distance @ E16B10 ===
consensus_distance=25.665



=== Log clique consensus distance @ E16B10 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=28.239


[E16B20 |   8064/60000 ( 13%) ] Loss: 0.0355 top1= 99.1477

=== Log global consensus distance @ E16B20 ===
consensus_distance=26.234



=== Log clique consensus distance @ E16B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=28.597



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=18.2166 top1= 19.2608


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.8119 top1= 53.4756


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.0199 top1= 46.4744

Train epoch 17
[E17B0  |    384/60000 (  1%) ] Loss: 0.0402 top1= 99.1477

=== Log global consensus distance @ E17B0 ===
consensus_distance=26.835



=== Log clique consensus distance @ E17B0 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=29.067


[E17B10 |   4224/60000 (  7%) ] Loss: 0.0249 top1= 99.1477

=== Log global consensus distance @ E17B10 ===
consensus_distance=27.494



=== Log clique consensus distance @ E17B10 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=29.728


[E17B20 |   8064/60000 ( 13%) ] Loss: 0.0433 top1= 98.8636

=== Log global consensus distance @ E17B20 ===
consensus_distance=28.046



=== Log clique consensus distance @ E17B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=30.043



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=19.7054 top1= 19.2608


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.9863 top1= 52.9647


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.6908 top1= 46.5645

Train epoch 18
[E18B0  |    384/60000 (  1%) ] Loss: 0.0214 top1= 99.7159

=== Log global consensus distance @ E18B0 ===
consensus_distance=28.694



=== Log clique consensus distance @ E18B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=30.642


[E18B10 |   4224/60000 (  7%) ] Loss: 0.0442 top1= 98.8636

=== Log global consensus distance @ E18B10 ===
consensus_distance=29.441



=== Log clique consensus distance @ E18B10 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=31.522


[E18B20 |   8064/60000 ( 13%) ] Loss: 0.0478 top1= 98.8636

=== Log global consensus distance @ E18B20 ===
consensus_distance=30.009



=== Log clique consensus distance @ E18B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=31.865



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=20.1026 top1= 19.2608


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.8432 top1= 52.6943


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.3605 top1= 45.9235

Train epoch 19
[E19B0  |    384/60000 (  1%) ] Loss: 0.0382 top1= 98.5795

=== Log global consensus distance @ E19B0 ===
consensus_distance=30.660



=== Log clique consensus distance @ E19B0 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=32.434


[E19B10 |   4224/60000 (  7%) ] Loss: 0.0569 top1= 98.2955

=== Log global consensus distance @ E19B10 ===
consensus_distance=31.390



=== Log clique consensus distance @ E19B10 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=33.239


[E19B20 |   8064/60000 ( 13%) ] Loss: 0.0554 top1= 97.7273

=== Log global consensus distance @ E19B20 ===
consensus_distance=32.058



=== Log clique consensus distance @ E19B20 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=33.869



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=22.0394 top1= 19.2808


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.0351 top1= 52.7143


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.1582 top1= 45.8433

Train epoch 20
[E20B0  |    384/60000 (  1%) ] Loss: 0.0619 top1= 97.4432

=== Log global consensus distance @ E20B0 ===
consensus_distance=32.775



=== Log clique consensus distance @ E20B0 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=34.606


[E20B10 |   4224/60000 (  7%) ] Loss: 0.0198 top1= 99.7159

=== Log global consensus distance @ E20B10 ===
consensus_distance=33.415



=== Log clique consensus distance @ E20B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=35.124


[E20B20 |   8064/60000 ( 13%) ] Loss: 0.0164 top1= 99.7159

=== Log global consensus distance @ E20B20 ===
consensus_distance=33.992



=== Log clique consensus distance @ E20B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=35.375



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=24.5072 top1= 19.3009


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.6155 top1= 54.1967


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.4194 top1= 46.7248

Train epoch 21
[E21B0  |    384/60000 (  1%) ] Loss: 0.0192 top1= 99.4318

=== Log global consensus distance @ E21B0 ===
consensus_distance=34.550



=== Log clique consensus distance @ E21B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=35.554


[E21B10 |   4224/60000 (  7%) ] Loss: 0.0466 top1= 98.5795

=== Log global consensus distance @ E21B10 ===
consensus_distance=35.106



=== Log clique consensus distance @ E21B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=35.756


[E21B20 |   8064/60000 ( 13%) ] Loss: 1.4732 top1= 99.1477

=== Log global consensus distance @ E21B20 ===
consensus_distance=36.991



=== Log clique consensus distance @ E21B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=36.190



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=27.6193 top1= 19.3510


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.7804 top1= 54.0164


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=9.0159 top1= 47.4760

Train epoch 22
[E22B0  |    384/60000 (  1%) ] Loss: 1.4264 top1= 99.1477

=== Log global consensus distance @ E22B0 ===
consensus_distance=40.349



=== Log clique consensus distance @ E22B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=36.590


[E22B10 |   4224/60000 (  7%) ] Loss: 0.5366 top1= 99.1477

=== Log global consensus distance @ E22B10 ===
consensus_distance=47.243



=== Log clique consensus distance @ E22B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=36.901


[E22B20 |   8064/60000 ( 13%) ] Loss: 140.8446 top1= 98.0114

=== Log global consensus distance @ E22B20 ===
consensus_distance=196.799



=== Log clique consensus distance @ E22B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=37.142



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.4988 top1= 52.9848


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=9.9626 top1= 47.5060

Train epoch 23
[E23B0  |    384/60000 (  1%) ] Loss: nan top1= 90.6250

=== Log global consensus distance @ E23B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E23B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=37.951


[E23B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.6250

=== Log global consensus distance @ E23B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E23B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=38.722


[E23B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.3409

=== Log global consensus distance @ E23B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E23B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=39.313



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5.3609 top1= 52.0433


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=11.2386 top1= 47.5260

Train epoch 24
[E24B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E24B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E24B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=39.955


[E24B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.6250

=== Log global consensus distance @ E24B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E24B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=40.445


[E24B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.6250

=== Log global consensus distance @ E24B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E24B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=40.697



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5.4926 top1= 52.3137


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=11.4516 top1= 46.9952

Train epoch 25
[E25B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E25B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E25B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=41.034


[E25B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E25B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E25B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=41.095


[E25B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.0568

=== Log global consensus distance @ E25B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E25B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=41.389



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5.6937 top1= 52.3237


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=11.3548 top1= 47.1454

Train epoch 26
[E26B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E26B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E26B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=41.670


[E26B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E26B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E26B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=41.757


[E26B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E26B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E26B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=42.097



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5.8679 top1= 52.2937


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=11.4827 top1= 47.4058

Train epoch 27
[E27B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E27B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E27B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=42.257


[E27B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.6250

=== Log global consensus distance @ E27B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E27B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=42.344


[E27B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.6250

=== Log global consensus distance @ E27B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E27B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=42.490



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5.9955 top1= 52.2436


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=11.2955 top1= 47.9267

Train epoch 28
[E28B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E28B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E28B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=42.625


[E28B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E28B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E28B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=42.641


[E28B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E28B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E28B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=42.668



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.0872 top1= 52.2236


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=11.6695 top1= 47.9467

Train epoch 29
[E29B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E29B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E29B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=42.774


[E29B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E29B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E29B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=42.866


[E29B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E29B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E29B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=42.868



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.1875 top1= 52.2035


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=12.0474 top1= 48.1470

Train epoch 30
[E30B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E30B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E30B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=42.930


[E30B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E30B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E30B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.023


[E30B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E30B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E30B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.069



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.2813 top1= 52.1434


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=12.0610 top1= 47.8065

Train epoch 31
[E31B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E31B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E31B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.104


[E31B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E31B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E31B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.142


[E31B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E31B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E31B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.172



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.3634 top1= 52.1534


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=12.2333 top1= 47.8466

Train epoch 32
[E32B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E32B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E32B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.204


[E32B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E32B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E32B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.241


[E32B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E32B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E32B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.271



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.4390 top1= 52.1234


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=12.3501 top1= 47.8165

Train epoch 33
[E33B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E33B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E33B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.301


[E33B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E33B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E33B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.335


[E33B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E33B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E33B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.362



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.5072 top1= 52.0933


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=12.4525 top1= 47.7764

Train epoch 34
[E34B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E34B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E34B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.390


[E34B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E34B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E34B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.421


[E34B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E34B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E34B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.445



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.5701 top1= 52.0533


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=12.5464 top1= 47.7865

Train epoch 35
[E35B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E35B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E35B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.471


[E35B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E35B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E35B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.500


[E35B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E35B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E35B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.523



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.6287 top1= 52.0032


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=12.6331 top1= 47.7764

Train epoch 36
[E36B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E36B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E36B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.547


[E36B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E36B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E36B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.574


[E36B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E36B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E36B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.595



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.6833 top1= 51.9832


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=12.7135 top1= 47.7564

Train epoch 37
[E37B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E37B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E37B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.618


[E37B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E37B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E37B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.643


[E37B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E37B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E37B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.664



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.7346 top1= 51.9331


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=12.7885 top1= 47.7264

Train epoch 38
[E38B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E38B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E38B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.685


[E38B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E38B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E38B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.709


[E38B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E38B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E38B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.728



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.7832 top1= 51.8630


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=12.8591 top1= 47.6863

Train epoch 39
[E39B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E39B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E39B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.749


[E39B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E39B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E39B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.771


[E39B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E39B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E39B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.789



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.8275 top1= 51.8429


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=12.9256 top1= 47.6763

Train epoch 40
[E40B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E40B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E40B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.809


[E40B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E40B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E40B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.830


[E40B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E40B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E40B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.847



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.8719 top1= 51.8129


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=12.9889 top1= 47.6462

Train epoch 41
[E41B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E41B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E41B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.866


[E41B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E41B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E41B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.886


[E41B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E41B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E41B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.902



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.9124 top1= 51.7929


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=13.0493 top1= 47.6262

Train epoch 42
[E42B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E42B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E42B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.920


[E42B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E42B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E42B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.939


[E42B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E42B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E42B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.955



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.9519 top1= 51.7228


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=13.1071 top1= 47.6162

Train epoch 43
[E43B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E43B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E43B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.972


[E43B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E43B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E43B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=43.990


[E43B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E43B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E43B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.005



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.9895 top1= 51.7127


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=13.1622 top1= 47.6062

Train epoch 44
[E44B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E44B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E44B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.021


[E44B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E44B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E44B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.039


[E44B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E44B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E44B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.053



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=7.0260 top1= 51.6927


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=13.2149 top1= 47.5761

Train epoch 45
[E45B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E45B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E45B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.069


[E45B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E45B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E45B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.085


[E45B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E45B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E45B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.099



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=7.0605 top1= 51.6526


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=13.2659 top1= 47.5761

Train epoch 46
[E46B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E46B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E46B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.114


[E46B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E46B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E46B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.130


[E46B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E46B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E46B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.144



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=7.0936 top1= 51.6627


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=13.3148 top1= 47.5761

Train epoch 47
[E47B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E47B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E47B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.158


[E47B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E47B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E47B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.174


[E47B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E47B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E47B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.186



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=7.1261 top1= 51.6727


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=13.3618 top1= 47.5761

Train epoch 48
[E48B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E48B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E48B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.200


[E48B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E48B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E48B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.215


[E48B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E48B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E48B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.228



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=7.1565 top1= 51.6727


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=13.4073 top1= 47.5661

Train epoch 49
[E49B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E49B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E49B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.241


[E49B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E49B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E49B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.256


[E49B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E49B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E49B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.268



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=7.1865 top1= 51.6426


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=13.4511 top1= 47.5561

Train epoch 50
[E50B0  |    384/60000 (  1%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E50B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E50B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.281


[E50B10 |   4224/60000 (  7%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E50B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E50B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.295


[E50B20 |   8064/60000 ( 13%) ] Loss: nan top1= 90.9091

=== Log global consensus distance @ E50B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E50B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=44.306



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=7.2156 top1= 51.6326


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=13.4937 top1= 47.5461

