
=== Start adding workers ===
=> Add worker SGDMWorker(index=0, momentum=0.9)
=> Add worker SGDMWorker(index=1, momentum=0.9)
=> Add worker SGDMWorker(index=2, momentum=0.9)
=> Add worker SGDMWorker(index=3, momentum=0.9)
=> Add worker SGDMWorker(index=4, momentum=0.9)
=> Add worker SGDMWorker(index=5, momentum=0.9)
=> Add worker SGDMWorker(index=6, momentum=0.9)
=> Add worker SGDMWorker(index=7, momentum=0.9)
=> Add worker SGDMWorker(index=8, momentum=0.9)
=> Add worker SGDMWorker(index=9, momentum=0.9)
=> Add worker SGDMWorker(index=10, momentum=0.9)
=> Add worker ByzantineWorker(index=11)

=== Start adding graph ===
TwoCliquesWithByzantine(m=5,b=1)

Train epoch 1
[E 1B0  |    384/60000 (  1%) ] Loss: 2.3142 top1=  7.6705

=== Peeking data label distribution E1B0 ===
Worker 0 has targets: tensor([0, 0, 0, 0, 0], device='cuda:0')
Worker 1 has targets: tensor([1, 1, 1, 0, 1], device='cuda:0')
Worker 2 has targets: tensor([1, 1, 2, 1, 1], device='cuda:0')
Worker 3 has targets: tensor([2, 2, 3, 2, 2], device='cuda:0')
Worker 4 has targets: tensor([3, 3, 3, 3, 3], device='cuda:0')
Worker 5 has targets: tensor([4, 4, 4, 4, 4], device='cuda:0')
Worker 6 has targets: tensor([5, 5, 5, 5, 5], device='cuda:0')
Worker 7 has targets: tensor([6, 6, 6, 5, 6], device='cuda:0')
Worker 8 has targets: tensor([6, 7, 7, 6, 6], device='cuda:0')
Worker 9 has targets: tensor([7, 7, 8, 7, 7], device='cuda:0')
Worker 10 has targets: tensor([8, 8, 9, 8, 8], device='cuda:0')
Worker 11 has targets: tensor([9, 9, 9, 9, 9], device='cuda:0')



=== Log global consensus distance @ E1B0 ===
consensus_distance=0.000



=== Log clique consensus distance @ E1B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.000


[E 1B10 |   4224/60000 (  7%) ] Loss: 1.9616 top1= 42.6136

=== Log global consensus distance @ E1B10 ===
consensus_distance=0.030



=== Log clique consensus distance @ E1B10 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=0.033


[E 1B20 |   8064/60000 ( 13%) ] Loss: 1.7733 top1= 32.6705

=== Log global consensus distance @ E1B20 ===
consensus_distance=0.098



=== Log clique consensus distance @ E1B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.170



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.3211 top1=  9.7456


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.5896 top1= 35.5268


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.4904 top1= 37.0793

Train epoch 2
[E 2B0  |    384/60000 (  1%) ] Loss: 1.3516 top1= 57.1023

=== Log global consensus distance @ E2B0 ===
consensus_distance=0.155



=== Log clique consensus distance @ E2B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.417


[E 2B10 |   4224/60000 (  7%) ] Loss: 1.0671 top1= 68.1818

=== Log global consensus distance @ E2B10 ===
consensus_distance=0.203



=== Log clique consensus distance @ E2B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.632


[E 2B20 |   8064/60000 ( 13%) ] Loss: 0.9433 top1= 72.1591

=== Log global consensus distance @ E2B20 ===
consensus_distance=0.232



=== Log clique consensus distance @ E2B20 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=0.758



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.8762 top1= 16.1358


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.8672 top1= 39.2829


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.9666 top1= 37.6703

Train epoch 3
[E 3B0  |    384/60000 (  1%) ] Loss: 0.7729 top1= 80.3977

=== Log global consensus distance @ E3B0 ===
consensus_distance=0.258



=== Log clique consensus distance @ E3B0 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=0.874


[E 3B10 |   4224/60000 (  7%) ] Loss: 0.6849 top1= 85.5114

=== Log global consensus distance @ E3B10 ===
consensus_distance=0.276



=== Log clique consensus distance @ E3B10 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=0.955


[E 3B20 |   8064/60000 ( 13%) ] Loss: 0.6742 top1= 84.0909

=== Log global consensus distance @ E3B20 ===
consensus_distance=0.288



=== Log clique consensus distance @ E3B20 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.009



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.3740 top1= 18.6899


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.9052 top1= 43.9904


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.1878 top1= 39.4732

Train epoch 4
[E 4B0  |    384/60000 (  1%) ] Loss: 0.5427 top1= 88.9205

=== Log global consensus distance @ E4B0 ===
consensus_distance=0.298



=== Log clique consensus distance @ E4B0 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.056


[E 4B10 |   4224/60000 (  7%) ] Loss: 0.5471 top1= 88.6364

=== Log global consensus distance @ E4B10 ===
consensus_distance=0.302



=== Log clique consensus distance @ E4B10 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.073


[E 4B20 |   8064/60000 ( 13%) ] Loss: 0.5752 top1= 86.3636

=== Log global consensus distance @ E4B20 ===
consensus_distance=0.306



=== Log clique consensus distance @ E4B20 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.093



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.8067 top1= 19.0304


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.9551 top1= 46.9852


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.3569 top1= 40.4447

Train epoch 5
[E 5B0  |    384/60000 (  1%) ] Loss: 0.4754 top1= 91.4773

=== Log global consensus distance @ E5B0 ===
consensus_distance=0.312



=== Log clique consensus distance @ E5B0 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.121


[E 5B10 |   4224/60000 (  7%) ] Loss: 0.5003 top1= 88.0682

=== Log global consensus distance @ E5B10 ===
consensus_distance=0.313



=== Log clique consensus distance @ E5B10 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.126


[E 5B20 |   8064/60000 ( 13%) ] Loss: 0.5398 top1= 86.9318

=== Log global consensus distance @ E5B20 ===
consensus_distance=0.316



=== Log clique consensus distance @ E5B20 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.141



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.1732 top1= 19.1206


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.9773 top1= 47.6562


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.4558 top1= 40.7853

Train epoch 6
[E 6B0  |    384/60000 (  1%) ] Loss: 0.4517 top1= 91.1932

=== Log global consensus distance @ E6B0 ===
consensus_distance=0.322



=== Log clique consensus distance @ E6B0 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.165


[E 6B10 |   4224/60000 (  7%) ] Loss: 0.4819 top1= 88.0682

=== Log global consensus distance @ E6B10 ===
consensus_distance=0.322



=== Log clique consensus distance @ E6B10 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.168


[E 6B20 |   8064/60000 ( 13%) ] Loss: 0.5240 top1= 87.2159

=== Log global consensus distance @ E6B20 ===
consensus_distance=0.326



=== Log clique consensus distance @ E6B20 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.182



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.4400 top1= 19.1406


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.9282 top1= 47.8666


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.4803 top1= 40.8454

Train epoch 7
[E 7B0  |    384/60000 (  1%) ] Loss: 0.4414 top1= 90.9091

=== Log global consensus distance @ E7B0 ===
consensus_distance=0.331



=== Log clique consensus distance @ E7B0 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.206


[E 7B10 |   4224/60000 (  7%) ] Loss: 0.4722 top1= 87.5000

=== Log global consensus distance @ E7B10 ===
consensus_distance=0.331



=== Log clique consensus distance @ E7B10 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.207


[E 7B20 |   8064/60000 ( 13%) ] Loss: 0.5184 top1= 87.5000

=== Log global consensus distance @ E7B20 ===
consensus_distance=0.334



=== Log clique consensus distance @ E7B20 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.219



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.6390 top1= 19.1907


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.8116 top1= 47.9868


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.4396 top1= 40.8053

Train epoch 8
[E 8B0  |    384/60000 (  1%) ] Loss: 0.4374 top1= 91.4773

=== Log global consensus distance @ E8B0 ===
consensus_distance=0.338



=== Log clique consensus distance @ E8B0 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.237


[E 8B10 |   4224/60000 (  7%) ] Loss: 0.4676 top1= 86.9318

=== Log global consensus distance @ E8B10 ===
consensus_distance=0.337



=== Log clique consensus distance @ E8B10 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.233


[E 8B20 |   8064/60000 ( 13%) ] Loss: 0.5187 top1= 87.2159

=== Log global consensus distance @ E8B20 ===
consensus_distance=0.339



=== Log clique consensus distance @ E8B20 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.242



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.7868 top1= 19.2208


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.6554 top1= 48.3173


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.3462 top1= 40.8353

Train epoch 9
[E 9B0  |    384/60000 (  1%) ] Loss: 0.4385 top1= 91.4773

=== Log global consensus distance @ E9B0 ===
consensus_distance=0.341



=== Log clique consensus distance @ E9B0 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.254


[E 9B10 |   4224/60000 (  7%) ] Loss: 0.4662 top1= 88.0682

=== Log global consensus distance @ E9B10 ===
consensus_distance=0.339



=== Log clique consensus distance @ E9B10 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.243


[E 9B20 |   8064/60000 ( 13%) ] Loss: 0.5218 top1= 87.2159

=== Log global consensus distance @ E9B20 ===
consensus_distance=0.340



=== Log clique consensus distance @ E9B20 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.245



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.9211 top1= 19.2308


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.5198 top1= 48.5677


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.2134 top1= 40.7853

Train epoch 10
[E10B0  |    384/60000 (  1%) ] Loss: 0.4441 top1= 91.4773

=== Log global consensus distance @ E10B0 ===
consensus_distance=0.340



=== Log clique consensus distance @ E10B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=1.248


[E10B10 |   4224/60000 (  7%) ] Loss: 0.4675 top1= 88.0682

=== Log global consensus distance @ E10B10 ===
consensus_distance=0.336



=== Log clique consensus distance @ E10B10 ===
clique1_consensus_distance=0.005
clique2_consensus_distance=1.231


[E10B20 |   8064/60000 ( 13%) ] Loss: 0.5238 top1= 87.7841

=== Log global consensus distance @ E10B20 ===
consensus_distance=0.335



=== Log clique consensus distance @ E10B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=1.225



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.0284 top1= 19.2708


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.4348 top1= 48.5377


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.0623 top1= 40.8954

Train epoch 11
[E11B0  |    384/60000 (  1%) ] Loss: 0.4480 top1= 92.0455

=== Log global consensus distance @ E11B0 ===
consensus_distance=0.333



=== Log clique consensus distance @ E11B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=1.218


[E11B10 |   4224/60000 (  7%) ] Loss: 0.4665 top1= 88.9205

=== Log global consensus distance @ E11B10 ===
consensus_distance=0.328



=== Log clique consensus distance @ E11B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=1.194


[E11B20 |   8064/60000 ( 13%) ] Loss: 0.5191 top1= 88.3523

=== Log global consensus distance @ E11B20 ===
consensus_distance=0.324



=== Log clique consensus distance @ E11B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=1.179



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.1012 top1= 19.2808


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.3786 top1= 48.3574


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.9073 top1= 40.9155

Train epoch 12
[E12B0  |    384/60000 (  1%) ] Loss: 0.4476 top1= 92.6136

=== Log global consensus distance @ E12B0 ===
consensus_distance=0.320



=== Log clique consensus distance @ E12B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=1.164


[E12B10 |   4224/60000 (  7%) ] Loss: 0.4632 top1= 89.4886

=== Log global consensus distance @ E12B10 ===
consensus_distance=0.314



=== Log clique consensus distance @ E12B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=1.137


[E12B20 |   8064/60000 ( 13%) ] Loss: 0.5137 top1= 88.6364

=== Log global consensus distance @ E12B20 ===
consensus_distance=0.311



=== Log clique consensus distance @ E12B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=1.121



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.2023 top1= 19.2909


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.3398 top1= 48.0569


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.8164 top1= 40.9255

Train epoch 13
[E13B0  |    384/60000 (  1%) ] Loss: 0.4475 top1= 92.3295

=== Log global consensus distance @ E13B0 ===
consensus_distance=0.307



=== Log clique consensus distance @ E13B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=1.108


[E13B10 |   4224/60000 (  7%) ] Loss: 0.4630 top1= 91.4773

=== Log global consensus distance @ E13B10 ===
consensus_distance=0.302



=== Log clique consensus distance @ E13B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=1.085


[E13B20 |   8064/60000 ( 13%) ] Loss: 0.5130 top1= 87.7841

=== Log global consensus distance @ E13B20 ===
consensus_distance=0.300



=== Log clique consensus distance @ E13B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=1.074



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.3306 top1= 19.2909


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.3221 top1= 47.8265


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7771 top1= 40.8754

Train epoch 14
[E14B0  |    384/60000 (  1%) ] Loss: 0.4459 top1= 92.3295

=== Log global consensus distance @ E14B0 ===
consensus_distance=0.297



=== Log clique consensus distance @ E14B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=1.066


[E14B10 |   4224/60000 (  7%) ] Loss: 0.4621 top1= 91.7614

=== Log global consensus distance @ E14B10 ===
consensus_distance=0.294



=== Log clique consensus distance @ E14B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=1.049


[E14B20 |   8064/60000 ( 13%) ] Loss: 0.5112 top1= 89.2045

=== Log global consensus distance @ E14B20 ===
consensus_distance=0.292



=== Log clique consensus distance @ E14B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=1.042



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.4499 top1= 19.2909


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.3047 top1= 47.6262


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7667 top1= 40.8454

Train epoch 15
[E15B0  |    384/60000 (  1%) ] Loss: 0.4433 top1= 92.0455

=== Log global consensus distance @ E15B0 ===
consensus_distance=0.290



=== Log clique consensus distance @ E15B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=1.036


[E15B10 |   4224/60000 (  7%) ] Loss: 0.4617 top1= 91.1932

=== Log global consensus distance @ E15B10 ===
consensus_distance=0.287



=== Log clique consensus distance @ E15B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=1.021


[E15B20 |   8064/60000 ( 13%) ] Loss: 0.5088 top1= 89.7727

=== Log global consensus distance @ E15B20 ===
consensus_distance=0.286



=== Log clique consensus distance @ E15B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=1.016



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.5724 top1= 19.2909


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2908 top1= 47.6062


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7615 top1= 40.8954

Train epoch 16
[E16B0  |    384/60000 (  1%) ] Loss: 0.4396 top1= 92.3295

=== Log global consensus distance @ E16B0 ===
consensus_distance=0.285



=== Log clique consensus distance @ E16B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=1.012


[E16B10 |   4224/60000 (  7%) ] Loss: 0.4605 top1= 91.1932

=== Log global consensus distance @ E16B10 ===
consensus_distance=0.282



=== Log clique consensus distance @ E16B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.998


[E16B20 |   8064/60000 ( 13%) ] Loss: 0.5044 top1= 90.0568

=== Log global consensus distance @ E16B20 ===
consensus_distance=0.281



=== Log clique consensus distance @ E16B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.994



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.6867 top1= 19.2808


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2767 top1= 47.7564


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7580 top1= 41.0357

Train epoch 17
[E17B0  |    384/60000 (  1%) ] Loss: 0.4359 top1= 92.8977

=== Log global consensus distance @ E17B0 ===
consensus_distance=0.280



=== Log clique consensus distance @ E17B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.990


[E17B10 |   4224/60000 (  7%) ] Loss: 0.4581 top1= 90.9091

=== Log global consensus distance @ E17B10 ===
consensus_distance=0.277



=== Log clique consensus distance @ E17B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.977


[E17B20 |   8064/60000 ( 13%) ] Loss: 0.5002 top1= 89.4886

=== Log global consensus distance @ E17B20 ===
consensus_distance=0.276



=== Log clique consensus distance @ E17B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.975



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.7897 top1= 19.2808


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2645 top1= 47.8466


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7534 top1= 41.1258

Train epoch 18
[E18B0  |    384/60000 (  1%) ] Loss: 0.4323 top1= 92.8977

=== Log global consensus distance @ E18B0 ===
consensus_distance=0.275



=== Log clique consensus distance @ E18B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.972


[E18B10 |   4224/60000 (  7%) ] Loss: 0.4555 top1= 90.9091

=== Log global consensus distance @ E18B10 ===
consensus_distance=0.273



=== Log clique consensus distance @ E18B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.960


[E18B20 |   8064/60000 ( 13%) ] Loss: 0.4985 top1= 89.2045

=== Log global consensus distance @ E18B20 ===
consensus_distance=0.273



=== Log clique consensus distance @ E18B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.959



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.8670 top1= 19.2708


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2539 top1= 47.8866


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7509 top1= 41.1859

Train epoch 19
[E19B0  |    384/60000 (  1%) ] Loss: 0.4302 top1= 92.6136

=== Log global consensus distance @ E19B0 ===
consensus_distance=0.272



=== Log clique consensus distance @ E19B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.958


[E19B10 |   4224/60000 (  7%) ] Loss: 0.4535 top1= 91.1932

=== Log global consensus distance @ E19B10 ===
consensus_distance=0.271



=== Log clique consensus distance @ E19B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.948


[E19B20 |   8064/60000 ( 13%) ] Loss: 0.4958 top1= 88.6364

=== Log global consensus distance @ E19B20 ===
consensus_distance=0.271



=== Log clique consensus distance @ E19B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.949



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.9382 top1= 19.2708


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2458 top1= 47.9667


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7462 top1= 41.2760

Train epoch 20
[E20B0  |    384/60000 (  1%) ] Loss: 0.4288 top1= 92.8977

=== Log global consensus distance @ E20B0 ===
consensus_distance=0.270



=== Log clique consensus distance @ E20B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.948


[E20B10 |   4224/60000 (  7%) ] Loss: 0.4507 top1= 90.6250

=== Log global consensus distance @ E20B10 ===
consensus_distance=0.269



=== Log clique consensus distance @ E20B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.939


[E20B20 |   8064/60000 ( 13%) ] Loss: 0.4936 top1= 88.9205

=== Log global consensus distance @ E20B20 ===
consensus_distance=0.268



=== Log clique consensus distance @ E20B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.939



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.9900 top1= 19.2608


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2402 top1= 48.0769


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7410 top1= 41.3662

Train epoch 21
[E21B0  |    384/60000 (  1%) ] Loss: 0.4265 top1= 93.1818

=== Log global consensus distance @ E21B0 ===
consensus_distance=0.268



=== Log clique consensus distance @ E21B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.939


[E21B10 |   4224/60000 (  7%) ] Loss: 0.4475 top1= 90.6250

=== Log global consensus distance @ E21B10 ===
consensus_distance=0.267



=== Log clique consensus distance @ E21B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.930


[E21B20 |   8064/60000 ( 13%) ] Loss: 0.4905 top1= 88.9205

=== Log global consensus distance @ E21B20 ===
consensus_distance=0.267



=== Log clique consensus distance @ E21B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.931



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.0378 top1= 19.2708


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2347 top1= 48.0569


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7375 top1= 41.4263

Train epoch 22
[E22B0  |    384/60000 (  1%) ] Loss: 0.4241 top1= 93.1818

=== Log global consensus distance @ E22B0 ===
consensus_distance=0.266



=== Log clique consensus distance @ E22B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.931


[E22B10 |   4224/60000 (  7%) ] Loss: 0.4436 top1= 90.9091

=== Log global consensus distance @ E22B10 ===
consensus_distance=0.265



=== Log clique consensus distance @ E22B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.923


[E22B20 |   8064/60000 ( 13%) ] Loss: 0.4877 top1= 88.9205

=== Log global consensus distance @ E22B20 ===
consensus_distance=0.265



=== Log clique consensus distance @ E22B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.923



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.0814 top1= 19.2608


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2298 top1= 48.1070


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7361 top1= 41.3962

Train epoch 23
[E23B0  |    384/60000 (  1%) ] Loss: 0.4223 top1= 93.4659

=== Log global consensus distance @ E23B0 ===
consensus_distance=0.265



=== Log clique consensus distance @ E23B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.924


[E23B10 |   4224/60000 (  7%) ] Loss: 0.4407 top1= 90.9091

=== Log global consensus distance @ E23B10 ===
consensus_distance=0.264



=== Log clique consensus distance @ E23B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.916


[E23B20 |   8064/60000 ( 13%) ] Loss: 0.4849 top1= 89.2045

=== Log global consensus distance @ E23B20 ===
consensus_distance=0.264



=== Log clique consensus distance @ E23B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.918



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.1258 top1= 19.2708


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2259 top1= 48.1170


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7372 top1= 41.3962

Train epoch 24
[E24B0  |    384/60000 (  1%) ] Loss: 0.4207 top1= 93.4659

=== Log global consensus distance @ E24B0 ===
consensus_distance=0.264



=== Log clique consensus distance @ E24B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.919


[E24B10 |   4224/60000 (  7%) ] Loss: 0.4379 top1= 90.9091

=== Log global consensus distance @ E24B10 ===
consensus_distance=0.263



=== Log clique consensus distance @ E24B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.912


[E24B20 |   8064/60000 ( 13%) ] Loss: 0.4830 top1= 89.4886

=== Log global consensus distance @ E24B20 ===
consensus_distance=0.263



=== Log clique consensus distance @ E24B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.914



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.1677 top1= 19.2708


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2234 top1= 48.1470


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7395 top1= 41.3962

Train epoch 25
[E25B0  |    384/60000 (  1%) ] Loss: 0.4195 top1= 93.4659

=== Log global consensus distance @ E25B0 ===
consensus_distance=0.263



=== Log clique consensus distance @ E25B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.916


[E25B10 |   4224/60000 (  7%) ] Loss: 0.4350 top1= 90.6250

=== Log global consensus distance @ E25B10 ===
consensus_distance=0.262



=== Log clique consensus distance @ E25B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.909


[E25B20 |   8064/60000 ( 13%) ] Loss: 0.4815 top1= 89.4886

=== Log global consensus distance @ E25B20 ===
consensus_distance=0.262



=== Log clique consensus distance @ E25B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.910



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.2026 top1= 19.2708


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2215 top1= 48.1871


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7440 top1= 41.3562

Train epoch 26
[E26B0  |    384/60000 (  1%) ] Loss: 0.4181 top1= 93.4659

=== Log global consensus distance @ E26B0 ===
consensus_distance=0.262



=== Log clique consensus distance @ E26B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.912


[E26B10 |   4224/60000 (  7%) ] Loss: 0.4331 top1= 90.6250

=== Log global consensus distance @ E26B10 ===
consensus_distance=0.261



=== Log clique consensus distance @ E26B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.906


[E26B20 |   8064/60000 ( 13%) ] Loss: 0.4803 top1= 89.4886

=== Log global consensus distance @ E26B20 ===
consensus_distance=0.261



=== Log clique consensus distance @ E26B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.908



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.2386 top1= 19.2608


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2194 top1= 48.2171


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7490 top1= 41.3462

Train epoch 27
[E27B0  |    384/60000 (  1%) ] Loss: 0.4163 top1= 92.8977

=== Log global consensus distance @ E27B0 ===
consensus_distance=0.262



=== Log clique consensus distance @ E27B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.910


[E27B10 |   4224/60000 (  7%) ] Loss: 0.4320 top1= 90.6250

=== Log global consensus distance @ E27B10 ===
consensus_distance=0.261



=== Log clique consensus distance @ E27B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.903


[E27B20 |   8064/60000 ( 13%) ] Loss: 0.4790 top1= 89.7727

=== Log global consensus distance @ E27B20 ===
consensus_distance=0.261



=== Log clique consensus distance @ E27B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.905



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.2780 top1= 19.2608


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2169 top1= 48.2372


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7493 top1= 41.2861

Train epoch 28
[E28B0  |    384/60000 (  1%) ] Loss: 0.4151 top1= 92.8977

=== Log global consensus distance @ E28B0 ===
consensus_distance=0.261



=== Log clique consensus distance @ E28B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.907


[E28B10 |   4224/60000 (  7%) ] Loss: 0.4303 top1= 90.6250

=== Log global consensus distance @ E28B10 ===
consensus_distance=0.260



=== Log clique consensus distance @ E28B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.901


[E28B20 |   8064/60000 ( 13%) ] Loss: 0.4774 top1= 89.4886

=== Log global consensus distance @ E28B20 ===
consensus_distance=0.261



=== Log clique consensus distance @ E28B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.904



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.3131 top1= 19.2608


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2154 top1= 48.1971


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7541 top1= 41.2660

Train epoch 29
[E29B0  |    384/60000 (  1%) ] Loss: 0.4132 top1= 92.8977

=== Log global consensus distance @ E29B0 ===
consensus_distance=0.261



=== Log clique consensus distance @ E29B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.906


[E29B10 |   4224/60000 (  7%) ] Loss: 0.4292 top1= 90.6250

=== Log global consensus distance @ E29B10 ===
consensus_distance=0.260



=== Log clique consensus distance @ E29B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.899


[E29B20 |   8064/60000 ( 13%) ] Loss: 0.4754 top1= 89.4886

=== Log global consensus distance @ E29B20 ===
consensus_distance=0.260



=== Log clique consensus distance @ E29B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.902



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.3510 top1= 19.2608


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2155 top1= 48.2071


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7573 top1= 41.2961

Train epoch 30
[E30B0  |    384/60000 (  1%) ] Loss: 0.4118 top1= 92.8977

=== Log global consensus distance @ E30B0 ===
consensus_distance=0.260



=== Log clique consensus distance @ E30B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.905


[E30B10 |   4224/60000 (  7%) ] Loss: 0.4275 top1= 90.6250

=== Log global consensus distance @ E30B10 ===
consensus_distance=0.260



=== Log clique consensus distance @ E30B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.899


[E30B20 |   8064/60000 ( 13%) ] Loss: 0.4742 top1= 89.4886

=== Log global consensus distance @ E30B20 ===
consensus_distance=0.260



=== Log clique consensus distance @ E30B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.901



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.3823 top1= 19.2608


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2161 top1= 48.2372


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7623 top1= 41.3061

Train epoch 31
[E31B0  |    384/60000 (  1%) ] Loss: 0.4103 top1= 92.8977

=== Log global consensus distance @ E31B0 ===
consensus_distance=0.260



=== Log clique consensus distance @ E31B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.904


[E31B10 |   4224/60000 (  7%) ] Loss: 0.4261 top1= 90.6250

=== Log global consensus distance @ E31B10 ===
consensus_distance=0.259



=== Log clique consensus distance @ E31B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.897


[E31B20 |   8064/60000 ( 13%) ] Loss: 0.4727 top1= 89.4886

=== Log global consensus distance @ E31B20 ===
consensus_distance=0.260



=== Log clique consensus distance @ E31B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.900



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.4136 top1= 19.2508


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2164 top1= 48.2873


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7670 top1= 41.2760

Train epoch 32
[E32B0  |    384/60000 (  1%) ] Loss: 0.4090 top1= 92.8977

=== Log global consensus distance @ E32B0 ===
consensus_distance=0.260



=== Log clique consensus distance @ E32B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.903


[E32B10 |   4224/60000 (  7%) ] Loss: 0.4246 top1= 90.6250

=== Log global consensus distance @ E32B10 ===
consensus_distance=0.259



=== Log clique consensus distance @ E32B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.896


[E32B20 |   8064/60000 ( 13%) ] Loss: 0.4716 top1= 89.4886

=== Log global consensus distance @ E32B20 ===
consensus_distance=0.259



=== Log clique consensus distance @ E32B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.899



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.4444 top1= 19.2508


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2181 top1= 48.2873


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7722 top1= 41.2961

Train epoch 33
[E33B0  |    384/60000 (  1%) ] Loss: 0.4079 top1= 92.8977

=== Log global consensus distance @ E33B0 ===
consensus_distance=0.260



=== Log clique consensus distance @ E33B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.902


[E33B10 |   4224/60000 (  7%) ] Loss: 0.4232 top1= 90.6250

=== Log global consensus distance @ E33B10 ===
consensus_distance=0.259



=== Log clique consensus distance @ E33B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.895


[E33B20 |   8064/60000 ( 13%) ] Loss: 0.4704 top1= 89.4886

=== Log global consensus distance @ E33B20 ===
consensus_distance=0.259



=== Log clique consensus distance @ E33B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.897



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.4708 top1= 19.2508


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2198 top1= 48.2572


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7771 top1= 41.3061

Train epoch 34
[E34B0  |    384/60000 (  1%) ] Loss: 0.4071 top1= 92.6136

=== Log global consensus distance @ E34B0 ===
consensus_distance=0.259



=== Log clique consensus distance @ E34B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.900


[E34B10 |   4224/60000 (  7%) ] Loss: 0.4220 top1= 90.9091

=== Log global consensus distance @ E34B10 ===
consensus_distance=0.259



=== Log clique consensus distance @ E34B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.894


[E34B20 |   8064/60000 ( 13%) ] Loss: 0.4692 top1= 89.7727

=== Log global consensus distance @ E34B20 ===
consensus_distance=0.259



=== Log clique consensus distance @ E34B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.896



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.4934 top1= 19.2408


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2244 top1= 48.2472


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7813 top1= 41.3161

Train epoch 35
[E35B0  |    384/60000 (  1%) ] Loss: 0.4062 top1= 92.3295

=== Log global consensus distance @ E35B0 ===
consensus_distance=0.259



=== Log clique consensus distance @ E35B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.899


[E35B10 |   4224/60000 (  7%) ] Loss: 0.4210 top1= 91.1932

=== Log global consensus distance @ E35B10 ===
consensus_distance=0.258



=== Log clique consensus distance @ E35B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.892


[E35B20 |   8064/60000 ( 13%) ] Loss: 0.4674 top1= 89.7727

=== Log global consensus distance @ E35B20 ===
consensus_distance=0.259



=== Log clique consensus distance @ E35B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.895



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.5191 top1= 19.2408


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2278 top1= 48.2372


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7860 top1= 41.3161

Train epoch 36
[E36B0  |    384/60000 (  1%) ] Loss: 0.4052 top1= 92.3295

=== Log global consensus distance @ E36B0 ===
consensus_distance=0.259



=== Log clique consensus distance @ E36B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.898


[E36B10 |   4224/60000 (  7%) ] Loss: 0.4201 top1= 91.1932

=== Log global consensus distance @ E36B10 ===
consensus_distance=0.258



=== Log clique consensus distance @ E36B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.891


[E36B20 |   8064/60000 ( 13%) ] Loss: 0.4665 top1= 89.7727

=== Log global consensus distance @ E36B20 ===
consensus_distance=0.258



=== Log clique consensus distance @ E36B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.893



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.5431 top1= 19.2408


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2295 top1= 48.2071


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7895 top1= 41.3361

Train epoch 37
[E37B0  |    384/60000 (  1%) ] Loss: 0.4042 top1= 92.3295

=== Log global consensus distance @ E37B0 ===
consensus_distance=0.258



=== Log clique consensus distance @ E37B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.896


[E37B10 |   4224/60000 (  7%) ] Loss: 0.4196 top1= 91.1932

=== Log global consensus distance @ E37B10 ===
consensus_distance=0.257



=== Log clique consensus distance @ E37B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.889


[E37B20 |   8064/60000 ( 13%) ] Loss: 0.4652 top1= 89.7727

=== Log global consensus distance @ E37B20 ===
consensus_distance=0.258



=== Log clique consensus distance @ E37B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.892



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.5696 top1= 19.2408


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2307 top1= 48.2272


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7949 top1= 41.3361

Train epoch 38
[E38B0  |    384/60000 (  1%) ] Loss: 0.4032 top1= 92.3295

=== Log global consensus distance @ E38B0 ===
consensus_distance=0.258



=== Log clique consensus distance @ E38B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.895


[E38B10 |   4224/60000 (  7%) ] Loss: 0.4183 top1= 91.1932

=== Log global consensus distance @ E38B10 ===
consensus_distance=0.257



=== Log clique consensus distance @ E38B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.888


[E38B20 |   8064/60000 ( 13%) ] Loss: 0.4646 top1= 89.7727

=== Log global consensus distance @ E38B20 ===
consensus_distance=0.257



=== Log clique consensus distance @ E38B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.890



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.5910 top1= 19.2508


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2327 top1= 48.2472


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7995 top1= 41.3261

Train epoch 39
[E39B0  |    384/60000 (  1%) ] Loss: 0.4021 top1= 92.6136

=== Log global consensus distance @ E39B0 ===
consensus_distance=0.258



=== Log clique consensus distance @ E39B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.893


[E39B10 |   4224/60000 (  7%) ] Loss: 0.4175 top1= 91.4773

=== Log global consensus distance @ E39B10 ===
consensus_distance=0.257



=== Log clique consensus distance @ E39B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.886


[E39B20 |   8064/60000 ( 13%) ] Loss: 0.4632 top1= 89.7727

=== Log global consensus distance @ E39B20 ===
consensus_distance=0.257



=== Log clique consensus distance @ E39B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.888



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.6134 top1= 19.2508


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2348 top1= 48.2772


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.8036 top1= 41.3361

Train epoch 40
[E40B0  |    384/60000 (  1%) ] Loss: 0.4013 top1= 92.3295

=== Log global consensus distance @ E40B0 ===
consensus_distance=0.257



=== Log clique consensus distance @ E40B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.891


[E40B10 |   4224/60000 (  7%) ] Loss: 0.4166 top1= 91.7614

=== Log global consensus distance @ E40B10 ===
consensus_distance=0.256



=== Log clique consensus distance @ E40B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.884


[E40B20 |   8064/60000 ( 13%) ] Loss: 0.4625 top1= 89.7727

=== Log global consensus distance @ E40B20 ===
consensus_distance=0.257



=== Log clique consensus distance @ E40B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=0.886



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.6320 top1= 19.2508


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2372 top1= 48.3073


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.8093 top1= 41.2961

