
=== Start adding workers ===
=> Add worker SGDMWorker(index=0, momentum=0.9)
=> Add worker SGDMWorker(index=1, momentum=0.9)
=> Add worker SGDMWorker(index=2, momentum=0.9)
=> Add worker SGDMWorker(index=3, momentum=0.9)
=> Add worker SGDMWorker(index=4, momentum=0.9)
=> Add worker SGDMWorker(index=5, momentum=0.9)
=> Add worker SGDMWorker(index=6, momentum=0.9)
=> Add worker SGDMWorker(index=7, momentum=0.9)
=> Add worker SGDMWorker(index=8, momentum=0.9)
=> Add worker SGDMWorker(index=9, momentum=0.9)
=> Add worker SGDMWorker(index=10, momentum=0.9)
=> Add worker ByzantineWorker(index=11)

=== Start adding graph ===
TwoCliquesWithByzantine(m=5,b=1)

Train epoch 1
[E 1B0  |    384/60000 (  1%) ] Loss: 2.3142 top1=  7.6705

=== Peeking data label distribution E1B0 ===
Worker 0 has targets: tensor([0, 0, 0, 0, 0], device='cuda:0')
Worker 1 has targets: tensor([1, 1, 1, 0, 1], device='cuda:0')
Worker 2 has targets: tensor([1, 1, 2, 1, 1], device='cuda:0')
Worker 3 has targets: tensor([2, 2, 3, 2, 2], device='cuda:0')
Worker 4 has targets: tensor([3, 3, 3, 3, 3], device='cuda:0')
Worker 5 has targets: tensor([4, 4, 4, 4, 4], device='cuda:0')
Worker 6 has targets: tensor([5, 5, 5, 5, 5], device='cuda:0')
Worker 7 has targets: tensor([6, 6, 6, 5, 6], device='cuda:0')
Worker 8 has targets: tensor([6, 7, 7, 6, 6], device='cuda:0')
Worker 9 has targets: tensor([7, 7, 8, 7, 7], device='cuda:0')
Worker 10 has targets: tensor([8, 8, 9, 8, 8], device='cuda:0')
Worker 11 has targets: tensor([9, 9, 9, 9, 9], device='cuda:0')



=== Log global consensus distance @ E1B0 ===
consensus_distance=0.001



=== Log clique consensus distance @ E1B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.002



=== Log mixing matrix @ E1B0 ===
[[0.167 0.167 0.167 0.167 0.167 0.    0.    0.    0.    0.    0.167 0.   ]
 [0.167 0.233 0.2   0.2   0.2   0.    0.    0.    0.    0.    0.    0.   ]
 [0.167 0.2   0.233 0.2   0.2   0.    0.    0.    0.    0.    0.    0.   ]
 [0.167 0.2   0.2   0.233 0.2   0.    0.    0.    0.    0.    0.    0.   ]
 [0.167 0.2   0.2   0.2   0.233 0.    0.    0.    0.    0.    0.    0.   ]
 [0.    0.    0.    0.    0.    0.233 0.2   0.2   0.2   0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.2   0.233 0.2   0.2   0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.2   0.2   0.233 0.2   0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.2   0.2   0.2   0.233 0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.167 0.167 0.167 0.167 0.167 0.167 0.   ]
 [0.167 0.    0.    0.    0.    0.    0.    0.    0.    0.167 0.292 0.375]
 [0.    0.    0.    0.    0.    0.    0.    0.    0.    0.    0.375 0.625]]


[E 1B10 |   4224/60000 (  7%) ] Loss: 0.9390 top1= 69.0341

=== Log global consensus distance @ E1B10 ===
consensus_distance=1.069



=== Log clique consensus distance @ E1B10 ===
clique1_consensus_distance=0.036
clique2_consensus_distance=1.624


[E 1B20 |   8064/60000 ( 13%) ] Loss: 0.2847 top1= 92.8977

=== Log global consensus distance @ E1B20 ===
consensus_distance=3.303



=== Log clique consensus distance @ E1B20 ===
clique1_consensus_distance=0.050
clique2_consensus_distance=4.886



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.5867 top1=  9.7456


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.9963 top1= 40.0441


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=5.4657 top1= 39.7736

Train epoch 2
[E 2B0  |    384/60000 (  1%) ] Loss: 0.2106 top1= 94.8864

=== Log global consensus distance @ E2B0 ===
consensus_distance=5.021



=== Log clique consensus distance @ E2B0 ===
clique1_consensus_distance=0.052
clique2_consensus_distance=6.653


[E 2B10 |   4224/60000 (  7%) ] Loss: 0.1937 top1= 94.6023

=== Log global consensus distance @ E2B10 ===
consensus_distance=6.538



=== Log clique consensus distance @ E2B10 ===
clique1_consensus_distance=0.054
clique2_consensus_distance=8.082


[E 2B20 |   8064/60000 ( 13%) ] Loss: 0.3073 top1= 94.8864

=== Log global consensus distance @ E2B20 ===
consensus_distance=7.992



=== Log clique consensus distance @ E2B20 ===
clique1_consensus_distance=0.055
clique2_consensus_distance=9.444



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.5742 top1= 10.5369


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.1424 top1= 42.2276


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=5.4604 top1= 43.4796

Train epoch 3
[E 3B0  |    384/60000 (  1%) ] Loss: 0.1334 top1= 98.0114

=== Log global consensus distance @ E3B0 ===
consensus_distance=9.492



=== Log clique consensus distance @ E3B0 ===
clique1_consensus_distance=0.055
clique2_consensus_distance=10.906


[E 3B10 |   4224/60000 (  7%) ] Loss: 0.1426 top1= 96.0227

=== Log global consensus distance @ E3B10 ===
consensus_distance=10.951



=== Log clique consensus distance @ E3B10 ===
clique1_consensus_distance=0.056
clique2_consensus_distance=12.290


[E 3B20 |   8064/60000 ( 13%) ] Loss: 0.1614 top1= 96.0227

=== Log global consensus distance @ E3B20 ===
consensus_distance=12.375



=== Log clique consensus distance @ E3B20 ===
clique1_consensus_distance=0.056
clique2_consensus_distance=13.588



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.9765 top1= 16.6266


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.5380 top1= 45.9135


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=5.6746 top1= 43.3894

Train epoch 4
[E 4B0  |    384/60000 (  1%) ] Loss: 0.1355 top1= 97.4432

=== Log global consensus distance @ E4B0 ===
consensus_distance=13.907



=== Log clique consensus distance @ E4B0 ===
clique1_consensus_distance=0.057
clique2_consensus_distance=14.819


[E 4B10 |   4224/60000 (  7%) ] Loss: 0.1038 top1= 96.5909

=== Log global consensus distance @ E4B10 ===
consensus_distance=15.626



=== Log clique consensus distance @ E4B10 ===
clique1_consensus_distance=0.057
clique2_consensus_distance=16.146


[E 4B20 |   8064/60000 ( 13%) ] Loss: 0.1264 top1= 97.4432

=== Log global consensus distance @ E4B20 ===
consensus_distance=17.135



=== Log clique consensus distance @ E4B20 ===
clique1_consensus_distance=0.057
clique2_consensus_distance=17.038



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.6180 top1= 17.8285


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.9672 top1= 47.3758


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=5.9513 top1= 42.5080

Train epoch 5
[E 5B0  |    384/60000 (  1%) ] Loss: 0.1066 top1= 97.4432

=== Log global consensus distance @ E5B0 ===
consensus_distance=18.665



=== Log clique consensus distance @ E5B0 ===
clique1_consensus_distance=0.057
clique2_consensus_distance=17.886


[E 5B10 |   4224/60000 (  7%) ] Loss: 0.2537 top1= 94.8864

=== Log global consensus distance @ E5B10 ===
consensus_distance=20.557



=== Log clique consensus distance @ E5B10 ===
clique1_consensus_distance=0.057
clique2_consensus_distance=18.903


[E 5B20 |   8064/60000 ( 13%) ] Loss: 0.1532 top1= 95.4545

=== Log global consensus distance @ E5B20 ===
consensus_distance=22.206



=== Log clique consensus distance @ E5B20 ===
clique1_consensus_distance=0.057
clique2_consensus_distance=19.560



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.6401 top1= 17.2175


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.0145 top1= 47.7163


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.0118 top1= 43.9203

Train epoch 6
[E 6B0  |    384/60000 (  1%) ] Loss: 0.0942 top1= 98.5795

=== Log global consensus distance @ E6B0 ===
consensus_distance=23.750



=== Log clique consensus distance @ E6B0 ===
clique1_consensus_distance=0.057
clique2_consensus_distance=20.280


[E 6B10 |   4224/60000 (  7%) ] Loss: 0.0872 top1= 97.4432

=== Log global consensus distance @ E6B10 ===
consensus_distance=25.228



=== Log clique consensus distance @ E6B10 ===
clique1_consensus_distance=0.057
clique2_consensus_distance=21.006


[E 6B20 |   8064/60000 ( 13%) ] Loss: 0.1088 top1= 96.5909

=== Log global consensus distance @ E6B20 ===
consensus_distance=26.723



=== Log clique consensus distance @ E6B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=21.470



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=8.0305 top1= 17.2075


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.7630 top1= 47.9467


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=5.8870 top1= 43.7800

Train epoch 7
[E 7B0  |    384/60000 (  1%) ] Loss: 0.1092 top1= 97.1591

=== Log global consensus distance @ E7B0 ===
consensus_distance=28.285



=== Log clique consensus distance @ E7B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=21.861


[E 7B10 |   4224/60000 (  7%) ] Loss: 0.0820 top1= 98.0114

=== Log global consensus distance @ E7B10 ===
consensus_distance=30.021



=== Log clique consensus distance @ E7B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=22.684


[E 7B20 |   8064/60000 ( 13%) ] Loss: 0.1172 top1= 96.0227

=== Log global consensus distance @ E7B20 ===
consensus_distance=31.513



=== Log clique consensus distance @ E7B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=23.174



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.1671 top1= 16.9972


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.4095 top1= 44.7316


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.2764 top1= 44.6314

Train epoch 8
[E 8B0  |    384/60000 (  1%) ] Loss: 0.1593 top1= 94.0341

=== Log global consensus distance @ E8B0 ===
consensus_distance=33.096



=== Log clique consensus distance @ E8B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=23.810


[E 8B10 |   4224/60000 (  7%) ] Loss: 0.0943 top1= 97.1591

=== Log global consensus distance @ E8B10 ===
consensus_distance=34.924



=== Log clique consensus distance @ E8B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=25.008


[E 8B20 |   8064/60000 ( 13%) ] Loss: 0.1024 top1= 97.1591

=== Log global consensus distance @ E8B20 ===
consensus_distance=36.547



=== Log clique consensus distance @ E8B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=25.633



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.9817 top1= 17.1174


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.7586 top1= 46.0136


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.9130 top1= 43.7200

Train epoch 9
[E 9B0  |    384/60000 (  1%) ] Loss: 0.0960 top1= 97.7273

=== Log global consensus distance @ E9B0 ===
consensus_distance=38.058



=== Log clique consensus distance @ E9B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=26.045


[E 9B10 |   4224/60000 (  7%) ] Loss: 0.0888 top1= 96.8750

=== Log global consensus distance @ E9B10 ===
consensus_distance=39.620



=== Log clique consensus distance @ E9B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=26.519


[E 9B20 |   8064/60000 ( 13%) ] Loss: 0.0799 top1= 97.4432

=== Log global consensus distance @ E9B20 ===
consensus_distance=41.280



=== Log clique consensus distance @ E9B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=27.324



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.2333 top1= 16.6967


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.6555 top1= 47.4960


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.2955 top1= 40.8554

Train epoch 10
[E10B0  |    384/60000 (  1%) ] Loss: 0.0873 top1= 97.1591

=== Log global consensus distance @ E10B0 ===
consensus_distance=42.948



=== Log clique consensus distance @ E10B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=27.981


[E10B10 |   4224/60000 (  7%) ] Loss: 0.0791 top1= 97.4432

=== Log global consensus distance @ E10B10 ===
consensus_distance=44.654



=== Log clique consensus distance @ E10B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=28.604


[E10B20 |   8064/60000 ( 13%) ] Loss: 0.0928 top1= 96.8750

=== Log global consensus distance @ E10B20 ===
consensus_distance=46.391



=== Log clique consensus distance @ E10B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=29.373



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.4101 top1= 16.6967


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.8961 top1= 46.5445


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.9781 top1= 42.9788

Train epoch 11
[E11B0  |    384/60000 (  1%) ] Loss: 0.0569 top1= 97.7273

=== Log global consensus distance @ E11B0 ===
consensus_distance=48.375



=== Log clique consensus distance @ E11B0 ===
clique1_consensus_distance=0.057
clique2_consensus_distance=30.522


[E11B10 |   4224/60000 (  7%) ] Loss: 0.1627 top1= 96.8750

=== Log global consensus distance @ E11B10 ===
consensus_distance=50.383



=== Log clique consensus distance @ E11B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=31.353


[E11B20 |   8064/60000 ( 13%) ] Loss: 0.1205 top1= 96.5909

=== Log global consensus distance @ E11B20 ===
consensus_distance=52.394



=== Log clique consensus distance @ E11B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=32.070



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=9.8258 top1= 16.8970


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.2953 top1= 46.7949


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=10.0466 top1= 42.4279

Train epoch 12
[E12B0  |    384/60000 (  1%) ] Loss: 0.1312 top1= 96.3068

=== Log global consensus distance @ E12B0 ===
consensus_distance=54.555



=== Log clique consensus distance @ E12B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=33.087


[E12B10 |   4224/60000 (  7%) ] Loss: 0.0619 top1= 97.1591

=== Log global consensus distance @ E12B10 ===
consensus_distance=56.855



=== Log clique consensus distance @ E12B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=34.374


[E12B20 |   8064/60000 ( 13%) ] Loss: 0.0576 top1= 98.0114

=== Log global consensus distance @ E12B20 ===
consensus_distance=59.762



=== Log clique consensus distance @ E12B20 ===
clique1_consensus_distance=0.057
clique2_consensus_distance=35.660



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=10.9791 top1= 17.5982


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.5338 top1= 47.4058


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=9.9083 top1= 44.1106

Train epoch 13
[E13B0  |    384/60000 (  1%) ] Loss: 0.0830 top1= 96.5909

=== Log global consensus distance @ E13B0 ===
consensus_distance=62.660



=== Log clique consensus distance @ E13B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=36.245


[E13B10 |   4224/60000 (  7%) ] Loss: 0.0938 top1= 96.0227

=== Log global consensus distance @ E13B10 ===
consensus_distance=68.613



=== Log clique consensus distance @ E13B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=37.300


[E13B20 |   8064/60000 ( 13%) ] Loss: 0.0802 top1= 97.4432

=== Log global consensus distance @ E13B20 ===
consensus_distance=73.457



=== Log clique consensus distance @ E13B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=38.344



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.8889 top1= 17.2576


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.4061 top1= 49.1086


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=10.5702 top1= 45.3025

Train epoch 14
[E14B0  |    384/60000 (  1%) ] Loss: 0.0714 top1= 97.1591

=== Log global consensus distance @ E14B0 ===
consensus_distance=79.214



=== Log clique consensus distance @ E14B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=38.913


[E14B10 |   4224/60000 (  7%) ] Loss: 0.1093 top1= 95.7386

=== Log global consensus distance @ E14B10 ===
consensus_distance=89.877



=== Log clique consensus distance @ E14B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=39.669


[E14B20 |   8064/60000 ( 13%) ] Loss: 0.0857 top1= 97.4432

=== Log global consensus distance @ E14B20 ===
consensus_distance=105.803



=== Log clique consensus distance @ E14B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=40.856



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.4992 top1= 14.9139


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.5189 top1= 48.0569


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=10.9134 top1= 41.3061

Train epoch 15
[E15B0  |    384/60000 (  1%) ] Loss: 0.1278 top1= 95.7386

=== Log global consensus distance @ E15B0 ===
consensus_distance=139.841



=== Log clique consensus distance @ E15B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=42.454


[E15B10 |   4224/60000 (  7%) ] Loss: 0.1591 top1= 97.1591

=== Log global consensus distance @ E15B10 ===
consensus_distance=613.080



=== Log clique consensus distance @ E15B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=44.086


[E15B20 |   8064/60000 ( 13%) ] Loss: 0.0789 top1= 97.7273

=== Log global consensus distance @ E15B20 ===
consensus_distance=1394.690



=== Log clique consensus distance @ E15B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=45.025



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.8150 top1= 14.2027


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.4840 top1= 47.7364


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=11.1955 top1= 45.2524

Train epoch 16
[E16B0  |    384/60000 (  1%) ] Loss: 0.1070 top1= 96.3068

=== Log global consensus distance @ E16B0 ===
consensus_distance=1772.368



=== Log clique consensus distance @ E16B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=46.725


[E16B10 |   4224/60000 (  7%) ] Loss: 0.0914 top1= 96.3068

=== Log global consensus distance @ E16B10 ===
consensus_distance=2161.900



=== Log clique consensus distance @ E16B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=47.944


[E16B20 |   8064/60000 ( 13%) ] Loss: 0.0977 top1= 96.8750

=== Log global consensus distance @ E16B20 ===
consensus_distance=2452.434



=== Log clique consensus distance @ E16B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=48.740



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.6487 top1=  9.9359


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5.7408 top1= 48.9583


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.2801 top1= 46.3141

Train epoch 17
[E17B0  |    384/60000 (  1%) ] Loss: 0.0779 top1= 97.4432

=== Log global consensus distance @ E17B0 ===
consensus_distance=2577.687



=== Log clique consensus distance @ E17B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=49.255


[E17B10 |   4224/60000 (  7%) ] Loss: 0.0860 top1= 96.5909

=== Log global consensus distance @ E17B10 ===
consensus_distance=2630.011



=== Log clique consensus distance @ E17B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=50.214


[E17B20 |   8064/60000 ( 13%) ] Loss: 0.0738 top1= 97.4432

=== Log global consensus distance @ E17B20 ===
consensus_distance=2653.954



=== Log clique consensus distance @ E17B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=51.178



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.6502 top1=  9.9559


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.0299 top1= 49.3089


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.6810 top1= 47.0853

Train epoch 18
[E18B0  |    384/60000 (  1%) ] Loss: 0.0747 top1= 97.1591

=== Log global consensus distance @ E18B0 ===
consensus_distance=2667.421



=== Log clique consensus distance @ E18B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=51.668


[E18B10 |   4224/60000 (  7%) ] Loss: 0.0880 top1= 96.8750

=== Log global consensus distance @ E18B10 ===
consensus_distance=2677.284



=== Log clique consensus distance @ E18B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=52.168


[E18B20 |   8064/60000 ( 13%) ] Loss: 0.0671 top1= 97.7273

=== Log global consensus distance @ E18B20 ===
consensus_distance=2685.975



=== Log clique consensus distance @ E18B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=52.908



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.6961 top1=  9.9960


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.4387 top1= 48.4976


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=10.1398 top1= 47.4459

Train epoch 19
[E19B0  |    384/60000 (  1%) ] Loss: 0.0647 top1= 97.4432

=== Log global consensus distance @ E19B0 ===
consensus_distance=2694.235



=== Log clique consensus distance @ E19B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=53.662


[E19B10 |   4224/60000 (  7%) ] Loss: 0.0781 top1= 97.1591

=== Log global consensus distance @ E19B10 ===
consensus_distance=2702.113



=== Log clique consensus distance @ E19B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=53.916


[E19B20 |   8064/60000 ( 13%) ] Loss: 0.0572 top1= 97.7273

=== Log global consensus distance @ E19B20 ===
consensus_distance=2710.133



=== Log clique consensus distance @ E19B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=54.632



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.7482 top1= 10.0962


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=7.0417 top1= 47.7965


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=10.8693 top1= 47.2356

Train epoch 20
[E20B0  |    384/60000 (  1%) ] Loss: 0.0550 top1= 98.2955

=== Log global consensus distance @ E20B0 ===
consensus_distance=2718.066



=== Log clique consensus distance @ E20B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=55.072


[E20B10 |   4224/60000 (  7%) ] Loss: 0.0674 top1= 97.7273

=== Log global consensus distance @ E20B10 ===
consensus_distance=2726.051



=== Log clique consensus distance @ E20B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=55.602


[E20B20 |   8064/60000 ( 13%) ] Loss: 0.0720 top1= 97.7273

=== Log global consensus distance @ E20B20 ===
consensus_distance=2733.757



=== Log clique consensus distance @ E20B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=55.540



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.7578 top1= 10.0561


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=7.0405 top1= 49.4391


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=10.0616 top1= 46.8950

Train epoch 21
[E21B0  |    384/60000 (  1%) ] Loss: 0.0716 top1= 97.1591

=== Log global consensus distance @ E21B0 ===
consensus_distance=2741.626



=== Log clique consensus distance @ E21B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=55.859


[E21B10 |   4224/60000 (  7%) ] Loss: 0.0749 top1= 97.4432

=== Log global consensus distance @ E21B10 ===
consensus_distance=2749.544



=== Log clique consensus distance @ E21B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=56.123


[E21B20 |   8064/60000 ( 13%) ] Loss: 0.0794 top1= 98.2955

=== Log global consensus distance @ E21B20 ===
consensus_distance=2757.436



=== Log clique consensus distance @ E21B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=56.383



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.8243 top1=  9.8858


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.9256 top1= 48.6378


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=10.9857 top1= 45.9135

Train epoch 22
[E22B0  |    384/60000 (  1%) ] Loss: 0.0781 top1= 97.1591

=== Log global consensus distance @ E22B0 ===
consensus_distance=2765.365



=== Log clique consensus distance @ E22B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=56.816


[E22B10 |   4224/60000 (  7%) ] Loss: 0.0770 top1= 96.8750

=== Log global consensus distance @ E22B10 ===
consensus_distance=2773.385



=== Log clique consensus distance @ E22B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=57.314


[E22B20 |   8064/60000 ( 13%) ] Loss: 0.0456 top1= 98.5795

=== Log global consensus distance @ E22B20 ===
consensus_distance=2781.552



=== Log clique consensus distance @ E22B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=58.111



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.8456 top1=  9.9359


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=7.6916 top1= 49.1987


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=11.0685 top1= 46.7748

Train epoch 23
[E23B0  |    384/60000 (  1%) ] Loss: 0.0544 top1= 97.7273

=== Log global consensus distance @ E23B0 ===
consensus_distance=2789.624



=== Log clique consensus distance @ E23B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=58.776


[E23B10 |   4224/60000 (  7%) ] Loss: 0.1209 top1= 96.5909

=== Log global consensus distance @ E23B10 ===
consensus_distance=2797.736



=== Log clique consensus distance @ E23B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=59.176


[E23B20 |   8064/60000 ( 13%) ] Loss: 0.0941 top1= 98.0114

=== Log global consensus distance @ E23B20 ===
consensus_distance=2805.844



=== Log clique consensus distance @ E23B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=59.676



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.0062 top1=  9.8458


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=7.4150 top1= 49.4692


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=10.8601 top1= 46.3341

Train epoch 24
[E24B0  |    384/60000 (  1%) ] Loss: 0.0544 top1= 98.0114

=== Log global consensus distance @ E24B0 ===
consensus_distance=2814.010



=== Log clique consensus distance @ E24B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=60.543


[E24B10 |   4224/60000 (  7%) ] Loss: 0.0726 top1= 97.4432

=== Log global consensus distance @ E24B10 ===
consensus_distance=2822.230



=== Log clique consensus distance @ E24B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=61.219


[E24B20 |   8064/60000 ( 13%) ] Loss: 0.0997 top1= 96.3068

=== Log global consensus distance @ E24B20 ===
consensus_distance=2830.487



=== Log clique consensus distance @ E24B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=62.343



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.9162 top1=  9.7756


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=8.8290 top1= 48.2672


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.9953 top1= 46.6947

Train epoch 25
[E25B0  |    384/60000 (  1%) ] Loss: 0.0672 top1= 97.7273

=== Log global consensus distance @ E25B0 ===
consensus_distance=2838.812



=== Log clique consensus distance @ E25B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=63.335


[E25B10 |   4224/60000 (  7%) ] Loss: 0.0629 top1= 97.4432

=== Log global consensus distance @ E25B10 ===
consensus_distance=2847.176



=== Log clique consensus distance @ E25B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=64.222


[E25B20 |   8064/60000 ( 13%) ] Loss: 0.1117 top1= 97.1591

=== Log global consensus distance @ E25B20 ===
consensus_distance=2855.410



=== Log clique consensus distance @ E25B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=65.037



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.9136 top1=  9.7456


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=9.0695 top1= 49.7997


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=9.3052 top1= 46.9251

Train epoch 26
[E26B0  |    384/60000 (  1%) ] Loss: 0.0626 top1= 98.0114

=== Log global consensus distance @ E26B0 ===
consensus_distance=2863.880



=== Log clique consensus distance @ E26B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=66.100


[E26B10 |   4224/60000 (  7%) ] Loss: 0.1410 top1= 96.0227

=== Log global consensus distance @ E26B10 ===
consensus_distance=2872.101



=== Log clique consensus distance @ E26B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=66.571


[E26B20 |   8064/60000 ( 13%) ] Loss: 0.0856 top1= 97.1591

=== Log global consensus distance @ E26B20 ===
consensus_distance=2880.369



=== Log clique consensus distance @ E26B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=67.103



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.0977 top1=  9.7456


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=8.4127 top1= 50.3305


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=10.8168 top1= 46.4643

Train epoch 27
[E27B0  |    384/60000 (  1%) ] Loss: 0.0565 top1= 98.0114

=== Log global consensus distance @ E27B0 ===
consensus_distance=2888.695



=== Log clique consensus distance @ E27B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=67.656


[E27B10 |   4224/60000 (  7%) ] Loss: 0.1001 top1= 96.8750

=== Log global consensus distance @ E27B10 ===
consensus_distance=2897.014



=== Log clique consensus distance @ E27B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=68.367


[E27B20 |   8064/60000 ( 13%) ] Loss: 0.1039 top1= 96.8750

=== Log global consensus distance @ E27B20 ===
consensus_distance=2905.274



=== Log clique consensus distance @ E27B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=69.053



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.9852 top1=  9.7456


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.9683 top1= 49.9700


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=10.0495 top1= 47.0353

Train epoch 28
[E28B0  |    384/60000 (  1%) ] Loss: 0.0938 top1= 97.1591

=== Log global consensus distance @ E28B0 ===
consensus_distance=2913.575



=== Log clique consensus distance @ E28B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=69.683


[E28B10 |   4224/60000 (  7%) ] Loss: 0.0766 top1= 97.1591

=== Log global consensus distance @ E28B10 ===
consensus_distance=2922.216



=== Log clique consensus distance @ E28B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=70.994


[E28B20 |   8064/60000 ( 13%) ] Loss: 0.0785 top1= 97.4432

=== Log global consensus distance @ E28B20 ===
consensus_distance=2930.600



=== Log clique consensus distance @ E28B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=71.936



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.0369 top1=  9.7456


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=8.0671 top1= 51.0517


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=14.0782 top1= 47.0252

Train epoch 29
[E29B0  |    384/60000 (  1%) ] Loss: 0.0610 top1= 97.7273

=== Log global consensus distance @ E29B0 ===
consensus_distance=2939.041



=== Log clique consensus distance @ E29B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=72.874


[E29B10 |   4224/60000 (  7%) ] Loss: 0.1467 top1= 96.0227

=== Log global consensus distance @ E29B10 ===
consensus_distance=2947.651



=== Log clique consensus distance @ E29B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=74.087


[E29B20 |   8064/60000 ( 13%) ] Loss: 0.1357 top1= 97.7273

=== Log global consensus distance @ E29B20 ===
consensus_distance=2956.099



=== Log clique consensus distance @ E29B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=74.827



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.1771 top1=  9.7456


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=7.9306 top1= 48.9383


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=17.0172 top1= 46.4944

Train epoch 30
[E30B0  |    384/60000 (  1%) ] Loss: 0.0964 top1= 96.5909

=== Log global consensus distance @ E30B0 ===
consensus_distance=2964.755



=== Log clique consensus distance @ E30B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=76.097


[E30B10 |   4224/60000 (  7%) ] Loss: 0.0944 top1= 97.1591

=== Log global consensus distance @ E30B10 ===
consensus_distance=2973.370



=== Log clique consensus distance @ E30B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=77.663


[E30B20 |   8064/60000 ( 13%) ] Loss: 0.0636 top1= 97.7273

=== Log global consensus distance @ E30B20 ===
consensus_distance=2981.922



=== Log clique consensus distance @ E30B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=78.858



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.1578 top1=  9.7456


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=9.9997 top1= 48.2071


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=16.6021 top1= 46.6947

Train epoch 31
[E31B0  |    384/60000 (  1%) ] Loss: 0.0695 top1= 97.1591

=== Log global consensus distance @ E31B0 ===
consensus_distance=2990.658



=== Log clique consensus distance @ E31B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=79.966


[E31B10 |   4224/60000 (  7%) ] Loss: 0.1044 top1= 97.1591

=== Log global consensus distance @ E31B10 ===
consensus_distance=2999.497



=== Log clique consensus distance @ E31B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=81.155


[E31B20 |   8064/60000 ( 13%) ] Loss: 0.1220 top1= 96.8750

=== Log global consensus distance @ E31B20 ===
consensus_distance=3007.764



=== Log clique consensus distance @ E31B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=81.720



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.0451 top1=  9.7456


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=7.8273 top1= 48.9683


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=13.6374 top1= 46.3542

Train epoch 32
[E32B0  |    384/60000 (  1%) ] Loss: 0.1135 top1= 96.0227

=== Log global consensus distance @ E32B0 ===
consensus_distance=3016.219



=== Log clique consensus distance @ E32B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=82.257


[E32B10 |   4224/60000 (  7%) ] Loss: 0.1861 top1= 95.7386

=== Log global consensus distance @ E32B10 ===
consensus_distance=3025.415



=== Log clique consensus distance @ E32B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=84.143


[E32B20 |   8064/60000 ( 13%) ] Loss: 0.0672 top1= 98.2955

=== Log global consensus distance @ E32B20 ===
consensus_distance=3034.213



=== Log clique consensus distance @ E32B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=85.571



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.3074 top1=  9.7456


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=8.1871 top1= 49.3890


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=16.5848 top1= 46.9251

Train epoch 33
[E33B0  |    384/60000 (  1%) ] Loss: 0.1942 top1= 96.5909

=== Log global consensus distance @ E33B0 ===
consensus_distance=3042.944



=== Log clique consensus distance @ E33B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=86.823


[E33B10 |   4224/60000 (  7%) ] Loss: 0.1416 top1= 94.8864

=== Log global consensus distance @ E33B10 ===
consensus_distance=3051.658



=== Log clique consensus distance @ E33B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=87.875


[E33B20 |   8064/60000 ( 13%) ] Loss: 0.2180 top1= 96.8750

=== Log global consensus distance @ E33B20 ===
consensus_distance=3061.080



=== Log clique consensus distance @ E33B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=90.343



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.6776 top1=  9.7456


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=8.5892 top1= 49.3389


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=17.4179 top1= 47.1054

Train epoch 34
[E34B0  |    384/60000 (  1%) ] Loss: 0.1407 top1= 96.5909

=== Log global consensus distance @ E34B0 ===
consensus_distance=3069.803



=== Log clique consensus distance @ E34B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=91.868


[E34B10 |   4224/60000 (  7%) ] Loss: 0.1243 top1= 95.4545

=== Log global consensus distance @ E34B10 ===
consensus_distance=3078.635



=== Log clique consensus distance @ E34B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=93.003


[E34B20 |   8064/60000 ( 13%) ] Loss: 0.1143 top1= 97.4432

=== Log global consensus distance @ E34B20 ===
consensus_distance=3087.642



=== Log clique consensus distance @ E34B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=94.416



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.1965 top1=  9.7456


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=8.2542 top1= 49.1887


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=21.1016 top1= 46.8249

Train epoch 35
[E35B0  |    384/60000 (  1%) ] Loss: 0.1124 top1= 96.3068

=== Log global consensus distance @ E35B0 ===
consensus_distance=3096.278



=== Log clique consensus distance @ E35B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=95.135


[E35B10 |   4224/60000 (  7%) ] Loss: 0.1416 top1= 96.5909

=== Log global consensus distance @ E35B10 ===
consensus_distance=3104.968



=== Log clique consensus distance @ E35B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=95.831


[E35B20 |   8064/60000 ( 13%) ] Loss: 0.1377 top1= 96.5909

=== Log global consensus distance @ E35B20 ===
consensus_distance=3113.757



=== Log clique consensus distance @ E35B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=96.678



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.4967 top1=  9.7456


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=7.6767 top1= 51.8429


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=17.7833 top1= 46.6747

Train epoch 36
[E36B0  |    384/60000 (  1%) ] Loss: 0.0662 top1= 97.4432

=== Log global consensus distance @ E36B0 ===
consensus_distance=3122.545



=== Log clique consensus distance @ E36B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=97.380


[E36B10 |   4224/60000 (  7%) ] Loss: 0.1693 top1= 95.7386

=== Log global consensus distance @ E36B10 ===
consensus_distance=3131.343



=== Log clique consensus distance @ E36B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=98.201


[E36B20 |   8064/60000 ( 13%) ] Loss: 0.3473 top1= 90.9091

=== Log global consensus distance @ E36B20 ===
consensus_distance=3140.106



=== Log clique consensus distance @ E36B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=101.452



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.1824 top1=  9.7456


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=8.8978 top1= 50.7212


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=19.4806 top1= 46.3041

Train epoch 37
[E37B0  |    384/60000 (  1%) ] Loss: 0.2816 top1= 95.4545

=== Log global consensus distance @ E37B0 ===
consensus_distance=3151.251



=== Log clique consensus distance @ E37B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=109.866


[E37B10 |   4224/60000 (  7%) ] Loss: 0.6365 top1= 90.3409

=== Log global consensus distance @ E37B10 ===
consensus_distance=3161.521



=== Log clique consensus distance @ E37B10 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=115.065


[E37B20 |   8064/60000 ( 13%) ] Loss: 0.3299 top1= 95.4545

=== Log global consensus distance @ E37B20 ===
consensus_distance=3171.699



=== Log clique consensus distance @ E37B20 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=119.072



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.1790 top1=  9.7456


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=10.2108 top1= 49.6595


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=19.7656 top1= 45.4828

Train epoch 38
[E38B0  |    384/60000 (  1%) ] Loss: 603459.6106 top1= 91.1932

=== Log global consensus distance @ E38B0 ===
consensus_distance=7410892.000



=== Log clique consensus distance @ E38B0 ===
clique1_consensus_distance=0.042
clique2_consensus_distance=121.773


[E38B10 |   4224/60000 (  7%) ] Loss: nan top1= 88.3523

=== Log global consensus distance @ E38B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E38B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=124.307


[E38B20 |   8064/60000 ( 13%) ] Loss: nan top1= 86.6477

=== Log global consensus distance @ E38B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E38B20 ===
clique1_consensus_distance=0.176
clique2_consensus_distance=127.031



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=10.5002 top1= 36.8289


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=16.5766 top1= 46.2740

Train epoch 39
[E39B0  |    384/60000 (  1%) ] Loss: nan top1= 67.0455

=== Log global consensus distance @ E39B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E39B0 ===
clique1_consensus_distance=0.011
clique2_consensus_distance=150.642


[E39B10 |   4224/60000 (  7%) ] Loss: nan top1= 58.8068

=== Log global consensus distance @ E39B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E39B10 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=200.115


[E39B20 |   8064/60000 ( 13%) ] Loss: nan top1= 57.3864

=== Log global consensus distance @ E39B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E39B20 ===
clique1_consensus_distance=0.003
clique2_consensus_distance=242.627



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.6722 top1= 22.5861


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=14.0002 top1= 46.1739

Train epoch 40
[E40B0  |    384/60000 (  1%) ] Loss: nan top1= 59.3750

=== Log global consensus distance @ E40B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E40B0 ===
clique1_consensus_distance=0.003
clique2_consensus_distance=270.591


[E40B10 |   4224/60000 (  7%) ] Loss: nan top1= 58.8068

=== Log global consensus distance @ E40B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E40B10 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=288.049


[E40B20 |   8064/60000 ( 13%) ] Loss: nan top1= 61.9318

=== Log global consensus distance @ E40B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E40B20 ===
clique1_consensus_distance=0.003
clique2_consensus_distance=300.418



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5.5160 top1= 23.0268


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=16.2108 top1= 46.7849

Train epoch 41
[E41B0  |    384/60000 (  1%) ] Loss: nan top1= 60.7955

=== Log global consensus distance @ E41B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E41B0 ===
clique1_consensus_distance=0.002
clique2_consensus_distance=307.415


[E41B10 |   4224/60000 (  7%) ] Loss: nan top1= 67.6136

=== Log global consensus distance @ E41B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E41B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=312.510


[E41B20 |   8064/60000 ( 13%) ] Loss: nan top1= 63.3523

=== Log global consensus distance @ E41B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E41B20 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=316.873



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.3624 top1= 28.6458


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=15.2326 top1= 46.6246

Train epoch 42
[E42B0  |    384/60000 (  1%) ] Loss: nan top1= 61.9318

=== Log global consensus distance @ E42B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E42B0 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=323.382


[E42B10 |   4224/60000 (  7%) ] Loss: nan top1= 70.7386

=== Log global consensus distance @ E42B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E42B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=332.761


[E42B20 |   8064/60000 ( 13%) ] Loss: nan top1= 70.4545

=== Log global consensus distance @ E42B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E42B20 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=337.714



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.5897 top1= 30.5789


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=13.5630 top1= 46.3942

Train epoch 43
[E43B0  |    384/60000 (  1%) ] Loss: nan top1= 73.0114

=== Log global consensus distance @ E43B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E43B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=341.779


[E43B10 |   4224/60000 (  7%) ] Loss: nan top1= 71.0227

=== Log global consensus distance @ E43B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E43B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=345.529


[E43B20 |   8064/60000 ( 13%) ] Loss: nan top1= 71.8750

=== Log global consensus distance @ E43B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E43B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=347.283



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.6378 top1= 31.5304


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=15.6115 top1= 46.8149

Train epoch 44
[E44B0  |    384/60000 (  1%) ] Loss: nan top1= 73.5795

=== Log global consensus distance @ E44B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E44B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=349.564


[E44B10 |   4224/60000 (  7%) ] Loss: nan top1= 71.0227

=== Log global consensus distance @ E44B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E44B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=351.875


[E44B20 |   8064/60000 ( 13%) ] Loss: nan top1= 71.8750

=== Log global consensus distance @ E44B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E44B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=353.466



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.3961 top1= 29.2869


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=15.4326 top1= 46.9050

Train epoch 45
[E45B0  |    384/60000 (  1%) ] Loss: nan top1= 73.0114

=== Log global consensus distance @ E45B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E45B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=355.078


[E45B10 |   4224/60000 (  7%) ] Loss: nan top1= 71.3068

=== Log global consensus distance @ E45B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E45B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=356.942


[E45B20 |   8064/60000 ( 13%) ] Loss: nan top1= 72.1591

=== Log global consensus distance @ E45B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E45B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=357.664



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.7857 top1= 31.5204


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=16.1465 top1= 46.9752

Train epoch 46
[E46B0  |    384/60000 (  1%) ] Loss: nan top1= 73.8636

=== Log global consensus distance @ E46B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E46B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=358.765


[E46B10 |   4224/60000 (  7%) ] Loss: nan top1= 71.3068

=== Log global consensus distance @ E46B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E46B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=360.491


[E46B20 |   8064/60000 ( 13%) ] Loss: nan top1= 72.1591

=== Log global consensus distance @ E46B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E46B20 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=362.066



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5.7293 top1= 32.1114


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=14.8599 top1= 46.8950

Train epoch 47
[E47B0  |    384/60000 (  1%) ] Loss: nan top1= 74.4318

=== Log global consensus distance @ E47B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E47B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=363.292


[E47B10 |   4224/60000 (  7%) ] Loss: nan top1= 71.3068

=== Log global consensus distance @ E47B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E47B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=364.190


[E47B20 |   8064/60000 ( 13%) ] Loss: nan top1= 71.8750

=== Log global consensus distance @ E47B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E47B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=365.000



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5.2657 top1= 32.2015


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=15.3880 top1= 46.9551

Train epoch 48
[E48B0  |    384/60000 (  1%) ] Loss: nan top1= 73.2955

=== Log global consensus distance @ E48B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E48B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=366.115


[E48B10 |   4224/60000 (  7%) ] Loss: nan top1= 71.0227

=== Log global consensus distance @ E48B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E48B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=367.253


[E48B20 |   8064/60000 ( 13%) ] Loss: nan top1= 72.1591

=== Log global consensus distance @ E48B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E48B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=367.987



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5.1706 top1= 32.3918


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=16.3074 top1= 46.8450

Train epoch 49
[E49B0  |    384/60000 (  1%) ] Loss: nan top1= 73.8636

=== Log global consensus distance @ E49B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E49B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=368.943


[E49B10 |   4224/60000 (  7%) ] Loss: nan top1= 71.3068

=== Log global consensus distance @ E49B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E49B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=369.916


[E49B20 |   8064/60000 ( 13%) ] Loss: nan top1= 71.8750

=== Log global consensus distance @ E49B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E49B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=370.672



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.6311 top1= 32.5821


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=17.7192 top1= 46.7448

Train epoch 50
[E50B0  |    384/60000 (  1%) ] Loss: nan top1= 72.7273

=== Log global consensus distance @ E50B0 ===
consensus_distance=nan



=== Log clique consensus distance @ E50B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=371.483


[E50B10 |   4224/60000 (  7%) ] Loss: nan top1= 71.5909

=== Log global consensus distance @ E50B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E50B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=372.359


[E50B20 |   8064/60000 ( 13%) ] Loss: nan top1= 72.4432

=== Log global consensus distance @ E50B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E50B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=373.052



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5.2791 top1= 32.7624


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=17.3751 top1= 46.9451

