
=== Start adding workers ===
=> Add worker SGDMWorker(index=0, momentum=0.0)
=> Add worker SGDMWorker(index=1, momentum=0.0)
=> Add worker SGDMWorker(index=2, momentum=0.0)
=> Add worker SGDMWorker(index=3, momentum=0.0)
=> Add worker SGDMWorker(index=4, momentum=0.0)
=> Add worker SGDMWorker(index=5, momentum=0.0)
=> Add worker SGDMWorker(index=6, momentum=0.0)
=> Add worker SGDMWorker(index=7, momentum=0.0)
=> Add worker SGDMWorker(index=8, momentum=0.0)
=> Add worker SGDMWorker(index=9, momentum=0.0)
=> Add worker SGDMWorker(index=10, momentum=0.0)
=> Add worker BitFlippingWorker
=> Add worker BitFlippingWorker
=> Add worker BitFlippingWorker

=== Start adding graph ===
TwoCliquesWithByzantine(m=5,b=3)

Train epoch 1
[E 1B0  |    448/60000 (  1%) ] Loss: 2.3094 top1=  7.9545

=== Peeking data label distribution E1B0 ===
Worker 0 has targets: tensor([0, 0, 0, 0, 0], device='cuda:0')
Worker 1 has targets: tensor([1, 1, 0, 1, 1], device='cuda:0')
Worker 2 has targets: tensor([1, 1, 1, 1, 1], device='cuda:0')
Worker 3 has targets: tensor([2, 2, 2, 2, 2], device='cuda:0')
Worker 4 has targets: tensor([3, 3, 2, 3, 3], device='cuda:0')
Worker 5 has targets: tensor([3, 3, 3, 3, 3], device='cuda:0')
Worker 6 has targets: tensor([4, 4, 4, 4, 4], device='cuda:0')
Worker 7 has targets: tensor([5, 5, 5, 5, 5], device='cuda:0')
Worker 8 has targets: tensor([6, 6, 5, 6, 6], device='cuda:0')
Worker 9 has targets: tensor([6, 6, 6, 6, 6], device='cuda:0')
Worker 10 has targets: tensor([7, 7, 7, 7, 7], device='cuda:0')
Worker 11 has targets: tensor([8, 8, 8, 8, 8], device='cuda:0')
Worker 12 has targets: tensor([9, 9, 8, 9, 9], device='cuda:0')
Worker 13 has targets: tensor([9, 9, 9, 9, 9], device='cuda:0')



=== Log global consensus distance @ E1B0 ===
consensus_distance=0.000



=== Log clique consensus distance @ E1B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.000


[E 1B10 |   4928/60000 (  8%) ] Loss: 1.6373 top1= 77.5568

=== Log global consensus distance @ E1B10 ===
consensus_distance=0.015



=== Log clique consensus distance @ E1B10 ===
clique1_consensus_distance=0.013
clique2_consensus_distance=0.029


[E 1B20 |   9408/60000 ( 16%) ] Loss: 1.0314 top1= 80.9659

=== Log global consensus distance @ E1B20 ===
consensus_distance=0.047



=== Log clique consensus distance @ E1B20 ===
clique1_consensus_distance=0.036
clique2_consensus_distance=0.087



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.2990 top1= 16.8770


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.4185 top1= 21.5345


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.4191 top1= 22.7264

Train epoch 2
[E 2B0  |    448/60000 (  1%) ] Loss: 0.6836 top1= 80.1136

=== Log global consensus distance @ E2B0 ===
consensus_distance=0.080



=== Log clique consensus distance @ E2B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=0.149


[E 2B10 |   4928/60000 (  8%) ] Loss: 0.4636 top1= 88.9205

=== Log global consensus distance @ E2B10 ===
consensus_distance=0.108



=== Log clique consensus distance @ E2B10 ===
clique1_consensus_distance=0.073
clique2_consensus_distance=0.200


[E 2B20 |   9408/60000 ( 16%) ] Loss: 0.3769 top1= 94.3182

=== Log global consensus distance @ E2B20 ===
consensus_distance=0.136



=== Log clique consensus distance @ E2B20 ===
clique1_consensus_distance=0.086
clique2_consensus_distance=0.239



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.8530 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.6295 top1= 21.3942


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.6413 top1= 17.1875

Train epoch 3
[E 3B0  |    448/60000 (  1%) ] Loss: 0.3106 top1= 94.3182

=== Log global consensus distance @ E3B0 ===
consensus_distance=0.173



=== Log clique consensus distance @ E3B0 ===
clique1_consensus_distance=0.096
clique2_consensus_distance=0.274


[E 3B10 |   4928/60000 (  8%) ] Loss: 0.2515 top1= 95.7386

=== Log global consensus distance @ E3B10 ===
consensus_distance=0.244



=== Log clique consensus distance @ E3B10 ===
clique1_consensus_distance=0.105
clique2_consensus_distance=0.302


[E 3B20 |   9408/60000 ( 16%) ] Loss: 0.2524 top1= 96.0227

=== Log global consensus distance @ E3B20 ===
consensus_distance=0.421



=== Log clique consensus distance @ E3B20 ===
clique1_consensus_distance=0.111
clique2_consensus_distance=0.328



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=17.4062 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.7426 top1= 22.4960


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.6912 top1= 25.5308

Train epoch 4
[E 4B0  |    448/60000 (  1%) ] Loss: 0.2201 top1= 95.4545

=== Log global consensus distance @ E4B0 ===
consensus_distance=0.783



=== Log clique consensus distance @ E4B0 ===
clique1_consensus_distance=0.118
clique2_consensus_distance=0.353


[E 4B10 |   4928/60000 (  8%) ] Loss: 0.1814 top1= 96.0227

=== Log global consensus distance @ E4B10 ===
consensus_distance=1.030



=== Log clique consensus distance @ E4B10 ===
clique1_consensus_distance=0.125
clique2_consensus_distance=0.375


[E 4B20 |   9408/60000 ( 16%) ] Loss: 0.1873 top1= 96.0227

=== Log global consensus distance @ E4B20 ===
consensus_distance=1.362



=== Log clique consensus distance @ E4B20 ===
clique1_consensus_distance=0.128
clique2_consensus_distance=0.397



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=42.3833 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.7997 top1= 26.9932


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7302 top1= 25.9014

Train epoch 5
[E 5B0  |    448/60000 (  1%) ] Loss: 0.1698 top1= 96.3068

=== Log global consensus distance @ E5B0 ===
consensus_distance=1.923



=== Log clique consensus distance @ E5B0 ===
clique1_consensus_distance=0.133
clique2_consensus_distance=0.418


[E 5B10 |   4928/60000 (  8%) ] Loss: 0.1350 top1= 97.4432

=== Log global consensus distance @ E5B10 ===
consensus_distance=2.223



=== Log clique consensus distance @ E5B10 ===
clique1_consensus_distance=0.137
clique2_consensus_distance=0.437


[E 5B20 |   9408/60000 ( 16%) ] Loss: 0.1500 top1= 96.0227

=== Log global consensus distance @ E5B20 ===
consensus_distance=2.588



=== Log clique consensus distance @ E5B20 ===
clique1_consensus_distance=0.141
clique2_consensus_distance=0.454



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=52.5282 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.8797 top1= 27.5140


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.8526 top1= 23.6278

Train epoch 6
[E 6B0  |    448/60000 (  1%) ] Loss: 0.1311 top1= 97.1591

=== Log global consensus distance @ E6B0 ===
consensus_distance=2.640



=== Log clique consensus distance @ E6B0 ===
clique1_consensus_distance=0.145
clique2_consensus_distance=0.472


[E 6B10 |   4928/60000 (  8%) ] Loss: 0.1093 top1= 98.2955

=== Log global consensus distance @ E6B10 ===
consensus_distance=3.097



=== Log clique consensus distance @ E6B10 ===
clique1_consensus_distance=0.149
clique2_consensus_distance=0.489


[E 6B20 |   9408/60000 ( 16%) ] Loss: 0.1290 top1= 96.0227

=== Log global consensus distance @ E6B20 ===
consensus_distance=3.289



=== Log clique consensus distance @ E6B20 ===
clique1_consensus_distance=0.153
clique2_consensus_distance=0.504



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=69.9967 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.9565 top1= 27.0433


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.9401 top1= 22.1154

Train epoch 7
[E 7B0  |    448/60000 (  1%) ] Loss: 0.1068 top1= 98.0114

=== Log global consensus distance @ E7B0 ===
consensus_distance=3.811



=== Log clique consensus distance @ E7B0 ===
clique1_consensus_distance=0.156
clique2_consensus_distance=0.520


[E 7B10 |   4928/60000 (  8%) ] Loss: 0.0923 top1= 98.2955

=== Log global consensus distance @ E7B10 ===
consensus_distance=4.176



=== Log clique consensus distance @ E7B10 ===
clique1_consensus_distance=0.158
clique2_consensus_distance=0.535


[E 7B20 |   9408/60000 ( 16%) ] Loss: 0.1128 top1= 97.4432

=== Log global consensus distance @ E7B20 ===
consensus_distance=4.845



=== Log clique consensus distance @ E7B20 ===
clique1_consensus_distance=0.160
clique2_consensus_distance=0.551



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=77.4372 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.9678 top1= 31.0998


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.0102 top1= 21.3742

Train epoch 8
[E 8B0  |    448/60000 (  1%) ] Loss: 0.0929 top1= 98.2955

=== Log global consensus distance @ E8B0 ===
consensus_distance=5.122



=== Log clique consensus distance @ E8B0 ===
clique1_consensus_distance=0.163
clique2_consensus_distance=0.566


[E 8B10 |   4928/60000 (  8%) ] Loss: 0.0810 top1= 98.2955

=== Log global consensus distance @ E8B10 ===
consensus_distance=6.146



=== Log clique consensus distance @ E8B10 ===
clique1_consensus_distance=0.165
clique2_consensus_distance=0.578


[E 8B20 |   9408/60000 ( 16%) ] Loss: 0.1025 top1= 97.7273

=== Log global consensus distance @ E8B20 ===
consensus_distance=6.882



=== Log clique consensus distance @ E8B20 ===
clique1_consensus_distance=0.168
clique2_consensus_distance=0.591



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=97.4550 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.0225 top1= 31.2300


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.1919 top1= 18.5998

Train epoch 9
[E 9B0  |    448/60000 (  1%) ] Loss: 0.0748 top1= 98.2955

=== Log global consensus distance @ E9B0 ===
consensus_distance=7.610



=== Log clique consensus distance @ E9B0 ===
clique1_consensus_distance=0.171
clique2_consensus_distance=0.604


[E 9B10 |   4928/60000 (  8%) ] Loss: 0.0701 top1= 98.5795

=== Log global consensus distance @ E9B10 ===
consensus_distance=8.662



=== Log clique consensus distance @ E9B10 ===
clique1_consensus_distance=0.172
clique2_consensus_distance=0.617


[E 9B20 |   9408/60000 ( 16%) ] Loss: 0.0922 top1= 97.4432

=== Log global consensus distance @ E9B20 ===
consensus_distance=10.114



=== Log clique consensus distance @ E9B20 ===
clique1_consensus_distance=0.173
clique2_consensus_distance=0.629



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=116.1693 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.0521 top1= 33.0729


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.1931 top1= 19.8217

Train epoch 10
[E10B0  |    448/60000 (  1%) ] Loss: 0.0692 top1= 98.2955

=== Log global consensus distance @ E10B0 ===
consensus_distance=11.544



=== Log clique consensus distance @ E10B0 ===
clique1_consensus_distance=0.175
clique2_consensus_distance=0.642


[E10B10 |   4928/60000 (  8%) ] Loss: 0.0623 top1= 98.8636

=== Log global consensus distance @ E10B10 ===
consensus_distance=12.924



=== Log clique consensus distance @ E10B10 ===
clique1_consensus_distance=0.177
clique2_consensus_distance=0.653


[E10B20 |   9408/60000 ( 16%) ] Loss: 0.0828 top1= 97.7273

=== Log global consensus distance @ E10B20 ===
consensus_distance=15.068



=== Log clique consensus distance @ E10B20 ===
clique1_consensus_distance=0.180
clique2_consensus_distance=0.665



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=142.5054 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.1035 top1= 32.8926


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.1765 top1= 21.2640

Train epoch 11
[E11B0  |    448/60000 (  1%) ] Loss: 0.0652 top1= 98.2955

=== Log global consensus distance @ E11B0 ===
consensus_distance=17.468



=== Log clique consensus distance @ E11B0 ===
clique1_consensus_distance=0.182
clique2_consensus_distance=0.677


[E11B10 |   4928/60000 (  8%) ] Loss: 0.0579 top1= 98.5795

=== Log global consensus distance @ E11B10 ===
consensus_distance=20.376



=== Log clique consensus distance @ E11B10 ===
clique1_consensus_distance=0.184
clique2_consensus_distance=0.685


[E11B20 |   9408/60000 ( 16%) ] Loss: 0.0824 top1= 98.0114

=== Log global consensus distance @ E11B20 ===
consensus_distance=24.134



=== Log clique consensus distance @ E11B20 ===
clique1_consensus_distance=0.186
clique2_consensus_distance=0.696



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=222.3031 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.1369 top1= 33.3233


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.3906 top1= 18.5296

Train epoch 12
[E12B0  |    448/60000 (  1%) ] Loss: 0.0538 top1= 98.8636

=== Log global consensus distance @ E12B0 ===
consensus_distance=30.338



=== Log clique consensus distance @ E12B0 ===
clique1_consensus_distance=0.188
clique2_consensus_distance=0.707


[E12B10 |   4928/60000 (  8%) ] Loss: 0.0505 top1= 99.4318

=== Log global consensus distance @ E12B10 ===
consensus_distance=36.846



=== Log clique consensus distance @ E12B10 ===
clique1_consensus_distance=0.188
clique2_consensus_distance=0.718


[E12B20 |   9408/60000 ( 16%) ] Loss: 0.0748 top1= 98.0114

=== Log global consensus distance @ E12B20 ===
consensus_distance=89.908



=== Log clique consensus distance @ E12B20 ===
clique1_consensus_distance=0.190
clique2_consensus_distance=0.727



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.1743 top1= 33.7240


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.4642 top1= 17.9988

Train epoch 13
[E13B0  |    448/60000 (  1%) ] Loss: 0.0534 top1= 99.4318

=== Log global consensus distance @ E13B0 ===
consensus_distance=0.334



=== Log clique consensus distance @ E13B0 ===
clique1_consensus_distance=0.191
clique2_consensus_distance=0.737


[E13B10 |   4928/60000 (  8%) ] Loss: 0.0463 top1= 99.1477

=== Log global consensus distance @ E13B10 ===
consensus_distance=0.337



=== Log clique consensus distance @ E13B10 ===
clique1_consensus_distance=0.193
clique2_consensus_distance=0.748


[E13B20 |   9408/60000 ( 16%) ] Loss: 0.0620 top1= 98.2955

=== Log global consensus distance @ E13B20 ===
consensus_distance=0.346



=== Log clique consensus distance @ E13B20 ===
clique1_consensus_distance=0.193
clique2_consensus_distance=0.767



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.2195 top1= 33.9042


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.6589 top1= 17.7384

Train epoch 14
[E14B0  |    448/60000 (  1%) ] Loss: 0.0449 top1= 99.4318

=== Log global consensus distance @ E14B0 ===
consensus_distance=0.355



=== Log clique consensus distance @ E14B0 ===
clique1_consensus_distance=0.194
clique2_consensus_distance=0.769


[E14B10 |   4928/60000 (  8%) ] Loss: 0.0432 top1= 99.1477

=== Log global consensus distance @ E14B10 ===
consensus_distance=0.362



=== Log clique consensus distance @ E14B10 ===
clique1_consensus_distance=0.196
clique2_consensus_distance=0.777


[E14B20 |   9408/60000 ( 16%) ] Loss: 0.0696 top1= 98.2955

=== Log global consensus distance @ E14B20 ===
consensus_distance=0.369



=== Log clique consensus distance @ E14B20 ===
clique1_consensus_distance=0.197
clique2_consensus_distance=0.787



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.2727 top1= 33.2031


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.4781 top1= 19.8618

Train epoch 15
[E15B0  |    448/60000 (  1%) ] Loss: 0.0462 top1= 99.1477

=== Log global consensus distance @ E15B0 ===
consensus_distance=0.369



=== Log clique consensus distance @ E15B0 ===
clique1_consensus_distance=0.199
clique2_consensus_distance=0.796


[E15B10 |   4928/60000 (  8%) ] Loss: 0.0394 top1= 99.4318

=== Log global consensus distance @ E15B10 ===
consensus_distance=0.375



=== Log clique consensus distance @ E15B10 ===
clique1_consensus_distance=0.201
clique2_consensus_distance=0.804


[E15B20 |   9408/60000 ( 16%) ] Loss: 0.0648 top1= 98.5795

=== Log global consensus distance @ E15B20 ===
consensus_distance=0.372



=== Log clique consensus distance @ E15B20 ===
clique1_consensus_distance=0.202
clique2_consensus_distance=0.812



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.3111 top1= 33.3534


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.6489 top1= 18.3994

Train epoch 16
[E16B0  |    448/60000 (  1%) ] Loss: 0.0378 top1= 99.7159

=== Log global consensus distance @ E16B0 ===
consensus_distance=0.378



=== Log clique consensus distance @ E16B0 ===
clique1_consensus_distance=0.204
clique2_consensus_distance=0.821


[E16B10 |   4928/60000 (  8%) ] Loss: 0.0374 top1= 99.7159

=== Log global consensus distance @ E16B10 ===
consensus_distance=0.386



=== Log clique consensus distance @ E16B10 ===
clique1_consensus_distance=0.205
clique2_consensus_distance=0.829


[E16B20 |   9408/60000 ( 16%) ] Loss: 0.0641 top1= 98.5795

=== Log global consensus distance @ E16B20 ===
consensus_distance=0.387



=== Log clique consensus distance @ E16B20 ===
clique1_consensus_distance=0.206
clique2_consensus_distance=0.837



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.3604 top1= 32.4619


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.5548 top1= 20.0321

Train epoch 17
[E17B0  |    448/60000 (  1%) ] Loss: 0.0390 top1= 99.4318

=== Log global consensus distance @ E17B0 ===
consensus_distance=0.394



=== Log clique consensus distance @ E17B0 ===
clique1_consensus_distance=0.207
clique2_consensus_distance=0.844


[E17B10 |   4928/60000 (  8%) ] Loss: 0.0344 top1= 99.7159

=== Log global consensus distance @ E17B10 ===
consensus_distance=0.382



=== Log clique consensus distance @ E17B10 ===
clique1_consensus_distance=0.209
clique2_consensus_distance=0.850


[E17B20 |   9408/60000 ( 16%) ] Loss: 0.0577 top1= 98.8636

=== Log global consensus distance @ E17B20 ===
consensus_distance=0.391



=== Log clique consensus distance @ E17B20 ===
clique1_consensus_distance=0.210
clique2_consensus_distance=0.859



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.4174 top1= 31.3001


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.5997 top1= 19.6715

Train epoch 18
[E18B0  |    448/60000 (  1%) ] Loss: 0.0346 top1= 99.4318

=== Log global consensus distance @ E18B0 ===
consensus_distance=0.396



=== Log clique consensus distance @ E18B0 ===
clique1_consensus_distance=0.211
clique2_consensus_distance=0.866


[E18B10 |   4928/60000 (  8%) ] Loss: 0.0349 top1= 99.4318

=== Log global consensus distance @ E18B10 ===
consensus_distance=0.399



=== Log clique consensus distance @ E18B10 ===
clique1_consensus_distance=0.211
clique2_consensus_distance=0.872


[E18B20 |   9408/60000 ( 16%) ] Loss: 0.0534 top1= 98.5795

=== Log global consensus distance @ E18B20 ===
consensus_distance=0.403



=== Log clique consensus distance @ E18B20 ===
clique1_consensus_distance=0.212
clique2_consensus_distance=0.879



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.4739 top1= 30.1583


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.6401 top1= 19.9920

Train epoch 19
[E19B0  |    448/60000 (  1%) ] Loss: 0.0323 top1=100.0000

=== Log global consensus distance @ E19B0 ===
consensus_distance=0.401



=== Log clique consensus distance @ E19B0 ===
clique1_consensus_distance=0.214
clique2_consensus_distance=0.888


[E19B10 |   4928/60000 (  8%) ] Loss: 0.0306 top1= 99.7159

=== Log global consensus distance @ E19B10 ===
consensus_distance=0.402



=== Log clique consensus distance @ E19B10 ===
clique1_consensus_distance=0.215
clique2_consensus_distance=0.895


[E19B20 |   9408/60000 ( 16%) ] Loss: 0.0529 top1= 98.5795

=== Log global consensus distance @ E19B20 ===
consensus_distance=0.418



=== Log clique consensus distance @ E19B20 ===
clique1_consensus_distance=0.217
clique2_consensus_distance=0.902



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.5130 top1= 30.5689


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.7138 top1= 19.5813

Train epoch 20
[E20B0  |    448/60000 (  1%) ] Loss: 0.0294 top1=100.0000

=== Log global consensus distance @ E20B0 ===
consensus_distance=0.406



=== Log clique consensus distance @ E20B0 ===
clique1_consensus_distance=0.218
clique2_consensus_distance=0.908


[E20B10 |   4928/60000 (  8%) ] Loss: 0.0295 top1= 99.7159

=== Log global consensus distance @ E20B10 ===
consensus_distance=0.420



=== Log clique consensus distance @ E20B10 ===
clique1_consensus_distance=0.219
clique2_consensus_distance=0.914


[E20B20 |   9408/60000 ( 16%) ] Loss: 0.0524 top1= 98.5795

=== Log global consensus distance @ E20B20 ===
consensus_distance=0.429



=== Log clique consensus distance @ E20B20 ===
clique1_consensus_distance=0.221
clique2_consensus_distance=0.921



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.5522 top1= 30.3686


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.7878 top1= 19.0605

Train epoch 21
[E21B0  |    448/60000 (  1%) ] Loss: 0.0262 top1=100.0000

=== Log global consensus distance @ E21B0 ===
consensus_distance=0.428



=== Log clique consensus distance @ E21B0 ===
clique1_consensus_distance=0.222
clique2_consensus_distance=0.928


[E21B10 |   4928/60000 (  8%) ] Loss: 0.0264 top1= 99.7159

=== Log global consensus distance @ E21B10 ===
consensus_distance=0.422



=== Log clique consensus distance @ E21B10 ===
clique1_consensus_distance=0.222
clique2_consensus_distance=0.934


[E21B20 |   9408/60000 ( 16%) ] Loss: 0.0488 top1= 98.5795

=== Log global consensus distance @ E21B20 ===
consensus_distance=0.432



=== Log clique consensus distance @ E21B20 ===
clique1_consensus_distance=0.223
clique2_consensus_distance=0.940



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.6142 top1= 28.7660


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.7203 top1= 20.5128

Train epoch 22
[E22B0  |    448/60000 (  1%) ] Loss: 0.0299 top1= 99.7159

=== Log global consensus distance @ E22B0 ===
consensus_distance=0.434



=== Log clique consensus distance @ E22B0 ===
clique1_consensus_distance=0.225
clique2_consensus_distance=0.947


[E22B10 |   4928/60000 (  8%) ] Loss: 0.0258 top1=100.0000

=== Log global consensus distance @ E22B10 ===
consensus_distance=0.499



=== Log clique consensus distance @ E22B10 ===
clique1_consensus_distance=0.226
clique2_consensus_distance=0.952


[E22B20 |   9408/60000 ( 16%) ] Loss: 0.0454 top1= 98.5795

=== Log global consensus distance @ E22B20 ===
consensus_distance=0.613



=== Log clique consensus distance @ E22B20 ===
clique1_consensus_distance=0.227
clique2_consensus_distance=0.958



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.6597 top1= 28.1550


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.7487 top1= 20.6330

Train epoch 23
[E23B0  |    448/60000 (  1%) ] Loss: 0.0270 top1=100.0000

=== Log global consensus distance @ E23B0 ===
consensus_distance=0.886



=== Log clique consensus distance @ E23B0 ===
clique1_consensus_distance=0.228
clique2_consensus_distance=0.964


[E23B10 |   4928/60000 (  8%) ] Loss: 0.0259 top1=100.0000

=== Log global consensus distance @ E23B10 ===
consensus_distance=1.032



=== Log clique consensus distance @ E23B10 ===
clique1_consensus_distance=0.229
clique2_consensus_distance=0.970


[E23B20 |   9408/60000 ( 16%) ] Loss: 0.0452 top1= 99.1477

=== Log global consensus distance @ E23B20 ===
consensus_distance=1.239



=== Log clique consensus distance @ E23B20 ===
clique1_consensus_distance=0.230
clique2_consensus_distance=0.976



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.7191 top1= 27.0933


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.8270 top1= 19.8518

Train epoch 24
[E24B0  |    448/60000 (  1%) ] Loss: 0.0251 top1=100.0000

=== Log global consensus distance @ E24B0 ===
consensus_distance=1.530



=== Log clique consensus distance @ E24B0 ===
clique1_consensus_distance=0.231
clique2_consensus_distance=0.983


[E24B10 |   4928/60000 (  8%) ] Loss: 0.0250 top1=100.0000

=== Log global consensus distance @ E24B10 ===
consensus_distance=1.909



=== Log clique consensus distance @ E24B10 ===
clique1_consensus_distance=0.232
clique2_consensus_distance=0.989


[E24B20 |   9408/60000 ( 16%) ] Loss: 0.0430 top1= 99.1477

=== Log global consensus distance @ E24B20 ===
consensus_distance=2.196



=== Log clique consensus distance @ E24B20 ===
clique1_consensus_distance=0.233
clique2_consensus_distance=0.993



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.7449 top1= 27.7043


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.9383 top1= 19.0805

Train epoch 25
[E25B0  |    448/60000 (  1%) ] Loss: 0.0234 top1=100.0000

=== Log global consensus distance @ E25B0 ===
consensus_distance=2.429



=== Log clique consensus distance @ E25B0 ===
clique1_consensus_distance=0.235
clique2_consensus_distance=0.999


[E25B10 |   4928/60000 (  8%) ] Loss: 0.0232 top1=100.0000

=== Log global consensus distance @ E25B10 ===
consensus_distance=2.749



=== Log clique consensus distance @ E25B10 ===
clique1_consensus_distance=0.236
clique2_consensus_distance=1.005


[E25B20 |   9408/60000 ( 16%) ] Loss: 0.0421 top1= 99.1477

=== Log global consensus distance @ E25B20 ===
consensus_distance=3.114



=== Log clique consensus distance @ E25B20 ===
clique1_consensus_distance=0.236
clique2_consensus_distance=1.011



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.8272 top1= 25.7712


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.8691 top1= 20.2925

Train epoch 26
[E26B0  |    448/60000 (  1%) ] Loss: 0.0234 top1=100.0000

=== Log global consensus distance @ E26B0 ===
consensus_distance=3.569



=== Log clique consensus distance @ E26B0 ===
clique1_consensus_distance=0.237
clique2_consensus_distance=1.017


[E26B10 |   4928/60000 (  8%) ] Loss: 0.0230 top1=100.0000

=== Log global consensus distance @ E26B10 ===
consensus_distance=3.973



=== Log clique consensus distance @ E26B10 ===
clique1_consensus_distance=0.238
clique2_consensus_distance=1.021


[E26B20 |   9408/60000 ( 16%) ] Loss: 0.0405 top1= 99.1477

=== Log global consensus distance @ E26B20 ===
consensus_distance=4.572



=== Log clique consensus distance @ E26B20 ===
clique1_consensus_distance=0.239
clique2_consensus_distance=1.026



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.8561 top1= 25.6711


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.8958 top1= 20.1723

Train epoch 27
[E27B0  |    448/60000 (  1%) ] Loss: 0.0233 top1=100.0000

=== Log global consensus distance @ E27B0 ===
consensus_distance=5.081



=== Log clique consensus distance @ E27B0 ===
clique1_consensus_distance=0.240
clique2_consensus_distance=1.032


[E27B10 |   4928/60000 (  8%) ] Loss: 0.0233 top1= 99.7159

=== Log global consensus distance @ E27B10 ===
consensus_distance=6.023



=== Log clique consensus distance @ E27B10 ===
clique1_consensus_distance=0.242
clique2_consensus_distance=1.035


[E27B20 |   9408/60000 ( 16%) ] Loss: 0.0393 top1= 99.1477

=== Log global consensus distance @ E27B20 ===
consensus_distance=6.829



=== Log clique consensus distance @ E27B20 ===
clique1_consensus_distance=0.243
clique2_consensus_distance=1.041



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.8771 top1= 26.0417


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.9043 top1= 20.7432

Train epoch 28
[E28B0  |    448/60000 (  1%) ] Loss: 0.0224 top1=100.0000

=== Log global consensus distance @ E28B0 ===
consensus_distance=8.053



=== Log clique consensus distance @ E28B0 ===
clique1_consensus_distance=0.244
clique2_consensus_distance=1.047


[E28B10 |   4928/60000 (  8%) ] Loss: 0.0212 top1=100.0000

=== Log global consensus distance @ E28B10 ===
consensus_distance=9.067



=== Log clique consensus distance @ E28B10 ===
clique1_consensus_distance=0.244
clique2_consensus_distance=1.053


[E28B20 |   9408/60000 ( 16%) ] Loss: 0.0404 top1= 98.8636

=== Log global consensus distance @ E28B20 ===
consensus_distance=10.693



=== Log clique consensus distance @ E28B20 ===
clique1_consensus_distance=0.246
clique2_consensus_distance=1.058



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.9675 top1= 24.4591


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.9335 top1= 20.7332

Train epoch 29
[E29B0  |    448/60000 (  1%) ] Loss: 0.0213 top1=100.0000

=== Log global consensus distance @ E29B0 ===
consensus_distance=12.861



=== Log clique consensus distance @ E29B0 ===
clique1_consensus_distance=0.246
clique2_consensus_distance=1.063


[E29B10 |   4928/60000 (  8%) ] Loss: 0.0206 top1=100.0000

=== Log global consensus distance @ E29B10 ===
consensus_distance=14.695



=== Log clique consensus distance @ E29B10 ===
clique1_consensus_distance=0.247
clique2_consensus_distance=1.067


[E29B20 |   9408/60000 ( 16%) ] Loss: 0.0349 top1= 98.8636

=== Log global consensus distance @ E29B20 ===
consensus_distance=12.315



=== Log clique consensus distance @ E29B20 ===
clique1_consensus_distance=0.249
clique2_consensus_distance=1.072



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.9930 top1= 24.6294


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.9461 top1= 20.9535

Train epoch 30
[E30B0  |    448/60000 (  1%) ] Loss: 0.0213 top1=100.0000

=== Log global consensus distance @ E30B0 ===
consensus_distance=15.121



=== Log clique consensus distance @ E30B0 ===
clique1_consensus_distance=0.249
clique2_consensus_distance=1.078


[E30B10 |   4928/60000 (  8%) ] Loss: 0.0275 top1= 99.7159

=== Log global consensus distance @ E30B10 ===
consensus_distance=18.926



=== Log clique consensus distance @ E30B10 ===
clique1_consensus_distance=0.250
clique2_consensus_distance=1.082


[E30B20 |   9408/60000 ( 16%) ] Loss: 0.0348 top1= 98.5795

=== Log global consensus distance @ E30B20 ===
consensus_distance=23.071



=== Log clique consensus distance @ E30B20 ===
clique1_consensus_distance=0.251
clique2_consensus_distance=1.086



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.0440 top1= 24.1787


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.0935 top1= 19.3510

Train epoch 31
[E31B0  |    448/60000 (  1%) ] Loss: 0.0195 top1=100.0000

=== Log global consensus distance @ E31B0 ===
consensus_distance=26.788



=== Log clique consensus distance @ E31B0 ===
clique1_consensus_distance=0.253
clique2_consensus_distance=1.091


[E31B10 |   4928/60000 (  8%) ] Loss: 0.0184 top1=100.0000

=== Log global consensus distance @ E31B10 ===
consensus_distance=11.353



=== Log clique consensus distance @ E31B10 ===
clique1_consensus_distance=0.254
clique2_consensus_distance=1.096


[E31B20 |   9408/60000 ( 16%) ] Loss: 0.0337 top1= 99.1477

=== Log global consensus distance @ E31B20 ===
consensus_distance=1.812



=== Log clique consensus distance @ E31B20 ===
clique1_consensus_distance=0.255
clique2_consensus_distance=1.099



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.0131 top1= 25.7812


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.0217 top1= 20.5929

Train epoch 32
[E32B0  |    448/60000 (  1%) ] Loss: 0.0197 top1=100.0000

=== Log global consensus distance @ E32B0 ===
consensus_distance=2.517



=== Log clique consensus distance @ E32B0 ===
clique1_consensus_distance=0.256
clique2_consensus_distance=1.103


[E32B10 |   4928/60000 (  8%) ] Loss: 0.0186 top1=100.0000

=== Log global consensus distance @ E32B10 ===
consensus_distance=3.821



=== Log clique consensus distance @ E32B10 ===
clique1_consensus_distance=0.257
clique2_consensus_distance=1.109


[E32B20 |   9408/60000 ( 16%) ] Loss: 0.0339 top1= 99.1477

=== Log global consensus distance @ E32B20 ===
consensus_distance=5.391



=== Log clique consensus distance @ E32B20 ===
clique1_consensus_distance=0.258
clique2_consensus_distance=1.113



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.0861 top1= 24.6995


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.0330 top1= 20.9936

Train epoch 33
[E33B0  |    448/60000 (  1%) ] Loss: 0.0190 top1=100.0000

=== Log global consensus distance @ E33B0 ===
consensus_distance=7.391



=== Log clique consensus distance @ E33B0 ===
clique1_consensus_distance=0.259
clique2_consensus_distance=1.119


[E33B10 |   4928/60000 (  8%) ] Loss: 0.0166 top1=100.0000

=== Log global consensus distance @ E33B10 ===
consensus_distance=10.815



=== Log clique consensus distance @ E33B10 ===
clique1_consensus_distance=0.260
clique2_consensus_distance=1.123


[E33B20 |   9408/60000 ( 16%) ] Loss: 0.0298 top1= 99.4318

=== Log global consensus distance @ E33B20 ===
consensus_distance=6.033



=== Log clique consensus distance @ E33B20 ===
clique1_consensus_distance=0.261
clique2_consensus_distance=1.127



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.0940 top1= 25.2504


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.1053 top1= 20.1823

Train epoch 34
[E34B0  |    448/60000 (  1%) ] Loss: 0.0173 top1=100.0000

=== Log global consensus distance @ E34B0 ===
consensus_distance=6.493



=== Log clique consensus distance @ E34B0 ===
clique1_consensus_distance=0.262
clique2_consensus_distance=1.131


[E34B10 |   4928/60000 (  8%) ] Loss: 0.0166 top1=100.0000

=== Log global consensus distance @ E34B10 ===
consensus_distance=1.899



=== Log clique consensus distance @ E34B10 ===
clique1_consensus_distance=0.262
clique2_consensus_distance=1.135


[E34B20 |   9408/60000 ( 16%) ] Loss: 0.0295 top1= 98.8636

=== Log global consensus distance @ E34B20 ===
consensus_distance=2.516



=== Log clique consensus distance @ E34B20 ===
clique1_consensus_distance=0.263
clique2_consensus_distance=1.140



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.1800 top1= 23.7981


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.1678 top1= 19.8317

Train epoch 35
[E35B0  |    448/60000 (  1%) ] Loss: 0.0172 top1=100.0000

=== Log global consensus distance @ E35B0 ===
consensus_distance=4.693



=== Log clique consensus distance @ E35B0 ===
clique1_consensus_distance=0.264
clique2_consensus_distance=1.144


[E35B10 |   4928/60000 (  8%) ] Loss: 0.0161 top1=100.0000

=== Log global consensus distance @ E35B10 ===
consensus_distance=7.506



=== Log clique consensus distance @ E35B10 ===
clique1_consensus_distance=0.265
clique2_consensus_distance=1.149


[E35B20 |   9408/60000 ( 16%) ] Loss: 0.0288 top1= 99.1477

=== Log global consensus distance @ E35B20 ===
consensus_distance=8.674



=== Log clique consensus distance @ E35B20 ===
clique1_consensus_distance=0.266
clique2_consensus_distance=1.152



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.1780 top1= 24.3389


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.1671 top1= 20.1322

Train epoch 36
[E36B0  |    448/60000 (  1%) ] Loss: 0.0157 top1=100.0000

=== Log global consensus distance @ E36B0 ===
consensus_distance=11.030



=== Log clique consensus distance @ E36B0 ===
clique1_consensus_distance=0.267
clique2_consensus_distance=1.154


[E36B10 |   4928/60000 (  8%) ] Loss: 0.0164 top1=100.0000

=== Log global consensus distance @ E36B10 ===
consensus_distance=2.243



=== Log clique consensus distance @ E36B10 ===
clique1_consensus_distance=0.268
clique2_consensus_distance=1.158


[E36B20 |   9408/60000 ( 16%) ] Loss: 0.0295 top1= 99.1477

=== Log global consensus distance @ E36B20 ===
consensus_distance=3.852



=== Log clique consensus distance @ E36B20 ===
clique1_consensus_distance=0.269
clique2_consensus_distance=1.163



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.2170 top1= 24.1787


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.1173 top1= 21.1939

Train epoch 37
[E37B0  |    448/60000 (  1%) ] Loss: 0.0186 top1=100.0000

=== Log global consensus distance @ E37B0 ===
consensus_distance=7.362



=== Log clique consensus distance @ E37B0 ===
clique1_consensus_distance=0.270
clique2_consensus_distance=1.168


[E37B10 |   4928/60000 (  8%) ] Loss: 0.0150 top1=100.0000

=== Log global consensus distance @ E37B10 ===
consensus_distance=4.695



=== Log clique consensus distance @ E37B10 ===
clique1_consensus_distance=0.271
clique2_consensus_distance=1.173


[E37B20 |   9408/60000 ( 16%) ] Loss: 0.0278 top1= 99.1477

=== Log global consensus distance @ E37B20 ===
consensus_distance=8.423



=== Log clique consensus distance @ E37B20 ===
clique1_consensus_distance=0.271
clique2_consensus_distance=1.178



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.2513 top1= 24.0885


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.1729 top1= 20.5529

Train epoch 38
[E38B0  |    448/60000 (  1%) ] Loss: 0.0175 top1=100.0000

=== Log global consensus distance @ E38B0 ===
consensus_distance=5.042



=== Log clique consensus distance @ E38B0 ===
clique1_consensus_distance=0.273
clique2_consensus_distance=1.181


[E38B10 |   4928/60000 (  8%) ] Loss: 0.0152 top1=100.0000

=== Log global consensus distance @ E38B10 ===
consensus_distance=4.589



=== Log clique consensus distance @ E38B10 ===
clique1_consensus_distance=0.274
clique2_consensus_distance=1.184


[E38B20 |   9408/60000 ( 16%) ] Loss: 0.0262 top1= 99.4318

=== Log global consensus distance @ E38B20 ===
consensus_distance=5.097



=== Log clique consensus distance @ E38B20 ===
clique1_consensus_distance=0.274
clique2_consensus_distance=1.189



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.2937 top1= 23.8882


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.1883 top1= 20.8133

Train epoch 39
[E39B0  |    448/60000 (  1%) ] Loss: 0.0168 top1=100.0000

=== Log global consensus distance @ E39B0 ===
consensus_distance=3.237



=== Log clique consensus distance @ E39B0 ===
clique1_consensus_distance=0.275
clique2_consensus_distance=1.193


[E39B10 |   4928/60000 (  8%) ] Loss: 0.0143 top1=100.0000

=== Log global consensus distance @ E39B10 ===
consensus_distance=1.797



=== Log clique consensus distance @ E39B10 ===
clique1_consensus_distance=0.276
clique2_consensus_distance=1.197


[E39B20 |   9408/60000 ( 16%) ] Loss: 0.0260 top1= 99.4318

=== Log global consensus distance @ E39B20 ===
consensus_distance=3.216



=== Log clique consensus distance @ E39B20 ===
clique1_consensus_distance=0.277
clique2_consensus_distance=1.200



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.3364 top1= 23.4776


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.2412 top1= 20.2123

Train epoch 40
[E40B0  |    448/60000 (  1%) ] Loss: 0.0151 top1=100.0000

=== Log global consensus distance @ E40B0 ===
consensus_distance=5.683



=== Log clique consensus distance @ E40B0 ===
clique1_consensus_distance=0.278
clique2_consensus_distance=1.204


[E40B10 |   4928/60000 (  8%) ] Loss: 0.0140 top1=100.0000

=== Log global consensus distance @ E40B10 ===
consensus_distance=7.545



=== Log clique consensus distance @ E40B10 ===
clique1_consensus_distance=0.278
clique2_consensus_distance=1.207


[E40B20 |   9408/60000 ( 16%) ] Loss: 0.0262 top1= 99.7159

=== Log global consensus distance @ E40B20 ===
consensus_distance=5.230



=== Log clique consensus distance @ E40B20 ===
clique1_consensus_distance=0.279
clique2_consensus_distance=1.210



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.3180 top1= 24.2188


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.2257 top1= 20.8934

