
=== Start adding workers ===
=> Add worker SGDMWorker(index=0, momentum=0.0)
=> Add worker SGDMWorker(index=1, momentum=0.0)
=> Add worker SGDMWorker(index=2, momentum=0.0)
=> Add worker SGDMWorker(index=3, momentum=0.0)
=> Add worker SGDMWorker(index=4, momentum=0.0)
=> Add worker SGDMWorker(index=5, momentum=0.0)
=> Add worker SGDMWorker(index=6, momentum=0.0)
=> Add worker SGDMWorker(index=7, momentum=0.0)
=> Add worker SGDMWorker(index=8, momentum=0.0)
=> Add worker SGDMWorker(index=9, momentum=0.0)
=> Add worker SGDMWorker(index=10, momentum=0.0)
=> Add worker LabelFlippingWorker
=> Add worker LabelFlippingWorker
=> Add worker LabelFlippingWorker

=== Start adding graph ===
TwoCliquesWithByzantine(m=5,b=3)

Train epoch 1
[E 1B0  |    448/60000 (  1%) ] Loss: 2.3094 top1=  7.9545

=== Peeking data label distribution E1B0 ===
Worker 0 has targets: tensor([0, 0, 0, 0, 0], device='cuda:0')
Worker 1 has targets: tensor([1, 1, 0, 1, 1], device='cuda:0')
Worker 2 has targets: tensor([1, 1, 1, 1, 1], device='cuda:0')
Worker 3 has targets: tensor([2, 2, 2, 2, 2], device='cuda:0')
Worker 4 has targets: tensor([3, 3, 2, 3, 3], device='cuda:0')
Worker 5 has targets: tensor([3, 3, 3, 3, 3], device='cuda:0')
Worker 6 has targets: tensor([4, 4, 4, 4, 4], device='cuda:0')
Worker 7 has targets: tensor([5, 5, 5, 5, 5], device='cuda:0')
Worker 8 has targets: tensor([6, 6, 5, 6, 6], device='cuda:0')
Worker 9 has targets: tensor([6, 6, 6, 6, 6], device='cuda:0')
Worker 10 has targets: tensor([7, 7, 7, 7, 7], device='cuda:0')
Worker 11 has targets: tensor([1, 1, 1, 1, 1], device='cuda:0')
Worker 12 has targets: tensor([0, 0, 1, 0, 0], device='cuda:0')
Worker 13 has targets: tensor([0, 0, 0, 0, 0], device='cuda:0')



=== Log global consensus distance @ E1B0 ===
consensus_distance=0.000



=== Log clique consensus distance @ E1B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.000


[E 1B10 |   4928/60000 (  8%) ] Loss: 1.6457 top1= 77.2727

=== Log global consensus distance @ E1B10 ===
consensus_distance=0.015



=== Log clique consensus distance @ E1B10 ===
clique1_consensus_distance=0.013
clique2_consensus_distance=0.029


[E 1B20 |   9408/60000 ( 16%) ] Loss: 1.0593 top1= 80.9659

=== Log global consensus distance @ E1B20 ===
consensus_distance=0.046



=== Log clique consensus distance @ E1B20 ===
clique1_consensus_distance=0.036
clique2_consensus_distance=0.087



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.2563 top1= 21.7949


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.4185 top1= 21.5345


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.4191 top1= 22.7264

Train epoch 2
[E 2B0  |    448/60000 (  1%) ] Loss: 0.7309 top1= 80.1136

=== Log global consensus distance @ E2B0 ===
consensus_distance=0.078



=== Log clique consensus distance @ E2B0 ===
clique1_consensus_distance=0.058
clique2_consensus_distance=0.149


[E 2B10 |   4928/60000 (  8%) ] Loss: 0.5122 top1= 88.9205

=== Log global consensus distance @ E2B10 ===
consensus_distance=0.102



=== Log clique consensus distance @ E2B10 ===
clique1_consensus_distance=0.073
clique2_consensus_distance=0.200


[E 2B20 |   9408/60000 ( 16%) ] Loss: 0.4240 top1= 94.3182

=== Log global consensus distance @ E2B20 ===
consensus_distance=0.122



=== Log clique consensus distance @ E2B20 ===
clique1_consensus_distance=0.086
clique2_consensus_distance=0.239



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.2180 top1= 24.5493


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.6295 top1= 21.3942


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.6413 top1= 17.1875

Train epoch 3
[E 3B0  |    448/60000 (  1%) ] Loss: 0.3512 top1= 94.3182

=== Log global consensus distance @ E3B0 ===
consensus_distance=0.139



=== Log clique consensus distance @ E3B0 ===
clique1_consensus_distance=0.096
clique2_consensus_distance=0.274


[E 3B10 |   4928/60000 (  8%) ] Loss: 0.2849 top1= 95.7386

=== Log global consensus distance @ E3B10 ===
consensus_distance=0.153



=== Log clique consensus distance @ E3B10 ===
clique1_consensus_distance=0.105
clique2_consensus_distance=0.302


[E 3B20 |   9408/60000 ( 16%) ] Loss: 0.2865 top1= 96.0227

=== Log global consensus distance @ E3B20 ===
consensus_distance=0.166



=== Log clique consensus distance @ E3B20 ===
clique1_consensus_distance=0.111
clique2_consensus_distance=0.328



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.1777 top1= 28.2853


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.7426 top1= 22.4960


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.6912 top1= 25.5308

Train epoch 4
[E 4B0  |    448/60000 (  1%) ] Loss: 0.2509 top1= 95.4545

=== Log global consensus distance @ E4B0 ===
consensus_distance=0.179



=== Log clique consensus distance @ E4B0 ===
clique1_consensus_distance=0.118
clique2_consensus_distance=0.353


[E 4B10 |   4928/60000 (  8%) ] Loss: 0.2067 top1= 96.0227

=== Log global consensus distance @ E4B10 ===
consensus_distance=0.190



=== Log clique consensus distance @ E4B10 ===
clique1_consensus_distance=0.125
clique2_consensus_distance=0.375


[E 4B20 |   9408/60000 ( 16%) ] Loss: 0.2136 top1= 96.0227

=== Log global consensus distance @ E4B20 ===
consensus_distance=0.200



=== Log clique consensus distance @ E4B20 ===
clique1_consensus_distance=0.128
clique2_consensus_distance=0.397



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.1561 top1= 28.3954


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.7997 top1= 26.9932


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7302 top1= 25.9014

Train epoch 5
[E 5B0  |    448/60000 (  1%) ] Loss: 0.1959 top1= 96.3068

=== Log global consensus distance @ E5B0 ===
consensus_distance=0.210



=== Log clique consensus distance @ E5B0 ===
clique1_consensus_distance=0.133
clique2_consensus_distance=0.418


[E 5B10 |   4928/60000 (  8%) ] Loss: 0.1554 top1= 97.4432

=== Log global consensus distance @ E5B10 ===
consensus_distance=0.219



=== Log clique consensus distance @ E5B10 ===
clique1_consensus_distance=0.137
clique2_consensus_distance=0.437


[E 5B20 |   9408/60000 ( 16%) ] Loss: 0.1725 top1= 96.0227

=== Log global consensus distance @ E5B20 ===
consensus_distance=0.227



=== Log clique consensus distance @ E5B20 ===
clique1_consensus_distance=0.141
clique2_consensus_distance=0.454



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.1312 top1= 30.7792


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.8797 top1= 27.5140


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.8526 top1= 23.6278

Train epoch 6
[E 6B0  |    448/60000 (  1%) ] Loss: 0.1541 top1= 97.1591

=== Log global consensus distance @ E6B0 ===
consensus_distance=0.236



=== Log clique consensus distance @ E6B0 ===
clique1_consensus_distance=0.145
clique2_consensus_distance=0.472


[E 6B10 |   4928/60000 (  8%) ] Loss: 0.1273 top1= 98.2955

=== Log global consensus distance @ E6B10 ===
consensus_distance=0.244



=== Log clique consensus distance @ E6B10 ===
clique1_consensus_distance=0.149
clique2_consensus_distance=0.489


[E 6B20 |   9408/60000 ( 16%) ] Loss: 0.1488 top1= 96.0227

=== Log global consensus distance @ E6B20 ===
consensus_distance=0.251



=== Log clique consensus distance @ E6B20 ===
clique1_consensus_distance=0.153
clique2_consensus_distance=0.504



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.1171 top1= 32.2115


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.9565 top1= 27.0433


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.9401 top1= 22.1154

Train epoch 7
[E 7B0  |    448/60000 (  1%) ] Loss: 0.1273 top1= 98.0114

=== Log global consensus distance @ E7B0 ===
consensus_distance=0.259



=== Log clique consensus distance @ E7B0 ===
clique1_consensus_distance=0.156
clique2_consensus_distance=0.520


[E 7B10 |   4928/60000 (  8%) ] Loss: 0.1085 top1= 98.2955

=== Log global consensus distance @ E7B10 ===
consensus_distance=0.265



=== Log clique consensus distance @ E7B10 ===
clique1_consensus_distance=0.158
clique2_consensus_distance=0.535


[E 7B20 |   9408/60000 ( 16%) ] Loss: 0.1307 top1= 97.4432

=== Log global consensus distance @ E7B20 ===
consensus_distance=0.272



=== Log clique consensus distance @ E7B20 ===
clique1_consensus_distance=0.160
clique2_consensus_distance=0.551



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.1032 top1= 32.0813


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.9678 top1= 31.0998


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.0102 top1= 21.3742

Train epoch 8
[E 8B0  |    448/60000 (  1%) ] Loss: 0.1120 top1= 98.2955

=== Log global consensus distance @ E8B0 ===
consensus_distance=0.279



=== Log clique consensus distance @ E8B0 ===
clique1_consensus_distance=0.163
clique2_consensus_distance=0.566


[E 8B10 |   4928/60000 (  8%) ] Loss: 0.0964 top1= 98.2955

=== Log global consensus distance @ E8B10 ===
consensus_distance=0.285



=== Log clique consensus distance @ E8B10 ===
clique1_consensus_distance=0.165
clique2_consensus_distance=0.578


[E 8B20 |   9408/60000 ( 16%) ] Loss: 0.1192 top1= 97.7273

=== Log global consensus distance @ E8B20 ===
consensus_distance=0.291



=== Log clique consensus distance @ E8B20 ===
clique1_consensus_distance=0.168
clique2_consensus_distance=0.591



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.0915 top1= 32.7524


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.0225 top1= 31.2300


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.1919 top1= 18.5998

Train epoch 9
[E 9B0  |    448/60000 (  1%) ] Loss: 0.0927 top1= 98.2955

=== Log global consensus distance @ E9B0 ===
consensus_distance=0.297



=== Log clique consensus distance @ E9B0 ===
clique1_consensus_distance=0.171
clique2_consensus_distance=0.604


[E 9B10 |   4928/60000 (  8%) ] Loss: 0.0851 top1= 98.5795

=== Log global consensus distance @ E9B10 ===
consensus_distance=0.302



=== Log clique consensus distance @ E9B10 ===
clique1_consensus_distance=0.172
clique2_consensus_distance=0.617


[E 9B20 |   9408/60000 ( 16%) ] Loss: 0.1081 top1= 97.4432

=== Log global consensus distance @ E9B20 ===
consensus_distance=0.307



=== Log clique consensus distance @ E9B20 ===
clique1_consensus_distance=0.173
clique2_consensus_distance=0.629



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.0791 top1= 33.0529


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.0521 top1= 33.0729


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.1931 top1= 19.8217

Train epoch 10
[E10B0  |    448/60000 (  1%) ] Loss: 0.0853 top1= 98.2955

=== Log global consensus distance @ E10B0 ===
consensus_distance=0.313



=== Log clique consensus distance @ E10B0 ===
clique1_consensus_distance=0.175
clique2_consensus_distance=0.642


[E10B10 |   4928/60000 (  8%) ] Loss: 0.0772 top1= 98.8636

=== Log global consensus distance @ E10B10 ===
consensus_distance=0.319



=== Log clique consensus distance @ E10B10 ===
clique1_consensus_distance=0.177
clique2_consensus_distance=0.653


[E10B20 |   9408/60000 ( 16%) ] Loss: 0.0976 top1= 97.7273

=== Log global consensus distance @ E10B20 ===
consensus_distance=0.324



=== Log clique consensus distance @ E10B20 ===
clique1_consensus_distance=0.180
clique2_consensus_distance=0.665



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.0695 top1= 33.9443


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.1035 top1= 32.8926


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.1765 top1= 21.2640

Train epoch 11
[E11B0  |    448/60000 (  1%) ] Loss: 0.0809 top1= 98.2955

=== Log global consensus distance @ E11B0 ===
consensus_distance=0.330



=== Log clique consensus distance @ E11B0 ===
clique1_consensus_distance=0.182
clique2_consensus_distance=0.677


[E11B10 |   4928/60000 (  8%) ] Loss: 0.0717 top1= 98.5795

=== Log global consensus distance @ E11B10 ===
consensus_distance=0.334



=== Log clique consensus distance @ E11B10 ===
clique1_consensus_distance=0.184
clique2_consensus_distance=0.685


[E11B20 |   9408/60000 ( 16%) ] Loss: 0.0965 top1= 98.0114

=== Log global consensus distance @ E11B20 ===
consensus_distance=0.338



=== Log clique consensus distance @ E11B20 ===
clique1_consensus_distance=0.186
clique2_consensus_distance=0.696



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.0632 top1= 33.7440


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.1369 top1= 33.3233


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.3906 top1= 18.5296

Train epoch 12
[E12B0  |    448/60000 (  1%) ] Loss: 0.0686 top1= 98.8636

=== Log global consensus distance @ E12B0 ===
consensus_distance=0.343



=== Log clique consensus distance @ E12B0 ===
clique1_consensus_distance=0.188
clique2_consensus_distance=0.707


[E12B10 |   4928/60000 (  8%) ] Loss: 0.0641 top1= 99.4318

=== Log global consensus distance @ E12B10 ===
consensus_distance=0.348



=== Log clique consensus distance @ E12B10 ===
clique1_consensus_distance=0.188
clique2_consensus_distance=0.718


[E12B20 |   9408/60000 ( 16%) ] Loss: 0.0883 top1= 98.0114

=== Log global consensus distance @ E12B20 ===
consensus_distance=0.352



=== Log clique consensus distance @ E12B20 ===
clique1_consensus_distance=0.190
clique2_consensus_distance=0.727



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.0573 top1= 34.0845


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.1743 top1= 33.7240


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.4642 top1= 17.9988

Train epoch 13
[E13B0  |    448/60000 (  1%) ] Loss: 0.0625 top1= 99.4318

=== Log global consensus distance @ E13B0 ===
consensus_distance=0.356



=== Log clique consensus distance @ E13B0 ===
clique1_consensus_distance=0.191
clique2_consensus_distance=0.737


[E13B10 |   4928/60000 (  8%) ] Loss: 0.0594 top1= 99.4318

=== Log global consensus distance @ E13B10 ===
consensus_distance=0.360



=== Log clique consensus distance @ E13B10 ===
clique1_consensus_distance=0.193
clique2_consensus_distance=0.746


[E13B20 |   9408/60000 ( 16%) ] Loss: 0.0806 top1= 97.7273

=== Log global consensus distance @ E13B20 ===
consensus_distance=0.364



=== Log clique consensus distance @ E13B20 ===
clique1_consensus_distance=0.193
clique2_consensus_distance=0.756



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9385 top1= 46.6046


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.2195 top1= 33.9042


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.4045 top1= 19.6114

Train epoch 14
[E14B0  |    448/60000 (  1%) ] Loss: 0.0597 top1= 99.1477

=== Log global consensus distance @ E14B0 ===
consensus_distance=0.344



=== Log clique consensus distance @ E14B0 ===
clique1_consensus_distance=0.194
clique2_consensus_distance=0.764


[E14B10 |   4928/60000 (  8%) ] Loss: 0.0531 top1= 99.4318

=== Log global consensus distance @ E14B10 ===
consensus_distance=0.345



=== Log clique consensus distance @ E14B10 ===
clique1_consensus_distance=0.196
clique2_consensus_distance=0.773


[E14B20 |   9408/60000 ( 16%) ] Loss: 0.0657 top1= 98.2955

=== Log global consensus distance @ E14B20 ===
consensus_distance=0.350



=== Log clique consensus distance @ E14B20 ===
clique1_consensus_distance=0.197
clique2_consensus_distance=0.783



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9867 top1= 37.1795


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.2727 top1= 33.2031


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.4559 top1= 18.8602

Train epoch 15
[E15B0  |    448/60000 (  1%) ] Loss: 0.0416 top1= 99.4318

=== Log global consensus distance @ E15B0 ===
consensus_distance=0.355



=== Log clique consensus distance @ E15B0 ===
clique1_consensus_distance=0.199
clique2_consensus_distance=0.793


[E15B10 |   4928/60000 (  8%) ] Loss: 0.0377 top1= 99.4318

=== Log global consensus distance @ E15B10 ===
consensus_distance=0.357



=== Log clique consensus distance @ E15B10 ===
clique1_consensus_distance=0.201
clique2_consensus_distance=0.799


[E15B20 |   9408/60000 ( 16%) ] Loss: 0.0598 top1= 98.5795

=== Log global consensus distance @ E15B20 ===
consensus_distance=0.360



=== Log clique consensus distance @ E15B20 ===
clique1_consensus_distance=0.202
clique2_consensus_distance=0.808



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9804 top1= 37.4299


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.3111 top1= 33.3534


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.5238 top1= 18.5096

Train epoch 16
[E16B0  |    448/60000 (  1%) ] Loss: 0.0369 top1= 99.7159

=== Log global consensus distance @ E16B0 ===
consensus_distance=0.364



=== Log clique consensus distance @ E16B0 ===
clique1_consensus_distance=0.204
clique2_consensus_distance=0.817


[E16B10 |   4928/60000 (  8%) ] Loss: 0.0346 top1= 99.4318

=== Log global consensus distance @ E16B10 ===
consensus_distance=0.368



=== Log clique consensus distance @ E16B10 ===
clique1_consensus_distance=0.205
clique2_consensus_distance=0.824


[E16B20 |   9408/60000 ( 16%) ] Loss: 0.0626 top1= 98.0114

=== Log global consensus distance @ E16B20 ===
consensus_distance=0.370



=== Log clique consensus distance @ E16B20 ===
clique1_consensus_distance=0.206
clique2_consensus_distance=0.829



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9559 top1= 39.4932


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.3604 top1= 32.4619


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.4672 top1= 19.8618

Train epoch 17
[E17B0  |    448/60000 (  1%) ] Loss: 0.0343 top1= 99.7159

=== Log global consensus distance @ E17B0 ===
consensus_distance=0.373



=== Log clique consensus distance @ E17B0 ===
clique1_consensus_distance=0.207
clique2_consensus_distance=0.837


[E17B10 |   4928/60000 (  8%) ] Loss: 0.0312 top1= 99.7159

=== Log global consensus distance @ E17B10 ===
consensus_distance=0.376



=== Log clique consensus distance @ E17B10 ===
clique1_consensus_distance=0.209
clique2_consensus_distance=0.844


[E17B20 |   9408/60000 ( 16%) ] Loss: 0.0516 top1= 98.5795

=== Log global consensus distance @ E17B20 ===
consensus_distance=0.379



=== Log clique consensus distance @ E17B20 ===
clique1_consensus_distance=0.210
clique2_consensus_distance=0.851



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9450 top1= 40.1542


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.4174 top1= 31.3001


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.5782 top1= 19.2909

Train epoch 18
[E18B0  |    448/60000 (  1%) ] Loss: 0.0292 top1= 99.7159

=== Log global consensus distance @ E18B0 ===
consensus_distance=0.382



=== Log clique consensus distance @ E18B0 ===
clique1_consensus_distance=0.211
clique2_consensus_distance=0.859


[E18B10 |   4928/60000 (  8%) ] Loss: 0.0295 top1= 99.7159

=== Log global consensus distance @ E18B10 ===
consensus_distance=0.384



=== Log clique consensus distance @ E18B10 ===
clique1_consensus_distance=0.211
clique2_consensus_distance=0.865


[E18B20 |   9408/60000 ( 16%) ] Loss: 0.0484 top1= 98.5795

=== Log global consensus distance @ E18B20 ===
consensus_distance=0.387



=== Log clique consensus distance @ E18B20 ===
clique1_consensus_distance=0.212
clique2_consensus_distance=0.871



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9387 top1= 40.4748


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.4739 top1= 30.1583


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.6142 top1= 19.7316

Train epoch 19
[E19B0  |    448/60000 (  1%) ] Loss: 0.0273 top1=100.0000

=== Log global consensus distance @ E19B0 ===
consensus_distance=0.390



=== Log clique consensus distance @ E19B0 ===
clique1_consensus_distance=0.214
clique2_consensus_distance=0.878


[E19B10 |   4928/60000 (  8%) ] Loss: 0.0265 top1=100.0000

=== Log global consensus distance @ E19B10 ===
consensus_distance=0.392



=== Log clique consensus distance @ E19B10 ===
clique1_consensus_distance=0.215
clique2_consensus_distance=0.884


[E19B20 |   9408/60000 ( 16%) ] Loss: 0.0459 top1= 98.5795

=== Log global consensus distance @ E19B20 ===
consensus_distance=0.395



=== Log clique consensus distance @ E19B20 ===
clique1_consensus_distance=0.217
clique2_consensus_distance=0.891



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9335 top1= 40.5349


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.5130 top1= 30.5689


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.6801 top1= 19.5613

Train epoch 20
[E20B0  |    448/60000 (  1%) ] Loss: 0.0248 top1=100.0000

=== Log global consensus distance @ E20B0 ===
consensus_distance=0.398



=== Log clique consensus distance @ E20B0 ===
clique1_consensus_distance=0.218
clique2_consensus_distance=0.897


[E20B10 |   4928/60000 (  8%) ] Loss: 0.0241 top1=100.0000

=== Log global consensus distance @ E20B10 ===
consensus_distance=0.400



=== Log clique consensus distance @ E20B10 ===
clique1_consensus_distance=0.219
clique2_consensus_distance=0.902


[E20B20 |   9408/60000 ( 16%) ] Loss: 0.0457 top1= 98.5795

=== Log global consensus distance @ E20B20 ===
consensus_distance=0.402



=== Log clique consensus distance @ E20B20 ===
clique1_consensus_distance=0.221
clique2_consensus_distance=0.908



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9256 top1= 41.0958


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.5522 top1= 30.3686


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.7051 top1= 20.0421

Train epoch 21
[E21B0  |    448/60000 (  1%) ] Loss: 0.0226 top1=100.0000

=== Log global consensus distance @ E21B0 ===
consensus_distance=0.405



=== Log clique consensus distance @ E21B0 ===
clique1_consensus_distance=0.222
clique2_consensus_distance=0.914


[E21B10 |   4928/60000 (  8%) ] Loss: 0.0228 top1=100.0000

=== Log global consensus distance @ E21B10 ===
consensus_distance=0.407



=== Log clique consensus distance @ E21B10 ===
clique1_consensus_distance=0.222
clique2_consensus_distance=0.919


[E21B20 |   9408/60000 ( 16%) ] Loss: 0.0420 top1= 98.5795

=== Log global consensus distance @ E21B20 ===
consensus_distance=0.409



=== Log clique consensus distance @ E21B20 ===
clique1_consensus_distance=0.223
clique2_consensus_distance=0.925



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9208 top1= 41.4764


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.6142 top1= 28.7660


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.7384 top1= 20.1422

Train epoch 22
[E22B0  |    448/60000 (  1%) ] Loss: 0.0231 top1=100.0000

=== Log global consensus distance @ E22B0 ===
consensus_distance=0.411



=== Log clique consensus distance @ E22B0 ===
clique1_consensus_distance=0.225
clique2_consensus_distance=0.930


[E22B10 |   4928/60000 (  8%) ] Loss: 0.0227 top1=100.0000

=== Log global consensus distance @ E22B10 ===
consensus_distance=0.413



=== Log clique consensus distance @ E22B10 ===
clique1_consensus_distance=0.226
clique2_consensus_distance=0.935


[E22B20 |   9408/60000 ( 16%) ] Loss: 0.0415 top1= 98.5795

=== Log global consensus distance @ E22B20 ===
consensus_distance=0.416



=== Log clique consensus distance @ E22B20 ===
clique1_consensus_distance=0.227
clique2_consensus_distance=0.940



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9199 top1= 41.5264


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.6597 top1= 28.1550


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.7700 top1= 20.2925

Train epoch 23
[E23B0  |    448/60000 (  1%) ] Loss: 0.0213 top1=100.0000

=== Log global consensus distance @ E23B0 ===
consensus_distance=0.418



=== Log clique consensus distance @ E23B0 ===
clique1_consensus_distance=0.228
clique2_consensus_distance=0.945


[E23B10 |   4928/60000 (  8%) ] Loss: 0.0208 top1=100.0000

=== Log global consensus distance @ E23B10 ===
consensus_distance=0.420



=== Log clique consensus distance @ E23B10 ===
clique1_consensus_distance=0.229
clique2_consensus_distance=0.950


[E23B20 |   9408/60000 ( 16%) ] Loss: 0.0390 top1= 98.8636

=== Log global consensus distance @ E23B20 ===
consensus_distance=0.422



=== Log clique consensus distance @ E23B20 ===
clique1_consensus_distance=0.230
clique2_consensus_distance=0.956



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9166 top1= 41.6166


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.7191 top1= 27.0933


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.7944 top1= 20.6530

Train epoch 24
[E24B0  |    448/60000 (  1%) ] Loss: 0.0205 top1=100.0000

=== Log global consensus distance @ E24B0 ===
consensus_distance=0.424



=== Log clique consensus distance @ E24B0 ===
clique1_consensus_distance=0.231
clique2_consensus_distance=0.962


[E24B10 |   4928/60000 (  8%) ] Loss: 0.0200 top1=100.0000

=== Log global consensus distance @ E24B10 ===
consensus_distance=0.427



=== Log clique consensus distance @ E24B10 ===
clique1_consensus_distance=0.232
clique2_consensus_distance=0.967


[E24B20 |   9408/60000 ( 16%) ] Loss: 0.0370 top1= 98.5795

=== Log global consensus distance @ E24B20 ===
consensus_distance=0.429



=== Log clique consensus distance @ E24B20 ===
clique1_consensus_distance=0.233
clique2_consensus_distance=0.971



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9109 top1= 41.9471


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.7449 top1= 27.7043


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.8323 top1= 20.6130

Train epoch 25
[E25B0  |    448/60000 (  1%) ] Loss: 0.0188 top1=100.0000

=== Log global consensus distance @ E25B0 ===
consensus_distance=0.431



=== Log clique consensus distance @ E25B0 ===
clique1_consensus_distance=0.235
clique2_consensus_distance=0.976


[E25B10 |   4928/60000 (  8%) ] Loss: 0.0191 top1=100.0000

=== Log global consensus distance @ E25B10 ===
consensus_distance=0.433



=== Log clique consensus distance @ E25B10 ===
clique1_consensus_distance=0.236
clique2_consensus_distance=0.980


[E25B20 |   9408/60000 ( 16%) ] Loss: 0.0351 top1= 98.8636

=== Log global consensus distance @ E25B20 ===
consensus_distance=0.434



=== Log clique consensus distance @ E25B20 ===
clique1_consensus_distance=0.236
clique2_consensus_distance=0.985



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9095 top1= 42.0773


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.8272 top1= 25.7712


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.8568 top1= 20.7532

Train epoch 26
[E26B0  |    448/60000 (  1%) ] Loss: 0.0184 top1=100.0000

=== Log global consensus distance @ E26B0 ===
consensus_distance=0.436



=== Log clique consensus distance @ E26B0 ===
clique1_consensus_distance=0.237
clique2_consensus_distance=0.990


[E26B10 |   4928/60000 (  8%) ] Loss: 0.0188 top1=100.0000

=== Log global consensus distance @ E26B10 ===
consensus_distance=0.438



=== Log clique consensus distance @ E26B10 ===
clique1_consensus_distance=0.238
clique2_consensus_distance=0.994


[E26B20 |   9408/60000 ( 16%) ] Loss: 0.0331 top1= 98.8636

=== Log global consensus distance @ E26B20 ===
consensus_distance=0.440



=== Log clique consensus distance @ E26B20 ===
clique1_consensus_distance=0.239
clique2_consensus_distance=0.999



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9050 top1= 42.2376


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.8561 top1= 25.6711


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.8870 top1= 20.6030

Train epoch 27
[E27B0  |    448/60000 (  1%) ] Loss: 0.0179 top1=100.0000

=== Log global consensus distance @ E27B0 ===
consensus_distance=0.442



=== Log clique consensus distance @ E27B0 ===
clique1_consensus_distance=0.240
clique2_consensus_distance=1.003


[E27B10 |   4928/60000 (  8%) ] Loss: 0.0182 top1=100.0000

=== Log global consensus distance @ E27B10 ===
consensus_distance=0.444



=== Log clique consensus distance @ E27B10 ===
clique1_consensus_distance=0.242
clique2_consensus_distance=1.006


[E27B20 |   9408/60000 ( 16%) ] Loss: 0.0328 top1= 98.8636

=== Log global consensus distance @ E27B20 ===
consensus_distance=0.446



=== Log clique consensus distance @ E27B20 ===
clique1_consensus_distance=0.243
clique2_consensus_distance=1.011



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9016 top1= 42.6182


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.8771 top1= 26.0417


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.8965 top1= 21.1038

Train epoch 28
[E28B0  |    448/60000 (  1%) ] Loss: 0.0170 top1=100.0000

=== Log global consensus distance @ E28B0 ===
consensus_distance=0.448



=== Log clique consensus distance @ E28B0 ===
clique1_consensus_distance=0.244
clique2_consensus_distance=1.016


[E28B10 |   4928/60000 (  8%) ] Loss: 0.0167 top1=100.0000

=== Log global consensus distance @ E28B10 ===
consensus_distance=0.450



=== Log clique consensus distance @ E28B10 ===
clique1_consensus_distance=0.244
clique2_consensus_distance=1.021


[E28B20 |   9408/60000 ( 16%) ] Loss: 0.0318 top1= 99.1477

=== Log global consensus distance @ E28B20 ===
consensus_distance=0.452



=== Log clique consensus distance @ E28B20 ===
clique1_consensus_distance=0.246
clique2_consensus_distance=1.026



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9003 top1= 42.8285


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.9675 top1= 24.4591


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.9305 top1= 21.0337

Train epoch 29
[E29B0  |    448/60000 (  1%) ] Loss: 0.0168 top1=100.0000

=== Log global consensus distance @ E29B0 ===
consensus_distance=0.454



=== Log clique consensus distance @ E29B0 ===
clique1_consensus_distance=0.246
clique2_consensus_distance=1.031


[E29B10 |   4928/60000 (  8%) ] Loss: 0.0162 top1=100.0000

=== Log global consensus distance @ E29B10 ===
consensus_distance=0.455



=== Log clique consensus distance @ E29B10 ===
clique1_consensus_distance=0.247
clique2_consensus_distance=1.034


[E29B20 |   9408/60000 ( 16%) ] Loss: 0.0298 top1= 98.8636

=== Log global consensus distance @ E29B20 ===
consensus_distance=0.457



=== Log clique consensus distance @ E29B20 ===
clique1_consensus_distance=0.249
clique2_consensus_distance=1.038



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8968 top1= 42.7584


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.9930 top1= 24.6294


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.9506 top1= 21.1038

Train epoch 30
[E30B0  |    448/60000 (  1%) ] Loss: 0.0155 top1=100.0000

=== Log global consensus distance @ E30B0 ===
consensus_distance=0.459



=== Log clique consensus distance @ E30B0 ===
clique1_consensus_distance=0.249
clique2_consensus_distance=1.043


[E30B10 |   4928/60000 (  8%) ] Loss: 0.0155 top1=100.0000

=== Log global consensus distance @ E30B10 ===
consensus_distance=0.460



=== Log clique consensus distance @ E30B10 ===
clique1_consensus_distance=0.250
clique2_consensus_distance=1.047


[E30B20 |   9408/60000 ( 16%) ] Loss: 0.0288 top1= 99.1477

=== Log global consensus distance @ E30B20 ===
consensus_distance=0.462



=== Log clique consensus distance @ E30B20 ===
clique1_consensus_distance=0.251
clique2_consensus_distance=1.050



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8935 top1= 43.0288


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.0440 top1= 24.1787


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.9731 top1= 20.9635

Train epoch 31
[E31B0  |    448/60000 (  1%) ] Loss: 0.0156 top1=100.0000

=== Log global consensus distance @ E31B0 ===
consensus_distance=0.464



=== Log clique consensus distance @ E31B0 ===
clique1_consensus_distance=0.253
clique2_consensus_distance=1.054


[E31B10 |   4928/60000 (  8%) ] Loss: 0.0154 top1=100.0000

=== Log global consensus distance @ E31B10 ===
consensus_distance=0.466



=== Log clique consensus distance @ E31B10 ===
clique1_consensus_distance=0.254
clique2_consensus_distance=1.057


[E31B20 |   9408/60000 ( 16%) ] Loss: 0.0282 top1= 99.1477

=== Log global consensus distance @ E31B20 ===
consensus_distance=0.467



=== Log clique consensus distance @ E31B20 ===
clique1_consensus_distance=0.255
clique2_consensus_distance=1.060



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8947 top1= 43.1591


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.0131 top1= 25.7812


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.9740 top1= 21.4944

Train epoch 32
[E32B0  |    448/60000 (  1%) ] Loss: 0.0151 top1=100.0000

=== Log global consensus distance @ E32B0 ===
consensus_distance=0.469



=== Log clique consensus distance @ E32B0 ===
clique1_consensus_distance=0.256
clique2_consensus_distance=1.064


[E32B10 |   4928/60000 (  8%) ] Loss: 0.0151 top1=100.0000

=== Log global consensus distance @ E32B10 ===
consensus_distance=0.471



=== Log clique consensus distance @ E32B10 ===
clique1_consensus_distance=0.257
clique2_consensus_distance=1.069


[E32B20 |   9408/60000 ( 16%) ] Loss: 0.0272 top1= 99.1477

=== Log global consensus distance @ E32B20 ===
consensus_distance=0.473



=== Log clique consensus distance @ E32B20 ===
clique1_consensus_distance=0.258
clique2_consensus_distance=1.073



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8920 top1= 43.1290


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.0861 top1= 24.6995


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.0052 top1= 21.5545

Train epoch 33
[E33B0  |    448/60000 (  1%) ] Loss: 0.0140 top1=100.0000

=== Log global consensus distance @ E33B0 ===
consensus_distance=0.475



=== Log clique consensus distance @ E33B0 ===
clique1_consensus_distance=0.259
clique2_consensus_distance=1.078


[E33B10 |   4928/60000 (  8%) ] Loss: 0.0135 top1=100.0000

=== Log global consensus distance @ E33B10 ===
consensus_distance=0.476



=== Log clique consensus distance @ E33B10 ===
clique1_consensus_distance=0.260
clique2_consensus_distance=1.082


[E33B20 |   9408/60000 ( 16%) ] Loss: 0.0248 top1= 99.1477

=== Log global consensus distance @ E33B20 ===
consensus_distance=0.478



=== Log clique consensus distance @ E33B20 ===
clique1_consensus_distance=0.261
clique2_consensus_distance=1.085



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8906 top1= 43.2792


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.0940 top1= 25.2504


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.0370 top1= 21.2640

Train epoch 34
[E34B0  |    448/60000 (  1%) ] Loss: 0.0135 top1=100.0000

=== Log global consensus distance @ E34B0 ===
consensus_distance=0.479



=== Log clique consensus distance @ E34B0 ===
clique1_consensus_distance=0.262
clique2_consensus_distance=1.088


[E34B10 |   4928/60000 (  8%) ] Loss: 0.0135 top1=100.0000

=== Log global consensus distance @ E34B10 ===
consensus_distance=0.480



=== Log clique consensus distance @ E34B10 ===
clique1_consensus_distance=0.262
clique2_consensus_distance=1.091


[E34B20 |   9408/60000 ( 16%) ] Loss: 0.0243 top1= 99.1477

=== Log global consensus distance @ E34B20 ===
consensus_distance=0.482



=== Log clique consensus distance @ E34B20 ===
clique1_consensus_distance=0.263
clique2_consensus_distance=1.096



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8882 top1= 43.4395


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.1800 top1= 23.7981


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.0569 top1= 21.2640

Train epoch 35
[E35B0  |    448/60000 (  1%) ] Loss: 0.0136 top1=100.0000

=== Log global consensus distance @ E35B0 ===
consensus_distance=0.484



=== Log clique consensus distance @ E35B0 ===
clique1_consensus_distance=0.264
clique2_consensus_distance=1.099


[E35B10 |   4928/60000 (  8%) ] Loss: 0.0131 top1=100.0000

=== Log global consensus distance @ E35B10 ===
consensus_distance=0.485



=== Log clique consensus distance @ E35B10 ===
clique1_consensus_distance=0.265
clique2_consensus_distance=1.103


[E35B20 |   9408/60000 ( 16%) ] Loss: 0.0226 top1= 99.4318

=== Log global consensus distance @ E35B20 ===
consensus_distance=0.487



=== Log clique consensus distance @ E35B20 ===
clique1_consensus_distance=0.266
clique2_consensus_distance=1.106



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8905 top1= 43.3393


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.1780 top1= 24.3389


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.0813 top1= 20.9936

Train epoch 36
[E36B0  |    448/60000 (  1%) ] Loss: 0.0123 top1=100.0000

=== Log global consensus distance @ E36B0 ===
consensus_distance=0.488



=== Log clique consensus distance @ E36B0 ===
clique1_consensus_distance=0.267
clique2_consensus_distance=1.108


[E36B10 |   4928/60000 (  8%) ] Loss: 0.0135 top1=100.0000

=== Log global consensus distance @ E36B10 ===
consensus_distance=0.489



=== Log clique consensus distance @ E36B10 ===
clique1_consensus_distance=0.268
clique2_consensus_distance=1.111


[E36B20 |   9408/60000 ( 16%) ] Loss: 0.0234 top1= 99.7159

=== Log global consensus distance @ E36B20 ===
consensus_distance=0.491



=== Log clique consensus distance @ E36B20 ===
clique1_consensus_distance=0.269
clique2_consensus_distance=1.116



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8840 top1= 43.6298


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.2170 top1= 24.1787


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.0686 top1= 21.8850

Train epoch 37
[E37B0  |    448/60000 (  1%) ] Loss: 0.0129 top1=100.0000

=== Log global consensus distance @ E37B0 ===
consensus_distance=0.493



=== Log clique consensus distance @ E37B0 ===
clique1_consensus_distance=0.270
clique2_consensus_distance=1.119


[E37B10 |   4928/60000 (  8%) ] Loss: 0.0126 top1=100.0000

=== Log global consensus distance @ E37B10 ===
consensus_distance=0.495



=== Log clique consensus distance @ E37B10 ===
clique1_consensus_distance=0.271
clique2_consensus_distance=1.124


[E37B20 |   9408/60000 ( 16%) ] Loss: 0.0215 top1= 99.7159

=== Log global consensus distance @ E37B20 ===
consensus_distance=0.496



=== Log clique consensus distance @ E37B20 ===
clique1_consensus_distance=0.271
clique2_consensus_distance=1.128



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8834 top1= 43.7800


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.2513 top1= 24.0885


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.1020 top1= 21.6346

Train epoch 38
[E38B0  |    448/60000 (  1%) ] Loss: 0.0121 top1=100.0000

=== Log global consensus distance @ E38B0 ===
consensus_distance=0.498



=== Log clique consensus distance @ E38B0 ===
clique1_consensus_distance=0.273
clique2_consensus_distance=1.130


[E38B10 |   4928/60000 (  8%) ] Loss: 0.0124 top1=100.0000

=== Log global consensus distance @ E38B10 ===
consensus_distance=0.499



=== Log clique consensus distance @ E38B10 ===
clique1_consensus_distance=0.274
clique2_consensus_distance=1.133


[E38B20 |   9408/60000 ( 16%) ] Loss: 0.0212 top1= 99.4318

=== Log global consensus distance @ E38B20 ===
consensus_distance=0.500



=== Log clique consensus distance @ E38B20 ===
clique1_consensus_distance=0.274
clique2_consensus_distance=1.137



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8810 top1= 43.7400


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.2937 top1= 23.8882


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.1140 top1= 21.7448

Train epoch 39
[E39B0  |    448/60000 (  1%) ] Loss: 0.0122 top1=100.0000

=== Log global consensus distance @ E39B0 ===
consensus_distance=0.502



=== Log clique consensus distance @ E39B0 ===
clique1_consensus_distance=0.275
clique2_consensus_distance=1.140


[E39B10 |   4928/60000 (  8%) ] Loss: 0.0116 top1=100.0000

=== Log global consensus distance @ E39B10 ===
consensus_distance=0.503



=== Log clique consensus distance @ E39B10 ===
clique1_consensus_distance=0.276
clique2_consensus_distance=1.143


[E39B20 |   9408/60000 ( 16%) ] Loss: 0.0208 top1= 99.4318

=== Log global consensus distance @ E39B20 ===
consensus_distance=0.504



=== Log clique consensus distance @ E39B20 ===
clique1_consensus_distance=0.277
clique2_consensus_distance=1.146



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8783 top1= 43.9904


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.3364 top1= 23.4776


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.1332 top1= 21.5845

Train epoch 40
[E40B0  |    448/60000 (  1%) ] Loss: 0.0118 top1=100.0000

=== Log global consensus distance @ E40B0 ===
consensus_distance=0.506



=== Log clique consensus distance @ E40B0 ===
clique1_consensus_distance=0.278
clique2_consensus_distance=1.149


[E40B10 |   4928/60000 (  8%) ] Loss: 0.0116 top1=100.0000

=== Log global consensus distance @ E40B10 ===
consensus_distance=0.507



=== Log clique consensus distance @ E40B10 ===
clique1_consensus_distance=0.278
clique2_consensus_distance=1.152


[E40B20 |   9408/60000 ( 16%) ] Loss: 0.0206 top1= 99.7159

=== Log global consensus distance @ E40B20 ===
consensus_distance=0.509



=== Log clique consensus distance @ E40B20 ===
clique1_consensus_distance=0.279
clique2_consensus_distance=1.154



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8803 top1= 43.8101


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.3180 top1= 24.2188


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.1324 top1= 21.9451

