
=== Start adding workers ===
=> Add worker SGDMWorker(index=0, momentum=0.9)
=> Add worker SGDMWorker(index=1, momentum=0.9)
=> Add worker SGDMWorker(index=2, momentum=0.9)
=> Add worker SGDMWorker(index=3, momentum=0.9)
=> Add worker SGDMWorker(index=4, momentum=0.9)
=> Add worker SGDMWorker(index=5, momentum=0.9)
=> Add worker SGDMWorker(index=6, momentum=0.9)
=> Add worker SGDMWorker(index=7, momentum=0.9)
=> Add worker SGDMWorker(index=8, momentum=0.9)
=> Add worker SGDMWorker(index=9, momentum=0.9)
=> Add worker SGDMWorker(index=10, momentum=0.9)
=> Add worker ByzantineWorker(index=11)

=== Start adding graph ===
TwoCliquesWithByzantine(m=5,b=1)

Train epoch 1
[E 1B0  |    384/60000 (  1%) ] Loss: 2.3142 top1=  7.6705

=== Peeking data label distribution E1B0 ===
Worker 0 has targets: tensor([0, 0, 0, 0, 0], device='cuda:0')
Worker 1 has targets: tensor([1, 1, 1, 0, 1], device='cuda:0')
Worker 2 has targets: tensor([1, 1, 2, 1, 1], device='cuda:0')
Worker 3 has targets: tensor([2, 2, 3, 2, 2], device='cuda:0')
Worker 4 has targets: tensor([3, 3, 3, 3, 3], device='cuda:0')
Worker 5 has targets: tensor([4, 4, 4, 4, 4], device='cuda:0')
Worker 6 has targets: tensor([5, 5, 5, 5, 5], device='cuda:0')
Worker 7 has targets: tensor([6, 6, 6, 5, 6], device='cuda:0')
Worker 8 has targets: tensor([6, 7, 7, 6, 6], device='cuda:0')
Worker 9 has targets: tensor([7, 7, 8, 7, 7], device='cuda:0')
Worker 10 has targets: tensor([8, 8, 9, 8, 8], device='cuda:0')
Worker 11 has targets: tensor([9, 9, 9, 9, 9], device='cuda:0')



=== Log global consensus distance @ E1B0 ===
consensus_distance=0.001



=== Log clique consensus distance @ E1B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.002



=== Log mixing matrix @ E1B0 ===
[[0.167 0.167 0.167 0.167 0.167 0.    0.    0.    0.    0.    0.167 0.   ]
 [0.167 0.233 0.2   0.2   0.2   0.    0.    0.    0.    0.    0.    0.   ]
 [0.167 0.2   0.233 0.2   0.2   0.    0.    0.    0.    0.    0.    0.   ]
 [0.167 0.2   0.2   0.233 0.2   0.    0.    0.    0.    0.    0.    0.   ]
 [0.167 0.2   0.2   0.2   0.233 0.    0.    0.    0.    0.    0.    0.   ]
 [0.    0.    0.    0.    0.    0.233 0.2   0.2   0.2   0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.2   0.233 0.2   0.2   0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.2   0.2   0.233 0.2   0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.2   0.2   0.2   0.233 0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.167 0.167 0.167 0.167 0.167 0.167 0.   ]
 [0.167 0.    0.    0.    0.    0.    0.    0.    0.    0.167 0.417 0.25 ]
 [0.    0.    0.    0.    0.    0.    0.    0.    0.    0.    0.25  0.75 ]]


[E 1B10 |   4224/60000 (  7%) ] Loss: 0.2990 top1= 88.0682

=== Log global consensus distance @ E1B10 ===
consensus_distance=0.862



=== Log clique consensus distance @ E1B10 ===
clique1_consensus_distance=0.470
clique2_consensus_distance=1.775


[E 1B20 |   8064/60000 ( 13%) ] Loss: 0.2284 top1= 92.0455

=== Log global consensus distance @ E1B20 ===
consensus_distance=1.410



=== Log clique consensus distance @ E1B20 ===
clique1_consensus_distance=0.554
clique2_consensus_distance=3.238



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6183 top1= 57.6723


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.9834 top1= 38.9724


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.5395 top1= 35.1262

Train epoch 2
[E 2B0  |    384/60000 (  1%) ] Loss: 0.0570 top1= 98.5795

=== Log global consensus distance @ E2B0 ===
consensus_distance=1.360



=== Log clique consensus distance @ E2B0 ===
clique1_consensus_distance=0.294
clique2_consensus_distance=3.552


[E 2B10 |   4224/60000 (  7%) ] Loss: 0.0789 top1= 97.1591

=== Log global consensus distance @ E2B10 ===
consensus_distance=1.208



=== Log clique consensus distance @ E2B10 ===
clique1_consensus_distance=0.077
clique2_consensus_distance=3.506


[E 2B20 |   8064/60000 ( 13%) ] Loss: 0.0789 top1= 97.7273

=== Log global consensus distance @ E2B20 ===
consensus_distance=1.174



=== Log clique consensus distance @ E2B20 ===
clique1_consensus_distance=0.015
clique2_consensus_distance=3.552



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.4389 top1= 54.4471


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.6336 top1= 42.4079


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.6279 top1= 36.9692

Train epoch 3
[E 3B0  |    384/60000 (  1%) ] Loss: 0.0451 top1= 98.5795

=== Log global consensus distance @ E3B0 ===
consensus_distance=1.216



=== Log clique consensus distance @ E3B0 ===
clique1_consensus_distance=0.013
clique2_consensus_distance=3.706


[E 3B10 |   4224/60000 (  7%) ] Loss: 0.0551 top1= 98.5795

=== Log global consensus distance @ E3B10 ===
consensus_distance=1.258



=== Log clique consensus distance @ E3B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=3.838


[E 3B20 |   8064/60000 ( 13%) ] Loss: 0.0291 top1= 99.4318

=== Log global consensus distance @ E3B20 ===
consensus_distance=1.293



=== Log clique consensus distance @ E3B20 ===
clique1_consensus_distance=0.009
clique2_consensus_distance=3.953



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.4546 top1= 49.3389


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5.6284 top1= 44.4712


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=5.7063 top1= 38.6318

Train epoch 4
[E 4B0  |    384/60000 (  1%) ] Loss: 0.0317 top1= 99.4318

=== Log global consensus distance @ E4B0 ===
consensus_distance=1.317



=== Log clique consensus distance @ E4B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=4.075


[E 4B10 |   4224/60000 (  7%) ] Loss: 0.0327 top1= 99.4318

=== Log global consensus distance @ E4B10 ===
consensus_distance=1.320



=== Log clique consensus distance @ E4B10 ===
clique1_consensus_distance=0.003
clique2_consensus_distance=4.141


[E 4B20 |   8064/60000 ( 13%) ] Loss: 0.0180 top1= 99.7159

=== Log global consensus distance @ E4B20 ===
consensus_distance=1.325



=== Log clique consensus distance @ E4B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=4.217



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.5151 top1= 45.5629


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.1020 top1= 45.1122


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.3615 top1= 40.6851

Train epoch 5
[E 5B0  |    384/60000 (  1%) ] Loss: 0.0237 top1= 99.7159

=== Log global consensus distance @ E5B0 ===
consensus_distance=1.337



=== Log clique consensus distance @ E5B0 ===
clique1_consensus_distance=0.002
clique2_consensus_distance=4.326


[E 5B10 |   4224/60000 (  7%) ] Loss: 0.0192 top1=100.0000

=== Log global consensus distance @ E5B10 ===
consensus_distance=1.329



=== Log clique consensus distance @ E5B10 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=4.359


[E 5B20 |   8064/60000 ( 13%) ] Loss: 0.0145 top1=100.0000

=== Log global consensus distance @ E5B20 ===
consensus_distance=1.328



=== Log clique consensus distance @ E5B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=4.410



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.7283 top1= 38.2412


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.4576 top1= 45.5629


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.7225 top1= 42.7384

Train epoch 6
[E 6B0  |    384/60000 (  1%) ] Loss: 0.0153 top1= 99.7159

=== Log global consensus distance @ E6B0 ===
consensus_distance=1.330



=== Log clique consensus distance @ E6B0 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=4.478


[E 6B10 |   4224/60000 (  7%) ] Loss: 0.0138 top1= 99.7159

=== Log global consensus distance @ E6B10 ===
consensus_distance=1.318



=== Log clique consensus distance @ E6B10 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=4.490


[E 6B20 |   8064/60000 ( 13%) ] Loss: 0.0115 top1= 99.7159

=== Log global consensus distance @ E6B20 ===
consensus_distance=1.316



=== Log clique consensus distance @ E6B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=4.524



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9358 top1= 33.7941


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.5866 top1= 46.3742


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.0196 top1= 42.8185

Train epoch 7
[E 7B0  |    384/60000 (  1%) ] Loss: 0.0113 top1=100.0000

=== Log global consensus distance @ E7B0 ===
consensus_distance=1.311



=== Log clique consensus distance @ E7B0 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=4.564


[E 7B10 |   4224/60000 (  7%) ] Loss: 0.0110 top1=100.0000

=== Log global consensus distance @ E7B10 ===
consensus_distance=1.304



=== Log clique consensus distance @ E7B10 ===
clique1_consensus_distance=0.002
clique2_consensus_distance=4.591


[E 7B20 |   8064/60000 ( 13%) ] Loss: 0.0121 top1= 99.7159

=== Log global consensus distance @ E7B20 ===
consensus_distance=1.303



=== Log clique consensus distance @ E7B20 ===
clique1_consensus_distance=0.003
clique2_consensus_distance=4.621



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9610 top1= 33.2432


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.2406 top1= 46.5946


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.0309 top1= 43.8802

Train epoch 8
[E 8B0  |    384/60000 (  1%) ] Loss: 0.0097 top1=100.0000

=== Log global consensus distance @ E8B0 ===
consensus_distance=1.299



=== Log clique consensus distance @ E8B0 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=4.656


[E 8B10 |   4224/60000 (  7%) ] Loss: 0.0104 top1= 99.7159

=== Log global consensus distance @ E8B10 ===
consensus_distance=1.288



=== Log clique consensus distance @ E8B10 ===
clique1_consensus_distance=0.002
clique2_consensus_distance=4.653


[E 8B20 |   8064/60000 ( 13%) ] Loss: 0.0099 top1=100.0000

=== Log global consensus distance @ E8B20 ===
consensus_distance=1.282



=== Log clique consensus distance @ E8B20 ===
clique1_consensus_distance=0.003
clique2_consensus_distance=4.659



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.1212 top1= 31.7308


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=6.0649 top1= 47.5561


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.8349 top1= 44.5212

Train epoch 9
[E 9B0  |    384/60000 (  1%) ] Loss: 0.0140 top1= 99.4318

=== Log global consensus distance @ E9B0 ===
consensus_distance=1.284



=== Log clique consensus distance @ E9B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=4.698


[E 9B10 |   4224/60000 (  7%) ] Loss: 0.0226 top1= 99.7159

=== Log global consensus distance @ E9B10 ===
consensus_distance=1.277



=== Log clique consensus distance @ E9B10 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=4.718


[E 9B20 |   8064/60000 ( 13%) ] Loss: 0.0180 top1= 99.4318

=== Log global consensus distance @ E9B20 ===
consensus_distance=1.296



=== Log clique consensus distance @ E9B20 ===
clique1_consensus_distance=0.012
clique2_consensus_distance=4.795



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.1007 top1= 32.8726


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.9395 top1= 48.5377


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.9928 top1= 44.1306

Train epoch 10
[E10B0  |    384/60000 (  1%) ] Loss: 0.0099 top1= 99.7159

=== Log global consensus distance @ E10B0 ===
consensus_distance=1.305



=== Log clique consensus distance @ E10B0 ===
clique1_consensus_distance=0.014
clique2_consensus_distance=4.870


[E10B10 |   4224/60000 (  7%) ] Loss: 0.0163 top1= 99.7159

=== Log global consensus distance @ E10B10 ===
consensus_distance=1.298



=== Log clique consensus distance @ E10B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=4.899


[E10B20 |   8064/60000 ( 13%) ] Loss: 0.0217 top1= 99.1477

=== Log global consensus distance @ E10B20 ===
consensus_distance=1.311



=== Log clique consensus distance @ E10B20 ===
clique1_consensus_distance=0.010
clique2_consensus_distance=4.944



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8287 top1= 36.7989


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.5907 top1= 48.8181


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.4487 top1= 44.6214

Train epoch 11
[E11B0  |    384/60000 (  1%) ] Loss: 0.0051 top1=100.0000

=== Log global consensus distance @ E11B0 ===
consensus_distance=1.324



=== Log clique consensus distance @ E11B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=5.029


[E11B10 |   4224/60000 (  7%) ] Loss: 0.0269 top1= 99.4318

=== Log global consensus distance @ E11B10 ===
consensus_distance=1.319



=== Log clique consensus distance @ E11B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.043


[E11B20 |   8064/60000 ( 13%) ] Loss: 0.0110 top1=100.0000

=== Log global consensus distance @ E11B20 ===
consensus_distance=1.316



=== Log clique consensus distance @ E11B20 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=5.043



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6693 top1= 41.1358


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.6633 top1= 48.2973


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.3182 top1= 43.7099

Train epoch 12
[E12B0  |    384/60000 (  1%) ] Loss: 0.0066 top1=100.0000

=== Log global consensus distance @ E12B0 ===
consensus_distance=1.316



=== Log clique consensus distance @ E12B0 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=5.049


[E12B10 |   4224/60000 (  7%) ] Loss: 0.0133 top1= 99.4318

=== Log global consensus distance @ E12B10 ===
consensus_distance=1.304



=== Log clique consensus distance @ E12B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.017


[E12B20 |   8064/60000 ( 13%) ] Loss: 0.0110 top1=100.0000

=== Log global consensus distance @ E12B20 ===
consensus_distance=1.297



=== Log clique consensus distance @ E12B20 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=4.998



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.7769 top1= 42.0673


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.9168 top1= 48.0769


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.2068 top1= 44.5012

Train epoch 13
[E13B0  |    384/60000 (  1%) ] Loss: 0.0057 top1=100.0000

=== Log global consensus distance @ E13B0 ===
consensus_distance=1.296



=== Log clique consensus distance @ E13B0 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=4.995


[E13B10 |   4224/60000 (  7%) ] Loss: 0.0061 top1=100.0000

=== Log global consensus distance @ E13B10 ===
consensus_distance=1.283



=== Log clique consensus distance @ E13B10 ===
clique1_consensus_distance=0.003
clique2_consensus_distance=4.953


[E13B20 |   8064/60000 ( 13%) ] Loss: 0.0045 top1=100.0000

=== Log global consensus distance @ E13B20 ===
consensus_distance=1.281



=== Log clique consensus distance @ E13B20 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=4.951



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.7545 top1= 44.3510


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.7186 top1= 48.1270


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.2618 top1= 44.8217

Train epoch 14
[E14B0  |    384/60000 (  1%) ] Loss: 0.0061 top1=100.0000

=== Log global consensus distance @ E14B0 ===
consensus_distance=1.275



=== Log clique consensus distance @ E14B0 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=4.937


[E14B10 |   4224/60000 (  7%) ] Loss: 0.0037 top1=100.0000

=== Log global consensus distance @ E14B10 ===
consensus_distance=1.266



=== Log clique consensus distance @ E14B10 ===
clique1_consensus_distance=0.002
clique2_consensus_distance=4.904


[E14B20 |   8064/60000 ( 13%) ] Loss: 0.0031 top1=100.0000

=== Log global consensus distance @ E14B20 ===
consensus_distance=1.275



=== Log clique consensus distance @ E14B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=4.933



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8446 top1= 42.6583


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.4982 top1= 48.6378


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.3141 top1= 45.6631

Train epoch 15
[E15B0  |    384/60000 (  1%) ] Loss: 0.0135 top1= 99.7159

=== Log global consensus distance @ E15B0 ===
consensus_distance=1.274



=== Log clique consensus distance @ E15B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=4.956


[E15B10 |   4224/60000 (  7%) ] Loss: 0.0081 top1=100.0000

=== Log global consensus distance @ E15B10 ===
consensus_distance=1.272



=== Log clique consensus distance @ E15B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=4.951


[E15B20 |   8064/60000 ( 13%) ] Loss: 0.0176 top1= 99.1477

=== Log global consensus distance @ E15B20 ===
consensus_distance=1.271



=== Log clique consensus distance @ E15B20 ===
clique1_consensus_distance=0.002
clique2_consensus_distance=4.947



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8717 top1= 44.3810


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.4100 top1= 49.3490


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.6125 top1= 45.1122

Train epoch 16
[E16B0  |    384/60000 (  1%) ] Loss: 0.0057 top1=100.0000

=== Log global consensus distance @ E16B0 ===
consensus_distance=1.272



=== Log clique consensus distance @ E16B0 ===
clique1_consensus_distance=0.004
clique2_consensus_distance=4.949


[E16B10 |   4224/60000 (  7%) ] Loss: 0.0036 top1=100.0000

=== Log global consensus distance @ E16B10 ===
consensus_distance=1.266



=== Log clique consensus distance @ E16B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=4.938


[E16B20 |   8064/60000 ( 13%) ] Loss: 0.0064 top1=100.0000

=== Log global consensus distance @ E16B20 ===
consensus_distance=1.269



=== Log clique consensus distance @ E16B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=4.954



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8708 top1= 44.5913


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.6991 top1= 48.3874


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.7118 top1= 45.7833

Train epoch 17
[E17B0  |    384/60000 (  1%) ] Loss: 0.0039 top1=100.0000

=== Log global consensus distance @ E17B0 ===
consensus_distance=1.290



=== Log clique consensus distance @ E17B0 ===
clique1_consensus_distance=0.048
clique2_consensus_distance=4.951


[E17B10 |   4224/60000 (  7%) ] Loss: 0.0042 top1=100.0000

=== Log global consensus distance @ E17B10 ===
consensus_distance=1.285



=== Log clique consensus distance @ E17B10 ===
clique1_consensus_distance=0.024
clique2_consensus_distance=4.986


[E17B20 |   8064/60000 ( 13%) ] Loss: 0.0084 top1=100.0000

=== Log global consensus distance @ E17B20 ===
consensus_distance=1.280



=== Log clique consensus distance @ E17B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.018



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.7577 top1= 48.1070


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.2584 top1= 47.5060


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.2511 top1= 44.9018

Train epoch 18
[E18B0  |    384/60000 (  1%) ] Loss: 0.0075 top1= 99.7159

=== Log global consensus distance @ E18B0 ===
consensus_distance=1.294



=== Log clique consensus distance @ E18B0 ===
clique1_consensus_distance=0.013
clique2_consensus_distance=5.055


[E18B10 |   4224/60000 (  7%) ] Loss: 0.0245 top1= 99.7159

=== Log global consensus distance @ E18B10 ===
consensus_distance=1.296



=== Log clique consensus distance @ E18B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.071


[E18B20 |   8064/60000 ( 13%) ] Loss: 0.0195 top1= 99.4318

=== Log global consensus distance @ E18B20 ===
consensus_distance=1.317



=== Log clique consensus distance @ E18B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.091



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8205 top1= 48.2572


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.2184 top1= 47.3758


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.2384 top1= 45.5028

Train epoch 19
[E19B0  |    384/60000 (  1%) ] Loss: 0.0688 top1= 99.4318

=== Log global consensus distance @ E19B0 ===
consensus_distance=1.436



=== Log clique consensus distance @ E19B0 ===
clique1_consensus_distance=0.017
clique2_consensus_distance=5.159


[E19B10 |   4224/60000 (  7%) ] Loss: 0.0095 top1=100.0000

=== Log global consensus distance @ E19B10 ===
consensus_distance=1.576



=== Log clique consensus distance @ E19B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.193


[E19B20 |   8064/60000 ( 13%) ] Loss: 0.0152 top1= 99.4318

=== Log global consensus distance @ E19B20 ===
consensus_distance=1.642



=== Log clique consensus distance @ E19B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.217



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.0112 top1= 47.9067


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.9023 top1= 48.7280


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.4440 top1= 43.7700

Train epoch 20
[E20B0  |    384/60000 (  1%) ] Loss: 0.0073 top1=100.0000

=== Log global consensus distance @ E20B0 ===
consensus_distance=1.677



=== Log clique consensus distance @ E20B0 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=5.258


[E20B10 |   4224/60000 (  7%) ] Loss: 0.0083 top1=100.0000

=== Log global consensus distance @ E20B10 ===
consensus_distance=1.678



=== Log clique consensus distance @ E20B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.311


[E20B20 |   8064/60000 ( 13%) ] Loss: 0.0086 top1= 99.7159

=== Log global consensus distance @ E20B20 ===
consensus_distance=1.671



=== Log clique consensus distance @ E20B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.340



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.9146 top1= 47.4659


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.1459 top1= 49.2788


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.6455 top1= 42.1074

Train epoch 21
[E21B0  |    384/60000 (  1%) ] Loss: 0.0062 top1= 99.7159

=== Log global consensus distance @ E21B0 ===
consensus_distance=1.678



=== Log clique consensus distance @ E21B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.428


[E21B10 |   4224/60000 (  7%) ] Loss: 0.0030 top1=100.0000

=== Log global consensus distance @ E21B10 ===
consensus_distance=1.681



=== Log clique consensus distance @ E21B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.527


[E21B20 |   8064/60000 ( 13%) ] Loss: 0.0143 top1= 99.4318

=== Log global consensus distance @ E21B20 ===
consensus_distance=1.663



=== Log clique consensus distance @ E21B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.573



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.0387 top1= 47.4459


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.1097 top1= 49.2588


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.2403 top1= 45.9435

Train epoch 22
[E22B0  |    384/60000 (  1%) ] Loss: 0.0095 top1= 99.7159

=== Log global consensus distance @ E22B0 ===
consensus_distance=1.643



=== Log clique consensus distance @ E22B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.596


[E22B10 |   4224/60000 (  7%) ] Loss: 0.0053 top1=100.0000

=== Log global consensus distance @ E22B10 ===
consensus_distance=1.628



=== Log clique consensus distance @ E22B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.623


[E22B20 |   8064/60000 ( 13%) ] Loss: 0.0037 top1=100.0000

=== Log global consensus distance @ E22B20 ===
consensus_distance=1.603



=== Log clique consensus distance @ E22B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.608



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.0532 top1= 48.7881


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.8978 top1= 49.3289


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.4561 top1= 45.6330

Train epoch 23
[E23B0  |    384/60000 (  1%) ] Loss: 0.0074 top1= 99.7159

=== Log global consensus distance @ E23B0 ===
consensus_distance=1.588



=== Log clique consensus distance @ E23B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.619


[E23B10 |   4224/60000 (  7%) ] Loss: 0.0071 top1= 99.7159

=== Log global consensus distance @ E23B10 ===
consensus_distance=1.571



=== Log clique consensus distance @ E23B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.616


[E23B20 |   8064/60000 ( 13%) ] Loss: 0.0042 top1=100.0000

=== Log global consensus distance @ E23B20 ===
consensus_distance=1.550



=== Log clique consensus distance @ E23B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.601



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.2179 top1= 48.0970


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.9456 top1= 49.2989


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.5818 top1= 46.1639

Train epoch 24
[E24B0  |    384/60000 (  1%) ] Loss: 0.0036 top1=100.0000

=== Log global consensus distance @ E24B0 ===
consensus_distance=1.531



=== Log clique consensus distance @ E24B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.578


[E24B10 |   4224/60000 (  7%) ] Loss: 0.0037 top1=100.0000

=== Log global consensus distance @ E24B10 ===
consensus_distance=1.509



=== Log clique consensus distance @ E24B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.543


[E24B20 |   8064/60000 ( 13%) ] Loss: 0.0024 top1=100.0000

=== Log global consensus distance @ E24B20 ===
consensus_distance=1.488



=== Log clique consensus distance @ E24B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.511



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.3566 top1= 48.4175


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.8333 top1= 49.4491


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.7240 top1= 46.3141

Train epoch 25
[E25B0  |    384/60000 (  1%) ] Loss: 0.0033 top1=100.0000

=== Log global consensus distance @ E25B0 ===
consensus_distance=1.468



=== Log clique consensus distance @ E25B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.475


[E25B10 |   4224/60000 (  7%) ] Loss: 0.0034 top1=100.0000

=== Log global consensus distance @ E25B10 ===
consensus_distance=1.449



=== Log clique consensus distance @ E25B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.440


[E25B20 |   8064/60000 ( 13%) ] Loss: 0.0054 top1=100.0000

=== Log global consensus distance @ E25B20 ===
consensus_distance=1.434



=== Log clique consensus distance @ E25B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.422



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.4830 top1= 49.0184


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.7279 top1= 49.5493


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.6948 top1= 46.8850

Train epoch 26
[E26B0  |    384/60000 (  1%) ] Loss: 0.0032 top1=100.0000

=== Log global consensus distance @ E26B0 ===
consensus_distance=1.417



=== Log clique consensus distance @ E26B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.393


[E26B10 |   4224/60000 (  7%) ] Loss: 0.0065 top1= 99.7159

=== Log global consensus distance @ E26B10 ===
consensus_distance=1.402



=== Log clique consensus distance @ E26B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.363


[E26B20 |   8064/60000 ( 13%) ] Loss: 0.0050 top1=100.0000

=== Log global consensus distance @ E26B20 ===
consensus_distance=1.393



=== Log clique consensus distance @ E26B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.358



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.5586 top1= 49.2788


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.6422 top1= 49.6995


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.6916 top1= 46.8249

Train epoch 27
[E27B0  |    384/60000 (  1%) ] Loss: 0.0023 top1=100.0000

=== Log global consensus distance @ E27B0 ===
consensus_distance=1.382



=== Log clique consensus distance @ E27B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.349


[E27B10 |   4224/60000 (  7%) ] Loss: 0.0024 top1=100.0000

=== Log global consensus distance @ E27B10 ===
consensus_distance=1.372



=== Log clique consensus distance @ E27B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.337


[E27B20 |   8064/60000 ( 13%) ] Loss: 0.0026 top1=100.0000

=== Log global consensus distance @ E27B20 ===
consensus_distance=1.364



=== Log clique consensus distance @ E27B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.330



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.6602 top1= 50.4307


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.5324 top1= 49.9399


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.8272 top1= 46.8850

Train epoch 28
[E28B0  |    384/60000 (  1%) ] Loss: 0.0025 top1=100.0000

=== Log global consensus distance @ E28B0 ===
consensus_distance=1.360



=== Log clique consensus distance @ E28B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.336


[E28B10 |   4224/60000 (  7%) ] Loss: 0.0025 top1=100.0000

=== Log global consensus distance @ E28B10 ===
consensus_distance=1.354



=== Log clique consensus distance @ E28B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.328


[E28B20 |   8064/60000 ( 13%) ] Loss: 0.0022 top1=100.0000

=== Log global consensus distance @ E28B20 ===
consensus_distance=1.348



=== Log clique consensus distance @ E28B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.321



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.8617 top1= 50.7111


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.4312 top1= 50.4107


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.0459 top1= 47.2456

Train epoch 29
[E29B0  |    384/60000 (  1%) ] Loss: 0.0025 top1=100.0000

=== Log global consensus distance @ E29B0 ===
consensus_distance=1.346



=== Log clique consensus distance @ E29B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.329


[E29B10 |   4224/60000 (  7%) ] Loss: 0.0022 top1=100.0000

=== Log global consensus distance @ E29B10 ===
consensus_distance=1.343



=== Log clique consensus distance @ E29B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.318


[E29B20 |   8064/60000 ( 13%) ] Loss: 0.0028 top1=100.0000

=== Log global consensus distance @ E29B20 ===
consensus_distance=1.338



=== Log clique consensus distance @ E29B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.299



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.1278 top1= 50.5909


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.3267 top1= 51.0016


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.3385 top1= 47.4860

Train epoch 30
[E30B0  |    384/60000 (  1%) ] Loss: 0.0028 top1=100.0000

=== Log global consensus distance @ E30B0 ===
consensus_distance=1.335



=== Log clique consensus distance @ E30B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.295


[E30B10 |   4224/60000 (  7%) ] Loss: 0.0019 top1=100.0000

=== Log global consensus distance @ E30B10 ===
consensus_distance=1.338



=== Log clique consensus distance @ E30B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.273


[E30B20 |   8064/60000 ( 13%) ] Loss: 0.0018 top1=100.0000

=== Log global consensus distance @ E30B20 ===
consensus_distance=1.336



=== Log clique consensus distance @ E30B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.242



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.4006 top1= 50.6210


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.2421 top1= 51.6727


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.6849 top1= 46.8349

Train epoch 31
[E31B0  |    384/60000 (  1%) ] Loss: 0.0020 top1=100.0000

=== Log global consensus distance @ E31B0 ===
consensus_distance=1.333



=== Log clique consensus distance @ E31B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.226


[E31B10 |   4224/60000 (  7%) ] Loss: 0.0020 top1=100.0000

=== Log global consensus distance @ E31B10 ===
consensus_distance=1.327



=== Log clique consensus distance @ E31B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.210


[E31B20 |   8064/60000 ( 13%) ] Loss: 0.0022 top1=100.0000

=== Log global consensus distance @ E31B20 ===
consensus_distance=1.326



=== Log clique consensus distance @ E31B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.192



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.5941 top1= 50.8614


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.1701 top1= 52.3037


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.8270 top1= 47.4760

Train epoch 32
[E32B0  |    384/60000 (  1%) ] Loss: 0.0024 top1=100.0000

=== Log global consensus distance @ E32B0 ===
consensus_distance=1.323



=== Log clique consensus distance @ E32B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.180


[E32B10 |   4224/60000 (  7%) ] Loss: 0.0017 top1=100.0000

=== Log global consensus distance @ E32B10 ===
consensus_distance=1.316



=== Log clique consensus distance @ E32B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.171


[E32B20 |   8064/60000 ( 13%) ] Loss: 0.0022 top1=100.0000

=== Log global consensus distance @ E32B20 ===
consensus_distance=1.311



=== Log clique consensus distance @ E32B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.173



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.6926 top1= 52.0633


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.0938 top1= 53.0148


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.8924 top1= 48.9784

Train epoch 33
[E33B0  |    384/60000 (  1%) ] Loss: 0.0024 top1=100.0000

=== Log global consensus distance @ E33B0 ===
consensus_distance=1.309



=== Log clique consensus distance @ E33B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.179


[E33B10 |   4224/60000 (  7%) ] Loss: 0.0019 top1=100.0000

=== Log global consensus distance @ E33B10 ===
consensus_distance=1.306



=== Log clique consensus distance @ E33B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.178


[E33B20 |   8064/60000 ( 13%) ] Loss: 0.0016 top1=100.0000

=== Log global consensus distance @ E33B20 ===
consensus_distance=1.303



=== Log clique consensus distance @ E33B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.175



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.9358 top1= 51.9932


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.0151 top1= 53.7159


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.0956 top1= 49.0184

Train epoch 34
[E34B0  |    384/60000 (  1%) ] Loss: 0.0021 top1=100.0000

=== Log global consensus distance @ E34B0 ===
consensus_distance=1.306



=== Log clique consensus distance @ E34B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.165


[E34B10 |   4224/60000 (  7%) ] Loss: 0.0017 top1=100.0000

=== Log global consensus distance @ E34B10 ===
consensus_distance=1.305



=== Log clique consensus distance @ E34B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.152


[E34B20 |   8064/60000 ( 13%) ] Loss: 0.0016 top1=100.0000

=== Log global consensus distance @ E34B20 ===
consensus_distance=1.302



=== Log clique consensus distance @ E34B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.148



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.0636 top1= 51.9030


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.9666 top1= 54.2768


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.3283 top1= 48.6779

Train epoch 35
[E35B0  |    384/60000 (  1%) ] Loss: 0.0017 top1=100.0000

=== Log global consensus distance @ E35B0 ===
consensus_distance=1.300



=== Log clique consensus distance @ E35B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.155


[E35B10 |   4224/60000 (  7%) ] Loss: 0.0018 top1=100.0000

=== Log global consensus distance @ E35B10 ===
consensus_distance=1.300



=== Log clique consensus distance @ E35B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.150


[E35B20 |   8064/60000 ( 13%) ] Loss: 0.0016 top1=100.0000

=== Log global consensus distance @ E35B20 ===
consensus_distance=1.298



=== Log clique consensus distance @ E35B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.156



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.3141 top1= 52.3538


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.9325 top1= 54.8778


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.5759 top1= 49.7196

Train epoch 36
[E36B0  |    384/60000 (  1%) ] Loss: 0.0019 top1=100.0000

=== Log global consensus distance @ E36B0 ===
consensus_distance=1.298



=== Log clique consensus distance @ E36B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.171


[E36B10 |   4224/60000 (  7%) ] Loss: 0.0017 top1=100.0000

=== Log global consensus distance @ E36B10 ===
consensus_distance=1.298



=== Log clique consensus distance @ E36B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.161


[E36B20 |   8064/60000 ( 13%) ] Loss: 0.0017 top1=100.0000

=== Log global consensus distance @ E36B20 ===
consensus_distance=1.298



=== Log clique consensus distance @ E36B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.166



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.4796 top1= 52.6943


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.8985 top1= 55.3986


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.7733 top1= 50.4207

Train epoch 37
[E37B0  |    384/60000 (  1%) ] Loss: 0.0020 top1=100.0000

=== Log global consensus distance @ E37B0 ===
consensus_distance=1.299



=== Log clique consensus distance @ E37B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.183


[E37B10 |   4224/60000 (  7%) ] Loss: 0.0017 top1=100.0000

=== Log global consensus distance @ E37B10 ===
consensus_distance=1.300



=== Log clique consensus distance @ E37B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.171


[E37B20 |   8064/60000 ( 13%) ] Loss: 0.0020 top1=100.0000

=== Log global consensus distance @ E37B20 ===
consensus_distance=1.302



=== Log clique consensus distance @ E37B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.176



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.6989 top1= 52.8746


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.8470 top1= 55.9095


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=9.0270 top1= 50.5609

Train epoch 38
[E38B0  |    384/60000 (  1%) ] Loss: 0.0019 top1=100.0000

=== Log global consensus distance @ E38B0 ===
consensus_distance=1.304



=== Log clique consensus distance @ E38B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.204


[E38B10 |   4224/60000 (  7%) ] Loss: 0.0021 top1=100.0000

=== Log global consensus distance @ E38B10 ===
consensus_distance=1.305



=== Log clique consensus distance @ E38B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.206


[E38B20 |   8064/60000 ( 13%) ] Loss: 0.0021 top1=100.0000

=== Log global consensus distance @ E38B20 ===
consensus_distance=1.309



=== Log clique consensus distance @ E38B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.219



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.9174 top1= 52.9848


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.7909 top1= 56.1699


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=9.2628 top1= 50.9816

Train epoch 39
[E39B0  |    384/60000 (  1%) ] Loss: 0.0020 top1=100.0000

=== Log global consensus distance @ E39B0 ===
consensus_distance=1.315



=== Log clique consensus distance @ E39B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.255


[E39B10 |   4224/60000 (  7%) ] Loss: 0.0047 top1= 99.7159

=== Log global consensus distance @ E39B10 ===
consensus_distance=1.322



=== Log clique consensus distance @ E39B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.286


[E39B20 |   8064/60000 ( 13%) ] Loss: 0.0024 top1=100.0000

=== Log global consensus distance @ E39B20 ===
consensus_distance=1.337



=== Log clique consensus distance @ E39B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.332



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.9695 top1= 53.0048


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.0030 top1= 55.1282


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=9.4622 top1= 51.4623

Train epoch 40
[E40B0  |    384/60000 (  1%) ] Loss: 0.0026 top1=100.0000

=== Log global consensus distance @ E40B0 ===
consensus_distance=1.354



=== Log clique consensus distance @ E40B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=5.401


[E40B10 |   4224/60000 (  7%) ] Loss: 0.0020 top1=100.0000

=== Log global consensus distance @ E40B10 ===
consensus_distance=1.372



=== Log clique consensus distance @ E40B10 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=5.488


[E40B20 |   8064/60000 ( 13%) ] Loss: 0.0227 top1= 99.4318

=== Log global consensus distance @ E40B20 ===
consensus_distance=1.437



=== Log clique consensus distance @ E40B20 ===
clique1_consensus_distance=0.035
clique2_consensus_distance=5.673



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.8756 top1= 53.7260


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.1926 top1= 59.8257


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=9.6934 top1= 52.2837

Train epoch 41
[E41B0  |    384/60000 (  1%) ] Loss: 0.0133 top1= 99.7159

=== Log global consensus distance @ E41B0 ===
consensus_distance=1.533



=== Log clique consensus distance @ E41B0 ===
clique1_consensus_distance=0.109
clique2_consensus_distance=5.931


[E41B10 |   4224/60000 (  7%) ] Loss: 0.0900 top1= 98.2955

=== Log global consensus distance @ E41B10 ===
consensus_distance=1.603



=== Log clique consensus distance @ E41B10 ===
clique1_consensus_distance=0.131
clique2_consensus_distance=6.183


[E41B20 |   8064/60000 ( 13%) ] Loss: 0.0188 top1= 99.4318

=== Log global consensus distance @ E41B20 ===
consensus_distance=1.638



=== Log clique consensus distance @ E41B20 ===
clique1_consensus_distance=0.096
clique2_consensus_distance=6.370



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.4392 top1= 53.6759


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.3318 top1= 56.4203


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=9.9255 top1= 52.4639

Train epoch 42
[E42B0  |    384/60000 (  1%) ] Loss: 0.0040 top1=100.0000

=== Log global consensus distance @ E42B0 ===
consensus_distance=1.641



=== Log clique consensus distance @ E42B0 ===
clique1_consensus_distance=0.023
clique2_consensus_distance=6.515


[E42B10 |   4224/60000 (  7%) ] Loss: 0.0080 top1=100.0000

=== Log global consensus distance @ E42B10 ===
consensus_distance=1.651



=== Log clique consensus distance @ E42B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=6.615


[E42B20 |   8064/60000 ( 13%) ] Loss: 0.0076 top1= 99.7159

=== Log global consensus distance @ E42B20 ===
consensus_distance=1.684



=== Log clique consensus distance @ E42B20 ===
clique1_consensus_distance=0.002
clique2_consensus_distance=6.731



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.6117 top1= 53.6158


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.8787 top1= 53.8562


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=10.1966 top1= 52.9748

Train epoch 43
[E43B0  |    384/60000 (  1%) ] Loss: 0.0068 top1= 99.7159

=== Log global consensus distance @ E43B0 ===
consensus_distance=1.703



=== Log clique consensus distance @ E43B0 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=6.808


[E43B10 |   4224/60000 (  7%) ] Loss: 0.0027 top1=100.0000

=== Log global consensus distance @ E43B10 ===
consensus_distance=1.709



=== Log clique consensus distance @ E43B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=6.848


[E43B20 |   8064/60000 ( 13%) ] Loss: 0.0029 top1=100.0000

=== Log global consensus distance @ E43B20 ===
consensus_distance=1.713



=== Log clique consensus distance @ E43B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=6.856



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.9259 top1= 53.6358


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.6177 top1= 55.3385


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=10.4701 top1= 53.2953

Train epoch 44
[E44B0  |    384/60000 (  1%) ] Loss: 0.0018 top1=100.0000

=== Log global consensus distance @ E44B0 ===
consensus_distance=1.724



=== Log clique consensus distance @ E44B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=6.901


[E44B10 |   4224/60000 (  7%) ] Loss: 0.0031 top1=100.0000

=== Log global consensus distance @ E44B10 ===
consensus_distance=1.734



=== Log clique consensus distance @ E44B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=6.950


[E44B20 |   8064/60000 ( 13%) ] Loss: 0.0023 top1=100.0000

=== Log global consensus distance @ E44B20 ===
consensus_distance=1.744



=== Log clique consensus distance @ E44B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=6.982



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.0495 top1= 53.6158


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.9034 top1= 55.0681


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=10.7256 top1= 53.5958

Train epoch 45
[E45B0  |    384/60000 (  1%) ] Loss: 0.0021 top1=100.0000

=== Log global consensus distance @ E45B0 ===
consensus_distance=1.751



=== Log clique consensus distance @ E45B0 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=7.012


[E45B10 |   4224/60000 (  7%) ] Loss: 0.0017 top1=100.0000

=== Log global consensus distance @ E45B10 ===
consensus_distance=1.756



=== Log clique consensus distance @ E45B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=7.040


[E45B20 |   8064/60000 ( 13%) ] Loss: 0.0032 top1=100.0000

=== Log global consensus distance @ E45B20 ===
consensus_distance=1.758



=== Log clique consensus distance @ E45B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=7.042



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.3413 top1= 53.8361


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.7492 top1= 56.4002


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=10.9974 top1= 53.8061

Train epoch 46
[E46B0  |    384/60000 (  1%) ] Loss: 0.0033 top1=100.0000

=== Log global consensus distance @ E46B0 ===
consensus_distance=1.760



=== Log clique consensus distance @ E46B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=7.053


[E46B10 |   4224/60000 (  7%) ] Loss: 0.0015 top1=100.0000

=== Log global consensus distance @ E46B10 ===
consensus_distance=1.760



=== Log clique consensus distance @ E46B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=7.054


[E46B20 |   8064/60000 ( 13%) ] Loss: 0.0016 top1=100.0000

=== Log global consensus distance @ E46B20 ===
consensus_distance=1.757



=== Log clique consensus distance @ E46B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=7.042



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.5720 top1= 53.8361


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.7582 top1= 56.6506


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=11.2591 top1= 54.0064

Train epoch 47
[E47B0  |    384/60000 (  1%) ] Loss: 0.0014 top1=100.0000

=== Log global consensus distance @ E47B0 ===
consensus_distance=1.755



=== Log clique consensus distance @ E47B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=7.032


[E47B10 |   4224/60000 (  7%) ] Loss: 0.0013 top1=100.0000

=== Log global consensus distance @ E47B10 ===
consensus_distance=1.752



=== Log clique consensus distance @ E47B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=7.023


[E47B20 |   8064/60000 ( 13%) ] Loss: 0.0016 top1=100.0000

=== Log global consensus distance @ E47B20 ===
consensus_distance=1.750



=== Log clique consensus distance @ E47B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=7.014



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.7828 top1= 53.9864


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.7401 top1= 57.3918


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=11.5196 top1= 54.0966

Train epoch 48
[E48B0  |    384/60000 (  1%) ] Loss: 0.0016 top1=100.0000

=== Log global consensus distance @ E48B0 ===
consensus_distance=1.749



=== Log clique consensus distance @ E48B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=7.009


[E48B10 |   4224/60000 (  7%) ] Loss: 0.0013 top1=100.0000

=== Log global consensus distance @ E48B10 ===
consensus_distance=1.745



=== Log clique consensus distance @ E48B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=6.994


[E48B20 |   8064/60000 ( 13%) ] Loss: 0.0011 top1=100.0000

=== Log global consensus distance @ E48B20 ===
consensus_distance=1.742



=== Log clique consensus distance @ E48B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=6.980



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.0032 top1= 54.0465


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.7008 top1= 58.0228


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=11.7752 top1= 54.1967

Train epoch 49
[E49B0  |    384/60000 (  1%) ] Loss: 0.0014 top1=100.0000

=== Log global consensus distance @ E49B0 ===
consensus_distance=1.740



=== Log clique consensus distance @ E49B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=6.973


[E49B10 |   4224/60000 (  7%) ] Loss: 0.0014 top1=100.0000

=== Log global consensus distance @ E49B10 ===
consensus_distance=1.738



=== Log clique consensus distance @ E49B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=6.965


[E49B20 |   8064/60000 ( 13%) ] Loss: 0.0013 top1=100.0000

=== Log global consensus distance @ E49B20 ===
consensus_distance=1.736



=== Log clique consensus distance @ E49B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=6.956



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.2623 top1= 54.1567


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.6430 top1= 58.5437


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=12.0294 top1= 54.2468

Train epoch 50
[E50B0  |    384/60000 (  1%) ] Loss: 0.0014 top1=100.0000

=== Log global consensus distance @ E50B0 ===
consensus_distance=1.735



=== Log clique consensus distance @ E50B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=6.954


[E50B10 |   4224/60000 (  7%) ] Loss: 0.0014 top1=100.0000

=== Log global consensus distance @ E50B10 ===
consensus_distance=1.734



=== Log clique consensus distance @ E50B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=6.948


[E50B20 |   8064/60000 ( 13%) ] Loss: 0.0014 top1=100.0000

=== Log global consensus distance @ E50B20 ===
consensus_distance=1.733



=== Log clique consensus distance @ E50B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=6.945



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.4939 top1= 54.2067


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.6208 top1= 58.9844


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=12.2808 top1= 54.3269

