
=== Start adding workers ===
=> Add worker SGDMWorker(index=0, momentum=0.9)
=> Add worker SGDMWorker(index=1, momentum=0.9)
=> Add worker SGDMWorker(index=2, momentum=0.9)
=> Add worker SGDMWorker(index=3, momentum=0.9)
=> Add worker SGDMWorker(index=4, momentum=0.9)
=> Add worker SGDMWorker(index=5, momentum=0.9)
=> Add worker SGDMWorker(index=6, momentum=0.9)
=> Add worker SGDMWorker(index=7, momentum=0.9)
=> Add worker SGDMWorker(index=8, momentum=0.9)
=> Add worker SGDMWorker(index=9, momentum=0.9)
=> Add worker SGDMWorker(index=10, momentum=0.9)
=> Add worker ByzantineWorker(index=11)

=== Start adding graph ===
TwoCliquesWithByzantine(m=5,b=1)

Train epoch 1
[E 1B0  |    384/60000 (  1%) ] Loss: 2.3142 top1=  7.6705

=== Peeking data label distribution E1B0 ===
Worker 0 has targets: tensor([0, 0, 0, 0, 0], device='cuda:0')
Worker 1 has targets: tensor([1, 1, 1, 0, 1], device='cuda:0')
Worker 2 has targets: tensor([1, 1, 2, 1, 1], device='cuda:0')
Worker 3 has targets: tensor([2, 2, 3, 2, 2], device='cuda:0')
Worker 4 has targets: tensor([3, 3, 3, 3, 3], device='cuda:0')
Worker 5 has targets: tensor([4, 4, 4, 4, 4], device='cuda:0')
Worker 6 has targets: tensor([5, 5, 5, 5, 5], device='cuda:0')
Worker 7 has targets: tensor([6, 6, 6, 5, 6], device='cuda:0')
Worker 8 has targets: tensor([6, 7, 7, 6, 6], device='cuda:0')
Worker 9 has targets: tensor([7, 7, 8, 7, 7], device='cuda:0')
Worker 10 has targets: tensor([8, 8, 9, 8, 8], device='cuda:0')
Worker 11 has targets: tensor([9, 9, 9, 9, 9], device='cuda:0')



=== Log global consensus distance @ E1B0 ===
consensus_distance=0.001



=== Log clique consensus distance @ E1B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.002



=== Log mixing matrix @ E1B0 ===
[[0.167 0.167 0.167 0.167 0.167 0.    0.    0.    0.    0.    0.167 0.   ]
 [0.167 0.233 0.2   0.2   0.2   0.    0.    0.    0.    0.    0.    0.   ]
 [0.167 0.2   0.233 0.2   0.2   0.    0.    0.    0.    0.    0.    0.   ]
 [0.167 0.2   0.2   0.233 0.2   0.    0.    0.    0.    0.    0.    0.   ]
 [0.167 0.2   0.2   0.2   0.233 0.    0.    0.    0.    0.    0.    0.   ]
 [0.    0.    0.    0.    0.    0.233 0.2   0.2   0.2   0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.2   0.233 0.2   0.2   0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.2   0.2   0.233 0.2   0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.2   0.2   0.2   0.233 0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.167 0.167 0.167 0.167 0.167 0.167 0.   ]
 [0.167 0.    0.    0.    0.    0.    0.    0.    0.    0.167 0.417 0.25 ]
 [0.    0.    0.    0.    0.    0.    0.    0.    0.    0.    0.25  0.75 ]]


[E 1B10 |   4224/60000 (  7%) ] Loss: 0.7001 top1= 77.8409

=== Log global consensus distance @ E1B10 ===
consensus_distance=0.467



=== Log clique consensus distance @ E1B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=1.558


[E 1B20 |   8064/60000 ( 13%) ] Loss: 0.2463 top1= 93.7500

=== Log global consensus distance @ E1B20 ===
consensus_distance=0.989



=== Log clique consensus distance @ E1B20 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=3.566



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.2792 top1= 27.5040


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.6423 top1= 41.1258


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.3922 top1= 42.2776

Train epoch 2
[E 2B0  |    384/60000 (  1%) ] Loss: 0.1355 top1= 95.1705

=== Log global consensus distance @ E2B0 ===
consensus_distance=1.055



=== Log clique consensus distance @ E2B0 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=3.913


[E 2B10 |   4224/60000 (  7%) ] Loss: 0.1239 top1= 95.7386

=== Log global consensus distance @ E2B10 ===
consensus_distance=0.950



=== Log clique consensus distance @ E2B10 ===
clique1_consensus_distance=0.007
clique2_consensus_distance=3.556


[E 2B20 |   8064/60000 ( 13%) ] Loss: 0.1716 top1= 95.1705

=== Log global consensus distance @ E2B20 ===
consensus_distance=0.890



=== Log clique consensus distance @ E2B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=3.267



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.8488 top1= 45.1522


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.4300 top1= 46.5445


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=6.1513 top1= 44.9519

Train epoch 3
[E 3B0  |    384/60000 (  1%) ] Loss: 0.0860 top1= 97.4432

=== Log global consensus distance @ E3B0 ===
consensus_distance=0.871



=== Log clique consensus distance @ E3B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=3.162


[E 3B10 |   4224/60000 (  7%) ] Loss: 0.0851 top1= 98.0114

=== Log global consensus distance @ E3B10 ===
consensus_distance=0.879



=== Log clique consensus distance @ E3B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=3.174


[E 3B20 |   8064/60000 ( 13%) ] Loss: 0.0909 top1= 97.1591

=== Log global consensus distance @ E3B20 ===
consensus_distance=0.895



=== Log clique consensus distance @ E3B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=3.233



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.7544 top1= 50.0300


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.8988 top1= 54.1066


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.0166 top1= 44.5613

Train epoch 4
[E 4B0  |    384/60000 (  1%) ] Loss: 0.0651 top1= 98.5795

=== Log global consensus distance @ E4B0 ===
consensus_distance=0.927



=== Log clique consensus distance @ E4B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=3.351


[E 4B10 |   4224/60000 (  7%) ] Loss: 0.0634 top1= 97.7273

=== Log global consensus distance @ E4B10 ===
consensus_distance=0.997



=== Log clique consensus distance @ E4B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=3.610


[E 4B20 |   8064/60000 ( 13%) ] Loss: 0.0661 top1= 98.0114

=== Log global consensus distance @ E4B20 ===
consensus_distance=1.052



=== Log clique consensus distance @ E4B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=3.833



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.5614 top1= 51.0417


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.6881 top1= 57.8225


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.5169 top1= 45.0020

Train epoch 5
[E 5B0  |    384/60000 (  1%) ] Loss: 0.0561 top1= 98.0114

=== Log global consensus distance @ E5B0 ===
consensus_distance=1.126



=== Log clique consensus distance @ E5B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=4.099


[E 5B10 |   4224/60000 (  7%) ] Loss: 0.0478 top1= 98.5795

=== Log global consensus distance @ E5B10 ===
consensus_distance=1.226



=== Log clique consensus distance @ E5B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=4.491


[E 5B20 |   8064/60000 ( 13%) ] Loss: 0.0701 top1= 97.4432

=== Log global consensus distance @ E5B20 ===
consensus_distance=1.298



=== Log clique consensus distance @ E5B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=4.786



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.2873 top1= 51.6927


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.4663 top1= 61.4283


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=7.9526 top1= 45.5429

Train epoch 6
[E 6B0  |    384/60000 (  1%) ] Loss: 0.0430 top1= 98.5795

=== Log global consensus distance @ E6B0 ===
consensus_distance=1.384



=== Log clique consensus distance @ E6B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=5.119


[E 6B10 |   4224/60000 (  7%) ] Loss: 0.0529 top1= 99.1477

=== Log global consensus distance @ E6B10 ===
consensus_distance=1.526



=== Log clique consensus distance @ E6B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=5.672


[E 6B20 |   8064/60000 ( 13%) ] Loss: 0.0740 top1= 97.7273

=== Log global consensus distance @ E6B20 ===
consensus_distance=1.610



=== Log clique consensus distance @ E6B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=5.994



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.7080 top1= 52.6843


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.3847 top1= 62.5501


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.2225 top1= 46.8950

Train epoch 7
[E 7B0  |    384/60000 (  1%) ] Loss: 0.0393 top1= 99.4318

=== Log global consensus distance @ E7B0 ===
consensus_distance=1.701



=== Log clique consensus distance @ E7B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=6.361


[E 7B10 |   4224/60000 (  7%) ] Loss: 0.0561 top1= 98.0114

=== Log global consensus distance @ E7B10 ===
consensus_distance=1.862



=== Log clique consensus distance @ E7B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=6.997


[E 7B20 |   8064/60000 ( 13%) ] Loss: 0.0690 top1= 98.2955

=== Log global consensus distance @ E7B20 ===
consensus_distance=1.978



=== Log clique consensus distance @ E7B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=7.450



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.2547 top1= 52.5641


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.3373 top1= 65.3446


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=9.5135 top1= 45.9135

Train epoch 8
[E 8B0  |    384/60000 (  1%) ] Loss: 0.0567 top1= 98.0114

=== Log global consensus distance @ E8B0 ===
consensus_distance=2.046



=== Log clique consensus distance @ E8B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=7.721


[E 8B10 |   4224/60000 (  7%) ] Loss: 0.0574 top1= 98.0114

=== Log global consensus distance @ E8B10 ===
consensus_distance=2.232



=== Log clique consensus distance @ E8B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=8.445


[E 8B20 |   8064/60000 ( 13%) ] Loss: 0.0556 top1= 98.0114

=== Log global consensus distance @ E8B20 ===
consensus_distance=2.384



=== Log clique consensus distance @ E8B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=9.045



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.5819 top1= 52.5441


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.1985 top1= 64.5533


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=10.8324 top1= 46.5445

Train epoch 9
[E 9B0  |    384/60000 (  1%) ] Loss: 0.0279 top1= 99.1477

=== Log global consensus distance @ E9B0 ===
consensus_distance=2.490



=== Log clique consensus distance @ E9B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=9.463


[E 9B10 |   4224/60000 (  7%) ] Loss: 0.0284 top1= 99.7159

=== Log global consensus distance @ E9B10 ===
consensus_distance=2.634



=== Log clique consensus distance @ E9B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=10.027


[E 9B20 |   8064/60000 ( 13%) ] Loss: 0.0437 top1= 98.8636

=== Log global consensus distance @ E9B20 ===
consensus_distance=2.696



=== Log clique consensus distance @ E9B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=10.270



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.6036 top1= 53.6959


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.6308 top1= 61.0677


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=12.1971 top1= 47.9467

Train epoch 10
[E10B0  |    384/60000 (  1%) ] Loss: 0.0266 top1= 99.7159

=== Log global consensus distance @ E10B0 ===
consensus_distance=2.754



=== Log clique consensus distance @ E10B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=10.501


[E10B10 |   4224/60000 (  7%) ] Loss: 0.0274 top1= 99.7159

=== Log global consensus distance @ E10B10 ===
consensus_distance=2.883



=== Log clique consensus distance @ E10B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=11.008


[E10B20 |   8064/60000 ( 13%) ] Loss: 0.0342 top1= 99.4318

=== Log global consensus distance @ E10B20 ===
consensus_distance=2.969



=== Log clique consensus distance @ E10B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=11.344



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=8.6528 top1= 53.6058


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.6988 top1= 62.0793


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=13.7871 top1= 47.4058

Train epoch 11
[E11B0  |    384/60000 (  1%) ] Loss: 0.0252 top1= 99.4318

=== Log global consensus distance @ E11B0 ===
consensus_distance=3.030



=== Log clique consensus distance @ E11B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=11.586


[E11B10 |   4224/60000 (  7%) ] Loss: 0.0297 top1= 99.1477

=== Log global consensus distance @ E11B10 ===
consensus_distance=3.162



=== Log clique consensus distance @ E11B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=12.106


[E11B20 |   8064/60000 ( 13%) ] Loss: 0.0333 top1= 99.1477

=== Log global consensus distance @ E11B20 ===
consensus_distance=3.269



=== Log clique consensus distance @ E11B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=12.526



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=9.5904 top1= 53.4956


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.7932 top1= 60.5469


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=15.2452 top1= 47.6863

Train epoch 12
[E12B0  |    384/60000 (  1%) ] Loss: 0.0263 top1= 99.7159

=== Log global consensus distance @ E12B0 ===
consensus_distance=3.323



=== Log clique consensus distance @ E12B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=12.741


[E12B10 |   4224/60000 (  7%) ] Loss: 0.0306 top1= 99.1477

=== Log global consensus distance @ E12B10 ===
consensus_distance=3.436



=== Log clique consensus distance @ E12B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=13.189


[E12B20 |   8064/60000 ( 13%) ] Loss: 0.0392 top1= 98.8636

=== Log global consensus distance @ E12B20 ===
consensus_distance=3.577



=== Log clique consensus distance @ E12B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=13.742



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=10.5084 top1= 53.7660


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.9286 top1= 59.5853


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=16.7736 top1= 47.8566

Train epoch 13
[E13B0  |    384/60000 (  1%) ] Loss: 0.0379 top1= 98.8636

=== Log global consensus distance @ E13B0 ===
consensus_distance=3.610



=== Log clique consensus distance @ E13B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=13.876


[E13B10 |   4224/60000 (  7%) ] Loss: 0.0413 top1= 98.5795

=== Log global consensus distance @ E13B10 ===
consensus_distance=3.679



=== Log clique consensus distance @ E13B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=14.144


[E13B20 |   8064/60000 ( 13%) ] Loss: 0.0632 top1= 97.4432

=== Log global consensus distance @ E13B20 ===
consensus_distance=3.833



=== Log clique consensus distance @ E13B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=14.755



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=11.0251 top1= 53.9964


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.5581 top1= 62.0393


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=18.4024 top1= 48.5577

Train epoch 14
[E14B0  |    384/60000 (  1%) ] Loss: 0.0350 top1= 99.1477

=== Log global consensus distance @ E14B0 ===
consensus_distance=3.945



=== Log clique consensus distance @ E14B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=15.199


[E14B10 |   4224/60000 (  7%) ] Loss: 0.0525 top1= 98.2955

=== Log global consensus distance @ E14B10 ===
consensus_distance=4.133



=== Log clique consensus distance @ E14B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=15.939


[E14B20 |   8064/60000 ( 13%) ] Loss: 0.0544 top1= 97.7273

=== Log global consensus distance @ E14B20 ===
consensus_distance=4.217



=== Log clique consensus distance @ E14B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=16.271



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=11.1558 top1= 54.0665


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.0155 top1= 55.4688


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=20.2993 top1= 48.7680

Train epoch 15
[E15B0  |    384/60000 (  1%) ] Loss: 0.0279 top1= 99.4318

=== Log global consensus distance @ E15B0 ===
consensus_distance=4.214



=== Log clique consensus distance @ E15B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=16.261


[E15B10 |   4224/60000 (  7%) ] Loss: 0.0343 top1= 98.8636

=== Log global consensus distance @ E15B10 ===
consensus_distance=4.223



=== Log clique consensus distance @ E15B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=16.296


[E15B20 |   8064/60000 ( 13%) ] Loss: 0.0357 top1= 98.5795

=== Log global consensus distance @ E15B20 ===
consensus_distance=4.237



=== Log clique consensus distance @ E15B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=16.349



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=12.5686 top1= 54.2668


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.4262 top1= 51.0317


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=22.3138 top1= 49.2788

Train epoch 16
[E16B0  |    384/60000 (  1%) ] Loss: 0.0204 top1= 99.7159

=== Log global consensus distance @ E16B0 ===
consensus_distance=4.242



=== Log clique consensus distance @ E16B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=16.370


[E16B10 |   4224/60000 (  7%) ] Loss: 0.0255 top1= 99.7159

=== Log global consensus distance @ E16B10 ===
consensus_distance=4.239



=== Log clique consensus distance @ E16B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=16.359


[E16B20 |   8064/60000 ( 13%) ] Loss: 0.0315 top1= 99.1477

=== Log global consensus distance @ E16B20 ===
consensus_distance=4.240



=== Log clique consensus distance @ E16B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=16.362



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=14.2470 top1= 54.2468


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.5461 top1= 50.5609


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=24.3930 top1= 49.4491

Train epoch 17
[E17B0  |    384/60000 (  1%) ] Loss: 0.0208 top1= 99.7159

=== Log global consensus distance @ E17B0 ===
consensus_distance=4.249



=== Log clique consensus distance @ E17B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=16.396


[E17B10 |   4224/60000 (  7%) ] Loss: 0.0222 top1= 99.7159

=== Log global consensus distance @ E17B10 ===
consensus_distance=4.247



=== Log clique consensus distance @ E17B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=16.389


[E17B20 |   8064/60000 ( 13%) ] Loss: 0.0389 top1= 99.1477

=== Log global consensus distance @ E17B20 ===
consensus_distance=4.248



=== Log clique consensus distance @ E17B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=16.391



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=15.9572 top1= 54.1967


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.3337 top1= 53.1050


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=26.4954 top1= 49.5393

Train epoch 18
[E18B0  |    384/60000 (  1%) ] Loss: 0.0289 top1= 99.4318

=== Log global consensus distance @ E18B0 ===
consensus_distance=4.293



=== Log clique consensus distance @ E18B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=16.571


[E18B10 |   4224/60000 (  7%) ] Loss: 0.0267 top1= 99.7159

=== Log global consensus distance @ E18B10 ===
consensus_distance=4.288



=== Log clique consensus distance @ E18B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=16.552


[E18B20 |   8064/60000 ( 13%) ] Loss: 0.0358 top1= 99.1477

=== Log global consensus distance @ E18B20 ===
consensus_distance=4.339



=== Log clique consensus distance @ E18B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=16.755



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=17.4932 top1= 54.3069


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.9624 top1= 56.7508


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=28.5664 top1= 50.1803

Train epoch 19
[E19B0  |    384/60000 (  1%) ] Loss: 0.0229 top1= 99.4318

=== Log global consensus distance @ E19B0 ===
consensus_distance=4.359



=== Log clique consensus distance @ E19B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=16.833


[E19B10 |   4224/60000 (  7%) ] Loss: 0.0399 top1= 98.5795

=== Log global consensus distance @ E19B10 ===
consensus_distance=4.372



=== Log clique consensus distance @ E19B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=16.883


[E19B20 |   8064/60000 ( 13%) ] Loss: 0.0374 top1= 98.5795

=== Log global consensus distance @ E19B20 ===
consensus_distance=4.437



=== Log clique consensus distance @ E19B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=17.142



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=19.0497 top1= 54.2368


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.0846 top1= 54.8277


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=30.7291 top1= 50.2103

Train epoch 20
[E20B0  |    384/60000 (  1%) ] Loss: 0.0284 top1= 98.8636

=== Log global consensus distance @ E20B0 ===
consensus_distance=4.451



=== Log clique consensus distance @ E20B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=17.198


[E20B10 |   4224/60000 (  7%) ] Loss: 0.0349 top1= 98.8636

=== Log global consensus distance @ E20B10 ===
consensus_distance=4.465



=== Log clique consensus distance @ E20B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=17.251


[E20B20 |   8064/60000 ( 13%) ] Loss: 0.0185 top1= 99.4318

=== Log global consensus distance @ E20B20 ===
consensus_distance=4.508



=== Log clique consensus distance @ E20B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=17.422



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=20.6259 top1= 54.2869


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.7962 top1= 57.4619


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=32.9035 top1= 50.6410

