
=== Start adding workers ===
=> Add worker SGDMWorker(index=0, momentum=0.95)
=> Add worker SGDMWorker(index=1, momentum=0.95)
=> Add worker SGDMWorker(index=2, momentum=0.95)
=> Add worker SGDMWorker(index=3, momentum=0.95)
=> Add worker SGDMWorker(index=4, momentum=0.95)
=> Add worker SGDMWorker(index=5, momentum=0.95)
=> Add worker SGDMWorker(index=6, momentum=0.95)
=> Add worker SGDMWorker(index=7, momentum=0.95)
=> Add worker SGDMWorker(index=8, momentum=0.95)
=> Add worker SGDMWorker(index=9, momentum=0.95)
=> Add worker SGDMWorker(index=10, momentum=0.95)
=> Add worker ByzantineWorker(index=11)
=> Add worker ByzantineWorker(index=12)

=== Start adding graph ===
TwoCliquesWithByzantine(m=5,b=2)

Train epoch 1
[E 1B0  |    416/60000 (  1%) ] Loss: 2.3051 top1=  8.5227

=== Peeking data label distribution E1B0 ===
Worker 0 has targets: tensor([9, 9, 2, 5, 8], device='cuda:0')
Worker 1 has targets: tensor([3, 4, 1, 1, 9], device='cuda:0')
Worker 2 has targets: tensor([5, 0, 6, 6, 2], device='cuda:0')
Worker 3 has targets: tensor([4, 6, 5, 0, 1], device='cuda:0')
Worker 4 has targets: tensor([7, 8, 5, 1, 0], device='cuda:0')
Worker 5 has targets: tensor([4, 9, 4, 4, 7], device='cuda:0')
Worker 6 has targets: tensor([9, 9, 7, 4, 9], device='cuda:0')
Worker 7 has targets: tensor([6, 3, 4, 0, 2], device='cuda:0')
Worker 8 has targets: tensor([8, 1, 1, 0, 6], device='cuda:0')
Worker 9 has targets: tensor([8, 3, 8, 7, 8], device='cuda:0')
Worker 10 has targets: tensor([7, 2, 7, 0, 7], device='cuda:0')
Worker 11 has targets: tensor([4, 5, 3, 6, 7], device='cuda:0')
Worker 12 has targets: tensor([8, 0, 3, 7, 2], device='cuda:0')



=== Log global consensus distance @ E1B0 ===
consensus_distance=0.000



=== Log clique consensus distance @ E1B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.000


[E 1B10 |   4576/60000 (  8%) ] Loss: 2.2649 top1= 18.1818

=== Log global consensus distance @ E1B10 ===
consensus_distance=0.001



=== Log clique consensus distance @ E1B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.001


[E 1B20 |   8736/60000 ( 15%) ] Loss: 2.1892 top1= 29.5455

=== Log global consensus distance @ E1B20 ===
consensus_distance=0.013



=== Log clique consensus distance @ E1B20 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=0.003



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.1376 top1= 21.0437


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.0788 top1= 38.9223


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.0844 top1= 38.0308

Train epoch 2
[E 2B0  |    416/60000 (  1%) ] Loss: 2.0527 top1= 38.6364

=== Log global consensus distance @ E2B0 ===
consensus_distance=0.137



=== Log clique consensus distance @ E2B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.010


[E 2B10 |   4576/60000 (  8%) ] Loss: 1.9639 top1= 36.6477

=== Log global consensus distance @ E2B10 ===
consensus_distance=1.338



=== Log clique consensus distance @ E2B10 ===
clique1_consensus_distance=0.059
clique2_consensus_distance=0.066


[E 2B20 |   8736/60000 ( 15%) ] Loss: 2.0944 top1= 40.9091

=== Log global consensus distance @ E2B20 ===
consensus_distance=12.362



=== Log clique consensus distance @ E2B20 ===
clique1_consensus_distance=0.543
clique2_consensus_distance=0.554



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.1448 top1= 64.3530


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.2431 top1= 61.9491


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.2554 top1= 61.4984

Train epoch 3
[E 3B0  |    416/60000 (  1%) ] Loss: 2.1438 top1= 40.0568

=== Log global consensus distance @ E3B0 ===
consensus_distance=54.004



=== Log clique consensus distance @ E3B0 ===
clique1_consensus_distance=2.559
clique2_consensus_distance=2.572


[E 3B10 |   4576/60000 (  8%) ] Loss: 1.5807 top1= 52.5568

=== Log global consensus distance @ E3B10 ===
consensus_distance=85.315



=== Log clique consensus distance @ E3B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.584


[E 3B20 |   8736/60000 ( 15%) ] Loss: 1.4752 top1= 53.1250

=== Log global consensus distance @ E3B20 ===
consensus_distance=124.076



=== Log clique consensus distance @ E3B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.598



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.3168 top1= 58.7440


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.9537 top1= 75.6210


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.9353 top1= 75.4607

Train epoch 4
[E 4B0  |    416/60000 (  1%) ] Loss: 1.3997 top1= 54.5455

=== Log global consensus distance @ E4B0 ===
consensus_distance=170.323



=== Log clique consensus distance @ E4B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.618


[E 4B10 |   4576/60000 (  8%) ] Loss: 1.3070 top1= 59.0909

=== Log global consensus distance @ E4B10 ===
consensus_distance=223.980



=== Log clique consensus distance @ E4B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.637


[E 4B20 |   8736/60000 ( 15%) ] Loss: 1.3783 top1= 57.1023

=== Log global consensus distance @ E4B20 ===
consensus_distance=284.977



=== Log clique consensus distance @ E4B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.655



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.3000 top1= 53.3353


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.9323 top1= 73.7079


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.8965 top1= 72.4760

Train epoch 5
[E 5B0  |    416/60000 (  1%) ] Loss: 1.4409 top1= 52.5568

=== Log global consensus distance @ E5B0 ===
consensus_distance=353.307



=== Log clique consensus distance @ E5B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.671


[E 5B10 |   4576/60000 (  8%) ] Loss: 1.3732 top1= 55.1136

=== Log global consensus distance @ E5B10 ===
consensus_distance=428.983



=== Log clique consensus distance @ E5B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.688


[E 5B20 |   8736/60000 ( 15%) ] Loss: 1.3532 top1= 52.5568

=== Log global consensus distance @ E5B20 ===
consensus_distance=512.033



=== Log clique consensus distance @ E5B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.705



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.5666 top1= 46.0837


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.9104 top1= 74.2388


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.9032 top1= 73.3273

Train epoch 6
[E 6B0  |    416/60000 (  1%) ] Loss: 1.4693 top1= 53.6932

=== Log global consensus distance @ E6B0 ===
consensus_distance=602.433



=== Log clique consensus distance @ E6B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.721


[E 6B10 |   4576/60000 (  8%) ] Loss: 1.4599 top1= 55.9659

=== Log global consensus distance @ E6B10 ===
consensus_distance=700.153



=== Log clique consensus distance @ E6B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.739


[E 6B20 |   8736/60000 ( 15%) ] Loss: 1.3892 top1= 52.8409

=== Log global consensus distance @ E6B20 ===
consensus_distance=805.224



=== Log clique consensus distance @ E6B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.760



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.1419 top1= 29.0865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.8890 top1= 73.5577


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.8743 top1= 74.7296

Train epoch 7
[E 7B0  |    416/60000 (  1%) ] Loss: 1.5324 top1= 52.2727

=== Log global consensus distance @ E7B0 ===
consensus_distance=917.629



=== Log clique consensus distance @ E7B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.781


[E 7B10 |   4576/60000 (  8%) ] Loss: 1.4040 top1= 54.2614

=== Log global consensus distance @ E7B10 ===
consensus_distance=1037.359



=== Log clique consensus distance @ E7B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.806


[E 7B20 |   8736/60000 ( 15%) ] Loss: 1.5440 top1= 50.8523

=== Log global consensus distance @ E7B20 ===
consensus_distance=1164.435



=== Log clique consensus distance @ E7B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.828



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.2354 top1= 24.9099


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.9046 top1= 71.7348


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.8570 top1= 74.1286

Train epoch 8
[E 8B0  |    416/60000 (  1%) ] Loss: 1.6741 top1= 46.8750

=== Log global consensus distance @ E8B0 ===
consensus_distance=1298.876



=== Log clique consensus distance @ E8B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.853


[E 8B10 |   4576/60000 (  8%) ] Loss: 1.5804 top1= 54.2614

=== Log global consensus distance @ E8B10 ===
consensus_distance=1440.652



=== Log clique consensus distance @ E8B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.878


[E 8B20 |   8736/60000 ( 15%) ] Loss: 1.5318 top1= 49.1477

=== Log global consensus distance @ E8B20 ===
consensus_distance=1589.771



=== Log clique consensus distance @ E8B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.905



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.0754 top1= 30.5689


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.9995 top1= 67.0072


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.9154 top1= 70.7432

Train epoch 9
[E 9B0  |    416/60000 (  1%) ] Loss: 1.7162 top1= 47.4432

=== Log global consensus distance @ E9B0 ===
consensus_distance=1746.237



=== Log clique consensus distance @ E9B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.934


[E 9B10 |   4576/60000 (  8%) ] Loss: 1.6481 top1= 49.1477

=== Log global consensus distance @ E9B10 ===
consensus_distance=1910.073



=== Log clique consensus distance @ E9B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=2.974


[E 9B20 |   8736/60000 ( 15%) ] Loss: 1.7037 top1= 51.4205

=== Log global consensus distance @ E9B20 ===
consensus_distance=2081.273



=== Log clique consensus distance @ E9B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=3.014



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8736 top1= 38.0308


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.0399 top1= 65.8754


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.9513 top1= 69.2107

Train epoch 10
[E10B0  |    416/60000 (  1%) ] Loss: 1.9484 top1= 45.1705

=== Log global consensus distance @ E10B0 ===
consensus_distance=2259.830



=== Log clique consensus distance @ E10B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=3.060


[E10B10 |   4576/60000 (  8%) ] Loss: 1.8387 top1= 44.0341

=== Log global consensus distance @ E10B10 ===
consensus_distance=2445.730



=== Log clique consensus distance @ E10B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=3.122


[E10B20 |   8736/60000 ( 15%) ] Loss: 1.9231 top1= 45.7386

=== Log global consensus distance @ E10B20 ===
consensus_distance=2638.969



=== Log clique consensus distance @ E10B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=3.182



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.0451 top1= 32.2716


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.0924 top1= 64.2628


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.9598 top1= 68.2592

Train epoch 11
[E11B0  |    416/60000 (  1%) ] Loss: 2.0770 top1= 46.3068

=== Log global consensus distance @ E11B0 ===
consensus_distance=2839.653



=== Log clique consensus distance @ E11B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=3.258


[E11B10 |   4576/60000 (  8%) ] Loss: 1.9444 top1= 45.4545

=== Log global consensus distance @ E11B10 ===
consensus_distance=3047.726



=== Log clique consensus distance @ E11B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=3.327


[E11B20 |   8736/60000 ( 15%) ] Loss: 1.9746 top1= 45.1705

=== Log global consensus distance @ E11B20 ===
consensus_distance=3263.373



=== Log clique consensus distance @ E11B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=3.378



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.1174 top1= 11.3582


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.2821 top1= 58.1030


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.0429 top1= 65.2444

Train epoch 12
[E12B0  |    416/60000 (  1%) ] Loss: 2.2385 top1= 43.1818

=== Log global consensus distance @ E12B0 ===
consensus_distance=3486.555



=== Log clique consensus distance @ E12B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=3.455


[E12B10 |   4576/60000 (  8%) ] Loss: 2.4629 top1= 44.6023

=== Log global consensus distance @ E12B10 ===
consensus_distance=3717.027



=== Log clique consensus distance @ E12B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=3.575


[E12B20 |   8736/60000 ( 15%) ] Loss: 2.1656 top1= 43.4659

=== Log global consensus distance @ E12B20 ===
consensus_distance=3954.702



=== Log clique consensus distance @ E12B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=3.678



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.1793 top1= 10.2664


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.3472 top1= 55.9896


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.1642 top1= 59.7256

Train epoch 13
[E13B0  |    416/60000 (  1%) ] Loss: 2.3869 top1= 42.8977

=== Log global consensus distance @ E13B0 ===
consensus_distance=4200.009



=== Log clique consensus distance @ E13B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=3.796


[E13B10 |   4576/60000 (  8%) ] Loss: 2.2514 top1= 40.0568

=== Log global consensus distance @ E13B10 ===
consensus_distance=4452.631



=== Log clique consensus distance @ E13B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=3.869


[E13B20 |   8736/60000 ( 15%) ] Loss: 2.2448 top1= 40.6250

=== Log global consensus distance @ E13B20 ===
consensus_distance=4712.542



=== Log clique consensus distance @ E13B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=3.959



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.4490 top1= 10.1262


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.5060 top1= 51.6026


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.2111 top1= 57.6522

Train epoch 14
[E14B0  |    416/60000 (  1%) ] Loss: 2.5573 top1= 39.4886

=== Log global consensus distance @ E14B0 ===
consensus_distance=4979.731



=== Log clique consensus distance @ E14B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=4.085


[E14B10 |   4576/60000 (  8%) ] Loss: 2.3168 top1= 37.5000

=== Log global consensus distance @ E14B10 ===
consensus_distance=5254.243



=== Log clique consensus distance @ E14B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=4.215


[E14B20 |   8736/60000 ( 15%) ] Loss: 2.3181 top1= 40.9091

=== Log global consensus distance @ E14B20 ===
consensus_distance=5536.080



=== Log clique consensus distance @ E14B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=4.318



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.7294 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.6571 top1= 44.8518


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.3492 top1= 54.1466

Train epoch 15
[E15B0  |    416/60000 (  1%) ] Loss: 2.6368 top1= 36.9318

=== Log global consensus distance @ E15B0 ===
consensus_distance=5825.209



=== Log clique consensus distance @ E15B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=4.428


[E15B10 |   4576/60000 (  8%) ] Loss: 2.5340 top1= 36.3636

=== Log global consensus distance @ E15B10 ===
consensus_distance=6121.646



=== Log clique consensus distance @ E15B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=4.549


[E15B20 |   8736/60000 ( 15%) ] Loss: 2.5691 top1= 34.9432

=== Log global consensus distance @ E15B20 ===
consensus_distance=6425.431



=== Log clique consensus distance @ E15B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=4.666



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5.9810 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.7566 top1= 43.1290


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.5454 top1= 45.5128

Train epoch 16
[E16B0  |    416/60000 (  1%) ] Loss: 2.7136 top1= 34.0909

=== Log global consensus distance @ E16B0 ===
consensus_distance=6736.548



=== Log clique consensus distance @ E16B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=4.802


[E16B10 |   4576/60000 (  8%) ] Loss: 2.8912 top1= 31.8182

=== Log global consensus distance @ E16B10 ===
consensus_distance=7055.055



=== Log clique consensus distance @ E16B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=4.986


[E16B20 |   8736/60000 ( 15%) ] Loss: 2.7414 top1= 32.1023

=== Log global consensus distance @ E16B20 ===
consensus_distance=7380.857



=== Log clique consensus distance @ E16B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=5.152



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.2244 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.8630 top1= 39.2127


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.7060 top1= 39.9439

Train epoch 17
[E17B0  |    416/60000 (  1%) ] Loss: 2.7963 top1= 31.2500

=== Log global consensus distance @ E17B0 ===
consensus_distance=7714.015



=== Log clique consensus distance @ E17B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=5.312


[E17B10 |   4576/60000 (  8%) ] Loss: 2.7641 top1= 23.8636

=== Log global consensus distance @ E17B10 ===
consensus_distance=8054.536



=== Log clique consensus distance @ E17B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=5.423


[E17B20 |   8736/60000 ( 15%) ] Loss: 2.8058 top1= 32.1023

=== Log global consensus distance @ E17B20 ===
consensus_distance=8402.369



=== Log clique consensus distance @ E17B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=5.500



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.4601 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.0072 top1= 35.5268


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.7766 top1= 42.5080

Train epoch 18
[E18B0  |    416/60000 (  1%) ] Loss: 2.8304 top1= 31.2500

=== Log global consensus distance @ E18B0 ===
consensus_distance=8757.525



=== Log clique consensus distance @ E18B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=5.570


[E18B10 |   4576/60000 (  8%) ] Loss: 2.7534 top1= 22.7273

=== Log global consensus distance @ E18B10 ===
consensus_distance=9120.022



=== Log clique consensus distance @ E18B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=5.600


[E18B20 |   8736/60000 ( 15%) ] Loss: 2.9136 top1= 25.2841

=== Log global consensus distance @ E18B20 ===
consensus_distance=9489.888



=== Log clique consensus distance @ E18B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=5.618



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.6896 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.9485 top1= 37.9507


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.7692 top1= 40.3446

Train epoch 19
[E19B0  |    416/60000 (  1%) ] Loss: 2.8804 top1= 26.4205

=== Log global consensus distance @ E19B0 ===
consensus_distance=9867.104



=== Log clique consensus distance @ E19B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=5.641


[E19B10 |   4576/60000 (  8%) ] Loss: 2.8379 top1= 21.5909

=== Log global consensus distance @ E19B10 ===
consensus_distance=10251.688



=== Log clique consensus distance @ E19B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=5.678


[E19B20 |   8736/60000 ( 15%) ] Loss: 3.0443 top1= 23.5795

=== Log global consensus distance @ E19B20 ===
consensus_distance=10643.637



=== Log clique consensus distance @ E19B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=5.724



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=6.9146 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.9834 top1= 35.5469


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.7554 top1= 40.6851

Train epoch 20
[E20B0  |    416/60000 (  1%) ] Loss: 2.9704 top1= 23.8636

=== Log global consensus distance @ E20B0 ===
consensus_distance=11042.944



=== Log clique consensus distance @ E20B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=5.761


[E20B10 |   4576/60000 (  8%) ] Loss: 2.9454 top1= 21.0227

=== Log global consensus distance @ E20B10 ===
consensus_distance=11449.617



=== Log clique consensus distance @ E20B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=5.831


[E20B20 |   8736/60000 ( 15%) ] Loss: 3.1663 top1= 24.1477

=== Log global consensus distance @ E20B20 ===
consensus_distance=11863.654



=== Log clique consensus distance @ E20B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=5.896



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.1343 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.0819 top1= 32.1615


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.7909 top1= 39.6635

Train epoch 21
[E21B0  |    416/60000 (  1%) ] Loss: 3.0601 top1= 21.5909

=== Log global consensus distance @ E21B0 ===
consensus_distance=12285.046



=== Log clique consensus distance @ E21B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=5.940


[E21B10 |   4576/60000 (  8%) ] Loss: 3.0645 top1= 19.8864

=== Log global consensus distance @ E21B10 ===
consensus_distance=12713.800



=== Log clique consensus distance @ E21B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=6.040


[E21B20 |   8736/60000 ( 15%) ] Loss: 3.3500 top1= 23.2955

=== Log global consensus distance @ E21B20 ===
consensus_distance=13149.968



=== Log clique consensus distance @ E21B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=6.191



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.3472 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.1958 top1= 32.7524


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.8685 top1= 37.7604

Train epoch 22
[E22B0  |    416/60000 (  1%) ] Loss: 3.2730 top1= 19.6023

=== Log global consensus distance @ E22B0 ===
consensus_distance=13593.434



=== Log clique consensus distance @ E22B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=6.286


[E22B10 |   4576/60000 (  8%) ] Loss: 3.1316 top1= 21.8750

=== Log global consensus distance @ E22B10 ===
consensus_distance=14044.292



=== Log clique consensus distance @ E22B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=6.373


[E22B20 |   8736/60000 ( 15%) ] Loss: 3.4171 top1= 21.8750

=== Log global consensus distance @ E22B20 ===
consensus_distance=14502.533



=== Log clique consensus distance @ E22B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=6.534



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.5539 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2651 top1= 30.4888


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.8947 top1= 36.4884

Train epoch 23
[E23B0  |    416/60000 (  1%) ] Loss: 3.3506 top1= 20.1705

=== Log global consensus distance @ E23B0 ===
consensus_distance=14968.180



=== Log clique consensus distance @ E23B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=6.697


[E23B10 |   4576/60000 (  8%) ] Loss: 3.1737 top1= 20.7386

=== Log global consensus distance @ E23B10 ===
consensus_distance=15441.170



=== Log clique consensus distance @ E23B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=6.827


[E23B20 |   8736/60000 ( 15%) ] Loss: 3.5163 top1= 21.5909

=== Log global consensus distance @ E23B20 ===
consensus_distance=15921.461



=== Log clique consensus distance @ E23B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=7.025



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.7554 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2836 top1= 26.6126


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.0092 top1= 30.4287

Train epoch 24
[E24B0  |    416/60000 (  1%) ] Loss: 3.4549 top1= 19.3182

=== Log global consensus distance @ E24B0 ===
consensus_distance=16409.158



=== Log clique consensus distance @ E24B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=7.228


[E24B10 |   4576/60000 (  8%) ] Loss: 3.2420 top1= 19.3182

=== Log global consensus distance @ E24B10 ===
consensus_distance=16904.229



=== Log clique consensus distance @ E24B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=7.396


[E24B20 |   8736/60000 ( 15%) ] Loss: 3.5950 top1= 21.8750

=== Log global consensus distance @ E24B20 ===
consensus_distance=17406.682



=== Log clique consensus distance @ E24B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=7.672



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7.9517 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.4917 top1= 24.6294


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.0527 top1= 26.6126

Train epoch 25
[E25B0  |    416/60000 (  1%) ] Loss: 3.5413 top1= 19.3182

=== Log global consensus distance @ E25B0 ===
consensus_distance=17916.510



=== Log clique consensus distance @ E25B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=7.916


[E25B10 |   4576/60000 (  8%) ] Loss: 3.3248 top1= 20.4545

=== Log global consensus distance @ E25B10 ===
consensus_distance=18433.670



=== Log clique consensus distance @ E25B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=8.078


[E25B20 |   8736/60000 ( 15%) ] Loss: 3.6238 top1= 21.3068

=== Log global consensus distance @ E25B20 ===
consensus_distance=18958.203



=== Log clique consensus distance @ E25B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=8.309



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=8.1434 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.7435 top1= 19.8618


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.1768 top1= 27.1134

Train epoch 26
[E26B0  |    416/60000 (  1%) ] Loss: 3.6795 top1= 16.1932

=== Log global consensus distance @ E26B0 ===
consensus_distance=19490.096



=== Log clique consensus distance @ E26B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=8.585


[E26B10 |   4576/60000 (  8%) ] Loss: 3.4997 top1= 15.0568

=== Log global consensus distance @ E26B10 ===
consensus_distance=20029.359



=== Log clique consensus distance @ E26B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=8.728


[E26B20 |   8736/60000 ( 15%) ] Loss: 3.7521 top1= 17.6136

=== Log global consensus distance @ E26B20 ===
consensus_distance=20576.000



=== Log clique consensus distance @ E26B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=8.897



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=8.3294 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.0454 top1= 15.1042


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.2483 top1= 32.4820

Train epoch 27
[E27B0  |    416/60000 (  1%) ] Loss: 3.6968 top1= 13.6364

=== Log global consensus distance @ E27B0 ===
consensus_distance=21129.973



=== Log clique consensus distance @ E27B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=9.125


[E27B10 |   4576/60000 (  8%) ] Loss: 3.5858 top1= 18.1818

=== Log global consensus distance @ E27B10 ===
consensus_distance=21691.375



=== Log clique consensus distance @ E27B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=9.332


[E27B20 |   8736/60000 ( 15%) ] Loss: 3.8904 top1= 14.7727

=== Log global consensus distance @ E27B20 ===
consensus_distance=22260.146



=== Log clique consensus distance @ E27B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=9.586



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=8.5113 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.6046 top1= 18.8401


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.3959 top1= 24.8798

Train epoch 28
[E28B0  |    416/60000 (  1%) ] Loss: 3.7170 top1= 13.0682

=== Log global consensus distance @ E28B0 ===
consensus_distance=22836.195



=== Log clique consensus distance @ E28B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=9.802


[E28B10 |   4576/60000 (  8%) ] Loss: 3.6369 top1= 14.2045

=== Log global consensus distance @ E28B10 ===
consensus_distance=23419.596



=== Log clique consensus distance @ E28B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=9.952


[E28B20 |   8736/60000 ( 15%) ] Loss: 3.8064 top1= 13.3523

=== Log global consensus distance @ E28B20 ===
consensus_distance=24010.334



=== Log clique consensus distance @ E28B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=10.225



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=8.6898 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.0174 top1=  9.8958


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.7599 top1= 21.5845

Train epoch 29
[E29B0  |    416/60000 (  1%) ] Loss: 3.7749 top1=  8.5227

=== Log global consensus distance @ E29B0 ===
consensus_distance=24608.443



=== Log clique consensus distance @ E29B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=10.505


[E29B10 |   4576/60000 (  8%) ] Loss: 3.4822 top1= 14.7727

=== Log global consensus distance @ E29B10 ===
consensus_distance=25213.941



=== Log clique consensus distance @ E29B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=10.782


[E29B20 |   8736/60000 ( 15%) ] Loss: 4.1151 top1= 14.2045

=== Log global consensus distance @ E29B20 ===
consensus_distance=25826.773



=== Log clique consensus distance @ E29B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=11.189



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=8.8650 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.4711 top1=  9.5052


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.8515 top1= 18.0188

Train epoch 30
[E30B0  |    416/60000 (  1%) ] Loss: 3.7600 top1= 13.0682

=== Log global consensus distance @ E30B0 ===
consensus_distance=26446.992



=== Log clique consensus distance @ E30B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=11.582


[E30B10 |   4576/60000 (  8%) ] Loss: 3.4410 top1= 14.2045

=== Log global consensus distance @ E30B10 ===
consensus_distance=27074.590



=== Log clique consensus distance @ E30B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=11.935


[E30B20 |   8736/60000 ( 15%) ] Loss: 4.3789 top1= 12.7841

=== Log global consensus distance @ E30B20 ===
consensus_distance=27709.449



=== Log clique consensus distance @ E30B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=12.330



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=9.0363 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.0286 top1= 14.0325


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.0743 top1= 11.0777

Train epoch 31
[E31B0  |    416/60000 (  1%) ] Loss: 3.9926 top1= 10.7955

=== Log global consensus distance @ E31B0 ===
consensus_distance=28351.756



=== Log clique consensus distance @ E31B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=12.809


[E31B10 |   4576/60000 (  8%) ] Loss: 3.6868 top1= 13.6364

=== Log global consensus distance @ E31B10 ===
consensus_distance=29001.428



=== Log clique consensus distance @ E31B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=13.320


[E31B20 |   8736/60000 ( 15%) ] Loss: 4.0368 top1= 13.0682

=== Log global consensus distance @ E31B20 ===
consensus_distance=29658.398



=== Log clique consensus distance @ E31B20 ===
clique1_consensus_distance=2.559
clique2_consensus_distance=13.915



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=9.2000 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.6462 top1= 12.5701


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.4941 top1=  9.2648

Train epoch 32
[E32B0  |    416/60000 (  1%) ] Loss: 3.9503 top1= 10.7955

=== Log global consensus distance @ E32B0 ===
consensus_distance=30322.762



=== Log clique consensus distance @ E32B0 ===
clique1_consensus_distance=2.559
clique2_consensus_distance=14.560


[E32B10 |   4576/60000 (  8%) ] Loss: 3.6718 top1= 15.6250

=== Log global consensus distance @ E32B10 ===
consensus_distance=30994.443



=== Log clique consensus distance @ E32B10 ===
clique1_consensus_distance=2.559
clique2_consensus_distance=15.143


[E32B20 |   8736/60000 ( 15%) ] Loss: 4.1224 top1= 11.6477

=== Log global consensus distance @ E32B20 ===
consensus_distance=31673.453



=== Log clique consensus distance @ E32B20 ===
clique1_consensus_distance=2.559
clique2_consensus_distance=15.876



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=9.3559 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.9683 top1=  9.8057


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.2003 top1=  9.5853

Train epoch 33
[E33B0  |    416/60000 (  1%) ] Loss: 4.0419 top1= 10.7955

=== Log global consensus distance @ E33B0 ===
consensus_distance=32359.816



=== Log clique consensus distance @ E33B0 ===
clique1_consensus_distance=2.559
clique2_consensus_distance=16.603


[E33B10 |   4576/60000 (  8%) ] Loss: 4.0753 top1= 15.3409

=== Log global consensus distance @ E33B10 ===
consensus_distance=33053.270



=== Log clique consensus distance @ E33B10 ===
clique1_consensus_distance=2.559
clique2_consensus_distance=16.801


[E33B20 |   8736/60000 ( 15%) ] Loss: 4.3204 top1= 11.6477

=== Log global consensus distance @ E33B20 ===
consensus_distance=33754.023



=== Log clique consensus distance @ E33B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=16.894



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=9.5038 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.8723 top1=  9.5152


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.2467 top1=  9.5753

Train epoch 34
[E34B0  |    416/60000 (  1%) ] Loss: 4.2855 top1= 12.2159

=== Log global consensus distance @ E34B0 ===
consensus_distance=34462.102



=== Log clique consensus distance @ E34B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=16.894


[E34B10 |   4576/60000 (  8%) ] Loss: 4.1030 top1= 15.3409

=== Log global consensus distance @ E34B10 ===
consensus_distance=35177.527



=== Log clique consensus distance @ E34B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=16.837


[E34B20 |   8736/60000 ( 15%) ] Loss: 4.3595 top1=  8.5227

=== Log global consensus distance @ E34B20 ===
consensus_distance=35900.207



=== Log clique consensus distance @ E34B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=16.706



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=9.6449 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.8273 top1=  6.7608


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.3167 top1=  9.5753

Train epoch 35
[E35B0  |    416/60000 (  1%) ] Loss: 4.3338 top1=  9.9432

=== Log global consensus distance @ E35B0 ===
consensus_distance=36630.301



=== Log clique consensus distance @ E35B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=16.578


[E35B10 |   4576/60000 (  8%) ] Loss: 4.2717 top1= 15.0568

=== Log global consensus distance @ E35B10 ===
consensus_distance=37367.773



=== Log clique consensus distance @ E35B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=16.434


[E35B20 |   8736/60000 ( 15%) ] Loss: 4.7145 top1= 10.2273

=== Log global consensus distance @ E35B20 ===
consensus_distance=38112.562



=== Log clique consensus distance @ E35B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=16.265



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=9.7809 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.8305 top1= 10.1663


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.1719 top1=  9.5853

Train epoch 36
[E36B0  |    416/60000 (  1%) ] Loss: 4.3500 top1= 11.6477

=== Log global consensus distance @ E36B0 ===
consensus_distance=38864.789



=== Log clique consensus distance @ E36B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=16.137


[E36B10 |   4576/60000 (  8%) ] Loss: 4.5307 top1= 13.0682

=== Log global consensus distance @ E36B10 ===
consensus_distance=39624.359



=== Log clique consensus distance @ E36B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=16.097


[E36B20 |   8736/60000 ( 15%) ] Loss: 4.7176 top1=  9.3750

=== Log global consensus distance @ E36B20 ===
consensus_distance=40391.258



=== Log clique consensus distance @ E36B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=16.013



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=9.9124 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5.3747 top1=  9.4952


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.6089 top1= 25.8413

Train epoch 37
[E37B0  |    416/60000 (  1%) ] Loss: 4.6153 top1= 10.2273

=== Log global consensus distance @ E37B0 ===
consensus_distance=41165.520



=== Log clique consensus distance @ E37B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=15.949


[E37B10 |   4576/60000 (  8%) ] Loss: 4.2733 top1= 12.2159

=== Log global consensus distance @ E37B10 ===
consensus_distance=41947.156



=== Log clique consensus distance @ E37B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=15.872


[E37B20 |   8736/60000 ( 15%) ] Loss: 4.6565 top1=  9.9432

=== Log global consensus distance @ E37B20 ===
consensus_distance=42736.168



=== Log clique consensus distance @ E37B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=15.762



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=10.0404 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5.6074 top1= 10.2764


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.1745 top1= 13.7420

Train epoch 38
[E38B0  |    416/60000 (  1%) ] Loss: 4.6984 top1= 13.6364

=== Log global consensus distance @ E38B0 ===
consensus_distance=43532.480



=== Log clique consensus distance @ E38B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=15.640


[E38B10 |   4576/60000 (  8%) ] Loss: 4.1849 top1= 13.9205

=== Log global consensus distance @ E38B10 ===
consensus_distance=44336.145



=== Log clique consensus distance @ E38B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=15.505


[E38B20 |   8736/60000 ( 15%) ] Loss: 4.5843 top1= 14.2045

=== Log global consensus distance @ E38B20 ===
consensus_distance=45147.168



=== Log clique consensus distance @ E38B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=15.378



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=10.1649 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5.5566 top1=  7.8726


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.0938 top1=  9.5753

Train epoch 39
[E39B0  |    416/60000 (  1%) ] Loss: 4.4196 top1= 14.2045

=== Log global consensus distance @ E39B0 ===
consensus_distance=45965.539



=== Log clique consensus distance @ E39B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=15.322


[E39B10 |   4576/60000 (  8%) ] Loss: 4.2608 top1= 11.0795

=== Log global consensus distance @ E39B10 ===
consensus_distance=46791.324



=== Log clique consensus distance @ E39B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=15.249


[E39B20 |   8736/60000 ( 15%) ] Loss: 4.5735 top1= 12.7841

=== Log global consensus distance @ E39B20 ===
consensus_distance=47624.406



=== Log clique consensus distance @ E39B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=15.103



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=10.2864 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5.5695 top1=  7.4419


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.3548 top1=  9.7756

Train epoch 40
[E40B0  |    416/60000 (  1%) ] Loss: 4.3705 top1= 13.9205

=== Log global consensus distance @ E40B0 ===
consensus_distance=48464.832



=== Log clique consensus distance @ E40B0 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=14.991


[E40B10 |   4576/60000 (  8%) ] Loss: 4.1945 top1= 14.7727

=== Log global consensus distance @ E40B10 ===
consensus_distance=49312.684



=== Log clique consensus distance @ E40B10 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=14.908


[E40B20 |   8736/60000 ( 15%) ] Loss: 4.6246 top1= 12.7841

=== Log global consensus distance @ E40B20 ===
consensus_distance=50167.809



=== Log clique consensus distance @ E40B20 ===
clique1_consensus_distance=2.560
clique2_consensus_distance=14.796



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=10.4050 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.8771 top1=  6.1098


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.7340 top1= 11.9091

