
=== Start adding workers ===
=> Add worker SGDMWorker(index=0, momentum=0.9)
=> Add worker SGDMWorker(index=1, momentum=0.9)
=> Add worker SGDMWorker(index=2, momentum=0.9)
=> Add worker SGDMWorker(index=3, momentum=0.9)
=> Add worker SGDMWorker(index=4, momentum=0.9)
=> Add worker SGDMWorker(index=5, momentum=0.9)
=> Add worker SGDMWorker(index=6, momentum=0.9)
=> Add worker SGDMWorker(index=7, momentum=0.9)
=> Add worker SGDMWorker(index=8, momentum=0.9)
=> Add worker SGDMWorker(index=9, momentum=0.9)
=> Add worker SGDMWorker(index=10, momentum=0.9)
=> Add worker BitFlippingWorker

=== Start adding graph ===
TwoCliquesWithByzantine(m=5,b=1)

Train epoch 1
[E 1B0  |    384/60000 (  1%) ] Loss: 2.3142 top1=  7.6705

=== Peeking data label distribution E1B0 ===
Worker 0 has targets: tensor([0, 0, 0, 0, 0], device='cuda:0')
Worker 1 has targets: tensor([1, 1, 1, 0, 1], device='cuda:0')
Worker 2 has targets: tensor([1, 1, 2, 1, 1], device='cuda:0')
Worker 3 has targets: tensor([2, 2, 3, 2, 2], device='cuda:0')
Worker 4 has targets: tensor([3, 3, 3, 3, 3], device='cuda:0')
Worker 5 has targets: tensor([4, 4, 4, 4, 4], device='cuda:0')
Worker 6 has targets: tensor([5, 5, 5, 5, 5], device='cuda:0')
Worker 7 has targets: tensor([6, 6, 6, 5, 6], device='cuda:0')
Worker 8 has targets: tensor([6, 7, 7, 6, 6], device='cuda:0')
Worker 9 has targets: tensor([7, 7, 8, 7, 7], device='cuda:0')
Worker 10 has targets: tensor([8, 8, 9, 8, 8], device='cuda:0')
Worker 11 has targets: tensor([9, 9, 9, 9, 9], device='cuda:0')



=== Log global consensus distance @ E1B0 ===
consensus_distance=0.004



=== Log clique consensus distance @ E1B0 ===
clique1_consensus_distance=0.003
clique2_consensus_distance=0.005



=== Log mixing matrix @ E1B0 ===
[[0.167 0.167 0.167 0.167 0.167 0.    0.    0.    0.    0.    0.167 0.   ]
 [0.167 0.233 0.2   0.2   0.2   0.    0.    0.    0.    0.    0.    0.   ]
 [0.167 0.2   0.233 0.2   0.2   0.    0.    0.    0.    0.    0.    0.   ]
 [0.167 0.2   0.2   0.233 0.2   0.    0.    0.    0.    0.    0.    0.   ]
 [0.167 0.2   0.2   0.2   0.233 0.    0.    0.    0.    0.    0.    0.   ]
 [0.    0.    0.    0.    0.    0.233 0.2   0.2   0.2   0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.2   0.233 0.2   0.2   0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.2   0.2   0.233 0.2   0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.2   0.2   0.2   0.233 0.167 0.    0.   ]
 [0.    0.    0.    0.    0.    0.167 0.167 0.167 0.167 0.167 0.167 0.   ]
 [0.167 0.    0.    0.    0.    0.    0.    0.    0.    0.167 0.499 0.168]
 [0.    0.    0.    0.    0.    0.    0.    0.    0.    0.    0.168 0.833]]


[E 1B10 |   4224/60000 (  7%) ] Loss: 0.2675 top1= 89.4886

=== Log global consensus distance @ E1B10 ===
consensus_distance=1.340



=== Log clique consensus distance @ E1B10 ===
clique1_consensus_distance=1.070
clique2_consensus_distance=2.093


[E 1B20 |   8064/60000 ( 13%) ] Loss: 0.1491 top1= 94.8864

=== Log global consensus distance @ E1B20 ===
consensus_distance=2.864



=== Log clique consensus distance @ E1B20 ===
clique1_consensus_distance=2.316
clique2_consensus_distance=4.423



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.7849 top1= 47.0753


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.1641 top1= 38.2712


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.3101 top1= 32.8726

Train epoch 2
[E 2B0  |    384/60000 (  1%) ] Loss: 0.0997 top1= 98.0114

=== Log global consensus distance @ E2B0 ===
consensus_distance=3.775



=== Log clique consensus distance @ E2B0 ===
clique1_consensus_distance=3.105
clique2_consensus_distance=5.747


[E 2B10 |   4224/60000 (  7%) ] Loss: 0.0571 top1= 98.0114

=== Log global consensus distance @ E2B10 ===
consensus_distance=4.320



=== Log clique consensus distance @ E2B10 ===
clique1_consensus_distance=3.586
clique2_consensus_distance=6.512


[E 2B20 |   8064/60000 ( 13%) ] Loss: 0.0325 top1= 98.8636

=== Log global consensus distance @ E2B20 ===
consensus_distance=4.652



=== Log clique consensus distance @ E2B20 ===
clique1_consensus_distance=3.871
clique2_consensus_distance=6.988



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6493 top1= 57.2716


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.7308 top1= 39.1226


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.3089 top1= 35.5268

Train epoch 3
[E 3B0  |    384/60000 (  1%) ] Loss: 0.0264 top1= 99.4318

=== Log global consensus distance @ E3B0 ===
consensus_distance=4.851



=== Log clique consensus distance @ E3B0 ===
clique1_consensus_distance=4.013
clique2_consensus_distance=7.306


[E 3B10 |   4224/60000 (  7%) ] Loss: 0.0129 top1= 99.4318

=== Log global consensus distance @ E3B10 ===
consensus_distance=4.983



=== Log clique consensus distance @ E3B10 ===
clique1_consensus_distance=4.132
clique2_consensus_distance=7.479


[E 3B20 |   8064/60000 ( 13%) ] Loss: 0.0067 top1= 99.7159

=== Log global consensus distance @ E3B20 ===
consensus_distance=5.075



=== Log clique consensus distance @ E3B20 ===
clique1_consensus_distance=4.223
clique2_consensus_distance=7.563



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6309 top1= 59.1446


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.4984 top1= 39.6334


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.7028 top1= 34.9659

Train epoch 4
[E 4B0  |    384/60000 (  1%) ] Loss: 0.0021 top1=100.0000

=== Log global consensus distance @ E4B0 ===
consensus_distance=5.129



=== Log clique consensus distance @ E4B0 ===
clique1_consensus_distance=4.273
clique2_consensus_distance=7.615


[E 4B10 |   4224/60000 (  7%) ] Loss: 0.0065 top1= 99.7159

=== Log global consensus distance @ E4B10 ===
consensus_distance=5.159



=== Log clique consensus distance @ E4B10 ===
clique1_consensus_distance=4.297
clique2_consensus_distance=7.651


[E 4B20 |   8064/60000 ( 13%) ] Loss: 0.0035 top1=100.0000

=== Log global consensus distance @ E4B20 ===
consensus_distance=5.176



=== Log clique consensus distance @ E4B20 ===
clique1_consensus_distance=4.320
clique2_consensus_distance=7.659



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6253 top1= 58.6438


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.7533 top1= 39.5433


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.8271 top1= 35.0962

Train epoch 5
[E 5B0  |    384/60000 (  1%) ] Loss: 0.0011 top1=100.0000

=== Log global consensus distance @ E5B0 ===
consensus_distance=5.190



=== Log clique consensus distance @ E5B0 ===
clique1_consensus_distance=4.342
clique2_consensus_distance=7.663


[E 5B10 |   4224/60000 (  7%) ] Loss: 0.0024 top1=100.0000

=== Log global consensus distance @ E5B10 ===
consensus_distance=5.191



=== Log clique consensus distance @ E5B10 ===
clique1_consensus_distance=4.344
clique2_consensus_distance=7.668


[E 5B20 |   8064/60000 ( 13%) ] Loss: 0.0010 top1=100.0000

=== Log global consensus distance @ E5B20 ===
consensus_distance=5.188



=== Log clique consensus distance @ E5B20 ===
clique1_consensus_distance=4.342
clique2_consensus_distance=7.667



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6140 top1= 58.9543


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.8409 top1= 39.5933


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.9079 top1= 35.2464

Train epoch 6
[E 6B0  |    384/60000 (  1%) ] Loss: 0.0005 top1=100.0000

=== Log global consensus distance @ E6B0 ===
consensus_distance=5.181



=== Log clique consensus distance @ E6B0 ===
clique1_consensus_distance=4.341
clique2_consensus_distance=7.657


[E 6B10 |   4224/60000 (  7%) ] Loss: 0.0032 top1=100.0000

=== Log global consensus distance @ E6B10 ===
consensus_distance=5.180



=== Log clique consensus distance @ E6B10 ===
clique1_consensus_distance=4.353
clique2_consensus_distance=7.647


[E 6B20 |   8064/60000 ( 13%) ] Loss: 0.0003 top1=100.0000

=== Log global consensus distance @ E6B20 ===
consensus_distance=5.178



=== Log clique consensus distance @ E6B20 ===
clique1_consensus_distance=4.365
clique2_consensus_distance=7.635



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6116 top1= 58.0429


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.8393 top1= 39.4932


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.9768 top1= 35.2163

Train epoch 7
[E 7B0  |    384/60000 (  1%) ] Loss: 0.0004 top1=100.0000

=== Log global consensus distance @ E7B0 ===
consensus_distance=5.175



=== Log clique consensus distance @ E7B0 ===
clique1_consensus_distance=4.373
clique2_consensus_distance=7.623


[E 7B10 |   4224/60000 (  7%) ] Loss: 0.0004 top1=100.0000

=== Log global consensus distance @ E7B10 ===
consensus_distance=5.163



=== Log clique consensus distance @ E7B10 ===
clique1_consensus_distance=4.365
clique2_consensus_distance=7.607


[E 7B20 |   8064/60000 ( 13%) ] Loss: 0.0003 top1=100.0000

=== Log global consensus distance @ E7B20 ===
consensus_distance=5.148



=== Log clique consensus distance @ E7B20 ===
clique1_consensus_distance=4.353
clique2_consensus_distance=7.591



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6103 top1= 58.4435


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.8583 top1= 39.6134


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.0227 top1= 35.1062

Train epoch 8
[E 8B0  |    384/60000 (  1%) ] Loss: 0.0003 top1=100.0000

=== Log global consensus distance @ E8B0 ===
consensus_distance=5.134



=== Log clique consensus distance @ E8B0 ===
clique1_consensus_distance=4.342
clique2_consensus_distance=7.574


[E 8B10 |   4224/60000 (  7%) ] Loss: 0.0003 top1=100.0000

=== Log global consensus distance @ E8B10 ===
consensus_distance=5.116



=== Log clique consensus distance @ E8B10 ===
clique1_consensus_distance=4.324
clique2_consensus_distance=7.555


[E 8B20 |   8064/60000 ( 13%) ] Loss: 0.0002 top1=100.0000

=== Log global consensus distance @ E8B20 ===
consensus_distance=5.098



=== Log clique consensus distance @ E8B20 ===
clique1_consensus_distance=4.306
clique2_consensus_distance=7.535



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6101 top1= 58.1530


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.9315 top1= 39.6034


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.0587 top1= 35.0661

Train epoch 9
[E 9B0  |    384/60000 (  1%) ] Loss: 0.0002 top1=100.0000

=== Log global consensus distance @ E9B0 ===
consensus_distance=5.079



=== Log clique consensus distance @ E9B0 ===
clique1_consensus_distance=4.286
clique2_consensus_distance=7.516


[E 9B10 |   4224/60000 (  7%) ] Loss: 0.0003 top1=100.0000

=== Log global consensus distance @ E9B10 ===
consensus_distance=5.059



=== Log clique consensus distance @ E9B10 ===
clique1_consensus_distance=4.264
clique2_consensus_distance=7.496


[E 9B20 |   8064/60000 ( 13%) ] Loss: 0.0002 top1=100.0000

=== Log global consensus distance @ E9B20 ===
consensus_distance=5.039



=== Log clique consensus distance @ E9B20 ===
clique1_consensus_distance=4.242
clique2_consensus_distance=7.476



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6104 top1= 58.0629


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.0090 top1= 39.6034


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.0886 top1= 35.0561

Train epoch 10
[E10B0  |    384/60000 (  1%) ] Loss: 0.0002 top1=100.0000

=== Log global consensus distance @ E10B0 ===
consensus_distance=5.019



=== Log clique consensus distance @ E10B0 ===
clique1_consensus_distance=4.221
clique2_consensus_distance=7.456


[E10B10 |   4224/60000 (  7%) ] Loss: 0.0003 top1=100.0000

=== Log global consensus distance @ E10B10 ===
consensus_distance=4.999



=== Log clique consensus distance @ E10B10 ===
clique1_consensus_distance=4.198
clique2_consensus_distance=7.436


[E10B20 |   8064/60000 ( 13%) ] Loss: 0.0002 top1=100.0000

=== Log global consensus distance @ E10B20 ===
consensus_distance=4.979



=== Log clique consensus distance @ E10B20 ===
clique1_consensus_distance=4.177
clique2_consensus_distance=7.416



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6097 top1= 57.8726


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.0466 top1= 39.6034


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.1142 top1= 35.0561

Train epoch 11
[E11B0  |    384/60000 (  1%) ] Loss: 0.0002 top1=100.0000

=== Log global consensus distance @ E11B0 ===
consensus_distance=4.959



=== Log clique consensus distance @ E11B0 ===
clique1_consensus_distance=4.156
clique2_consensus_distance=7.395


[E11B10 |   4224/60000 (  7%) ] Loss: 0.0002 top1=100.0000

=== Log global consensus distance @ E11B10 ===
consensus_distance=4.938



=== Log clique consensus distance @ E11B10 ===
clique1_consensus_distance=4.133
clique2_consensus_distance=7.375


[E11B20 |   8064/60000 ( 13%) ] Loss: 0.0002 top1=100.0000

=== Log global consensus distance @ E11B20 ===
consensus_distance=4.918



=== Log clique consensus distance @ E11B20 ===
clique1_consensus_distance=4.112
clique2_consensus_distance=7.354



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6092 top1= 57.7023


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.0806 top1= 39.5933


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.1376 top1= 35.0561

Train epoch 12
[E12B0  |    384/60000 (  1%) ] Loss: 0.0001 top1=100.0000

=== Log global consensus distance @ E12B0 ===
consensus_distance=4.898



=== Log clique consensus distance @ E12B0 ===
clique1_consensus_distance=4.090
clique2_consensus_distance=7.334


[E12B10 |   4224/60000 (  7%) ] Loss: 0.0002 top1=100.0000

=== Log global consensus distance @ E12B10 ===
consensus_distance=4.877



=== Log clique consensus distance @ E12B10 ===
clique1_consensus_distance=4.068
clique2_consensus_distance=7.313


[E12B20 |   8064/60000 ( 13%) ] Loss: 0.0001 top1=100.0000

=== Log global consensus distance @ E12B20 ===
consensus_distance=4.857



=== Log clique consensus distance @ E12B20 ===
clique1_consensus_distance=4.046
clique2_consensus_distance=7.292



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6087 top1= 57.6222


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.1089 top1= 39.5933


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.1596 top1= 35.0661

Train epoch 13
[E13B0  |    384/60000 (  1%) ] Loss: 0.0001 top1=100.0000

=== Log global consensus distance @ E13B0 ===
consensus_distance=4.837



=== Log clique consensus distance @ E13B0 ===
clique1_consensus_distance=4.024
clique2_consensus_distance=7.272


[E13B10 |   4224/60000 (  7%) ] Loss: 0.0002 top1=100.0000

=== Log global consensus distance @ E13B10 ===
consensus_distance=4.816



=== Log clique consensus distance @ E13B10 ===
clique1_consensus_distance=4.002
clique2_consensus_distance=7.252


[E13B20 |   8064/60000 ( 13%) ] Loss: 0.0001 top1=100.0000

=== Log global consensus distance @ E13B20 ===
consensus_distance=4.796



=== Log clique consensus distance @ E13B20 ===
clique1_consensus_distance=3.981
clique2_consensus_distance=7.231



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6082 top1= 57.5421


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.1333 top1= 39.5933


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.1801 top1= 35.0761

Train epoch 14
[E14B0  |    384/60000 (  1%) ] Loss: 0.0001 top1=100.0000

=== Log global consensus distance @ E14B0 ===
consensus_distance=4.776



=== Log clique consensus distance @ E14B0 ===
clique1_consensus_distance=3.959
clique2_consensus_distance=7.210


[E14B10 |   4224/60000 (  7%) ] Loss: 0.0002 top1=100.0000

=== Log global consensus distance @ E14B10 ===
consensus_distance=4.756



=== Log clique consensus distance @ E14B10 ===
clique1_consensus_distance=3.937
clique2_consensus_distance=7.190


[E14B20 |   8064/60000 ( 13%) ] Loss: 0.0001 top1=100.0000

=== Log global consensus distance @ E14B20 ===
consensus_distance=4.736



=== Log clique consensus distance @ E14B20 ===
clique1_consensus_distance=3.915
clique2_consensus_distance=7.169



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6076 top1= 57.4519


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.1543 top1= 39.5933


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.1994 top1= 35.0461

Train epoch 15
[E15B0  |    384/60000 (  1%) ] Loss: 0.0001 top1=100.0000

=== Log global consensus distance @ E15B0 ===
consensus_distance=4.716



=== Log clique consensus distance @ E15B0 ===
clique1_consensus_distance=3.894
clique2_consensus_distance=7.149


[E15B10 |   4224/60000 (  7%) ] Loss: 0.0002 top1=100.0000

=== Log global consensus distance @ E15B10 ===
consensus_distance=4.695



=== Log clique consensus distance @ E15B10 ===
clique1_consensus_distance=3.872
clique2_consensus_distance=7.129


[E15B20 |   8064/60000 ( 13%) ] Loss: 0.0001 top1=100.0000

=== Log global consensus distance @ E15B20 ===
consensus_distance=4.675



=== Log clique consensus distance @ E15B20 ===
clique1_consensus_distance=3.850
clique2_consensus_distance=7.108



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6071 top1= 57.3618


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.1759 top1= 39.5833


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.2179 top1= 35.0461

Train epoch 16
[E16B0  |    384/60000 (  1%) ] Loss: 0.0001 top1=100.0000

=== Log global consensus distance @ E16B0 ===
consensus_distance=4.655



=== Log clique consensus distance @ E16B0 ===
clique1_consensus_distance=3.829
clique2_consensus_distance=7.088


[E16B10 |   4224/60000 (  7%) ] Loss: 0.0002 top1=100.0000

=== Log global consensus distance @ E16B10 ===
consensus_distance=4.635



=== Log clique consensus distance @ E16B10 ===
clique1_consensus_distance=3.807
clique2_consensus_distance=7.068


[E16B20 |   8064/60000 ( 13%) ] Loss: 0.0001 top1=100.0000

=== Log global consensus distance @ E16B20 ===
consensus_distance=4.615



=== Log clique consensus distance @ E16B20 ===
clique1_consensus_distance=3.786
clique2_consensus_distance=7.047



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6066 top1= 57.3017


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.1951 top1= 39.6034


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.2355 top1= 35.0461

Train epoch 17
[E17B0  |    384/60000 (  1%) ] Loss: 0.0001 top1=100.0000

=== Log global consensus distance @ E17B0 ===
consensus_distance=4.595



=== Log clique consensus distance @ E17B0 ===
clique1_consensus_distance=3.764
clique2_consensus_distance=7.027


[E17B10 |   4224/60000 (  7%) ] Loss: 0.0002 top1=100.0000

=== Log global consensus distance @ E17B10 ===
consensus_distance=4.575



=== Log clique consensus distance @ E17B10 ===
clique1_consensus_distance=3.743
clique2_consensus_distance=7.007


[E17B20 |   8064/60000 ( 13%) ] Loss: 0.0001 top1=100.0000

=== Log global consensus distance @ E17B20 ===
consensus_distance=4.555



=== Log clique consensus distance @ E17B20 ===
clique1_consensus_distance=3.722
clique2_consensus_distance=6.987



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6061 top1= 57.2616


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.2129 top1= 39.6134


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.2525 top1= 35.0361

Train epoch 18
[E18B0  |    384/60000 (  1%) ] Loss: 0.0001 top1=100.0000

=== Log global consensus distance @ E18B0 ===
consensus_distance=4.535



=== Log clique consensus distance @ E18B0 ===
clique1_consensus_distance=3.700
clique2_consensus_distance=6.967


[E18B10 |   4224/60000 (  7%) ] Loss: 0.0002 top1=100.0000

=== Log global consensus distance @ E18B10 ===
consensus_distance=4.515



=== Log clique consensus distance @ E18B10 ===
clique1_consensus_distance=3.679
clique2_consensus_distance=6.947


[E18B20 |   8064/60000 ( 13%) ] Loss: 0.0001 top1=100.0000

=== Log global consensus distance @ E18B20 ===
consensus_distance=4.496



=== Log clique consensus distance @ E18B20 ===
clique1_consensus_distance=3.658
clique2_consensus_distance=6.927



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6056 top1= 57.2216


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.2300 top1= 39.6134


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.2692 top1= 35.0461

Train epoch 19
[E19B0  |    384/60000 (  1%) ] Loss: 0.0001 top1=100.0000

=== Log global consensus distance @ E19B0 ===
consensus_distance=4.476



=== Log clique consensus distance @ E19B0 ===
clique1_consensus_distance=3.637
clique2_consensus_distance=6.907


[E19B10 |   4224/60000 (  7%) ] Loss: 0.0002 top1=100.0000

=== Log global consensus distance @ E19B10 ===
consensus_distance=4.456



=== Log clique consensus distance @ E19B10 ===
clique1_consensus_distance=3.615
clique2_consensus_distance=6.887


[E19B20 |   8064/60000 ( 13%) ] Loss: 0.0001 top1=100.0000

=== Log global consensus distance @ E19B20 ===
consensus_distance=4.437



=== Log clique consensus distance @ E19B20 ===
clique1_consensus_distance=3.594
clique2_consensus_distance=6.867



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6051 top1= 57.1514


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.2453 top1= 39.6134


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.2854 top1= 35.0461

Train epoch 20
[E20B0  |    384/60000 (  1%) ] Loss: 0.0001 top1=100.0000

=== Log global consensus distance @ E20B0 ===
consensus_distance=4.417



=== Log clique consensus distance @ E20B0 ===
clique1_consensus_distance=3.574
clique2_consensus_distance=6.848


[E20B10 |   4224/60000 (  7%) ] Loss: 0.0002 top1=100.0000

=== Log global consensus distance @ E20B10 ===
consensus_distance=4.397



=== Log clique consensus distance @ E20B10 ===
clique1_consensus_distance=3.552
clique2_consensus_distance=6.828


[E20B20 |   8064/60000 ( 13%) ] Loss: 0.0001 top1=100.0000

=== Log global consensus distance @ E20B20 ===
consensus_distance=4.378



=== Log clique consensus distance @ E20B20 ===
clique1_consensus_distance=3.532
clique2_consensus_distance=6.808



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6045 top1= 57.0913


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4.2597 top1= 39.6234


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.3009 top1= 35.0461

