
=== Start adding workers ===
=> Add worker SGDMWorker(index=0, momentum=0.0)
=> Add worker SGDMWorker(index=1, momentum=0.0)
=> Add worker SGDMWorker(index=2, momentum=0.0)
=> Add worker SGDMWorker(index=3, momentum=0.0)
=> Add worker SGDMWorker(index=4, momentum=0.0)
=> Add worker SGDMWorker(index=5, momentum=0.0)
=> Add worker SGDMWorker(index=6, momentum=0.0)
=> Add worker SGDMWorker(index=7, momentum=0.0)
=> Add worker SGDMWorker(index=8, momentum=0.0)
=> Add worker SGDMWorker(index=9, momentum=0.0)
=> Add worker SGDMWorker(index=10, momentum=0.0)
=> Add worker BitFlippingWorker
=> Add worker BitFlippingWorker
=> Add worker BitFlippingWorker

=== Start adding graph ===
TwoCliquesWithByzantine(m=5,b=3)

Train epoch 1
[E 1B0  |    448/60000 (  1%) ] Loss: 2.3094 top1=  7.9545

=== Peeking data label distribution E1B0 ===
Worker 0 has targets: tensor([0, 0, 0, 0, 0], device='cuda:0')
Worker 1 has targets: tensor([1, 1, 0, 1, 1], device='cuda:0')
Worker 2 has targets: tensor([1, 1, 1, 1, 1], device='cuda:0')
Worker 3 has targets: tensor([2, 2, 2, 2, 2], device='cuda:0')
Worker 4 has targets: tensor([3, 3, 2, 3, 3], device='cuda:0')
Worker 5 has targets: tensor([3, 3, 3, 3, 3], device='cuda:0')
Worker 6 has targets: tensor([4, 4, 4, 4, 4], device='cuda:0')
Worker 7 has targets: tensor([5, 5, 5, 5, 5], device='cuda:0')
Worker 8 has targets: tensor([6, 6, 5, 6, 6], device='cuda:0')
Worker 9 has targets: tensor([6, 6, 6, 6, 6], device='cuda:0')
Worker 10 has targets: tensor([7, 7, 7, 7, 7], device='cuda:0')
Worker 11 has targets: tensor([8, 8, 8, 8, 8], device='cuda:0')
Worker 12 has targets: tensor([9, 9, 8, 9, 9], device='cuda:0')
Worker 13 has targets: tensor([9, 9, 9, 9, 9], device='cuda:0')



=== Log global consensus distance @ E1B0 ===
consensus_distance=0.000



=== Log clique consensus distance @ E1B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.000


[E 1B10 |   4928/60000 (  8%) ] Loss: 2.2391 top1= 21.0227

=== Log global consensus distance @ E1B10 ===
consensus_distance=0.000



=== Log clique consensus distance @ E1B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.002


[E 1B20 |   9408/60000 ( 16%) ] Loss: 2.1993 top1= 25.2841

=== Log global consensus distance @ E1B20 ===
consensus_distance=0.001



=== Log clique consensus distance @ E1B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.004



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.2871 top1= 17.4579


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2836 top1= 16.3862


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.2918 top1= 18.1090

Train epoch 2
[E 2B0  |    448/60000 (  1%) ] Loss: 2.1387 top1= 36.0795

=== Log global consensus distance @ E2B0 ===
consensus_distance=0.002



=== Log clique consensus distance @ E2B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.007


[E 2B10 |   4928/60000 (  8%) ] Loss: 2.0930 top1= 38.0682

=== Log global consensus distance @ E2B10 ===
consensus_distance=0.002



=== Log clique consensus distance @ E2B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.009


[E 2B20 |   9408/60000 ( 16%) ] Loss: 2.0569 top1= 39.4886

=== Log global consensus distance @ E2B20 ===
consensus_distance=0.003



=== Log clique consensus distance @ E2B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.012



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.2756 top1= 18.5196


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2781 top1= 22.9367


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.2859 top1= 21.9852

Train epoch 3
[E 3B0  |    448/60000 (  1%) ] Loss: 1.9914 top1= 44.3182

=== Log global consensus distance @ E3B0 ===
consensus_distance=0.003



=== Log clique consensus distance @ E3B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.014


[E 3B10 |   4928/60000 (  8%) ] Loss: 1.9455 top1= 46.8750

=== Log global consensus distance @ E3B10 ===
consensus_distance=0.004



=== Log clique consensus distance @ E3B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.016


[E 3B20 |   9408/60000 ( 16%) ] Loss: 1.9134 top1= 46.3068

=== Log global consensus distance @ E3B20 ===
consensus_distance=0.004



=== Log clique consensus distance @ E3B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.018



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.2701 top1= 19.6214


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2862 top1= 23.3674


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.2853 top1= 27.4740

Train epoch 4
[E 4B0  |    448/60000 (  1%) ] Loss: 1.8489 top1= 49.4318

=== Log global consensus distance @ E4B0 ===
consensus_distance=0.005



=== Log clique consensus distance @ E4B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.020


[E 4B10 |   4928/60000 (  8%) ] Loss: 1.8056 top1= 51.1364

=== Log global consensus distance @ E4B10 ===
consensus_distance=0.005



=== Log clique consensus distance @ E4B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.022


[E 4B20 |   9408/60000 ( 16%) ] Loss: 1.7760 top1= 50.0000

=== Log global consensus distance @ E4B20 ===
consensus_distance=0.005



=== Log clique consensus distance @ E4B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.023



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.2744 top1= 24.5493


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.3057 top1= 24.6995


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.2958 top1= 31.2300

Train epoch 5
[E 5B0  |    448/60000 (  1%) ] Loss: 1.7105 top1= 54.2614

=== Log global consensus distance @ E5B0 ===
consensus_distance=0.006



=== Log clique consensus distance @ E5B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.025


[E 5B10 |   4928/60000 (  8%) ] Loss: 1.6669 top1= 56.2500

=== Log global consensus distance @ E5B10 ===
consensus_distance=0.006



=== Log clique consensus distance @ E5B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.026


[E 5B20 |   9408/60000 ( 16%) ] Loss: 1.6380 top1= 54.8295

=== Log global consensus distance @ E5B20 ===
consensus_distance=0.006



=== Log clique consensus distance @ E5B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.027



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.2921 top1= 30.9495


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.3387 top1= 27.2436


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.3232 top1= 32.4119

Train epoch 6
[E 6B0  |    448/60000 (  1%) ] Loss: 1.5706 top1= 58.2386

=== Log global consensus distance @ E6B0 ===
consensus_distance=0.007



=== Log clique consensus distance @ E6B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.028


[E 6B10 |   4928/60000 (  8%) ] Loss: 1.5256 top1= 61.6477

=== Log global consensus distance @ E6B10 ===
consensus_distance=0.007



=== Log clique consensus distance @ E6B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.029


[E 6B20 |   9408/60000 ( 16%) ] Loss: 1.4965 top1= 59.9432

=== Log global consensus distance @ E6B20 ===
consensus_distance=0.007



=== Log clique consensus distance @ E6B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.030



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.3321 top1= 37.6603


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.3898 top1= 30.7091


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.3733 top1= 33.5136

Train epoch 7
[E 7B0  |    448/60000 (  1%) ] Loss: 1.4273 top1= 64.4886

=== Log global consensus distance @ E7B0 ===
consensus_distance=0.007



=== Log clique consensus distance @ E7B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.031


[E 7B10 |   4928/60000 (  8%) ] Loss: 1.3800 top1= 65.6250

=== Log global consensus distance @ E7B10 ===
consensus_distance=0.008



=== Log clique consensus distance @ E7B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.032


[E 7B20 |   9408/60000 ( 16%) ] Loss: 1.3498 top1= 63.9205

=== Log global consensus distance @ E7B20 ===
consensus_distance=0.008



=== Log clique consensus distance @ E7B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.032



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.4123 top1= 42.7183


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.4737 top1= 33.8942


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.4603 top1= 37.1194

Train epoch 8
[E 8B0  |    448/60000 (  1%) ] Loss: 1.2791 top1= 69.6023

=== Log global consensus distance @ E8B0 ===
consensus_distance=0.008



=== Log clique consensus distance @ E8B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.033


[E 8B10 |   4928/60000 (  8%) ] Loss: 1.2288 top1= 72.4432

=== Log global consensus distance @ E8B10 ===
consensus_distance=0.008



=== Log clique consensus distance @ E8B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.033


[E 8B20 |   9408/60000 ( 16%) ] Loss: 1.1966 top1= 69.3182

=== Log global consensus distance @ E8B20 ===
consensus_distance=0.008



=== Log clique consensus distance @ E8B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.033



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.5762 top1= 43.8802


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.6204 top1= 38.8722


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.6112 top1= 40.0341

Train epoch 9
[E 9B0  |    448/60000 (  1%) ] Loss: 1.1244 top1= 72.7273

=== Log global consensus distance @ E9B0 ===
consensus_distance=0.008



=== Log clique consensus distance @ E9B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.034


[E 9B10 |   4928/60000 (  8%) ] Loss: 1.0720 top1= 74.4318

=== Log global consensus distance @ E9B10 ===
consensus_distance=0.009



=== Log clique consensus distance @ E9B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.034


[E 9B20 |   9408/60000 ( 16%) ] Loss: 1.0380 top1= 71.0227

=== Log global consensus distance @ E9B20 ===
consensus_distance=0.009



=== Log clique consensus distance @ E9B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.034



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.9702 top1= 32.6422


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.9048 top1= 43.5497


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.8957 top1= 41.5865

Train epoch 10
[E10B0  |    448/60000 (  1%) ] Loss: 0.9721 top1= 73.8636

=== Log global consensus distance @ E10B0 ===
consensus_distance=0.010



=== Log clique consensus distance @ E10B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.035


[E10B10 |   4928/60000 (  8%) ] Loss: 0.9317 top1= 74.4318

=== Log global consensus distance @ E10B10 ===
consensus_distance=0.010



=== Log clique consensus distance @ E10B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.036


[E10B20 |   9408/60000 ( 16%) ] Loss: 0.9035 top1= 72.1591

=== Log global consensus distance @ E10B20 ===
consensus_distance=0.011



=== Log clique consensus distance @ E10B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.036



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.1474 top1= 14.0425


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3.5536 top1= 45.6130


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.5134 top1= 41.5164

Train epoch 11
[E11B0  |    448/60000 (  1%) ] Loss: 0.8625 top1= 74.1477

=== Log global consensus distance @ E11B0 ===
consensus_distance=0.013



=== Log clique consensus distance @ E11B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.038


[E11B10 |   4928/60000 (  8%) ] Loss: 0.8375 top1= 73.8636

=== Log global consensus distance @ E11B10 ===
consensus_distance=0.015



=== Log clique consensus distance @ E11B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.039


[E11B20 |   9408/60000 ( 16%) ] Loss: 0.8275 top1= 69.8864

=== Log global consensus distance @ E11B20 ===
consensus_distance=0.020



=== Log clique consensus distance @ E11B20 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=0.042



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=10.1449 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5.5618 top1= 45.6330


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=5.3898 top1= 40.8253

Train epoch 12
[E12B0  |    448/60000 (  1%) ] Loss: 0.8471 top1= 69.0341

=== Log global consensus distance @ E12B0 ===
consensus_distance=0.031



=== Log clique consensus distance @ E12B0 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=0.048


[E12B10 |   4928/60000 (  8%) ] Loss: 1.0374 top1= 64.7727

=== Log global consensus distance @ E12B10 ===
consensus_distance=0.090



=== Log clique consensus distance @ E12B10 ===
clique1_consensus_distance=0.003
clique2_consensus_distance=0.062


[E12B20 |   9408/60000 ( 16%) ] Loss: 43.3513 top1= 40.9091

=== Log global consensus distance @ E12B20 ===
consensus_distance=11.134



=== Log clique consensus distance @ E12B20 ===
clique1_consensus_distance=0.443
clique2_consensus_distance=0.639



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=73848.0368 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=844.4180 top1= 10.3165


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1020.4683 top1=  8.9143

Train epoch 13
[E13B0  |    448/60000 (  1%) ] Loss: 304.1603 top1= 36.3636

=== Log global consensus distance @ E13B0 ===
consensus_distance=50.529



=== Log clique consensus distance @ E13B0 ===
clique1_consensus_distance=0.622
clique2_consensus_distance=5.295


[E13B10 |   4928/60000 (  8%) ] Loss: 258.0427 top1= 45.7386

=== Log global consensus distance @ E13B10 ===
consensus_distance=123.297



=== Log clique consensus distance @ E13B10 ===
clique1_consensus_distance=0.621
clique2_consensus_distance=8.877


[E13B20 |   9408/60000 ( 16%) ] Loss: 201.7285 top1= 65.0568

=== Log global consensus distance @ E13B20 ===
consensus_distance=226.211



=== Log clique consensus distance @ E13B20 ===
clique1_consensus_distance=0.598
clique2_consensus_distance=16.297



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2102258.6010 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2156.7898 top1= 15.4447


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2140.5718 top1= 24.0685

Train epoch 14
[E14B0  |    448/60000 (  1%) ] Loss: 502.4499 top1= 46.0227

=== Log global consensus distance @ E14B0 ===
consensus_distance=367.324



=== Log clique consensus distance @ E14B0 ===
clique1_consensus_distance=0.731
clique2_consensus_distance=40.402


[E14B10 |   4928/60000 (  8%) ] Loss: 154.9575 top1= 63.9205

=== Log global consensus distance @ E14B10 ===
consensus_distance=524.370



=== Log clique consensus distance @ E14B10 ===
clique1_consensus_distance=0.609
clique2_consensus_distance=47.941


[E14B20 |   9408/60000 ( 16%) ] Loss: 212.6657 top1= 67.3295

=== Log global consensus distance @ E14B20 ===
consensus_distance=702.287



=== Log clique consensus distance @ E14B20 ===
clique1_consensus_distance=0.600
clique2_consensus_distance=53.729



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=13808302.3462 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2300.1444 top1= 41.2760


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=316.2604 top1= 13.6719

Train epoch 15
[E15B0  |    448/60000 (  1%) ] Loss: 85.8021 top1= 55.6818

=== Log global consensus distance @ E15B0 ===
consensus_distance=956.186



=== Log clique consensus distance @ E15B0 ===
clique1_consensus_distance=0.623
clique2_consensus_distance=172.313


[E15B10 |   4928/60000 (  8%) ] Loss: 31.6114 top1= 34.9432

=== Log global consensus distance @ E15B10 ===
consensus_distance=1205.817



=== Log clique consensus distance @ E15B10 ===
clique1_consensus_distance=0.599
clique2_consensus_distance=209.848


[E15B20 |   9408/60000 ( 16%) ] Loss: 9.4260 top1= 48.0114

=== Log global consensus distance @ E15B20 ===
consensus_distance=1463.633



=== Log clique consensus distance @ E15B20 ===
clique1_consensus_distance=0.596
clique2_consensus_distance=185.870



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=55016384.5128 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=792.1984 top1= 34.8558


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=91.2940 top1= 17.5982

Train epoch 16
[E16B0  |    448/60000 (  1%) ] Loss: 25.5538 top1= 44.8864

=== Log global consensus distance @ E16B0 ===
consensus_distance=1748.558



=== Log clique consensus distance @ E16B0 ===
clique1_consensus_distance=0.593
clique2_consensus_distance=191.903


[E16B10 |   4928/60000 (  8%) ] Loss: 25.8979 top1= 35.2273

=== Log global consensus distance @ E16B10 ===
consensus_distance=2053.807



=== Log clique consensus distance @ E16B10 ===
clique1_consensus_distance=0.616
clique2_consensus_distance=190.356


[E16B20 |   9408/60000 ( 16%) ] Loss: 14.5510 top1= 34.9432

=== Log global consensus distance @ E16B20 ===
consensus_distance=2398.242



=== Log clique consensus distance @ E16B20 ===
clique1_consensus_distance=0.597
clique2_consensus_distance=171.151



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=155193777.0256 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2142.6169 top1= 28.5056


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.6755 top1= 13.0509

Train epoch 17
[E17B0  |    448/60000 (  1%) ] Loss: 6.2207 top1= 35.5114

=== Log global consensus distance @ E17B0 ===
consensus_distance=2769.451



=== Log clique consensus distance @ E17B0 ===
clique1_consensus_distance=0.607
clique2_consensus_distance=165.382


[E17B10 |   4928/60000 (  8%) ] Loss: 62.0954 top1= 27.2727

=== Log global consensus distance @ E17B10 ===
consensus_distance=3156.718



=== Log clique consensus distance @ E17B10 ===
clique1_consensus_distance=0.618
clique2_consensus_distance=184.112


[E17B20 |   9408/60000 ( 16%) ] Loss: 384.8871 top1= 28.1250

=== Log global consensus distance @ E17B20 ===
consensus_distance=3603.050



=== Log clique consensus distance @ E17B20 ===
clique1_consensus_distance=0.663
clique2_consensus_distance=181.421



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=354421766.3590 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=810.0572 top1= 26.9030


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.5502 top1= 11.7288

Train epoch 18
[E18B0  |    448/60000 (  1%) ] Loss: 11.4840 top1= 33.2386

=== Log global consensus distance @ E18B0 ===
consensus_distance=4034.366



=== Log clique consensus distance @ E18B0 ===
clique1_consensus_distance=0.593
clique2_consensus_distance=184.142


[E18B10 |   4928/60000 (  8%) ] Loss: 11.9267 top1= 34.0909

=== Log global consensus distance @ E18B10 ===
consensus_distance=4507.209



=== Log clique consensus distance @ E18B10 ===
clique1_consensus_distance=0.597
clique2_consensus_distance=193.473


[E18B20 |   9408/60000 ( 16%) ] Loss: 4.1340 top1= 31.8182

=== Log global consensus distance @ E18B20 ===
consensus_distance=5017.743



=== Log clique consensus distance @ E18B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=231.024



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=712164663.7949 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1536.3169 top1= 24.7696


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.3421 top1= 10.6871

Train epoch 19
[E19B0  |    448/60000 (  1%) ] Loss: 1.8056 top1= 34.3750

=== Log global consensus distance @ E19B0 ===
consensus_distance=5519.414



=== Log clique consensus distance @ E19B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=222.132


[E19B10 |   4928/60000 (  8%) ] Loss: 39.3740 top1= 26.4205

=== Log global consensus distance @ E19B10 ===
consensus_distance=6084.984



=== Log clique consensus distance @ E19B10 ===
clique1_consensus_distance=0.638
clique2_consensus_distance=238.416


[E19B20 |   9408/60000 ( 16%) ] Loss: 674.3646 top1= 26.4205

=== Log global consensus distance @ E19B20 ===
consensus_distance=6653.730



=== Log clique consensus distance @ E19B20 ===
clique1_consensus_distance=0.860
clique2_consensus_distance=247.043



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1285892661.3333 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2419.7432 top1= 19.5112


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=193.0647 top1= 11.1078

Train epoch 20
[E20B0  |    448/60000 (  1%) ] Loss: 7.2888 top1= 27.8409

=== Log global consensus distance @ E20B0 ===
consensus_distance=7294.205



=== Log clique consensus distance @ E20B0 ===
clique1_consensus_distance=0.598
clique2_consensus_distance=255.691


[E20B10 |   4928/60000 (  8%) ] Loss: 10.8724 top1= 21.5909

=== Log global consensus distance @ E20B10 ===
consensus_distance=7956.923



=== Log clique consensus distance @ E20B10 ===
clique1_consensus_distance=0.612
clique2_consensus_distance=264.695


[E20B20 |   9408/60000 ( 16%) ] Loss: 2.0490 top1= 22.4432

=== Log global consensus distance @ E20B20 ===
consensus_distance=8606.433



=== Log clique consensus distance @ E20B20 ===
clique1_consensus_distance=0.598
clique2_consensus_distance=264.467



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2182654887.3846 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=94515.2414 top1= 11.5885


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=104.1762 top1= 10.9375

Train epoch 21
[E21B0  |    448/60000 (  1%) ] Loss: 46.8676 top1= 24.1477

=== Log global consensus distance @ E21B0 ===
consensus_distance=9288.182



=== Log clique consensus distance @ E21B0 ===
clique1_consensus_distance=0.595
clique2_consensus_distance=266.622


[E21B10 |   4928/60000 (  8%) ] Loss: 510.0594 top1= 22.4432

=== Log global consensus distance @ E21B10 ===
consensus_distance=10055.643



=== Log clique consensus distance @ E21B10 ===
clique1_consensus_distance=1.108
clique2_consensus_distance=289.980


[E21B20 |   9408/60000 ( 16%) ] Loss: 2117.6918 top1= 23.0114

=== Log global consensus distance @ E21B20 ===
consensus_distance=10803.945



=== Log clique consensus distance @ E21B20 ===
clique1_consensus_distance=0.595
clique2_consensus_distance=283.430



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3464291846.5641 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=77868.7791 top1= 14.9239


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=8.2644 top1= 10.8474

Train epoch 22
[E22B0  |    448/60000 (  1%) ] Loss: 2.0540 top1= 23.2955

=== Log global consensus distance @ E22B0 ===
consensus_distance=11522.425



=== Log clique consensus distance @ E22B0 ===
clique1_consensus_distance=0.597
clique2_consensus_distance=285.764


[E22B10 |   4928/60000 (  8%) ] Loss: 30.4879 top1= 23.2955

=== Log global consensus distance @ E22B10 ===
consensus_distance=12386.562



=== Log clique consensus distance @ E22B10 ===
clique1_consensus_distance=0.942
clique2_consensus_distance=298.515


[E22B20 |   9408/60000 ( 16%) ] Loss: 376.3707 top1= 23.8636

=== Log global consensus distance @ E22B20 ===
consensus_distance=13145.125



=== Log clique consensus distance @ E22B20 ===
clique1_consensus_distance=0.596
clique2_consensus_distance=288.739



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=5160954285.9487 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=326.5815 top1= 11.6286


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=16.0294 top1= 10.4067

Train epoch 23
[E23B0  |    448/60000 (  1%) ] Loss: 2.0513 top1= 23.2955

=== Log global consensus distance @ E23B0 ===
consensus_distance=14159.823



=== Log clique consensus distance @ E23B0 ===
clique1_consensus_distance=0.636
clique2_consensus_distance=312.899


[E23B10 |   4928/60000 (  8%) ] Loss: 2.0378 top1= 22.4432

=== Log global consensus distance @ E23B10 ===
consensus_distance=14952.587



=== Log clique consensus distance @ E23B10 ===
clique1_consensus_distance=0.632
clique2_consensus_distance=309.841


[E23B20 |   9408/60000 ( 16%) ] Loss: 101.3834 top1= 27.8409

=== Log global consensus distance @ E23B20 ===
consensus_distance=16039.102



=== Log clique consensus distance @ E23B20 ===
clique1_consensus_distance=0.994
clique2_consensus_distance=332.542



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=7693560201.8462 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=16678.2099 top1= 12.5401


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=13.7660 top1= 10.3566

Train epoch 24
[E24B0  |    448/60000 (  1%) ] Loss: 4.5479 top1= 23.8636

=== Log global consensus distance @ E24B0 ===
consensus_distance=16978.182



=== Log clique consensus distance @ E24B0 ===
clique1_consensus_distance=0.671
clique2_consensus_distance=334.916


[E24B10 |   4928/60000 (  8%) ] Loss: 1986.7839 top1= 35.2273

=== Log global consensus distance @ E24B10 ===
consensus_distance=17976.713



=== Log clique consensus distance @ E24B10 ===
clique1_consensus_distance=0.626
clique2_consensus_distance=336.998


[E24B20 |   9408/60000 ( 16%) ] Loss: 7.3892 top1= 36.0795

=== Log global consensus distance @ E24B20 ===
consensus_distance=18963.979



=== Log clique consensus distance @ E24B20 ===
clique1_consensus_distance=0.850
clique2_consensus_distance=356.462



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=10796810909.5385 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4211.8020 top1= 11.6687


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4406.0589 top1=  9.8858

Train epoch 25
[E25B0  |    448/60000 (  1%) ] Loss: 2.0217 top1= 36.3636

=== Log global consensus distance @ E25B0 ===
consensus_distance=20061.229



=== Log clique consensus distance @ E25B0 ===
clique1_consensus_distance=0.675
clique2_consensus_distance=369.097


[E25B10 |   4928/60000 (  8%) ] Loss: 48.5675 top1= 35.5114

=== Log global consensus distance @ E25B10 ===
consensus_distance=21114.336



=== Log clique consensus distance @ E25B10 ===
clique1_consensus_distance=0.596
clique2_consensus_distance=356.407


[E25B20 |   9408/60000 ( 16%) ] Loss: 117.8996 top1= 35.7955

=== Log global consensus distance @ E25B20 ===
consensus_distance=22286.516



=== Log clique consensus distance @ E25B20 ===
clique1_consensus_distance=0.966
clique2_consensus_distance=364.422



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=14953939206.5641 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=197625.3413 top1= 10.5869


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.2709 top1=  9.5753

Train epoch 26
[E26B0  |    448/60000 (  1%) ] Loss: 2.0416 top1= 35.2273

=== Log global consensus distance @ E26B0 ===
consensus_distance=23510.914



=== Log clique consensus distance @ E26B0 ===
clique1_consensus_distance=0.626
clique2_consensus_distance=361.867


[E26B10 |   4928/60000 (  8%) ] Loss: 2.0478 top1= 34.3750

=== Log global consensus distance @ E26B10 ===
consensus_distance=24674.117



=== Log clique consensus distance @ E26B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=367.787


[E26B20 |   9408/60000 ( 16%) ] Loss: 2.0441 top1= 34.3750

=== Log global consensus distance @ E26B20 ===
consensus_distance=25755.855



=== Log clique consensus distance @ E26B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=354.628



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=20155373673.0256 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=4579.7423 top1= 11.9792


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=15.9160 top1=  9.5853

Train epoch 27
[E27B0  |    448/60000 (  1%) ] Loss: 4030.7725 top1= 34.6591

=== Log global consensus distance @ E27B0 ===
consensus_distance=27137.998



=== Log clique consensus distance @ E27B0 ===
clique1_consensus_distance=1.139
clique2_consensus_distance=363.917


[E27B10 |   4928/60000 (  8%) ] Loss: 2.0381 top1= 34.6591

=== Log global consensus distance @ E27B10 ===
consensus_distance=28270.697



=== Log clique consensus distance @ E27B10 ===
clique1_consensus_distance=0.596
clique2_consensus_distance=360.025


[E27B20 |   9408/60000 ( 16%) ] Loss: 2.0345 top1= 34.6591

=== Log global consensus distance @ E27B20 ===
consensus_distance=29535.672



=== Log clique consensus distance @ E27B20 ===
clique1_consensus_distance=0.596
clique2_consensus_distance=350.948



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=26844522023.3846 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=24062.1445 top1= 12.8606


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1134.5186 top1=  9.9159

Train epoch 28
[E28B0  |    448/60000 (  1%) ] Loss: 26154.0315 top1= 35.5114

=== Log global consensus distance @ E28B0 ===
consensus_distance=30964.973



=== Log clique consensus distance @ E28B0 ===
clique1_consensus_distance=0.641
clique2_consensus_distance=350.693


[E28B10 |   4928/60000 (  8%) ] Loss: 2.0484 top1= 34.0909

=== Log global consensus distance @ E28B10 ===
consensus_distance=32247.750



=== Log clique consensus distance @ E28B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=366.605


[E28B20 |   9408/60000 ( 16%) ] Loss: 2.0316 top1= 34.6591

=== Log global consensus distance @ E28B20 ===
consensus_distance=33650.891



=== Log clique consensus distance @ E28B20 ===
clique1_consensus_distance=0.677
clique2_consensus_distance=378.922



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=34970315749.7436 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=797271.1584 top1= 12.1795


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=363.4116 top1=  9.8057

Train epoch 29
[E29B0  |    448/60000 (  1%) ] Loss: 6.0250 top1= 34.9432

=== Log global consensus distance @ E29B0 ===
consensus_distance=35071.953



=== Log clique consensus distance @ E29B0 ===
clique1_consensus_distance=0.733
clique2_consensus_distance=385.941


[E29B10 |   4928/60000 (  8%) ] Loss: 8.9165 top1= 34.0909

=== Log global consensus distance @ E29B10 ===
consensus_distance=36622.477



=== Log clique consensus distance @ E29B10 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=378.110


[E29B20 |   9408/60000 ( 16%) ] Loss: 1155.1619 top1= 35.2273

=== Log global consensus distance @ E29B20 ===
consensus_distance=38238.289



=== Log clique consensus distance @ E29B20 ===
clique1_consensus_distance=0.627
clique2_consensus_distance=379.328



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=44959587039.1795 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=3675992.3365 top1= 13.0909


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1349.8524 top1=  9.5853

Train epoch 30
[E30B0  |    448/60000 (  1%) ] Loss: 1299.9942 top1= 35.5114

=== Log global consensus distance @ E30B0 ===
consensus_distance=39704.406



=== Log clique consensus distance @ E30B0 ===
clique1_consensus_distance=1.142
clique2_consensus_distance=382.618


[E30B10 |   4928/60000 (  8%) ] Loss: 51.0291 top1= 34.3750

=== Log global consensus distance @ E30B10 ===
consensus_distance=41104.930



=== Log clique consensus distance @ E30B10 ===
clique1_consensus_distance=0.803
clique2_consensus_distance=390.611


[E30B20 |   9408/60000 ( 16%) ] Loss: 2.0325 top1= 34.3750

=== Log global consensus distance @ E30B20 ===
consensus_distance=42742.254



=== Log clique consensus distance @ E30B20 ===
clique1_consensus_distance=0.602
clique2_consensus_distance=409.259



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=56015587170.4615 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=10655.8782 top1= 10.5869


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=205.4436 top1=  9.5753

Train epoch 31
[E31B0  |    448/60000 (  1%) ] Loss: 108.8804 top1= 34.6591

=== Log global consensus distance @ E31B0 ===
consensus_distance=44562.488



=== Log clique consensus distance @ E31B0 ===
clique1_consensus_distance=1.028
clique2_consensus_distance=414.902


[E31B10 |   4928/60000 (  8%) ] Loss: 306.1022 top1= 34.0909

=== Log global consensus distance @ E31B10 ===
consensus_distance=46093.363



=== Log clique consensus distance @ E31B10 ===
clique1_consensus_distance=0.832
clique2_consensus_distance=403.832


[E31B20 |   9408/60000 ( 16%) ] Loss: 2.0029 top1= 35.5114

=== Log global consensus distance @ E31B20 ===
consensus_distance=47854.398



=== Log clique consensus distance @ E31B20 ===
clique1_consensus_distance=0.642
clique2_consensus_distance=413.561



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=70385932077.9487 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2801030.7957 top1= 13.7821


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=278.7695 top1=  9.7155

Train epoch 32
[E32B0  |    448/60000 (  1%) ] Loss: 2.0170 top1= 35.5114

=== Log global consensus distance @ E32B0 ===
consensus_distance=49632.707



=== Log clique consensus distance @ E32B0 ===
clique1_consensus_distance=0.595
clique2_consensus_distance=422.488


[E32B10 |   4928/60000 (  8%) ] Loss: 2.0368 top1= 34.0909

=== Log global consensus distance @ E32B10 ===
consensus_distance=51366.488



=== Log clique consensus distance @ E32B10 ===
clique1_consensus_distance=0.628
clique2_consensus_distance=423.707


[E32B20 |   9408/60000 ( 16%) ] Loss: 2.0201 top1= 34.6591

=== Log global consensus distance @ E32B20 ===
consensus_distance=53215.812



=== Log clique consensus distance @ E32B20 ===
clique1_consensus_distance=0.644
clique2_consensus_distance=428.529



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=87154937540.9231 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=5296960.7901 top1= 13.9022


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=438.0476 top1= 11.7288

Train epoch 33
[E33B0  |    448/60000 (  1%) ] Loss: 170.8801 top1= 36.0795

=== Log global consensus distance @ E33B0 ===
consensus_distance=54948.770



=== Log clique consensus distance @ E33B0 ===
clique1_consensus_distance=0.596
clique2_consensus_distance=428.617


[E33B10 |   4928/60000 (  8%) ] Loss: 2.0340 top1= 34.0909

=== Log global consensus distance @ E33B10 ===
consensus_distance=57002.211



=== Log clique consensus distance @ E33B10 ===
clique1_consensus_distance=0.593
clique2_consensus_distance=460.720


[E33B20 |   9408/60000 ( 16%) ] Loss: 2.0239 top1= 34.3750

=== Log global consensus distance @ E33B20 ===
consensus_distance=58860.910



=== Log clique consensus distance @ E33B20 ===
clique1_consensus_distance=0.643
clique2_consensus_distance=463.560



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=106063492227.2821 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1846933.3633 top1= 12.1094


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=277.4378 top1=  9.5954

Train epoch 34
[E34B0  |    448/60000 (  1%) ] Loss: 2.0314 top1= 34.6591

=== Log global consensus distance @ E34B0 ===
consensus_distance=60685.520



=== Log clique consensus distance @ E34B0 ===
clique1_consensus_distance=0.636
clique2_consensus_distance=462.028


[E34B10 |   4928/60000 (  8%) ] Loss: 166903.0133 top1= 34.6591

=== Log global consensus distance @ E34B10 ===
consensus_distance=62591.824



=== Log clique consensus distance @ E34B10 ===
clique1_consensus_distance=0.890
clique2_consensus_distance=462.395


[E34B20 |   9408/60000 ( 16%) ] Loss: 22659.1037 top1= 34.6591

=== Log global consensus distance @ E34B20 ===
consensus_distance=64517.012



=== Log clique consensus distance @ E34B20 ===
clique1_consensus_distance=0.780
clique2_consensus_distance=459.187



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=128279510829.9487 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1006075.1000 top1= 12.7304


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=4.4532 top1=  9.5753

Train epoch 35
[E35B0  |    448/60000 (  1%) ] Loss: 2.0284 top1= 34.6591

=== Log global consensus distance @ E35B0 ===
consensus_distance=67052.227



=== Log clique consensus distance @ E35B0 ===
clique1_consensus_distance=0.597
clique2_consensus_distance=449.581


[E35B10 |   4928/60000 (  8%) ] Loss: 374.8205 top1= 34.6591

=== Log global consensus distance @ E35B10 ===
consensus_distance=68762.102



=== Log clique consensus distance @ E35B10 ===
clique1_consensus_distance=0.820
clique2_consensus_distance=451.315


[E35B20 |   9408/60000 ( 16%) ] Loss: 2.0116 top1= 34.6591

=== Log global consensus distance @ E35B20 ===
consensus_distance=70772.875



=== Log clique consensus distance @ E35B20 ===
clique1_consensus_distance=0.595
clique2_consensus_distance=440.780



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=155366088388.9231 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1534360.4429 top1= 10.7873


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=57888.3013 top1= 11.8289

Train epoch 36
[E36B0  |    448/60000 (  1%) ] Loss: 1.9919 top1= 36.0795

=== Log global consensus distance @ E36B0 ===
consensus_distance=72985.609



=== Log clique consensus distance @ E36B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=459.360


[E36B10 |   4928/60000 (  8%) ] Loss: 5065.0666 top1= 34.6591

=== Log global consensus distance @ E36B10 ===
consensus_distance=75133.031



=== Log clique consensus distance @ E36B10 ===
clique1_consensus_distance=0.688
clique2_consensus_distance=483.396


[E36B20 |   9408/60000 ( 16%) ] Loss: 15397.0936 top1= 35.2273

=== Log global consensus distance @ E36B20 ===
consensus_distance=77312.750



=== Log clique consensus distance @ E36B20 ===
clique1_consensus_distance=0.608
clique2_consensus_distance=484.027



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=184285124555.4872 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1399865.1305 top1= 11.8790


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=11552.2476 top1= 10.0561

Train epoch 37
[E37B0  |    448/60000 (  1%) ] Loss: 36644.1821 top1= 35.5114

=== Log global consensus distance @ E37B0 ===
consensus_distance=79337.188



=== Log clique consensus distance @ E37B0 ===
clique1_consensus_distance=0.597
clique2_consensus_distance=506.917


[E37B10 |   4928/60000 (  8%) ] Loss: 8797.2266 top1= 36.3636

=== Log global consensus distance @ E37B10 ===
consensus_distance=81620.867



=== Log clique consensus distance @ E37B10 ===
clique1_consensus_distance=0.596
clique2_consensus_distance=502.314


[E37B20 |   9408/60000 ( 16%) ] Loss: 1.9757 top1= 36.0795

=== Log global consensus distance @ E37B20 ===
consensus_distance=83875.992



=== Log clique consensus distance @ E37B20 ===
clique1_consensus_distance=0.627
clique2_consensus_distance=503.296



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=217671812752.4102 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=11028113.9263 top1= 13.3814


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=3.0366 top1=  9.7055

Train epoch 38
[E38B0  |    448/60000 (  1%) ] Loss: 2.0013 top1= 35.5114

=== Log global consensus distance @ E38B0 ===
consensus_distance=86355.391



=== Log clique consensus distance @ E38B0 ===
clique1_consensus_distance=0.597
clique2_consensus_distance=509.674


[E38B10 |   4928/60000 (  8%) ] Loss: 2.0199 top1= 34.0909

=== Log global consensus distance @ E38B10 ===
consensus_distance=88611.805



=== Log clique consensus distance @ E38B10 ===
clique1_consensus_distance=0.593
clique2_consensus_distance=545.055


[E38B20 |   9408/60000 ( 16%) ] Loss: 2.0095 top1= 34.3750

=== Log global consensus distance @ E38B20 ===
consensus_distance=90912.297



=== Log clique consensus distance @ E38B20 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=551.608



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=256252808270.7692 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=15233360.9103 top1= 12.5300


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=13.6437 top1=  9.5853

Train epoch 39
[E39B0  |    448/60000 (  1%) ] Loss: 2.0104 top1= 34.9432

=== Log global consensus distance @ E39B0 ===
consensus_distance=93813.289



=== Log clique consensus distance @ E39B0 ===
clique1_consensus_distance=0.592
clique2_consensus_distance=569.789


[E39B10 |   4928/60000 (  8%) ] Loss: 2.0171 top1= 34.0909

=== Log global consensus distance @ E39B10 ===
consensus_distance=96017.000



=== Log clique consensus distance @ E39B10 ===
clique1_consensus_distance=0.593
clique2_consensus_distance=577.735


[E39B20 |   9408/60000 ( 16%) ] Loss: 1.9999 top1= 34.6591

=== Log global consensus distance @ E39B20 ===
consensus_distance=98333.195



=== Log clique consensus distance @ E39B20 ===
clique1_consensus_distance=0.600
clique2_consensus_distance=585.275



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=299576408431.5897 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1770884.2813 top1= 10.4367


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=102.4066 top1=  9.6354

Train epoch 40
[E40B0  |    448/60000 (  1%) ] Loss: 1.9941 top1= 35.5114

=== Log global consensus distance @ E40B0 ===
consensus_distance=101220.164



=== Log clique consensus distance @ E40B0 ===
clique1_consensus_distance=0.603
clique2_consensus_distance=592.684


[E40B10 |   4928/60000 (  8%) ] Loss: 2.0144 top1= 34.0909

=== Log global consensus distance @ E40B10 ===
consensus_distance=104187.297



=== Log clique consensus distance @ E40B10 ===
clique1_consensus_distance=0.630
clique2_consensus_distance=593.089


[E40B20 |   9408/60000 ( 16%) ] Loss: 110689.6148 top1= 34.6591

=== Log global consensus distance @ E40B20 ===
consensus_distance=106734.000



=== Log clique consensus distance @ E40B20 ===
clique1_consensus_distance=0.891
clique2_consensus_distance=604.575



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=348441477960.2051 top1= 10.2865


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=20985014.1538 top1= 13.9123


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=912.9172 top1=  9.6154

