
=== Start adding workers ===
=> Add worker SGDMWorker(index=0, momentum=0.0)
=> Add worker SGDMWorker(index=1, momentum=0.0)
=> Add worker SGDMWorker(index=2, momentum=0.0)
=> Add worker SGDMWorker(index=3, momentum=0.0)
=> Add worker SGDMWorker(index=4, momentum=0.0)
=> Add worker SGDMWorker(index=5, momentum=0.0)
=> Add worker SGDMWorker(index=6, momentum=0.0)
=> Add worker SGDMWorker(index=7, momentum=0.0)
=> Add worker SGDMWorker(index=8, momentum=0.0)
=> Add worker SGDMWorker(index=9, momentum=0.0)
=> Add worker SGDMWorker(index=10, momentum=0.0)
=> Add worker ByzantineWorker(index=11)
=> Add worker ByzantineWorker(index=12)
=> Add worker ByzantineWorker(index=13)

=== Start adding graph ===
TwoCliquesWithByzantine(m=5,b=3)

Train epoch 1
[E 1B0  |    448/60000 (  1%) ] Loss: 2.3005 top1=  9.0909

=== Peeking data label distribution E1B0 ===
Worker 0 has targets: tensor([9, 4, 6, 0, 0], device='cuda:0')
Worker 1 has targets: tensor([3, 0, 5, 1, 7], device='cuda:0')
Worker 2 has targets: tensor([5, 6, 5, 4, 9], device='cuda:0')
Worker 3 has targets: tensor([4, 8, 4, 4, 2], device='cuda:0')
Worker 4 has targets: tensor([7, 9, 7, 0, 6], device='cuda:0')
Worker 5 has targets: tensor([4, 9, 4, 0, 8], device='cuda:0')
Worker 6 has targets: tensor([9, 3, 1, 7, 7], device='cuda:0')
Worker 7 has targets: tensor([6, 1, 8, 0, 7], device='cuda:0')
Worker 8 has targets: tensor([8, 3, 7, 6, 2], device='cuda:0')
Worker 9 has targets: tensor([8, 2, 3, 7, 8], device='cuda:0')
Worker 10 has targets: tensor([7, 5, 3, 8, 8], device='cuda:0')
Worker 11 has targets: tensor([4, 0, 5, 9, 5], device='cuda:0')
Worker 12 has targets: tensor([8, 2, 1, 2, 7], device='cuda:0')
Worker 13 has targets: tensor([9, 1, 6, 1, 1], device='cuda:0')



=== Log global consensus distance @ E1B0 ===
consensus_distance=0.000



=== Log clique consensus distance @ E1B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.000


[E 1B10 |   4928/60000 (  8%) ] Loss: 2.2809 top1= 14.4886

=== Log global consensus distance @ E1B10 ===
consensus_distance=0.000



=== Log clique consensus distance @ E1B10 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.000


[E 1B20 |   9408/60000 ( 16%) ] Loss: 2.2901 top1= 11.6477

=== Log global consensus distance @ E1B20 ===
consensus_distance=0.000



=== Log clique consensus distance @ E1B20 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.000



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.2796 top1= 17.4379


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2774 top1= 17.9487


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.2773 top1= 17.5080

Train epoch 2
[E 2B0  |    448/60000 (  1%) ] Loss: 2.2633 top1= 15.9091

=== Log global consensus distance @ E2B0 ===
consensus_distance=0.003



=== Log clique consensus distance @ E2B0 ===
clique1_consensus_distance=0.000
clique2_consensus_distance=0.000


[E 2B10 |   4928/60000 (  8%) ] Loss: 2.2748 top1= 21.0227

=== Log global consensus distance @ E2B10 ===
consensus_distance=0.030



=== Log clique consensus distance @ E2B10 ===
clique1_consensus_distance=0.001
clique2_consensus_distance=0.001


[E 2B20 |   9408/60000 ( 16%) ] Loss: 2.2686 top1= 19.3182

=== Log global consensus distance @ E2B20 ===
consensus_distance=0.240



=== Log clique consensus distance @ E2B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.006



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.3864 top1= 21.0437


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2652 top1= 25.5509


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.2654 top1= 25.6310

Train epoch 3
[E 3B0  |    448/60000 (  1%) ] Loss: 2.2980 top1= 19.0341

=== Log global consensus distance @ E3B0 ===
consensus_distance=0.757



=== Log clique consensus distance @ E3B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.006


[E 3B10 |   4928/60000 (  8%) ] Loss: 2.3359 top1= 22.4432

=== Log global consensus distance @ E3B10 ===
consensus_distance=1.569



=== Log clique consensus distance @ E3B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.007


[E 3B20 |   9408/60000 ( 16%) ] Loss: 2.2981 top1= 18.1818

=== Log global consensus distance @ E3B20 ===
consensus_distance=2.675



=== Log clique consensus distance @ E3B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.007



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.1153 top1= 32.6522


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.2178 top1= 27.6042


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.2192 top1= 27.4339

Train epoch 4
[E 4B0  |    448/60000 (  1%) ] Loss: 2.3471 top1= 20.1705

=== Log global consensus distance @ E4B0 ===
consensus_distance=4.073



=== Log clique consensus distance @ E4B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.007


[E 4B10 |   4928/60000 (  8%) ] Loss: 2.3353 top1= 24.1477

=== Log global consensus distance @ E4B10 ===
consensus_distance=5.763



=== Log clique consensus distance @ E4B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.007


[E 4B20 |   9408/60000 ( 16%) ] Loss: 2.2381 top1= 23.0114

=== Log global consensus distance @ E4B20 ===
consensus_distance=7.746



=== Log clique consensus distance @ E4B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.007



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8350 top1= 44.3009


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=2.0900 top1= 35.4968


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=2.0914 top1= 35.7171

Train epoch 5
[E 5B0  |    448/60000 (  1%) ] Loss: 2.3440 top1= 21.5909

=== Log global consensus distance @ E5B0 ===
consensus_distance=10.022



=== Log clique consensus distance @ E5B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.007


[E 5B10 |   4928/60000 (  8%) ] Loss: 2.2737 top1= 26.4205

=== Log global consensus distance @ E5B10 ===
consensus_distance=12.592



=== Log clique consensus distance @ E5B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.007


[E 5B20 |   9408/60000 ( 16%) ] Loss: 2.0786 top1= 30.6818

=== Log global consensus distance @ E5B20 ===
consensus_distance=15.454



=== Log clique consensus distance @ E5B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.007



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6124 top1= 52.5040


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.9580 top1= 44.7015


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.9598 top1= 45.6130

Train epoch 6
[E 6B0  |    448/60000 (  1%) ] Loss: 2.2756 top1= 26.7045

=== Log global consensus distance @ E6B0 ===
consensus_distance=18.608



=== Log clique consensus distance @ E6B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.007


[E 6B10 |   4928/60000 (  8%) ] Loss: 2.1775 top1= 30.9659

=== Log global consensus distance @ E6B10 ===
consensus_distance=22.057



=== Log clique consensus distance @ E6B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.007


[E 6B20 |   9408/60000 ( 16%) ] Loss: 1.9496 top1= 37.5000

=== Log global consensus distance @ E6B20 ===
consensus_distance=25.797



=== Log clique consensus distance @ E6B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.008



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.4565 top1= 57.3117


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.8441 top1= 52.9247


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.8491 top1= 53.5857

Train epoch 7
[E 7B0  |    448/60000 (  1%) ] Loss: 2.2365 top1= 30.1136

=== Log global consensus distance @ E7B0 ===
consensus_distance=29.830



=== Log clique consensus distance @ E7B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.008


[E 7B10 |   4928/60000 (  8%) ] Loss: 2.1149 top1= 35.5114

=== Log global consensus distance @ E7B10 ===
consensus_distance=34.158



=== Log clique consensus distance @ E7B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.008


[E 7B20 |   9408/60000 ( 16%) ] Loss: 1.8403 top1= 42.8977

=== Log global consensus distance @ E7B20 ===
consensus_distance=38.777



=== Log clique consensus distance @ E7B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.008



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.3114 top1= 60.4968


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.7250 top1= 58.8341


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.7338 top1= 58.8942

Train epoch 8
[E 8B0  |    448/60000 (  1%) ] Loss: 2.1847 top1= 35.2273

=== Log global consensus distance @ E8B0 ===
consensus_distance=43.689



=== Log clique consensus distance @ E8B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.008


[E 8B10 |   4928/60000 (  8%) ] Loss: 2.0219 top1= 38.6364

=== Log global consensus distance @ E8B10 ===
consensus_distance=48.896



=== Log clique consensus distance @ E8B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.009


[E 8B20 |   9408/60000 ( 16%) ] Loss: 1.7360 top1= 45.7386

=== Log global consensus distance @ E8B20 ===
consensus_distance=54.394



=== Log clique consensus distance @ E8B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.009



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.2057 top1= 61.4183


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.6031 top1= 62.6202


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.6115 top1= 62.0893

Train epoch 9
[E 9B0  |    448/60000 (  1%) ] Loss: 2.1166 top1= 37.7841

=== Log global consensus distance @ E9B0 ===
consensus_distance=60.186



=== Log clique consensus distance @ E9B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.009


[E 9B10 |   4928/60000 (  8%) ] Loss: 1.9119 top1= 43.4659

=== Log global consensus distance @ E9B10 ===
consensus_distance=66.272



=== Log clique consensus distance @ E9B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.010


[E 9B20 |   9408/60000 ( 16%) ] Loss: 1.6131 top1= 48.2955

=== Log global consensus distance @ E9B20 ===
consensus_distance=72.650



=== Log clique consensus distance @ E9B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.010



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.1191 top1= 63.5817


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.4817 top1= 65.2845


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.4938 top1= 64.5833

Train epoch 10
[E10B0  |    448/60000 (  1%) ] Loss: 2.0507 top1= 41.7614

=== Log global consensus distance @ E10B0 ===
consensus_distance=79.323



=== Log clique consensus distance @ E10B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.011


[E10B10 |   4928/60000 (  8%) ] Loss: 1.8199 top1= 48.5795

=== Log global consensus distance @ E10B10 ===
consensus_distance=86.289



=== Log clique consensus distance @ E10B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.011


[E10B20 |   9408/60000 ( 16%) ] Loss: 1.5232 top1= 51.1364

=== Log global consensus distance @ E10B20 ===
consensus_distance=93.548



=== Log clique consensus distance @ E10B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.012



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.0684 top1= 64.3830


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.3683 top1= 68.0990


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.3796 top1= 67.1675

Train epoch 11
[E11B0  |    448/60000 (  1%) ] Loss: 1.9719 top1= 44.8864

=== Log global consensus distance @ E11B0 ===
consensus_distance=101.101



=== Log clique consensus distance @ E11B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.012


[E11B10 |   4928/60000 (  8%) ] Loss: 1.6845 top1= 49.4318

=== Log global consensus distance @ E11B10 ===
consensus_distance=108.948



=== Log clique consensus distance @ E11B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.013


[E11B20 |   9408/60000 ( 16%) ] Loss: 1.4595 top1= 52.8409

=== Log global consensus distance @ E11B20 ===
consensus_distance=117.087



=== Log clique consensus distance @ E11B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.013



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.0520 top1= 64.9239


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.2639 top1= 70.3726


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.2699 top1= 69.3409

Train epoch 12
[E12B0  |    448/60000 (  1%) ] Loss: 1.8778 top1= 47.1591

=== Log global consensus distance @ E12B0 ===
consensus_distance=125.522



=== Log clique consensus distance @ E12B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.014


[E12B10 |   4928/60000 (  8%) ] Loss: 1.6037 top1= 53.6932

=== Log global consensus distance @ E12B10 ===
consensus_distance=134.251



=== Log clique consensus distance @ E12B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.014


[E12B20 |   9408/60000 ( 16%) ] Loss: 1.3947 top1= 55.3977

=== Log global consensus distance @ E12B20 ===
consensus_distance=143.271



=== Log clique consensus distance @ E12B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.015



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.0543 top1= 65.7853


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.1665 top1= 72.1655


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.1724 top1= 71.2540

Train epoch 13
[E13B0  |    448/60000 (  1%) ] Loss: 1.8113 top1= 50.0000

=== Log global consensus distance @ E13B0 ===
consensus_distance=152.586



=== Log clique consensus distance @ E13B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.016


[E13B10 |   4928/60000 (  8%) ] Loss: 1.5203 top1= 55.3977

=== Log global consensus distance @ E13B10 ===
consensus_distance=162.196



=== Log clique consensus distance @ E13B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.017


[E13B20 |   9408/60000 ( 16%) ] Loss: 1.3150 top1= 59.6591

=== Log global consensus distance @ E13B20 ===
consensus_distance=172.097



=== Log clique consensus distance @ E13B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.018



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.1074 top1= 64.6835


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.0809 top1= 73.9283


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.0871 top1= 72.8766

Train epoch 14
[E14B0  |    448/60000 (  1%) ] Loss: 1.6786 top1= 53.1250

=== Log global consensus distance @ E14B0 ===
consensus_distance=182.293



=== Log clique consensus distance @ E14B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.018


[E14B10 |   4928/60000 (  8%) ] Loss: 1.4573 top1= 56.8182

=== Log global consensus distance @ E14B10 ===
consensus_distance=192.783



=== Log clique consensus distance @ E14B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.019


[E14B20 |   9408/60000 ( 16%) ] Loss: 1.2580 top1= 62.7841

=== Log global consensus distance @ E14B20 ===
consensus_distance=203.565



=== Log clique consensus distance @ E14B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.020



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.1508 top1= 64.6835


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=1.0062 top1= 75.1302


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=1.0118 top1= 74.1386

Train epoch 15
[E15B0  |    448/60000 (  1%) ] Loss: 1.5938 top1= 54.2614

=== Log global consensus distance @ E15B0 ===
consensus_distance=214.644



=== Log clique consensus distance @ E15B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.021


[E15B10 |   4928/60000 (  8%) ] Loss: 1.4163 top1= 59.0909

=== Log global consensus distance @ E15B10 ===
consensus_distance=226.015



=== Log clique consensus distance @ E15B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.022


[E15B20 |   9408/60000 ( 16%) ] Loss: 1.3002 top1= 61.6477

=== Log global consensus distance @ E15B20 ===
consensus_distance=237.677



=== Log clique consensus distance @ E15B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.023



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.2054 top1= 64.9840


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.9423 top1= 76.3421


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.9438 top1= 75.6310

Train epoch 16
[E16B0  |    448/60000 (  1%) ] Loss: 1.3585 top1= 57.1023

=== Log global consensus distance @ E16B0 ===
consensus_distance=249.639



=== Log clique consensus distance @ E16B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.025


[E16B10 |   4928/60000 (  8%) ] Loss: 1.3710 top1= 60.7955

=== Log global consensus distance @ E16B10 ===
consensus_distance=261.889



=== Log clique consensus distance @ E16B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.026


[E16B20 |   9408/60000 ( 16%) ] Loss: 1.1659 top1= 65.0568

=== Log global consensus distance @ E16B20 ===
consensus_distance=274.429



=== Log clique consensus distance @ E16B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.027



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.2827 top1= 65.7252


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.8834 top1= 77.3137


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.8862 top1= 76.6326

Train epoch 17
[E17B0  |    448/60000 (  1%) ] Loss: 1.3730 top1= 58.2386

=== Log global consensus distance @ E17B0 ===
consensus_distance=287.269



=== Log clique consensus distance @ E17B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.028


[E17B10 |   4928/60000 (  8%) ] Loss: 1.2066 top1= 61.9318

=== Log global consensus distance @ E17B10 ===
consensus_distance=300.408



=== Log clique consensus distance @ E17B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.029


[E17B20 |   9408/60000 ( 16%) ] Loss: 1.1712 top1= 65.9091

=== Log global consensus distance @ E17B20 ===
consensus_distance=313.830



=== Log clique consensus distance @ E17B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.031



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.4261 top1= 64.7837


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.8323 top1= 78.2151


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.8367 top1= 77.6442

Train epoch 18
[E18B0  |    448/60000 (  1%) ] Loss: 1.3677 top1= 59.6591

=== Log global consensus distance @ E18B0 ===
consensus_distance=327.553



=== Log clique consensus distance @ E18B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.032


[E18B10 |   4928/60000 (  8%) ] Loss: 1.1886 top1= 64.2045

=== Log global consensus distance @ E18B10 ===
consensus_distance=341.570



=== Log clique consensus distance @ E18B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.034


[E18B20 |   9408/60000 ( 16%) ] Loss: 1.2125 top1= 66.7614

=== Log global consensus distance @ E18B20 ===
consensus_distance=355.877



=== Log clique consensus distance @ E18B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.035



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.5147 top1= 64.9740


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.7889 top1= 79.2869


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.7914 top1= 78.6158

Train epoch 19
[E19B0  |    448/60000 (  1%) ] Loss: 1.2191 top1= 60.2273

=== Log global consensus distance @ E19B0 ===
consensus_distance=370.483



=== Log clique consensus distance @ E19B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.037


[E19B10 |   4928/60000 (  8%) ] Loss: 1.1790 top1= 65.6250

=== Log global consensus distance @ E19B10 ===
consensus_distance=385.382



=== Log clique consensus distance @ E19B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.038


[E19B20 |   9408/60000 ( 16%) ] Loss: 1.1676 top1= 68.1818

=== Log global consensus distance @ E19B20 ===
consensus_distance=400.570



=== Log clique consensus distance @ E19B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.040



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.5997 top1= 65.9054


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.7533 top1= 80.0581


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.7540 top1= 79.2969

Train epoch 20
[E20B0  |    448/60000 (  1%) ] Loss: 1.1312 top1= 61.3636

=== Log global consensus distance @ E20B0 ===
consensus_distance=416.053



=== Log clique consensus distance @ E20B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.042


[E20B10 |   4928/60000 (  8%) ] Loss: 1.1054 top1= 67.3295

=== Log global consensus distance @ E20B10 ===
consensus_distance=431.836



=== Log clique consensus distance @ E20B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.043


[E20B20 |   9408/60000 ( 16%) ] Loss: 1.1287 top1= 69.6023

=== Log global consensus distance @ E20B20 ===
consensus_distance=447.903



=== Log clique consensus distance @ E20B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.045



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.6882 top1= 67.0172


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.7240 top1= 80.5389


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.7218 top1= 80.0280

Train epoch 21
[E21B0  |    448/60000 (  1%) ] Loss: 1.1493 top1= 63.0682

=== Log global consensus distance @ E21B0 ===
consensus_distance=464.266



=== Log clique consensus distance @ E21B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.047


[E21B10 |   4928/60000 (  8%) ] Loss: 1.1285 top1= 66.1932

=== Log global consensus distance @ E21B10 ===
consensus_distance=480.930



=== Log clique consensus distance @ E21B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.049


[E21B20 |   9408/60000 ( 16%) ] Loss: 1.0509 top1= 70.7386

=== Log global consensus distance @ E21B20 ===
consensus_distance=497.882



=== Log clique consensus distance @ E21B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.051



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8539 top1= 66.3061


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.6980 top1= 81.3201


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.6956 top1= 80.7893

Train epoch 22
[E22B0  |    448/60000 (  1%) ] Loss: 1.0770 top1= 65.0568

=== Log global consensus distance @ E22B0 ===
consensus_distance=515.130



=== Log clique consensus distance @ E22B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.053


[E22B10 |   4928/60000 (  8%) ] Loss: 1.1012 top1= 67.3295

=== Log global consensus distance @ E22B10 ===
consensus_distance=532.674



=== Log clique consensus distance @ E22B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.055


[E22B20 |   9408/60000 ( 16%) ] Loss: 0.9850 top1= 72.1591

=== Log global consensus distance @ E22B20 ===
consensus_distance=550.509



=== Log clique consensus distance @ E22B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.057



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=1.8161 top1= 68.9904


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.6760 top1= 81.8309


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.6731 top1= 81.2400

Train epoch 23
[E23B0  |    448/60000 (  1%) ] Loss: 1.1046 top1= 65.0568

=== Log global consensus distance @ E23B0 ===
consensus_distance=568.641



=== Log clique consensus distance @ E23B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.059


[E23B10 |   4928/60000 (  8%) ] Loss: 1.0533 top1= 68.7500

=== Log global consensus distance @ E23B10 ===
consensus_distance=587.065



=== Log clique consensus distance @ E23B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.061


[E23B20 |   9408/60000 ( 16%) ] Loss: 1.0656 top1= 72.1591

=== Log global consensus distance @ E23B20 ===
consensus_distance=605.774



=== Log clique consensus distance @ E23B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.064



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.2022 top1= 67.1575


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.6569 top1= 82.1514


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.6536 top1= 81.7208

Train epoch 24
[E24B0  |    448/60000 (  1%) ] Loss: 1.0536 top1= 65.6250

=== Log global consensus distance @ E24B0 ===
consensus_distance=624.783



=== Log clique consensus distance @ E24B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.066


[E24B10 |   4928/60000 (  8%) ] Loss: 1.0915 top1= 69.0341

=== Log global consensus distance @ E24B10 ===
consensus_distance=644.079



=== Log clique consensus distance @ E24B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.068


[E24B20 |   9408/60000 ( 16%) ] Loss: 1.4733 top1= 72.7273

=== Log global consensus distance @ E24B20 ===
consensus_distance=663.591



=== Log clique consensus distance @ E24B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.071



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.0129 top1= 67.8586


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.6408 top1= 82.5521


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.6362 top1= 82.1715

Train epoch 25
[E25B0  |    448/60000 (  1%) ] Loss: 1.1668 top1= 65.6250

=== Log global consensus distance @ E25B0 ===
consensus_distance=683.480



=== Log clique consensus distance @ E25B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.073


[E25B10 |   4928/60000 (  8%) ] Loss: 1.1230 top1= 70.4545

=== Log global consensus distance @ E25B10 ===
consensus_distance=703.663



=== Log clique consensus distance @ E25B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.075


[E25B20 |   9408/60000 ( 16%) ] Loss: 1.0381 top1= 73.8636

=== Log global consensus distance @ E25B20 ===
consensus_distance=724.144



=== Log clique consensus distance @ E25B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.078



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.1318 top1= 68.2292


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.6264 top1= 82.9627


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.6216 top1= 82.5421

Train epoch 26
[E26B0  |    448/60000 (  1%) ] Loss: 1.0646 top1= 67.3295

=== Log global consensus distance @ E26B0 ===
consensus_distance=744.914



=== Log clique consensus distance @ E26B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.081


[E26B10 |   4928/60000 (  8%) ] Loss: 1.1077 top1= 71.5909

=== Log global consensus distance @ E26B10 ===
consensus_distance=765.981



=== Log clique consensus distance @ E26B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.083


[E26B20 |   9408/60000 ( 16%) ] Loss: 0.8994 top1= 74.4318

=== Log global consensus distance @ E26B20 ===
consensus_distance=787.346



=== Log clique consensus distance @ E26B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.087



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.2288 top1= 68.8201


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.6128 top1= 83.3033


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.6089 top1= 82.7825

Train epoch 27
[E27B0  |    448/60000 (  1%) ] Loss: 0.9677 top1= 68.4659

=== Log global consensus distance @ E27B0 ===
consensus_distance=809.004



=== Log clique consensus distance @ E27B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.090


[E27B10 |   4928/60000 (  8%) ] Loss: 1.0319 top1= 72.7273

=== Log global consensus distance @ E27B10 ===
consensus_distance=830.954



=== Log clique consensus distance @ E27B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.092


[E27B20 |   9408/60000 ( 16%) ] Loss: 0.8461 top1= 75.5682

=== Log global consensus distance @ E27B20 ===
consensus_distance=853.203



=== Log clique consensus distance @ E27B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.095



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.3236 top1= 69.1807


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.6004 top1= 83.7540


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.5979 top1= 82.9928

Train epoch 28
[E28B0  |    448/60000 (  1%) ] Loss: 1.0109 top1= 68.7500

=== Log global consensus distance @ E28B0 ===
consensus_distance=875.744



=== Log clique consensus distance @ E28B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.099


[E28B10 |   4928/60000 (  8%) ] Loss: 0.9639 top1= 72.4432

=== Log global consensus distance @ E28B10 ===
consensus_distance=898.577



=== Log clique consensus distance @ E28B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.101


[E28B20 |   9408/60000 ( 16%) ] Loss: 0.9074 top1= 77.8409

=== Log global consensus distance @ E28B20 ===
consensus_distance=921.708



=== Log clique consensus distance @ E28B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.105



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.4152 top1= 70.1623


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.5888 top1= 83.9543


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.5873 top1= 83.2031

Train epoch 29
[E29B0  |    448/60000 (  1%) ] Loss: 0.8874 top1= 70.4545

=== Log global consensus distance @ E29B0 ===
consensus_distance=945.131



=== Log clique consensus distance @ E29B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.108


[E29B10 |   4928/60000 (  8%) ] Loss: 0.9684 top1= 73.2955

=== Log global consensus distance @ E29B10 ===
consensus_distance=968.847



=== Log clique consensus distance @ E29B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.111


[E29B20 |   9408/60000 ( 16%) ] Loss: 0.9314 top1= 76.9886

=== Log global consensus distance @ E29B20 ===
consensus_distance=992.857



=== Log clique consensus distance @ E29B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.115



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.6007 top1= 70.3626


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.5800 top1= 84.1446


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.5783 top1= 83.3834

Train epoch 30
[E30B0  |    448/60000 (  1%) ] Loss: 0.9129 top1= 70.1705

=== Log global consensus distance @ E30B0 ===
consensus_distance=1017.162



=== Log clique consensus distance @ E30B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.118


[E30B10 |   4928/60000 (  8%) ] Loss: 0.9245 top1= 73.5795

=== Log global consensus distance @ E30B10 ===
consensus_distance=1041.761



=== Log clique consensus distance @ E30B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.121


[E30B20 |   9408/60000 ( 16%) ] Loss: 0.8496 top1= 77.8409

=== Log global consensus distance @ E30B20 ===
consensus_distance=1066.658



=== Log clique consensus distance @ E30B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.126



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.8363 top1= 70.1322


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.5727 top1= 84.1847


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.5706 top1= 83.6138

Train epoch 31
[E31B0  |    448/60000 (  1%) ] Loss: 0.8724 top1= 70.1705

=== Log global consensus distance @ E31B0 ===
consensus_distance=1091.846



=== Log clique consensus distance @ E31B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.129


[E31B10 |   4928/60000 (  8%) ] Loss: 0.9196 top1= 74.1477

=== Log global consensus distance @ E31B10 ===
consensus_distance=1117.327



=== Log clique consensus distance @ E31B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.132


[E31B20 |   9408/60000 ( 16%) ] Loss: 0.8941 top1= 78.1250

=== Log global consensus distance @ E31B20 ===
consensus_distance=1143.109



=== Log clique consensus distance @ E31B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.137



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=2.8721 top1= 71.6647


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.5659 top1= 84.2147


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.5640 top1= 83.8642

Train epoch 32
[E32B0  |    448/60000 (  1%) ] Loss: 0.8635 top1= 70.4545

=== Log global consensus distance @ E32B0 ===
consensus_distance=1169.177



=== Log clique consensus distance @ E32B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.141


[E32B10 |   4928/60000 (  8%) ] Loss: 0.8557 top1= 74.4318

=== Log global consensus distance @ E32B10 ===
consensus_distance=1195.542



=== Log clique consensus distance @ E32B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.144


[E32B20 |   9408/60000 ( 16%) ] Loss: 0.7781 top1= 77.8409

=== Log global consensus distance @ E32B20 ===
consensus_distance=1222.204



=== Log clique consensus distance @ E32B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.149



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.4643 top1= 69.0905


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.5598 top1= 84.2849


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.5588 top1= 83.9844

Train epoch 33
[E33B0  |    448/60000 (  1%) ] Loss: 0.9198 top1= 69.3182

=== Log global consensus distance @ E33B0 ===
consensus_distance=1249.144



=== Log clique consensus distance @ E33B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.153


[E33B10 |   4928/60000 (  8%) ] Loss: 0.9018 top1= 73.8636

=== Log global consensus distance @ E33B10 ===
consensus_distance=1276.389



=== Log clique consensus distance @ E33B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.156


[E33B20 |   9408/60000 ( 16%) ] Loss: 0.8235 top1= 77.2727

=== Log global consensus distance @ E33B20 ===
consensus_distance=1303.932



=== Log clique consensus distance @ E33B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.162



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.0067 top1= 72.7965


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.5540 top1= 84.5052


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.5539 top1= 84.0946

Train epoch 34
[E34B0  |    448/60000 (  1%) ] Loss: 0.8429 top1= 70.7386

=== Log global consensus distance @ E34B0 ===
consensus_distance=1331.768



=== Log clique consensus distance @ E34B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.166


[E34B10 |   4928/60000 (  8%) ] Loss: 0.7959 top1= 74.4318

=== Log global consensus distance @ E34B10 ===
consensus_distance=1359.894



=== Log clique consensus distance @ E34B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.169


[E34B20 |   9408/60000 ( 16%) ] Loss: 0.8328 top1= 77.8409

=== Log global consensus distance @ E34B20 ===
consensus_distance=1388.320



=== Log clique consensus distance @ E34B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.175



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.1217 top1= 73.3173


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.5482 top1= 84.6254


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.5497 top1= 84.2047

Train epoch 35
[E35B0  |    448/60000 (  1%) ] Loss: 0.8607 top1= 70.7386

=== Log global consensus distance @ E35B0 ===
consensus_distance=1417.038



=== Log clique consensus distance @ E35B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.180


[E35B10 |   4928/60000 (  8%) ] Loss: 0.9693 top1= 74.1477

=== Log global consensus distance @ E35B10 ===
consensus_distance=1446.049



=== Log clique consensus distance @ E35B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.183


[E35B20 |   9408/60000 ( 16%) ] Loss: 0.8697 top1= 78.6932

=== Log global consensus distance @ E35B20 ===
consensus_distance=1475.356



=== Log clique consensus distance @ E35B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.189



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.5083 top1= 72.5060


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.5433 top1= 84.8558


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.5462 top1= 84.2548

Train epoch 36
[E36B0  |    448/60000 (  1%) ] Loss: 0.8442 top1= 71.3068

=== Log global consensus distance @ E36B0 ===
consensus_distance=1504.957



=== Log clique consensus distance @ E36B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.194


[E36B10 |   4928/60000 (  8%) ] Loss: 0.8503 top1= 75.5682

=== Log global consensus distance @ E36B10 ===
consensus_distance=1534.852



=== Log clique consensus distance @ E36B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.198


[E36B20 |   9408/60000 ( 16%) ] Loss: 0.7828 top1= 79.2614

=== Log global consensus distance @ E36B20 ===
consensus_distance=1565.041



=== Log clique consensus distance @ E36B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.204



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.7112 top1= 73.8181


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.5391 top1= 84.9760


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.5434 top1= 84.2548

Train epoch 37
[E37B0  |    448/60000 (  1%) ] Loss: 0.8479 top1= 71.0227

=== Log global consensus distance @ E37B0 ===
consensus_distance=1595.523



=== Log clique consensus distance @ E37B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.209


[E37B10 |   4928/60000 (  8%) ] Loss: 0.7520 top1= 75.8523

=== Log global consensus distance @ E37B10 ===
consensus_distance=1626.302



=== Log clique consensus distance @ E37B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.213


[E37B20 |   9408/60000 ( 16%) ] Loss: 1.1791 top1= 77.5568

=== Log global consensus distance @ E37B20 ===
consensus_distance=1657.356



=== Log clique consensus distance @ E37B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.219



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=4.0190 top1= 73.6478


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.5353 top1= 85.0861


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.5407 top1= 84.4852

Train epoch 38
[E38B0  |    448/60000 (  1%) ] Loss: 1.8500 top1= 70.1705

=== Log global consensus distance @ E38B0 ===
consensus_distance=1688.708



=== Log clique consensus distance @ E38B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.224


[E38B10 |   4928/60000 (  8%) ] Loss: 1.0467 top1= 75.2841

=== Log global consensus distance @ E38B10 ===
consensus_distance=1720.361



=== Log clique consensus distance @ E38B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.228


[E38B20 |   9408/60000 ( 16%) ] Loss: 1.9496 top1= 76.9886

=== Log global consensus distance @ E38B20 ===
consensus_distance=1752.303



=== Log clique consensus distance @ E38B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.234



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=3.9146 top1= 73.5677


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.5315 top1= 85.1663


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.5388 top1= 84.4952

Train epoch 39
[E39B0  |    448/60000 (  1%) ] Loss: 1.0031 top1= 71.0227

=== Log global consensus distance @ E39B0 ===
consensus_distance=1784.537



=== Log clique consensus distance @ E39B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.240


[E39B10 |   4928/60000 (  8%) ] Loss: 0.8516 top1= 75.8523

=== Log global consensus distance @ E39B10 ===
consensus_distance=1817.076



=== Log clique consensus distance @ E39B10 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.244


[E39B20 |   9408/60000 ( 16%) ] Loss: 1.3186 top1= 77.8409

=== Log global consensus distance @ E39B20 ===
consensus_distance=1849.898



=== Log clique consensus distance @ E39B20 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.251



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=124.2455 top1= 24.7196


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=0.5282 top1= 85.1963


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=0.5373 top1= 84.5052

Train epoch 40
[E40B0  |    448/60000 (  1%) ] Loss: 336.5568 top1= 66.1932

=== Log global consensus distance @ E40B0 ===
consensus_distance=1884.606



=== Log clique consensus distance @ E40B0 ===
clique1_consensus_distance=0.006
clique2_consensus_distance=0.256


[E40B10 |   4928/60000 (  8%) ] Loss: nan top1= 10.5114

=== Log global consensus distance @ E40B10 ===
consensus_distance=nan



=== Log clique consensus distance @ E40B10 ===
clique1_consensus_distance=nan
clique2_consensus_distance=nan


[E40B20 |   9408/60000 ( 16%) ] Loss: nan top1=  9.6591

=== Log global consensus distance @ E40B20 ===
consensus_distance=nan



=== Log clique consensus distance @ E40B20 ===
clique1_consensus_distance=nan
clique2_consensus_distance=nan



=> Averaged model (Global Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique1 Average Validation Accuracy) | Eval Loss=nan top1=  9.8057


=> Averaged model (Clique2 Average Validation Accuracy) | Eval Loss=nan top1=  9.8057

