Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02289319410920143
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326311111450195
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019447365775704384
Inter Cos: 0.039566896855831146
Norm Quadratic Average: 41.81686019897461
Nearest Class Center Accuracy: 0.03916

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023271551355719566
Inter Cos: 0.029252419248223305
Norm Quadratic Average: 43.007904052734375
Nearest Class Center Accuracy: 0.05364

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023480895906686783
Inter Cos: 0.02178303152322769
Norm Quadratic Average: 33.37189483642578
Nearest Class Center Accuracy: 0.06232

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02590588852763176
Inter Cos: 0.024570908397436142
Norm Quadratic Average: 9.279419898986816
Nearest Class Center Accuracy: 0.06986

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03502476587891579
Inter Cos: 0.03674986585974693
Norm Quadratic Average: 3.0271785259246826
Nearest Class Center Accuracy: 0.07216

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10169873386621475
Inter Cos: 0.1319747269153595
Norm Quadratic Average: 0.7821980118751526
Nearest Class Center Accuracy: 0.0797

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3015807867050171
Inter Cos: 0.3794822692871094
Norm Quadratic Average: 0.7217068672180176
Nearest Class Center Accuracy: 0.08268

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.37691617012023926
Inter Cos: 0.6499574780464172
Norm Quadratic Average: 1.0427055358886719
Nearest Class Center Accuracy: 0.07904

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5411164164543152
Inter Cos: 0.7992637753486633
Norm Quadratic Average: 1.253937005996704
Nearest Class Center Accuracy: 0.086

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7113689184188843
Inter Cos: 0.9156242609024048
Norm Quadratic Average: 1.9375187158584595
Nearest Class Center Accuracy: 0.08926

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7986072301864624
Inter Cos: 0.9363422393798828
Norm Quadratic Average: 4.416954517364502
Nearest Class Center Accuracy: 0.0895

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8426323533058167
Inter Cos: 0.9439575672149658
Norm Quadratic Average: 7.452722072601318
Nearest Class Center Accuracy: 0.08854

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8460052013397217
Inter Cos: 0.9433603882789612
Norm Quadratic Average: 12.250933647155762
Nearest Class Center Accuracy: 0.0882

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8410066962242126
Inter Cos: 0.9434762597084045
Norm Quadratic Average: 21.27607536315918
Nearest Class Center Accuracy: 0.08708

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8228346109390259
Inter Cos: 0.9345577955245972
Norm Quadratic Average: 37.06505584716797
Nearest Class Center Accuracy: 0.08532

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.9834911823272705
Linear Weight Rank: 50
Intra Cos: 0.8258047103881836
Inter Cos: 0.9301110506057739
Norm Quadratic Average: 262.9549255371094
Nearest Class Center Accuracy: 0.08424

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.5232198238372803
Linear Weight Rank: 2045
Intra Cos: 0.8120658993721008
Inter Cos: 0.9056481719017029
Norm Quadratic Average: 177.90606689453125
Nearest Class Center Accuracy: 0.08966

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.303298473358154
Linear Weight Rank: 96
Intra Cos: 0.7853511571884155
Inter Cos: 0.8872619271278381
Norm Quadratic Average: 89.22935485839844
Nearest Class Center Accuracy: 0.0943

Output Layer:
Intra Cos: 0.8147892355918884
Inter Cos: 0.9344114065170288
Norm Quadratic Average: 100.02986907958984
Nearest Class Center Accuracy: 0.09428

Test Set:
Average Loss: 5.229720949554443
Accuracy: 0.2654
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.5016287565231323, Weights: 0.16545166075229645
NC2 Equiangle: Features: 0.3630085523200758, Weights: 0.18717234601878158
NC3 Self-Duality: 0.8249152898788452
NC4 NCC Mismatch: 0.44520000000000004

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621266715228558
Inter Cos: 0.406754732131958
Norm Quadratic Average: 29.42218780517578
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01387713011354208
Inter Cos: 0.28449326753616333
Norm Quadratic Average: 42.06059265136719
Nearest Class Center Accuracy: 0.196

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016327321529388428
Inter Cos: 0.23723921179771423
Norm Quadratic Average: 43.277442932128906
Nearest Class Center Accuracy: 0.3049

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014584499411284924
Inter Cos: 0.17813938856124878
Norm Quadratic Average: 33.564388275146484
Nearest Class Center Accuracy: 0.4155

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01665298268198967
Inter Cos: 0.21727941930294037
Norm Quadratic Average: 9.334940910339355
Nearest Class Center Accuracy: 0.4822

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021528620272874832
Inter Cos: 0.22597891092300415
Norm Quadratic Average: 3.0380747318267822
Nearest Class Center Accuracy: 0.4904

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03727399557828903
Inter Cos: 0.4457065165042877
Norm Quadratic Average: 0.7801860570907593
Nearest Class Center Accuracy: 0.4337

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07986554503440857
Inter Cos: 0.71048504114151
Norm Quadratic Average: 0.7121782898902893
Nearest Class Center Accuracy: 0.3284

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08820898085832596
Inter Cos: 0.7994146943092346
Norm Quadratic Average: 1.0225715637207031
Nearest Class Center Accuracy: 0.2664

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1648508906364441
Inter Cos: 0.8053374290466309
Norm Quadratic Average: 1.2300382852554321
Nearest Class Center Accuracy: 0.2529

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.13977180421352386
Inter Cos: 0.8656770586967468
Norm Quadratic Average: 1.89162015914917
Nearest Class Center Accuracy: 0.2244

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08823459595441818
Inter Cos: 0.9006567001342773
Norm Quadratic Average: 4.320888042449951
Nearest Class Center Accuracy: 0.2117

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02610025927424431
Inter Cos: 0.9258927702903748
Norm Quadratic Average: 7.305079460144043
Nearest Class Center Accuracy: 0.1916

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.005462132394313812
Inter Cos: 0.9252551794052124
Norm Quadratic Average: 12.01498031616211
Nearest Class Center Accuracy: 0.1949

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0019182274118065834
Inter Cos: 0.9301052093505859
Norm Quadratic Average: 20.89686393737793
Nearest Class Center Accuracy: 0.1947

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015368669293820858
Inter Cos: 0.9251580834388733
Norm Quadratic Average: 36.478328704833984
Nearest Class Center Accuracy: 0.1964

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.9834911823272705
Linear Weight Rank: 50
Intra Cos: 0.11279669404029846
Inter Cos: 0.902858555316925
Norm Quadratic Average: 259.254638671875
Nearest Class Center Accuracy: 0.2021

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.5232198238372803
Linear Weight Rank: 2045
Intra Cos: 0.22664979100227356
Inter Cos: 0.8112335205078125
Norm Quadratic Average: 174.35574340820312
Nearest Class Center Accuracy: 0.23

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.303298473358154
Linear Weight Rank: 96
Intra Cos: 0.19114096462726593
Inter Cos: 0.8026671409606934
Norm Quadratic Average: 86.99491119384766
Nearest Class Center Accuracy: 0.2472

Output Layer:
Intra Cos: 0.1908148229122162
Inter Cos: 0.8286482095718384
Norm Quadratic Average: 97.24955749511719
Nearest Class Center Accuracy: 0.2354

