Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.0001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893192246556282
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326313018798828
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.032661110162734985
Inter Cos: 0.032878801226615906
Norm Quadratic Average: 64.43146514892578
Nearest Class Center Accuracy: 0.04366

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023564377799630165
Inter Cos: 0.02118029072880745
Norm Quadratic Average: 93.94251251220703
Nearest Class Center Accuracy: 0.05602

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018490193411707878
Inter Cos: 0.023704983294010162
Norm Quadratic Average: 179.63465881347656
Nearest Class Center Accuracy: 0.06186

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02293500117957592
Inter Cos: 0.02535548433661461
Norm Quadratic Average: 192.2922821044922
Nearest Class Center Accuracy: 0.06686

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024491170421242714
Inter Cos: 0.028604790568351746
Norm Quadratic Average: 283.27764892578125
Nearest Class Center Accuracy: 0.06904

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02521253563463688
Inter Cos: 0.030462782829999924
Norm Quadratic Average: 355.6370544433594
Nearest Class Center Accuracy: 0.07122

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.027369100600481033
Inter Cos: 0.030602827668190002
Norm Quadratic Average: 459.4074401855469
Nearest Class Center Accuracy: 0.07266

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.044062912464141846
Inter Cos: 0.038534294813871384
Norm Quadratic Average: 333.5123596191406
Nearest Class Center Accuracy: 0.0772

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05006463825702667
Inter Cos: 0.04271863400936127
Norm Quadratic Average: 310.87255859375
Nearest Class Center Accuracy: 0.07904

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06543838977813721
Inter Cos: 0.055792436003685
Norm Quadratic Average: 222.87808227539062
Nearest Class Center Accuracy: 0.08296

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10289987176656723
Inter Cos: 0.08314286917448044
Norm Quadratic Average: 157.5789031982422
Nearest Class Center Accuracy: 0.0858

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.25056198239326477
Inter Cos: 0.1774243414402008
Norm Quadratic Average: 76.1719741821289
Nearest Class Center Accuracy: 0.09028

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5152751207351685
Inter Cos: 0.3051188290119171
Norm Quadratic Average: 48.33762741088867
Nearest Class Center Accuracy: 0.09282

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7080999612808228
Inter Cos: 0.3391866385936737
Norm Quadratic Average: 29.70747184753418
Nearest Class Center Accuracy: 0.09398

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.785736620426178
Inter Cos: 0.299669086933136
Norm Quadratic Average: 17.872093200683594
Nearest Class Center Accuracy: 0.09518

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 73.95696258544922
Linear Weight Rank: 4031
Intra Cos: 0.8573122620582581
Inter Cos: 0.3151572346687317
Norm Quadratic Average: 73.02027130126953
Nearest Class Center Accuracy: 0.09806

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 32.199337005615234
Linear Weight Rank: 3666
Intra Cos: 0.900561511516571
Inter Cos: 0.3331265449523926
Norm Quadratic Average: 48.85226058959961
Nearest Class Center Accuracy: 0.09944

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 12.943747520446777
Linear Weight Rank: 98
Intra Cos: 0.9145867228507996
Inter Cos: 0.3893274664878845
Norm Quadratic Average: 39.75674057006836
Nearest Class Center Accuracy: 0.09952

Output Layer:
Intra Cos: 0.9640983939170837
Inter Cos: 0.6860886812210083
Norm Quadratic Average: 77.42495727539062
Nearest Class Center Accuracy: 0.0993

Test Set:
Average Loss: 4.269169785308838
Accuracy: 0.4918
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.45442795753479004, Weights: 0.03743935376405716
NC2 Equiangle: Features: 0.17430015486900252, Weights: 0.12188520951704546
NC3 Self-Duality: 0.7032825946807861
NC4 NCC Mismatch: 0.15739999999999998

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422183990478516
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01438117865473032
Inter Cos: 0.23588795959949493
Norm Quadratic Average: 64.79334259033203
Nearest Class Center Accuracy: 0.2191

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014235164038836956
Inter Cos: 0.2260272055864334
Norm Quadratic Average: 94.6266098022461
Nearest Class Center Accuracy: 0.344

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011636295355856419
Inter Cos: 0.16304531693458557
Norm Quadratic Average: 180.9457244873047
Nearest Class Center Accuracy: 0.4239

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016472678631544113
Inter Cos: 0.2090516984462738
Norm Quadratic Average: 193.8131103515625
Nearest Class Center Accuracy: 0.4585

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01556957047432661
Inter Cos: 0.19373264908790588
Norm Quadratic Average: 285.3354797363281
Nearest Class Center Accuracy: 0.49

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016533657908439636
Inter Cos: 0.18405215442180634
Norm Quadratic Average: 357.8841857910156
Nearest Class Center Accuracy: 0.5078

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018246453255414963
Inter Cos: 0.1825452446937561
Norm Quadratic Average: 461.6860046386719
Nearest Class Center Accuracy: 0.5121

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021493181586265564
Inter Cos: 0.22224971652030945
Norm Quadratic Average: 334.6468811035156
Nearest Class Center Accuracy: 0.5271

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02162422612309456
Inter Cos: 0.18154457211494446
Norm Quadratic Average: 309.1449890136719
Nearest Class Center Accuracy: 0.5315

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02446555718779564
Inter Cos: 0.20654265582561493
Norm Quadratic Average: 218.20272827148438
Nearest Class Center Accuracy: 0.5284

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03579862415790558
Inter Cos: 0.23532050848007202
Norm Quadratic Average: 151.18882751464844
Nearest Class Center Accuracy: 0.5054

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07253780215978622
Inter Cos: 0.3227608799934387
Norm Quadratic Average: 70.32100677490234
Nearest Class Center Accuracy: 0.4729

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.15103092789649963
Inter Cos: 0.36260175704956055
Norm Quadratic Average: 42.52298355102539
Nearest Class Center Accuracy: 0.4457

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.21250194311141968
Inter Cos: 0.4156757891178131
Norm Quadratic Average: 25.354629516601562
Nearest Class Center Accuracy: 0.4403

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2379661500453949
Inter Cos: 0.37178078293800354
Norm Quadratic Average: 14.994598388671875
Nearest Class Center Accuracy: 0.4506

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 73.95696258544922
Linear Weight Rank: 4031
Intra Cos: 0.23169554769992828
Inter Cos: 0.36729031801223755
Norm Quadratic Average: 60.38262939453125
Nearest Class Center Accuracy: 0.4653

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 32.199337005615234
Linear Weight Rank: 3666
Intra Cos: 0.19506396353244781
Inter Cos: 0.35380712151527405
Norm Quadratic Average: 39.934993743896484
Nearest Class Center Accuracy: 0.4755

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 12.943747520446777
Linear Weight Rank: 98
Intra Cos: 0.19250382483005524
Inter Cos: 0.4626556932926178
Norm Quadratic Average: 32.5660285949707
Nearest Class Center Accuracy: 0.4806

Output Layer:
Intra Cos: 0.18534806370735168
Inter Cos: 0.7020543217658997
Norm Quadratic Average: 62.7746467590332
Nearest Class Center Accuracy: 0.4782

