Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893192246556282
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326313018798828
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021008089184761047
Inter Cos: 0.05176762118935585
Norm Quadratic Average: 43.412105560302734
Nearest Class Center Accuracy: 0.0403

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02241583541035652
Inter Cos: 0.02624339982867241
Norm Quadratic Average: 45.74052429199219
Nearest Class Center Accuracy: 0.05692

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02082558535039425
Inter Cos: 0.023772913962602615
Norm Quadratic Average: 39.66050720214844
Nearest Class Center Accuracy: 0.06454

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024680308997631073
Inter Cos: 0.025315262377262115
Norm Quadratic Average: 11.642040252685547
Nearest Class Center Accuracy: 0.0715

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03920608013868332
Inter Cos: 0.03511920943856239
Norm Quadratic Average: 4.143684387207031
Nearest Class Center Accuracy: 0.07646

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10971754044294357
Inter Cos: 0.10496998578310013
Norm Quadratic Average: 1.2009474039077759
Nearest Class Center Accuracy: 0.08522

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3037046790122986
Inter Cos: 0.306456059217453
Norm Quadratic Average: 0.923284113407135
Nearest Class Center Accuracy: 0.0884

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.47439810633659363
Inter Cos: 0.473972886800766
Norm Quadratic Average: 1.0629676580429077
Nearest Class Center Accuracy: 0.08724

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6652609705924988
Inter Cos: 0.615193247795105
Norm Quadratic Average: 1.6805444955825806
Nearest Class Center Accuracy: 0.0879

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7174487113952637
Inter Cos: 0.6735631227493286
Norm Quadratic Average: 3.631462574005127
Nearest Class Center Accuracy: 0.08666

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.756812334060669
Inter Cos: 0.7261141538619995
Norm Quadratic Average: 7.53900146484375
Nearest Class Center Accuracy: 0.08696

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7308931350708008
Inter Cos: 0.7757882475852966
Norm Quadratic Average: 12.020267486572266
Nearest Class Center Accuracy: 0.08566

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7640798091888428
Inter Cos: 0.7630181908607483
Norm Quadratic Average: 21.754304885864258
Nearest Class Center Accuracy: 0.08686

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8057330250740051
Inter Cos: 0.7257558107376099
Norm Quadratic Average: 37.90642547607422
Nearest Class Center Accuracy: 0.08852

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8573148846626282
Inter Cos: 0.7269317507743835
Norm Quadratic Average: 58.319393157958984
Nearest Class Center Accuracy: 0.092

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.0874218940734863
Linear Weight Rank: 216
Intra Cos: 0.8471239805221558
Inter Cos: 0.688556969165802
Norm Quadratic Average: 330.7685546875
Nearest Class Center Accuracy: 0.09454

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.7643256187438965
Linear Weight Rank: 2286
Intra Cos: 0.8543027639389038
Inter Cos: 0.664866030216217
Norm Quadratic Average: 232.39503479003906
Nearest Class Center Accuracy: 0.09724

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.3355793952941895
Linear Weight Rank: 97
Intra Cos: 0.8448689579963684
Inter Cos: 0.6403164863586426
Norm Quadratic Average: 123.6983642578125
Nearest Class Center Accuracy: 0.0987

Output Layer:
Intra Cos: 0.8845536708831787
Inter Cos: 0.7675802111625671
Norm Quadratic Average: 106.41864013671875
Nearest Class Center Accuracy: 0.0989

Test Set:
Average Loss: 7.355177634429932
Accuracy: 0.3448
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.3842010200023651, Weights: 0.08164547383785248
NC2 Equiangle: Features: 0.2924282867739899, Weights: 0.127895569464173
NC3 Self-Duality: 0.7797244191169739
NC4 NCC Mismatch: 0.3579

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422183990478516
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0136100547388196
Inter Cos: 0.30386340618133545
Norm Quadratic Average: 43.66120910644531
Nearest Class Center Accuracy: 0.1973

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015523708425462246
Inter Cos: 0.261349618434906
Norm Quadratic Average: 46.023780822753906
Nearest Class Center Accuracy: 0.3301

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01564020663499832
Inter Cos: 0.19053657352924347
Norm Quadratic Average: 39.914852142333984
Nearest Class Center Accuracy: 0.4419

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01593266800045967
Inter Cos: 0.2058863639831543
Norm Quadratic Average: 11.720833778381348
Nearest Class Center Accuracy: 0.5109

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017839346081018448
Inter Cos: 0.22093228995800018
Norm Quadratic Average: 4.16171932220459
Nearest Class Center Accuracy: 0.5401

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03956976532936096
Inter Cos: 0.38517653942108154
Norm Quadratic Average: 1.1969021558761597
Nearest Class Center Accuracy: 0.4942

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0704183280467987
Inter Cos: 0.7057666182518005
Norm Quadratic Average: 0.9022873640060425
Nearest Class Center Accuracy: 0.3878

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09640476107597351
Inter Cos: 0.8561966419219971
Norm Quadratic Average: 1.0242115259170532
Nearest Class Center Accuracy: 0.326

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.12071625143289566
Inter Cos: 0.9345988035202026
Norm Quadratic Average: 1.6111477613449097
Nearest Class Center Accuracy: 0.311

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.11219067126512527
Inter Cos: 0.9601225256919861
Norm Quadratic Average: 3.478959083557129
Nearest Class Center Accuracy: 0.2884

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1167679950594902
Inter Cos: 0.9687036871910095
Norm Quadratic Average: 7.208858489990234
Nearest Class Center Accuracy: 0.2797

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06992538273334503
Inter Cos: 0.9803300499916077
Norm Quadratic Average: 11.465941429138184
Nearest Class Center Accuracy: 0.2523

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08950687944889069
Inter Cos: 0.9787313938140869
Norm Quadratic Average: 20.72718048095703
Nearest Class Center Accuracy: 0.2647

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.11767535656690598
Inter Cos: 0.9706181287765503
Norm Quadratic Average: 36.066368103027344
Nearest Class Center Accuracy: 0.2805

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1567525416612625
Inter Cos: 0.9464751482009888
Norm Quadratic Average: 55.35074996948242
Nearest Class Center Accuracy: 0.2987

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.0874218940734863
Linear Weight Rank: 216
Intra Cos: 0.26573288440704346
Inter Cos: 0.9099634885787964
Norm Quadratic Average: 314.5444641113281
Nearest Class Center Accuracy: 0.312

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.7643256187438965
Linear Weight Rank: 2286
Intra Cos: 0.30502644181251526
Inter Cos: 0.8442903161048889
Norm Quadratic Average: 220.6937713623047
Nearest Class Center Accuracy: 0.329

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.3355793952941895
Linear Weight Rank: 97
Intra Cos: 0.23532915115356445
Inter Cos: 0.783288836479187
Norm Quadratic Average: 117.54037475585938
Nearest Class Center Accuracy: 0.3407

Output Layer:
Intra Cos: 0.2548103630542755
Inter Cos: 0.809478223323822
Norm Quadratic Average: 101.6248550415039
Nearest Class Center Accuracy: 0.3354

