Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.01.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893192246556282
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326313018798828
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013729586265981197
Inter Cos: 0.03013211488723755
Norm Quadratic Average: 8.718475341796875
Nearest Class Center Accuracy: 0.03936

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01820322684943676
Inter Cos: 0.036923691630363464
Norm Quadratic Average: 6.443610191345215
Nearest Class Center Accuracy: 0.0566

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013918607495725155
Inter Cos: 0.030692214146256447
Norm Quadratic Average: 4.767521858215332
Nearest Class Center Accuracy: 0.06366

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020863959565758705
Inter Cos: 0.020241783931851387
Norm Quadratic Average: 3.5287883281707764
Nearest Class Center Accuracy: 0.0716

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022777125239372253
Inter Cos: 0.01970277726650238
Norm Quadratic Average: 2.700761079788208
Nearest Class Center Accuracy: 0.07536

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02481725998222828
Inter Cos: 0.021356843411922455
Norm Quadratic Average: 2.5381548404693604
Nearest Class Center Accuracy: 0.07778

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022273238748311996
Inter Cos: 0.018170861527323723
Norm Quadratic Average: 2.473257541656494
Nearest Class Center Accuracy: 0.08066

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03298291936516762
Inter Cos: 0.028576970100402832
Norm Quadratic Average: 1.8522497415542603
Nearest Class Center Accuracy: 0.08774

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04115293547511101
Inter Cos: 0.03300551697611809
Norm Quadratic Average: 1.2469909191131592
Nearest Class Center Accuracy: 0.0923

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0831054151058197
Inter Cos: 0.051053423434495926
Norm Quadratic Average: 0.9684664607048035
Nearest Class Center Accuracy: 0.09598

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.21871069073677063
Inter Cos: 0.09196454286575317
Norm Quadratic Average: 0.7666087746620178
Nearest Class Center Accuracy: 0.0974

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5884108543395996
Inter Cos: 0.18321222066879272
Norm Quadratic Average: 0.5693427324295044
Nearest Class Center Accuracy: 0.0982

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8845919370651245
Inter Cos: 0.3344267010688782
Norm Quadratic Average: 0.43462660908699036
Nearest Class Center Accuracy: 0.1

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.936120331287384
Inter Cos: 0.3353244364261627
Norm Quadratic Average: 0.5069975852966309
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9773041605949402
Inter Cos: 0.3863537907600403
Norm Quadratic Average: 1.151318907737732
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.6493844985961914
Linear Weight Rank: 148
Intra Cos: 0.9884536266326904
Inter Cos: 0.43989479541778564
Norm Quadratic Average: 35.46675491333008
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.6743228435516357
Linear Weight Rank: 1556
Intra Cos: 0.9904038906097412
Inter Cos: 0.47673508524894714
Norm Quadratic Average: 33.35182571411133
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 3.7899065017700195
Linear Weight Rank: 97
Intra Cos: 0.990592360496521
Inter Cos: 0.4735775589942932
Norm Quadratic Average: 33.575035095214844
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.991937518119812
Inter Cos: 0.4978557825088501
Norm Quadratic Average: 36.616432189941406
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 1.8516944193840026
Accuracy: 0.6245
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.1519337147474289, Weights: 0.01850747875869274
NC2 Equiangle: Features: 0.2526764964094066, Weights: 0.21753339054608586
NC3 Self-Duality: 0.13532432913780212
NC4 NCC Mismatch: 0.06830000000000003

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422183990478516
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.007029884494841099
Inter Cos: 0.19110502302646637
Norm Quadratic Average: 8.776650428771973
Nearest Class Center Accuracy: 0.2231

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010393916629254818
Inter Cos: 0.2568894624710083
Norm Quadratic Average: 6.486366271972656
Nearest Class Center Accuracy: 0.358

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.008967551402747631
Inter Cos: 0.14231859147548676
Norm Quadratic Average: 4.788350582122803
Nearest Class Center Accuracy: 0.4869

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013832096941769123
Inter Cos: 0.19760873913764954
Norm Quadratic Average: 3.5421409606933594
Nearest Class Center Accuracy: 0.5364

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015682149678468704
Inter Cos: 0.17774663865566254
Norm Quadratic Average: 2.7093045711517334
Nearest Class Center Accuracy: 0.5741

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016170073300600052
Inter Cos: 0.14731766283512115
Norm Quadratic Average: 2.541701555252075
Nearest Class Center Accuracy: 0.5951

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013501991517841816
Inter Cos: 0.11794457584619522
Norm Quadratic Average: 2.4723892211914062
Nearest Class Center Accuracy: 0.6305

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016981296241283417
Inter Cos: 0.15266844630241394
Norm Quadratic Average: 1.8471683263778687
Nearest Class Center Accuracy: 0.6617

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018357980996370316
Inter Cos: 0.16503052413463593
Norm Quadratic Average: 1.2296792268753052
Nearest Class Center Accuracy: 0.6818

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026514898985624313
Inter Cos: 0.21282219886779785
Norm Quadratic Average: 0.9242939949035645
Nearest Class Center Accuracy: 0.6568

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05320104584097862
Inter Cos: 0.31227922439575195
Norm Quadratic Average: 0.6890235543251038
Nearest Class Center Accuracy: 0.6095

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.21627816557884216
Inter Cos: 0.4174528419971466
Norm Quadratic Average: 0.4723351001739502
Nearest Class Center Accuracy: 0.5484

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.28461790084838867
Inter Cos: 0.4608515202999115
Norm Quadratic Average: 0.34404298663139343
Nearest Class Center Accuracy: 0.5943

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2820342779159546
Inter Cos: 0.5191956162452698
Norm Quadratic Average: 0.4268648326396942
Nearest Class Center Accuracy: 0.6215

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2976298928260803
Inter Cos: 0.5659511089324951
Norm Quadratic Average: 1.022310733795166
Nearest Class Center Accuracy: 0.6263

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.6493844985961914
Linear Weight Rank: 148
Intra Cos: 0.3174452483654022
Inter Cos: 0.6135773062705994
Norm Quadratic Average: 31.999574661254883
Nearest Class Center Accuracy: 0.6267

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.6743228435516357
Linear Weight Rank: 1556
Intra Cos: 0.32887426018714905
Inter Cos: 0.6316381096839905
Norm Quadratic Average: 30.42423439025879
Nearest Class Center Accuracy: 0.6273

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 3.7899065017700195
Linear Weight Rank: 97
Intra Cos: 0.3251565098762512
Inter Cos: 0.6270254850387573
Norm Quadratic Average: 30.94896697998047
Nearest Class Center Accuracy: 0.6267

Output Layer:
Intra Cos: 0.3272313177585602
Inter Cos: 0.6371638774871826
Norm Quadratic Average: 33.84841537475586
Nearest Class Center Accuracy: 0.6263

