Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.0005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477276891469955
Norm Quadratic Average: 27.597177505493164
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01138345804065466
Inter Cos: 0.05652233585715294
Norm Quadratic Average: 34.566490173339844
Nearest Class Center Accuracy: 0.3451

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016640817746520042
Inter Cos: 0.06233925372362137
Norm Quadratic Average: 21.44745445251465
Nearest Class Center Accuracy: 0.475

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01280885748565197
Inter Cos: 0.04962580278515816
Norm Quadratic Average: 18.523651123046875
Nearest Class Center Accuracy: 0.53776

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01633811928331852
Inter Cos: 0.04800399765372276
Norm Quadratic Average: 12.252274513244629
Nearest Class Center Accuracy: 0.6136

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016490556299686432
Inter Cos: 0.04121524095535278
Norm Quadratic Average: 10.958539009094238
Nearest Class Center Accuracy: 0.66576

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017271485179662704
Inter Cos: 0.03405086323618889
Norm Quadratic Average: 10.483030319213867
Nearest Class Center Accuracy: 0.71274

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018649768084287643
Inter Cos: 0.030452456325292587
Norm Quadratic Average: 10.579219818115234
Nearest Class Center Accuracy: 0.76068

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03964589536190033
Inter Cos: 0.04537705332040787
Norm Quadratic Average: 7.176092624664307
Nearest Class Center Accuracy: 0.86162

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09459823369979858
Inter Cos: 0.059487394988536835
Norm Quadratic Average: 8.394057273864746
Nearest Class Center Accuracy: 0.93036

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.18935781717300415
Inter Cos: 0.09344043582677841
Norm Quadratic Average: 9.386114120483398
Nearest Class Center Accuracy: 0.96156

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3025091588497162
Inter Cos: 0.11439863592386246
Norm Quadratic Average: 9.989529609680176
Nearest Class Center Accuracy: 0.97982

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5696391463279724
Inter Cos: 0.1804286539554596
Norm Quadratic Average: 8.674758911132812
Nearest Class Center Accuracy: 0.98598

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8477874398231506
Inter Cos: 0.11368116736412048
Norm Quadratic Average: 5.877249240875244
Nearest Class Center Accuracy: 0.99684

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9095675349235535
Inter Cos: 0.025430113077163696
Norm Quadratic Average: 6.016201019287109
Nearest Class Center Accuracy: 0.99932

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9134507179260254
Inter Cos: -0.03765062242746353
Norm Quadratic Average: 5.882760524749756
Nearest Class Center Accuracy: 1.0

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 20.256147384643555
Linear Weight Rank: 4031
Intra Cos: 0.9545912742614746
Inter Cos: -0.027218453586101532
Norm Quadratic Average: 45.98047637939453
Nearest Class Center Accuracy: 1.0

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 8.753255844116211
Linear Weight Rank: 3666
Intra Cos: 0.9826396107673645
Inter Cos: -0.011440582573413849
Norm Quadratic Average: 27.064178466796875
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.5635697841644287
Linear Weight Rank: 10
Intra Cos: 0.9754029512405396
Inter Cos: -0.0016993184108287096
Norm Quadratic Average: 17.32421875
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9947032928466797
Inter Cos: 0.15166640281677246
Norm Quadratic Average: 13.480965614318848
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.8012231244802475
Accuracy: 0.864
NC1 Within Class Collapse: 3.0112056732177734
NC2 Equinorm: Features: 0.13764511048793793, Weights: 0.027145639061927795
NC2 Equiangle: Features: 0.07741388214959039, Weights: 0.06681834326850043
NC3 Self-Duality: 0.21882958710193634
NC4 NCC Mismatch: 0.017100000000000004

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526073545217514
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.55013656616211
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010047725401818752
Inter Cos: 0.05755537748336792
Norm Quadratic Average: 34.532562255859375
Nearest Class Center Accuracy: 0.3634

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015513899736106396
Inter Cos: 0.06356566399335861
Norm Quadratic Average: 21.431121826171875
Nearest Class Center Accuracy: 0.4896

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012017869390547276
Inter Cos: 0.0503380224108696
Norm Quadratic Average: 18.521095275878906
Nearest Class Center Accuracy: 0.5532

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015238561667501926
Inter Cos: 0.04846007376909256
Norm Quadratic Average: 12.252273559570312
Nearest Class Center Accuracy: 0.6212

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015131155960261822
Inter Cos: 0.04146060720086098
Norm Quadratic Average: 10.960495948791504
Nearest Class Center Accuracy: 0.6626

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01564157009124756
Inter Cos: 0.0344986617565155
Norm Quadratic Average: 10.47546672821045
Nearest Class Center Accuracy: 0.7002

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01639663800597191
Inter Cos: 0.03120652586221695
Norm Quadratic Average: 10.559179306030273
Nearest Class Center Accuracy: 0.7335

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03162569925189018
Inter Cos: 0.04826383665204048
Norm Quadratic Average: 7.147121906280518
Nearest Class Center Accuracy: 0.7844

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07183493673801422
Inter Cos: 0.06623832136392593
Norm Quadratic Average: 8.308527946472168
Nearest Class Center Accuracy: 0.8126

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.14871735870838165
Inter Cos: 0.10168440639972687
Norm Quadratic Average: 9.216864585876465
Nearest Class Center Accuracy: 0.8218

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.22381140291690826
Inter Cos: 0.13853222131729126
Norm Quadratic Average: 9.736950874328613
Nearest Class Center Accuracy: 0.8331

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4309106171131134
Inter Cos: 0.2630695700645447
Norm Quadratic Average: 8.381330490112305
Nearest Class Center Accuracy: 0.8266

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.578231155872345
Inter Cos: 0.2956225574016571
Norm Quadratic Average: 5.5644989013671875
Nearest Class Center Accuracy: 0.8387

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5850651860237122
Inter Cos: 0.23295730352401733
Norm Quadratic Average: 5.622380256652832
Nearest Class Center Accuracy: 0.85

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5481730103492737
Inter Cos: 0.14465081691741943
Norm Quadratic Average: 5.440587997436523
Nearest Class Center Accuracy: 0.8598

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 20.256147384643555
Linear Weight Rank: 4031
Intra Cos: 0.564276397228241
Inter Cos: 0.12681175768375397
Norm Quadratic Average: 42.11831283569336
Nearest Class Center Accuracy: 0.8619

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 8.753255844116211
Linear Weight Rank: 3666
Intra Cos: 0.5372714400291443
Inter Cos: 0.1011507511138916
Norm Quadratic Average: 24.852571487426758
Nearest Class Center Accuracy: 0.8635

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.5635697841644287
Linear Weight Rank: 10
Intra Cos: 0.527704119682312
Inter Cos: 0.13245339691638947
Norm Quadratic Average: 16.16014862060547
Nearest Class Center Accuracy: 0.8634

Output Layer:
Intra Cos: 0.5858587622642517
Inter Cos: 0.24683456122875214
Norm Quadratic Average: 12.369392395019531
Nearest Class Center Accuracy: 0.8638

