Model save path: ./New_Models/bn_False_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.0001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597183227539062
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018101802095770836
Inter Cos: 0.06903223693370819
Norm Quadratic Average: 47.04419708251953
Nearest Class Center Accuracy: 0.35158

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018269820138812065
Inter Cos: 0.05933484435081482
Norm Quadratic Average: 53.572113037109375
Nearest Class Center Accuracy: 0.4918

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018933983519673347
Inter Cos: 0.048201147466897964
Norm Quadratic Average: 78.3189926147461
Nearest Class Center Accuracy: 0.5685

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022542724385857582
Inter Cos: 0.04875745251774788
Norm Quadratic Average: 56.55852127075195
Nearest Class Center Accuracy: 0.6305

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025753607973456383
Inter Cos: 0.04332961142063141
Norm Quadratic Average: 57.9749870300293
Nearest Class Center Accuracy: 0.67758

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03068385273218155
Inter Cos: 0.03986497223377228
Norm Quadratic Average: 51.06990432739258
Nearest Class Center Accuracy: 0.71848

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.039470281451940536
Inter Cos: 0.04262129217386246
Norm Quadratic Average: 46.767555236816406
Nearest Class Center Accuracy: 0.7465

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06757955998182297
Inter Cos: 0.06264383345842361
Norm Quadratic Average: 24.27495765686035
Nearest Class Center Accuracy: 0.8158

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.12680357694625854
Inter Cos: 0.09771035611629486
Norm Quadratic Average: 17.738603591918945
Nearest Class Center Accuracy: 0.85002

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2015305608510971
Inter Cos: 0.15060865879058838
Norm Quadratic Average: 11.97148323059082
Nearest Class Center Accuracy: 0.88506

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.31312933564186096
Inter Cos: 0.18643394112586975
Norm Quadratic Average: 9.199864387512207
Nearest Class Center Accuracy: 0.91262

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5482137799263
Inter Cos: 0.28674837946891785
Norm Quadratic Average: 5.919200897216797
Nearest Class Center Accuracy: 0.9244

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7931662797927856
Inter Cos: 0.3172438144683838
Norm Quadratic Average: 5.507330894470215
Nearest Class Center Accuracy: 0.94746

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8731050491333008
Inter Cos: 0.29388904571533203
Norm Quadratic Average: 5.2829694747924805
Nearest Class Center Accuracy: 0.96368

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9033076763153076
Inter Cos: 0.244144469499588
Norm Quadratic Average: 4.769124507904053
Nearest Class Center Accuracy: 0.9819

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 73.42788696289062
Linear Weight Rank: 4031
Intra Cos: 0.9377966523170471
Inter Cos: 0.23607578873634338
Norm Quadratic Average: 27.000587463378906
Nearest Class Center Accuracy: 0.99292

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 29.953752517700195
Linear Weight Rank: 3670
Intra Cos: 0.9377804398536682
Inter Cos: 0.21413028240203857
Norm Quadratic Average: 22.50071907043457
Nearest Class Center Accuracy: 0.99568

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 4.010662078857422
Linear Weight Rank: 10
Intra Cos: 0.9274877309799194
Inter Cos: 0.12214256078004837
Norm Quadratic Average: 20.41316032409668
Nearest Class Center Accuracy: 0.99674

Output Layer:
Intra Cos: 0.9801989197731018
Inter Cos: 0.3431747555732727
Norm Quadratic Average: 24.93359375
Nearest Class Center Accuracy: 0.9994

Test Set:
Average Loss: 1.1156154811859131
Accuracy: 0.8348
NC1 Within Class Collapse: 5.2195258140563965
NC2 Equinorm: Features: 0.2954685389995575, Weights: 0.019576065242290497
NC2 Equiangle: Features: 0.20062327914767794, Weights: 0.16731377707587347
NC3 Self-Duality: 0.48245513439178467
NC4 NCC Mismatch: 0.07779999999999998

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526075407862663
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550134658813477
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01634780503809452
Inter Cos: 0.06866051256656647
Norm Quadratic Average: 46.9998664855957
Nearest Class Center Accuracy: 0.3709

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01770971342921257
Inter Cos: 0.06003860756754875
Norm Quadratic Average: 53.52452087402344
Nearest Class Center Accuracy: 0.505

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018148673698306084
Inter Cos: 0.04852898418903351
Norm Quadratic Average: 78.26727294921875
Nearest Class Center Accuracy: 0.5803

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020627733319997787
Inter Cos: 0.049581386148929596
Norm Quadratic Average: 56.52318572998047
Nearest Class Center Accuracy: 0.6326

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02355426736176014
Inter Cos: 0.044104475528001785
Norm Quadratic Average: 57.95528793334961
Nearest Class Center Accuracy: 0.6707

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.027833014726638794
Inter Cos: 0.04072706401348114
Norm Quadratic Average: 51.02589416503906
Nearest Class Center Accuracy: 0.6948

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03542786464095116
Inter Cos: 0.044330254197120667
Norm Quadratic Average: 46.683502197265625
Nearest Class Center Accuracy: 0.7109

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05737088620662689
Inter Cos: 0.06439359486103058
Norm Quadratic Average: 24.165252685546875
Nearest Class Center Accuracy: 0.7412

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.11174938082695007
Inter Cos: 0.10208819061517715
Norm Quadratic Average: 17.57069969177246
Nearest Class Center Accuracy: 0.7451

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.17098362743854523
Inter Cos: 0.15240290760993958
Norm Quadratic Average: 11.78508472442627
Nearest Class Center Accuracy: 0.7569

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2563595771789551
Inter Cos: 0.19321858882904053
Norm Quadratic Average: 9.004481315612793
Nearest Class Center Accuracy: 0.7682

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.42469170689582825
Inter Cos: 0.32408392429351807
Norm Quadratic Average: 5.743732452392578
Nearest Class Center Accuracy: 0.7664

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5469580888748169
Inter Cos: 0.37605154514312744
Norm Quadratic Average: 5.290128707885742
Nearest Class Center Accuracy: 0.7708

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5738572478294373
Inter Cos: 0.3502671420574188
Norm Quadratic Average: 5.041540622711182
Nearest Class Center Accuracy: 0.782

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5821109414100647
Inter Cos: 0.2915852665901184
Norm Quadratic Average: 4.529129505157471
Nearest Class Center Accuracy: 0.7972

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 73.42788696289062
Linear Weight Rank: 4031
Intra Cos: 0.5685855746269226
Inter Cos: 0.21893128752708435
Norm Quadratic Average: 25.458829879760742
Nearest Class Center Accuracy: 0.8087

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 29.953752517700195
Linear Weight Rank: 3670
Intra Cos: 0.558465838432312
Inter Cos: 0.20969536900520325
Norm Quadratic Average: 21.296483993530273
Nearest Class Center Accuracy: 0.8077

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 4.010662078857422
Linear Weight Rank: 10
Intra Cos: 0.5631189942359924
Inter Cos: 0.2506415545940399
Norm Quadratic Average: 19.447805404663086
Nearest Class Center Accuracy: 0.81

Output Layer:
Intra Cos: 0.5877776741981506
Inter Cos: 0.433065265417099
Norm Quadratic Average: 23.381404876708984
Nearest Class Center Accuracy: 0.8222

