Model save path: ./New_Models/bn_False_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597183227539062
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018988987430930138
Inter Cos: 0.08614905923604965
Norm Quadratic Average: 33.30699920654297
Nearest Class Center Accuracy: 0.34556

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02191184274852276
Inter Cos: 0.08638918399810791
Norm Quadratic Average: 34.3956413269043
Nearest Class Center Accuracy: 0.461

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025425663217902184
Inter Cos: 0.08228345215320587
Norm Quadratic Average: 48.370147705078125
Nearest Class Center Accuracy: 0.53206

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02711942233145237
Inter Cos: 0.07987380027770996
Norm Quadratic Average: 35.45067596435547
Nearest Class Center Accuracy: 0.58864

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03256423398852348
Inter Cos: 0.0759139358997345
Norm Quadratic Average: 34.48271942138672
Nearest Class Center Accuracy: 0.63024

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03582917898893356
Inter Cos: 0.06597858667373657
Norm Quadratic Average: 27.544893264770508
Nearest Class Center Accuracy: 0.66248

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03477565199136734
Inter Cos: 0.04732266440987587
Norm Quadratic Average: 18.267412185668945
Nearest Class Center Accuracy: 0.69746

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05635210871696472
Inter Cos: 0.07505320757627487
Norm Quadratic Average: 6.795012950897217
Nearest Class Center Accuracy: 0.78132

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1522780805826187
Inter Cos: 0.1646493673324585
Norm Quadratic Average: 3.927830696105957
Nearest Class Center Accuracy: 0.8539

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.37645915150642395
Inter Cos: 0.2824292778968811
Norm Quadratic Average: 2.5259506702423096
Nearest Class Center Accuracy: 0.9287

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.46823444962501526
Inter Cos: 0.2974902391433716
Norm Quadratic Average: 2.267575740814209
Nearest Class Center Accuracy: 0.95696

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5695117115974426
Inter Cos: 0.34751683473587036
Norm Quadratic Average: 1.566107153892517
Nearest Class Center Accuracy: 0.98476

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7690162062644958
Inter Cos: 0.3662987947463989
Norm Quadratic Average: 1.6574658155441284
Nearest Class Center Accuracy: 0.99666

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8266303539276123
Inter Cos: 0.270765483379364
Norm Quadratic Average: 2.169595718383789
Nearest Class Center Accuracy: 0.99948

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8247860074043274
Inter Cos: 0.23891191184520721
Norm Quadratic Average: 2.8044512271881104
Nearest Class Center Accuracy: 0.99986

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 4.863166809082031
Linear Weight Rank: 4029
Intra Cos: 0.8498890399932861
Inter Cos: 0.1593886762857437
Norm Quadratic Average: 17.703174591064453
Nearest Class Center Accuracy: 0.99996

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.437486171722412
Linear Weight Rank: 3648
Intra Cos: 0.8718314170837402
Inter Cos: 0.17337384819984436
Norm Quadratic Average: 17.861268997192383
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.850498676300049
Linear Weight Rank: 9
Intra Cos: 0.864324152469635
Inter Cos: 0.1746750921010971
Norm Quadratic Average: 17.87594985961914
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.8563896417617798
Inter Cos: 0.2262776494026184
Norm Quadratic Average: 19.99129295349121
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.9029936708450318
Accuracy: 0.8307
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.17008467018604279, Weights: 0.029131725430488586
NC2 Equiangle: Features: 0.26058294508192276, Weights: 0.1680623902214898
NC3 Self-Duality: 0.12977467477321625
NC4 NCC Mismatch: 0.033499999999999974

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526075407862663
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550134658813477
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017007431015372276
Inter Cos: 0.08633168041706085
Norm Quadratic Average: 33.26579284667969
Nearest Class Center Accuracy: 0.3606

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020688721910119057
Inter Cos: 0.08721771836280823
Norm Quadratic Average: 34.36973190307617
Nearest Class Center Accuracy: 0.4762

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02350643277168274
Inter Cos: 0.0833461731672287
Norm Quadratic Average: 48.35234069824219
Nearest Class Center Accuracy: 0.5403

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025077015161514282
Inter Cos: 0.0811050608754158
Norm Quadratic Average: 35.46919631958008
Nearest Class Center Accuracy: 0.5951

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.030223524197936058
Inter Cos: 0.07673784345388412
Norm Quadratic Average: 34.53519058227539
Nearest Class Center Accuracy: 0.628

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.033028554171323776
Inter Cos: 0.0664665624499321
Norm Quadratic Average: 27.590669631958008
Nearest Class Center Accuracy: 0.6552

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03177541494369507
Inter Cos: 0.04778179153800011
Norm Quadratic Average: 18.28725814819336
Nearest Class Center Accuracy: 0.6868

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04930754378437996
Inter Cos: 0.0759144276380539
Norm Quadratic Average: 6.791045188903809
Nearest Class Center Accuracy: 0.7398

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.13004916906356812
Inter Cos: 0.16512037813663483
Norm Quadratic Average: 3.9126546382904053
Nearest Class Center Accuracy: 0.7777

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.30132532119750977
Inter Cos: 0.2828103005886078
Norm Quadratic Average: 2.5049796104431152
Nearest Class Center Accuracy: 0.8101

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.35974305868148804
Inter Cos: 0.2899360954761505
Norm Quadratic Average: 2.2405378818511963
Nearest Class Center Accuracy: 0.8186

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.44429871439933777
Inter Cos: 0.3502098619937897
Norm Quadratic Average: 1.5387998819351196
Nearest Class Center Accuracy: 0.8216

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5647167563438416
Inter Cos: 0.430960088968277
Norm Quadratic Average: 1.6139062643051147
Nearest Class Center Accuracy: 0.8243

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5408351421356201
Inter Cos: 0.3896048069000244
Norm Quadratic Average: 2.1012377738952637
Nearest Class Center Accuracy: 0.8266

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5100967884063721
Inter Cos: 0.351808100938797
Norm Quadratic Average: 2.7079615592956543
Nearest Class Center Accuracy: 0.8259

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 4.863166809082031
Linear Weight Rank: 4029
Intra Cos: 0.5265811085700989
Inter Cos: 0.32517722249031067
Norm Quadratic Average: 17.06863784790039
Nearest Class Center Accuracy: 0.826

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.437486171722412
Linear Weight Rank: 3648
Intra Cos: 0.5166788697242737
Inter Cos: 0.30138474702835083
Norm Quadratic Average: 17.19889259338379
Nearest Class Center Accuracy: 0.8255

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.850498676300049
Linear Weight Rank: 9
Intra Cos: 0.4952011704444885
Inter Cos: 0.28551873564720154
Norm Quadratic Average: 17.243799209594727
Nearest Class Center Accuracy: 0.8266

Output Layer:
Intra Cos: 0.4829721748828888
Inter Cos: 0.3104892671108246
Norm Quadratic Average: 19.276927947998047
Nearest Class Center Accuracy: 0.8266

