Model save path: ./New_Models/bn_False_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.01.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597183227539062
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018671823665499687
Inter Cos: 0.08800359070301056
Norm Quadratic Average: 28.779006958007812
Nearest Class Center Accuracy: 0.33622

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02407195419073105
Inter Cos: 0.09612788259983063
Norm Quadratic Average: 23.993284225463867
Nearest Class Center Accuracy: 0.43792

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03647208958864212
Inter Cos: 0.09912994503974915
Norm Quadratic Average: 21.3671932220459
Nearest Class Center Accuracy: 0.52162

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.028052918612957
Inter Cos: 0.07233291119337082
Norm Quadratic Average: 6.996805667877197
Nearest Class Center Accuracy: 0.60724

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04496244341135025
Inter Cos: 0.07249151915311813
Norm Quadratic Average: 2.149427652359009
Nearest Class Center Accuracy: 0.6778

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20545156300067902
Inter Cos: 0.24989569187164307
Norm Quadratic Average: 0.501290500164032
Nearest Class Center Accuracy: 0.84952

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5894504189491272
Inter Cos: 0.5386661887168884
Norm Quadratic Average: 0.41677752137184143
Nearest Class Center Accuracy: 0.87154

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7302866578102112
Inter Cos: 0.7854758501052856
Norm Quadratic Average: 0.43676477670669556
Nearest Class Center Accuracy: 0.85496

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7532381415367126
Inter Cos: 0.948728084564209
Norm Quadratic Average: 0.7121817469596863
Nearest Class Center Accuracy: 0.86586

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7887000441551208
Inter Cos: 0.9644556045532227
Norm Quadratic Average: 1.263936996459961
Nearest Class Center Accuracy: 0.90116

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8397603631019592
Inter Cos: 0.9557934403419495
Norm Quadratic Average: 2.336055040359497
Nearest Class Center Accuracy: 0.9196

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.852329671382904
Inter Cos: 0.9867118000984192
Norm Quadratic Average: 3.152233362197876
Nearest Class Center Accuracy: 0.9041

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9020467400550842
Inter Cos: 0.9873934388160706
Norm Quadratic Average: 5.3994140625
Nearest Class Center Accuracy: 0.89654

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9019966125488281
Inter Cos: 0.9864954948425293
Norm Quadratic Average: 9.252193450927734
Nearest Class Center Accuracy: 0.89702

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8832418322563171
Inter Cos: 0.9672161936759949
Norm Quadratic Average: 14.411155700683594
Nearest Class Center Accuracy: 0.89808

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 1.9509638547897339
Linear Weight Rank: 11
Intra Cos: 0.8471390008926392
Inter Cos: 0.9405074119567871
Norm Quadratic Average: 69.886474609375
Nearest Class Center Accuracy: 0.91524

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 1.974936604499817
Linear Weight Rank: 2552
Intra Cos: 0.8601696491241455
Inter Cos: 0.8774988651275635
Norm Quadratic Average: 46.81849670410156
Nearest Class Center Accuracy: 0.93716

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.9561537504196167
Linear Weight Rank: 9
Intra Cos: 0.8787566423416138
Inter Cos: 0.7252653241157532
Norm Quadratic Average: 26.35455322265625
Nearest Class Center Accuracy: 0.96282

Output Layer:
Intra Cos: 0.9427827000617981
Inter Cos: 0.682697594165802
Norm Quadratic Average: 16.518474578857422
Nearest Class Center Accuracy: 0.9813

Test Set:
Average Loss: 0.8848089172363282
Accuracy: 0.8042
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.33435678482055664, Weights: 0.14023886620998383
NC2 Equiangle: Features: 0.41690919664171006, Weights: 0.1488528887430827
NC3 Self-Duality: 0.6185764074325562
NC4 NCC Mismatch: 0.07930000000000004

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526075407862663
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550134658813477
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01716083101928234
Inter Cos: 0.08851068466901779
Norm Quadratic Average: 28.76345443725586
Nearest Class Center Accuracy: 0.3512

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023439763113856316
Inter Cos: 0.09704285115003586
Norm Quadratic Average: 23.998525619506836
Nearest Class Center Accuracy: 0.4512

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03435533493757248
Inter Cos: 0.09906650334596634
Norm Quadratic Average: 21.389320373535156
Nearest Class Center Accuracy: 0.5288

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026281267404556274
Inter Cos: 0.07234842330217361
Norm Quadratic Average: 7.003443241119385
Nearest Class Center Accuracy: 0.6099

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04211964085698128
Inter Cos: 0.0723448321223259
Norm Quadratic Average: 2.1498985290527344
Nearest Class Center Accuracy: 0.6661

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.18411694467067719
Inter Cos: 0.253231406211853
Norm Quadratic Average: 0.4995001554489136
Nearest Class Center Accuracy: 0.7884

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5183857679367065
Inter Cos: 0.5201811790466309
Norm Quadratic Average: 0.41423481702804565
Nearest Class Center Accuracy: 0.7836

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6316671967506409
Inter Cos: 0.7527864575386047
Norm Quadratic Average: 0.43589919805526733
Nearest Class Center Accuracy: 0.7557

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.627165675163269
Inter Cos: 0.9254082441329956
Norm Quadratic Average: 0.7125330567359924
Nearest Class Center Accuracy: 0.7377

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6653465628623962
Inter Cos: 0.9382944703102112
Norm Quadratic Average: 1.263313889503479
Nearest Class Center Accuracy: 0.75

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7026761174201965
Inter Cos: 0.9231641888618469
Norm Quadratic Average: 2.329453706741333
Nearest Class Center Accuracy: 0.7556

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6783613562583923
Inter Cos: 0.944418728351593
Norm Quadratic Average: 3.128380060195923
Nearest Class Center Accuracy: 0.7444

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7099859118461609
Inter Cos: 0.9465768337249756
Norm Quadratic Average: 5.35689115524292
Nearest Class Center Accuracy: 0.739

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7081459164619446
Inter Cos: 0.9446214437484741
Norm Quadratic Average: 9.178548812866211
Nearest Class Center Accuracy: 0.7402

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7022968530654907
Inter Cos: 0.9320209622383118
Norm Quadratic Average: 14.301963806152344
Nearest Class Center Accuracy: 0.7401

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 1.9509638547897339
Linear Weight Rank: 11
Intra Cos: 0.6389167308807373
Inter Cos: 0.8927565217018127
Norm Quadratic Average: 69.35569763183594
Nearest Class Center Accuracy: 0.7489

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 1.974936604499817
Linear Weight Rank: 2552
Intra Cos: 0.6406904458999634
Inter Cos: 0.813617467880249
Norm Quadratic Average: 46.364322662353516
Nearest Class Center Accuracy: 0.765

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.9561537504196167
Linear Weight Rank: 9
Intra Cos: 0.6541616916656494
Inter Cos: 0.6537967324256897
Norm Quadratic Average: 25.905376434326172
Nearest Class Center Accuracy: 0.7804

Output Layer:
Intra Cos: 0.585020899772644
Inter Cos: 0.5732997059822083
Norm Quadratic Average: 16.112751007080078
Nearest Class Center Accuracy: 0.7914

