Model save path: ./New_Models/bn_False_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.0003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477276891469955
Norm Quadratic Average: 27.597177505493164
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018271325156092644
Inter Cos: 0.0755142793059349
Norm Quadratic Average: 41.41184616088867
Nearest Class Center Accuracy: 0.35134

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019398942589759827
Inter Cos: 0.0697559118270874
Norm Quadratic Average: 45.715301513671875
Nearest Class Center Accuracy: 0.49028

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023884819820523262
Inter Cos: 0.05694414675235748
Norm Quadratic Average: 61.033241271972656
Nearest Class Center Accuracy: 0.57078

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02462918497622013
Inter Cos: 0.05313936248421669
Norm Quadratic Average: 40.20574188232422
Nearest Class Center Accuracy: 0.63004

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02763419598340988
Inter Cos: 0.04825538024306297
Norm Quadratic Average: 35.989959716796875
Nearest Class Center Accuracy: 0.67246

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03283529728651047
Inter Cos: 0.04323219507932663
Norm Quadratic Average: 27.140789031982422
Nearest Class Center Accuracy: 0.71454

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.036815986037254333
Inter Cos: 0.04569188505411148
Norm Quadratic Average: 19.97939109802246
Nearest Class Center Accuracy: 0.74466

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06837599724531174
Inter Cos: 0.06936747580766678
Norm Quadratic Average: 8.644933700561523
Nearest Class Center Accuracy: 0.81898

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.14708250761032104
Inter Cos: 0.1047375276684761
Norm Quadratic Average: 5.423190593719482
Nearest Class Center Accuracy: 0.86718

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.28677380084991455
Inter Cos: 0.1815769374370575
Norm Quadratic Average: 3.6903953552246094
Nearest Class Center Accuracy: 0.92078

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.42995133996009827
Inter Cos: 0.20730683207511902
Norm Quadratic Average: 3.101949453353882
Nearest Class Center Accuracy: 0.96028

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6507812142372131
Inter Cos: 0.24443626403808594
Norm Quadratic Average: 2.1384024620056152
Nearest Class Center Accuracy: 0.97912

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8400623202323914
Inter Cos: 0.22805826365947723
Norm Quadratic Average: 2.0519866943359375
Nearest Class Center Accuracy: 0.99256

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8994644284248352
Inter Cos: 0.24549242854118347
Norm Quadratic Average: 2.18255615234375
Nearest Class Center Accuracy: 0.99764

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9233120083808899
Inter Cos: 0.2537071704864502
Norm Quadratic Average: 2.2904372215270996
Nearest Class Center Accuracy: 0.99948

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 38.51638412475586
Linear Weight Rank: 4031
Intra Cos: 0.9462149143218994
Inter Cos: 0.29039373993873596
Norm Quadratic Average: 15.311501502990723
Nearest Class Center Accuracy: 0.99982

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 15.942728996276855
Linear Weight Rank: 3669
Intra Cos: 0.9490514397621155
Inter Cos: 0.2739655077457428
Norm Quadratic Average: 14.961889266967773
Nearest Class Center Accuracy: 0.99996

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 3.394737958908081
Linear Weight Rank: 10
Intra Cos: 0.9423442482948303
Inter Cos: 0.18960720300674438
Norm Quadratic Average: 15.386473655700684
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9515540599822998
Inter Cos: 0.2822423577308655
Norm Quadratic Average: 18.75609588623047
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.8547590807199478
Accuracy: 0.847
NC1 Within Class Collapse: 3.989060878753662
NC2 Equinorm: Features: 0.1974540650844574, Weights: 0.023381352424621582
NC2 Equiangle: Features: 0.23424886067708334, Weights: 0.15118783315022785
NC3 Self-Duality: 0.2135545015335083
NC4 NCC Mismatch: 0.032299999999999995

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526073545217514
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.55013656616211
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01629691570997238
Inter Cos: 0.0750768706202507
Norm Quadratic Average: 41.38089370727539
Nearest Class Center Accuracy: 0.3696

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018138887360692024
Inter Cos: 0.07040870934724808
Norm Quadratic Average: 45.69404983520508
Nearest Class Center Accuracy: 0.5061

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022494681179523468
Inter Cos: 0.057109273970127106
Norm Quadratic Average: 61.03316879272461
Nearest Class Center Accuracy: 0.5827

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022615134716033936
Inter Cos: 0.05349664017558098
Norm Quadratic Average: 40.20917510986328
Nearest Class Center Accuracy: 0.6337

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025379711762070656
Inter Cos: 0.04879986122250557
Norm Quadratic Average: 36.02979278564453
Nearest Class Center Accuracy: 0.6625

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02975625917315483
Inter Cos: 0.043980080634355545
Norm Quadratic Average: 27.15317153930664
Nearest Class Center Accuracy: 0.6957

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.032864101231098175
Inter Cos: 0.04666736349463463
Norm Quadratic Average: 19.966915130615234
Nearest Class Center Accuracy: 0.7134

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.058463502675294876
Inter Cos: 0.07126791775226593
Norm Quadratic Average: 8.615558624267578
Nearest Class Center Accuracy: 0.7545

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.12908241152763367
Inter Cos: 0.10333991050720215
Norm Quadratic Average: 5.379791259765625
Nearest Class Center Accuracy: 0.7651

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2450408637523651
Inter Cos: 0.18765105307102203
Norm Quadratic Average: 3.6471776962280273
Nearest Class Center Accuracy: 0.7887

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.31139376759529114
Inter Cos: 0.2284558117389679
Norm Quadratic Average: 3.0519847869873047
Nearest Class Center Accuracy: 0.8104

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.45418161153793335
Inter Cos: 0.29715418815612793
Norm Quadratic Average: 2.0872902870178223
Nearest Class Center Accuracy: 0.8168

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5346940159797668
Inter Cos: 0.3105619549751282
Norm Quadratic Average: 1.9717979431152344
Nearest Class Center Accuracy: 0.8273

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5391797423362732
Inter Cos: 0.27287814021110535
Norm Quadratic Average: 2.077928304672241
Nearest Class Center Accuracy: 0.8325

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5278998017311096
Inter Cos: 0.24100548028945923
Norm Quadratic Average: 2.1676547527313232
Nearest Class Center Accuracy: 0.8373

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 38.51638412475586
Linear Weight Rank: 4031
Intra Cos: 0.5392913222312927
Inter Cos: 0.1994590163230896
Norm Quadratic Average: 14.43270492553711
Nearest Class Center Accuracy: 0.8395

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 15.942728996276855
Linear Weight Rank: 3669
Intra Cos: 0.5306009650230408
Inter Cos: 0.18426276743412018
Norm Quadratic Average: 14.154854774475098
Nearest Class Center Accuracy: 0.8422

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 3.394737958908081
Linear Weight Rank: 10
Intra Cos: 0.5193715691566467
Inter Cos: 0.21676668524742126
Norm Quadratic Average: 14.664290428161621
Nearest Class Center Accuracy: 0.844

Output Layer:
Intra Cos: 0.5312473177909851
Inter Cos: 0.3227140009403229
Norm Quadratic Average: 17.853069305419922
Nearest Class Center Accuracy: 0.8458

