Model save path: ./New_Models/bn_False_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.0001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0198909193277359
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597179412841797
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01567377708852291
Inter Cos: 0.06734709441661835
Norm Quadratic Average: 47.05904769897461
Nearest Class Center Accuracy: 0.35952

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017089802771806717
Inter Cos: 0.05816650390625
Norm Quadratic Average: 53.40879821777344
Nearest Class Center Accuracy: 0.49894

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019694853574037552
Inter Cos: 0.05146782845258713
Norm Quadratic Average: 74.40400695800781
Nearest Class Center Accuracy: 0.5746

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023416655138134956
Inter Cos: 0.05173422396183014
Norm Quadratic Average: 54.030364990234375
Nearest Class Center Accuracy: 0.63802

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02790028788149357
Inter Cos: 0.04627709835767746
Norm Quadratic Average: 58.498531341552734
Nearest Class Center Accuracy: 0.67996

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.031736668199300766
Inter Cos: 0.042948681861162186
Norm Quadratic Average: 53.04925537109375
Nearest Class Center Accuracy: 0.71318

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03513966128230095
Inter Cos: 0.04307396337389946
Norm Quadratic Average: 48.60273361206055
Nearest Class Center Accuracy: 0.74282

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06001998484134674
Inter Cos: 0.06125486269593239
Norm Quadratic Average: 25.599761962890625
Nearest Class Center Accuracy: 0.81342

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10816735029220581
Inter Cos: 0.0634366050362587
Norm Quadratic Average: 18.18609619140625
Nearest Class Center Accuracy: 0.85618

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.18518009781837463
Inter Cos: 0.09740107506513596
Norm Quadratic Average: 11.963493347167969
Nearest Class Center Accuracy: 0.89202

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3012681305408478
Inter Cos: 0.14280834794044495
Norm Quadratic Average: 8.912489891052246
Nearest Class Center Accuracy: 0.91896

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5639822483062744
Inter Cos: 0.23510012030601501
Norm Quadratic Average: 5.606204509735107
Nearest Class Center Accuracy: 0.92682

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7868741154670715
Inter Cos: 0.24878256022930145
Norm Quadratic Average: 5.165600299835205
Nearest Class Center Accuracy: 0.95276

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8669465184211731
Inter Cos: 0.18792517483234406
Norm Quadratic Average: 4.911613464355469
Nearest Class Center Accuracy: 0.97286

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9002511501312256
Inter Cos: 0.14934533834457397
Norm Quadratic Average: 4.395158767700195
Nearest Class Center Accuracy: 0.99038

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 73.42546844482422
Linear Weight Rank: 4031
Intra Cos: 0.9300416111946106
Inter Cos: 0.2036214917898178
Norm Quadratic Average: 25.647321701049805
Nearest Class Center Accuracy: 0.99688

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 29.945898056030273
Linear Weight Rank: 3670
Intra Cos: 0.9332507252693176
Inter Cos: 0.17687228322029114
Norm Quadratic Average: 21.65633773803711
Nearest Class Center Accuracy: 0.99806

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 3.9989113807678223
Linear Weight Rank: 10
Intra Cos: 0.9282962679862976
Inter Cos: 0.15402038395404816
Norm Quadratic Average: 19.862911224365234
Nearest Class Center Accuracy: 0.99854

Output Layer:
Intra Cos: 0.9865312576293945
Inter Cos: 0.37868815660476685
Norm Quadratic Average: 24.162927627563477
Nearest Class Center Accuracy: 0.99994

Test Set:
Average Loss: 1.0887703353404998
Accuracy: 0.8387
NC1 Within Class Collapse: 4.893680572509766
NC2 Equinorm: Features: 0.2629866898059845, Weights: 0.025516871362924576
NC2 Equiangle: Features: 0.19539078606499566, Weights: 0.1661552217271593
NC3 Self-Duality: 0.45868149399757385
NC4 NCC Mismatch: 0.07089999999999996

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526077270507812
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550132751464844
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014080686494708061
Inter Cos: 0.06768409162759781
Norm Quadratic Average: 46.99848175048828
Nearest Class Center Accuracy: 0.3784

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015934407711029053
Inter Cos: 0.059070900082588196
Norm Quadratic Average: 53.37017059326172
Nearest Class Center Accuracy: 0.5157

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018448954448103905
Inter Cos: 0.05170997977256775
Norm Quadratic Average: 74.40907287597656
Nearest Class Center Accuracy: 0.589

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021278241649270058
Inter Cos: 0.052327416837215424
Norm Quadratic Average: 54.036251068115234
Nearest Class Center Accuracy: 0.6442

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02490183152258396
Inter Cos: 0.046587273478507996
Norm Quadratic Average: 58.486053466796875
Nearest Class Center Accuracy: 0.6748

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.028140585869550705
Inter Cos: 0.043623246252536774
Norm Quadratic Average: 52.996849060058594
Nearest Class Center Accuracy: 0.6978

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03047039359807968
Inter Cos: 0.04434937238693237
Norm Quadratic Average: 48.51190185546875
Nearest Class Center Accuracy: 0.7129

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.048833999782800674
Inter Cos: 0.06225913017988205
Norm Quadratic Average: 25.442092895507812
Nearest Class Center Accuracy: 0.741

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08607959747314453
Inter Cos: 0.06289023905992508
Norm Quadratic Average: 18.019222259521484
Nearest Class Center Accuracy: 0.7522

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.15228396654129028
Inter Cos: 0.10326480865478516
Norm Quadratic Average: 11.805195808410645
Nearest Class Center Accuracy: 0.7663

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.23603811860084534
Inter Cos: 0.1595201939344406
Norm Quadratic Average: 8.764608383178711
Nearest Class Center Accuracy: 0.7707

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4030609428882599
Inter Cos: 0.2746564745903015
Norm Quadratic Average: 5.484793186187744
Nearest Class Center Accuracy: 0.7642

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5390498638153076
Inter Cos: 0.3130897283554077
Norm Quadratic Average: 4.990976333618164
Nearest Class Center Accuracy: 0.777

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5794308185577393
Inter Cos: 0.2879903316497803
Norm Quadratic Average: 4.7041335105896
Nearest Class Center Accuracy: 0.7884

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5783291459083557
Inter Cos: 0.244169682264328
Norm Quadratic Average: 4.18234920501709
Nearest Class Center Accuracy: 0.8092

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 73.42546844482422
Linear Weight Rank: 4031
Intra Cos: 0.5691680908203125
Inter Cos: 0.22649618983268738
Norm Quadratic Average: 24.258028030395508
Nearest Class Center Accuracy: 0.8187

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 29.945898056030273
Linear Weight Rank: 3670
Intra Cos: 0.5641881823539734
Inter Cos: 0.22829976677894592
Norm Quadratic Average: 20.5533504486084
Nearest Class Center Accuracy: 0.8199

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 3.9989113807678223
Linear Weight Rank: 10
Intra Cos: 0.5827101469039917
Inter Cos: 0.23612159490585327
Norm Quadratic Average: 18.977588653564453
Nearest Class Center Accuracy: 0.8215

Output Layer:
Intra Cos: 0.6229965090751648
Inter Cos: 0.39744025468826294
Norm Quadratic Average: 22.70340919494629
Nearest Class Center Accuracy: 0.8323

