Model save path: ./New_Models/bn_False_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0198909193277359
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597179412841797
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019515030086040497
Inter Cos: 0.08452778309583664
Norm Quadratic Average: 32.652488708496094
Nearest Class Center Accuracy: 0.34924

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023512031883001328
Inter Cos: 0.08870765566825867
Norm Quadratic Average: 32.53672790527344
Nearest Class Center Accuracy: 0.46032

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026944849640130997
Inter Cos: 0.0882597416639328
Norm Quadratic Average: 44.09593963623047
Nearest Class Center Accuracy: 0.5281

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.031450752168893814
Inter Cos: 0.08985421806573868
Norm Quadratic Average: 33.439029693603516
Nearest Class Center Accuracy: 0.5848

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03725385665893555
Inter Cos: 0.08691467344760895
Norm Quadratic Average: 36.74179458618164
Nearest Class Center Accuracy: 0.6247

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03545358404517174
Inter Cos: 0.07318544387817383
Norm Quadratic Average: 34.49717712402344
Nearest Class Center Accuracy: 0.65422

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.028972741216421127
Inter Cos: 0.051041245460510254
Norm Quadratic Average: 24.36400032043457
Nearest Class Center Accuracy: 0.68228

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04472056031227112
Inter Cos: 0.06326112896203995
Norm Quadratic Average: 8.649025917053223
Nearest Class Center Accuracy: 0.76848

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1174815446138382
Inter Cos: 0.12579761445522308
Norm Quadratic Average: 4.369522571563721
Nearest Class Center Accuracy: 0.84186

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.33577588200569153
Inter Cos: 0.2692640721797943
Norm Quadratic Average: 2.5195810794830322
Nearest Class Center Accuracy: 0.922

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4539477229118347
Inter Cos: 0.309988409280777
Norm Quadratic Average: 2.046917676925659
Nearest Class Center Accuracy: 0.95958

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5984811186790466
Inter Cos: 0.3030785024166107
Norm Quadratic Average: 1.2389854192733765
Nearest Class Center Accuracy: 0.99346

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8134739398956299
Inter Cos: 0.26648348569869995
Norm Quadratic Average: 1.270728588104248
Nearest Class Center Accuracy: 0.99934

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8503180742263794
Inter Cos: 0.2080746740102768
Norm Quadratic Average: 1.7805637121200562
Nearest Class Center Accuracy: 0.99998

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8496435284614563
Inter Cos: 0.20926135778427124
Norm Quadratic Average: 2.454911947250366
Nearest Class Center Accuracy: 1.0

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 4.843845367431641
Linear Weight Rank: 4029
Intra Cos: 0.8625144362449646
Inter Cos: 0.19750528037548065
Norm Quadratic Average: 16.364965438842773
Nearest Class Center Accuracy: 1.0

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.4337430000305176
Linear Weight Rank: 3647
Intra Cos: 0.8793869614601135
Inter Cos: 0.20392480492591858
Norm Quadratic Average: 17.279178619384766
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.83111572265625
Linear Weight Rank: 9
Intra Cos: 0.8762751817703247
Inter Cos: 0.20294363796710968
Norm Quadratic Average: 17.74671173095703
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.8855952024459839
Inter Cos: 0.2834305763244629
Norm Quadratic Average: 20.283306121826172
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.9324249375343323
Accuracy: 0.8261
NC1 Within Class Collapse: 5.3654985427856445
NC2 Equinorm: Features: 0.14498722553253174, Weights: 0.03670762479305267
NC2 Equiangle: Features: 0.2561737060546875, Weights: 0.1680796093410916
NC3 Self-Duality: 0.1304250806570053
NC4 NCC Mismatch: 0.031299999999999994

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526077270507812
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550132751464844
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017299512401223183
Inter Cos: 0.0846271961927414
Norm Quadratic Average: 32.620235443115234
Nearest Class Center Accuracy: 0.3668

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02247127704322338
Inter Cos: 0.08914019167423248
Norm Quadratic Average: 32.53141403198242
Nearest Class Center Accuracy: 0.4765

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025090470910072327
Inter Cos: 0.08866482228040695
Norm Quadratic Average: 44.10982894897461
Nearest Class Center Accuracy: 0.5389

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.028808509930968285
Inter Cos: 0.09035718441009521
Norm Quadratic Average: 33.4669189453125
Nearest Class Center Accuracy: 0.5902

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03429538384079933
Inter Cos: 0.08709469437599182
Norm Quadratic Average: 36.78382873535156
Nearest Class Center Accuracy: 0.6225

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.032612137496471405
Inter Cos: 0.07357257604598999
Norm Quadratic Average: 34.53314971923828
Nearest Class Center Accuracy: 0.654

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026158742606639862
Inter Cos: 0.05162204056978226
Norm Quadratic Average: 24.384790420532227
Nearest Class Center Accuracy: 0.6749

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03810176998376846
Inter Cos: 0.06456569582223892
Norm Quadratic Average: 8.6445951461792
Nearest Class Center Accuracy: 0.737

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1054014042019844
Inter Cos: 0.12774361670017242
Norm Quadratic Average: 4.353273868560791
Nearest Class Center Accuracy: 0.771

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.289896160364151
Inter Cos: 0.26935842633247375
Norm Quadratic Average: 2.49995493888855
Nearest Class Center Accuracy: 0.8059

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3674577474594116
Inter Cos: 0.29902005195617676
Norm Quadratic Average: 2.022675037384033
Nearest Class Center Accuracy: 0.8201

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4306875169277191
Inter Cos: 0.3193943500518799
Norm Quadratic Average: 1.2144899368286133
Nearest Class Center Accuracy: 0.8253

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5547357201576233
Inter Cos: 0.3655482530593872
Norm Quadratic Average: 1.2282991409301758
Nearest Class Center Accuracy: 0.8236

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.530960202217102
Inter Cos: 0.3339231610298157
Norm Quadratic Average: 1.7126705646514893
Nearest Class Center Accuracy: 0.8249

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5096281170845032
Inter Cos: 0.31414762139320374
Norm Quadratic Average: 2.356375217437744
Nearest Class Center Accuracy: 0.8267

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 4.843845367431641
Linear Weight Rank: 4029
Intra Cos: 0.5170523524284363
Inter Cos: 0.2933425009250641
Norm Quadratic Average: 15.709895133972168
Nearest Class Center Accuracy: 0.8254

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.4337430000305176
Linear Weight Rank: 3647
Intra Cos: 0.5170279741287231
Inter Cos: 0.2778901755809784
Norm Quadratic Average: 16.59560203552246
Nearest Class Center Accuracy: 0.8257

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.83111572265625
Linear Weight Rank: 9
Intra Cos: 0.5025232434272766
Inter Cos: 0.2667469382286072
Norm Quadratic Average: 17.097686767578125
Nearest Class Center Accuracy: 0.8263

Output Layer:
Intra Cos: 0.5091593861579895
Inter Cos: 0.3014029860496521
Norm Quadratic Average: 19.526113510131836
Nearest Class Center Accuracy: 0.8243

