Model save path: ./New_Models/bn_False_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.01.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0198909193277359
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597179412841797
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019191443920135498
Inter Cos: 0.08801927417516708
Norm Quadratic Average: 29.416866302490234
Nearest Class Center Accuracy: 0.3382

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02279982529580593
Inter Cos: 0.09118589013814926
Norm Quadratic Average: 24.422203063964844
Nearest Class Center Accuracy: 0.444

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03214775770902634
Inter Cos: 0.08816780149936676
Norm Quadratic Average: 21.461334228515625
Nearest Class Center Accuracy: 0.52728

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025765608996152878
Inter Cos: 0.06684326380491257
Norm Quadratic Average: 7.097794055938721
Nearest Class Center Accuracy: 0.60842

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04406287521123886
Inter Cos: 0.06993459165096283
Norm Quadratic Average: 2.1717848777770996
Nearest Class Center Accuracy: 0.68142

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2180221527814865
Inter Cos: 0.22419984638690948
Norm Quadratic Average: 0.49824362993240356
Nearest Class Center Accuracy: 0.86178

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5215541124343872
Inter Cos: 0.543083131313324
Norm Quadratic Average: 0.3968738317489624
Nearest Class Center Accuracy: 0.88934

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6326651573181152
Inter Cos: 0.7073814868927002
Norm Quadratic Average: 0.3655787408351898
Nearest Class Center Accuracy: 0.89308

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5539382100105286
Inter Cos: 0.765434205532074
Norm Quadratic Average: 0.3619838058948517
Nearest Class Center Accuracy: 0.94078

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.531009316444397
Inter Cos: 0.944060742855072
Norm Quadratic Average: 0.6725447773933411
Nearest Class Center Accuracy: 0.94144

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7778946161270142
Inter Cos: 0.9322745203971863
Norm Quadratic Average: 1.3602757453918457
Nearest Class Center Accuracy: 0.9593

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.857138991355896
Inter Cos: 0.9530163407325745
Norm Quadratic Average: 2.1826415061950684
Nearest Class Center Accuracy: 0.9565

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8720666170120239
Inter Cos: 0.9591385722160339
Norm Quadratic Average: 3.661822557449341
Nearest Class Center Accuracy: 0.95292

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8724534511566162
Inter Cos: 0.9599602222442627
Norm Quadratic Average: 6.473731517791748
Nearest Class Center Accuracy: 0.95316

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8775226473808289
Inter Cos: 0.9538154602050781
Norm Quadratic Average: 10.943133354187012
Nearest Class Center Accuracy: 0.95344

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 1.952730417251587
Linear Weight Rank: 10
Intra Cos: 0.8850342035293579
Inter Cos: 0.941586434841156
Norm Quadratic Average: 60.40752029418945
Nearest Class Center Accuracy: 0.95422

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 1.9765020608901978
Linear Weight Rank: 2502
Intra Cos: 0.8799972534179688
Inter Cos: 0.8854972124099731
Norm Quadratic Average: 42.049076080322266
Nearest Class Center Accuracy: 0.9659

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.9540897607803345
Linear Weight Rank: 9
Intra Cos: 0.8956275582313538
Inter Cos: 0.7538967132568359
Norm Quadratic Average: 25.01021957397461
Nearest Class Center Accuracy: 0.97582

Output Layer:
Intra Cos: 0.8940239548683167
Inter Cos: 0.6636232137680054
Norm Quadratic Average: 15.58813190460205
Nearest Class Center Accuracy: 0.9854

Test Set:
Average Loss: 0.9304916944384575
Accuracy: 0.8022
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.33247581124305725, Weights: 0.1359068751335144
NC2 Equiangle: Features: 0.3917004903157552, Weights: 0.15179239908854167
NC3 Self-Duality: 0.6368000507354736
NC4 NCC Mismatch: 0.0746

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526077270507812
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550132751464844
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0167669877409935
Inter Cos: 0.0884459987282753
Norm Quadratic Average: 29.38791847229004
Nearest Class Center Accuracy: 0.3546

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022036030888557434
Inter Cos: 0.0918789803981781
Norm Quadratic Average: 24.420629501342773
Nearest Class Center Accuracy: 0.4565

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03036142885684967
Inter Cos: 0.08818599581718445
Norm Quadratic Average: 21.47852325439453
Nearest Class Center Accuracy: 0.5326

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02402171492576599
Inter Cos: 0.06727486848831177
Norm Quadratic Average: 7.107921123504639
Nearest Class Center Accuracy: 0.6114

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04104182869195938
Inter Cos: 0.07022858411073685
Norm Quadratic Average: 2.174426555633545
Nearest Class Center Accuracy: 0.6721

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1883605271577835
Inter Cos: 0.2252788096666336
Norm Quadratic Average: 0.4976331889629364
Nearest Class Center Accuracy: 0.793

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4598258435726166
Inter Cos: 0.49230703711509705
Norm Quadratic Average: 0.39443662762641907
Nearest Class Center Accuracy: 0.7879

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5370388627052307
Inter Cos: 0.6301892399787903
Norm Quadratic Average: 0.36140790581703186
Nearest Class Center Accuracy: 0.7732

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4040592610836029
Inter Cos: 0.7077209949493408
Norm Quadratic Average: 0.353691041469574
Nearest Class Center Accuracy: 0.7938

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3785020112991333
Inter Cos: 0.8718149065971375
Norm Quadratic Average: 0.6536429524421692
Nearest Class Center Accuracy: 0.7774

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5447095632553101
Inter Cos: 0.8424237370491028
Norm Quadratic Average: 1.3172427415847778
Nearest Class Center Accuracy: 0.7767

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.567166805267334
Inter Cos: 0.8891834616661072
Norm Quadratic Average: 2.110352039337158
Nearest Class Center Accuracy: 0.7701

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.567442774772644
Inter Cos: 0.9008411765098572
Norm Quadratic Average: 3.544834613800049
Nearest Class Center Accuracy: 0.7678

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5676888823509216
Inter Cos: 0.9018330574035645
Norm Quadratic Average: 6.266299247741699
Nearest Class Center Accuracy: 0.7679

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5694875121116638
Inter Cos: 0.8932936787605286
Norm Quadratic Average: 10.597038269042969
Nearest Class Center Accuracy: 0.7666

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 1.952730417251587
Linear Weight Rank: 10
Intra Cos: 0.5726802349090576
Inter Cos: 0.8831012845039368
Norm Quadratic Average: 58.718345642089844
Nearest Class Center Accuracy: 0.7613

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 1.9765020608901978
Linear Weight Rank: 2502
Intra Cos: 0.5596213936805725
Inter Cos: 0.8136181235313416
Norm Quadratic Average: 40.888694763183594
Nearest Class Center Accuracy: 0.7773

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.9540897607803345
Linear Weight Rank: 9
Intra Cos: 0.4975054860115051
Inter Cos: 0.689391553401947
Norm Quadratic Average: 24.273202896118164
Nearest Class Center Accuracy: 0.7841

Output Layer:
Intra Cos: 0.3907315731048584
Inter Cos: 0.6012442111968994
Norm Quadratic Average: 15.098567962646484
Nearest Class Center Accuracy: 0.7931

