Model save path: ./New_Models/bn_False_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.0003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0198909193277359
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597179412841797
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016547562554478645
Inter Cos: 0.06812447309494019
Norm Quadratic Average: 40.72761535644531
Nearest Class Center Accuracy: 0.35676

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01871631294488907
Inter Cos: 0.06050201132893562
Norm Quadratic Average: 42.96479797363281
Nearest Class Center Accuracy: 0.49228

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020276924595236778
Inter Cos: 0.05385133996605873
Norm Quadratic Average: 54.85457229614258
Nearest Class Center Accuracy: 0.57014

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024150386452674866
Inter Cos: 0.059017613530159
Norm Quadratic Average: 36.87868118286133
Nearest Class Center Accuracy: 0.625

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02863018400967121
Inter Cos: 0.05236608907580376
Norm Quadratic Average: 34.18030548095703
Nearest Class Center Accuracy: 0.67278

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03382815420627594
Inter Cos: 0.04733874276280403
Norm Quadratic Average: 26.81561851501465
Nearest Class Center Accuracy: 0.71302

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.037907980382442474
Inter Cos: 0.046679116785526276
Norm Quadratic Average: 21.225296020507812
Nearest Class Center Accuracy: 0.7403

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06336197257041931
Inter Cos: 0.06472761183977127
Norm Quadratic Average: 9.618265151977539
Nearest Class Center Accuracy: 0.8106

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.12336310744285583
Inter Cos: 0.07807684689760208
Norm Quadratic Average: 5.84752893447876
Nearest Class Center Accuracy: 0.86276

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.24811765551567078
Inter Cos: 0.1438840627670288
Norm Quadratic Average: 3.6741344928741455
Nearest Class Center Accuracy: 0.92094

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3937104642391205
Inter Cos: 0.19279327988624573
Norm Quadratic Average: 2.9914071559906006
Nearest Class Center Accuracy: 0.9645

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6129236221313477
Inter Cos: 0.227826789021492
Norm Quadratic Average: 1.9600074291229248
Nearest Class Center Accuracy: 0.98432

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8352619409561157
Inter Cos: 0.16206352412700653
Norm Quadratic Average: 1.8504581451416016
Nearest Class Center Accuracy: 0.99666

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8985001444816589
Inter Cos: 0.2021375447511673
Norm Quadratic Average: 2.0033979415893555
Nearest Class Center Accuracy: 0.99946

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9222061634063721
Inter Cos: 0.23507393896579742
Norm Quadratic Average: 2.1732447147369385
Nearest Class Center Accuracy: 0.99998

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 38.5131721496582
Linear Weight Rank: 4031
Intra Cos: 0.9456179738044739
Inter Cos: 0.26402437686920166
Norm Quadratic Average: 14.820019721984863
Nearest Class Center Accuracy: 0.99998

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 15.933812141418457
Linear Weight Rank: 3669
Intra Cos: 0.9500292539596558
Inter Cos: 0.2743419110774994
Norm Quadratic Average: 14.721034049987793
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 3.3931803703308105
Linear Weight Rank: 10
Intra Cos: 0.9450051784515381
Inter Cos: 0.1838407665491104
Norm Quadratic Average: 15.298661231994629
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.958734929561615
Inter Cos: 0.2770586311817169
Norm Quadratic Average: 18.568761825561523
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.8643565250873566
Accuracy: 0.8486
NC1 Within Class Collapse: 3.8836097717285156
NC2 Equinorm: Features: 0.17851485311985016, Weights: 0.01632705144584179
NC2 Equiangle: Features: 0.22571608225504558, Weights: 0.14810267554389106
NC3 Self-Duality: 0.20019617676734924
NC4 NCC Mismatch: 0.02949999999999997

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526077270507812
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550132751464844
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014844543300569057
Inter Cos: 0.06812916696071625
Norm Quadratic Average: 40.681854248046875
Nearest Class Center Accuracy: 0.3757

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01751074381172657
Inter Cos: 0.06149134412407875
Norm Quadratic Average: 42.939090728759766
Nearest Class Center Accuracy: 0.5066

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01877683587372303
Inter Cos: 0.05426036939024925
Norm Quadratic Average: 54.84891891479492
Nearest Class Center Accuracy: 0.5834

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02201293222606182
Inter Cos: 0.05966035649180412
Norm Quadratic Average: 36.89459228515625
Nearest Class Center Accuracy: 0.6251

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025852544233202934
Inter Cos: 0.052917689085006714
Norm Quadratic Average: 34.20023727416992
Nearest Class Center Accuracy: 0.6673

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03002169355750084
Inter Cos: 0.04816069081425667
Norm Quadratic Average: 26.812374114990234
Nearest Class Center Accuracy: 0.6977

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03314869478344917
Inter Cos: 0.047892723232507706
Norm Quadratic Average: 21.204856872558594
Nearest Class Center Accuracy: 0.7122

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05184882879257202
Inter Cos: 0.06590981781482697
Norm Quadratic Average: 9.578182220458984
Nearest Class Center Accuracy: 0.7479

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10382287949323654
Inter Cos: 0.07634291797876358
Norm Quadratic Average: 5.800223350524902
Nearest Class Center Accuracy: 0.7672

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20268464088439941
Inter Cos: 0.14701959490776062
Norm Quadratic Average: 3.6303999423980713
Nearest Class Center Accuracy: 0.7881

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2882286608219147
Inter Cos: 0.20467489957809448
Norm Quadratic Average: 2.942972421646118
Nearest Class Center Accuracy: 0.8141

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.41647931933403015
Inter Cos: 0.2825748026371002
Norm Quadratic Average: 1.9123684167861938
Nearest Class Center Accuracy: 0.8217

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5233558416366577
Inter Cos: 0.2919997572898865
Norm Quadratic Average: 1.7742129564285278
Nearest Class Center Accuracy: 0.8318

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5409581065177917
Inter Cos: 0.2762856185436249
Norm Quadratic Average: 1.90371835231781
Nearest Class Center Accuracy: 0.8373

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5371548533439636
Inter Cos: 0.2521132528781891
Norm Quadratic Average: 2.056570053100586
Nearest Class Center Accuracy: 0.8424

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 38.5131721496582
Linear Weight Rank: 4031
Intra Cos: 0.5509136915206909
Inter Cos: 0.22116774320602417
Norm Quadratic Average: 13.978275299072266
Nearest Class Center Accuracy: 0.8433

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 15.933812141418457
Linear Weight Rank: 3669
Intra Cos: 0.5438721179962158
Inter Cos: 0.19451695680618286
Norm Quadratic Average: 13.927391052246094
Nearest Class Center Accuracy: 0.844

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 3.3931803703308105
Linear Weight Rank: 10
Intra Cos: 0.5358603000640869
Inter Cos: 0.21588146686553955
Norm Quadratic Average: 14.571578979492188
Nearest Class Center Accuracy: 0.8449

Output Layer:
Intra Cos: 0.559299647808075
Inter Cos: 0.32627248764038086
Norm Quadratic Average: 17.646167755126953
Nearest Class Center Accuracy: 0.8455

