Model save path: ./New_Models/bn_False_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477276891469955
Norm Quadratic Average: 27.597177505493164
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020817456766963005
Inter Cos: 0.09413976222276688
Norm Quadratic Average: 30.88209342956543
Nearest Class Center Accuracy: 0.32876

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02537429891526699
Inter Cos: 0.10609051585197449
Norm Quadratic Average: 25.636808395385742
Nearest Class Center Accuracy: 0.42072

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026629626750946045
Inter Cos: 0.09051534533500671
Norm Quadratic Average: 28.496936798095703
Nearest Class Center Accuracy: 0.49406

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025166215375065804
Inter Cos: 0.0688277930021286
Norm Quadratic Average: 13.546737670898438
Nearest Class Center Accuracy: 0.58058

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02910587005317211
Inter Cos: 0.0608455128967762
Norm Quadratic Average: 5.866845607757568
Nearest Class Center Accuracy: 0.63634

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05488542094826698
Inter Cos: 0.08334063738584518
Norm Quadratic Average: 1.9281195402145386
Nearest Class Center Accuracy: 0.69854

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10822773724794388
Inter Cos: 0.17902646958827972
Norm Quadratic Average: 0.9358365535736084
Nearest Class Center Accuracy: 0.76842

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2308230996131897
Inter Cos: 0.31852495670318604
Norm Quadratic Average: 0.4517976641654968
Nearest Class Center Accuracy: 0.82336

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4428292512893677
Inter Cos: 0.4844461679458618
Norm Quadratic Average: 0.35296905040740967
Nearest Class Center Accuracy: 0.89532

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5586327910423279
Inter Cos: 0.5310871005058289
Norm Quadratic Average: 0.42401042580604553
Nearest Class Center Accuracy: 0.9513

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6077086925506592
Inter Cos: 0.5150151252746582
Norm Quadratic Average: 0.6313410401344299
Nearest Class Center Accuracy: 0.97298

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6800413727760315
Inter Cos: 0.5409262776374817
Norm Quadratic Average: 0.7112376689910889
Nearest Class Center Accuracy: 0.9781

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7481551766395569
Inter Cos: 0.6170418858528137
Norm Quadratic Average: 1.0886791944503784
Nearest Class Center Accuracy: 0.98202

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.77822345495224
Inter Cos: 0.6232281923294067
Norm Quadratic Average: 1.8649084568023682
Nearest Class Center Accuracy: 0.98628

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7999801635742188
Inter Cos: 0.6157887578010559
Norm Quadratic Average: 3.1284918785095215
Nearest Class Center Accuracy: 0.9913

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.490957021713257
Linear Weight Rank: 3110
Intra Cos: 0.80936199426651
Inter Cos: 0.486847847700119
Norm Quadratic Average: 20.319978713989258
Nearest Class Center Accuracy: 0.99438

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.568927764892578
Linear Weight Rank: 2849
Intra Cos: 0.8498265147209167
Inter Cos: 0.4976799190044403
Norm Quadratic Average: 20.756641387939453
Nearest Class Center Accuracy: 0.99788

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.5109517574310303
Linear Weight Rank: 9
Intra Cos: 0.8570036292076111
Inter Cos: 0.4317067861557007
Norm Quadratic Average: 19.13925552368164
Nearest Class Center Accuracy: 0.99948

Output Layer:
Intra Cos: 0.8779060244560242
Inter Cos: 0.47061264514923096
Norm Quadratic Average: 19.383968353271484
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.8158629061698913
Accuracy: 0.8273
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.23859713971614838, Weights: 0.08078686892986298
NC2 Equiangle: Features: 0.33933503892686634, Weights: 0.1885247548421224
NC3 Self-Duality: 0.2456008493900299
NC4 NCC Mismatch: 0.039100000000000024

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526073545217514
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.55013656616211
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01787639781832695
Inter Cos: 0.09462863951921463
Norm Quadratic Average: 30.844532012939453
Nearest Class Center Accuracy: 0.3435

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02357391081750393
Inter Cos: 0.10684079676866531
Norm Quadratic Average: 25.629924774169922
Nearest Class Center Accuracy: 0.4321

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02503378689289093
Inter Cos: 0.09140871465206146
Norm Quadratic Average: 28.5074520111084
Nearest Class Center Accuracy: 0.5062

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023145316168665886
Inter Cos: 0.0696762278676033
Norm Quadratic Average: 13.561834335327148
Nearest Class Center Accuracy: 0.5867

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02674790285527706
Inter Cos: 0.060696184635162354
Norm Quadratic Average: 5.876734256744385
Nearest Class Center Accuracy: 0.6325

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05035864934325218
Inter Cos: 0.08270767331123352
Norm Quadratic Average: 1.9284917116165161
Nearest Class Center Accuracy: 0.6788

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1025727167725563
Inter Cos: 0.18150776624679565
Norm Quadratic Average: 0.9343904852867126
Nearest Class Center Accuracy: 0.73

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.21011370420455933
Inter Cos: 0.32147127389907837
Norm Quadratic Average: 0.4498380720615387
Nearest Class Center Accuracy: 0.7589

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3706261217594147
Inter Cos: 0.4440889358520508
Norm Quadratic Average: 0.35013526678085327
Nearest Class Center Accuracy: 0.7938

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4340759217739105
Inter Cos: 0.4885145127773285
Norm Quadratic Average: 0.4196256697177887
Nearest Class Center Accuracy: 0.809

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.46006056666374207
Inter Cos: 0.48139721155166626
Norm Quadratic Average: 0.6244332790374756
Nearest Class Center Accuracy: 0.8131

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5087804198265076
Inter Cos: 0.521619975566864
Norm Quadratic Average: 0.703324019908905
Nearest Class Center Accuracy: 0.8088

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5740026831626892
Inter Cos: 0.5918636322021484
Norm Quadratic Average: 1.0753235816955566
Nearest Class Center Accuracy: 0.8073

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5833355188369751
Inter Cos: 0.6036695837974548
Norm Quadratic Average: 1.839015007019043
Nearest Class Center Accuracy: 0.8112

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5728880763053894
Inter Cos: 0.5923227071762085
Norm Quadratic Average: 3.078552722930908
Nearest Class Center Accuracy: 0.817

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.490957021713257
Linear Weight Rank: 3110
Intra Cos: 0.5696143507957458
Inter Cos: 0.5046628713607788
Norm Quadratic Average: 19.968528747558594
Nearest Class Center Accuracy: 0.8231

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.568927764892578
Linear Weight Rank: 2849
Intra Cos: 0.5622263550758362
Inter Cos: 0.5191927552223206
Norm Quadratic Average: 20.35658073425293
Nearest Class Center Accuracy: 0.8257

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.5109517574310303
Linear Weight Rank: 9
Intra Cos: 0.5506477355957031
Inter Cos: 0.47244998812675476
Norm Quadratic Average: 18.749662399291992
Nearest Class Center Accuracy: 0.827

Output Layer:
Intra Cos: 0.5372545123100281
Inter Cos: 0.4978688359260559
Norm Quadratic Average: 18.94603729248047
Nearest Class Center Accuracy: 0.8273

