Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02289319410920143
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326311111450195
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026405014097690582
Inter Cos: 0.045594796538352966
Norm Quadratic Average: 47.42631530761719
Nearest Class Center Accuracy: 0.03936

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02298072911798954
Inter Cos: 0.039722345769405365
Norm Quadratic Average: 59.54813003540039
Nearest Class Center Accuracy: 0.04958

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023356124758720398
Inter Cos: 0.028168555349111557
Norm Quadratic Average: 79.6524429321289
Nearest Class Center Accuracy: 0.06154

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023378519341349602
Inter Cos: 0.022908316925168037
Norm Quadratic Average: 41.515140533447266
Nearest Class Center Accuracy: 0.06858

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024502072483301163
Inter Cos: 0.021499231457710266
Norm Quadratic Average: 18.54640007019043
Nearest Class Center Accuracy: 0.07292

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04116956144571304
Inter Cos: 0.034705836325883865
Norm Quadratic Average: 5.0138115882873535
Nearest Class Center Accuracy: 0.07906

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.13630977272987366
Inter Cos: 0.11205615103244781
Norm Quadratic Average: 1.3087654113769531
Nearest Class Center Accuracy: 0.09092

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6098081469535828
Inter Cos: 0.5313453674316406
Norm Quadratic Average: 0.489248663187027
Nearest Class Center Accuracy: 0.09548

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8281230330467224
Inter Cos: 0.7822737693786621
Norm Quadratic Average: 0.508253276348114
Nearest Class Center Accuracy: 0.09764

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.846439003944397
Inter Cos: 0.8076925277709961
Norm Quadratic Average: 1.0439953804016113
Nearest Class Center Accuracy: 0.09884

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8585824966430664
Inter Cos: 0.7889665961265564
Norm Quadratic Average: 2.5484323501586914
Nearest Class Center Accuracy: 0.09932

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8896538019180298
Inter Cos: 0.7850226163864136
Norm Quadratic Average: 4.692016124725342
Nearest Class Center Accuracy: 0.09952

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.917705774307251
Inter Cos: 0.7828209400177002
Norm Quadratic Average: 9.321836471557617
Nearest Class Center Accuracy: 0.09976

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9261746406555176
Inter Cos: 0.7719981670379639
Norm Quadratic Average: 18.277101516723633
Nearest Class Center Accuracy: 0.09976

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9287177324295044
Inter Cos: 0.7451853156089783
Norm Quadratic Average: 32.468994140625
Nearest Class Center Accuracy: 0.09982

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.3848462104797363
Linear Weight Rank: 1930
Intra Cos: 0.8915150165557861
Inter Cos: 0.6894303560256958
Norm Quadratic Average: 184.0824737548828
Nearest Class Center Accuracy: 0.09984

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.9973363876342773
Linear Weight Rank: 2866
Intra Cos: 0.9171905517578125
Inter Cos: 0.6645004749298096
Norm Quadratic Average: 132.15725708007812
Nearest Class Center Accuracy: 0.09988

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.11900520324707
Linear Weight Rank: 97
Intra Cos: 0.9170112609863281
Inter Cos: 0.6012619137763977
Norm Quadratic Average: 74.86211395263672
Nearest Class Center Accuracy: 0.09988

Output Layer:
Intra Cos: 0.9374033212661743
Inter Cos: 0.7031546831130981
Norm Quadratic Average: 57.510677337646484
Nearest Class Center Accuracy: 0.0999

Test Set:
Average Loss: 4.080288656616211
Accuracy: 0.4915
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.24144737422466278, Weights: 0.06277786195278168
NC2 Equiangle: Features: 0.24008433948863636, Weights: 0.10097336277817234
NC3 Self-Duality: 0.5024738311767578
NC4 NCC Mismatch: 0.20650000000000002

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621266715228558
Inter Cos: 0.406754732131958
Norm Quadratic Average: 29.42218780517578
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012406491674482822
Inter Cos: 0.27087652683258057
Norm Quadratic Average: 47.66851043701172
Nearest Class Center Accuracy: 0.1884

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016882289201021194
Inter Cos: 0.27654287219047546
Norm Quadratic Average: 59.87517166137695
Nearest Class Center Accuracy: 0.286

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015586384572088718
Inter Cos: 0.23793524503707886
Norm Quadratic Average: 80.16495513916016
Nearest Class Center Accuracy: 0.3945

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018053419888019562
Inter Cos: 0.22144293785095215
Norm Quadratic Average: 41.83988571166992
Nearest Class Center Accuracy: 0.4829

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01819353550672531
Inter Cos: 0.18204569816589355
Norm Quadratic Average: 18.674137115478516
Nearest Class Center Accuracy: 0.5473

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024238936603069305
Inter Cos: 0.2308991700410843
Norm Quadratic Average: 5.035787105560303
Nearest Class Center Accuracy: 0.5679

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05596182867884636
Inter Cos: 0.38127923011779785
Norm Quadratic Average: 1.2958478927612305
Nearest Class Center Accuracy: 0.5665

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.25382277369499207
Inter Cos: 0.6850674748420715
Norm Quadratic Average: 0.4689177870750427
Nearest Class Center Accuracy: 0.5128

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3189625144004822
Inter Cos: 0.8364689350128174
Norm Quadratic Average: 0.47984758019447327
Nearest Class Center Accuracy: 0.4809

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.31121599674224854
Inter Cos: 0.8680710196495056
Norm Quadratic Average: 0.9736286997795105
Nearest Class Center Accuracy: 0.4653

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.31064045429229736
Inter Cos: 0.8814714550971985
Norm Quadratic Average: 2.358325719833374
Nearest Class Center Accuracy: 0.4627

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.32944348454475403
Inter Cos: 0.8784927725791931
Norm Quadratic Average: 4.323588848114014
Nearest Class Center Accuracy: 0.4498

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3111354112625122
Inter Cos: 0.8922772407531738
Norm Quadratic Average: 8.580031394958496
Nearest Class Center Accuracy: 0.4521

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.28331252932548523
Inter Cos: 0.8942346572875977
Norm Quadratic Average: 16.81298828125
Nearest Class Center Accuracy: 0.4547

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2715834677219391
Inter Cos: 0.884732723236084
Norm Quadratic Average: 29.918062210083008
Nearest Class Center Accuracy: 0.4585

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.3848462104797363
Linear Weight Rank: 1930
Intra Cos: 0.30945494771003723
Inter Cos: 0.7978560328483582
Norm Quadratic Average: 173.9405059814453
Nearest Class Center Accuracy: 0.4624

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.9973363876342773
Linear Weight Rank: 2866
Intra Cos: 0.3524301052093506
Inter Cos: 0.7601108551025391
Norm Quadratic Average: 123.29580688476562
Nearest Class Center Accuracy: 0.4764

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.11900520324707
Linear Weight Rank: 97
Intra Cos: 0.29607224464416504
Inter Cos: 0.7067787647247314
Norm Quadratic Average: 69.3979721069336
Nearest Class Center Accuracy: 0.4865

Output Layer:
Intra Cos: 0.3231061100959778
Inter Cos: 0.7551969885826111
Norm Quadratic Average: 53.47385787963867
Nearest Class Center Accuracy: 0.4845

