Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.03.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0198909193277359
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597179412841797
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011799903586506844
Inter Cos: 0.06069687753915787
Norm Quadratic Average: 3.257878065109253
Nearest Class Center Accuracy: 0.32158

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018813742324709892
Inter Cos: 0.07698259502649307
Norm Quadratic Average: 2.8034818172454834
Nearest Class Center Accuracy: 0.43884

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014331117272377014
Inter Cos: 0.06079116836190224
Norm Quadratic Average: 1.9374412298202515
Nearest Class Center Accuracy: 0.53074

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01809588260948658
Inter Cos: 0.057212959975004196
Norm Quadratic Average: 1.213476300239563
Nearest Class Center Accuracy: 0.61576

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024973470717668533
Inter Cos: 0.05048336833715439
Norm Quadratic Average: 1.0435420274734497
Nearest Class Center Accuracy: 0.67498

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02553493157029152
Inter Cos: 0.050368499010801315
Norm Quadratic Average: 1.0350368022918701
Nearest Class Center Accuracy: 0.713

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023300684988498688
Inter Cos: 0.037798743695020676
Norm Quadratic Average: 0.8755024671554565
Nearest Class Center Accuracy: 0.76454

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.052956633269786835
Inter Cos: 0.06293147802352905
Norm Quadratic Average: 0.454756498336792
Nearest Class Center Accuracy: 0.89028

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.21635431051254272
Inter Cos: 0.16978448629379272
Norm Quadratic Average: 0.1949700117111206
Nearest Class Center Accuracy: 0.9404

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5380203723907471
Inter Cos: 0.24625034630298615
Norm Quadratic Average: 0.10985957086086273
Nearest Class Center Accuracy: 0.99394

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7520041465759277
Inter Cos: 0.2897491455078125
Norm Quadratic Average: 0.12057794630527496
Nearest Class Center Accuracy: 0.99902

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8977659940719604
Inter Cos: 0.3403421640396118
Norm Quadratic Average: 0.13504374027252197
Nearest Class Center Accuracy: 0.99964

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9263360500335693
Inter Cos: 0.2531488537788391
Norm Quadratic Average: 0.13139814138412476
Nearest Class Center Accuracy: 0.99986

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9851629734039307
Inter Cos: 0.17032340168952942
Norm Quadratic Average: 0.24609073996543884
Nearest Class Center Accuracy: 0.99986

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9951602816581726
Inter Cos: 0.21430745720863342
Norm Quadratic Average: 0.744979739189148
Nearest Class Center Accuracy: 0.99986

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 1.9368277788162231
Linear Weight Rank: 8
Intra Cos: 0.9978651404380798
Inter Cos: 0.3063185214996338
Norm Quadratic Average: 22.410551071166992
Nearest Class Center Accuracy: 0.99986

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 1.9399383068084717
Linear Weight Rank: 1324
Intra Cos: 0.9984555840492249
Inter Cos: 0.28341343998908997
Norm Quadratic Average: 15.0890474319458
Nearest Class Center Accuracy: 0.99986

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.9400920867919922
Linear Weight Rank: 8
Intra Cos: 0.9984437227249146
Inter Cos: 0.233084037899971
Norm Quadratic Average: 10.442770004272461
Nearest Class Center Accuracy: 0.99986

Output Layer:
Intra Cos: 0.9984682202339172
Inter Cos: 0.2352364957332611
Norm Quadratic Average: 7.820658206939697
Nearest Class Center Accuracy: 0.99986

Test Set:
Average Loss: 0.5261544913768769
Accuracy: 0.8626
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.10866034775972366, Weights: 0.011546202935278416
NC2 Equiangle: Features: 0.19522675408257378, Weights: 0.16583633422851562
NC3 Self-Duality: 0.0455298088490963
NC4 NCC Mismatch: 0.009099999999999997

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526077270507812
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550132751464844
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010093074291944504
Inter Cos: 0.061722949147224426
Norm Quadratic Average: 3.253403902053833
Nearest Class Center Accuracy: 0.339

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0174429789185524
Inter Cos: 0.07851827889680862
Norm Quadratic Average: 2.801284074783325
Nearest Class Center Accuracy: 0.4582

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013585102744400501
Inter Cos: 0.06126286834478378
Norm Quadratic Average: 1.9380115270614624
Nearest Class Center Accuracy: 0.546

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017147522419691086
Inter Cos: 0.05792410671710968
Norm Quadratic Average: 1.2148842811584473
Nearest Class Center Accuracy: 0.6228

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023056820034980774
Inter Cos: 0.050894156098365784
Norm Quadratic Average: 1.0447348356246948
Nearest Class Center Accuracy: 0.6716

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023343848064541817
Inter Cos: 0.050936438143253326
Norm Quadratic Average: 1.0353745222091675
Nearest Class Center Accuracy: 0.7009

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020416663959622383
Inter Cos: 0.03840358555316925
Norm Quadratic Average: 0.8745889663696289
Nearest Class Center Accuracy: 0.7333

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.041578635573387146
Inter Cos: 0.06622742861509323
Norm Quadratic Average: 0.452399879693985
Nearest Class Center Accuracy: 0.8113

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.17202414572238922
Inter Cos: 0.17448697984218597
Norm Quadratic Average: 0.1909564584493637
Nearest Class Center Accuracy: 0.8219

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.37266385555267334
Inter Cos: 0.2621104419231415
Norm Quadratic Average: 0.10642629861831665
Nearest Class Center Accuracy: 0.8497

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.475094735622406
Inter Cos: 0.24596598744392395
Norm Quadratic Average: 0.11481565237045288
Nearest Class Center Accuracy: 0.8619

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5656815767288208
Inter Cos: 0.3046934902667999
Norm Quadratic Average: 0.1268317550420761
Nearest Class Center Accuracy: 0.8565

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5041325688362122
Inter Cos: 0.2076985239982605
Norm Quadratic Average: 0.12382321804761887
Nearest Class Center Accuracy: 0.8625

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5632886290550232
Inter Cos: 0.16859698295593262
Norm Quadratic Average: 0.23098431527614594
Nearest Class Center Accuracy: 0.8626

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5664762258529663
Inter Cos: 0.22851575911045074
Norm Quadratic Average: 0.7006585597991943
Nearest Class Center Accuracy: 0.8632

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 1.9368277788162231
Linear Weight Rank: 8
Intra Cos: 0.5979111194610596
Inter Cos: 0.3245973289012909
Norm Quadratic Average: 21.044822692871094
Nearest Class Center Accuracy: 0.8639

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 1.9399383068084717
Linear Weight Rank: 1324
Intra Cos: 0.5942992568016052
Inter Cos: 0.3160901367664337
Norm Quadratic Average: 14.183368682861328
Nearest Class Center Accuracy: 0.8639

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.9400920867919922
Linear Weight Rank: 8
Intra Cos: 0.5920838117599487
Inter Cos: 0.30432477593421936
Norm Quadratic Average: 9.829888343811035
Nearest Class Center Accuracy: 0.8626

Output Layer:
Intra Cos: 0.5942134857177734
Inter Cos: 0.2946667969226837
Norm Quadratic Average: 7.380795001983643
Nearest Class Center Accuracy: 0.8631

