Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477276891469955
Norm Quadratic Average: 27.597177505493164
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012179273180663586
Inter Cos: 0.061043042689561844
Norm Quadratic Average: 6.203826427459717
Nearest Class Center Accuracy: 0.34184

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018480753526091576
Inter Cos: 0.06233590096235275
Norm Quadratic Average: 4.695950031280518
Nearest Class Center Accuracy: 0.47402

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013144776225090027
Inter Cos: 0.051495373249053955
Norm Quadratic Average: 3.340970754623413
Nearest Class Center Accuracy: 0.55302

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014822961762547493
Inter Cos: 0.053206488490104675
Norm Quadratic Average: 2.3085572719573975
Nearest Class Center Accuracy: 0.62076

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018150581046938896
Inter Cos: 0.047995466738939285
Norm Quadratic Average: 1.6973118782043457
Nearest Class Center Accuracy: 0.67778

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020862676203250885
Inter Cos: 0.042463771998882294
Norm Quadratic Average: 1.4581180810928345
Nearest Class Center Accuracy: 0.73264

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021368645131587982
Inter Cos: 0.03761608898639679
Norm Quadratic Average: 1.276388168334961
Nearest Class Center Accuracy: 0.79406

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.050662145018577576
Inter Cos: 0.0455724261701107
Norm Quadratic Average: 0.9503720998764038
Nearest Class Center Accuracy: 0.90994

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.13001826405525208
Inter Cos: 0.07628113776445389
Norm Quadratic Average: 0.610882580280304
Nearest Class Center Accuracy: 0.95174

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3508632183074951
Inter Cos: 0.1536816656589508
Norm Quadratic Average: 0.45845645666122437
Nearest Class Center Accuracy: 0.97326

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5491403937339783
Inter Cos: 0.06767375767230988
Norm Quadratic Average: 0.32723820209503174
Nearest Class Center Accuracy: 0.999

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7686331272125244
Inter Cos: 0.014472629874944687
Norm Quadratic Average: 0.2696736454963684
Nearest Class Center Accuracy: 1.0

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9074433445930481
Inter Cos: 0.017339682206511497
Norm Quadratic Average: 0.2678568661212921
Nearest Class Center Accuracy: 1.0

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9790449738502502
Inter Cos: -0.002206571400165558
Norm Quadratic Average: 0.49930092692375183
Nearest Class Center Accuracy: 1.0

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9931870698928833
Inter Cos: -0.029916150495409966
Norm Quadratic Average: 1.0289757251739502
Nearest Class Center Accuracy: 1.0

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.1702334880828857
Linear Weight Rank: 113
Intra Cos: 0.997986376285553
Inter Cos: -0.019943121820688248
Norm Quadratic Average: 24.95329475402832
Nearest Class Center Accuracy: 1.0

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.1891260147094727
Linear Weight Rank: 1089
Intra Cos: 0.9984849095344543
Inter Cos: 0.015659747645258904
Norm Quadratic Average: 16.848100662231445
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.1761369705200195
Linear Weight Rank: 9
Intra Cos: 0.9986395239830017
Inter Cos: 0.08968720585107803
Norm Quadratic Average: 11.674090385437012
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9989727735519409
Inter Cos: 0.1852242350578308
Norm Quadratic Average: 8.563992500305176
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.42750795221328736
Accuracy: 0.8987
NC1 Within Class Collapse: 1.9367631673812866
NC2 Equinorm: Features: 0.09708113223314285, Weights: 0.00653111981227994
NC2 Equiangle: Features: 0.10184914271036784, Weights: 0.035064636336432566
NC3 Self-Duality: 0.02680380269885063
NC4 NCC Mismatch: 0.0047000000000000375

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526073545217514
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.55013656616211
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011627682484686375
Inter Cos: 0.06196780875325203
Norm Quadratic Average: 6.199316501617432
Nearest Class Center Accuracy: 0.361

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017586540430784225
Inter Cos: 0.0636272057890892
Norm Quadratic Average: 4.694011211395264
Nearest Class Center Accuracy: 0.4913

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012480377219617367
Inter Cos: 0.052382178604602814
Norm Quadratic Average: 3.3406851291656494
Nearest Class Center Accuracy: 0.5712

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013911060057580471
Inter Cos: 0.05413335561752319
Norm Quadratic Average: 2.3088674545288086
Nearest Class Center Accuracy: 0.6311

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01681523025035858
Inter Cos: 0.04883843660354614
Norm Quadratic Average: 1.6977100372314453
Nearest Class Center Accuracy: 0.676

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01879204623401165
Inter Cos: 0.043436210602521896
Norm Quadratic Average: 1.457000494003296
Nearest Class Center Accuracy: 0.7155

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01824757643043995
Inter Cos: 0.03879145532846451
Norm Quadratic Average: 1.2727265357971191
Nearest Class Center Accuracy: 0.7544

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03852367028594017
Inter Cos: 0.04871812462806702
Norm Quadratic Average: 0.9431893229484558
Nearest Class Center Accuracy: 0.8253

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1092301532626152
Inter Cos: 0.08491219580173492
Norm Quadratic Average: 0.5979121923446655
Nearest Class Center Accuracy: 0.8445

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3027564287185669
Inter Cos: 0.19926074147224426
Norm Quadratic Average: 0.4425763785839081
Nearest Class Center Accuracy: 0.8469

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.43816155195236206
Inter Cos: 0.15804386138916016
Norm Quadratic Average: 0.31270137429237366
Nearest Class Center Accuracy: 0.878

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5612121820449829
Inter Cos: 0.16273133456707
Norm Quadratic Average: 0.2569977045059204
Nearest Class Center Accuracy: 0.8883

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6088908910751343
Inter Cos: 0.06381921470165253
Norm Quadratic Average: 0.2544356882572174
Nearest Class Center Accuracy: 0.8968

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.646484911441803
Inter Cos: 0.04836143180727959
Norm Quadratic Average: 0.47109079360961914
Nearest Class Center Accuracy: 0.8974

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6683110594749451
Inter Cos: 0.10265295207500458
Norm Quadratic Average: 0.9678145051002502
Nearest Class Center Accuracy: 0.8979

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.1702334880828857
Linear Weight Rank: 113
Intra Cos: 0.685307502746582
Inter Cos: 0.15241527557373047
Norm Quadratic Average: 23.38340950012207
Nearest Class Center Accuracy: 0.8986

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.1891260147094727
Linear Weight Rank: 1089
Intra Cos: 0.68785560131073
Inter Cos: 0.16298668086528778
Norm Quadratic Average: 15.796968460083008
Nearest Class Center Accuracy: 0.8985

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.1761369705200195
Linear Weight Rank: 9
Intra Cos: 0.6950380206108093
Inter Cos: 0.2079678475856781
Norm Quadratic Average: 10.9650297164917
Nearest Class Center Accuracy: 0.8988

Output Layer:
Intra Cos: 0.70756995677948
Inter Cos: 0.2636539340019226
Norm Quadratic Average: 8.060290336608887
Nearest Class Center Accuracy: 0.8987

