Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.0005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893192246556282
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326313018798828
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.028996814042329788
Inter Cos: 0.037636518478393555
Norm Quadratic Average: 51.6427116394043
Nearest Class Center Accuracy: 0.04274

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023933956399559975
Inter Cos: 0.02627229318022728
Norm Quadratic Average: 67.70156860351562
Nearest Class Center Accuracy: 0.05416

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022056447342038155
Inter Cos: 0.028846465051174164
Norm Quadratic Average: 110.36204528808594
Nearest Class Center Accuracy: 0.06196

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025144385173916817
Inter Cos: 0.026334142312407494
Norm Quadratic Average: 93.55620574951172
Nearest Class Center Accuracy: 0.06722

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026220792904496193
Inter Cos: 0.031450510025024414
Norm Quadratic Average: 105.04188537597656
Nearest Class Center Accuracy: 0.06974

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.029610726982355118
Inter Cos: 0.03450065851211548
Norm Quadratic Average: 99.06748962402344
Nearest Class Center Accuracy: 0.07212

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0320332869887352
Inter Cos: 0.03278835490345955
Norm Quadratic Average: 90.69470977783203
Nearest Class Center Accuracy: 0.07482

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05405917763710022
Inter Cos: 0.042023222893476486
Norm Quadratic Average: 46.20813751220703
Nearest Class Center Accuracy: 0.08006

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06409800797700882
Inter Cos: 0.049934450536966324
Norm Quadratic Average: 28.358928680419922
Nearest Class Center Accuracy: 0.0825

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10066208988428116
Inter Cos: 0.08087268471717834
Norm Quadratic Average: 13.401479721069336
Nearest Class Center Accuracy: 0.08742

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.19862614572048187
Inter Cos: 0.1560848355293274
Norm Quadratic Average: 7.422883987426758
Nearest Class Center Accuracy: 0.09304

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4381733238697052
Inter Cos: 0.35147178173065186
Norm Quadratic Average: 3.958390474319458
Nearest Class Center Accuracy: 0.09608

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7563851475715637
Inter Cos: 0.5455513000488281
Norm Quadratic Average: 3.516303300857544
Nearest Class Center Accuracy: 0.099

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8340691328048706
Inter Cos: 0.5832311511039734
Norm Quadratic Average: 4.2095866203308105
Nearest Class Center Accuracy: 0.0997

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8642520308494568
Inter Cos: 0.6065415143966675
Norm Quadratic Average: 5.417142391204834
Nearest Class Center Accuracy: 0.09994

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 20.96467399597168
Linear Weight Rank: 4030
Intra Cos: 0.875886082649231
Inter Cos: 0.5620543360710144
Norm Quadratic Average: 41.346900939941406
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 11.473671913146973
Linear Weight Rank: 3653
Intra Cos: 0.8693069219589233
Inter Cos: 0.5232039093971252
Norm Quadratic Average: 43.20143127441406
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 8.10492992401123
Linear Weight Rank: 98
Intra Cos: 0.8699766397476196
Inter Cos: 0.49631524085998535
Norm Quadratic Average: 41.47945785522461
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9162980318069458
Inter Cos: 0.6292213201522827
Norm Quadratic Average: 62.81504821777344
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 4.080590252304077
Accuracy: 0.4955
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.26594528555870056, Weights: 0.04874159395694733
NC2 Equiangle: Features: 0.2363906151357323, Weights: 0.11152052754103535
NC3 Self-Duality: 0.4946401119232178
NC4 NCC Mismatch: 0.17400000000000004

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422183990478516
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013516542501747608
Inter Cos: 0.26436546444892883
Norm Quadratic Average: 51.92103958129883
Nearest Class Center Accuracy: 0.2136

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016515564173460007
Inter Cos: 0.23571832478046417
Norm Quadratic Average: 68.1379165649414
Nearest Class Center Accuracy: 0.3245

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014915763400495052
Inter Cos: 0.18444578349590302
Norm Quadratic Average: 111.14828491210938
Nearest Class Center Accuracy: 0.4023

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019662830978631973
Inter Cos: 0.22814173996448517
Norm Quadratic Average: 94.34745025634766
Nearest Class Center Accuracy: 0.4551

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019850071519613266
Inter Cos: 0.19672518968582153
Norm Quadratic Average: 105.953857421875
Nearest Class Center Accuracy: 0.4826

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02066408470273018
Inter Cos: 0.18659332394599915
Norm Quadratic Average: 99.88089752197266
Nearest Class Center Accuracy: 0.5055

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022299565374851227
Inter Cos: 0.17898985743522644
Norm Quadratic Average: 91.29814910888672
Nearest Class Center Accuracy: 0.5268

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0257825069129467
Inter Cos: 0.2149771749973297
Norm Quadratic Average: 46.42051696777344
Nearest Class Center Accuracy: 0.5525

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02847280725836754
Inter Cos: 0.22957870364189148
Norm Quadratic Average: 28.224679946899414
Nearest Class Center Accuracy: 0.5573

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04069839417934418
Inter Cos: 0.29785293340682983
Norm Quadratic Average: 13.106728553771973
Nearest Class Center Accuracy: 0.5463

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06976720690727234
Inter Cos: 0.40631988644599915
Norm Quadratic Average: 7.131176471710205
Nearest Class Center Accuracy: 0.5257

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.15058042109012604
Inter Cos: 0.5629572868347168
Norm Quadratic Average: 3.692168712615967
Nearest Class Center Accuracy: 0.4952

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20947962999343872
Inter Cos: 0.6699765920639038
Norm Quadratic Average: 3.170755386352539
Nearest Class Center Accuracy: 0.4856

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.19591936469078064
Inter Cos: 0.6850711107254028
Norm Quadratic Average: 3.774747610092163
Nearest Class Center Accuracy: 0.486

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.17049038410186768
Inter Cos: 0.6924983859062195
Norm Quadratic Average: 4.883866786956787
Nearest Class Center Accuracy: 0.4877

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 20.96467399597168
Linear Weight Rank: 4030
Intra Cos: 0.16885055601596832
Inter Cos: 0.6748372912406921
Norm Quadratic Average: 37.55109405517578
Nearest Class Center Accuracy: 0.494

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 11.473671913146973
Linear Weight Rank: 3653
Intra Cos: 0.1611481010913849
Inter Cos: 0.6595158576965332
Norm Quadratic Average: 39.339141845703125
Nearest Class Center Accuracy: 0.4962

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 8.10492992401123
Linear Weight Rank: 98
Intra Cos: 0.16427776217460632
Inter Cos: 0.6480564475059509
Norm Quadratic Average: 37.78058624267578
Nearest Class Center Accuracy: 0.4994

Output Layer:
Intra Cos: 0.17208826541900635
Inter Cos: 0.7330429553985596
Norm Quadratic Average: 57.477943420410156
Nearest Class Center Accuracy: 0.4942

