Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477276891469955
Norm Quadratic Average: 27.597177505493164
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0117072444409132
Inter Cos: 0.059533946216106415
Norm Quadratic Average: 20.808082580566406
Nearest Class Center Accuracy: 0.34298

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016091061756014824
Inter Cos: 0.06288692355155945
Norm Quadratic Average: 14.567225456237793
Nearest Class Center Accuracy: 0.47856

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012372251600027084
Inter Cos: 0.04652828350663185
Norm Quadratic Average: 11.061274528503418
Nearest Class Center Accuracy: 0.55258

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015683822333812714
Inter Cos: 0.04657544195652008
Norm Quadratic Average: 7.854764461517334
Nearest Class Center Accuracy: 0.62228

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01611931622028351
Inter Cos: 0.037901218980550766
Norm Quadratic Average: 5.964518070220947
Nearest Class Center Accuracy: 0.67636

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017291145399212837
Inter Cos: 0.03265725076198578
Norm Quadratic Average: 5.829031467437744
Nearest Class Center Accuracy: 0.72492

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01885426789522171
Inter Cos: 0.029261507093906403
Norm Quadratic Average: 5.747566223144531
Nearest Class Center Accuracy: 0.76644

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03937528654932976
Inter Cos: 0.05085700377821922
Norm Quadratic Average: 4.0357770919799805
Nearest Class Center Accuracy: 0.87044

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0904838889837265
Inter Cos: 0.050513844937086105
Norm Quadratic Average: 2.6589627265930176
Nearest Class Center Accuracy: 0.92974

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20774546265602112
Inter Cos: 0.07868267595767975
Norm Quadratic Average: 2.4509503841400146
Nearest Class Center Accuracy: 0.95032

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3519093096256256
Inter Cos: 0.08317623287439346
Norm Quadratic Average: 2.189504623413086
Nearest Class Center Accuracy: 0.98012

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.636452317237854
Inter Cos: 0.09733285009860992
Norm Quadratic Average: 1.9874740839004517
Nearest Class Center Accuracy: 0.9902

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8892462253570557
Inter Cos: 0.012573909014463425
Norm Quadratic Average: 1.2448689937591553
Nearest Class Center Accuracy: 0.9992

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.933542788028717
Inter Cos: -0.01889093779027462
Norm Quadratic Average: 1.2353687286376953
Nearest Class Center Accuracy: 1.0

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.954548180103302
Inter Cos: -0.03081951104104519
Norm Quadratic Average: 1.183763027191162
Nearest Class Center Accuracy: 1.0

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 4.64811372756958
Linear Weight Rank: 4029
Intra Cos: 0.9899534583091736
Inter Cos: -0.042722538113594055
Norm Quadratic Average: 24.391860961914062
Nearest Class Center Accuracy: 1.0

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.1979434490203857
Linear Weight Rank: 3637
Intra Cos: 0.9931067824363708
Inter Cos: -0.025565188378095627
Norm Quadratic Average: 17.18160629272461
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.5055575370788574
Linear Weight Rank: 9
Intra Cos: 0.9929800033569336
Inter Cos: 0.00980901438742876
Norm Quadratic Average: 12.760751724243164
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9954872727394104
Inter Cos: 0.17869511246681213
Norm Quadratic Average: 10.49719524383545
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.6700370742797852
Accuracy: 0.8787
NC1 Within Class Collapse: 2.594374179840088
NC2 Equinorm: Features: 0.12890172004699707, Weights: 0.021552465856075287
NC2 Equiangle: Features: 0.09567719565497504, Weights: 0.04479268391927083
NC3 Self-Duality: 0.08153577148914337
NC4 NCC Mismatch: 0.007299999999999973

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526073545217514
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.55013656616211
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01020065788179636
Inter Cos: 0.060603369027376175
Norm Quadratic Average: 20.79022979736328
Nearest Class Center Accuracy: 0.3614

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014911544509232044
Inter Cos: 0.06401718407869339
Norm Quadratic Average: 14.560699462890625
Nearest Class Center Accuracy: 0.4955

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01165151596069336
Inter Cos: 0.047101620584726334
Norm Quadratic Average: 11.059953689575195
Nearest Class Center Accuracy: 0.5647

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014605838805437088
Inter Cos: 0.04699629172682762
Norm Quadratic Average: 7.854620933532715
Nearest Class Center Accuracy: 0.6306

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014714750461280346
Inter Cos: 0.03817647323012352
Norm Quadratic Average: 5.967016220092773
Nearest Class Center Accuracy: 0.6756

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015360492281615734
Inter Cos: 0.03296640142798424
Norm Quadratic Average: 5.825417995452881
Nearest Class Center Accuracy: 0.7106

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0160786472260952
Inter Cos: 0.02959616668522358
Norm Quadratic Average: 5.735293388366699
Nearest Class Center Accuracy: 0.7374

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.030829012393951416
Inter Cos: 0.05334536358714104
Norm Quadratic Average: 4.015089988708496
Nearest Class Center Accuracy: 0.7923

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06459121406078339
Inter Cos: 0.05785471200942993
Norm Quadratic Average: 2.6213173866271973
Nearest Class Center Accuracy: 0.8184

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.16341939568519592
Inter Cos: 0.09501801431179047
Norm Quadratic Average: 2.380141496658325
Nearest Class Center Accuracy: 0.8156

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.25236958265304565
Inter Cos: 0.1248021200299263
Norm Quadratic Average: 2.102908134460449
Nearest Class Center Accuracy: 0.8337

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4552168548107147
Inter Cos: 0.21148055791854858
Norm Quadratic Average: 1.8866385221481323
Nearest Class Center Accuracy: 0.8336

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5927199721336365
Inter Cos: 0.20823006331920624
Norm Quadratic Average: 1.1625826358795166
Nearest Class Center Accuracy: 0.8522

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5819436311721802
Inter Cos: 0.13987921178340912
Norm Quadratic Average: 1.146948218345642
Nearest Class Center Accuracy: 0.8696

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5523214936256409
Inter Cos: 0.07434296607971191
Norm Quadratic Average: 1.1137703657150269
Nearest Class Center Accuracy: 0.8786

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 4.64811372756958
Linear Weight Rank: 4029
Intra Cos: 0.5694231986999512
Inter Cos: 0.1001429632306099
Norm Quadratic Average: 22.903303146362305
Nearest Class Center Accuracy: 0.8787

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.1979434490203857
Linear Weight Rank: 3637
Intra Cos: 0.5685861110687256
Inter Cos: 0.09355803579092026
Norm Quadratic Average: 16.169755935668945
Nearest Class Center Accuracy: 0.8789

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.5055575370788574
Linear Weight Rank: 9
Intra Cos: 0.5755481123924255
Inter Cos: 0.12911102175712585
Norm Quadratic Average: 12.09312915802002
Nearest Class Center Accuracy: 0.8785

Output Layer:
Intra Cos: 0.6031521558761597
Inter Cos: 0.23345907032489777
Norm Quadratic Average: 9.948078155517578
Nearest Class Center Accuracy: 0.8783

