Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02289319410920143
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326311111450195
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014380902983248234
Inter Cos: 0.03242778033018112
Norm Quadratic Average: 12.392406463623047
Nearest Class Center Accuracy: 0.03884

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018961306661367416
Inter Cos: 0.037051521241664886
Norm Quadratic Average: 8.58232593536377
Nearest Class Center Accuracy: 0.05794

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01473440881818533
Inter Cos: 0.03016895242035389
Norm Quadratic Average: 6.351224422454834
Nearest Class Center Accuracy: 0.06404

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021734869107604027
Inter Cos: 0.01876249350607395
Norm Quadratic Average: 4.696154594421387
Nearest Class Center Accuracy: 0.07136

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023249443620443344
Inter Cos: 0.018853357061743736
Norm Quadratic Average: 3.5868868827819824
Nearest Class Center Accuracy: 0.07538

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02470553107559681
Inter Cos: 0.020746521651744843
Norm Quadratic Average: 3.4679956436157227
Nearest Class Center Accuracy: 0.07786

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021638158708810806
Inter Cos: 0.01934593915939331
Norm Quadratic Average: 3.497403621673584
Nearest Class Center Accuracy: 0.07954

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.031182192265987396
Inter Cos: 0.025455685332417488
Norm Quadratic Average: 2.5468533039093018
Nearest Class Center Accuracy: 0.0863

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03852785751223564
Inter Cos: 0.029029488563537598
Norm Quadratic Average: 1.6681437492370605
Nearest Class Center Accuracy: 0.09068

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.059335339814424515
Inter Cos: 0.046818364411592484
Norm Quadratic Average: 1.3565531969070435
Nearest Class Center Accuracy: 0.0956

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.11742229759693146
Inter Cos: 0.061194825917482376
Norm Quadratic Average: 1.138709545135498
Nearest Class Center Accuracy: 0.09794

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3836415708065033
Inter Cos: 0.12892667949199677
Norm Quadratic Average: 0.9089151620864868
Nearest Class Center Accuracy: 0.09894

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8012621998786926
Inter Cos: 0.17254431545734406
Norm Quadratic Average: 0.5956467390060425
Nearest Class Center Accuracy: 0.1

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9276232719421387
Inter Cos: 0.2602764070034027
Norm Quadratic Average: 0.6305347681045532
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9627535343170166
Inter Cos: 0.326470285654068
Norm Quadratic Average: 1.1639117002487183
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 4.033622741699219
Linear Weight Rank: 1320
Intra Cos: 0.9826443195343018
Inter Cos: 0.380379855632782
Norm Quadratic Average: 38.60234069824219
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 4.395262718200684
Linear Weight Rank: 1790
Intra Cos: 0.985271155834198
Inter Cos: 0.3821142911911011
Norm Quadratic Average: 32.74985885620117
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.491694450378418
Linear Weight Rank: 97
Intra Cos: 0.9854147434234619
Inter Cos: 0.397737592458725
Norm Quadratic Average: 31.20213508605957
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9868525862693787
Inter Cos: 0.45217734575271606
Norm Quadratic Average: 32.63718795776367
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 1.946573350906372
Accuracy: 0.6213
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.15737760066986084, Weights: 0.01835346221923828
NC2 Equiangle: Features: 0.21501380997474748, Weights: 0.15886404326467804
NC3 Self-Duality: 0.22063660621643066
NC4 NCC Mismatch: 0.0676

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621266715228558
Inter Cos: 0.406754732131958
Norm Quadratic Average: 29.42218780517578
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.007920677773654461
Inter Cos: 0.2130092829465866
Norm Quadratic Average: 12.467658042907715
Nearest Class Center Accuracy: 0.2079

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012004236690700054
Inter Cos: 0.2457040399312973
Norm Quadratic Average: 8.638520240783691
Nearest Class Center Accuracy: 0.3634

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0112281059846282
Inter Cos: 0.15975727140903473
Norm Quadratic Average: 6.379063129425049
Nearest Class Center Accuracy: 0.4753

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015383892692625523
Inter Cos: 0.19364777207374573
Norm Quadratic Average: 4.715294361114502
Nearest Class Center Accuracy: 0.5331

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015136810950934887
Inter Cos: 0.16770848631858826
Norm Quadratic Average: 3.5985047817230225
Nearest Class Center Accuracy: 0.5749

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014840270392596722
Inter Cos: 0.1442134976387024
Norm Quadratic Average: 3.4741735458374023
Nearest Class Center Accuracy: 0.5953

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012536159716546535
Inter Cos: 0.1196729764342308
Norm Quadratic Average: 3.496999740600586
Nearest Class Center Accuracy: 0.6143

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016085606068372726
Inter Cos: 0.14468087255954742
Norm Quadratic Average: 2.541860342025757
Nearest Class Center Accuracy: 0.6556

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016123604029417038
Inter Cos: 0.1494160294532776
Norm Quadratic Average: 1.6496347188949585
Nearest Class Center Accuracy: 0.685

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021093670278787613
Inter Cos: 0.2052287608385086
Norm Quadratic Average: 1.3110004663467407
Nearest Class Center Accuracy: 0.6688

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03503970056772232
Inter Cos: 0.28175103664398193
Norm Quadratic Average: 1.054895281791687
Nearest Class Center Accuracy: 0.6326

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.13979768753051758
Inter Cos: 0.4034935235977173
Norm Quadratic Average: 0.7801164388656616
Nearest Class Center Accuracy: 0.5617

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2140199840068817
Inter Cos: 0.43011975288391113
Norm Quadratic Average: 0.4788557291030884
Nearest Class Center Accuracy: 0.5882

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.240480437874794
Inter Cos: 0.4460752010345459
Norm Quadratic Average: 0.5056882500648499
Nearest Class Center Accuracy: 0.6172

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2585335671901703
Inter Cos: 0.5069941878318787
Norm Quadratic Average: 1.007094383239746
Nearest Class Center Accuracy: 0.6243

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 4.033622741699219
Linear Weight Rank: 1320
Intra Cos: 0.26014477014541626
Inter Cos: 0.5550859570503235
Norm Quadratic Average: 34.17934036254883
Nearest Class Center Accuracy: 0.6256

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 4.395262718200684
Linear Weight Rank: 1790
Intra Cos: 0.2747909426689148
Inter Cos: 0.5495753884315491
Norm Quadratic Average: 29.63721466064453
Nearest Class Center Accuracy: 0.6245

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.491694450378418
Linear Weight Rank: 97
Intra Cos: 0.283716082572937
Inter Cos: 0.5385125875473022
Norm Quadratic Average: 28.680191040039062
Nearest Class Center Accuracy: 0.6222

Output Layer:
Intra Cos: 0.30559682846069336
Inter Cos: 0.5470841526985168
Norm Quadratic Average: 30.051454544067383
Nearest Class Center Accuracy: 0.6227

