Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893190383911133
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326326370239258
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014124843291938305
Inter Cos: 0.029859544709324837
Norm Quadratic Average: 30.674415588378906
Nearest Class Center Accuracy: 0.03954

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018429983407258987
Inter Cos: 0.038564857095479965
Norm Quadratic Average: 20.747039794921875
Nearest Class Center Accuracy: 0.05744

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015277666039764881
Inter Cos: 0.028031667694449425
Norm Quadratic Average: 16.15696907043457
Nearest Class Center Accuracy: 0.06386

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021296823397278786
Inter Cos: 0.02102174237370491
Norm Quadratic Average: 11.55813217163086
Nearest Class Center Accuracy: 0.07064

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0199901033192873
Inter Cos: 0.020346153527498245
Norm Quadratic Average: 9.049527168273926
Nearest Class Center Accuracy: 0.07472

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02165248990058899
Inter Cos: 0.02113446779549122
Norm Quadratic Average: 8.973531723022461
Nearest Class Center Accuracy: 0.07696

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021410129964351654
Inter Cos: 0.019475452601909637
Norm Quadratic Average: 8.965116500854492
Nearest Class Center Accuracy: 0.07908

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03232923895120621
Inter Cos: 0.027686435729265213
Norm Quadratic Average: 6.103627681732178
Nearest Class Center Accuracy: 0.08592

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.042563434690237045
Inter Cos: 0.03188997879624367
Norm Quadratic Average: 4.4269700050354
Nearest Class Center Accuracy: 0.0901

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0624469630420208
Inter Cos: 0.04220719635486603
Norm Quadratic Average: 3.8112895488739014
Nearest Class Center Accuracy: 0.09386

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09417463839054108
Inter Cos: 0.06291285157203674
Norm Quadratic Average: 3.573417901992798
Nearest Class Center Accuracy: 0.09676

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2208380550146103
Inter Cos: 0.1315063089132309
Norm Quadratic Average: 2.796647787094116
Nearest Class Center Accuracy: 0.09898

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5924172401428223
Inter Cos: 0.22074738144874573
Norm Quadratic Average: 1.7121530771255493
Nearest Class Center Accuracy: 0.1

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7989187240600586
Inter Cos: 0.20803983509540558
Norm Quadratic Average: 1.6582499742507935
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8853371739387512
Inter Cos: 0.19987890124320984
Norm Quadratic Average: 1.500290870666504
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 6.308125019073486
Linear Weight Rank: 4024
Intra Cos: 0.9475510716438293
Inter Cos: 0.2582235336303711
Norm Quadratic Average: 37.23284912109375
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 6.2681074142456055
Linear Weight Rank: 3535
Intra Cos: 0.9561496376991272
Inter Cos: 0.2969888150691986
Norm Quadratic Average: 30.86688804626465
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 6.145127296447754
Linear Weight Rank: 98
Intra Cos: 0.955897331237793
Inter Cos: 0.3003554344177246
Norm Quadratic Average: 29.870119094848633
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9630336761474609
Inter Cos: 0.4108496308326721
Norm Quadratic Average: 35.606346130371094
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 2.351977066040039
Accuracy: 0.5974
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.16317635774612427, Weights: 0.02350442111492157
NC2 Equiangle: Features: 0.20031723484848485, Weights: 0.11612405796243687
NC3 Self-Duality: 0.3492422103881836
NC4 NCC Mismatch: 0.06989999999999996

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422189712524414
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.007254830561578274
Inter Cos: 0.192569300532341
Norm Quadratic Average: 30.87045669555664
Nearest Class Center Accuracy: 0.2229

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0110051603987813
Inter Cos: 0.23147350549697876
Norm Quadratic Average: 20.885787963867188
Nearest Class Center Accuracy: 0.3656

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01033769454807043
Inter Cos: 0.1424073576927185
Norm Quadratic Average: 16.232250213623047
Nearest Class Center Accuracy: 0.4793

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014557168819010258
Inter Cos: 0.1723795384168625
Norm Quadratic Average: 11.600366592407227
Nearest Class Center Accuracy: 0.5261

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015388243831694126
Inter Cos: 0.1504514217376709
Norm Quadratic Average: 9.073929786682129
Nearest Class Center Accuracy: 0.5752

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014790409244596958
Inter Cos: 0.13265055418014526
Norm Quadratic Average: 8.982013702392578
Nearest Class Center Accuracy: 0.5936

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012878666631877422
Inter Cos: 0.11871248483657837
Norm Quadratic Average: 8.96201229095459
Nearest Class Center Accuracy: 0.6138

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015792153775691986
Inter Cos: 0.14520519971847534
Norm Quadratic Average: 6.092923641204834
Nearest Class Center Accuracy: 0.6427

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017695512622594833
Inter Cos: 0.156762033700943
Norm Quadratic Average: 4.382720947265625
Nearest Class Center Accuracy: 0.6633

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021867692470550537
Inter Cos: 0.18972434103488922
Norm Quadratic Average: 3.7120449542999268
Nearest Class Center Accuracy: 0.6555

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03093118593096733
Inter Cos: 0.24425651133060455
Norm Quadratic Average: 3.4121813774108887
Nearest Class Center Accuracy: 0.6396

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08076997846364975
Inter Cos: 0.3518402874469757
Norm Quadratic Average: 2.56158709526062
Nearest Class Center Accuracy: 0.6009

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.170210063457489
Inter Cos: 0.471737265586853
Norm Quadratic Average: 1.4738390445709229
Nearest Class Center Accuracy: 0.5878

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.21615347266197205
Inter Cos: 0.4396938681602478
Norm Quadratic Average: 1.3628162145614624
Nearest Class Center Accuracy: 0.5847

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.21224108338356018
Inter Cos: 0.42338743805885315
Norm Quadratic Average: 1.3042601346969604
Nearest Class Center Accuracy: 0.6034

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 6.308125019073486
Linear Weight Rank: 4024
Intra Cos: 0.23442323505878448
Inter Cos: 0.48344698548316956
Norm Quadratic Average: 32.827640533447266
Nearest Class Center Accuracy: 0.6051

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 6.2681074142456055
Linear Weight Rank: 3535
Intra Cos: 0.25905299186706543
Inter Cos: 0.5065256357192993
Norm Quadratic Average: 28.018117904663086
Nearest Class Center Accuracy: 0.6024

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 6.145127296447754
Linear Weight Rank: 98
Intra Cos: 0.27186986804008484
Inter Cos: 0.5301785469055176
Norm Quadratic Average: 27.760313034057617
Nearest Class Center Accuracy: 0.6011

Output Layer:
Intra Cos: 0.29676857590675354
Inter Cos: 0.6047400236129761
Norm Quadratic Average: 33.34192657470703
Nearest Class Center Accuracy: 0.6006

