Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02289319410920143
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326311111450195
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.027605576440691948
Inter Cos: 0.042673058807849884
Norm Quadratic Average: 44.082149505615234
Nearest Class Center Accuracy: 0.04166

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02395043708384037
Inter Cos: 0.030490882694721222
Norm Quadratic Average: 53.206642150878906
Nearest Class Center Accuracy: 0.05156

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026769133284687996
Inter Cos: 0.028422178700566292
Norm Quadratic Average: 86.01911163330078
Nearest Class Center Accuracy: 0.0603

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.029370833188295364
Inter Cos: 0.03011968731880188
Norm Quadratic Average: 72.94052124023438
Nearest Class Center Accuracy: 0.06634

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03211737424135208
Inter Cos: 0.04104482755064964
Norm Quadratic Average: 85.0758056640625
Nearest Class Center Accuracy: 0.06882

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.033723048865795135
Inter Cos: 0.03948952630162239
Norm Quadratic Average: 87.68146514892578
Nearest Class Center Accuracy: 0.07126

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03260967507958412
Inter Cos: 0.03067762218415737
Norm Quadratic Average: 76.8052749633789
Nearest Class Center Accuracy: 0.07372

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04354611411690712
Inter Cos: 0.034613028168678284
Norm Quadratic Average: 33.08962631225586
Nearest Class Center Accuracy: 0.07924

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05496211349964142
Inter Cos: 0.043520595878362656
Norm Quadratic Average: 16.3651180267334
Nearest Class Center Accuracy: 0.08262

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10557891428470612
Inter Cos: 0.07997262477874756
Norm Quadratic Average: 6.099059104919434
Nearest Class Center Accuracy: 0.08724

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.26213786005973816
Inter Cos: 0.20512476563453674
Norm Quadratic Average: 3.284745454788208
Nearest Class Center Accuracy: 0.09426

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5343164205551147
Inter Cos: 0.4050048589706421
Norm Quadratic Average: 1.9216375350952148
Nearest Class Center Accuracy: 0.09894

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8392783403396606
Inter Cos: 0.590688943862915
Norm Quadratic Average: 2.1312034130096436
Nearest Class Center Accuracy: 0.09986

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.890842616558075
Inter Cos: 0.6136404275894165
Norm Quadratic Average: 3.4673287868499756
Nearest Class Center Accuracy: 0.0999

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9015994071960449
Inter Cos: 0.6227156519889832
Norm Quadratic Average: 5.797793388366699
Nearest Class Center Accuracy: 0.09996

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 6.211599349975586
Linear Weight Rank: 4026
Intra Cos: 0.9008446335792542
Inter Cos: 0.6037775874137878
Norm Quadratic Average: 54.10296630859375
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 6.657352447509766
Linear Weight Rank: 3573
Intra Cos: 0.8913155794143677
Inter Cos: 0.563992977142334
Norm Quadratic Average: 61.95554733276367
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 6.361692905426025
Linear Weight Rank: 98
Intra Cos: 0.8749723434448242
Inter Cos: 0.505560576915741
Norm Quadratic Average: 53.89961242675781
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9084492921829224
Inter Cos: 0.5784881114959717
Norm Quadratic Average: 64.53880310058594
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 4.116710294342041
Accuracy: 0.4803
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.2495700865983963, Weights: 0.04407847300171852
NC2 Equiangle: Features: 0.25778793797348487, Weights: 0.10105984157986111
NC3 Self-Duality: 0.5266591310501099
NC4 NCC Mismatch: 0.21209999999999996

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621266715228558
Inter Cos: 0.406754732131958
Norm Quadratic Average: 29.42218780517578
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014288867823779583
Inter Cos: 0.2640962600708008
Norm Quadratic Average: 44.30754089355469
Nearest Class Center Accuracy: 0.2062

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017878025770187378
Inter Cos: 0.2670592963695526
Norm Quadratic Average: 53.51748275756836
Nearest Class Center Accuracy: 0.3045

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01649509370326996
Inter Cos: 0.24141082167625427
Norm Quadratic Average: 86.59452056884766
Nearest Class Center Accuracy: 0.367

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022154204547405243
Inter Cos: 0.2539421617984772
Norm Quadratic Average: 73.51187133789062
Nearest Class Center Accuracy: 0.4233

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023392125964164734
Inter Cos: 0.2406308352947235
Norm Quadratic Average: 85.7593002319336
Nearest Class Center Accuracy: 0.4476

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024176087230443954
Inter Cos: 0.23700949549674988
Norm Quadratic Average: 88.36399841308594
Nearest Class Center Accuracy: 0.4712

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021845679730176926
Inter Cos: 0.19567684829235077
Norm Quadratic Average: 77.35076904296875
Nearest Class Center Accuracy: 0.5121

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024999599903821945
Inter Cos: 0.21680909395217896
Norm Quadratic Average: 33.2461051940918
Nearest Class Center Accuracy: 0.5558

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02960789203643799
Inter Cos: 0.21512797474861145
Norm Quadratic Average: 16.32672119140625
Nearest Class Center Accuracy: 0.5699

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.047804757952690125
Inter Cos: 0.32391005754470825
Norm Quadratic Average: 5.97982120513916
Nearest Class Center Accuracy: 0.5458

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09475758671760559
Inter Cos: 0.48103395104408264
Norm Quadratic Average: 3.1740763187408447
Nearest Class Center Accuracy: 0.5266

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.17149753868579865
Inter Cos: 0.6261848211288452
Norm Quadratic Average: 1.809065341949463
Nearest Class Center Accuracy: 0.5099

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2609480321407318
Inter Cos: 0.7256680130958557
Norm Quadratic Average: 1.9161697626113892
Nearest Class Center Accuracy: 0.4821

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.27128341794013977
Inter Cos: 0.7426249980926514
Norm Quadratic Average: 3.081106185913086
Nearest Class Center Accuracy: 0.4752

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.26363638043403625
Inter Cos: 0.7449890971183777
Norm Quadratic Average: 5.138166904449463
Nearest Class Center Accuracy: 0.4741

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 6.211599349975586
Linear Weight Rank: 4026
Intra Cos: 0.2531817555427551
Inter Cos: 0.7261236310005188
Norm Quadratic Average: 48.270320892333984
Nearest Class Center Accuracy: 0.4751

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 6.657352447509766
Linear Weight Rank: 3573
Intra Cos: 0.2467385083436966
Inter Cos: 0.6982241868972778
Norm Quadratic Average: 56.01605987548828
Nearest Class Center Accuracy: 0.4787

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 6.361692905426025
Linear Weight Rank: 98
Intra Cos: 0.21625837683677673
Inter Cos: 0.6678978204727173
Norm Quadratic Average: 48.61183166503906
Nearest Class Center Accuracy: 0.4816

Output Layer:
Intra Cos: 0.22873573005199432
Inter Cos: 0.7337484955787659
Norm Quadratic Average: 58.0789794921875
Nearest Class Center Accuracy: 0.4778

