Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.0003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893192246556282
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326313018798828
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.030439645051956177
Inter Cos: 0.03515039384365082
Norm Quadratic Average: 54.704891204833984
Nearest Class Center Accuracy: 0.04356

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02419714815914631
Inter Cos: 0.026083054021000862
Norm Quadratic Average: 72.3411636352539
Nearest Class Center Accuracy: 0.05504

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023237427696585655
Inter Cos: 0.028125274926424026
Norm Quadratic Average: 124.53913116455078
Nearest Class Center Accuracy: 0.06118

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025477251037955284
Inter Cos: 0.027858151122927666
Norm Quadratic Average: 113.21357727050781
Nearest Class Center Accuracy: 0.0669

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.027444442734122276
Inter Cos: 0.03481312468647957
Norm Quadratic Average: 142.2611083984375
Nearest Class Center Accuracy: 0.06942

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.029163192957639694
Inter Cos: 0.03584469482302666
Norm Quadratic Average: 149.1909637451172
Nearest Class Center Accuracy: 0.0725

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02952129766345024
Inter Cos: 0.03736279904842377
Norm Quadratic Average: 154.57363891601562
Nearest Class Center Accuracy: 0.0744

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04507859796285629
Inter Cos: 0.042494580149650574
Norm Quadratic Average: 87.95853424072266
Nearest Class Center Accuracy: 0.08016

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05121646076440811
Inter Cos: 0.04673305153846741
Norm Quadratic Average: 61.71517562866211
Nearest Class Center Accuracy: 0.08248

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07250987738370895
Inter Cos: 0.06818654388189316
Norm Quadratic Average: 33.94632339477539
Nearest Class Center Accuracy: 0.0856

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.12752050161361694
Inter Cos: 0.11524893343448639
Norm Quadratic Average: 19.343177795410156
Nearest Class Center Accuracy: 0.08954

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3330698609352112
Inter Cos: 0.2570624351501465
Norm Quadratic Average: 9.258831024169922
Nearest Class Center Accuracy: 0.09214

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6582418084144592
Inter Cos: 0.43368205428123474
Norm Quadratic Average: 6.830636978149414
Nearest Class Center Accuracy: 0.09554

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7900986075401306
Inter Cos: 0.47806331515312195
Norm Quadratic Average: 5.9668660163879395
Nearest Class Center Accuracy: 0.09822

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8450576663017273
Inter Cos: 0.5044058561325073
Norm Quadratic Average: 5.667980670928955
Nearest Class Center Accuracy: 0.0997

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 39.00918960571289
Linear Weight Rank: 4031
Intra Cos: 0.8726136088371277
Inter Cos: 0.4822593629360199
Norm Quadratic Average: 36.92079544067383
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 18.144420623779297
Linear Weight Rank: 3662
Intra Cos: 0.876592755317688
Inter Cos: 0.4458070993423462
Norm Quadratic Average: 36.23032760620117
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 9.611570358276367
Linear Weight Rank: 98
Intra Cos: 0.8885073065757751
Inter Cos: 0.4560665190219879
Norm Quadratic Average: 36.03968811035156
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9322953224182129
Inter Cos: 0.655335545539856
Norm Quadratic Average: 62.42167663574219
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 3.931506763458252
Accuracy: 0.4982
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.31010815501213074, Weights: 0.044009413570165634
NC2 Equiangle: Features: 0.2234445036300505, Weights: 0.11711872139362374
NC3 Self-Duality: 0.5246506929397583
NC4 NCC Mismatch: 0.15439999999999998

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422183990478516
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013573835603892803
Inter Cos: 0.2552262544631958
Norm Quadratic Average: 55.002201080322266
Nearest Class Center Accuracy: 0.2171

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015829846262931824
Inter Cos: 0.22101356089115143
Norm Quadratic Average: 72.82815551757812
Nearest Class Center Accuracy: 0.3314

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014114144258201122
Inter Cos: 0.17231330275535583
Norm Quadratic Average: 125.36678314208984
Nearest Class Center Accuracy: 0.3995

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018473919481039047
Inter Cos: 0.21711957454681396
Norm Quadratic Average: 114.07481384277344
Nearest Class Center Accuracy: 0.4477

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01882323995232582
Inter Cos: 0.1951482594013214
Norm Quadratic Average: 143.32725524902344
Nearest Class Center Accuracy: 0.48

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01918383687734604
Inter Cos: 0.1890893280506134
Norm Quadratic Average: 150.2378692626953
Nearest Class Center Accuracy: 0.5075

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021079178899526596
Inter Cos: 0.1858639419078827
Norm Quadratic Average: 155.4958038330078
Nearest Class Center Accuracy: 0.5199

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02330087125301361
Inter Cos: 0.22428163886070251
Norm Quadratic Average: 88.28266906738281
Nearest Class Center Accuracy: 0.5464

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02416561171412468
Inter Cos: 0.20392738282680511
Norm Quadratic Average: 61.37338638305664
Nearest Class Center Accuracy: 0.5491

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03222513198852539
Inter Cos: 0.2516153156757355
Norm Quadratic Average: 33.1905517578125
Nearest Class Center Accuracy: 0.5411

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05328452214598656
Inter Cos: 0.3221411406993866
Norm Quadratic Average: 18.516393661499023
Nearest Class Center Accuracy: 0.52

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.12322556227445602
Inter Cos: 0.47642362117767334
Norm Quadratic Average: 8.5562105178833
Nearest Class Center Accuracy: 0.4845

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1999439001083374
Inter Cos: 0.5721808671951294
Norm Quadratic Average: 6.093329906463623
Nearest Class Center Accuracy: 0.4759

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.19757512211799622
Inter Cos: 0.5792653560638428
Norm Quadratic Average: 5.248083591461182
Nearest Class Center Accuracy: 0.4805

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.163909450173378
Inter Cos: 0.590285062789917
Norm Quadratic Average: 4.989124298095703
Nearest Class Center Accuracy: 0.4924

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 39.00918960571289
Linear Weight Rank: 4031
Intra Cos: 0.15584273636341095
Inter Cos: 0.5921778678894043
Norm Quadratic Average: 32.62278747558594
Nearest Class Center Accuracy: 0.4944

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 18.144420623779297
Linear Weight Rank: 3662
Intra Cos: 0.14710105955600739
Inter Cos: 0.5857464075088501
Norm Quadratic Average: 32.080322265625
Nearest Class Center Accuracy: 0.4969

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 9.611570358276367
Linear Weight Rank: 98
Intra Cos: 0.14998970925807953
Inter Cos: 0.6077612638473511
Norm Quadratic Average: 31.93107032775879
Nearest Class Center Accuracy: 0.4956

Output Layer:
Intra Cos: 0.1633068323135376
Inter Cos: 0.7185937166213989
Norm Quadratic Average: 55.55760192871094
Nearest Class Center Accuracy: 0.4921

