Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.0003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597183227539062
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011424615979194641
Inter Cos: 0.05404382571578026
Norm Quadratic Average: 59.79438781738281
Nearest Class Center Accuracy: 0.34946

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01592862978577614
Inter Cos: 0.06536857038736343
Norm Quadratic Average: 34.3059196472168
Nearest Class Center Accuracy: 0.47178

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013080247677862644
Inter Cos: 0.055046793073415756
Norm Quadratic Average: 32.60039520263672
Nearest Class Center Accuracy: 0.53966

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016215918585658073
Inter Cos: 0.049492549151182175
Norm Quadratic Average: 21.492305755615234
Nearest Class Center Accuracy: 0.60968

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016580283641815186
Inter Cos: 0.04002954810857773
Norm Quadratic Average: 22.183082580566406
Nearest Class Center Accuracy: 0.6564

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018970033153891563
Inter Cos: 0.03620213270187378
Norm Quadratic Average: 21.89805793762207
Nearest Class Center Accuracy: 0.70446

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021864257752895355
Inter Cos: 0.03219180926680565
Norm Quadratic Average: 22.105024337768555
Nearest Class Center Accuracy: 0.75276

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04365792125463486
Inter Cos: 0.05840350687503815
Norm Quadratic Average: 15.596280097961426
Nearest Class Center Accuracy: 0.84132

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09074341505765915
Inter Cos: 0.0734887346625328
Norm Quadratic Average: 17.928096771240234
Nearest Class Center Accuracy: 0.91726

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.16457398235797882
Inter Cos: 0.08053366839885712
Norm Quadratic Average: 18.592832565307617
Nearest Class Center Accuracy: 0.95654

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2545870542526245
Inter Cos: 0.10279776901006699
Norm Quadratic Average: 19.04549217224121
Nearest Class Center Accuracy: 0.97736

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4745599925518036
Inter Cos: 0.19523371756076813
Norm Quadratic Average: 15.038661003112793
Nearest Class Center Accuracy: 0.9862

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7343758940696716
Inter Cos: 0.12991705536842346
Norm Quadratic Average: 10.467549324035645
Nearest Class Center Accuracy: 0.99848

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.803246259689331
Inter Cos: 0.03304416686296463
Norm Quadratic Average: 11.031742095947266
Nearest Class Center Accuracy: 0.99996

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8151451945304871
Inter Cos: -0.004736620932817459
Norm Quadratic Average: 11.547309875488281
Nearest Class Center Accuracy: 0.99998

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 38.506961822509766
Linear Weight Rank: 4031
Intra Cos: 0.8888724446296692
Inter Cos: 0.07351961731910706
Norm Quadratic Average: 69.71732330322266
Nearest Class Center Accuracy: 1.0

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 16.028650283813477
Linear Weight Rank: 3669
Intra Cos: 0.9667499661445618
Inter Cos: 0.10426487773656845
Norm Quadratic Average: 38.92295837402344
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.8620340824127197
Linear Weight Rank: 10
Intra Cos: 0.9631507992744446
Inter Cos: 0.06851881742477417
Norm Quadratic Average: 22.941577911376953
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.992249608039856
Inter Cos: 0.24420149624347687
Norm Quadratic Average: 18.67768669128418
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.8974620392799377
Accuracy: 0.8638
NC1 Within Class Collapse: 3.263929843902588
NC2 Equinorm: Features: 0.1534869521856308, Weights: 0.018430035561323166
NC2 Equiangle: Features: 0.11530692842271593, Weights: 0.09689805772569444
NC3 Self-Duality: 0.40446481108665466
NC4 NCC Mismatch: 0.03049999999999997

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526075407862663
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550134658813477
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010211425833404064
Inter Cos: 0.054979849606752396
Norm Quadratic Average: 59.74907302856445
Nearest Class Center Accuracy: 0.3714

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014853821136057377
Inter Cos: 0.06629558652639389
Norm Quadratic Average: 34.290382385253906
Nearest Class Center Accuracy: 0.4884

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012310173362493515
Inter Cos: 0.055476292967796326
Norm Quadratic Average: 32.59566116333008
Nearest Class Center Accuracy: 0.5511

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015063599683344364
Inter Cos: 0.049773719161748886
Norm Quadratic Average: 21.492656707763672
Nearest Class Center Accuracy: 0.6136

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015111387707293034
Inter Cos: 0.040064647793769836
Norm Quadratic Average: 22.182174682617188
Nearest Class Center Accuracy: 0.6546

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016914887353777885
Inter Cos: 0.03643924742937088
Norm Quadratic Average: 21.88675308227539
Nearest Class Center Accuracy: 0.6873

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018858490511775017
Inter Cos: 0.03315858915448189
Norm Quadratic Average: 22.069721221923828
Nearest Class Center Accuracy: 0.721

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03441358357667923
Inter Cos: 0.06011149659752846
Norm Quadratic Average: 15.545605659484863
Nearest Class Center Accuracy: 0.7715

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0670504942536354
Inter Cos: 0.07808316498994827
Norm Quadratic Average: 17.794771194458008
Nearest Class Center Accuracy: 0.8063

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.11449208110570908
Inter Cos: 0.08560899645090103
Norm Quadratic Average: 18.341238021850586
Nearest Class Center Accuracy: 0.823

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1725759506225586
Inter Cos: 0.116547591984272
Norm Quadratic Average: 18.656997680664062
Nearest Class Center Accuracy: 0.832

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.35973799228668213
Inter Cos: 0.25133419036865234
Norm Quadratic Average: 14.564046859741211
Nearest Class Center Accuracy: 0.8257

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5374050140380859
Inter Cos: 0.28695282340049744
Norm Quadratic Average: 9.909582138061523
Nearest Class Center Accuracy: 0.8401

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5521485805511475
Inter Cos: 0.24707259237766266
Norm Quadratic Average: 10.286538124084473
Nearest Class Center Accuracy: 0.849

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5371133685112
Inter Cos: 0.18155591189861298
Norm Quadratic Average: 10.650046348571777
Nearest Class Center Accuracy: 0.8516

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 38.506961822509766
Linear Weight Rank: 4031
Intra Cos: 0.5711186528205872
Inter Cos: 0.18327003717422485
Norm Quadratic Average: 63.848724365234375
Nearest Class Center Accuracy: 0.8536

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 16.028650283813477
Linear Weight Rank: 3669
Intra Cos: 0.5336755514144897
Inter Cos: 0.1528254747390747
Norm Quadratic Average: 35.31914138793945
Nearest Class Center Accuracy: 0.8598

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.8620340824127197
Linear Weight Rank: 10
Intra Cos: 0.5222899317741394
Inter Cos: 0.1653972566127777
Norm Quadratic Average: 21.137847900390625
Nearest Class Center Accuracy: 0.8596

Output Layer:
Intra Cos: 0.5928104519844055
Inter Cos: 0.3095172643661499
Norm Quadratic Average: 16.83583641052246
Nearest Class Center Accuracy: 0.8627

