Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_100_lr_0.001_model_type_vgg19_train_samples_None_weight_decay_0.005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477276891469955
Norm Quadratic Average: 27.597177505493164
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015089196152985096
Inter Cos: 0.0637686550617218
Norm Quadratic Average: 33.1578483581543
Nearest Class Center Accuracy: 0.35038

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017899349331855774
Inter Cos: 0.06280004978179932
Norm Quadratic Average: 19.60127067565918
Nearest Class Center Accuracy: 0.44768

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015326286666095257
Inter Cos: 0.052090808749198914
Norm Quadratic Average: 20.827476501464844
Nearest Class Center Accuracy: 0.49942

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01779242232441902
Inter Cos: 0.05417722463607788
Norm Quadratic Average: 14.069567680358887
Nearest Class Center Accuracy: 0.5745

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01783985085785389
Inter Cos: 0.04730599746108055
Norm Quadratic Average: 14.77578353881836
Nearest Class Center Accuracy: 0.61524

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019913719967007637
Inter Cos: 0.041797835379838943
Norm Quadratic Average: 14.850503921508789
Nearest Class Center Accuracy: 0.65022

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02173873409628868
Inter Cos: 0.03809181973338127
Norm Quadratic Average: 14.964996337890625
Nearest Class Center Accuracy: 0.69034

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.037207525223493576
Inter Cos: 0.06223073601722717
Norm Quadratic Average: 9.943094253540039
Nearest Class Center Accuracy: 0.77016

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06080864742398262
Inter Cos: 0.07254575192928314
Norm Quadratic Average: 10.726256370544434
Nearest Class Center Accuracy: 0.83924

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09474711120128632
Inter Cos: 0.07593299448490143
Norm Quadratic Average: 10.858280181884766
Nearest Class Center Accuracy: 0.90402

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.14053140580654144
Inter Cos: 0.08015769720077515
Norm Quadratic Average: 10.852300643920898
Nearest Class Center Accuracy: 0.956

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3141337037086487
Inter Cos: 0.12756948173046112
Norm Quadratic Average: 7.683297157287598
Nearest Class Center Accuracy: 0.98992

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6131818890571594
Inter Cos: 0.10776539146900177
Norm Quadratic Average: 5.390312194824219
Nearest Class Center Accuracy: 0.99982

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7808617949485779
Inter Cos: 0.050955772399902344
Norm Quadratic Average: 5.697296619415283
Nearest Class Center Accuracy: 1.0

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8718720078468323
Inter Cos: 0.03495177999138832
Norm Quadratic Average: 5.85487699508667
Nearest Class Center Accuracy: 1.0

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 22.42884635925293
Linear Weight Rank: 4031
Intra Cos: 0.9535843133926392
Inter Cos: -0.043552104383707047
Norm Quadratic Average: 53.25801467895508
Nearest Class Center Accuracy: 1.0

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 9.204693794250488
Linear Weight Rank: 3669
Intra Cos: 0.9752075672149658
Inter Cos: -0.00706201558932662
Norm Quadratic Average: 28.226327896118164
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.78765869140625
Linear Weight Rank: 10
Intra Cos: 0.9777564406394958
Inter Cos: 0.0699302926659584
Norm Quadratic Average: 16.220705032348633
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9843928813934326
Inter Cos: 0.2008133977651596
Norm Quadratic Average: 9.594691276550293
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.6781870307922363
Accuracy: 0.8295
NC1 Within Class Collapse: 4.196811676025391
NC2 Equinorm: Features: 0.13131101429462433, Weights: 0.009004793129861355
NC2 Equiangle: Features: 0.12600713306003147, Weights: 0.04105453491210938
NC3 Self-Duality: 0.07232221961021423
NC4 NCC Mismatch: 0.017000000000000015

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018480459228157997
Inter Cos: 0.09352368116378784
Norm Quadratic Average: 27.530664443969727
Nearest Class Center Accuracy: 0.2895

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014710504561662674
Inter Cos: 0.05946292355656624
Norm Quadratic Average: 33.11055374145508
Nearest Class Center Accuracy: 0.3965

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01720007322728634
Inter Cos: 0.058759089559316635
Norm Quadratic Average: 19.58050537109375
Nearest Class Center Accuracy: 0.508

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014669844880700111
Inter Cos: 0.04844231531023979
Norm Quadratic Average: 20.809043884277344
Nearest Class Center Accuracy: 0.5805

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01610242761671543
Inter Cos: 0.0504307895898819
Norm Quadratic Average: 14.050457954406738
Nearest Class Center Accuracy: 0.639

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01604704186320305
Inter Cos: 0.04440496861934662
Norm Quadratic Average: 14.758230209350586
Nearest Class Center Accuracy: 0.678

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018034685403108597
Inter Cos: 0.039677564054727554
Norm Quadratic Average: 14.835187911987305
Nearest Class Center Accuracy: 0.6965

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019675545394420624
Inter Cos: 0.03952537477016449
Norm Quadratic Average: 14.947142601013184
Nearest Class Center Accuracy: 0.7255

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.030735516920685768
Inter Cos: 0.06562142074108124
Norm Quadratic Average: 9.92834758758545
Nearest Class Center Accuracy: 0.75

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04757630452513695
Inter Cos: 0.0778549313545227
Norm Quadratic Average: 10.692948341369629
Nearest Class Center Accuracy: 0.7715

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06854218989610672
Inter Cos: 0.08466748893260956
Norm Quadratic Average: 10.79971981048584
Nearest Class Center Accuracy: 0.7885

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09249737858772278
Inter Cos: 0.09377027302980423
Norm Quadratic Average: 10.744817733764648
Nearest Class Center Accuracy: 0.8045

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.203464537858963
Inter Cos: 0.15787620842456818
Norm Quadratic Average: 7.49630880355835
Nearest Class Center Accuracy: 0.8195

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3335142731666565
Inter Cos: 0.22433310747146606
Norm Quadratic Average: 5.088244915008545
Nearest Class Center Accuracy: 0.8215

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.38817253708839417
Inter Cos: 0.23183658719062805
Norm Quadratic Average: 5.257531642913818
Nearest Class Center Accuracy: 0.8255

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4116184115409851
Inter Cos: 0.22337296605110168
Norm Quadratic Average: 5.338393688201904
Nearest Class Center Accuracy: 0.8295

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 22.42884635925293
Linear Weight Rank: 4031
Intra Cos: 0.4554215669631958
Inter Cos: 0.19927047193050385
Norm Quadratic Average: 47.45600509643555
Nearest Class Center Accuracy: 0.831

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 9.204693794250488
Linear Weight Rank: 3669
Intra Cos: 0.47822532057762146
Inter Cos: 0.21836896240711212
Norm Quadratic Average: 25.050094604492188
Nearest Class Center Accuracy: 0.83

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.78765869140625
Linear Weight Rank: 10
Intra Cos: 0.4870532751083374
Inter Cos: 0.2507188320159912
Norm Quadratic Average: 14.457667350769043
Nearest Class Center Accuracy: 0.83

Output Layer:
Intra Cos: 0.5139690041542053
Inter Cos: 0.3195478320121765
Norm Quadratic Average: 8.583935737609863
Nearest Class Center Accuracy: 0.8305

