Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.0001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477276891469955
Norm Quadratic Average: 27.597177505493164
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013482807204127312
Inter Cos: 0.061628375202417374
Norm Quadratic Average: 113.39519500732422
Nearest Class Center Accuracy: 0.3522

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015737561509013176
Inter Cos: 0.06007704883813858
Norm Quadratic Average: 63.576839447021484
Nearest Class Center Accuracy: 0.4632

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013989384286105633
Inter Cos: 0.053755730390548706
Norm Quadratic Average: 65.35851287841797
Nearest Class Center Accuracy: 0.5278

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01787623018026352
Inter Cos: 0.04998769238591194
Norm Quadratic Average: 45.2359733581543
Nearest Class Center Accuracy: 0.60264

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018954062834382057
Inter Cos: 0.04266421124339104
Norm Quadratic Average: 47.26259994506836
Nearest Class Center Accuracy: 0.64998

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021058734506368637
Inter Cos: 0.03759711608290672
Norm Quadratic Average: 46.47422790527344
Nearest Class Center Accuracy: 0.69172

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023901041597127914
Inter Cos: 0.03800356760621071
Norm Quadratic Average: 47.16754913330078
Nearest Class Center Accuracy: 0.73

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04050178453326225
Inter Cos: 0.06557802110910416
Norm Quadratic Average: 32.30195236206055
Nearest Class Center Accuracy: 0.81188

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07302508503198624
Inter Cos: 0.0797211229801178
Norm Quadratic Average: 35.52199172973633
Nearest Class Center Accuracy: 0.89432

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.11874610185623169
Inter Cos: 0.07942848652601242
Norm Quadratic Average: 36.2652702331543
Nearest Class Center Accuracy: 0.94686

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.18859551846981049
Inter Cos: 0.08489084988832474
Norm Quadratic Average: 37.07744598388672
Nearest Class Center Accuracy: 0.97206

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4188248813152313
Inter Cos: 0.14205323159694672
Norm Quadratic Average: 27.644420623779297
Nearest Class Center Accuracy: 0.9832

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7009789943695068
Inter Cos: 0.1408557891845703
Norm Quadratic Average: 19.738046646118164
Nearest Class Center Accuracy: 0.99186

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7944760322570801
Inter Cos: 0.10897020995616913
Norm Quadratic Average: 21.579849243164062
Nearest Class Center Accuracy: 0.9873

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8367370367050171
Inter Cos: 0.14418663084506989
Norm Quadratic Average: 24.063777923583984
Nearest Class Center Accuracy: 0.9801

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 73.48889923095703
Linear Weight Rank: 4031
Intra Cos: 0.7788508534431458
Inter Cos: 0.22458185255527496
Norm Quadratic Average: 100.2947769165039
Nearest Class Center Accuracy: 0.97282

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 30.25059700012207
Linear Weight Rank: 3670
Intra Cos: 0.9048023819923401
Inter Cos: 0.12003157287836075
Norm Quadratic Average: 45.378990173339844
Nearest Class Center Accuracy: 0.99894

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 3.8419480323791504
Linear Weight Rank: 10
Intra Cos: 0.9087345004081726
Inter Cos: 0.07592210173606873
Norm Quadratic Average: 25.022857666015625
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9861453771591187
Inter Cos: 0.2630457282066345
Norm Quadratic Average: 21.701513290405273
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 1.0099416348457337
Accuracy: 0.8558
NC1 Within Class Collapse: 3.792642593383789
NC2 Equinorm: Features: 0.23018288612365723, Weights: 0.017678411677479744
NC2 Equiangle: Features: 0.1063702901204427, Weights: 0.1361930423312717
NC3 Self-Duality: 0.7383022904396057
NC4 NCC Mismatch: 0.06230000000000002

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526073545217514
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.55013656616211
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011992114596068859
Inter Cos: 0.06235746294260025
Norm Quadratic Average: 113.28880310058594
Nearest Class Center Accuracy: 0.3758

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014795842580497265
Inter Cos: 0.06097714230418205
Norm Quadratic Average: 63.5418586730957
Nearest Class Center Accuracy: 0.4789

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013027979992330074
Inter Cos: 0.05400792881846428
Norm Quadratic Average: 65.35765838623047
Nearest Class Center Accuracy: 0.5399

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016590004786849022
Inter Cos: 0.050312869250774384
Norm Quadratic Average: 45.2424201965332
Nearest Class Center Accuracy: 0.6098

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01721489429473877
Inter Cos: 0.04295986890792847
Norm Quadratic Average: 47.272525787353516
Nearest Class Center Accuracy: 0.6473

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018868161365389824
Inter Cos: 0.03786052390933037
Norm Quadratic Average: 46.465484619140625
Nearest Class Center Accuracy: 0.6814

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020921820774674416
Inter Cos: 0.03935549780726433
Norm Quadratic Average: 47.13142013549805
Nearest Class Center Accuracy: 0.7053

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03299272805452347
Inter Cos: 0.06759638339281082
Norm Quadratic Average: 32.24619674682617
Nearest Class Center Accuracy: 0.7533

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05654098466038704
Inter Cos: 0.08393332362174988
Norm Quadratic Average: 35.35793685913086
Nearest Class Center Accuracy: 0.79

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08679025620222092
Inter Cos: 0.08749110996723175
Norm Quadratic Average: 35.9383544921875
Nearest Class Center Accuracy: 0.8118

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.12768296897411346
Inter Cos: 0.09385889023542404
Norm Quadratic Average: 36.52236557006836
Nearest Class Center Accuracy: 0.8256

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2969811260700226
Inter Cos: 0.18077139556407928
Norm Quadratic Average: 26.949798583984375
Nearest Class Center Accuracy: 0.8227

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.47036314010620117
Inter Cos: 0.2557612955570221
Norm Quadratic Average: 18.89891815185547
Nearest Class Center Accuracy: 0.8277

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5498673915863037
Inter Cos: 0.26269522309303284
Norm Quadratic Average: 20.49991226196289
Nearest Class Center Accuracy: 0.8273

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6144058108329773
Inter Cos: 0.3111141622066498
Norm Quadratic Average: 22.97694206237793
Nearest Class Center Accuracy: 0.8251

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 73.48889923095703
Linear Weight Rank: 4031
Intra Cos: 0.5291076302528381
Inter Cos: 0.3606035113334656
Norm Quadratic Average: 96.58228302001953
Nearest Class Center Accuracy: 0.8061

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 30.25059700012207
Linear Weight Rank: 3670
Intra Cos: 0.5472368597984314
Inter Cos: 0.17913301289081573
Norm Quadratic Average: 41.75636672973633
Nearest Class Center Accuracy: 0.8321

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 3.8419480323791504
Linear Weight Rank: 10
Intra Cos: 0.5234633684158325
Inter Cos: 0.1651199460029602
Norm Quadratic Average: 23.061214447021484
Nearest Class Center Accuracy: 0.8372

Output Layer:
Intra Cos: 0.5963276028633118
Inter Cos: 0.3229237198829651
Norm Quadratic Average: 19.577425003051758
Nearest Class Center Accuracy: 0.8532

