Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.0005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02289319410920143
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326311111450195
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013988805003464222
Inter Cos: 0.029493795707821846
Norm Quadratic Average: 44.0311279296875
Nearest Class Center Accuracy: 0.04058

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019555505365133286
Inter Cos: 0.03926580026745796
Norm Quadratic Average: 29.280073165893555
Nearest Class Center Accuracy: 0.05754

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014151078648865223
Inter Cos: 0.0269504114985466
Norm Quadratic Average: 23.607444763183594
Nearest Class Center Accuracy: 0.06332

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02152314968407154
Inter Cos: 0.022248607128858566
Norm Quadratic Average: 16.12493133544922
Nearest Class Center Accuracy: 0.06998

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021437276154756546
Inter Cos: 0.020822744816541672
Norm Quadratic Average: 13.378271102905273
Nearest Class Center Accuracy: 0.07458

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022371355444192886
Inter Cos: 0.021061910316348076
Norm Quadratic Average: 13.115073204040527
Nearest Class Center Accuracy: 0.07752

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022952625527977943
Inter Cos: 0.02097163163125515
Norm Quadratic Average: 13.38015079498291
Nearest Class Center Accuracy: 0.07966

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.033632081001996994
Inter Cos: 0.02952023781836033
Norm Quadratic Average: 8.614635467529297
Nearest Class Center Accuracy: 0.08588

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04430496692657471
Inter Cos: 0.03690909594297409
Norm Quadratic Average: 6.88279914855957
Nearest Class Center Accuracy: 0.09076

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06281040608882904
Inter Cos: 0.046347714960575104
Norm Quadratic Average: 6.291664123535156
Nearest Class Center Accuracy: 0.09434

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09078957140445709
Inter Cos: 0.06440091878175735
Norm Quadratic Average: 6.49696159362793
Nearest Class Center Accuracy: 0.09736

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.21014225482940674
Inter Cos: 0.12267345935106277
Norm Quadratic Average: 5.40904426574707
Nearest Class Center Accuracy: 0.09938

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5280422568321228
Inter Cos: 0.22135859727859497
Norm Quadratic Average: 4.837091445922852
Nearest Class Center Accuracy: 0.1

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7196549773216248
Inter Cos: 0.24114128947257996
Norm Quadratic Average: 5.310599327087402
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8235116004943848
Inter Cos: 0.2563841938972473
Norm Quadratic Average: 5.500531196594238
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 21.08315086364746
Linear Weight Rank: 4030
Intra Cos: 0.9114705920219421
Inter Cos: 0.2917156219482422
Norm Quadratic Average: 41.0588493347168
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 11.345495223999023
Linear Weight Rank: 3648
Intra Cos: 0.940460205078125
Inter Cos: 0.3086192011833191
Norm Quadratic Average: 32.339813232421875
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 7.590775012969971
Linear Weight Rank: 98
Intra Cos: 0.9472239017486572
Inter Cos: 0.32066628336906433
Norm Quadratic Average: 30.057613372802734
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9599508047103882
Inter Cos: 0.4576476812362671
Norm Quadratic Average: 40.55448532104492
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 2.536530364227295
Accuracy: 0.5823
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.20104387402534485, Weights: 0.028273237869143486
NC2 Equiangle: Features: 0.19118564798374368, Weights: 0.10879032019412879
NC3 Self-Duality: 0.3846539258956909
NC4 NCC Mismatch: 0.07479999999999998

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621266715228558
Inter Cos: 0.406754732131958
Norm Quadratic Average: 29.42218780517578
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.007091565988957882
Inter Cos: 0.18400932848453522
Norm Quadratic Average: 44.31382369995117
Nearest Class Center Accuracy: 0.2297

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011457369662821293
Inter Cos: 0.24325516819953918
Norm Quadratic Average: 29.479736328125
Nearest Class Center Accuracy: 0.3596

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010588179342448711
Inter Cos: 0.15063250064849854
Norm Quadratic Average: 23.723878860473633
Nearest Class Center Accuracy: 0.4598

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015698324888944626
Inter Cos: 0.1717984527349472
Norm Quadratic Average: 16.187477111816406
Nearest Class Center Accuracy: 0.5098

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015089350752532482
Inter Cos: 0.14136731624603271
Norm Quadratic Average: 13.414815902709961
Nearest Class Center Accuracy: 0.5622

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013822250999510288
Inter Cos: 0.12391931563615799
Norm Quadratic Average: 13.129239082336426
Nearest Class Center Accuracy: 0.5866

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013363287784159184
Inter Cos: 0.11067526787519455
Norm Quadratic Average: 13.376446723937988
Nearest Class Center Accuracy: 0.6078

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016777653247117996
Inter Cos: 0.1375010460615158
Norm Quadratic Average: 8.600239753723145
Nearest Class Center Accuracy: 0.6354

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018959738314151764
Inter Cos: 0.1588277816772461
Norm Quadratic Average: 6.824077129364014
Nearest Class Center Accuracy: 0.6516

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023843593895435333
Inter Cos: 0.19183999300003052
Norm Quadratic Average: 6.164943218231201
Nearest Class Center Accuracy: 0.6427

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03136853128671646
Inter Cos: 0.24709153175354004
Norm Quadratic Average: 6.281615257263184
Nearest Class Center Accuracy: 0.6302

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07427741587162018
Inter Cos: 0.35758617520332336
Norm Quadratic Average: 5.082651615142822
Nearest Class Center Accuracy: 0.5965

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.15385639667510986
Inter Cos: 0.4984112083911896
Norm Quadratic Average: 4.32293176651001
Nearest Class Center Accuracy: 0.5835

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.17439423501491547
Inter Cos: 0.5312502384185791
Norm Quadratic Average: 4.57750940322876
Nearest Class Center Accuracy: 0.584

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.18543322384357452
Inter Cos: 0.5038458108901978
Norm Quadratic Average: 4.645498275756836
Nearest Class Center Accuracy: 0.5874

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 21.08315086364746
Linear Weight Rank: 4030
Intra Cos: 0.22417141497135162
Inter Cos: 0.5020051002502441
Norm Quadratic Average: 33.5087890625
Nearest Class Center Accuracy: 0.5837

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 11.345495223999023
Linear Weight Rank: 3648
Intra Cos: 0.22971968352794647
Inter Cos: 0.5001064538955688
Norm Quadratic Average: 26.75588607788086
Nearest Class Center Accuracy: 0.5867

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 7.590775012969971
Linear Weight Rank: 98
Intra Cos: 0.2352602779865265
Inter Cos: 0.544540286064148
Norm Quadratic Average: 25.436689376831055
Nearest Class Center Accuracy: 0.5867

Output Layer:
Intra Cos: 0.2749811112880707
Inter Cos: 0.6419088840484619
Norm Quadratic Average: 34.70150375366211
Nearest Class Center Accuracy: 0.5812

