Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.0005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893190383911133
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326326370239258
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013519305735826492
Inter Cos: 0.027457382529973984
Norm Quadratic Average: 45.09044647216797
Nearest Class Center Accuracy: 0.04044

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01918632909655571
Inter Cos: 0.03773456811904907
Norm Quadratic Average: 28.576658248901367
Nearest Class Center Accuracy: 0.05736

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015412242151796818
Inter Cos: 0.026251576840877533
Norm Quadratic Average: 23.8076229095459
Nearest Class Center Accuracy: 0.0631

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02135341987013817
Inter Cos: 0.020545033738017082
Norm Quadratic Average: 16.422025680541992
Nearest Class Center Accuracy: 0.07026

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021646589040756226
Inter Cos: 0.0193476565182209
Norm Quadratic Average: 13.463834762573242
Nearest Class Center Accuracy: 0.07402

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022112106904387474
Inter Cos: 0.020685963332653046
Norm Quadratic Average: 13.360881805419922
Nearest Class Center Accuracy: 0.0777

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021689683198928833
Inter Cos: 0.0213612150400877
Norm Quadratic Average: 13.4663724899292
Nearest Class Center Accuracy: 0.07968

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.033000312745571136
Inter Cos: 0.03071751445531845
Norm Quadratic Average: 8.507336616516113
Nearest Class Center Accuracy: 0.08552

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04570227861404419
Inter Cos: 0.040474966168403625
Norm Quadratic Average: 6.863911151885986
Nearest Class Center Accuracy: 0.0902

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06483012437820435
Inter Cos: 0.05137399584054947
Norm Quadratic Average: 6.228551864624023
Nearest Class Center Accuracy: 0.09398

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09821545332670212
Inter Cos: 0.07191717624664307
Norm Quadratic Average: 6.385646343231201
Nearest Class Center Accuracy: 0.09674

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.22996024787425995
Inter Cos: 0.13771472871303558
Norm Quadratic Average: 5.384942054748535
Nearest Class Center Accuracy: 0.09838

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5657281875610352
Inter Cos: 0.26275548338890076
Norm Quadratic Average: 4.839081287384033
Nearest Class Center Accuracy: 0.1

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7348758578300476
Inter Cos: 0.28544852137565613
Norm Quadratic Average: 5.2257184982299805
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8333789110183716
Inter Cos: 0.2547941207885742
Norm Quadratic Average: 5.496396541595459
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 21.071056365966797
Linear Weight Rank: 4030
Intra Cos: 0.9168270230293274
Inter Cos: 0.3109670579433441
Norm Quadratic Average: 41.129703521728516
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 11.339019775390625
Linear Weight Rank: 3648
Intra Cos: 0.9468185901641846
Inter Cos: 0.3662508428096771
Norm Quadratic Average: 32.41136932373047
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 7.558384418487549
Linear Weight Rank: 98
Intra Cos: 0.9518135190010071
Inter Cos: 0.3300773501396179
Norm Quadratic Average: 29.956167221069336
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9666244387626648
Inter Cos: 0.44201838970184326
Norm Quadratic Average: 40.080867767333984
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 2.517626082611084
Accuracy: 0.579
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.20178073644638062, Weights: 0.028245149180293083
NC2 Equiangle: Features: 0.18881581932607322, Weights: 0.10812687421085859
NC3 Self-Duality: 0.3852015435695648
NC4 NCC Mismatch: 0.07599999999999996

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422189712524414
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.007587087340652943
Inter Cos: 0.1830163151025772
Norm Quadratic Average: 45.38054656982422
Nearest Class Center Accuracy: 0.2302

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010435664094984531
Inter Cos: 0.2275233268737793
Norm Quadratic Average: 28.772216796875
Nearest Class Center Accuracy: 0.3637

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01068419311195612
Inter Cos: 0.14400161802768707
Norm Quadratic Average: 23.9205322265625
Nearest Class Center Accuracy: 0.4699

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015343974344432354
Inter Cos: 0.18260182440280914
Norm Quadratic Average: 16.48664093017578
Nearest Class Center Accuracy: 0.5148

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014789299108088017
Inter Cos: 0.15693670511245728
Norm Quadratic Average: 13.50583553314209
Nearest Class Center Accuracy: 0.5621

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01472554076462984
Inter Cos: 0.13194668292999268
Norm Quadratic Average: 13.38064193725586
Nearest Class Center Accuracy: 0.5863

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013298683799803257
Inter Cos: 0.11468140035867691
Norm Quadratic Average: 13.466052055358887
Nearest Class Center Accuracy: 0.6107

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017300978302955627
Inter Cos: 0.13210619986057281
Norm Quadratic Average: 8.4961519241333
Nearest Class Center Accuracy: 0.637

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020147554576396942
Inter Cos: 0.1546803116798401
Norm Quadratic Average: 6.810189723968506
Nearest Class Center Accuracy: 0.6543

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02455873042345047
Inter Cos: 0.18889480829238892
Norm Quadratic Average: 6.103519916534424
Nearest Class Center Accuracy: 0.6439

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03294641152024269
Inter Cos: 0.2338716834783554
Norm Quadratic Average: 6.169276237487793
Nearest Class Center Accuracy: 0.6358

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0757780596613884
Inter Cos: 0.34444114565849304
Norm Quadratic Average: 5.048901557922363
Nearest Class Center Accuracy: 0.5961

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.15095224976539612
Inter Cos: 0.4736040234565735
Norm Quadratic Average: 4.3221917152404785
Nearest Class Center Accuracy: 0.5785

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.18217620253562927
Inter Cos: 0.4857068657875061
Norm Quadratic Average: 4.520217418670654
Nearest Class Center Accuracy: 0.5788

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.19143521785736084
Inter Cos: 0.4517142176628113
Norm Quadratic Average: 4.658588409423828
Nearest Class Center Accuracy: 0.5824

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 21.071056365966797
Linear Weight Rank: 4030
Intra Cos: 0.22825047373771667
Inter Cos: 0.43612152338027954
Norm Quadratic Average: 33.66301345825195
Nearest Class Center Accuracy: 0.5792

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 11.339019775390625
Linear Weight Rank: 3648
Intra Cos: 0.235290989279747
Inter Cos: 0.4515048861503601
Norm Quadratic Average: 26.8736629486084
Nearest Class Center Accuracy: 0.5809

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 7.558384418487549
Linear Weight Rank: 98
Intra Cos: 0.2446776181459427
Inter Cos: 0.5107880234718323
Norm Quadratic Average: 25.400829315185547
Nearest Class Center Accuracy: 0.5796

Output Layer:
Intra Cos: 0.25738614797592163
Inter Cos: 0.6228082180023193
Norm Quadratic Average: 34.356292724609375
Nearest Class Center Accuracy: 0.5768

