Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893190383911133
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326326370239258
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025164177641272545
Inter Cos: 0.04542483389377594
Norm Quadratic Average: 47.252044677734375
Nearest Class Center Accuracy: 0.0391

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0240455511957407
Inter Cos: 0.0378011092543602
Norm Quadratic Average: 59.11615753173828
Nearest Class Center Accuracy: 0.0501

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02476400136947632
Inter Cos: 0.02638295665383339
Norm Quadratic Average: 76.47073364257812
Nearest Class Center Accuracy: 0.06204

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02253912389278412
Inter Cos: 0.020407430827617645
Norm Quadratic Average: 36.449275970458984
Nearest Class Center Accuracy: 0.06914

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021790489554405212
Inter Cos: 0.02342260256409645
Norm Quadratic Average: 15.115787506103516
Nearest Class Center Accuracy: 0.0725

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04072031006217003
Inter Cos: 0.03755047917366028
Norm Quadratic Average: 3.9922876358032227
Nearest Class Center Accuracy: 0.07966

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1263163834810257
Inter Cos: 0.10600249469280243
Norm Quadratic Average: 1.4063993692398071
Nearest Class Center Accuracy: 0.09108

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.35949715971946716
Inter Cos: 0.33752042055130005
Norm Quadratic Average: 0.6820693016052246
Nearest Class Center Accuracy: 0.09636

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5739227533340454
Inter Cos: 0.5472920536994934
Norm Quadratic Average: 0.638160228729248
Nearest Class Center Accuracy: 0.09904

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6972284913063049
Inter Cos: 0.6499155759811401
Norm Quadratic Average: 0.9530755877494812
Nearest Class Center Accuracy: 0.09968

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7349549531936646
Inter Cos: 0.6723045706748962
Norm Quadratic Average: 1.9560960531234741
Nearest Class Center Accuracy: 0.09972

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8140974044799805
Inter Cos: 0.6929545998573303
Norm Quadratic Average: 2.942378520965576
Nearest Class Center Accuracy: 0.09994

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8867678046226501
Inter Cos: 0.7363453507423401
Norm Quadratic Average: 5.455602645874023
Nearest Class Center Accuracy: 0.09998

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.91477370262146
Inter Cos: 0.7453305721282959
Norm Quadratic Average: 11.216327667236328
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9284777045249939
Inter Cos: 0.7490392923355103
Norm Quadratic Average: 22.16759490966797
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.522226333618164
Linear Weight Rank: 1827
Intra Cos: 0.8700312376022339
Inter Cos: 0.6499016880989075
Norm Quadratic Average: 145.8975372314453
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 4.1062331199646
Linear Weight Rank: 2963
Intra Cos: 0.8995466232299805
Inter Cos: 0.6422470211982727
Norm Quadratic Average: 116.77098083496094
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.242870330810547
Linear Weight Rank: 97
Intra Cos: 0.9106622934341431
Inter Cos: 0.5955832004547119
Norm Quadratic Average: 72.44718933105469
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9206350445747375
Inter Cos: 0.6822232007980347
Norm Quadratic Average: 59.00916290283203
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 3.9303012718200683
Accuracy: 0.4973
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.1902160942554474, Weights: 0.056355319917201996
NC2 Equiangle: Features: 0.24877702809343435, Weights: 0.10440668895991162
NC3 Self-Duality: 0.4655679762363434
NC4 NCC Mismatch: 0.19789999999999996

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422189712524414
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01288666296750307
Inter Cos: 0.2763902544975281
Norm Quadratic Average: 47.496009826660156
Nearest Class Center Accuracy: 0.1895

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01760411635041237
Inter Cos: 0.27296531200408936
Norm Quadratic Average: 59.44780731201172
Nearest Class Center Accuracy: 0.2853

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017093267291784286
Inter Cos: 0.21656355261802673
Norm Quadratic Average: 76.96868896484375
Nearest Class Center Accuracy: 0.3938

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01649313047528267
Inter Cos: 0.23458226025104523
Norm Quadratic Average: 36.7432975769043
Nearest Class Center Accuracy: 0.5004

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017151139676570892
Inter Cos: 0.18923938274383545
Norm Quadratic Average: 15.220017433166504
Nearest Class Center Accuracy: 0.5511

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025272540748119354
Inter Cos: 0.24333198368549347
Norm Quadratic Average: 4.003314971923828
Nearest Class Center Accuracy: 0.5713

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.055622342973947525
Inter Cos: 0.3899388313293457
Norm Quadratic Average: 1.395238995552063
Nearest Class Center Accuracy: 0.563

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.13399122655391693
Inter Cos: 0.6339921355247498
Norm Quadratic Average: 0.6624259352684021
Nearest Class Center Accuracy: 0.5283

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2059888392686844
Inter Cos: 0.7590276002883911
Norm Quadratic Average: 0.6109699010848999
Nearest Class Center Accuracy: 0.5155

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.21578717231750488
Inter Cos: 0.7983560562133789
Norm Quadratic Average: 0.9001955389976501
Nearest Class Center Accuracy: 0.4979

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20654378831386566
Inter Cos: 0.8125982880592346
Norm Quadratic Average: 1.8341468572616577
Nearest Class Center Accuracy: 0.4972

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20808462798595428
Inter Cos: 0.8329295516014099
Norm Quadratic Average: 2.7481133937835693
Nearest Class Center Accuracy: 0.4818

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2296813428401947
Inter Cos: 0.8650516271591187
Norm Quadratic Average: 5.067393779754639
Nearest Class Center Accuracy: 0.4732

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.22286011278629303
Inter Cos: 0.8627111911773682
Norm Quadratic Average: 10.394405364990234
Nearest Class Center Accuracy: 0.4735

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.21520474553108215
Inter Cos: 0.8497592210769653
Norm Quadratic Average: 20.531131744384766
Nearest Class Center Accuracy: 0.4736

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.522226333618164
Linear Weight Rank: 1827
Intra Cos: 0.19236937165260315
Inter Cos: 0.7652835845947266
Norm Quadratic Average: 137.86659240722656
Nearest Class Center Accuracy: 0.4745

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 4.1062331199646
Linear Weight Rank: 2963
Intra Cos: 0.187498077750206
Inter Cos: 0.7520778179168701
Norm Quadratic Average: 109.64566802978516
Nearest Class Center Accuracy: 0.4908

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.242870330810547
Linear Weight Rank: 97
Intra Cos: 0.17836661636829376
Inter Cos: 0.7168208956718445
Norm Quadratic Average: 67.52716064453125
Nearest Class Center Accuracy: 0.4906

Output Layer:
Intra Cos: 0.21398045122623444
Inter Cos: 0.7700579166412354
Norm Quadratic Average: 55.03607940673828
Nearest Class Center Accuracy: 0.4901

