Model save path: ./New_Models/bn_False_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0198909193277359
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597179412841797
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021588796749711037
Inter Cos: 0.09871804714202881
Norm Quadratic Average: 30.663663864135742
Nearest Class Center Accuracy: 0.33254

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025277314707636833
Inter Cos: 0.10511180758476257
Norm Quadratic Average: 25.248897552490234
Nearest Class Center Accuracy: 0.42512

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.030715974047780037
Inter Cos: 0.11304373294115067
Norm Quadratic Average: 30.639860153198242
Nearest Class Center Accuracy: 0.48166

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03346601501107216
Inter Cos: 0.10344117134809494
Norm Quadratic Average: 20.51224708557129
Nearest Class Center Accuracy: 0.54236

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03931227698922157
Inter Cos: 0.09528851509094238
Norm Quadratic Average: 17.253643035888672
Nearest Class Center Accuracy: 0.58782

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04229632765054703
Inter Cos: 0.08346490561962128
Norm Quadratic Average: 11.718786239624023
Nearest Class Center Accuracy: 0.62448

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04041320085525513
Inter Cos: 0.06535963714122772
Norm Quadratic Average: 5.3987202644348145
Nearest Class Center Accuracy: 0.66658

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07708930969238281
Inter Cos: 0.11926047503948212
Norm Quadratic Average: 1.1984175443649292
Nearest Class Center Accuracy: 0.76536

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2995000183582306
Inter Cos: 0.35254940390586853
Norm Quadratic Average: 0.46805307269096375
Nearest Class Center Accuracy: 0.86372

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4895744323730469
Inter Cos: 0.47555112838745117
Norm Quadratic Average: 0.38431838154792786
Nearest Class Center Accuracy: 0.92086

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5436350703239441
Inter Cos: 0.511508584022522
Norm Quadratic Average: 0.49002426862716675
Nearest Class Center Accuracy: 0.94968

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.646091878414154
Inter Cos: 0.5808223485946655
Norm Quadratic Average: 0.46119043231010437
Nearest Class Center Accuracy: 0.98366

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7685002088546753
Inter Cos: 0.6619483828544617
Norm Quadratic Average: 0.7108238339424133
Nearest Class Center Accuracy: 0.99098

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7743367552757263
Inter Cos: 0.6561394333839417
Norm Quadratic Average: 1.337594985961914
Nearest Class Center Accuracy: 0.9928

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7620782852172852
Inter Cos: 0.6296800971031189
Norm Quadratic Average: 2.445178985595703
Nearest Class Center Accuracy: 0.99446

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.6169440746307373
Linear Weight Rank: 3073
Intra Cos: 0.8005823493003845
Inter Cos: 0.47293341159820557
Norm Quadratic Average: 16.17225456237793
Nearest Class Center Accuracy: 0.9972

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.6874210834503174
Linear Weight Rank: 2846
Intra Cos: 0.8343731164932251
Inter Cos: 0.4891955256462097
Norm Quadratic Average: 17.514375686645508
Nearest Class Center Accuracy: 0.99982

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.637115955352783
Linear Weight Rank: 9
Intra Cos: 0.8439162373542786
Inter Cos: 0.4047926068305969
Norm Quadratic Average: 17.2491397857666
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.8544511198997498
Inter Cos: 0.4191958010196686
Norm Quadratic Average: 18.525232315063477
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.923874202823639
Accuracy: 0.8088
NC1 Within Class Collapse: 5.895383834838867
NC2 Equinorm: Features: 0.22729863226413727, Weights: 0.0775689035654068
NC2 Equiangle: Features: 0.3349945068359375, Weights: 0.19204143948025174
NC3 Self-Duality: 0.22493699193000793
NC4 NCC Mismatch: 0.03410000000000002

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526077270507812
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550132751464844
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019076861441135406
Inter Cos: 0.0992104634642601
Norm Quadratic Average: 30.621932983398438
Nearest Class Center Accuracy: 0.3474

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024712929502129555
Inter Cos: 0.10608156770467758
Norm Quadratic Average: 25.242950439453125
Nearest Class Center Accuracy: 0.4358

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.029014838859438896
Inter Cos: 0.11425060033798218
Norm Quadratic Average: 30.655672073364258
Nearest Class Center Accuracy: 0.493

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.030754927545785904
Inter Cos: 0.10466234385967255
Norm Quadratic Average: 20.537506103515625
Nearest Class Center Accuracy: 0.553

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03602798283100128
Inter Cos: 0.09597426652908325
Norm Quadratic Average: 17.285009384155273
Nearest Class Center Accuracy: 0.5882

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03894466161727905
Inter Cos: 0.08349061012268066
Norm Quadratic Average: 11.742326736450195
Nearest Class Center Accuracy: 0.6251

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.037113405764102936
Inter Cos: 0.06516911834478378
Norm Quadratic Average: 5.404825687408447
Nearest Class Center Accuracy: 0.6616

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06888476014137268
Inter Cos: 0.12090455740690231
Norm Quadratic Average: 1.1983305215835571
Nearest Class Center Accuracy: 0.736

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.257657527923584
Inter Cos: 0.3502880036830902
Norm Quadratic Average: 0.46697303652763367
Nearest Class Center Accuracy: 0.7898

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.39431071281433105
Inter Cos: 0.4279809594154358
Norm Quadratic Average: 0.3820044994354248
Nearest Class Center Accuracy: 0.799

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.41460177302360535
Inter Cos: 0.45098400115966797
Norm Quadratic Average: 0.48594456911087036
Nearest Class Center Accuracy: 0.7968

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.47515952587127686
Inter Cos: 0.4930625557899475
Norm Quadratic Average: 0.45484793186187744
Nearest Class Center Accuracy: 0.7926

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5589190125465393
Inter Cos: 0.5790504813194275
Norm Quadratic Average: 0.699474036693573
Nearest Class Center Accuracy: 0.7939

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5534803867340088
Inter Cos: 0.5765078663825989
Norm Quadratic Average: 1.3147976398468018
Nearest Class Center Accuracy: 0.7954

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5306998491287231
Inter Cos: 0.556164026260376
Norm Quadratic Average: 2.3998446464538574
Nearest Class Center Accuracy: 0.7972

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.6169440746307373
Linear Weight Rank: 3073
Intra Cos: 0.5354245901107788
Inter Cos: 0.4767693281173706
Norm Quadratic Average: 15.857890129089355
Nearest Class Center Accuracy: 0.8022

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.6874210834503174
Linear Weight Rank: 2846
Intra Cos: 0.5167630314826965
Inter Cos: 0.49421626329421997
Norm Quadratic Average: 17.13761329650879
Nearest Class Center Accuracy: 0.8072

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.637115955352783
Linear Weight Rank: 9
Intra Cos: 0.502190113067627
Inter Cos: 0.44423672556877136
Norm Quadratic Average: 16.865358352661133
Nearest Class Center Accuracy: 0.8084

Output Layer:
Intra Cos: 0.47356268763542175
Inter Cos: 0.4506934881210327
Norm Quadratic Average: 18.08491325378418
Nearest Class Center Accuracy: 0.8069

