Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0198909193277359
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597179412841797
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012685495428740978
Inter Cos: 0.0591929629445076
Norm Quadratic Average: 4.121286392211914
Nearest Class Center Accuracy: 0.33786

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017700912430882454
Inter Cos: 0.061491042375564575
Norm Quadratic Average: 2.7226011753082275
Nearest Class Center Accuracy: 0.47566

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012705955654382706
Inter Cos: 0.05086809769272804
Norm Quadratic Average: 1.9915610551834106
Nearest Class Center Accuracy: 0.54628

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01576371118426323
Inter Cos: 0.04919188469648361
Norm Quadratic Average: 1.3415334224700928
Nearest Class Center Accuracy: 0.62738

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01951792649924755
Inter Cos: 0.04620182141661644
Norm Quadratic Average: 1.0598866939544678
Nearest Class Center Accuracy: 0.67484

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022579511627554893
Inter Cos: 0.04671205207705498
Norm Quadratic Average: 0.8875086903572083
Nearest Class Center Accuracy: 0.71818

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02525855228304863
Inter Cos: 0.04510961472988129
Norm Quadratic Average: 0.8046942353248596
Nearest Class Center Accuracy: 0.76562

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.053363487124443054
Inter Cos: 0.07739176601171494
Norm Quadratic Average: 0.5198394656181335
Nearest Class Center Accuracy: 0.89566

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.15770088136196136
Inter Cos: 0.15309737622737885
Norm Quadratic Average: 0.3045502305030823
Nearest Class Center Accuracy: 0.96398

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4559297561645508
Inter Cos: 0.2980708181858063
Norm Quadratic Average: 0.2038649320602417
Nearest Class Center Accuracy: 0.99212

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6967042088508606
Inter Cos: 0.1984020620584488
Norm Quadratic Average: 0.16876374185085297
Nearest Class Center Accuracy: 0.99982

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8375778794288635
Inter Cos: 0.0814843401312828
Norm Quadratic Average: 0.1796431988477707
Nearest Class Center Accuracy: 1.0

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8978487253189087
Inter Cos: 0.01614467054605484
Norm Quadratic Average: 0.22560399770736694
Nearest Class Center Accuracy: 1.0

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9758761525154114
Inter Cos: -0.01642651855945587
Norm Quadratic Average: 0.4717341661453247
Nearest Class Center Accuracy: 1.0

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9951258897781372
Inter Cos: -0.03905808553099632
Norm Quadratic Average: 1.0175684690475464
Nearest Class Center Accuracy: 1.0

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.166956663131714
Linear Weight Rank: 96
Intra Cos: 0.9988832473754883
Inter Cos: -0.0342659130692482
Norm Quadratic Average: 24.941205978393555
Nearest Class Center Accuracy: 1.0

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.18255877494812
Linear Weight Rank: 1001
Intra Cos: 0.9991858005523682
Inter Cos: 0.026065917685627937
Norm Quadratic Average: 16.796226501464844
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.172476053237915
Linear Weight Rank: 9
Intra Cos: 0.9992871284484863
Inter Cos: 0.07184413820505142
Norm Quadratic Average: 11.626791000366211
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9994889497756958
Inter Cos: 0.09679868817329407
Norm Quadratic Average: 8.462462425231934
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.42574526438713073
Accuracy: 0.8989
NC1 Within Class Collapse: 1.9584264755249023
NC2 Equinorm: Features: 0.0843651220202446, Weights: 0.002484237542375922
NC2 Equiangle: Features: 0.09393366707695855, Weights: 0.025205230712890624
NC3 Self-Duality: 0.028964947909116745
NC4 NCC Mismatch: 0.008099999999999996

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526077270507812
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550132751464844
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011289477348327637
Inter Cos: 0.059851646423339844
Norm Quadratic Average: 4.116721153259277
Nearest Class Center Accuracy: 0.3593

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016298498958349228
Inter Cos: 0.06285025179386139
Norm Quadratic Average: 2.7213029861450195
Nearest Class Center Accuracy: 0.4915

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011946167796850204
Inter Cos: 0.051655061542987823
Norm Quadratic Average: 1.991979956626892
Nearest Class Center Accuracy: 0.5631

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014855644665658474
Inter Cos: 0.049985602498054504
Norm Quadratic Average: 1.3424232006072998
Nearest Class Center Accuracy: 0.6369

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018106261268258095
Inter Cos: 0.04683024808764458
Norm Quadratic Average: 1.0606954097747803
Nearest Class Center Accuracy: 0.6712

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020667318254709244
Inter Cos: 0.04721087962388992
Norm Quadratic Average: 0.8873072266578674
Nearest Class Center Accuracy: 0.7034

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022295063361525536
Inter Cos: 0.04568193480372429
Norm Quadratic Average: 0.8035547137260437
Nearest Class Center Accuracy: 0.7343

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.042432017624378204
Inter Cos: 0.07940058410167694
Norm Quadratic Average: 0.5176371335983276
Nearest Class Center Accuracy: 0.8202

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1317901760339737
Inter Cos: 0.16194704174995422
Norm Quadratic Average: 0.29977846145629883
Nearest Class Center Accuracy: 0.8594

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3860782980918884
Inter Cos: 0.31352928280830383
Norm Quadratic Average: 0.1977950781583786
Nearest Class Center Accuracy: 0.8766

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5297648310661316
Inter Cos: 0.24940559267997742
Norm Quadratic Average: 0.1620979607105255
Nearest Class Center Accuracy: 0.8926

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5961426496505737
Inter Cos: 0.21605637669563293
Norm Quadratic Average: 0.1707928478717804
Nearest Class Center Accuracy: 0.8985

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5891420841217041
Inter Cos: 0.11642089486122131
Norm Quadratic Average: 0.2157188355922699
Nearest Class Center Accuracy: 0.8997

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6202103495597839
Inter Cos: 0.11117043346166611
Norm Quadratic Average: 0.44539108872413635
Nearest Class Center Accuracy: 0.8997

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6371788382530212
Inter Cos: 0.1293075978755951
Norm Quadratic Average: 0.9538695812225342
Nearest Class Center Accuracy: 0.9

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.166956663131714
Linear Weight Rank: 96
Intra Cos: 0.6548990607261658
Inter Cos: 0.15254025161266327
Norm Quadratic Average: 23.265277862548828
Nearest Class Center Accuracy: 0.8995

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.18255877494812
Linear Weight Rank: 1001
Intra Cos: 0.6600745320320129
Inter Cos: 0.17164087295532227
Norm Quadratic Average: 15.679546356201172
Nearest Class Center Accuracy: 0.8997

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.172476053237915
Linear Weight Rank: 9
Intra Cos: 0.6652966737747192
Inter Cos: 0.19309310615062714
Norm Quadratic Average: 10.868741989135742
Nearest Class Center Accuracy: 0.9002

Output Layer:
Intra Cos: 0.6692448258399963
Inter Cos: 0.20216044783592224
Norm Quadratic Average: 7.917119979858398
Nearest Class Center Accuracy: 0.8997

