Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.0001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0198909193277359
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597179412841797
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012569407932460308
Inter Cos: 0.059188418090343475
Norm Quadratic Average: 112.78518676757812
Nearest Class Center Accuracy: 0.35194

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016556724905967712
Inter Cos: 0.05938082933425903
Norm Quadratic Average: 65.49014282226562
Nearest Class Center Accuracy: 0.47018

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0151217021048069
Inter Cos: 0.058249473571777344
Norm Quadratic Average: 65.02473449707031
Nearest Class Center Accuracy: 0.5272

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01854681223630905
Inter Cos: 0.05613968148827553
Norm Quadratic Average: 44.96296310424805
Nearest Class Center Accuracy: 0.60168

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019924072548747063
Inter Cos: 0.052538901567459106
Norm Quadratic Average: 46.772769927978516
Nearest Class Center Accuracy: 0.6429

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02215154841542244
Inter Cos: 0.0456608384847641
Norm Quadratic Average: 46.87592315673828
Nearest Class Center Accuracy: 0.68626

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024125024676322937
Inter Cos: 0.03922135382890701
Norm Quadratic Average: 46.95637893676758
Nearest Class Center Accuracy: 0.7282

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04449755698442459
Inter Cos: 0.06026330962777138
Norm Quadratic Average: 32.29252624511719
Nearest Class Center Accuracy: 0.8168

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07896831631660461
Inter Cos: 0.07401502132415771
Norm Quadratic Average: 35.373775482177734
Nearest Class Center Accuracy: 0.88964

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.13005289435386658
Inter Cos: 0.07282297313213348
Norm Quadratic Average: 36.28278732299805
Nearest Class Center Accuracy: 0.94308

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2034333050251007
Inter Cos: 0.08403996378183365
Norm Quadratic Average: 36.72770309448242
Nearest Class Center Accuracy: 0.96588

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3898817002773285
Inter Cos: 0.14046889543533325
Norm Quadratic Average: 28.0394344329834
Nearest Class Center Accuracy: 0.96826

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5559720993041992
Inter Cos: 0.1423790156841278
Norm Quadratic Average: 20.454774856567383
Nearest Class Center Accuracy: 0.97658

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5974605679512024
Inter Cos: 0.07811039686203003
Norm Quadratic Average: 23.37179946899414
Nearest Class Center Accuracy: 0.96274

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.572041392326355
Inter Cos: 0.07869147509336472
Norm Quadratic Average: 27.873212814331055
Nearest Class Center Accuracy: 0.94806

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 73.48465728759766
Linear Weight Rank: 4031
Intra Cos: 0.6499828696250916
Inter Cos: 0.09365054965019226
Norm Quadratic Average: 84.93339538574219
Nearest Class Center Accuracy: 0.96126

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 30.248912811279297
Linear Weight Rank: 3669
Intra Cos: 0.8521918058395386
Inter Cos: 0.06166656315326691
Norm Quadratic Average: 43.49170684814453
Nearest Class Center Accuracy: 0.99998

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 3.830578088760376
Linear Weight Rank: 10
Intra Cos: 0.8837246894836426
Inter Cos: 0.05728621408343315
Norm Quadratic Average: 25.287654876708984
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9814234375953674
Inter Cos: 0.2702433466911316
Norm Quadratic Average: 22.804176330566406
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 1.027191973400116
Accuracy: 0.8572
NC1 Within Class Collapse: 3.800102710723877
NC2 Equinorm: Features: 0.19349654018878937, Weights: 0.023203136399388313
NC2 Equiangle: Features: 0.1043746100531684, Weights: 0.12053443060980903
NC3 Self-Duality: 0.6908478736877441
NC4 NCC Mismatch: 0.06940000000000002

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526077270507812
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550132751464844
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011108778417110443
Inter Cos: 0.060481589287519455
Norm Quadratic Average: 112.68199920654297
Nearest Class Center Accuracy: 0.3731

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015334478579461575
Inter Cos: 0.06035276874899864
Norm Quadratic Average: 65.46888732910156
Nearest Class Center Accuracy: 0.4805

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01411446463316679
Inter Cos: 0.05884493142366409
Norm Quadratic Average: 65.0512924194336
Nearest Class Center Accuracy: 0.542

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017130691558122635
Inter Cos: 0.056945331394672394
Norm Quadratic Average: 44.987361907958984
Nearest Class Center Accuracy: 0.6063

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018241416662931442
Inter Cos: 0.053080979734659195
Norm Quadratic Average: 46.79515838623047
Nearest Class Center Accuracy: 0.642

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020011208951473236
Inter Cos: 0.04615253210067749
Norm Quadratic Average: 46.86296463012695
Nearest Class Center Accuracy: 0.6736

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021228643134236336
Inter Cos: 0.04008810967206955
Norm Quadratic Average: 46.92283630371094
Nearest Class Center Accuracy: 0.7001

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03628268092870712
Inter Cos: 0.06206578388810158
Norm Quadratic Average: 32.219078063964844
Nearest Class Center Accuracy: 0.7464

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.060716662555933
Inter Cos: 0.07711861282587051
Norm Quadratic Average: 35.180641174316406
Nearest Class Center Accuracy: 0.7843

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09275810420513153
Inter Cos: 0.07896933704614639
Norm Quadratic Average: 35.898406982421875
Nearest Class Center Accuracy: 0.8068

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.13536450266838074
Inter Cos: 0.09033182263374329
Norm Quadratic Average: 36.0602912902832
Nearest Class Center Accuracy: 0.8174

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.27910909056663513
Inter Cos: 0.15671373903751373
Norm Quadratic Average: 27.060871124267578
Nearest Class Center Accuracy: 0.8106

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4097418487071991
Inter Cos: 0.21552221477031708
Norm Quadratic Average: 19.254085540771484
Nearest Class Center Accuracy: 0.8198

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4348229765892029
Inter Cos: 0.22758260369300842
Norm Quadratic Average: 21.558238983154297
Nearest Class Center Accuracy: 0.8169

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.40133845806121826
Inter Cos: 0.25676417350769043
Norm Quadratic Average: 25.2915096282959
Nearest Class Center Accuracy: 0.8034

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 73.48465728759766
Linear Weight Rank: 4031
Intra Cos: 0.4502961039543152
Inter Cos: 0.2588118016719818
Norm Quadratic Average: 77.55403900146484
Nearest Class Center Accuracy: 0.7969

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 30.248912811279297
Linear Weight Rank: 3669
Intra Cos: 0.5573508739471436
Inter Cos: 0.1818927377462387
Norm Quadratic Average: 39.421531677246094
Nearest Class Center Accuracy: 0.8326

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 3.830578088760376
Linear Weight Rank: 10
Intra Cos: 0.5435348153114319
Inter Cos: 0.1620006412267685
Norm Quadratic Average: 23.136486053466797
Nearest Class Center Accuracy: 0.8377

Output Layer:
Intra Cos: 0.5867138504981995
Inter Cos: 0.3042758107185364
Norm Quadratic Average: 20.42456817626953
Nearest Class Center Accuracy: 0.8534

