Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.0001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597183227539062
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012834373861551285
Inter Cos: 0.05927717313170433
Norm Quadratic Average: 113.39399719238281
Nearest Class Center Accuracy: 0.35424

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016031907871365547
Inter Cos: 0.05947224423289299
Norm Quadratic Average: 64.43476104736328
Nearest Class Center Accuracy: 0.46674

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014035499654710293
Inter Cos: 0.05628655105829239
Norm Quadratic Average: 65.0271224975586
Nearest Class Center Accuracy: 0.53034

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017439112067222595
Inter Cos: 0.05464525148272514
Norm Quadratic Average: 44.335227966308594
Nearest Class Center Accuracy: 0.60822

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0184793621301651
Inter Cos: 0.04727598652243614
Norm Quadratic Average: 46.811729431152344
Nearest Class Center Accuracy: 0.65276

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0207439623773098
Inter Cos: 0.041634347289800644
Norm Quadratic Average: 46.39704895019531
Nearest Class Center Accuracy: 0.69202

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023390039801597595
Inter Cos: 0.0366254523396492
Norm Quadratic Average: 46.72289276123047
Nearest Class Center Accuracy: 0.73174

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.043245770037174225
Inter Cos: 0.06459541618824005
Norm Quadratic Average: 32.25863265991211
Nearest Class Center Accuracy: 0.82162

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07841329276561737
Inter Cos: 0.07522456347942352
Norm Quadratic Average: 35.26261520385742
Nearest Class Center Accuracy: 0.8992

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.132186621427536
Inter Cos: 0.08532609045505524
Norm Quadratic Average: 35.92906951904297
Nearest Class Center Accuracy: 0.94978

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20350956916809082
Inter Cos: 0.11042924970388412
Norm Quadratic Average: 36.35032653808594
Nearest Class Center Accuracy: 0.97506

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.40395623445510864
Inter Cos: 0.21516655385494232
Norm Quadratic Average: 27.309833526611328
Nearest Class Center Accuracy: 0.98552

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6066844463348389
Inter Cos: 0.20065990090370178
Norm Quadratic Average: 19.657167434692383
Nearest Class Center Accuracy: 0.99312

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6599864363670349
Inter Cos: 0.13287344574928284
Norm Quadratic Average: 22.071332931518555
Nearest Class Center Accuracy: 0.98078

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6542467474937439
Inter Cos: 0.11292483657598495
Norm Quadratic Average: 25.694345474243164
Nearest Class Center Accuracy: 0.96118

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 73.48068237304688
Linear Weight Rank: 4031
Intra Cos: 0.7136291265487671
Inter Cos: 0.1295504868030548
Norm Quadratic Average: 83.1509780883789
Nearest Class Center Accuracy: 0.97952

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 30.23680305480957
Linear Weight Rank: 3670
Intra Cos: 0.8823725581169128
Inter Cos: 0.04768284037709236
Norm Quadratic Average: 44.45029067993164
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 3.784857749938965
Linear Weight Rank: 10
Intra Cos: 0.9174570441246033
Inter Cos: 0.04132659733295441
Norm Quadratic Average: 25.310266494750977
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.984563946723938
Inter Cos: 0.33435386419296265
Norm Quadratic Average: 22.70789909362793
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.9944025626182557
Accuracy: 0.8534
NC1 Within Class Collapse: 3.8291664123535156
NC2 Equinorm: Features: 0.20158153772354126, Weights: 0.01988011598587036
NC2 Equiangle: Features: 0.10754114786783854, Weights: 0.1309894561767578
NC3 Self-Duality: 0.6938582062721252
NC4 NCC Mismatch: 0.07289999999999996

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526075407862663
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550134658813477
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011448626406490803
Inter Cos: 0.059915851801633835
Norm Quadratic Average: 113.33245849609375
Nearest Class Center Accuracy: 0.375

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015084103681147099
Inter Cos: 0.06035355105996132
Norm Quadratic Average: 64.41234588623047
Nearest Class Center Accuracy: 0.4833

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013138673268258572
Inter Cos: 0.056827254593372345
Norm Quadratic Average: 65.03311920166016
Nearest Class Center Accuracy: 0.5387

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016133511438965797
Inter Cos: 0.05503510683774948
Norm Quadratic Average: 44.34920883178711
Nearest Class Center Accuracy: 0.611

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016771992668509483
Inter Cos: 0.047459859400987625
Norm Quadratic Average: 46.83171844482422
Nearest Class Center Accuracy: 0.6515

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018518606200814247
Inter Cos: 0.04183885455131531
Norm Quadratic Average: 46.39741516113281
Nearest Class Center Accuracy: 0.6816

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020121432840824127
Inter Cos: 0.03717924281954765
Norm Quadratic Average: 46.67406463623047
Nearest Class Center Accuracy: 0.7086

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03446424752473831
Inter Cos: 0.06622328609228134
Norm Quadratic Average: 32.18595886230469
Nearest Class Center Accuracy: 0.7546

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05926676094532013
Inter Cos: 0.07896220684051514
Norm Quadratic Average: 35.0726318359375
Nearest Class Center Accuracy: 0.7938

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09455617517232895
Inter Cos: 0.08158126473426819
Norm Quadratic Average: 35.57195281982422
Nearest Class Center Accuracy: 0.814

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.13642597198486328
Inter Cos: 0.10980686545372009
Norm Quadratic Average: 35.75748062133789
Nearest Class Center Accuracy: 0.8266

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.30421337485313416
Inter Cos: 0.22913169860839844
Norm Quadratic Average: 26.516969680786133
Nearest Class Center Accuracy: 0.8257

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4444376528263092
Inter Cos: 0.2982815206050873
Norm Quadratic Average: 18.66302490234375
Nearest Class Center Accuracy: 0.8284

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.46514734625816345
Inter Cos: 0.2987709045410156
Norm Quadratic Average: 20.720983505249023
Nearest Class Center Accuracy: 0.8238

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4297051727771759
Inter Cos: 0.30073976516723633
Norm Quadratic Average: 24.09208106994629
Nearest Class Center Accuracy: 0.8089

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 73.48068237304688
Linear Weight Rank: 4031
Intra Cos: 0.4863264560699463
Inter Cos: 0.29211995005607605
Norm Quadratic Average: 77.45890045166016
Nearest Class Center Accuracy: 0.8018

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 30.23680305480957
Linear Weight Rank: 3670
Intra Cos: 0.5500395894050598
Inter Cos: 0.1730116754770279
Norm Quadratic Average: 40.30027389526367
Nearest Class Center Accuracy: 0.8318

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 3.784857749938965
Linear Weight Rank: 10
Intra Cos: 0.5261210203170776
Inter Cos: 0.16683027148246765
Norm Quadratic Average: 23.1072940826416
Nearest Class Center Accuracy: 0.8366

Output Layer:
Intra Cos: 0.58177250623703
Inter Cos: 0.3551943302154541
Norm Quadratic Average: 20.311288833618164
Nearest Class Center Accuracy: 0.8505

