Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.01.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597183227539062
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011040532030165195
Inter Cos: 0.05604759231209755
Norm Quadratic Average: 6.053685665130615
Nearest Class Center Accuracy: 0.34088

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01866173930466175
Inter Cos: 0.06270848214626312
Norm Quadratic Average: 4.94924259185791
Nearest Class Center Accuracy: 0.47312

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012324207462370396
Inter Cos: 0.04919225350022316
Norm Quadratic Average: 3.4695138931274414
Nearest Class Center Accuracy: 0.5601

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014789938926696777
Inter Cos: 0.04577944427728653
Norm Quadratic Average: 2.387300968170166
Nearest Class Center Accuracy: 0.64036

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01700878143310547
Inter Cos: 0.03743371739983559
Norm Quadratic Average: 1.763474941253662
Nearest Class Center Accuracy: 0.69538

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021121740341186523
Inter Cos: 0.034703899174928665
Norm Quadratic Average: 1.482278823852539
Nearest Class Center Accuracy: 0.7563

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025419287383556366
Inter Cos: 0.029858967289328575
Norm Quadratic Average: 1.2634681463241577
Nearest Class Center Accuracy: 0.83716

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07525603473186493
Inter Cos: 0.046038202941417694
Norm Quadratic Average: 0.9069164395332336
Nearest Class Center Accuracy: 0.93622

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1950690895318985
Inter Cos: 0.07230658829212189
Norm Quadratic Average: 0.6094892024993896
Nearest Class Center Accuracy: 0.9576

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.45901134610176086
Inter Cos: 0.12593770027160645
Norm Quadratic Average: 0.4196549952030182
Nearest Class Center Accuracy: 0.98624

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5892917513847351
Inter Cos: 0.0727320984005928
Norm Quadratic Average: 0.25520843267440796
Nearest Class Center Accuracy: 0.99928

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8228455781936646
Inter Cos: 0.03095150552690029
Norm Quadratic Average: 0.18132461607456207
Nearest Class Center Accuracy: 0.99992

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9397229552268982
Inter Cos: 0.02358020842075348
Norm Quadratic Average: 0.2011551409959793
Nearest Class Center Accuracy: 0.99992

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9924027919769287
Inter Cos: -0.001727246679365635
Norm Quadratic Average: 0.46451056003570557
Nearest Class Center Accuracy: 0.99992

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9977220296859741
Inter Cos: -0.07193176448345184
Norm Quadratic Average: 1.0127915143966675
Nearest Class Center Accuracy: 0.99992

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.0919008255004883
Linear Weight Rank: 10
Intra Cos: 0.9985138773918152
Inter Cos: -0.015404862351715565
Norm Quadratic Average: 24.989450454711914
Nearest Class Center Accuracy: 0.99992

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.0966176986694336
Linear Weight Rank: 1453
Intra Cos: 0.9986326694488525
Inter Cos: 0.016104891896247864
Norm Quadratic Average: 16.384695053100586
Nearest Class Center Accuracy: 0.99992

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.094874858856201
Linear Weight Rank: 9
Intra Cos: 0.9987174868583679
Inter Cos: 0.08204448968172073
Norm Quadratic Average: 10.912259101867676
Nearest Class Center Accuracy: 0.99992

Output Layer:
Intra Cos: 0.9988929033279419
Inter Cos: 0.1775008589029312
Norm Quadratic Average: 7.69229793548584
Nearest Class Center Accuracy: 0.99992

Test Set:
Average Loss: 0.4302614429950714
Accuracy: 0.8965
NC1 Within Class Collapse: 2.0238442420959473
NC2 Equinorm: Features: 0.08316144347190857, Weights: 0.006418166216462851
NC2 Equiangle: Features: 0.09179426829020182, Weights: 0.03205421765645345
NC3 Self-Duality: 0.01866649091243744
NC4 NCC Mismatch: 0.0049000000000000155

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526075407862663
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550134658813477
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011130024679005146
Inter Cos: 0.05664573237299919
Norm Quadratic Average: 6.049405097961426
Nearest Class Center Accuracy: 0.3614

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01732218638062477
Inter Cos: 0.06365006417036057
Norm Quadratic Average: 4.948103904724121
Nearest Class Center Accuracy: 0.4903

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011552653275430202
Inter Cos: 0.049401234835386276
Norm Quadratic Average: 3.4712753295898438
Nearest Class Center Accuracy: 0.5798

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01370231993496418
Inter Cos: 0.0464579313993454
Norm Quadratic Average: 2.3888494968414307
Nearest Class Center Accuracy: 0.6463

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015351579524576664
Inter Cos: 0.03813828527927399
Norm Quadratic Average: 1.7652558088302612
Nearest Class Center Accuracy: 0.6881

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01820494793355465
Inter Cos: 0.0356207937002182
Norm Quadratic Average: 1.4809926748275757
Nearest Class Center Accuracy: 0.7278

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019874585792422295
Inter Cos: 0.03115357644855976
Norm Quadratic Average: 1.2569457292556763
Nearest Class Center Accuracy: 0.7812

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.052244458347558975
Inter Cos: 0.04923895001411438
Norm Quadratic Average: 0.8952165842056274
Nearest Class Center Accuracy: 0.8383

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.16615724563598633
Inter Cos: 0.08893785625696182
Norm Quadratic Average: 0.5904065370559692
Nearest Class Center Accuracy: 0.8378

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3705032765865326
Inter Cos: 0.19493520259857178
Norm Quadratic Average: 0.40168753266334534
Nearest Class Center Accuracy: 0.8474

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4300280511379242
Inter Cos: 0.15183590352535248
Norm Quadratic Average: 0.24210065603256226
Nearest Class Center Accuracy: 0.8821

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5535680651664734
Inter Cos: 0.15577542781829834
Norm Quadratic Average: 0.1716165542602539
Nearest Class Center Accuracy: 0.8853

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6113871932029724
Inter Cos: 0.08721715211868286
Norm Quadratic Average: 0.19098077714443207
Nearest Class Center Accuracy: 0.8947

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6436100602149963
Inter Cos: 0.05821991339325905
Norm Quadratic Average: 0.43614640831947327
Nearest Class Center Accuracy: 0.8958

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6531331539154053
Inter Cos: 0.0908038541674614
Norm Quadratic Average: 0.949799656867981
Nearest Class Center Accuracy: 0.8962

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.0919008255004883
Linear Weight Rank: 10
Intra Cos: 0.6619893908500671
Inter Cos: 0.11540168523788452
Norm Quadratic Average: 23.36981201171875
Nearest Class Center Accuracy: 0.8962

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.0966176986694336
Linear Weight Rank: 1453
Intra Cos: 0.6699309349060059
Inter Cos: 0.15963198244571686
Norm Quadratic Average: 15.339179992675781
Nearest Class Center Accuracy: 0.8962

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.094874858856201
Linear Weight Rank: 9
Intra Cos: 0.6774777770042419
Inter Cos: 0.20452071726322174
Norm Quadratic Average: 10.227513313293457
Nearest Class Center Accuracy: 0.8962

Output Layer:
Intra Cos: 0.6899933815002441
Inter Cos: 0.2571432590484619
Norm Quadratic Average: 7.223120212554932
Nearest Class Center Accuracy: 0.8958

