Model save path: ./New_Models/bn_False_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.0005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0198909193277359
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597179412841797
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01755564473569393
Inter Cos: 0.0794249176979065
Norm Quadratic Average: 38.6381721496582
Nearest Class Center Accuracy: 0.35338

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01863277330994606
Inter Cos: 0.07058297842741013
Norm Quadratic Average: 40.02804183959961
Nearest Class Center Accuracy: 0.48432

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021653486415743828
Inter Cos: 0.06289894878864288
Norm Quadratic Average: 51.24433898925781
Nearest Class Center Accuracy: 0.56228

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02383391745388508
Inter Cos: 0.059461768716573715
Norm Quadratic Average: 32.886444091796875
Nearest Class Center Accuracy: 0.62288

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026210211217403412
Inter Cos: 0.05091991275548935
Norm Quadratic Average: 27.584012985229492
Nearest Class Center Accuracy: 0.67112

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03009631671011448
Inter Cos: 0.0489630363881588
Norm Quadratic Average: 19.48357391357422
Nearest Class Center Accuracy: 0.71342

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03536820784211159
Inter Cos: 0.046016763895750046
Norm Quadratic Average: 13.425100326538086
Nearest Class Center Accuracy: 0.74756

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06441614031791687
Inter Cos: 0.07492322474718094
Norm Quadratic Average: 5.75223445892334
Nearest Class Center Accuracy: 0.82106

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.15851879119873047
Inter Cos: 0.1210644468665123
Norm Quadratic Average: 3.708907127380371
Nearest Class Center Accuracy: 0.88126

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.32860973477363586
Inter Cos: 0.19115519523620605
Norm Quadratic Average: 2.664423704147339
Nearest Class Center Accuracy: 0.9456

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4694296419620514
Inter Cos: 0.24083983898162842
Norm Quadratic Average: 2.3879148960113525
Nearest Class Center Accuracy: 0.98038

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6264133453369141
Inter Cos: 0.2765443027019501
Norm Quadratic Average: 1.6822104454040527
Nearest Class Center Accuracy: 0.99516

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8286816477775574
Inter Cos: 0.2201584279537201
Norm Quadratic Average: 1.6742913722991943
Nearest Class Center Accuracy: 0.9991

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.871214747428894
Inter Cos: 0.22986377775669098
Norm Quadratic Average: 1.9431743621826172
Nearest Class Center Accuracy: 0.99974

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8871312141418457
Inter Cos: 0.23520152270793915
Norm Quadratic Average: 2.2351324558258057
Nearest Class Center Accuracy: 0.99996

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 20.315078735351562
Linear Weight Rank: 4031
Intra Cos: 0.9163159132003784
Inter Cos: 0.23316849768161774
Norm Quadratic Average: 15.032675743103027
Nearest Class Center Accuracy: 0.9999

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 8.798423767089844
Linear Weight Rank: 3667
Intra Cos: 0.9246702790260315
Inter Cos: 0.20901234447956085
Norm Quadratic Average: 15.270611763000488
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 3.1546196937561035
Linear Weight Rank: 10
Intra Cos: 0.9210492372512817
Inter Cos: 0.18258295953273773
Norm Quadratic Average: 15.97463321685791
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9284857511520386
Inter Cos: 0.31054335832595825
Norm Quadratic Average: 19.029918670654297
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.8438939064025879
Accuracy: 0.8434
NC1 Within Class Collapse: 4.164793014526367
NC2 Equinorm: Features: 0.1787918508052826, Weights: 0.021876757964491844
NC2 Equiangle: Features: 0.2524428473578559, Weights: 0.15481125513712565
NC3 Self-Duality: 0.1648198962211609
NC4 NCC Mismatch: 0.03190000000000004

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526077270507812
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550132751464844
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015640033408999443
Inter Cos: 0.07955481112003326
Norm Quadratic Average: 38.59042739868164
Nearest Class Center Accuracy: 0.3672

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017453614622354507
Inter Cos: 0.07135120779275894
Norm Quadratic Average: 40.0103874206543
Nearest Class Center Accuracy: 0.5011

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020173603668808937
Inter Cos: 0.06322012096643448
Norm Quadratic Average: 51.25864028930664
Nearest Class Center Accuracy: 0.5728

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02178802341222763
Inter Cos: 0.06014185771346092
Norm Quadratic Average: 32.91408920288086
Nearest Class Center Accuracy: 0.6262

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024000465869903564
Inter Cos: 0.05135117098689079
Norm Quadratic Average: 27.617733001708984
Nearest Class Center Accuracy: 0.667

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02713722176849842
Inter Cos: 0.04948558658361435
Norm Quadratic Average: 19.501506805419922
Nearest Class Center Accuracy: 0.6983

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03121281787753105
Inter Cos: 0.04648794233798981
Norm Quadratic Average: 13.4196195602417
Nearest Class Center Accuracy: 0.7226

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05385575443506241
Inter Cos: 0.07702070474624634
Norm Quadratic Average: 5.732110977172852
Nearest Class Center Accuracy: 0.7572

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.12922947108745575
Inter Cos: 0.12466735392808914
Norm Quadratic Average: 3.683806896209717
Nearest Class Center Accuracy: 0.7853

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2560809254646301
Inter Cos: 0.19261200726032257
Norm Quadratic Average: 2.6362082958221436
Nearest Class Center Accuracy: 0.815

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3281233608722687
Inter Cos: 0.24651871621608734
Norm Quadratic Average: 2.3513834476470947
Nearest Class Center Accuracy: 0.8264

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.41198551654815674
Inter Cos: 0.30505016446113586
Norm Quadratic Average: 1.642295241355896
Nearest Class Center Accuracy: 0.8308

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5195389986038208
Inter Cos: 0.3357359766960144
Norm Quadratic Average: 1.6125364303588867
Nearest Class Center Accuracy: 0.8344

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5230244398117065
Inter Cos: 0.30467134714126587
Norm Quadratic Average: 1.8603824377059937
Nearest Class Center Accuracy: 0.8361

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.517181932926178
Inter Cos: 0.27768099308013916
Norm Quadratic Average: 2.1335220336914062
Nearest Class Center Accuracy: 0.8378

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 20.315078735351562
Linear Weight Rank: 4031
Intra Cos: 0.5382038950920105
Inter Cos: 0.2496088743209839
Norm Quadratic Average: 14.30369758605957
Nearest Class Center Accuracy: 0.8377

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 8.798423767089844
Linear Weight Rank: 3667
Intra Cos: 0.5366880297660828
Inter Cos: 0.23243394494056702
Norm Quadratic Average: 14.54461669921875
Nearest Class Center Accuracy: 0.8385

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 3.1546196937561035
Linear Weight Rank: 10
Intra Cos: 0.5291174054145813
Inter Cos: 0.24470940232276917
Norm Quadratic Average: 15.288695335388184
Nearest Class Center Accuracy: 0.8396

Output Layer:
Intra Cos: 0.5391407608985901
Inter Cos: 0.3313816785812378
Norm Quadratic Average: 18.21199607849121
Nearest Class Center Accuracy: 0.8405

