Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.02.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0198909193277359
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597179412841797
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012424187734723091
Inter Cos: 0.05411547049880028
Norm Quadratic Average: 4.517610549926758
Nearest Class Center Accuracy: 0.33928

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02031244896352291
Inter Cos: 0.0742008164525032
Norm Quadratic Average: 3.684504747390747
Nearest Class Center Accuracy: 0.4657

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013684011995792389
Inter Cos: 0.055340226739645004
Norm Quadratic Average: 2.6102190017700195
Nearest Class Center Accuracy: 0.54956

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015743594616651535
Inter Cos: 0.04906371235847473
Norm Quadratic Average: 1.732621431350708
Nearest Class Center Accuracy: 0.6316

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018419954925775528
Inter Cos: 0.04127249866724014
Norm Quadratic Average: 1.3700032234191895
Nearest Class Center Accuracy: 0.6859

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021985867992043495
Inter Cos: 0.04147293418645859
Norm Quadratic Average: 1.1952499151229858
Nearest Class Center Accuracy: 0.74332

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.028076305985450745
Inter Cos: 0.03761642053723335
Norm Quadratic Average: 0.9442625641822815
Nearest Class Center Accuracy: 0.83522

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08552144467830658
Inter Cos: 0.08152025938034058
Norm Quadratic Average: 0.5034133195877075
Nearest Class Center Accuracy: 0.95736

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3464750349521637
Inter Cos: 0.14228346943855286
Norm Quadratic Average: 0.28097623586654663
Nearest Class Center Accuracy: 0.97632

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6245848536491394
Inter Cos: 0.1768736094236374
Norm Quadratic Average: 0.17652738094329834
Nearest Class Center Accuracy: 0.99766

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7481679916381836
Inter Cos: 0.22192683815956116
Norm Quadratic Average: 0.16065827012062073
Nearest Class Center Accuracy: 0.99886

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9047372937202454
Inter Cos: 0.16788680851459503
Norm Quadratic Average: 0.14570008218288422
Nearest Class Center Accuracy: 0.99988

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.931472897529602
Inter Cos: 0.12436214834451675
Norm Quadratic Average: 0.14656493067741394
Nearest Class Center Accuracy: 0.99996

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.986907422542572
Inter Cos: 0.09983248263597488
Norm Quadratic Average: 0.31385961174964905
Nearest Class Center Accuracy: 0.99996

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9963729381561279
Inter Cos: 0.07441819459199905
Norm Quadratic Average: 0.8643624186515808
Nearest Class Center Accuracy: 0.99996

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.00327467918396
Linear Weight Rank: 9
Intra Cos: 0.997948408126831
Inter Cos: 0.244270920753479
Norm Quadratic Average: 23.815227508544922
Nearest Class Center Accuracy: 0.99996

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.006925344467163
Linear Weight Rank: 1421
Intra Cos: 0.9984263181686401
Inter Cos: 0.2546885907649994
Norm Quadratic Average: 15.740653991699219
Nearest Class Center Accuracy: 0.99996

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.0064661502838135
Linear Weight Rank: 9
Intra Cos: 0.9987210035324097
Inter Cos: 0.22952505946159363
Norm Quadratic Average: 10.622830390930176
Nearest Class Center Accuracy: 0.99996

Output Layer:
Intra Cos: 0.9990290999412537
Inter Cos: 0.1588267683982849
Norm Quadratic Average: 7.619103908538818
Nearest Class Center Accuracy: 0.99996

Test Set:
Average Loss: 0.45945761633217336
Accuracy: 0.8826
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.08578351140022278, Weights: 0.011017152108252048
NC2 Equiangle: Features: 0.14037833743625217, Weights: 0.10365956624348958
NC3 Self-Duality: 0.04456319659948349
NC4 NCC Mismatch: 0.008000000000000007

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526077270507812
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550132751464844
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011010984890162945
Inter Cos: 0.0541858933866024
Norm Quadratic Average: 4.5121307373046875
Nearest Class Center Accuracy: 0.3589

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01883867383003235
Inter Cos: 0.0755821242928505
Norm Quadratic Average: 3.6821045875549316
Nearest Class Center Accuracy: 0.4842

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012908728793263435
Inter Cos: 0.055849649012088776
Norm Quadratic Average: 2.610305070877075
Nearest Class Center Accuracy: 0.5689

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014902225695550442
Inter Cos: 0.04978612810373306
Norm Quadratic Average: 1.733047366142273
Nearest Class Center Accuracy: 0.6373

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017017513513565063
Inter Cos: 0.041738517582416534
Norm Quadratic Average: 1.3701497316360474
Nearest Class Center Accuracy: 0.6812

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0194430910050869
Inter Cos: 0.04181096330285072
Norm Quadratic Average: 1.1941694021224976
Nearest Class Center Accuracy: 0.7173

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02273576147854328
Inter Cos: 0.03867166489362717
Norm Quadratic Average: 0.9410505890846252
Nearest Class Center Accuracy: 0.774

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.060680683702230453
Inter Cos: 0.08402031660079956
Norm Quadratic Average: 0.4978853464126587
Nearest Class Center Accuracy: 0.8454

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2944885492324829
Inter Cos: 0.16581828892230988
Norm Quadratic Average: 0.27312758564949036
Nearest Class Center Accuracy: 0.8397

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4566347002983093
Inter Cos: 0.22755762934684753
Norm Quadratic Average: 0.16920454800128937
Nearest Class Center Accuracy: 0.8611

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5022903084754944
Inter Cos: 0.2555510401725769
Norm Quadratic Average: 0.15249161422252655
Nearest Class Center Accuracy: 0.8727

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6092560887336731
Inter Cos: 0.17216718196868896
Norm Quadratic Average: 0.13796387612819672
Nearest Class Center Accuracy: 0.8653

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6070233583450317
Inter Cos: 0.1761760413646698
Norm Quadratic Average: 0.13915397226810455
Nearest Class Center Accuracy: 0.8797

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6213711500167847
Inter Cos: 0.1535387933254242
Norm Quadratic Average: 0.29594936966896057
Nearest Class Center Accuracy: 0.8819

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6406879425048828
Inter Cos: 0.18737415969371796
Norm Quadratic Average: 0.81309974193573
Nearest Class Center Accuracy: 0.8826

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.00327467918396
Linear Weight Rank: 9
Intra Cos: 0.6584969758987427
Inter Cos: 0.3010202944278717
Norm Quadratic Average: 22.385730743408203
Nearest Class Center Accuracy: 0.8833

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.006925344467163
Linear Weight Rank: 1421
Intra Cos: 0.6650258898735046
Inter Cos: 0.3110854923725128
Norm Quadratic Average: 14.804556846618652
Nearest Class Center Accuracy: 0.8833

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.0064661502838135
Linear Weight Rank: 9
Intra Cos: 0.6695912480354309
Inter Cos: 0.3075005114078522
Norm Quadratic Average: 9.996440887451172
Nearest Class Center Accuracy: 0.8836

Output Layer:
Intra Cos: 0.6829116344451904
Inter Cos: 0.2773965895175934
Norm Quadratic Average: 7.184414863586426
Nearest Class Center Accuracy: 0.8829

