Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0198909193277359
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597179412841797
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012723137624561787
Inter Cos: 0.06295598298311234
Norm Quadratic Average: 20.900299072265625
Nearest Class Center Accuracy: 0.34442

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016688937321305275
Inter Cos: 0.06323998421430588
Norm Quadratic Average: 14.321372985839844
Nearest Class Center Accuracy: 0.47824

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014104802161455154
Inter Cos: 0.053330205380916595
Norm Quadratic Average: 11.030854225158691
Nearest Class Center Accuracy: 0.54434

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017642993479967117
Inter Cos: 0.05697248503565788
Norm Quadratic Average: 7.716215133666992
Nearest Class Center Accuracy: 0.61276

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017605861648917198
Inter Cos: 0.04636223986744881
Norm Quadratic Average: 6.061825275421143
Nearest Class Center Accuracy: 0.66466

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018535573035478592
Inter Cos: 0.038854245096445084
Norm Quadratic Average: 5.837344169616699
Nearest Class Center Accuracy: 0.71242

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020843181759119034
Inter Cos: 0.033395007252693176
Norm Quadratic Average: 5.738420486450195
Nearest Class Center Accuracy: 0.76248

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04177575930953026
Inter Cos: 0.044681087136268616
Norm Quadratic Average: 4.003739833831787
Nearest Class Center Accuracy: 0.86898

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09111803025007248
Inter Cos: 0.04868609458208084
Norm Quadratic Average: 2.641233205795288
Nearest Class Center Accuracy: 0.9323

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1993214339017868
Inter Cos: 0.07173307240009308
Norm Quadratic Average: 2.4301347732543945
Nearest Class Center Accuracy: 0.95508

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.32327061891555786
Inter Cos: 0.06623663753271103
Norm Quadratic Average: 2.1739320755004883
Nearest Class Center Accuracy: 0.98376

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.623653769493103
Inter Cos: 0.0723055824637413
Norm Quadratic Average: 1.9676964282989502
Nearest Class Center Accuracy: 0.99074

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8958618640899658
Inter Cos: 0.034822072833776474
Norm Quadratic Average: 1.2327802181243896
Nearest Class Center Accuracy: 0.99898

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9339585900306702
Inter Cos: 0.012458758428692818
Norm Quadratic Average: 1.2351858615875244
Nearest Class Center Accuracy: 1.0

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9557048678398132
Inter Cos: -0.043463461101055145
Norm Quadratic Average: 1.1731141805648804
Nearest Class Center Accuracy: 1.0

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 4.652191162109375
Linear Weight Rank: 4029
Intra Cos: 0.9910096526145935
Inter Cos: -0.05981700122356415
Norm Quadratic Average: 24.461162567138672
Nearest Class Center Accuracy: 1.0

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.1978557109832764
Linear Weight Rank: 3637
Intra Cos: 0.9940997958183289
Inter Cos: -0.014789445325732231
Norm Quadratic Average: 17.186386108398438
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.505500078201294
Linear Weight Rank: 9
Intra Cos: 0.9941726326942444
Inter Cos: 0.018790675327181816
Norm Quadratic Average: 12.840832710266113
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9960999488830566
Inter Cos: 0.166914165019989
Norm Quadratic Average: 10.609442710876465
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.7051573070526123
Accuracy: 0.8742
NC1 Within Class Collapse: 2.6799066066741943
NC2 Equinorm: Features: 0.12046550959348679, Weights: 0.01799304410815239
NC2 Equiangle: Features: 0.0990181393093533, Weights: 0.04853801197475857
NC3 Self-Duality: 0.08076459914445877
NC4 NCC Mismatch: 0.006900000000000017

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526077270507812
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550132751464844
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011140295304358006
Inter Cos: 0.06401968002319336
Norm Quadratic Average: 20.885658264160156
Nearest Class Center Accuracy: 0.3632

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015523449517786503
Inter Cos: 0.0644356906414032
Norm Quadratic Average: 14.318645477294922
Nearest Class Center Accuracy: 0.4942

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013316841796040535
Inter Cos: 0.05396343022584915
Norm Quadratic Average: 11.03383731842041
Nearest Class Center Accuracy: 0.5577

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01686171442270279
Inter Cos: 0.057840459048748016
Norm Quadratic Average: 7.719362735748291
Nearest Class Center Accuracy: 0.6178

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016659585759043694
Inter Cos: 0.04693801701068878
Norm Quadratic Average: 6.063006401062012
Nearest Class Center Accuracy: 0.6615

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01689600758254528
Inter Cos: 0.03959322348237038
Norm Quadratic Average: 5.833185195922852
Nearest Class Center Accuracy: 0.6974

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01806468516588211
Inter Cos: 0.03466004133224487
Norm Quadratic Average: 5.727921485900879
Nearest Class Center Accuracy: 0.733

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.032467179000377655
Inter Cos: 0.04695131629705429
Norm Quadratic Average: 3.9880213737487793
Nearest Class Center Accuracy: 0.7967

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06761141866445541
Inter Cos: 0.054367125034332275
Norm Quadratic Average: 2.6080281734466553
Nearest Class Center Accuracy: 0.8256

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.15282008051872253
Inter Cos: 0.08845128864049911
Norm Quadratic Average: 2.3649885654449463
Nearest Class Center Accuracy: 0.823

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2514897286891937
Inter Cos: 0.11399317532777786
Norm Quadratic Average: 2.092128038406372
Nearest Class Center Accuracy: 0.8388

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.42969831824302673
Inter Cos: 0.191924586892128
Norm Quadratic Average: 1.8714038133621216
Nearest Class Center Accuracy: 0.8324

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5944570899009705
Inter Cos: 0.20615240931510925
Norm Quadratic Average: 1.1520013809204102
Nearest Class Center Accuracy: 0.8488

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5894857048988342
Inter Cos: 0.15323957800865173
Norm Quadratic Average: 1.1481958627700806
Nearest Class Center Accuracy: 0.8629

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.553991973400116
Inter Cos: 0.09097188711166382
Norm Quadratic Average: 1.1041232347488403
Nearest Class Center Accuracy: 0.8734

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 4.652191162109375
Linear Weight Rank: 4029
Intra Cos: 0.5669415593147278
Inter Cos: 0.12116431444883347
Norm Quadratic Average: 22.949970245361328
Nearest Class Center Accuracy: 0.8742

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.1978557109832764
Linear Weight Rank: 3637
Intra Cos: 0.5646848678588867
Inter Cos: 0.11401423066854477
Norm Quadratic Average: 16.163610458374023
Nearest Class Center Accuracy: 0.8748

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.505500078201294
Linear Weight Rank: 9
Intra Cos: 0.571147620677948
Inter Cos: 0.14562314748764038
Norm Quadratic Average: 12.156264305114746
Nearest Class Center Accuracy: 0.8752

Output Layer:
Intra Cos: 0.6009833216667175
Inter Cos: 0.23172158002853394
Norm Quadratic Average: 10.048141479492188
Nearest Class Center Accuracy: 0.8754

