Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.0003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0198909193277359
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597179412841797
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01098423358052969
Inter Cos: 0.055444926023483276
Norm Quadratic Average: 59.5226936340332
Nearest Class Center Accuracy: 0.34564

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017355529591441154
Inter Cos: 0.06333906948566437
Norm Quadratic Average: 34.82890319824219
Nearest Class Center Accuracy: 0.46168

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013574972748756409
Inter Cos: 0.05691548064351082
Norm Quadratic Average: 32.47195053100586
Nearest Class Center Accuracy: 0.52256

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01682893931865692
Inter Cos: 0.056031230837106705
Norm Quadratic Average: 22.232318878173828
Nearest Class Center Accuracy: 0.60142

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017313601449131966
Inter Cos: 0.04698140174150467
Norm Quadratic Average: 22.227685928344727
Nearest Class Center Accuracy: 0.64812

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019180256873369217
Inter Cos: 0.04141940921545029
Norm Quadratic Average: 21.610454559326172
Nearest Class Center Accuracy: 0.69312

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02154087834060192
Inter Cos: 0.03454720973968506
Norm Quadratic Average: 21.661293029785156
Nearest Class Center Accuracy: 0.73876

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.040861837565898895
Inter Cos: 0.05228772759437561
Norm Quadratic Average: 15.475603103637695
Nearest Class Center Accuracy: 0.83222

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08156868815422058
Inter Cos: 0.06475994735956192
Norm Quadratic Average: 17.841053009033203
Nearest Class Center Accuracy: 0.91456

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.14209547638893127
Inter Cos: 0.07651273161172867
Norm Quadratic Average: 18.681440353393555
Nearest Class Center Accuracy: 0.95748

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.22736908495426178
Inter Cos: 0.08717785030603409
Norm Quadratic Average: 19.098661422729492
Nearest Class Center Accuracy: 0.9791

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4582033157348633
Inter Cos: 0.12645284831523895
Norm Quadratic Average: 15.148711204528809
Nearest Class Center Accuracy: 0.9888

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7095903158187866
Inter Cos: 0.08807840198278427
Norm Quadratic Average: 10.673890113830566
Nearest Class Center Accuracy: 0.9989

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7962571382522583
Inter Cos: -0.0044718412682414055
Norm Quadratic Average: 11.115575790405273
Nearest Class Center Accuracy: 1.0

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8043797016143799
Inter Cos: -0.011519508436322212
Norm Quadratic Average: 11.732213020324707
Nearest Class Center Accuracy: 0.9997

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 38.51051330566406
Linear Weight Rank: 4031
Intra Cos: 0.8753443360328674
Inter Cos: 0.06299488991498947
Norm Quadratic Average: 70.608154296875
Nearest Class Center Accuracy: 1.0

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 16.048480987548828
Linear Weight Rank: 3668
Intra Cos: 0.9606183767318726
Inter Cos: 0.0787733718752861
Norm Quadratic Average: 39.18682098388672
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.893357992172241
Linear Weight Rank: 10
Intra Cos: 0.9603734016418457
Inter Cos: 0.05183973163366318
Norm Quadratic Average: 22.958030700683594
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9918126463890076
Inter Cos: 0.2244638353586197
Norm Quadratic Average: 18.567150115966797
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.9175103651046753
Accuracy: 0.8593
NC1 Within Class Collapse: 3.3693602085113525
NC2 Equinorm: Features: 0.16061300039291382, Weights: 0.02294510044157505
NC2 Equiangle: Features: 0.1107455677456326, Weights: 0.09731470743815104
NC3 Self-Duality: 0.4168560206890106
NC4 NCC Mismatch: 0.040100000000000025

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526077270507812
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550132751464844
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.009795166552066803
Inter Cos: 0.05664696544408798
Norm Quadratic Average: 59.46916198730469
Nearest Class Center Accuracy: 0.3653

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01636946201324463
Inter Cos: 0.06456825137138367
Norm Quadratic Average: 34.8149528503418
Nearest Class Center Accuracy: 0.4788

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013009021058678627
Inter Cos: 0.05773501843214035
Norm Quadratic Average: 32.47145080566406
Nearest Class Center Accuracy: 0.5378

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0157582089304924
Inter Cos: 0.05698419362306595
Norm Quadratic Average: 22.235212326049805
Nearest Class Center Accuracy: 0.6061

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016020946204662323
Inter Cos: 0.04780920594930649
Norm Quadratic Average: 22.23485565185547
Nearest Class Center Accuracy: 0.6477

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017388587817549706
Inter Cos: 0.042236536741256714
Norm Quadratic Average: 21.603975296020508
Nearest Class Center Accuracy: 0.682

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01885978877544403
Inter Cos: 0.03561962768435478
Norm Quadratic Average: 21.63237190246582
Nearest Class Center Accuracy: 0.7112

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03237757086753845
Inter Cos: 0.054152511060237885
Norm Quadratic Average: 15.428276062011719
Nearest Class Center Accuracy: 0.7649

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06012250855565071
Inter Cos: 0.06920741498470306
Norm Quadratic Average: 17.70233726501465
Nearest Class Center Accuracy: 0.8045

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10470233112573624
Inter Cos: 0.07810211926698685
Norm Quadratic Average: 18.41530990600586
Nearest Class Center Accuracy: 0.8196

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1530514806509018
Inter Cos: 0.10081911087036133
Norm Quadratic Average: 18.680870056152344
Nearest Class Center Accuracy: 0.8286

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3333820700645447
Inter Cos: 0.18641290068626404
Norm Quadratic Average: 14.628240585327148
Nearest Class Center Accuracy: 0.8272

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.49808016419410706
Inter Cos: 0.2399272471666336
Norm Quadratic Average: 10.074934005737305
Nearest Class Center Accuracy: 0.8379

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5240386128425598
Inter Cos: 0.20616458356380463
Norm Quadratic Average: 10.339971542358398
Nearest Class Center Accuracy: 0.8453

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5232111811637878
Inter Cos: 0.1653071641921997
Norm Quadratic Average: 10.816473960876465
Nearest Class Center Accuracy: 0.8464

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 38.51051330566406
Linear Weight Rank: 4031
Intra Cos: 0.5660495162010193
Inter Cos: 0.16008149087429047
Norm Quadratic Average: 64.58338165283203
Nearest Class Center Accuracy: 0.8484

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 16.048480987548828
Linear Weight Rank: 3668
Intra Cos: 0.5273450016975403
Inter Cos: 0.13728152215480804
Norm Quadratic Average: 35.6518669128418
Nearest Class Center Accuracy: 0.8532

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.893357992172241
Linear Weight Rank: 10
Intra Cos: 0.523276150226593
Inter Cos: 0.16419793665409088
Norm Quadratic Average: 21.19569206237793
Nearest Class Center Accuracy: 0.8542

Output Layer:
Intra Cos: 0.5955613851547241
Inter Cos: 0.30549371242523193
Norm Quadratic Average: 16.719738006591797
Nearest Class Center Accuracy: 0.8602

