Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0198909193277359
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597179412841797
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013912820257246494
Inter Cos: 0.0642182007431984
Norm Quadratic Average: 8.628033638000488
Nearest Class Center Accuracy: 0.34058

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01798361912369728
Inter Cos: 0.06645654886960983
Norm Quadratic Average: 6.3713459968566895
Nearest Class Center Accuracy: 0.47678

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013682045973837376
Inter Cos: 0.049203258007764816
Norm Quadratic Average: 4.684021949768066
Nearest Class Center Accuracy: 0.5521

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015499803237617016
Inter Cos: 0.048487402498722076
Norm Quadratic Average: 3.2377769947052
Nearest Class Center Accuracy: 0.61966

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015889815986156464
Inter Cos: 0.04175536707043648
Norm Quadratic Average: 2.359632968902588
Nearest Class Center Accuracy: 0.67546

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018360503017902374
Inter Cos: 0.036698516458272934
Norm Quadratic Average: 2.1560306549072266
Nearest Class Center Accuracy: 0.72758

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01945456676185131
Inter Cos: 0.03256887570023537
Norm Quadratic Average: 1.9852372407913208
Nearest Class Center Accuracy: 0.78206

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04341646656394005
Inter Cos: 0.04674704372882843
Norm Quadratic Average: 1.514431357383728
Nearest Class Center Accuracy: 0.90034

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09802203625440598
Inter Cos: 0.05834369361400604
Norm Quadratic Average: 0.9695401191711426
Nearest Class Center Accuracy: 0.9546

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2598215341567993
Inter Cos: 0.10953833907842636
Norm Quadratic Average: 0.7368608713150024
Nearest Class Center Accuracy: 0.97114

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.44700658321380615
Inter Cos: 0.09131859987974167
Norm Quadratic Average: 0.5155500769615173
Nearest Class Center Accuracy: 0.99856

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7326427102088928
Inter Cos: 0.06725452095270157
Norm Quadratic Average: 0.3655964434146881
Nearest Class Center Accuracy: 1.0

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9349814653396606
Inter Cos: -0.02140408381819725
Norm Quadratic Average: 0.31030917167663574
Nearest Class Center Accuracy: 1.0

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9833734035491943
Inter Cos: -0.036761414259672165
Norm Quadratic Average: 0.44841402769088745
Nearest Class Center Accuracy: 1.0

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9945515990257263
Inter Cos: -0.05199754983186722
Norm Quadratic Average: 0.9079048037528992
Nearest Class Center Accuracy: 1.0

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.236177921295166
Linear Weight Rank: 2961
Intra Cos: 0.9983633756637573
Inter Cos: -0.04825009033083916
Norm Quadratic Average: 24.665557861328125
Nearest Class Center Accuracy: 1.0

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.302710771560669
Linear Weight Rank: 960
Intra Cos: 0.9987303614616394
Inter Cos: -0.017868896946310997
Norm Quadratic Average: 16.876787185668945
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.254282236099243
Linear Weight Rank: 9
Intra Cos: 0.9987301230430603
Inter Cos: 0.06362995505332947
Norm Quadratic Average: 11.98947525024414
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9991480708122253
Inter Cos: 0.11454622447490692
Norm Quadratic Average: 8.985294342041016
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.47311035568714144
Accuracy: 0.8881
NC1 Within Class Collapse: 2.190114974975586
NC2 Equinorm: Features: 0.10309668630361557, Weights: 0.009702490642666817
NC2 Equiangle: Features: 0.10147049162122938, Weights: 0.026537704467773437
NC3 Self-Duality: 0.0482058972120285
NC4 NCC Mismatch: 0.008700000000000041

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526077270507812
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550132751464844
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0120169622823596
Inter Cos: 0.06513422727584839
Norm Quadratic Average: 8.620333671569824
Nearest Class Center Accuracy: 0.3611

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01676659658551216
Inter Cos: 0.06799320876598358
Norm Quadratic Average: 6.368598461151123
Nearest Class Center Accuracy: 0.4907

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012851672247052193
Inter Cos: 0.04992913827300072
Norm Quadratic Average: 4.683800220489502
Nearest Class Center Accuracy: 0.5666

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014534803107380867
Inter Cos: 0.04925650358200073
Norm Quadratic Average: 3.2380542755126953
Nearest Class Center Accuracy: 0.6244

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014695660211145878
Inter Cos: 0.04232687130570412
Norm Quadratic Average: 2.359645128250122
Nearest Class Center Accuracy: 0.6717

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01661461964249611
Inter Cos: 0.03744148463010788
Norm Quadratic Average: 2.1538376808166504
Nearest Class Center Accuracy: 0.7096

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016746213659644127
Inter Cos: 0.03352975845336914
Norm Quadratic Average: 1.9809472560882568
Nearest Class Center Accuracy: 0.7451

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03358946368098259
Inter Cos: 0.04877535253763199
Norm Quadratic Average: 1.506298303604126
Nearest Class Center Accuracy: 0.8185

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07944489270448685
Inter Cos: 0.06381151080131531
Norm Quadratic Average: 0.9523890614509583
Nearest Class Center Accuracy: 0.8417

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20942196249961853
Inter Cos: 0.1422642469406128
Norm Quadratic Average: 0.7102550864219666
Nearest Class Center Accuracy: 0.8373

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3456149995326996
Inter Cos: 0.16545206308364868
Norm Quadratic Average: 0.49197837710380554
Nearest Class Center Accuracy: 0.8664

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5095318555831909
Inter Cos: 0.21493421494960785
Norm Quadratic Average: 0.34517961740493774
Nearest Class Center Accuracy: 0.8827

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5811930894851685
Inter Cos: 0.09552763402462006
Norm Quadratic Average: 0.2881186902523041
Nearest Class Center Accuracy: 0.8868

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6036045551300049
Inter Cos: 0.0571155920624733
Norm Quadratic Average: 0.41515326499938965
Nearest Class Center Accuracy: 0.8876

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6273365020751953
Inter Cos: 0.11235721409320831
Norm Quadratic Average: 0.8422806859016418
Nearest Class Center Accuracy: 0.8881

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.236177921295166
Linear Weight Rank: 2961
Intra Cos: 0.6426875591278076
Inter Cos: 0.17084084451198578
Norm Quadratic Average: 22.825584411621094
Nearest Class Center Accuracy: 0.8886

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.302710771560669
Linear Weight Rank: 960
Intra Cos: 0.6460880637168884
Inter Cos: 0.1848328709602356
Norm Quadratic Average: 15.632960319519043
Nearest Class Center Accuracy: 0.8887

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.254282236099243
Linear Weight Rank: 9
Intra Cos: 0.653449296951294
Inter Cos: 0.21474383771419525
Norm Quadratic Average: 11.137283325195312
Nearest Class Center Accuracy: 0.8889

Output Layer:
Intra Cos: 0.6591600775718689
Inter Cos: 0.22844253480434418
Norm Quadratic Average: 8.357619285583496
Nearest Class Center Accuracy: 0.8886

