Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.0005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597183227539062
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01142189558595419
Inter Cos: 0.055277708917856216
Norm Quadratic Average: 34.78266525268555
Nearest Class Center Accuracy: 0.34162

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016521457582712173
Inter Cos: 0.058663710951805115
Norm Quadratic Average: 21.846681594848633
Nearest Class Center Accuracy: 0.47038

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013290217146277428
Inter Cos: 0.050666775554418564
Norm Quadratic Average: 18.48371124267578
Nearest Class Center Accuracy: 0.53618

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015909826382994652
Inter Cos: 0.049811672419309616
Norm Quadratic Average: 12.271472930908203
Nearest Class Center Accuracy: 0.61044

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016463402658700943
Inter Cos: 0.04009387269616127
Norm Quadratic Average: 10.98737621307373
Nearest Class Center Accuracy: 0.66308

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018455570563673973
Inter Cos: 0.03265781328082085
Norm Quadratic Average: 10.472477912902832
Nearest Class Center Accuracy: 0.71634

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02068655751645565
Inter Cos: 0.029921598732471466
Norm Quadratic Average: 10.50953197479248
Nearest Class Center Accuracy: 0.76556

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04106367006897926
Inter Cos: 0.04847319796681404
Norm Quadratic Average: 7.088274955749512
Nearest Class Center Accuracy: 0.86054

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09173141419887543
Inter Cos: 0.052561208605766296
Norm Quadratic Average: 8.276744842529297
Nearest Class Center Accuracy: 0.9263

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.17129439115524292
Inter Cos: 0.07647760212421417
Norm Quadratic Average: 9.142743110656738
Nearest Class Center Accuracy: 0.95738

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2761470377445221
Inter Cos: 0.09264587610960007
Norm Quadratic Average: 9.821695327758789
Nearest Class Center Accuracy: 0.97614

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5378658175468445
Inter Cos: 0.16481651365756989
Norm Quadratic Average: 8.478097915649414
Nearest Class Center Accuracy: 0.97976

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7923807501792908
Inter Cos: 0.10709688812494278
Norm Quadratic Average: 5.754452705383301
Nearest Class Center Accuracy: 0.99772

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8668558597564697
Inter Cos: 0.00806158035993576
Norm Quadratic Average: 5.882347583770752
Nearest Class Center Accuracy: 1.0

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8834338784217834
Inter Cos: -0.022471316158771515
Norm Quadratic Average: 5.9508233070373535
Nearest Class Center Accuracy: 1.0

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 20.254831314086914
Linear Weight Rank: 4031
Intra Cos: 0.9547743201255798
Inter Cos: 0.028756940737366676
Norm Quadratic Average: 45.42692947387695
Nearest Class Center Accuracy: 1.0

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 8.763899803161621
Linear Weight Rank: 3666
Intra Cos: 0.9832382202148438
Inter Cos: 0.03872008994221687
Norm Quadratic Average: 27.331592559814453
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.56889009475708
Linear Weight Rank: 10
Intra Cos: 0.9751361608505249
Inter Cos: 0.035523656755685806
Norm Quadratic Average: 17.39998435974121
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9946434497833252
Inter Cos: 0.2065177708864212
Norm Quadratic Average: 13.674971580505371
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.7763230972766876
Accuracy: 0.8708
NC1 Within Class Collapse: 2.861100435256958
NC2 Equinorm: Features: 0.12416999042034149, Weights: 0.02540503814816475
NC2 Equiangle: Features: 0.09447858598497179, Weights: 0.06556464301215278
NC3 Self-Duality: 0.21858392655849457
NC4 NCC Mismatch: 0.014700000000000046

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526075407862663
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550134658813477
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01019157376140356
Inter Cos: 0.05618070811033249
Norm Quadratic Average: 34.75889587402344
Nearest Class Center Accuracy: 0.3575

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015383892692625523
Inter Cos: 0.05950761213898659
Norm Quadratic Average: 21.839012145996094
Nearest Class Center Accuracy: 0.4899

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012459313496947289
Inter Cos: 0.05094679445028305
Norm Quadratic Average: 18.488744735717773
Nearest Class Center Accuracy: 0.549

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014940516091883183
Inter Cos: 0.05014638230204582
Norm Quadratic Average: 12.277091979980469
Nearest Class Center Accuracy: 0.6167

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01506729144603014
Inter Cos: 0.0406339168548584
Norm Quadratic Average: 10.99197006225586
Nearest Class Center Accuracy: 0.6602

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01646554097533226
Inter Cos: 0.03338620811700821
Norm Quadratic Average: 10.469564437866211
Nearest Class Center Accuracy: 0.702

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017718076705932617
Inter Cos: 0.031182467937469482
Norm Quadratic Average: 10.492599487304688
Nearest Class Center Accuracy: 0.7363

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03266220539808273
Inter Cos: 0.05092811584472656
Norm Quadratic Average: 7.059351444244385
Nearest Class Center Accuracy: 0.7855

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06762108206748962
Inter Cos: 0.059684738516807556
Norm Quadratic Average: 8.190547943115234
Nearest Class Center Accuracy: 0.8125

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1287192553281784
Inter Cos: 0.08385574817657471
Norm Quadratic Average: 8.968862533569336
Nearest Class Center Accuracy: 0.8219

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.19237467646598816
Inter Cos: 0.11613154411315918
Norm Quadratic Average: 9.547048568725586
Nearest Class Center Accuracy: 0.8298

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.37961146235466003
Inter Cos: 0.24377119541168213
Norm Quadratic Average: 8.142241477966309
Nearest Class Center Accuracy: 0.8215

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5546811819076538
Inter Cos: 0.2737232446670532
Norm Quadratic Average: 5.416057586669922
Nearest Class Center Accuracy: 0.8418

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5830131769180298
Inter Cos: 0.20790667831897736
Norm Quadratic Average: 5.456772804260254
Nearest Class Center Accuracy: 0.8599

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5547443628311157
Inter Cos: 0.12863481044769287
Norm Quadratic Average: 5.484157085418701
Nearest Class Center Accuracy: 0.8675

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 20.254831314086914
Linear Weight Rank: 4031
Intra Cos: 0.567881166934967
Inter Cos: 0.1067415103316307
Norm Quadratic Average: 41.56654739379883
Nearest Class Center Accuracy: 0.868

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 8.763899803161621
Linear Weight Rank: 3666
Intra Cos: 0.5495877265930176
Inter Cos: 0.08694948256015778
Norm Quadratic Average: 25.126291275024414
Nearest Class Center Accuracy: 0.8684

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.56889009475708
Linear Weight Rank: 10
Intra Cos: 0.5410972237586975
Inter Cos: 0.12004987895488739
Norm Quadratic Average: 16.25084686279297
Nearest Class Center Accuracy: 0.869

Output Layer:
Intra Cos: 0.6065208315849304
Inter Cos: 0.2501358389854431
Norm Quadratic Average: 12.561701774597168
Nearest Class Center Accuracy: 0.8705

