Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.02.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597183227539062
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011154328472912312
Inter Cos: 0.05911817401647568
Norm Quadratic Average: 4.673061847686768
Nearest Class Center Accuracy: 0.3324

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019055314362049103
Inter Cos: 0.07302785664796829
Norm Quadratic Average: 3.7220499515533447
Nearest Class Center Accuracy: 0.46034

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013277407735586166
Inter Cos: 0.05754505842924118
Norm Quadratic Average: 2.587928533554077
Nearest Class Center Accuracy: 0.54678

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015296760946512222
Inter Cos: 0.049745142459869385
Norm Quadratic Average: 1.722913384437561
Nearest Class Center Accuracy: 0.63082

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019022829830646515
Inter Cos: 0.041302721947431564
Norm Quadratic Average: 1.3902103900909424
Nearest Class Center Accuracy: 0.68496

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02236299216747284
Inter Cos: 0.04239508509635925
Norm Quadratic Average: 1.201772928237915
Nearest Class Center Accuracy: 0.74606

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02744840271770954
Inter Cos: 0.0339592806994915
Norm Quadratic Average: 0.9322947859764099
Nearest Class Center Accuracy: 0.8275

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08826731890439987
Inter Cos: 0.060700058937072754
Norm Quadratic Average: 0.5010760426521301
Nearest Class Center Accuracy: 0.95536

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.30289578437805176
Inter Cos: 0.15670891106128693
Norm Quadratic Average: 0.2752051055431366
Nearest Class Center Accuracy: 0.97518

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6684820652008057
Inter Cos: 0.15530744194984436
Norm Quadratic Average: 0.17395314574241638
Nearest Class Center Accuracy: 0.99582

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.775079607963562
Inter Cos: 0.0311577171087265
Norm Quadratic Average: 0.14279593527317047
Nearest Class Center Accuracy: 0.9991

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9117487072944641
Inter Cos: 0.228735089302063
Norm Quadratic Average: 0.14767810702323914
Nearest Class Center Accuracy: 0.99994

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9378498196601868
Inter Cos: 0.2162870466709137
Norm Quadratic Average: 0.16008314490318298
Nearest Class Center Accuracy: 0.99998

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9899619221687317
Inter Cos: 0.14280545711517334
Norm Quadratic Average: 0.30281493067741394
Nearest Class Center Accuracy: 0.99998

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9967594146728516
Inter Cos: 0.07023303955793381
Norm Quadratic Average: 0.878165066242218
Nearest Class Center Accuracy: 0.99998

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.0019118785858154
Linear Weight Rank: 9
Intra Cos: 0.9979057908058167
Inter Cos: 0.20565827190876007
Norm Quadratic Average: 23.77414894104004
Nearest Class Center Accuracy: 0.99998

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.0055744647979736
Linear Weight Rank: 1563
Intra Cos: 0.998358964920044
Inter Cos: 0.22183620929718018
Norm Quadratic Average: 15.690689086914062
Nearest Class Center Accuracy: 0.99998

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.005092144012451
Linear Weight Rank: 9
Intra Cos: 0.998610258102417
Inter Cos: 0.20757503807544708
Norm Quadratic Average: 10.571495056152344
Nearest Class Center Accuracy: 0.99998

Output Layer:
Intra Cos: 0.998890221118927
Inter Cos: 0.17114074528217316
Norm Quadratic Average: 7.579672813415527
Nearest Class Center Accuracy: 0.99998

Test Set:
Average Loss: 0.4555112247467041
Accuracy: 0.8828
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.08566806465387344, Weights: 0.010725024156272411
NC2 Equiangle: Features: 0.14266577826605903, Weights: 0.1032327651977539
NC3 Self-Duality: 0.040934864431619644
NC4 NCC Mismatch: 0.006099999999999994

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526075407862663
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550134658813477
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010066392831504345
Inter Cos: 0.05982138589024544
Norm Quadratic Average: 4.668650150299072
Nearest Class Center Accuracy: 0.3524

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01773543283343315
Inter Cos: 0.07426611334085464
Norm Quadratic Average: 3.720660924911499
Nearest Class Center Accuracy: 0.4775

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012388540431857109
Inter Cos: 0.058036938309669495
Norm Quadratic Average: 2.587935447692871
Nearest Class Center Accuracy: 0.5608

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014272873289883137
Inter Cos: 0.05038709565997124
Norm Quadratic Average: 1.7234230041503906
Nearest Class Center Accuracy: 0.6361

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01737240143120289
Inter Cos: 0.0415998138487339
Norm Quadratic Average: 1.3913531303405762
Nearest Class Center Accuracy: 0.6786

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01957794651389122
Inter Cos: 0.042945604771375656
Norm Quadratic Average: 1.2005621194839478
Nearest Class Center Accuracy: 0.72

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022428641095757484
Inter Cos: 0.034852344542741776
Norm Quadratic Average: 0.9284864664077759
Nearest Class Center Accuracy: 0.7716

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06336800754070282
Inter Cos: 0.0665428414940834
Norm Quadratic Average: 0.49503305554389954
Nearest Class Center Accuracy: 0.8453

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2563555836677551
Inter Cos: 0.18215779960155487
Norm Quadratic Average: 0.2665743827819824
Nearest Class Center Accuracy: 0.8371

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.46159952878952026
Inter Cos: 0.21494132280349731
Norm Quadratic Average: 0.16665928065776825
Nearest Class Center Accuracy: 0.8592

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5143881440162659
Inter Cos: 0.11428067088127136
Norm Quadratic Average: 0.13486382365226746
Nearest Class Center Accuracy: 0.8743

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6103540062904358
Inter Cos: 0.14070044457912445
Norm Quadratic Average: 0.13890831172466278
Nearest Class Center Accuracy: 0.8632

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6093939542770386
Inter Cos: 0.14302361011505127
Norm Quadratic Average: 0.15146979689598083
Nearest Class Center Accuracy: 0.879

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6446766257286072
Inter Cos: 0.15902675688266754
Norm Quadratic Average: 0.28576600551605225
Nearest Class Center Accuracy: 0.8834

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6585204005241394
Inter Cos: 0.17771023511886597
Norm Quadratic Average: 0.8263346552848816
Nearest Class Center Accuracy: 0.8828

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.0019118785858154
Linear Weight Rank: 9
Intra Cos: 0.6670100092887878
Inter Cos: 0.27177053689956665
Norm Quadratic Average: 22.363842010498047
Nearest Class Center Accuracy: 0.8826

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.0055744647979736
Linear Weight Rank: 1563
Intra Cos: 0.6760103106498718
Inter Cos: 0.28709858655929565
Norm Quadratic Average: 14.763596534729004
Nearest Class Center Accuracy: 0.8826

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.005092144012451
Linear Weight Rank: 9
Intra Cos: 0.6793968677520752
Inter Cos: 0.28689754009246826
Norm Quadratic Average: 9.950155258178711
Nearest Class Center Accuracy: 0.8826

Output Layer:
Intra Cos: 0.6925431489944458
Inter Cos: 0.2598438262939453
Norm Quadratic Average: 7.143922328948975
Nearest Class Center Accuracy: 0.8824

