Model save path: ./New_Models/bn_False_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.02.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597183227539062
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0208030603826046
Inter Cos: 0.09848982840776443
Norm Quadratic Average: 9.474761009216309
Nearest Class Center Accuracy: 0.32594

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0339616984128952
Inter Cos: 0.17700143158435822
Norm Quadratic Average: 1.8402506113052368
Nearest Class Center Accuracy: 0.32162

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.057252876460552216
Inter Cos: 0.3106869161128998
Norm Quadratic Average: 0.9432662725448608
Nearest Class Center Accuracy: 0.3493

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08036524057388306
Inter Cos: 0.3767000138759613
Norm Quadratic Average: 0.6393871903419495
Nearest Class Center Accuracy: 0.35526

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.12525084614753723
Inter Cos: 0.5591824054718018
Norm Quadratic Average: 0.8654509782791138
Nearest Class Center Accuracy: 0.31308

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.14738574624061584
Inter Cos: 0.6349097490310669
Norm Quadratic Average: 1.3538774251937866
Nearest Class Center Accuracy: 0.30318

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.16087201237678528
Inter Cos: 0.6821905374526978
Norm Quadratic Average: 2.152012586593628
Nearest Class Center Accuracy: 0.29796

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.16892603039741516
Inter Cos: 0.7258100509643555
Norm Quadratic Average: 2.047649621963501
Nearest Class Center Accuracy: 0.2897

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1870788186788559
Inter Cos: 0.7777873873710632
Norm Quadratic Average: 2.4267475605010986
Nearest Class Center Accuracy: 0.28366

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2029242068529129
Inter Cos: 0.8174253702163696
Norm Quadratic Average: 3.1819446086883545
Nearest Class Center Accuracy: 0.28072

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.21244235336780548
Inter Cos: 0.8354548215866089
Norm Quadratic Average: 4.287868976593018
Nearest Class Center Accuracy: 0.27876

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.22188495099544525
Inter Cos: 0.8482041954994202
Norm Quadratic Average: 4.1673502922058105
Nearest Class Center Accuracy: 0.27596

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.22174525260925293
Inter Cos: 0.8512786030769348
Norm Quadratic Average: 3.717252731323242
Nearest Class Center Accuracy: 0.27546

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.22185170650482178
Inter Cos: 0.8517051935195923
Norm Quadratic Average: 3.327666997909546
Nearest Class Center Accuracy: 0.27542

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.22163179516792297
Inter Cos: 0.85183185338974
Norm Quadratic Average: 3.097472906112671
Nearest Class Center Accuracy: 0.27538

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 1.1749272346496582
Linear Weight Rank: 2
Intra Cos: 0.2214680314064026
Inter Cos: 0.8519695401191711
Norm Quadratic Average: 13.941883087158203
Nearest Class Center Accuracy: 0.27532

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 1.1879600286483765
Linear Weight Rank: 1934
Intra Cos: 0.22066211700439453
Inter Cos: 0.851933479309082
Norm Quadratic Average: 9.47608757019043
Nearest Class Center Accuracy: 0.2753

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.2288457155227661
Linear Weight Rank: 9
Intra Cos: 0.3595599830150604
Inter Cos: 0.8159046173095703
Norm Quadratic Average: 6.445157051086426
Nearest Class Center Accuracy: 0.2788

Output Layer:
Intra Cos: 0.26958799362182617
Inter Cos: 0.8481892347335815
Norm Quadratic Average: 6.099822998046875
Nearest Class Center Accuracy: 0.27412

Test Set:
Average Loss: 1.7545998497009276
Accuracy: 0.2866
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.36800989508628845, Weights: 0.2958013415336609
NC2 Equiangle: Features: 0.971639421251085, Weights: 0.6761673821343316
NC3 Self-Duality: 0.3633368909358978
NC4 NCC Mismatch: 0.22030000000000005

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526075407862663
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550134658813477
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02156161703169346
Inter Cos: 0.09610911458730698
Norm Quadratic Average: 9.477225303649902
Nearest Class Center Accuracy: 0.3371

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.031027264893054962
Inter Cos: 0.18756864964962006
Norm Quadratic Average: 1.8429197072982788
Nearest Class Center Accuracy: 0.3324

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.054559532552957535
Inter Cos: 0.32367321848869324
Norm Quadratic Average: 0.944450855255127
Nearest Class Center Accuracy: 0.3575

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08037695288658142
Inter Cos: 0.388165146112442
Norm Quadratic Average: 0.6389703154563904
Nearest Class Center Accuracy: 0.3609

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.12695427238941193
Inter Cos: 0.5555906891822815
Norm Quadratic Average: 0.8651032447814941
Nearest Class Center Accuracy: 0.3147

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1490430235862732
Inter Cos: 0.630305290222168
Norm Quadratic Average: 1.3538882732391357
Nearest Class Center Accuracy: 0.3041

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.16224981844425201
Inter Cos: 0.6771571636199951
Norm Quadratic Average: 2.152531385421753
Nearest Class Center Accuracy: 0.2995

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.16972187161445618
Inter Cos: 0.7229915857315063
Norm Quadratic Average: 2.0473954677581787
Nearest Class Center Accuracy: 0.2906

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1855972558259964
Inter Cos: 0.779610812664032
Norm Quadratic Average: 2.426295757293701
Nearest Class Center Accuracy: 0.2869

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.19885076582431793
Inter Cos: 0.8183642029762268
Norm Quadratic Average: 3.1816928386688232
Nearest Class Center Accuracy: 0.2837

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20731185376644135
Inter Cos: 0.8366901278495789
Norm Quadratic Average: 4.2882513999938965
Nearest Class Center Accuracy: 0.2823

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.21458004415035248
Inter Cos: 0.8520146012306213
Norm Quadratic Average: 4.168543338775635
Nearest Class Center Accuracy: 0.2781

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2139052301645279
Inter Cos: 0.8575333952903748
Norm Quadratic Average: 3.7184700965881348
Nearest Class Center Accuracy: 0.2775

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2142203003168106
Inter Cos: 0.8580925464630127
Norm Quadratic Average: 3.3288581371307373
Nearest Class Center Accuracy: 0.2767

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.21463344991207123
Inter Cos: 0.8578512668609619
Norm Quadratic Average: 3.0986618995666504
Nearest Class Center Accuracy: 0.2768

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 1.1749272346496582
Linear Weight Rank: 2
Intra Cos: 0.21487168967723846
Inter Cos: 0.8581507205963135
Norm Quadratic Average: 13.94818115234375
Nearest Class Center Accuracy: 0.2769

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 1.1879600286483765
Linear Weight Rank: 1934
Intra Cos: 0.21393975615501404
Inter Cos: 0.8585365414619446
Norm Quadratic Average: 9.481681823730469
Nearest Class Center Accuracy: 0.2769

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.2288457155227661
Linear Weight Rank: 9
Intra Cos: 0.3627307116985321
Inter Cos: 0.813923716545105
Norm Quadratic Average: 6.449652194976807
Nearest Class Center Accuracy: 0.2828

Output Layer:
Intra Cos: 0.2672960162162781
Inter Cos: 0.8504812717437744
Norm Quadratic Average: 6.105795383453369
Nearest Class Center Accuracy: 0.2769

