Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.0003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02289319410920143
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326311111450195
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03199217468500137
Inter Cos: 0.03717687726020813
Norm Quadratic Average: 55.111045837402344
Nearest Class Center Accuracy: 0.04282

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024585627019405365
Inter Cos: 0.024218376725912094
Norm Quadratic Average: 71.22294616699219
Nearest Class Center Accuracy: 0.05434

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023707684129476547
Inter Cos: 0.026994122192263603
Norm Quadratic Average: 122.82888793945312
Nearest Class Center Accuracy: 0.06172

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02639739029109478
Inter Cos: 0.027175655588507652
Norm Quadratic Average: 117.09352111816406
Nearest Class Center Accuracy: 0.06722

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.027547867968678474
Inter Cos: 0.032792747020721436
Norm Quadratic Average: 148.29751586914062
Nearest Class Center Accuracy: 0.06986

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.029298990964889526
Inter Cos: 0.033222269266843796
Norm Quadratic Average: 160.56112670898438
Nearest Class Center Accuracy: 0.07212

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.031082414090633392
Inter Cos: 0.030765268951654434
Norm Quadratic Average: 172.09730529785156
Nearest Class Center Accuracy: 0.07374

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04525244981050491
Inter Cos: 0.03724590688943863
Norm Quadratic Average: 101.79375457763672
Nearest Class Center Accuracy: 0.07836

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04801554977893829
Inter Cos: 0.04093759506940842
Norm Quadratic Average: 74.09471893310547
Nearest Class Center Accuracy: 0.08096

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06895299255847931
Inter Cos: 0.053244754672050476
Norm Quadratic Average: 40.738990783691406
Nearest Class Center Accuracy: 0.08492

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.11263745278120041
Inter Cos: 0.08186431974172592
Norm Quadratic Average: 22.761110305786133
Nearest Class Center Accuracy: 0.08846

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2908702492713928
Inter Cos: 0.2141609936952591
Norm Quadratic Average: 10.408659934997559
Nearest Class Center Accuracy: 0.09166

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6374881267547607
Inter Cos: 0.42163851857185364
Norm Quadratic Average: 7.221048355102539
Nearest Class Center Accuracy: 0.09588

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7897762656211853
Inter Cos: 0.4952852725982666
Norm Quadratic Average: 6.012725830078125
Nearest Class Center Accuracy: 0.09846

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8520310521125793
Inter Cos: 0.511868953704834
Norm Quadratic Average: 5.528920650482178
Nearest Class Center Accuracy: 0.09974

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 39.01507568359375
Linear Weight Rank: 4031
Intra Cos: 0.8876094222068787
Inter Cos: 0.46918413043022156
Norm Quadratic Average: 35.39515686035156
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 18.131832122802734
Linear Weight Rank: 3662
Intra Cos: 0.8947003483772278
Inter Cos: 0.43122196197509766
Norm Quadratic Average: 34.9426383972168
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 9.550737380981445
Linear Weight Rank: 98
Intra Cos: 0.9049344658851624
Inter Cos: 0.44753190875053406
Norm Quadratic Average: 35.31838607788086
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9313765168190002
Inter Cos: 0.6591854691505432
Norm Quadratic Average: 60.9987678527832
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 4.009818605804443
Accuracy: 0.4924
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.29803916811943054, Weights: 0.038715776056051254
NC2 Equiangle: Features: 0.2179318822995581, Weights: 0.11616048177083334
NC3 Self-Duality: 0.5115966796875
NC4 NCC Mismatch: 0.14590000000000003

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621266715228558
Inter Cos: 0.406754732131958
Norm Quadratic Average: 29.42218780517578
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013202405534684658
Inter Cos: 0.2542728781700134
Norm Quadratic Average: 55.42629623413086
Nearest Class Center Accuracy: 0.2129

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01690893992781639
Inter Cos: 0.22808244824409485
Norm Quadratic Average: 71.68943786621094
Nearest Class Center Accuracy: 0.3262

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014724557287991047
Inter Cos: 0.18259938061237335
Norm Quadratic Average: 123.67172241210938
Nearest Class Center Accuracy: 0.3937

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019396811723709106
Inter Cos: 0.2252385914325714
Norm Quadratic Average: 118.02971649169922
Nearest Class Center Accuracy: 0.435

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01853744313120842
Inter Cos: 0.19958528876304626
Norm Quadratic Average: 149.47279357910156
Nearest Class Center Accuracy: 0.4717

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019371304661035538
Inter Cos: 0.19257687032222748
Norm Quadratic Average: 161.69927978515625
Nearest Class Center Accuracy: 0.4884

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01922190934419632
Inter Cos: 0.18284659087657928
Norm Quadratic Average: 173.0904083251953
Nearest Class Center Accuracy: 0.5057

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020480383187532425
Inter Cos: 0.2030561864376068
Norm Quadratic Average: 102.10672760009766
Nearest Class Center Accuracy: 0.5319

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022618360817432404
Inter Cos: 0.1684245765209198
Norm Quadratic Average: 73.64550018310547
Nearest Class Center Accuracy: 0.5472

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.027324523776769638
Inter Cos: 0.2039089947938919
Norm Quadratic Average: 39.83610916137695
Nearest Class Center Accuracy: 0.54

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.040553752332925797
Inter Cos: 0.26987165212631226
Norm Quadratic Average: 21.820005416870117
Nearest Class Center Accuracy: 0.5166

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10115612298250198
Inter Cos: 0.4018518328666687
Norm Quadratic Average: 9.639917373657227
Nearest Class Center Accuracy: 0.476

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.18669939041137695
Inter Cos: 0.5433709025382996
Norm Quadratic Average: 6.432562351226807
Nearest Class Center Accuracy: 0.4691

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2040601372718811
Inter Cos: 0.5675181150436401
Norm Quadratic Average: 5.26416015625
Nearest Class Center Accuracy: 0.4725

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.186959907412529
Inter Cos: 0.5724847912788391
Norm Quadratic Average: 4.8383402824401855
Nearest Class Center Accuracy: 0.4817

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 39.01507568359375
Linear Weight Rank: 4031
Intra Cos: 0.18318219482898712
Inter Cos: 0.5679399967193604
Norm Quadratic Average: 31.157562255859375
Nearest Class Center Accuracy: 0.4897

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 18.131832122802734
Linear Weight Rank: 3662
Intra Cos: 0.17374655604362488
Inter Cos: 0.5631470680236816
Norm Quadratic Average: 30.90890121459961
Nearest Class Center Accuracy: 0.4917

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 9.550737380981445
Linear Weight Rank: 98
Intra Cos: 0.1757999211549759
Inter Cos: 0.6018955111503601
Norm Quadratic Average: 31.32615089416504
Nearest Class Center Accuracy: 0.4922

Output Layer:
Intra Cos: 0.19199799001216888
Inter Cos: 0.7092024683952332
Norm Quadratic Average: 54.37372970581055
Nearest Class Center Accuracy: 0.4856

