Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.0005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893190383911133
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326326370239258
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.028064079582691193
Inter Cos: 0.03720536828041077
Norm Quadratic Average: 51.532127380371094
Nearest Class Center Accuracy: 0.0421

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02461359277367592
Inter Cos: 0.0278927069157362
Norm Quadratic Average: 65.74079895019531
Nearest Class Center Accuracy: 0.05402

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022224869579076767
Inter Cos: 0.025785915553569794
Norm Quadratic Average: 106.3433837890625
Nearest Class Center Accuracy: 0.06282

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02508222870528698
Inter Cos: 0.024895058944821358
Norm Quadratic Average: 92.3603286743164
Nearest Class Center Accuracy: 0.06862

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026313653215765953
Inter Cos: 0.03181358799338341
Norm Quadratic Average: 105.31439971923828
Nearest Class Center Accuracy: 0.07038

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0300794318318367
Inter Cos: 0.03681023046374321
Norm Quadratic Average: 103.8921890258789
Nearest Class Center Accuracy: 0.0724

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03295725956559181
Inter Cos: 0.03507921099662781
Norm Quadratic Average: 100.05646514892578
Nearest Class Center Accuracy: 0.07464

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04958648607134819
Inter Cos: 0.0412391759455204
Norm Quadratic Average: 52.8847541809082
Nearest Class Center Accuracy: 0.07996

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.056729938834905624
Inter Cos: 0.048750489950180054
Norm Quadratic Average: 32.43511962890625
Nearest Class Center Accuracy: 0.08228

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08916456252336502
Inter Cos: 0.07063912600278854
Norm Quadratic Average: 15.173503875732422
Nearest Class Center Accuracy: 0.08676

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.17169350385665894
Inter Cos: 0.13003703951835632
Norm Quadratic Average: 8.130011558532715
Nearest Class Center Accuracy: 0.09196

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4127267897129059
Inter Cos: 0.2994858920574188
Norm Quadratic Average: 4.048736095428467
Nearest Class Center Accuracy: 0.09592

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7679267525672913
Inter Cos: 0.5220024585723877
Norm Quadratic Average: 3.3315327167510986
Nearest Class Center Accuracy: 0.09908

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8531628251075745
Inter Cos: 0.5801149606704712
Norm Quadratic Average: 3.8248260021209717
Nearest Class Center Accuracy: 0.09968

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8773743510246277
Inter Cos: 0.6038020253181458
Norm Quadratic Average: 4.869663715362549
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 20.973527908325195
Linear Weight Rank: 4030
Intra Cos: 0.8827735185623169
Inter Cos: 0.5592079758644104
Norm Quadratic Average: 37.835418701171875
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 11.450485229492188
Linear Weight Rank: 3653
Intra Cos: 0.8828182220458984
Inter Cos: 0.5306718349456787
Norm Quadratic Average: 41.012901306152344
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 8.095052719116211
Linear Weight Rank: 98
Intra Cos: 0.879803478717804
Inter Cos: 0.5085662603378296
Norm Quadratic Average: 40.87212371826172
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9206727147102356
Inter Cos: 0.6406487822532654
Norm Quadratic Average: 61.8734130859375
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 3.942739168548584
Accuracy: 0.4982
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.25932174921035767, Weights: 0.0446496345102787
NC2 Equiangle: Features: 0.2370584260574495, Weights: 0.1101638454861111
NC3 Self-Duality: 0.5004547834396362
NC4 NCC Mismatch: 0.17259999999999998

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422189712524414
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01178466435521841
Inter Cos: 0.26158252358436584
Norm Quadratic Average: 51.82586669921875
Nearest Class Center Accuracy: 0.2115

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016464058309793472
Inter Cos: 0.249169260263443
Norm Quadratic Average: 66.19173431396484
Nearest Class Center Accuracy: 0.3231

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015116090886294842
Inter Cos: 0.19222572445869446
Norm Quadratic Average: 107.12323760986328
Nearest Class Center Accuracy: 0.4002

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01932423934340477
Inter Cos: 0.2333213835954666
Norm Quadratic Average: 93.11173248291016
Nearest Class Center Accuracy: 0.4522

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01898692548274994
Inter Cos: 0.22248242795467377
Norm Quadratic Average: 106.15331268310547
Nearest Class Center Accuracy: 0.4838

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01988964155316353
Inter Cos: 0.22652867436408997
Norm Quadratic Average: 104.66371154785156
Nearest Class Center Accuracy: 0.4976

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020371243357658386
Inter Cos: 0.2151152640581131
Norm Quadratic Average: 100.66197204589844
Nearest Class Center Accuracy: 0.5161

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022661324590444565
Inter Cos: 0.241618812084198
Norm Quadratic Average: 53.080692291259766
Nearest Class Center Accuracy: 0.5447

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024899501353502274
Inter Cos: 0.21028363704681396
Norm Quadratic Average: 32.2884407043457
Nearest Class Center Accuracy: 0.5559

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03379758819937706
Inter Cos: 0.24625056982040405
Norm Quadratic Average: 14.87155532836914
Nearest Class Center Accuracy: 0.548

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05832481011748314
Inter Cos: 0.3673720061779022
Norm Quadratic Average: 7.837167739868164
Nearest Class Center Accuracy: 0.5257

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.15863867104053497
Inter Cos: 0.5588780045509338
Norm Quadratic Average: 3.796294927597046
Nearest Class Center Accuracy: 0.4992

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.26023343205451965
Inter Cos: 0.675408661365509
Norm Quadratic Average: 3.0152437686920166
Nearest Class Center Accuracy: 0.4936

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.27056974172592163
Inter Cos: 0.6764010190963745
Norm Quadratic Average: 3.4321258068084717
Nearest Class Center Accuracy: 0.4894

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.25526338815689087
Inter Cos: 0.668183445930481
Norm Quadratic Average: 4.388731956481934
Nearest Class Center Accuracy: 0.4897

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 20.973527908325195
Linear Weight Rank: 4030
Intra Cos: 0.2391207218170166
Inter Cos: 0.6555245518684387
Norm Quadratic Average: 34.40331268310547
Nearest Class Center Accuracy: 0.4932

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 11.450485229492188
Linear Weight Rank: 3653
Intra Cos: 0.22796961665153503
Inter Cos: 0.6425288915634155
Norm Quadratic Average: 37.465858459472656
Nearest Class Center Accuracy: 0.4922

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 8.095052719116211
Linear Weight Rank: 98
Intra Cos: 0.21626968681812286
Inter Cos: 0.6371651291847229
Norm Quadratic Average: 37.330108642578125
Nearest Class Center Accuracy: 0.4945

Output Layer:
Intra Cos: 0.23479719460010529
Inter Cos: 0.7079727649688721
Norm Quadratic Average: 56.670433044433594
Nearest Class Center Accuracy: 0.49

