Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893190383911133
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326326370239258
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013407952152192593
Inter Cos: 0.032911159098148346
Norm Quadratic Average: 12.622458457946777
Nearest Class Center Accuracy: 0.03866

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01763509400188923
Inter Cos: 0.038166631013154984
Norm Quadratic Average: 8.65707778930664
Nearest Class Center Accuracy: 0.05772

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01334067527204752
Inter Cos: 0.029120199382305145
Norm Quadratic Average: 6.414971828460693
Nearest Class Center Accuracy: 0.06406

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020748184993863106
Inter Cos: 0.019239310175180435
Norm Quadratic Average: 4.837583065032959
Nearest Class Center Accuracy: 0.07144

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022559143602848053
Inter Cos: 0.019988704472780228
Norm Quadratic Average: 3.6583282947540283
Nearest Class Center Accuracy: 0.07536

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023838762193918228
Inter Cos: 0.020429227501153946
Norm Quadratic Average: 3.502214193344116
Nearest Class Center Accuracy: 0.07756

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02200544998049736
Inter Cos: 0.019682111218571663
Norm Quadratic Average: 3.522892951965332
Nearest Class Center Accuracy: 0.07946

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03159981220960617
Inter Cos: 0.02589765191078186
Norm Quadratic Average: 2.5372724533081055
Nearest Class Center Accuracy: 0.0859

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.038545019924640656
Inter Cos: 0.030042331665754318
Norm Quadratic Average: 1.6725186109542847
Nearest Class Center Accuracy: 0.09074

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06031860038638115
Inter Cos: 0.039381228387355804
Norm Quadratic Average: 1.3255995512008667
Nearest Class Center Accuracy: 0.09532

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.12135539948940277
Inter Cos: 0.0560019426047802
Norm Quadratic Average: 1.138487696647644
Nearest Class Center Accuracy: 0.09792

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3776128888130188
Inter Cos: 0.13570156693458557
Norm Quadratic Average: 0.8973503112792969
Nearest Class Center Accuracy: 0.09906

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.800385057926178
Inter Cos: 0.2099265456199646
Norm Quadratic Average: 0.6063870787620544
Nearest Class Center Accuracy: 0.09998

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9277217388153076
Inter Cos: 0.328748881816864
Norm Quadratic Average: 0.6371346712112427
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9616333246231079
Inter Cos: 0.36618855595588684
Norm Quadratic Average: 1.1709576845169067
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 4.043537139892578
Linear Weight Rank: 1305
Intra Cos: 0.983841061592102
Inter Cos: 0.3822948634624481
Norm Quadratic Average: 38.86785888671875
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 4.400943279266357
Linear Weight Rank: 1775
Intra Cos: 0.985525369644165
Inter Cos: 0.3739595413208008
Norm Quadratic Average: 32.93959045410156
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.494081974029541
Linear Weight Rank: 97
Intra Cos: 0.9863695502281189
Inter Cos: 0.3514571785926819
Norm Quadratic Average: 31.35419464111328
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9887329339981079
Inter Cos: 0.3983091413974762
Norm Quadratic Average: 32.835487365722656
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 1.9766173131942748
Accuracy: 0.6196
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.15925979614257812, Weights: 0.01910330168902874
NC2 Equiangle: Features: 0.21639076309974747, Weights: 0.15874260179924243
NC3 Self-Duality: 0.22634591162204742
NC4 NCC Mismatch: 0.06699999999999995

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422189712524414
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.007865502499043941
Inter Cos: 0.21285440027713776
Norm Quadratic Average: 12.702343940734863
Nearest Class Center Accuracy: 0.2147

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.009897629730403423
Inter Cos: 0.253476619720459
Norm Quadratic Average: 8.71574592590332
Nearest Class Center Accuracy: 0.3625

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.009833990596234798
Inter Cos: 0.15226924419403076
Norm Quadratic Average: 6.444827079772949
Nearest Class Center Accuracy: 0.4844

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01479173731058836
Inter Cos: 0.19360007345676422
Norm Quadratic Average: 4.857015609741211
Nearest Class Center Accuracy: 0.5344

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016012661159038544
Inter Cos: 0.17120461165905
Norm Quadratic Average: 3.669785499572754
Nearest Class Center Accuracy: 0.5758

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01603349670767784
Inter Cos: 0.15030135214328766
Norm Quadratic Average: 3.508702039718628
Nearest Class Center Accuracy: 0.5927

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013470656238496304
Inter Cos: 0.13352400064468384
Norm Quadratic Average: 3.5238537788391113
Nearest Class Center Accuracy: 0.6148

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01659293845295906
Inter Cos: 0.1699865311384201
Norm Quadratic Average: 2.5342438220977783
Nearest Class Center Accuracy: 0.6553

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016784459352493286
Inter Cos: 0.1617845892906189
Norm Quadratic Average: 1.6571098566055298
Nearest Class Center Accuracy: 0.6797

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02283323183655739
Inter Cos: 0.20268309116363525
Norm Quadratic Average: 1.283847451210022
Nearest Class Center Accuracy: 0.6691

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03573513403534889
Inter Cos: 0.2986038029193878
Norm Quadratic Average: 1.056565284729004
Nearest Class Center Accuracy: 0.6313

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.12590231001377106
Inter Cos: 0.4018998146057129
Norm Quadratic Average: 0.7698323130607605
Nearest Class Center Accuracy: 0.5656

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.22903136909008026
Inter Cos: 0.4333987832069397
Norm Quadratic Average: 0.48985204100608826
Nearest Class Center Accuracy: 0.581

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2589086890220642
Inter Cos: 0.4357430934906006
Norm Quadratic Average: 0.5126079320907593
Nearest Class Center Accuracy: 0.6106

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.27236121892929077
Inter Cos: 0.5102091431617737
Norm Quadratic Average: 1.0103257894515991
Nearest Class Center Accuracy: 0.6192

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 4.043537139892578
Linear Weight Rank: 1305
Intra Cos: 0.27035200595855713
Inter Cos: 0.557746171951294
Norm Quadratic Average: 34.287288665771484
Nearest Class Center Accuracy: 0.6222

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 4.400943279266357
Linear Weight Rank: 1775
Intra Cos: 0.29502537846565247
Inter Cos: 0.573265552520752
Norm Quadratic Average: 29.676345825195312
Nearest Class Center Accuracy: 0.6213

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.494081974029541
Linear Weight Rank: 97
Intra Cos: 0.3068036139011383
Inter Cos: 0.5706823468208313
Norm Quadratic Average: 28.700618743896484
Nearest Class Center Accuracy: 0.6198

Output Layer:
Intra Cos: 0.32389676570892334
Inter Cos: 0.5829137563705444
Norm Quadratic Average: 30.117387771606445
Nearest Class Center Accuracy: 0.6184

