Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.0001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02289319410920143
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326311111450195
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01426874753087759
Inter Cos: 0.027612624689936638
Norm Quadratic Average: 113.88841247558594
Nearest Class Center Accuracy: 0.04034

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019011875614523888
Inter Cos: 0.03608277440071106
Norm Quadratic Average: 66.72199249267578
Nearest Class Center Accuracy: 0.05644

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016420984640717506
Inter Cos: 0.023177465423941612
Norm Quadratic Average: 64.8116226196289
Nearest Class Center Accuracy: 0.06268

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021631339564919472
Inter Cos: 0.02439035288989544
Norm Quadratic Average: 42.914222717285156
Nearest Class Center Accuracy: 0.06952

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023040426895022392
Inter Cos: 0.024007853120565414
Norm Quadratic Average: 43.39234161376953
Nearest Class Center Accuracy: 0.07302

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025310484692454338
Inter Cos: 0.02479546144604683
Norm Quadratic Average: 42.22914123535156
Nearest Class Center Accuracy: 0.0762

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02705659158527851
Inter Cos: 0.025178827345371246
Norm Quadratic Average: 41.55513381958008
Nearest Class Center Accuracy: 0.07894

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03841531276702881
Inter Cos: 0.03407936915755272
Norm Quadratic Average: 27.209016799926758
Nearest Class Center Accuracy: 0.08414

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05211929231882095
Inter Cos: 0.04399409145116806
Norm Quadratic Average: 31.197160720825195
Nearest Class Center Accuracy: 0.0884

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07257650792598724
Inter Cos: 0.05360393971204758
Norm Quadratic Average: 31.5587100982666
Nearest Class Center Accuracy: 0.09254

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10144753009080887
Inter Cos: 0.07115583121776581
Norm Quadratic Average: 32.97505569458008
Nearest Class Center Accuracy: 0.09578

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20844043791294098
Inter Cos: 0.13216835260391235
Norm Quadratic Average: 26.055099487304688
Nearest Class Center Accuracy: 0.09868

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.46350428462028503
Inter Cos: 0.25073298811912537
Norm Quadratic Average: 19.56709098815918
Nearest Class Center Accuracy: 0.09994

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6165964007377625
Inter Cos: 0.28349077701568604
Norm Quadratic Average: 20.992572784423828
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7023810148239136
Inter Cos: 0.2938101291656494
Norm Quadratic Average: 23.649097442626953
Nearest Class Center Accuracy: 0.09998

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 74.03176879882812
Linear Weight Rank: 4031
Intra Cos: 0.8241390585899353
Inter Cos: 0.3803115487098694
Norm Quadratic Average: 61.1293830871582
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 32.49850082397461
Linear Weight Rank: 3665
Intra Cos: 0.8864027261734009
Inter Cos: 0.37543290853500366
Norm Quadratic Average: 44.76813888549805
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 12.683450698852539
Linear Weight Rank: 99
Intra Cos: 0.917111337184906
Inter Cos: 0.3796318769454956
Norm Quadratic Average: 41.31728744506836
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9549863934516907
Inter Cos: 0.5534374713897705
Norm Quadratic Average: 79.84650421142578
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 4.28806431274414
Accuracy: 0.561
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.26749736070632935, Weights: 0.029559960588812828
NC2 Equiangle: Features: 0.16571509775489268, Weights: 0.11256340258049242
NC3 Self-Duality: 0.552398145198822
NC4 NCC Mismatch: 0.10309999999999997

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621266715228558
Inter Cos: 0.406754732131958
Norm Quadratic Average: 29.42218780517578
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.008211671374738216
Inter Cos: 0.19307053089141846
Norm Quadratic Average: 114.63114166259766
Nearest Class Center Accuracy: 0.2275

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012080210261046886
Inter Cos: 0.24402596056461334
Norm Quadratic Average: 67.20726013183594
Nearest Class Center Accuracy: 0.3546

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011373705230653286
Inter Cos: 0.15311111509799957
Norm Quadratic Average: 65.17377471923828
Nearest Class Center Accuracy: 0.4551

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016973018646240234
Inter Cos: 0.19215305149555206
Norm Quadratic Average: 43.120269775390625
Nearest Class Center Accuracy: 0.4895

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01740257814526558
Inter Cos: 0.1783413141965866
Norm Quadratic Average: 43.52999496459961
Nearest Class Center Accuracy: 0.527

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017285849899053574
Inter Cos: 0.15404251217842102
Norm Quadratic Average: 42.30128479003906
Nearest Class Center Accuracy: 0.5578

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016133394092321396
Inter Cos: 0.13968366384506226
Norm Quadratic Average: 41.58799743652344
Nearest Class Center Accuracy: 0.585

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020117390900850296
Inter Cos: 0.1586514711380005
Norm Quadratic Average: 27.200775146484375
Nearest Class Center Accuracy: 0.602

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024351969361305237
Inter Cos: 0.18038561940193176
Norm Quadratic Average: 31.070106506347656
Nearest Class Center Accuracy: 0.6084

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03166632726788521
Inter Cos: 0.2147516906261444
Norm Quadratic Average: 31.252168655395508
Nearest Class Center Accuracy: 0.6045

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04259377717971802
Inter Cos: 0.2602691948413849
Norm Quadratic Average: 32.40220260620117
Nearest Class Center Accuracy: 0.6008

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0702051892876625
Inter Cos: 0.3471266031265259
Norm Quadratic Average: 25.12352180480957
Nearest Class Center Accuracy: 0.5837

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.13333715498447418
Inter Cos: 0.5015469193458557
Norm Quadratic Average: 18.175907135009766
Nearest Class Center Accuracy: 0.5703

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1709723323583603
Inter Cos: 0.5419934391975403
Norm Quadratic Average: 18.911184310913086
Nearest Class Center Accuracy: 0.5558

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.22693049907684326
Inter Cos: 0.5235854983329773
Norm Quadratic Average: 21.066049575805664
Nearest Class Center Accuracy: 0.5498

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 74.03176879882812
Linear Weight Rank: 4031
Intra Cos: 0.25797849893569946
Inter Cos: 0.47690120339393616
Norm Quadratic Average: 51.17809295654297
Nearest Class Center Accuracy: 0.5539

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 32.49850082397461
Linear Weight Rank: 3665
Intra Cos: 0.21762877702713013
Inter Cos: 0.4533458650112152
Norm Quadratic Average: 36.01604461669922
Nearest Class Center Accuracy: 0.5594

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 12.683450698852539
Linear Weight Rank: 99
Intra Cos: 0.21885791420936584
Inter Cos: 0.5180478692054749
Norm Quadratic Average: 32.99836730957031
Nearest Class Center Accuracy: 0.5596

Output Layer:
Intra Cos: 0.2899934947490692
Inter Cos: 0.6906018257141113
Norm Quadratic Average: 64.025146484375
Nearest Class Center Accuracy: 0.5606

