Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.0001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893190383911133
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326326370239258
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.028386814519762993
Inter Cos: 0.03128434345126152
Norm Quadratic Average: 65.95481872558594
Nearest Class Center Accuracy: 0.04266

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021248390898108482
Inter Cos: 0.021361082792282104
Norm Quadratic Average: 94.38534545898438
Nearest Class Center Accuracy: 0.05648

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017743729054927826
Inter Cos: 0.020754873752593994
Norm Quadratic Average: 180.2842254638672
Nearest Class Center Accuracy: 0.06372

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02219553291797638
Inter Cos: 0.023283034563064575
Norm Quadratic Average: 184.73995971679688
Nearest Class Center Accuracy: 0.06888

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023882640525698662
Inter Cos: 0.029908467084169388
Norm Quadratic Average: 273.41107177734375
Nearest Class Center Accuracy: 0.0702

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.028244806453585625
Inter Cos: 0.035487353801727295
Norm Quadratic Average: 335.7986145019531
Nearest Class Center Accuracy: 0.07254

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.032998837530612946
Inter Cos: 0.038660597056150436
Norm Quadratic Average: 436.02520751953125
Nearest Class Center Accuracy: 0.074

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05097763612866402
Inter Cos: 0.045756567269563675
Norm Quadratic Average: 315.3251647949219
Nearest Class Center Accuracy: 0.07844

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.055377744138240814
Inter Cos: 0.04746095463633537
Norm Quadratic Average: 297.2718505859375
Nearest Class Center Accuracy: 0.08068

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0714273452758789
Inter Cos: 0.056631579995155334
Norm Quadratic Average: 215.04806518554688
Nearest Class Center Accuracy: 0.08338

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10438310354948044
Inter Cos: 0.07989764958620071
Norm Quadratic Average: 152.0400390625
Nearest Class Center Accuracy: 0.08556

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2175890952348709
Inter Cos: 0.1584816426038742
Norm Quadratic Average: 73.8011703491211
Nearest Class Center Accuracy: 0.09024

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4975656569004059
Inter Cos: 0.29455089569091797
Norm Quadratic Average: 46.43215560913086
Nearest Class Center Accuracy: 0.0923

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6747849583625793
Inter Cos: 0.2794676423072815
Norm Quadratic Average: 28.670541763305664
Nearest Class Center Accuracy: 0.09276

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7803515195846558
Inter Cos: 0.2652994990348816
Norm Quadratic Average: 17.40969467163086
Nearest Class Center Accuracy: 0.0943

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 73.92908477783203
Linear Weight Rank: 4031
Intra Cos: 0.860247790813446
Inter Cos: 0.3153602182865143
Norm Quadratic Average: 73.05953216552734
Nearest Class Center Accuracy: 0.09648

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 32.18055725097656
Linear Weight Rank: 3666
Intra Cos: 0.8849930763244629
Inter Cos: 0.30769509077072144
Norm Quadratic Average: 48.73009490966797
Nearest Class Center Accuracy: 0.09856

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 12.909836769104004
Linear Weight Rank: 98
Intra Cos: 0.9003841876983643
Inter Cos: 0.35498544573783875
Norm Quadratic Average: 39.56166458129883
Nearest Class Center Accuracy: 0.09928

Output Layer:
Intra Cos: 0.9566835761070251
Inter Cos: 0.6573679447174072
Norm Quadratic Average: 76.85169219970703
Nearest Class Center Accuracy: 0.09998

Test Set:
Average Loss: 4.169886688232422
Accuracy: 0.4989
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.4510365128517151, Weights: 0.03313734382390976
NC2 Equiangle: Features: 0.17374485825047348, Weights: 0.12034960197679924
NC3 Self-Duality: 0.6976029872894287
NC4 NCC Mismatch: 0.15080000000000005

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422189712524414
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011724957264959812
Inter Cos: 0.2455746978521347
Norm Quadratic Average: 66.36605834960938
Nearest Class Center Accuracy: 0.2156

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013520057313144207
Inter Cos: 0.221429705619812
Norm Quadratic Average: 95.13693237304688
Nearest Class Center Accuracy: 0.3526

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012279358692467213
Inter Cos: 0.16320785880088806
Norm Quadratic Average: 181.64654541015625
Nearest Class Center Accuracy: 0.4438

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015539155341684818
Inter Cos: 0.21065008640289307
Norm Quadratic Average: 186.19569396972656
Nearest Class Center Accuracy: 0.4792

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015321142040193081
Inter Cos: 0.1836559921503067
Norm Quadratic Average: 275.3568115234375
Nearest Class Center Accuracy: 0.4998

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015990711748600006
Inter Cos: 0.18654407560825348
Norm Quadratic Average: 337.9788818359375
Nearest Class Center Accuracy: 0.5133

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01891585811972618
Inter Cos: 0.19295454025268555
Norm Quadratic Average: 438.017822265625
Nearest Class Center Accuracy: 0.5096

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02101195976138115
Inter Cos: 0.20365555584430695
Norm Quadratic Average: 315.58612060546875
Nearest Class Center Accuracy: 0.5243

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0231156088411808
Inter Cos: 0.19778519868850708
Norm Quadratic Average: 294.5506896972656
Nearest Class Center Accuracy: 0.5329

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026344630867242813
Inter Cos: 0.21890150010585785
Norm Quadratic Average: 210.14979553222656
Nearest Class Center Accuracy: 0.5287

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03905138745903969
Inter Cos: 0.2533537447452545
Norm Quadratic Average: 145.62803649902344
Nearest Class Center Accuracy: 0.5117

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07781291753053665
Inter Cos: 0.3536621928215027
Norm Quadratic Average: 67.72210693359375
Nearest Class Center Accuracy: 0.4797

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1491973102092743
Inter Cos: 0.41427066922187805
Norm Quadratic Average: 40.265193939208984
Nearest Class Center Accuracy: 0.4567

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20751357078552246
Inter Cos: 0.42962726950645447
Norm Quadratic Average: 24.060537338256836
Nearest Class Center Accuracy: 0.449

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.23115770518779755
Inter Cos: 0.40620070695877075
Norm Quadratic Average: 14.416863441467285
Nearest Class Center Accuracy: 0.4572

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 73.92908477783203
Linear Weight Rank: 4031
Intra Cos: 0.24523185193538666
Inter Cos: 0.39430999755859375
Norm Quadratic Average: 59.99736785888672
Nearest Class Center Accuracy: 0.4684

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 32.18055725097656
Linear Weight Rank: 3666
Intra Cos: 0.2240576595067978
Inter Cos: 0.3747062087059021
Norm Quadratic Average: 39.67216873168945
Nearest Class Center Accuracy: 0.4809

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 12.909836769104004
Linear Weight Rank: 98
Intra Cos: 0.21454350650310516
Inter Cos: 0.4710639417171478
Norm Quadratic Average: 32.282615661621094
Nearest Class Center Accuracy: 0.4864

Output Layer:
Intra Cos: 0.21067668497562408
Inter Cos: 0.7088121175765991
Norm Quadratic Average: 61.977561950683594
Nearest Class Center Accuracy: 0.4871

