Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.0005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02289319410920143
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326311111450195
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02815304324030876
Inter Cos: 0.03947184234857559
Norm Quadratic Average: 50.581626892089844
Nearest Class Center Accuracy: 0.04228

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02376559004187584
Inter Cos: 0.02871617116034031
Norm Quadratic Average: 63.78546905517578
Nearest Class Center Accuracy: 0.0539

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02428917959332466
Inter Cos: 0.026716265827417374
Norm Quadratic Average: 103.62560272216797
Nearest Class Center Accuracy: 0.06196

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.027710428461432457
Inter Cos: 0.026537982746958733
Norm Quadratic Average: 93.55780029296875
Nearest Class Center Accuracy: 0.06712

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0296049602329731
Inter Cos: 0.03457731381058693
Norm Quadratic Average: 112.32726287841797
Nearest Class Center Accuracy: 0.06904

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.031570516526699066
Inter Cos: 0.03522764518857002
Norm Quadratic Average: 114.46891784667969
Nearest Class Center Accuracy: 0.0711

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0327761135995388
Inter Cos: 0.03232647851109505
Norm Quadratic Average: 113.25187683105469
Nearest Class Center Accuracy: 0.07338

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04628866910934448
Inter Cos: 0.038091301918029785
Norm Quadratic Average: 58.565765380859375
Nearest Class Center Accuracy: 0.07794

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05107133463025093
Inter Cos: 0.04387729614973068
Norm Quadratic Average: 35.92100143432617
Nearest Class Center Accuracy: 0.08064

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08366330713033676
Inter Cos: 0.06664390116930008
Norm Quadratic Average: 16.837749481201172
Nearest Class Center Accuracy: 0.08486

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.16031506657600403
Inter Cos: 0.12052346020936966
Norm Quadratic Average: 8.894096374511719
Nearest Class Center Accuracy: 0.09012

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.40446382761001587
Inter Cos: 0.31039726734161377
Norm Quadratic Average: 4.38629150390625
Nearest Class Center Accuracy: 0.09366

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.758774995803833
Inter Cos: 0.5234228372573853
Norm Quadratic Average: 3.573375940322876
Nearest Class Center Accuracy: 0.09812

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8569537997245789
Inter Cos: 0.5588376522064209
Norm Quadratic Average: 4.051158905029297
Nearest Class Center Accuracy: 0.09916

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8801944255828857
Inter Cos: 0.5581446886062622
Norm Quadratic Average: 5.105347156524658
Nearest Class Center Accuracy: 0.09988

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 20.969043731689453
Linear Weight Rank: 4030
Intra Cos: 0.8792065978050232
Inter Cos: 0.5160216093063354
Norm Quadratic Average: 39.20187759399414
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 11.485041618347168
Linear Weight Rank: 3653
Intra Cos: 0.8758625388145447
Inter Cos: 0.47963109612464905
Norm Quadratic Average: 41.73816680908203
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 8.081762313842773
Linear Weight Rank: 98
Intra Cos: 0.8735572695732117
Inter Cos: 0.4638766050338745
Norm Quadratic Average: 40.91328811645508
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9087147116661072
Inter Cos: 0.6244907379150391
Norm Quadratic Average: 61.79170227050781
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 3.997865238952637
Accuracy: 0.4967
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.26958268880844116, Weights: 0.04297596216201782
NC2 Equiangle: Features: 0.23609113596906567, Weights: 0.11153372099905302
NC3 Self-Duality: 0.5001690983772278
NC4 NCC Mismatch: 0.17000000000000004

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621266715228558
Inter Cos: 0.406754732131958
Norm Quadratic Average: 29.42218780517578
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013540943153202534
Inter Cos: 0.2562699317932129
Norm Quadratic Average: 50.85576629638672
Nearest Class Center Accuracy: 0.2129

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017481088638305664
Inter Cos: 0.23852035403251648
Norm Quadratic Average: 64.20803833007812
Nearest Class Center Accuracy: 0.3213

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015892479568719864
Inter Cos: 0.19574995338916779
Norm Quadratic Average: 104.36951446533203
Nearest Class Center Accuracy: 0.3901

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020287107676267624
Inter Cos: 0.2390259951353073
Norm Quadratic Average: 94.33245086669922
Nearest Class Center Accuracy: 0.4351

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021347615867853165
Inter Cos: 0.21563826501369476
Norm Quadratic Average: 113.25817108154297
Nearest Class Center Accuracy: 0.4646

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021272283047437668
Inter Cos: 0.20005743205547333
Norm Quadratic Average: 115.35118865966797
Nearest Class Center Accuracy: 0.4883

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020710155367851257
Inter Cos: 0.18192295730113983
Norm Quadratic Average: 114.01045989990234
Nearest Class Center Accuracy: 0.5075

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02101455256342888
Inter Cos: 0.19639568030834198
Norm Quadratic Average: 58.81207275390625
Nearest Class Center Accuracy: 0.5409

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0234244205057621
Inter Cos: 0.17963914573192596
Norm Quadratic Average: 35.72416305541992
Nearest Class Center Accuracy: 0.5591

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0337388813495636
Inter Cos: 0.2352645993232727
Norm Quadratic Average: 16.482421875
Nearest Class Center Accuracy: 0.5435

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05587630346417427
Inter Cos: 0.35993289947509766
Norm Quadratic Average: 8.550923347473145
Nearest Class Center Accuracy: 0.523

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1385752260684967
Inter Cos: 0.5308359861373901
Norm Quadratic Average: 4.1054368019104
Nearest Class Center Accuracy: 0.4881

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20888034999370575
Inter Cos: 0.6496775150299072
Norm Quadratic Average: 3.229386329650879
Nearest Class Center Accuracy: 0.4877

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.19322286546230316
Inter Cos: 0.6604288220405579
Norm Quadratic Average: 3.624769449234009
Nearest Class Center Accuracy: 0.4897

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.17357449233531952
Inter Cos: 0.6587442755699158
Norm Quadratic Average: 4.586558818817139
Nearest Class Center Accuracy: 0.493

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 20.969043731689453
Linear Weight Rank: 4030
Intra Cos: 0.16099633276462555
Inter Cos: 0.6356220245361328
Norm Quadratic Average: 35.54122543334961
Nearest Class Center Accuracy: 0.4936

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 11.485041618347168
Linear Weight Rank: 3653
Intra Cos: 0.15040725469589233
Inter Cos: 0.6153978705406189
Norm Quadratic Average: 37.990196228027344
Nearest Class Center Accuracy: 0.4948

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 8.081762313842773
Linear Weight Rank: 98
Intra Cos: 0.14733408391475677
Inter Cos: 0.6170282363891602
Norm Quadratic Average: 37.25029373168945
Nearest Class Center Accuracy: 0.4952

Output Layer:
Intra Cos: 0.16309069097042084
Inter Cos: 0.6999093294143677
Norm Quadratic Average: 56.437992095947266
Nearest Class Center Accuracy: 0.4903

