Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893192246556282
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326313018798828
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.028190292418003082
Inter Cos: 0.03800690174102783
Norm Quadratic Average: 45.74782943725586
Nearest Class Center Accuracy: 0.0412

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022699937224388123
Inter Cos: 0.027564089745283127
Norm Quadratic Average: 58.34862518310547
Nearest Class Center Accuracy: 0.05314

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02263684757053852
Inter Cos: 0.02576098032295704
Norm Quadratic Average: 93.44477081298828
Nearest Class Center Accuracy: 0.0617

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02394878678023815
Inter Cos: 0.02342211827635765
Norm Quadratic Average: 71.23827362060547
Nearest Class Center Accuracy: 0.06846

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023900995030999184
Inter Cos: 0.028880871832370758
Norm Quadratic Average: 67.3873062133789
Nearest Class Center Accuracy: 0.07116

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.027901599183678627
Inter Cos: 0.030479617416858673
Norm Quadratic Average: 51.008506774902344
Nearest Class Center Accuracy: 0.07472

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03260233625769615
Inter Cos: 0.029760094359517097
Norm Quadratic Average: 36.618743896484375
Nearest Class Center Accuracy: 0.07808

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05823861062526703
Inter Cos: 0.050021566450595856
Norm Quadratic Average: 14.849919319152832
Nearest Class Center Accuracy: 0.08396

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10417129844427109
Inter Cos: 0.08147352188825607
Norm Quadratic Average: 7.4998016357421875
Nearest Class Center Accuracy: 0.08698

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.25880610942840576
Inter Cos: 0.19427941739559174
Norm Quadratic Average: 3.3844690322875977
Nearest Class Center Accuracy: 0.091

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.47901102900505066
Inter Cos: 0.36105844378471375
Norm Quadratic Average: 2.3812789916992188
Nearest Class Center Accuracy: 0.09724

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.660611629486084
Inter Cos: 0.46184760332107544
Norm Quadratic Average: 1.9005286693572998
Nearest Class Center Accuracy: 0.0995

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.842551589012146
Inter Cos: 0.6047413349151611
Norm Quadratic Average: 2.5742244720458984
Nearest Class Center Accuracy: 0.09972

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.882025420665741
Inter Cos: 0.6113306879997253
Norm Quadratic Average: 4.435814380645752
Nearest Class Center Accuracy: 0.09984

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8964433670043945
Inter Cos: 0.621053159236908
Norm Quadratic Average: 7.768889904022217
Nearest Class Center Accuracy: 0.09994

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 6.258396625518799
Linear Weight Rank: 4026
Intra Cos: 0.8910070657730103
Inter Cos: 0.5953360795974731
Norm Quadratic Average: 67.66973114013672
Nearest Class Center Accuracy: 0.09998

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 6.728082656860352
Linear Weight Rank: 3569
Intra Cos: 0.8915111422538757
Inter Cos: 0.5424829125404358
Norm Quadratic Average: 68.27438354492188
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 6.409646034240723
Linear Weight Rank: 98
Intra Cos: 0.8967413306236267
Inter Cos: 0.4764113426208496
Norm Quadratic Average: 55.39708709716797
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9267631769180298
Inter Cos: 0.5421479940414429
Norm Quadratic Average: 64.95199584960938
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 4.2711365550994875
Accuracy: 0.4819
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.2501841187477112, Weights: 0.03726905211806297
NC2 Equiangle: Features: 0.25184338502209597, Weights: 0.09556629527698864
NC3 Self-Duality: 0.512570858001709
NC4 NCC Mismatch: 0.19189999999999996

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422183990478516
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013497029431164265
Inter Cos: 0.25400787591934204
Norm Quadratic Average: 45.98600387573242
Nearest Class Center Accuracy: 0.2073

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01570543274283409
Inter Cos: 0.24862267076969147
Norm Quadratic Average: 58.70125961303711
Nearest Class Center Accuracy: 0.3156

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0152431083843112
Inter Cos: 0.20160916447639465
Norm Quadratic Average: 94.07860565185547
Nearest Class Center Accuracy: 0.3986

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018950853496789932
Inter Cos: 0.22613973915576935
Norm Quadratic Average: 71.79768371582031
Nearest Class Center Accuracy: 0.4664

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01920020580291748
Inter Cos: 0.2010631561279297
Norm Quadratic Average: 67.90960693359375
Nearest Class Center Accuracy: 0.5051

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02076512947678566
Inter Cos: 0.18887640535831451
Norm Quadratic Average: 51.34039306640625
Nearest Class Center Accuracy: 0.5364

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02201727405190468
Inter Cos: 0.1881822794675827
Norm Quadratic Average: 36.77522277832031
Nearest Class Center Accuracy: 0.5571

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02771272510290146
Inter Cos: 0.25505274534225464
Norm Quadratic Average: 14.862276077270508
Nearest Class Center Accuracy: 0.5767

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04737964645028114
Inter Cos: 0.35150906443595886
Norm Quadratic Average: 7.4272236824035645
Nearest Class Center Accuracy: 0.5555

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10184594243764877
Inter Cos: 0.4861909747123718
Norm Quadratic Average: 3.2867023944854736
Nearest Class Center Accuracy: 0.5248

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.16959252953529358
Inter Cos: 0.5959302186965942
Norm Quadratic Average: 2.2661049365997314
Nearest Class Center Accuracy: 0.521

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.22866562008857727
Inter Cos: 0.6643471717834473
Norm Quadratic Average: 1.7643582820892334
Nearest Class Center Accuracy: 0.5074

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2831403911113739
Inter Cos: 0.7449904680252075
Norm Quadratic Average: 2.3266375064849854
Nearest Class Center Accuracy: 0.4829

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2858714163303375
Inter Cos: 0.7725244760513306
Norm Quadratic Average: 3.976088285446167
Nearest Class Center Accuracy: 0.4753

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.27391672134399414
Inter Cos: 0.786301851272583
Norm Quadratic Average: 6.946181774139404
Nearest Class Center Accuracy: 0.4697

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 6.258396625518799
Linear Weight Rank: 4026
Intra Cos: 0.3150600492954254
Inter Cos: 0.7612879276275635
Norm Quadratic Average: 61.4026985168457
Nearest Class Center Accuracy: 0.4687

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 6.728082656860352
Linear Weight Rank: 3569
Intra Cos: 0.28299471735954285
Inter Cos: 0.7443593740463257
Norm Quadratic Average: 62.2192268371582
Nearest Class Center Accuracy: 0.4748

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 6.409646034240723
Linear Weight Rank: 98
Intra Cos: 0.251642107963562
Inter Cos: 0.7044929265975952
Norm Quadratic Average: 50.25820541381836
Nearest Class Center Accuracy: 0.4778

Output Layer:
Intra Cos: 0.25874659419059753
Inter Cos: 0.7578245401382446
Norm Quadratic Average: 58.9009895324707
Nearest Class Center Accuracy: 0.4761

