Model save path: ./New_Models/bn_False_dataset_MNIST_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.005.pth.tar
Training Set:
Layer 0: Conv2d(1, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09116753190755844
Inter Cos: 0.10967151820659637
Norm Quadratic Average: 23.567678451538086
Nearest Class Center Accuracy: 0.8079833333333334

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.11725941300392151
Inter Cos: 0.14077526330947876
Norm Quadratic Average: 71.20375061035156
Nearest Class Center Accuracy: 0.79965

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.13883371651172638
Inter Cos: 0.17963476479053497
Norm Quadratic Average: 138.20590209960938
Nearest Class Center Accuracy: 0.7786

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1436915248632431
Inter Cos: 0.18884645402431488
Norm Quadratic Average: 268.4670104980469
Nearest Class Center Accuracy: 0.7758333333333334

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.17058131098747253
Inter Cos: 0.19194437563419342
Norm Quadratic Average: 173.8869171142578
Nearest Class Center Accuracy: 0.8181166666666667

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1947741061449051
Inter Cos: 0.21038027107715607
Norm Quadratic Average: 129.42478942871094
Nearest Class Center Accuracy: 0.8387333333333333

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.21867209672927856
Inter Cos: 0.23695097863674164
Norm Quadratic Average: 116.90108489990234
Nearest Class Center Accuracy: 0.8698833333333333

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2613062858581543
Inter Cos: 0.25182679295539856
Norm Quadratic Average: 106.41513061523438
Nearest Class Center Accuracy: 0.9110333333333334

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.23913311958312988
Inter Cos: 0.25168368220329285
Norm Quadratic Average: 46.95205307006836
Nearest Class Center Accuracy: 0.90945

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.29847681522369385
Inter Cos: 0.3123663365840912
Norm Quadratic Average: 27.138376235961914
Nearest Class Center Accuracy: 0.8972833333333333

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3874889612197876
Inter Cos: 0.33076030015945435
Norm Quadratic Average: 23.816566467285156
Nearest Class Center Accuracy: 0.9111833333333333

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.49964118003845215
Inter Cos: 0.33372965455055237
Norm Quadratic Average: 24.89909553527832
Nearest Class Center Accuracy: 0.9429833333333333

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.542583167552948
Inter Cos: 0.501017689704895
Norm Quadratic Average: 16.488590240478516
Nearest Class Center Accuracy: 0.9346833333333333

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6800510883331299
Inter Cos: 0.5766635537147522
Norm Quadratic Average: 14.671557426452637
Nearest Class Center Accuracy: 0.9542166666666667

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7214618921279907
Inter Cos: 0.5558968782424927
Norm Quadratic Average: 16.455974578857422
Nearest Class Center Accuracy: 0.9708833333333333

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7465372681617737
Inter Cos: 0.525391161441803
Norm Quadratic Average: 18.843761444091797
Nearest Class Center Accuracy: 0.9795166666666667

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 1.6318364143371582
Linear Weight Rank: 34
Intra Cos: 0.7850472331047058
Inter Cos: 0.3800271153450012
Norm Quadratic Average: 79.01258087158203
Nearest Class Center Accuracy: 0.9881

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 1.6428660154342651
Linear Weight Rank: 2721
Intra Cos: 0.8515665531158447
Inter Cos: 0.30942684412002563
Norm Quadratic Average: 49.83116912841797
Nearest Class Center Accuracy: 0.9940666666666667

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.6308825016021729
Linear Weight Rank: 9
Intra Cos: 0.8768653273582458
Inter Cos: 0.2829539179801941
Norm Quadratic Average: 30.69632911682129
Nearest Class Center Accuracy: 0.9960833333333333

Output Layer:
Intra Cos: 0.907771646976471
Inter Cos: 0.3583795130252838
Norm Quadratic Average: 21.39360809326172
Nearest Class Center Accuracy: 0.9978333333333333

Test Set:
Average Loss: 0.03758825162262656
Accuracy: 0.9899
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.17648835480213165, Weights: 0.04947911202907562
NC2 Equiangle: Features: 0.25408982170952693, Weights: 0.21048524644639757
NC3 Self-Duality: 0.09741933643817902
NC4 NCC Mismatch: 0.008199999999999985

Layer 0: Conv2d(1, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10219582915306091
Inter Cos: 0.12048853933811188
Norm Quadratic Average: 23.595195770263672
Nearest Class Center Accuracy: 0.8229

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.12891359627246857
Inter Cos: 0.15417151153087616
Norm Quadratic Average: 71.63958740234375
Nearest Class Center Accuracy: 0.8162

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.15321886539459229
Inter Cos: 0.196689635515213
Norm Quadratic Average: 138.88072204589844
Nearest Class Center Accuracy: 0.7982

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.15840478241443634
Inter Cos: 0.20717398822307587
Norm Quadratic Average: 269.8029479980469
Nearest Class Center Accuracy: 0.7969

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.18078657984733582
Inter Cos: 0.21075588464736938
Norm Quadratic Average: 174.2667999267578
Nearest Class Center Accuracy: 0.8337

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20678254961967468
Inter Cos: 0.23106864094734192
Norm Quadratic Average: 129.72360229492188
Nearest Class Center Accuracy: 0.8532

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.23108282685279846
Inter Cos: 0.2590877413749695
Norm Quadratic Average: 117.20172119140625
Nearest Class Center Accuracy: 0.8835

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.27334538102149963
Inter Cos: 0.27237454056739807
Norm Quadratic Average: 106.96468353271484
Nearest Class Center Accuracy: 0.9181

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.24836479127407074
Inter Cos: 0.2635081708431244
Norm Quadratic Average: 47.25227737426758
Nearest Class Center Accuracy: 0.9178

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3069283068180084
Inter Cos: 0.3087639808654785
Norm Quadratic Average: 27.34745979309082
Nearest Class Center Accuracy: 0.9018

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3981277346611023
Inter Cos: 0.3266877233982086
Norm Quadratic Average: 24.031675338745117
Nearest Class Center Accuracy: 0.9158

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5152170062065125
Inter Cos: 0.36165568232536316
Norm Quadratic Average: 25.15590476989746
Nearest Class Center Accuracy: 0.9431

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5632742047309875
Inter Cos: 0.51258385181427
Norm Quadratic Average: 16.670438766479492
Nearest Class Center Accuracy: 0.9336

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6937377452850342
Inter Cos: 0.5852234363555908
Norm Quadratic Average: 14.847237586975098
Nearest Class Center Accuracy: 0.9487

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.731284499168396
Inter Cos: 0.5616115927696228
Norm Quadratic Average: 16.658369064331055
Nearest Class Center Accuracy: 0.9641

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7538856863975525
Inter Cos: 0.5287265181541443
Norm Quadratic Average: 19.079132080078125
Nearest Class Center Accuracy: 0.9715

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 1.6318364143371582
Linear Weight Rank: 34
Intra Cos: 0.7893441319465637
Inter Cos: 0.38429325819015503
Norm Quadratic Average: 80.03485870361328
Nearest Class Center Accuracy: 0.9796

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 1.6428660154342651
Linear Weight Rank: 2721
Intra Cos: 0.8512648344039917
Inter Cos: 0.31077390909194946
Norm Quadratic Average: 50.503475189208984
Nearest Class Center Accuracy: 0.9847

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.6308825016021729
Linear Weight Rank: 9
Intra Cos: 0.8745241165161133
Inter Cos: 0.284483402967453
Norm Quadratic Average: 31.109960556030273
Nearest Class Center Accuracy: 0.9854

Output Layer:
Intra Cos: 0.906596302986145
Inter Cos: 0.36016735434532166
Norm Quadratic Average: 21.6933650970459
Nearest Class Center Accuracy: 0.987

