Model save path: ./New_Models/bn_False_dataset_MNIST_epochs_200_lr_0.01_model_type_vgg19_rand_seed_846264_test_samples_None_train_samples_None_weight_decay_0.01.pth.tar
Training Set:
Layer 0: Conv2d(1, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09116754680871964
Inter Cos: 0.10967151820659637
Norm Quadratic Average: 23.567686080932617
Nearest Class Center Accuracy: 0.8079833333333334

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0856136605143547
Inter Cos: 0.09817079454660416
Norm Quadratic Average: 6.313413541314723e-16
Nearest Class Center Accuracy: 0.8129166666666666

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.09871666666666666

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.09871666666666666

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.09871666666666666

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.09871666666666666

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.09871666666666666

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.09871666666666666

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.09871666666666666

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.09871666666666666

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.09871666666666666

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.09871666666666666

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.09871666666666666

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.09871666666666666

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.09871666666666666

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.09871666666666666

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 9.798436899772752e-16
Linear Weight Rank: 4031
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.09871666666666666

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.9602133417302235e-16
Linear Weight Rank: 3671
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.09871666666666666

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 5.003679846897697e-16
Linear Weight Rank: 9
Intra Cos: 1.0082933902740479
Inter Cos: 1.0087319612503052
Norm Quadratic Average: 1.6686461455697381e-21
Nearest Class Center Accuracy: 0.09871666666666666

Output Layer:
Intra Cos: 0.9999989867210388
Inter Cos: 1.0000008344650269
Norm Quadratic Average: 7.617629762535216e-07
Nearest Class Center Accuracy: 0.09871666666666666

Test Set:
Average Loss: 2.3010425910949706
Accuracy: 0.1135
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.0, Weights: 0.8522621989250183
NC2 Equiangle: Features: nan, Weights: 0.5703080071343316
NC3 Self-Duality: 33.88754653930664
NC4 NCC Mismatch: 1.0

Layer 0: Conv2d(1, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10219582170248032
Inter Cos: 0.12048851698637009
Norm Quadratic Average: 23.59519386291504
Nearest Class Center Accuracy: 0.8229

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09532859921455383
Inter Cos: 0.1084682047367096
Norm Quadratic Average: 6.329267351109363e-16
Nearest Class Center Accuracy: 0.8241

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.098

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.098

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.098

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.098

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.098

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.098

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.098

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.098

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.098

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.098

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.098

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.098

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.098

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.098

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 9.798436899772752e-16
Linear Weight Rank: 4031
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.098

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.9602133417302235e-16
Linear Weight Rank: 3671
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.098

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 5.003679846897697e-16
Linear Weight Rank: 9
Intra Cos: 2.0823071002960205
Inter Cos: 2.0813539028167725
Norm Quadratic Average: 1.6740958743820435e-22
Nearest Class Center Accuracy: 0.1135

Output Layer:
Intra Cos: 0.9999997615814209
Inter Cos: 1.000000238418579
Norm Quadratic Average: 8.535838702528054e-08
Nearest Class Center Accuracy: 0.101

