Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.01.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893190383911133
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326326370239258
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03069246932864189
Inter Cos: 0.0720098540186882
Norm Quadratic Average: 2.9841805567441815e-13
Nearest Class Center Accuracy: 0.0341

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 3.3103270530700684
Inter Cos: 3.305708408355713
Norm Quadratic Average: 2.994713653207373e-22
Nearest Class Center Accuracy: 0.01

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 2.4699738025665283
Inter Cos: 2.4670348167419434
Norm Quadratic Average: 2.994713653207373e-22
Nearest Class Center Accuracy: 0.01

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 6.593957424163818
Inter Cos: 6.582770824432373
Norm Quadratic Average: 1.4973568266036865e-22
Nearest Class Center Accuracy: 0.01

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 8.690553665161133
Inter Cos: 8.675176620483398
Norm Quadratic Average: 1.4973568266036865e-22
Nearest Class Center Accuracy: 0.01

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 5.280266761779785
Inter Cos: 5.2717061042785645
Norm Quadratic Average: 2.117582368135751e-22
Nearest Class Center Accuracy: 0.01

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 2.200018882751465
Inter Cos: 2.197619676589966
Norm Quadratic Average: 1.9808169850177323e-22
Nearest Class Center Accuracy: 0.01

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 1.8183014392852783
Inter Cos: 1.8166656494140625
Norm Quadratic Average: 2.899619184764494e-22
Nearest Class Center Accuracy: 0.01

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 1.3666322231292725
Inter Cos: 1.3658993244171143
Norm Quadratic Average: 4.966170961356839e-22
Nearest Class Center Accuracy: 0.01

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 1.1463587284088135
Inter Cos: 1.146066665649414
Norm Quadratic Average: 8.132729316851088e-22
Nearest Class Center Accuracy: 0.01

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 6.722260552025072e-13
Linear Weight Rank: 4031
Intra Cos: 1.0196759700775146
Inter Cos: 1.0196369886398315
Norm Quadratic Average: 5.1550194657924455e-21
Nearest Class Center Accuracy: 0.01

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.7175226587246304e-13
Linear Weight Rank: 3670
Intra Cos: 1.1479281187057495
Inter Cos: 1.147633671760559
Norm Quadratic Average: 8.037403617499671e-22
Nearest Class Center Accuracy: 0.01

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.2447392578940854e-14
Linear Weight Rank: 99
Intra Cos: 1.0022566318511963
Inter Cos: 1.0022525787353516
Norm Quadratic Average: 1.937906056730232e-21
Nearest Class Center Accuracy: 0.01

Output Layer:
Intra Cos: 1.0000003576278687
Inter Cos: 1.0000007152557373
Norm Quadratic Average: 5.493994148508818e-09
Nearest Class Center Accuracy: 0.01

Test Set:
Average Loss: 4.605170180511474
Accuracy: 0.01
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.0, Weights: 0.011117971502244473
NC2 Equiangle: Features: nan, Weights: 0.014787668555673927
NC3 Self-Duality: 4.1531081199646
NC4 NCC Mismatch: 1.0

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422189712524414
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01074282731860876
Inter Cos: 0.3496449887752533
Norm Quadratic Average: 2.9936510627208424e-13
Nearest Class Center Accuracy: 0.1287

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 6.722260552025072e-13
Linear Weight Rank: 4031
Intra Cos: 2.5396292209625244
Inter Cos: 2.5242350101470947
Norm Quadratic Average: 6.41858026062946e-22
Nearest Class Center Accuracy: 0.01

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.7175226587246304e-13
Linear Weight Rank: 3670
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.2447392578940854e-14
Linear Weight Rank: 99
Intra Cos: 1.0878139734268188
Inter Cos: 1.086936116218567
Norm Quadratic Average: 4.317090654960218e-22
Nearest Class Center Accuracy: 0.01

Output Layer:
Intra Cos: 0.999999463558197
Inter Cos: 1.0
Norm Quadratic Average: 1.1185229409349517e-09
Nearest Class Center Accuracy: 0.01

