Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.01.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02289319410920143
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326311111450195
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04748283326625824
Inter Cos: 0.06297146528959274
Norm Quadratic Average: 2.98448521755465e-13
Nearest Class Center Accuracy: 0.0334

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 2.9308090209960938
Inter Cos: 2.926948070526123
Norm Quadratic Average: 1.4973568266036865e-22
Nearest Class Center Accuracy: 0.01

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 4.537306308746338
Inter Cos: 4.530231952667236
Norm Quadratic Average: 2.117582368135751e-22
Nearest Class Center Accuracy: 0.01

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 11.796470642089844
Inter Cos: 11.774886131286621
Norm Quadratic Average: 1.4973568266036865e-22
Nearest Class Center Accuracy: 0.01

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 13.5134916305542
Inter Cos: 13.4884672164917
Norm Quadratic Average: 7.486784133018432e-23
Nearest Class Center Accuracy: 0.01

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 2.0420961380004883
Inter Cos: 2.0400125980377197
Norm Quadratic Average: 2.4830854806784195e-22
Nearest Class Center Accuracy: 0.01

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 1.4751465320587158
Inter Cos: 1.4741967916488647
Norm Quadratic Average: 3.890247233040501e-22
Nearest Class Center Accuracy: 0.01

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 1.1604106426239014
Inter Cos: 1.1600902080535889
Norm Quadratic Average: 7.102587036505943e-22
Nearest Class Center Accuracy: 0.01

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 6.722200920905586e-13
Linear Weight Rank: 4031
Intra Cos: 1.0322331190109253
Inter Cos: 1.032168984413147
Norm Quadratic Average: 4.178034747939574e-21
Nearest Class Center Accuracy: 0.01

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.71643195133911e-13
Linear Weight Rank: 3671
Intra Cos: 1.187125325202942
Inter Cos: 1.1871503591537476
Norm Quadratic Average: 7.834339460898747e-22
Nearest Class Center Accuracy: 0.01

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.230968196237625e-14
Linear Weight Rank: 99
Intra Cos: 1.0020560026168823
Inter Cos: 1.0020781755447388
Norm Quadratic Average: 2.0064721805378107e-21
Nearest Class Center Accuracy: 0.01

Output Layer:
Intra Cos: 0.9999994039535522
Inter Cos: 0.9999998211860657
Norm Quadratic Average: 4.5906620727009795e-09
Nearest Class Center Accuracy: 0.01

Test Set:
Average Loss: 4.605170135498047
Accuracy: 0.01
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.0, Weights: 0.011350231245160103
NC2 Equiangle: Features: nan, Weights: 0.01507153443615846
NC3 Self-Duality: 5.427287578582764
NC4 NCC Mismatch: 1.0

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621266715228558
Inter Cos: 0.406754732131958
Norm Quadratic Average: 29.42218780517578
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012173936702311039
Inter Cos: 0.3485028147697449
Norm Quadratic Average: 2.9893904192335174e-13
Nearest Class Center Accuracy: 0.1203

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: nan
Inter Cos: nan
Norm Quadratic Average: 0.0
Nearest Class Center Accuracy: 0.01

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 6.722200920905586e-13
Linear Weight Rank: 4031
Intra Cos: 3.336519479751587
Inter Cos: 3.3131561279296875
Norm Quadratic Average: 5.24074908243952e-22
Nearest Class Center Accuracy: 0.01

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.71643195133911e-13
Linear Weight Rank: 3671
Intra Cos: 22.537639617919922
Inter Cos: 22.322269439697266
Norm Quadratic Average: 3.743392066509216e-23
Nearest Class Center Accuracy: 0.01

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.230968196237625e-14
Linear Weight Rank: 99
Intra Cos: 1.0223689079284668
Inter Cos: 1.0221456289291382
Norm Quadratic Average: 4.317090654960218e-22
Nearest Class Center Accuracy: 0.01

Output Layer:
Intra Cos: 0.9999999403953552
Inter Cos: 1.000000238418579
Norm Quadratic Average: 8.835833176235042e-10
Nearest Class Center Accuracy: 0.01

