Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893192246556282
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326313018798828
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022876756265759468
Inter Cos: 0.03996308520436287
Norm Quadratic Average: 47.622047424316406
Nearest Class Center Accuracy: 0.0397

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021329618990421295
Inter Cos: 0.030062682926654816
Norm Quadratic Average: 59.42148971557617
Nearest Class Center Accuracy: 0.05438

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02140919491648674
Inter Cos: 0.02421550080180168
Norm Quadratic Average: 69.88381958007812
Nearest Class Center Accuracy: 0.0634

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020623410120606422
Inter Cos: 0.02155376970767975
Norm Quadratic Average: 28.82659912109375
Nearest Class Center Accuracy: 0.06992

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02505631372332573
Inter Cos: 0.02669087052345276
Norm Quadratic Average: 10.979936599731445
Nearest Class Center Accuracy: 0.0741

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05331248417496681
Inter Cos: 0.046569835394620895
Norm Quadratic Average: 2.516313076019287
Nearest Class Center Accuracy: 0.08352

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2553164064884186
Inter Cos: 0.18844404816627502
Norm Quadratic Average: 0.9863254427909851
Nearest Class Center Accuracy: 0.0946

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5643258094787598
Inter Cos: 0.5203855633735657
Norm Quadratic Average: 0.8021851181983948
Nearest Class Center Accuracy: 0.09388

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.705223560333252
Inter Cos: 0.753675639629364
Norm Quadratic Average: 1.0893757343292236
Nearest Class Center Accuracy: 0.09222

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7341182231903076
Inter Cos: 0.807173490524292
Norm Quadratic Average: 2.0494656562805176
Nearest Class Center Accuracy: 0.09218

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.747227132320404
Inter Cos: 0.7798151969909668
Norm Quadratic Average: 4.2888288497924805
Nearest Class Center Accuracy: 0.0933

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8202841281890869
Inter Cos: 0.7729038000106812
Norm Quadratic Average: 6.591209411621094
Nearest Class Center Accuracy: 0.09396

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8784823417663574
Inter Cos: 0.7674257755279541
Norm Quadratic Average: 12.360822677612305
Nearest Class Center Accuracy: 0.09438

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9126039743423462
Inter Cos: 0.7457557916641235
Norm Quadratic Average: 23.972763061523438
Nearest Class Center Accuracy: 0.09536

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9166541695594788
Inter Cos: 0.7238608002662659
Norm Quadratic Average: 39.9291877746582
Nearest Class Center Accuracy: 0.09688

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.3218014240264893
Linear Weight Rank: 1941
Intra Cos: 0.8708595633506775
Inter Cos: 0.6290709376335144
Norm Quadratic Average: 212.9175567626953
Nearest Class Center Accuracy: 0.09772

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.999850273132324
Linear Weight Rank: 2797
Intra Cos: 0.8913154006004333
Inter Cos: 0.6259951591491699
Norm Quadratic Average: 142.6493377685547
Nearest Class Center Accuracy: 0.0988

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.197006702423096
Linear Weight Rank: 97
Intra Cos: 0.8918516635894775
Inter Cos: 0.6292813420295715
Norm Quadratic Average: 79.13006591796875
Nearest Class Center Accuracy: 0.09962

Output Layer:
Intra Cos: 0.9197578430175781
Inter Cos: 0.7663249373435974
Norm Quadratic Average: 62.8250846862793
Nearest Class Center Accuracy: 0.09986

Test Set:
Average Loss: 4.245383833312988
Accuracy: 0.4845
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.2345779836177826, Weights: 0.06321276724338531
NC2 Equiangle: Features: 0.231717467645202, Weights: 0.10471844913983586
NC3 Self-Duality: 0.49824854731559753
NC4 NCC Mismatch: 0.1935

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422183990478516
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013163990341126919
Inter Cos: 0.2645830810070038
Norm Quadratic Average: 47.8847541809082
Nearest Class Center Accuracy: 0.1999

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015734072774648666
Inter Cos: 0.2570206820964813
Norm Quadratic Average: 59.77985763549805
Nearest Class Center Accuracy: 0.3204

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01589145138859749
Inter Cos: 0.19079038500785828
Norm Quadratic Average: 70.3486099243164
Nearest Class Center Accuracy: 0.4257

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016169823706150055
Inter Cos: 0.20088452100753784
Norm Quadratic Average: 29.066164016723633
Nearest Class Center Accuracy: 0.5054

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01636238768696785
Inter Cos: 0.18841424584388733
Norm Quadratic Average: 11.048493385314941
Nearest Class Center Accuracy: 0.5456

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025565266609191895
Inter Cos: 0.28116995096206665
Norm Quadratic Average: 2.5151290893554688
Nearest Class Center Accuracy: 0.5626

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08432988077402115
Inter Cos: 0.5481343269348145
Norm Quadratic Average: 0.9647138118743896
Nearest Class Center Accuracy: 0.5335

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.25736120343208313
Inter Cos: 0.7115219831466675
Norm Quadratic Average: 0.7665321230888367
Nearest Class Center Accuracy: 0.4593

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2965729534626007
Inter Cos: 0.8022633194923401
Norm Quadratic Average: 1.0343031883239746
Nearest Class Center Accuracy: 0.4074

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.25087419152259827
Inter Cos: 0.8302301168441772
Norm Quadratic Average: 1.9364533424377441
Nearest Class Center Accuracy: 0.38

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.23285238444805145
Inter Cos: 0.8437540531158447
Norm Quadratic Average: 4.045382976531982
Nearest Class Center Accuracy: 0.3826

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.27717602252960205
Inter Cos: 0.8392924070358276
Norm Quadratic Average: 6.212432861328125
Nearest Class Center Accuracy: 0.3876

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2853563129901886
Inter Cos: 0.8576767444610596
Norm Quadratic Average: 11.615435600280762
Nearest Class Center Accuracy: 0.4154

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.29382190108299255
Inter Cos: 0.8743855953216553
Norm Quadratic Average: 22.44200325012207
Nearest Class Center Accuracy: 0.4409

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3254000246524811
Inter Cos: 0.8830926418304443
Norm Quadratic Average: 37.432220458984375
Nearest Class Center Accuracy: 0.4539

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.3218014240264893
Linear Weight Rank: 1941
Intra Cos: 0.3711972236633301
Inter Cos: 0.8283860087394714
Norm Quadratic Average: 202.56109619140625
Nearest Class Center Accuracy: 0.4609

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.999850273132324
Linear Weight Rank: 2797
Intra Cos: 0.3337087631225586
Inter Cos: 0.7702752947807312
Norm Quadratic Average: 134.55413818359375
Nearest Class Center Accuracy: 0.476

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.197006702423096
Linear Weight Rank: 97
Intra Cos: 0.27373072504997253
Inter Cos: 0.7216173410415649
Norm Quadratic Average: 74.01423645019531
Nearest Class Center Accuracy: 0.4815

Output Layer:
Intra Cos: 0.31106242537498474
Inter Cos: 0.7615246772766113
Norm Quadratic Average: 58.80820083618164
Nearest Class Center Accuracy: 0.4787

