Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.0001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893190383911133
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326326370239258
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013128316961228848
Inter Cos: 0.025909829884767532
Norm Quadratic Average: 116.73463439941406
Nearest Class Center Accuracy: 0.0404

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01819789782166481
Inter Cos: 0.03705642372369766
Norm Quadratic Average: 67.53885650634766
Nearest Class Center Accuracy: 0.0571

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015728015452623367
Inter Cos: 0.027090653777122498
Norm Quadratic Average: 64.43616485595703
Nearest Class Center Accuracy: 0.06366

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021677475422620773
Inter Cos: 0.020818572491407394
Norm Quadratic Average: 43.319976806640625
Nearest Class Center Accuracy: 0.06992

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02312270738184452
Inter Cos: 0.021518290042877197
Norm Quadratic Average: 43.20523452758789
Nearest Class Center Accuracy: 0.07392

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025545861572027206
Inter Cos: 0.02216607891023159
Norm Quadratic Average: 42.39419174194336
Nearest Class Center Accuracy: 0.07682

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026212362572550774
Inter Cos: 0.022769194096326828
Norm Quadratic Average: 42.012210845947266
Nearest Class Center Accuracy: 0.07968

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03880126029253006
Inter Cos: 0.03487122431397438
Norm Quadratic Average: 27.69571304321289
Nearest Class Center Accuracy: 0.08478

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05578696355223656
Inter Cos: 0.04800661653280258
Norm Quadratic Average: 31.50296401977539
Nearest Class Center Accuracy: 0.08906

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07607436180114746
Inter Cos: 0.06297257542610168
Norm Quadratic Average: 31.810522079467773
Nearest Class Center Accuracy: 0.09262

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1033325046300888
Inter Cos: 0.08056958764791489
Norm Quadratic Average: 33.052433013916016
Nearest Class Center Accuracy: 0.09572

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2065206915140152
Inter Cos: 0.1388017237186432
Norm Quadratic Average: 25.758358001708984
Nearest Class Center Accuracy: 0.09832

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4423315227031708
Inter Cos: 0.2732446491718292
Norm Quadratic Average: 19.415925979614258
Nearest Class Center Accuracy: 0.09978

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6030329465866089
Inter Cos: 0.31922006607055664
Norm Quadratic Average: 21.362831115722656
Nearest Class Center Accuracy: 0.0998

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6794325709342957
Inter Cos: 0.31892454624176025
Norm Quadratic Average: 25.661865234375
Nearest Class Center Accuracy: 0.09858

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 74.0097885131836
Linear Weight Rank: 4031
Intra Cos: 0.7952910661697388
Inter Cos: 0.29537433385849
Norm Quadratic Average: 59.655029296875
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 32.368473052978516
Linear Weight Rank: 3665
Intra Cos: 0.8483250141143799
Inter Cos: 0.2696687877178192
Norm Quadratic Average: 44.699127197265625
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 12.684307098388672
Linear Weight Rank: 99
Intra Cos: 0.8833831548690796
Inter Cos: 0.28723061084747314
Norm Quadratic Average: 42.785152435302734
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9368939995765686
Inter Cos: 0.5063621401786804
Norm Quadratic Average: 83.82737731933594
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 4.425136040878296
Accuracy: 0.5588
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.2766498327255249, Weights: 0.030457764863967896
NC2 Equiangle: Features: 0.16753131904987373, Weights: 0.11095204979482323
NC3 Self-Duality: 0.5493674278259277
NC4 NCC Mismatch: 0.1139

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422189712524414
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.007510150782763958
Inter Cos: 0.19249068200588226
Norm Quadratic Average: 117.5171890258789
Nearest Class Center Accuracy: 0.2312

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010418021120131016
Inter Cos: 0.24055969715118408
Norm Quadratic Average: 68.00704956054688
Nearest Class Center Accuracy: 0.3586

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01150019746273756
Inter Cos: 0.14595617353916168
Norm Quadratic Average: 64.7596664428711
Nearest Class Center Accuracy: 0.4642

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015363925136625767
Inter Cos: 0.18612374365329742
Norm Quadratic Average: 43.50248718261719
Nearest Class Center Accuracy: 0.4992

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0161832794547081
Inter Cos: 0.16194184124469757
Norm Quadratic Average: 43.336612701416016
Nearest Class Center Accuracy: 0.5365

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016515694558620453
Inter Cos: 0.14050351083278656
Norm Quadratic Average: 42.465816497802734
Nearest Class Center Accuracy: 0.5674

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015287023968994617
Inter Cos: 0.1257580816745758
Norm Quadratic Average: 42.036006927490234
Nearest Class Center Accuracy: 0.5896

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01911744475364685
Inter Cos: 0.15848325192928314
Norm Quadratic Average: 27.662622451782227
Nearest Class Center Accuracy: 0.6031

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024142097681760788
Inter Cos: 0.1887349933385849
Norm Quadratic Average: 31.330018997192383
Nearest Class Center Accuracy: 0.6087

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0320248119533062
Inter Cos: 0.2345045655965805
Norm Quadratic Average: 31.44051742553711
Nearest Class Center Accuracy: 0.6057

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.042356137186288834
Inter Cos: 0.29522907733917236
Norm Quadratic Average: 32.39686965942383
Nearest Class Center Accuracy: 0.6006

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.075319804251194
Inter Cos: 0.3904772698879242
Norm Quadratic Average: 24.748035430908203
Nearest Class Center Accuracy: 0.5854

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.12564393877983093
Inter Cos: 0.5170755386352539
Norm Quadratic Average: 17.94907569885254
Nearest Class Center Accuracy: 0.5719

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.16737206280231476
Inter Cos: 0.5378546118736267
Norm Quadratic Average: 19.160568237304688
Nearest Class Center Accuracy: 0.5613

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2051607221364975
Inter Cos: 0.5225098133087158
Norm Quadratic Average: 22.65369987487793
Nearest Class Center Accuracy: 0.5528

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 74.0097885131836
Linear Weight Rank: 4031
Intra Cos: 0.23492377996444702
Inter Cos: 0.4589732885360718
Norm Quadratic Average: 50.244686126708984
Nearest Class Center Accuracy: 0.5633

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 32.368473052978516
Linear Weight Rank: 3665
Intra Cos: 0.2083766758441925
Inter Cos: 0.4237057566642761
Norm Quadratic Average: 36.30745315551758
Nearest Class Center Accuracy: 0.5636

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 12.684307098388672
Linear Weight Rank: 99
Intra Cos: 0.22354698181152344
Inter Cos: 0.5164148807525635
Norm Quadratic Average: 34.433570861816406
Nearest Class Center Accuracy: 0.5615

Output Layer:
Intra Cos: 0.25512054562568665
Inter Cos: 0.6923067569732666
Norm Quadratic Average: 67.52030944824219
Nearest Class Center Accuracy: 0.5631

