Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.0003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893192246556282
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326313018798828
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014238527975976467
Inter Cos: 0.028808264061808586
Norm Quadratic Average: 64.94342803955078
Nearest Class Center Accuracy: 0.04058

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01884111575782299
Inter Cos: 0.035039760172367096
Norm Quadratic Average: 39.28409194946289
Nearest Class Center Accuracy: 0.05682

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015346894972026348
Inter Cos: 0.02530946582555771
Norm Quadratic Average: 34.76646041870117
Nearest Class Center Accuracy: 0.06326

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021944070234894753
Inter Cos: 0.022726040333509445
Norm Quadratic Average: 23.051313400268555
Nearest Class Center Accuracy: 0.0696

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0213073268532753
Inter Cos: 0.023128215223550797
Norm Quadratic Average: 21.506912231445312
Nearest Class Center Accuracy: 0.07366

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023247066885232925
Inter Cos: 0.02412407100200653
Norm Quadratic Average: 20.73260498046875
Nearest Class Center Accuracy: 0.07684

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024242885410785675
Inter Cos: 0.022888455539941788
Norm Quadratic Average: 20.764728546142578
Nearest Class Center Accuracy: 0.07896

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03331378474831581
Inter Cos: 0.03244657441973686
Norm Quadratic Average: 12.614407539367676
Nearest Class Center Accuracy: 0.08564

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04619313403964043
Inter Cos: 0.0431472584605217
Norm Quadratic Average: 13.248662948608398
Nearest Class Center Accuracy: 0.09006

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06562547385692596
Inter Cos: 0.05872071534395218
Norm Quadratic Average: 13.036040306091309
Nearest Class Center Accuracy: 0.09304

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09548912197351456
Inter Cos: 0.08359394967556
Norm Quadratic Average: 14.175891876220703
Nearest Class Center Accuracy: 0.09596

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.21442705392837524
Inter Cos: 0.15064555406570435
Norm Quadratic Average: 12.61596393585205
Nearest Class Center Accuracy: 0.09886

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.495642751455307
Inter Cos: 0.2888866662979126
Norm Quadratic Average: 9.62460994720459
Nearest Class Center Accuracy: 0.09998

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6647792458534241
Inter Cos: 0.32870715856552124
Norm Quadratic Average: 10.338419914245605
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.760295569896698
Inter Cos: 0.2885900139808655
Norm Quadratic Average: 10.67408275604248
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 39.12425231933594
Linear Weight Rank: 4031
Intra Cos: 0.8683454990386963
Inter Cos: 0.3062618374824524
Norm Quadratic Average: 56.20581817626953
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 18.239980697631836
Linear Weight Rank: 3660
Intra Cos: 0.925315797328949
Inter Cos: 0.3487728238105774
Norm Quadratic Average: 39.407005310058594
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 9.046956062316895
Linear Weight Rank: 98
Intra Cos: 0.9454538226127625
Inter Cos: 0.3571445643901825
Norm Quadratic Average: 33.41000747680664
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9686886072158813
Inter Cos: 0.5057733058929443
Norm Quadratic Average: 49.256690979003906
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 2.90724469833374
Accuracy: 0.5757
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.24490879476070404, Weights: 0.026255417615175247
NC2 Equiangle: Features: 0.17377522786458333, Weights: 0.10766901189630682
NC3 Self-Duality: 0.4548408091068268
NC4 NCC Mismatch: 0.09119999999999995

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422183990478516
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.00808222871273756
Inter Cos: 0.18502092361450195
Norm Quadratic Average: 65.3639144897461
Nearest Class Center Accuracy: 0.231

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011642065830528736
Inter Cos: 0.24646924436092377
Norm Quadratic Average: 39.55315017700195
Nearest Class Center Accuracy: 0.3605

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01077242475003004
Inter Cos: 0.1531023532152176
Norm Quadratic Average: 34.93512725830078
Nearest Class Center Accuracy: 0.465

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015635110437870026
Inter Cos: 0.17581649124622345
Norm Quadratic Average: 23.14360237121582
Nearest Class Center Accuracy: 0.5086

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015849296003580093
Inter Cos: 0.15115758776664734
Norm Quadratic Average: 21.56437873840332
Nearest Class Center Accuracy: 0.5508

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015010190196335316
Inter Cos: 0.14022770524024963
Norm Quadratic Average: 20.755817413330078
Nearest Class Center Accuracy: 0.5733

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014207529835402966
Inter Cos: 0.13118673861026764
Norm Quadratic Average: 20.769075393676758
Nearest Class Center Accuracy: 0.5984

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01627347618341446
Inter Cos: 0.14594075083732605
Norm Quadratic Average: 12.597208976745605
Nearest Class Center Accuracy: 0.6252

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01946450024843216
Inter Cos: 0.16338257491588593
Norm Quadratic Average: 13.165725708007812
Nearest Class Center Accuracy: 0.6304

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02474134787917137
Inter Cos: 0.20177680253982544
Norm Quadratic Average: 12.849639892578125
Nearest Class Center Accuracy: 0.6281

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03443676978349686
Inter Cos: 0.25184544920921326
Norm Quadratic Average: 13.828313827514648
Nearest Class Center Accuracy: 0.6169

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06740538030862808
Inter Cos: 0.3452935516834259
Norm Quadratic Average: 12.092371940612793
Nearest Class Center Accuracy: 0.5927

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.12686628103256226
Inter Cos: 0.4837884306907654
Norm Quadratic Average: 8.834503173828125
Nearest Class Center Accuracy: 0.5834

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.16386474668979645
Inter Cos: 0.4947684705257416
Norm Quadratic Average: 9.17639446258545
Nearest Class Center Accuracy: 0.581

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.18830569088459015
Inter Cos: 0.48411163687705994
Norm Quadratic Average: 9.232596397399902
Nearest Class Center Accuracy: 0.581

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 39.12425231933594
Linear Weight Rank: 4031
Intra Cos: 0.23108337819576263
Inter Cos: 0.46629321575164795
Norm Quadratic Average: 46.41123580932617
Nearest Class Center Accuracy: 0.5732

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 18.239980697631836
Linear Weight Rank: 3660
Intra Cos: 0.22202439606189728
Inter Cos: 0.4627588987350464
Norm Quadratic Average: 32.11965560913086
Nearest Class Center Accuracy: 0.5779

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 9.046956062316895
Linear Weight Rank: 98
Intra Cos: 0.22641277313232422
Inter Cos: 0.5357929468154907
Norm Quadratic Average: 27.35407257080078
Nearest Class Center Accuracy: 0.5787

Output Layer:
Intra Cos: 0.2658502757549286
Inter Cos: 0.6863196492195129
Norm Quadratic Average: 40.521244049072266
Nearest Class Center Accuracy: 0.5748

