Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893192246556282
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326313018798828
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013343922793865204
Inter Cos: 0.029172655194997787
Norm Quadratic Average: 12.383813858032227
Nearest Class Center Accuracy: 0.03908

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01753121241927147
Inter Cos: 0.040209293365478516
Norm Quadratic Average: 8.565095901489258
Nearest Class Center Accuracy: 0.05776

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013507269322872162
Inter Cos: 0.030976422131061554
Norm Quadratic Average: 6.411238193511963
Nearest Class Center Accuracy: 0.0642

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022090012207627296
Inter Cos: 0.023511866107583046
Norm Quadratic Average: 4.750714302062988
Nearest Class Center Accuracy: 0.07122

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023536356166005135
Inter Cos: 0.020306572318077087
Norm Quadratic Average: 3.5788567066192627
Nearest Class Center Accuracy: 0.07458

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02266368828713894
Inter Cos: 0.02100248448550701
Norm Quadratic Average: 3.416616201400757
Nearest Class Center Accuracy: 0.07768

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021055754274129868
Inter Cos: 0.021048687398433685
Norm Quadratic Average: 3.5007755756378174
Nearest Class Center Accuracy: 0.08016

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03141095116734505
Inter Cos: 0.026788707822561264
Norm Quadratic Average: 2.4896230697631836
Nearest Class Center Accuracy: 0.08636

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03756385296583176
Inter Cos: 0.029666010290384293
Norm Quadratic Average: 1.6653647422790527
Nearest Class Center Accuracy: 0.09074

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05815704166889191
Inter Cos: 0.04597853124141693
Norm Quadratic Average: 1.3462693691253662
Nearest Class Center Accuracy: 0.0955

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.11344116926193237
Inter Cos: 0.0684124156832695
Norm Quadratic Average: 1.134448528289795
Nearest Class Center Accuracy: 0.09824

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3601691722869873
Inter Cos: 0.14524810016155243
Norm Quadratic Average: 0.8983402848243713
Nearest Class Center Accuracy: 0.09948

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7845070362091064
Inter Cos: 0.21228763461112976
Norm Quadratic Average: 0.5924712419509888
Nearest Class Center Accuracy: 0.1

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9226467609405518
Inter Cos: 0.32602494955062866
Norm Quadratic Average: 0.6335586309432983
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9577717185020447
Inter Cos: 0.3502948582172394
Norm Quadratic Average: 1.1765152215957642
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 4.055777549743652
Linear Weight Rank: 1285
Intra Cos: 0.9837815761566162
Inter Cos: 0.3954709470272064
Norm Quadratic Average: 39.07168960571289
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 4.410696983337402
Linear Weight Rank: 1768
Intra Cos: 0.9864569306373596
Inter Cos: 0.3863133490085602
Norm Quadratic Average: 32.93019485473633
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.501324653625488
Linear Weight Rank: 97
Intra Cos: 0.9864866137504578
Inter Cos: 0.4010043144226074
Norm Quadratic Average: 31.179393768310547
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9878988862037659
Inter Cos: 0.4271131157875061
Norm Quadratic Average: 32.474212646484375
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 1.9694342526435853
Accuracy: 0.619
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.1598375141620636, Weights: 0.018127599731087685
NC2 Equiangle: Features: 0.2156567136205808, Weights: 0.15716937440814394
NC3 Self-Duality: 0.22473280131816864
NC4 NCC Mismatch: 0.06379999999999997

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422183990478516
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.007644881494343281
Inter Cos: 0.19832780957221985
Norm Quadratic Average: 12.462774276733398
Nearest Class Center Accuracy: 0.2208

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011032641865313053
Inter Cos: 0.26346978545188904
Norm Quadratic Average: 8.622036933898926
Nearest Class Center Accuracy: 0.3659

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010521742515265942
Inter Cos: 0.15582555532455444
Norm Quadratic Average: 6.4404449462890625
Nearest Class Center Accuracy: 0.4807

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015867356210947037
Inter Cos: 0.19064688682556152
Norm Quadratic Average: 4.769697666168213
Nearest Class Center Accuracy: 0.5295

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016217555850744247
Inter Cos: 0.1669011116027832
Norm Quadratic Average: 3.5900626182556152
Nearest Class Center Accuracy: 0.5658

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015807971358299255
Inter Cos: 0.14366154372692108
Norm Quadratic Average: 3.4222402572631836
Nearest Class Center Accuracy: 0.5925

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013415067456662655
Inter Cos: 0.11800121515989304
Norm Quadratic Average: 3.501424551010132
Nearest Class Center Accuracy: 0.6161

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016719788312911987
Inter Cos: 0.1579686552286148
Norm Quadratic Average: 2.4859859943389893
Nearest Class Center Accuracy: 0.6556

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0170762836933136
Inter Cos: 0.15840604901313782
Norm Quadratic Average: 1.648823618888855
Nearest Class Center Accuracy: 0.6832

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02305028587579727
Inter Cos: 0.20773296058177948
Norm Quadratic Average: 1.3034098148345947
Nearest Class Center Accuracy: 0.6722

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03555220738053322
Inter Cos: 0.27415910363197327
Norm Quadratic Average: 1.052794337272644
Nearest Class Center Accuracy: 0.6376

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.11620115488767624
Inter Cos: 0.40808922052383423
Norm Quadratic Average: 0.7729321718215942
Nearest Class Center Accuracy: 0.5697

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20890089869499207
Inter Cos: 0.4538007080554962
Norm Quadratic Average: 0.47867289185523987
Nearest Class Center Accuracy: 0.5896

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2601204216480255
Inter Cos: 0.47359535098075867
Norm Quadratic Average: 0.5087261199951172
Nearest Class Center Accuracy: 0.6119

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.27570009231567383
Inter Cos: 0.5288366079330444
Norm Quadratic Average: 1.016197681427002
Nearest Class Center Accuracy: 0.6232

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 4.055777549743652
Linear Weight Rank: 1285
Intra Cos: 0.2883007824420929
Inter Cos: 0.5645992159843445
Norm Quadratic Average: 34.52864074707031
Nearest Class Center Accuracy: 0.6224

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 4.410696983337402
Linear Weight Rank: 1768
Intra Cos: 0.2852887511253357
Inter Cos: 0.5657706260681152
Norm Quadratic Average: 29.74477195739746
Nearest Class Center Accuracy: 0.6226

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.501324653625488
Linear Weight Rank: 97
Intra Cos: 0.2806415259838104
Inter Cos: 0.5565803647041321
Norm Quadratic Average: 28.614606857299805
Nearest Class Center Accuracy: 0.6227

Output Layer:
Intra Cos: 0.2898596525192261
Inter Cos: 0.5657175183296204
Norm Quadratic Average: 29.8487548828125
Nearest Class Center Accuracy: 0.62

