Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893192246556282
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326313018798828
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012440530583262444
Inter Cos: 0.0280402023345232
Norm Quadratic Average: 10.001999855041504
Nearest Class Center Accuracy: 0.04012

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018756022676825523
Inter Cos: 0.03882478550076485
Norm Quadratic Average: 7.327739238739014
Nearest Class Center Accuracy: 0.05738

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013310825452208519
Inter Cos: 0.0328855998814106
Norm Quadratic Average: 5.3637261390686035
Nearest Class Center Accuracy: 0.06366

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021623408421874046
Inter Cos: 0.021362770348787308
Norm Quadratic Average: 4.049707412719727
Nearest Class Center Accuracy: 0.07164

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02294541522860527
Inter Cos: 0.02136998437345028
Norm Quadratic Average: 3.030836820602417
Nearest Class Center Accuracy: 0.075

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023091554641723633
Inter Cos: 0.02095254510641098
Norm Quadratic Average: 2.8989853858947754
Nearest Class Center Accuracy: 0.07742

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021067390218377113
Inter Cos: 0.018208075314760208
Norm Quadratic Average: 2.872925281524658
Nearest Class Center Accuracy: 0.07936

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.030989110469818115
Inter Cos: 0.025448419153690338
Norm Quadratic Average: 2.1094889640808105
Nearest Class Center Accuracy: 0.08636

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03891974315047264
Inter Cos: 0.026847271248698235
Norm Quadratic Average: 1.3737856149673462
Nearest Class Center Accuracy: 0.09112

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0667329877614975
Inter Cos: 0.03875921666622162
Norm Quadratic Average: 1.0936291217803955
Nearest Class Center Accuracy: 0.09546

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.16350150108337402
Inter Cos: 0.055365774780511856
Norm Quadratic Average: 0.9200339317321777
Nearest Class Center Accuracy: 0.09768

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.46526196599006653
Inter Cos: 0.13553175330162048
Norm Quadratic Average: 0.7438551187515259
Nearest Class Center Accuracy: 0.09866

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8192731738090515
Inter Cos: 0.23007817566394806
Norm Quadratic Average: 0.5268629789352417
Nearest Class Center Accuracy: 0.1

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9006373882293701
Inter Cos: 0.3235083222389221
Norm Quadratic Average: 0.5797239542007446
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9539240598678589
Inter Cos: 0.3428444266319275
Norm Quadratic Average: 1.1704182624816895
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.9145638942718506
Linear Weight Rank: 346
Intra Cos: 0.9780821204185486
Inter Cos: 0.3833222985267639
Norm Quadratic Average: 38.6151123046875
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 4.03130578994751
Linear Weight Rank: 1740
Intra Cos: 0.9809005856513977
Inter Cos: 0.40769174695014954
Norm Quadratic Average: 33.87506866455078
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.155693054199219
Linear Weight Rank: 97
Intra Cos: 0.9803049564361572
Inter Cos: 0.408338725566864
Norm Quadratic Average: 32.07102584838867
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9809173941612244
Inter Cos: 0.4424630105495453
Norm Quadratic Average: 33.43156433105469
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 1.9338765111923217
Accuracy: 0.6225
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.14961844682693481, Weights: 0.016654931008815765
NC2 Equiangle: Features: 0.2256161221590909, Weights: 0.18157749368686868
NC3 Self-Duality: 0.15674179792404175
NC4 NCC Mismatch: 0.05800000000000005

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422183990478516
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.007510618306696415
Inter Cos: 0.18207035958766937
Norm Quadratic Average: 10.066872596740723
Nearest Class Center Accuracy: 0.2286

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010353595949709415
Inter Cos: 0.2572171092033386
Norm Quadratic Average: 7.376805782318115
Nearest Class Center Accuracy: 0.3647

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.009978351183235645
Inter Cos: 0.1549096405506134
Norm Quadratic Average: 5.388017177581787
Nearest Class Center Accuracy: 0.4881

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015301628969609737
Inter Cos: 0.1943494826555252
Norm Quadratic Average: 4.065455436706543
Nearest Class Center Accuracy: 0.5334

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016883421689271927
Inter Cos: 0.17244583368301392
Norm Quadratic Average: 3.0397486686706543
Nearest Class Center Accuracy: 0.5687

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01560263056308031
Inter Cos: 0.14630301296710968
Norm Quadratic Average: 2.9030613899230957
Nearest Class Center Accuracy: 0.5934

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012581120245158672
Inter Cos: 0.12183143943548203
Norm Quadratic Average: 2.8733386993408203
Nearest Class Center Accuracy: 0.6213

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014843528158962727
Inter Cos: 0.1583023965358734
Norm Quadratic Average: 2.106199264526367
Nearest Class Center Accuracy: 0.6592

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015933454036712646
Inter Cos: 0.14707139134407043
Norm Quadratic Average: 1.3588026762008667
Nearest Class Center Accuracy: 0.692

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021366313099861145
Inter Cos: 0.20482662320137024
Norm Quadratic Average: 1.0520437955856323
Nearest Class Center Accuracy: 0.6705

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04194537550210953
Inter Cos: 0.28917986154556274
Norm Quadratic Average: 0.8383103013038635
Nearest Class Center Accuracy: 0.6182

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.174047589302063
Inter Cos: 0.38419055938720703
Norm Quadratic Average: 0.6308062672615051
Nearest Class Center Accuracy: 0.5475

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2682968080043793
Inter Cos: 0.4269843101501465
Norm Quadratic Average: 0.4241876006126404
Nearest Class Center Accuracy: 0.5858

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2632219195365906
Inter Cos: 0.4411280155181885
Norm Quadratic Average: 0.48255303502082825
Nearest Class Center Accuracy: 0.6197

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2616123557090759
Inter Cos: 0.5005177855491638
Norm Quadratic Average: 1.0456743240356445
Nearest Class Center Accuracy: 0.6265

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.9145638942718506
Linear Weight Rank: 346
Intra Cos: 0.2757503390312195
Inter Cos: 0.559283435344696
Norm Quadratic Average: 35.156917572021484
Nearest Class Center Accuracy: 0.6284

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 4.03130578994751
Linear Weight Rank: 1740
Intra Cos: 0.298978328704834
Inter Cos: 0.579524040222168
Norm Quadratic Average: 31.258525848388672
Nearest Class Center Accuracy: 0.6282

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.155693054199219
Linear Weight Rank: 97
Intra Cos: 0.30796414613723755
Inter Cos: 0.5952399373054504
Norm Quadratic Average: 30.00274658203125
Nearest Class Center Accuracy: 0.627

Output Layer:
Intra Cos: 0.2977234721183777
Inter Cos: 0.6265657544136047
Norm Quadratic Average: 31.455961227416992
Nearest Class Center Accuracy: 0.626

