Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893190383911133
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326326370239258
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02420668676495552
Inter Cos: 0.04830777645111084
Norm Quadratic Average: 46.868011474609375
Nearest Class Center Accuracy: 0.03934

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02373531647026539
Inter Cos: 0.04441814497113228
Norm Quadratic Average: 59.09925842285156
Nearest Class Center Accuracy: 0.05004

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026023264974355698
Inter Cos: 0.027986181899905205
Norm Quadratic Average: 69.21878814697266
Nearest Class Center Accuracy: 0.06212

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023777883499860764
Inter Cos: 0.02158452570438385
Norm Quadratic Average: 29.040796279907227
Nearest Class Center Accuracy: 0.06924

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.028772827237844467
Inter Cos: 0.02593953162431717
Norm Quadratic Average: 10.96350383758545
Nearest Class Center Accuracy: 0.07338

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05495705455541611
Inter Cos: 0.043767862021923065
Norm Quadratic Average: 2.3865859508514404
Nearest Class Center Accuracy: 0.08368

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.34119945764541626
Inter Cos: 0.29858407378196716
Norm Quadratic Average: 1.0089378356933594
Nearest Class Center Accuracy: 0.09556

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6623899936676025
Inter Cos: 0.5794804096221924
Norm Quadratic Average: 1.065903902053833
Nearest Class Center Accuracy: 0.09598

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.783713698387146
Inter Cos: 0.7535635232925415
Norm Quadratic Average: 1.5865346193313599
Nearest Class Center Accuracy: 0.09642

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8208185434341431
Inter Cos: 0.7348795533180237
Norm Quadratic Average: 3.149542808532715
Nearest Class Center Accuracy: 0.09694

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.812397837638855
Inter Cos: 0.7607520222663879
Norm Quadratic Average: 7.2623467445373535
Nearest Class Center Accuracy: 0.09572

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7748339176177979
Inter Cos: 0.8294157385826111
Norm Quadratic Average: 11.57563304901123
Nearest Class Center Accuracy: 0.0945

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8191991448402405
Inter Cos: 0.8135147094726562
Norm Quadratic Average: 18.250062942504883
Nearest Class Center Accuracy: 0.09544

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8452988266944885
Inter Cos: 0.7841737270355225
Norm Quadratic Average: 31.158885955810547
Nearest Class Center Accuracy: 0.09606

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.872190535068512
Inter Cos: 0.7407892346382141
Norm Quadratic Average: 51.2741813659668
Nearest Class Center Accuracy: 0.09692

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.0933046340942383
Linear Weight Rank: 276
Intra Cos: 0.8353832364082336
Inter Cos: 0.76806640625
Norm Quadratic Average: 276.1995849609375
Nearest Class Center Accuracy: 0.09802

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.573035955429077
Linear Weight Rank: 2701
Intra Cos: 0.8401623368263245
Inter Cos: 0.7114642858505249
Norm Quadratic Average: 183.0537872314453
Nearest Class Center Accuracy: 0.09912

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 3.896259307861328
Linear Weight Rank: 97
Intra Cos: 0.83906489610672
Inter Cos: 0.6019564867019653
Norm Quadratic Average: 95.03063201904297
Nearest Class Center Accuracy: 0.09954

Output Layer:
Intra Cos: 0.8797702193260193
Inter Cos: 0.6810314655303955
Norm Quadratic Average: 70.34187316894531
Nearest Class Center Accuracy: 0.09962

Test Set:
Average Loss: 4.588106939697266
Accuracy: 0.4441
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.32108554244041443, Weights: 0.08556077629327774
NC2 Equiangle: Features: 0.2516534485479798, Weights: 0.10581772312973485
NC3 Self-Duality: 0.6567106246948242
NC4 NCC Mismatch: 0.27790000000000004

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422189712524414
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0129660340026021
Inter Cos: 0.28060147166252136
Norm Quadratic Average: 47.12076950073242
Nearest Class Center Accuracy: 0.1924

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018070686608552933
Inter Cos: 0.2834281921386719
Norm Quadratic Average: 59.44160079956055
Nearest Class Center Accuracy: 0.2857

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018013708293437958
Inter Cos: 0.2116023302078247
Norm Quadratic Average: 69.6436767578125
Nearest Class Center Accuracy: 0.3951

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016683626919984818
Inter Cos: 0.2123909592628479
Norm Quadratic Average: 29.262203216552734
Nearest Class Center Accuracy: 0.4995

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020192433148622513
Inter Cos: 0.19003883004188538
Norm Quadratic Average: 11.029644012451172
Nearest Class Center Accuracy: 0.5392

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025875430554151535
Inter Cos: 0.2681710124015808
Norm Quadratic Average: 2.38789439201355
Nearest Class Center Accuracy: 0.5566

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10633648931980133
Inter Cos: 0.5408220291137695
Norm Quadratic Average: 0.981932520866394
Nearest Class Center Accuracy: 0.4958

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3183133602142334
Inter Cos: 0.6982582807540894
Norm Quadratic Average: 1.0181668996810913
Nearest Class Center Accuracy: 0.4171

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.40108397603034973
Inter Cos: 0.8114984035491943
Norm Quadratic Average: 1.5112981796264648
Nearest Class Center Accuracy: 0.3851

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3982342481613159
Inter Cos: 0.8539848923683167
Norm Quadratic Average: 3.010432243347168
Nearest Class Center Accuracy: 0.3687

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.38190269470214844
Inter Cos: 0.8727501630783081
Norm Quadratic Average: 6.9499125480651855
Nearest Class Center Accuracy: 0.3498

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3693159520626068
Inter Cos: 0.897357165813446
Norm Quadratic Average: 11.119013786315918
Nearest Class Center Accuracy: 0.3229

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.406019926071167
Inter Cos: 0.8944113850593567
Norm Quadratic Average: 17.49428939819336
Nearest Class Center Accuracy: 0.3382

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.41951897740364075
Inter Cos: 0.8863509893417358
Norm Quadratic Average: 29.784976959228516
Nearest Class Center Accuracy: 0.3525

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.43592944741249084
Inter Cos: 0.8636042475700378
Norm Quadratic Average: 48.90753173828125
Nearest Class Center Accuracy: 0.3669

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.0933046340942383
Linear Weight Rank: 276
Intra Cos: 0.434837281703949
Inter Cos: 0.8199643492698669
Norm Quadratic Average: 265.33355712890625
Nearest Class Center Accuracy: 0.3856

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.573035955429077
Linear Weight Rank: 2701
Intra Cos: 0.37136322259902954
Inter Cos: 0.7424098253250122
Norm Quadratic Average: 175.03057861328125
Nearest Class Center Accuracy: 0.4122

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 3.896259307861328
Linear Weight Rank: 97
Intra Cos: 0.29145166277885437
Inter Cos: 0.7015120387077332
Norm Quadratic Average: 90.22586059570312
Nearest Class Center Accuracy: 0.4266

Output Layer:
Intra Cos: 0.3198113441467285
Inter Cos: 0.7421194911003113
Norm Quadratic Average: 66.85701751708984
Nearest Class Center Accuracy: 0.4242

