Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597183227539062
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013430275022983551
Inter Cos: 0.06608802825212479
Norm Quadratic Average: 8.779189109802246
Nearest Class Center Accuracy: 0.33932

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01773132011294365
Inter Cos: 0.06397181749343872
Norm Quadratic Average: 6.31524133682251
Nearest Class Center Accuracy: 0.4807

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014416243880987167
Inter Cos: 0.0567554272711277
Norm Quadratic Average: 4.685484886169434
Nearest Class Center Accuracy: 0.54758

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016035672277212143
Inter Cos: 0.052514221519231796
Norm Quadratic Average: 3.2751996517181396
Nearest Class Center Accuracy: 0.62434

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01773863099515438
Inter Cos: 0.039717674255371094
Norm Quadratic Average: 2.4531638622283936
Nearest Class Center Accuracy: 0.68082

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020061975345015526
Inter Cos: 0.03824619576334953
Norm Quadratic Average: 2.1630654335021973
Nearest Class Center Accuracy: 0.72772

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02019740268588066
Inter Cos: 0.035140007734298706
Norm Quadratic Average: 2.045016288757324
Nearest Class Center Accuracy: 0.78778

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04448983818292618
Inter Cos: 0.047025881707668304
Norm Quadratic Average: 1.5341486930847168
Nearest Class Center Accuracy: 0.89974

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09876308590173721
Inter Cos: 0.06738968938589096
Norm Quadratic Average: 0.9799247980117798
Nearest Class Center Accuracy: 0.95346

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.27851617336273193
Inter Cos: 0.11680371314287186
Norm Quadratic Average: 0.7493209838867188
Nearest Class Center Accuracy: 0.9726

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.49354442954063416
Inter Cos: 0.09670725464820862
Norm Quadratic Average: 0.5148630738258362
Nearest Class Center Accuracy: 0.99914

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7401542067527771
Inter Cos: 0.06618344038724899
Norm Quadratic Average: 0.3648190200328827
Nearest Class Center Accuracy: 0.99998

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9356617331504822
Inter Cos: -0.03107587806880474
Norm Quadratic Average: 0.31584569811820984
Nearest Class Center Accuracy: 1.0

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9813653230667114
Inter Cos: -0.05160467326641083
Norm Quadratic Average: 0.4525204002857208
Nearest Class Center Accuracy: 1.0

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9940051436424255
Inter Cos: -0.07217724621295929
Norm Quadratic Average: 0.9068167805671692
Nearest Class Center Accuracy: 1.0

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.2337310314178467
Linear Weight Rank: 2963
Intra Cos: 0.9985270500183105
Inter Cos: -0.052717920392751694
Norm Quadratic Average: 24.704364776611328
Nearest Class Center Accuracy: 1.0

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.2998974323272705
Linear Weight Rank: 995
Intra Cos: 0.9989309906959534
Inter Cos: -0.013633141294121742
Norm Quadratic Average: 16.91155433654785
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.2528977394104004
Linear Weight Rank: 9
Intra Cos: 0.9989703893661499
Inter Cos: 0.061693742871284485
Norm Quadratic Average: 11.998604774475098
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9992798566818237
Inter Cos: 0.10643855482339859
Norm Quadratic Average: 8.972447395324707
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.4714362542033195
Accuracy: 0.8887
NC1 Within Class Collapse: 2.154507637023926
NC2 Equinorm: Features: 0.10191278904676437, Weights: 0.009056398645043373
NC2 Equiangle: Features: 0.09995640648735894, Weights: 0.02476523717244466
NC3 Self-Duality: 0.048042722046375275
NC4 NCC Mismatch: 0.007000000000000006

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526075407862663
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550134658813477
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011572498828172684
Inter Cos: 0.06699281930923462
Norm Quadratic Average: 8.77107048034668
Nearest Class Center Accuracy: 0.3582

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01639006845653057
Inter Cos: 0.06519635766744614
Norm Quadratic Average: 6.311882495880127
Nearest Class Center Accuracy: 0.498

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013609413057565689
Inter Cos: 0.05739414691925049
Norm Quadratic Average: 4.685123920440674
Nearest Class Center Accuracy: 0.5624

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015218646265566349
Inter Cos: 0.05353308841586113
Norm Quadratic Average: 3.276505947113037
Nearest Class Center Accuracy: 0.6323

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016476212069392204
Inter Cos: 0.040733616799116135
Norm Quadratic Average: 2.454899787902832
Nearest Class Center Accuracy: 0.6771

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018163736909627914
Inter Cos: 0.039331741631031036
Norm Quadratic Average: 2.161977529525757
Nearest Class Center Accuracy: 0.7084

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017381565645337105
Inter Cos: 0.036215510219335556
Norm Quadratic Average: 2.0397655963897705
Nearest Class Center Accuracy: 0.7476

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03360186144709587
Inter Cos: 0.04913671314716339
Norm Quadratic Average: 1.5242748260498047
Nearest Class Center Accuracy: 0.8171

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08080749958753586
Inter Cos: 0.07352153211832047
Norm Quadratic Average: 0.9608805775642395
Nearest Class Center Accuracy: 0.8387

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.22387757897377014
Inter Cos: 0.14903301000595093
Norm Quadratic Average: 0.7201312184333801
Nearest Class Center Accuracy: 0.8356

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.36584144830703735
Inter Cos: 0.1693853884935379
Norm Quadratic Average: 0.4899432063102722
Nearest Class Center Accuracy: 0.8709

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5079816579818726
Inter Cos: 0.19891808927059174
Norm Quadratic Average: 0.34261807799339294
Nearest Class Center Accuracy: 0.8856

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.595593273639679
Inter Cos: 0.1097593680024147
Norm Quadratic Average: 0.2926568388938904
Nearest Class Center Accuracy: 0.8878

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6101468205451965
Inter Cos: 0.08204235136508942
Norm Quadratic Average: 0.41851887106895447
Nearest Class Center Accuracy: 0.8891

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6229924559593201
Inter Cos: 0.10018986463546753
Norm Quadratic Average: 0.8413408398628235
Nearest Class Center Accuracy: 0.8893

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.2337310314178467
Linear Weight Rank: 2963
Intra Cos: 0.6464575529098511
Inter Cos: 0.15969642996788025
Norm Quadratic Average: 22.85333251953125
Nearest Class Center Accuracy: 0.8893

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.2998974323272705
Linear Weight Rank: 995
Intra Cos: 0.6498955488204956
Inter Cos: 0.16960430145263672
Norm Quadratic Average: 15.660993576049805
Nearest Class Center Accuracy: 0.8892

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.2528977394104004
Linear Weight Rank: 9
Intra Cos: 0.6574504971504211
Inter Cos: 0.1976538747549057
Norm Quadratic Average: 11.142874717712402
Nearest Class Center Accuracy: 0.8893

Output Layer:
Intra Cos: 0.6633605360984802
Inter Cos: 0.21860148012638092
Norm Quadratic Average: 8.34339427947998
Nearest Class Center Accuracy: 0.8893

