Model save path: ./New_Models/bn_False_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.0005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477276891469955
Norm Quadratic Average: 27.597177505493164
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01847747527062893
Inter Cos: 0.08079735934734344
Norm Quadratic Average: 39.04561233520508
Nearest Class Center Accuracy: 0.3493

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018358765169978142
Inter Cos: 0.07539559155702591
Norm Quadratic Average: 43.04743194580078
Nearest Class Center Accuracy: 0.4773

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023278119042515755
Inter Cos: 0.06256420910358429
Norm Quadratic Average: 56.51504898071289
Nearest Class Center Accuracy: 0.56578

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02607605792582035
Inter Cos: 0.05766237899661064
Norm Quadratic Average: 37.16305923461914
Nearest Class Center Accuracy: 0.62156

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.028851376846432686
Inter Cos: 0.05091949552297592
Norm Quadratic Average: 32.171142578125
Nearest Class Center Accuracy: 0.66196

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03303951025009155
Inter Cos: 0.04407624900341034
Norm Quadratic Average: 23.330801010131836
Nearest Class Center Accuracy: 0.704

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03768076002597809
Inter Cos: 0.04669085890054703
Norm Quadratic Average: 16.15335464477539
Nearest Class Center Accuracy: 0.73648

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06443937122821808
Inter Cos: 0.07366164773702621
Norm Quadratic Average: 6.563933372497559
Nearest Class Center Accuracy: 0.81396

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.15135690569877625
Inter Cos: 0.10940178483724594
Norm Quadratic Average: 3.9960739612579346
Nearest Class Center Accuracy: 0.87302

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.32885822653770447
Inter Cos: 0.21815583109855652
Norm Quadratic Average: 2.8174314498901367
Nearest Class Center Accuracy: 0.93616

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.45178014039993286
Inter Cos: 0.24308308959007263
Norm Quadratic Average: 2.4357082843780518
Nearest Class Center Accuracy: 0.97406

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6309090256690979
Inter Cos: 0.264777809381485
Norm Quadratic Average: 1.6843132972717285
Nearest Class Center Accuracy: 0.99382

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8191820383071899
Inter Cos: 0.25083059072494507
Norm Quadratic Average: 1.7018071413040161
Nearest Class Center Accuracy: 0.9988

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8607930541038513
Inter Cos: 0.2641962170600891
Norm Quadratic Average: 1.9899877309799194
Nearest Class Center Accuracy: 0.99984

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8807618618011475
Inter Cos: 0.2714387774467468
Norm Quadratic Average: 2.2849371433258057
Nearest Class Center Accuracy: 0.99998

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 20.317707061767578
Linear Weight Rank: 4031
Intra Cos: 0.9104466438293457
Inter Cos: 0.25447916984558105
Norm Quadratic Average: 15.401028633117676
Nearest Class Center Accuracy: 1.0

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 8.804516792297363
Linear Weight Rank: 3667
Intra Cos: 0.9197369813919067
Inter Cos: 0.24510636925697327
Norm Quadratic Average: 15.476667404174805
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 3.1551036834716797
Linear Weight Rank: 10
Intra Cos: 0.914278507232666
Inter Cos: 0.23470719158649445
Norm Quadratic Average: 15.909567832946777
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9176883697509766
Inter Cos: 0.3487326204776764
Norm Quadratic Average: 18.752897262573242
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.8204015520095825
Accuracy: 0.8401
NC1 Within Class Collapse: 4.2106781005859375
NC2 Equinorm: Features: 0.19589518010616302, Weights: 0.024416692554950714
NC2 Equiangle: Features: 0.2581787533230252, Weights: 0.14825026194254556
NC3 Self-Duality: 0.16963525116443634
NC4 NCC Mismatch: 0.034599999999999964

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526073545217514
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.55013656616211
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01632210984826088
Inter Cos: 0.0808425024151802
Norm Quadratic Average: 39.01142120361328
Nearest Class Center Accuracy: 0.3663

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017201539129018784
Inter Cos: 0.0762467160820961
Norm Quadratic Average: 43.02744674682617
Nearest Class Center Accuracy: 0.494

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021713482216000557
Inter Cos: 0.0626770555973053
Norm Quadratic Average: 56.507808685302734
Nearest Class Center Accuracy: 0.5744

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023925384506583214
Inter Cos: 0.05785445496439934
Norm Quadratic Average: 37.1733283996582
Nearest Class Center Accuracy: 0.6236

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02630886249244213
Inter Cos: 0.05085379630327225
Norm Quadratic Average: 32.20615768432617
Nearest Class Center Accuracy: 0.6578

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.029863469302654266
Inter Cos: 0.04578164592385292
Norm Quadratic Average: 23.34803581237793
Nearest Class Center Accuracy: 0.6875

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03354103863239288
Inter Cos: 0.047939080744981766
Norm Quadratic Average: 16.149883270263672
Nearest Class Center Accuracy: 0.7088

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0545857734978199
Inter Cos: 0.0750180333852768
Norm Quadratic Average: 6.547743797302246
Nearest Class Center Accuracy: 0.7535

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.12607070803642273
Inter Cos: 0.1137329488992691
Norm Quadratic Average: 3.9713563919067383
Nearest Class Center Accuracy: 0.7762

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2608339488506317
Inter Cos: 0.21593894064426422
Norm Quadratic Average: 2.788775682449341
Nearest Class Center Accuracy: 0.803

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3201456665992737
Inter Cos: 0.2513527274131775
Norm Quadratic Average: 2.3967766761779785
Nearest Class Center Accuracy: 0.8242

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.41933685541152954
Inter Cos: 0.301540732383728
Norm Quadratic Average: 1.6419436931610107
Nearest Class Center Accuracy: 0.8311

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5193524956703186
Inter Cos: 0.3528372049331665
Norm Quadratic Average: 1.6370468139648438
Nearest Class Center Accuracy: 0.8333

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5205841064453125
Inter Cos: 0.3294162452220917
Norm Quadratic Average: 1.9030659198760986
Nearest Class Center Accuracy: 0.835

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5162213444709778
Inter Cos: 0.3033704161643982
Norm Quadratic Average: 2.1780896186828613
Nearest Class Center Accuracy: 0.8367

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 20.317707061767578
Linear Weight Rank: 4031
Intra Cos: 0.536007821559906
Inter Cos: 0.2711866497993469
Norm Quadratic Average: 14.634103775024414
Nearest Class Center Accuracy: 0.8367

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 8.804516792297363
Linear Weight Rank: 3667
Intra Cos: 0.5315001606941223
Inter Cos: 0.24921934306621552
Norm Quadratic Average: 14.717438697814941
Nearest Class Center Accuracy: 0.8361

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 3.1551036834716797
Linear Weight Rank: 10
Intra Cos: 0.5180644989013672
Inter Cos: 0.25346216559410095
Norm Quadratic Average: 15.19766616821289
Nearest Class Center Accuracy: 0.8387

Output Layer:
Intra Cos: 0.5215163826942444
Inter Cos: 0.3393252193927765
Norm Quadratic Average: 17.93620491027832
Nearest Class Center Accuracy: 0.8389

