Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.03.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477276891469955
Norm Quadratic Average: 27.597177505493164
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010991021059453487
Inter Cos: 0.0676443874835968
Norm Quadratic Average: 2.9803006649017334
Nearest Class Center Accuracy: 0.31202

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0168219693005085
Inter Cos: 0.07779683917760849
Norm Quadratic Average: 2.762295722961426
Nearest Class Center Accuracy: 0.43122

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014102350920438766
Inter Cos: 0.0615081861615181
Norm Quadratic Average: 1.92223060131073
Nearest Class Center Accuracy: 0.53154

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017272066324949265
Inter Cos: 0.0571989007294178
Norm Quadratic Average: 1.1973322629928589
Nearest Class Center Accuracy: 0.6093

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022295759990811348
Inter Cos: 0.05157354846596718
Norm Quadratic Average: 1.0252500772476196
Nearest Class Center Accuracy: 0.6625

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024093978106975555
Inter Cos: 0.05621907114982605
Norm Quadratic Average: 1.0309265851974487
Nearest Class Center Accuracy: 0.69986

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022732356563210487
Inter Cos: 0.03887009248137474
Norm Quadratic Average: 0.8903689384460449
Nearest Class Center Accuracy: 0.75904

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04838312417268753
Inter Cos: 0.06304794549942017
Norm Quadratic Average: 0.46444690227508545
Nearest Class Center Accuracy: 0.88162

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.18828727304935455
Inter Cos: 0.10360302776098251
Norm Quadratic Average: 0.20596536993980408
Nearest Class Center Accuracy: 0.95216

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5966512560844421
Inter Cos: 0.2382623851299286
Norm Quadratic Average: 0.12384273111820221
Nearest Class Center Accuracy: 0.99

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7306613326072693
Inter Cos: 0.055214401334524155
Norm Quadratic Average: 0.1151273176074028
Nearest Class Center Accuracy: 0.99894

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.889336109161377
Inter Cos: 0.12433875352144241
Norm Quadratic Average: 0.1169072613120079
Nearest Class Center Accuracy: 0.99978

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.941774845123291
Inter Cos: 0.14092841744422913
Norm Quadratic Average: 0.1136377826333046
Nearest Class Center Accuracy: 0.9998

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9866750240325928
Inter Cos: 0.22240835428237915
Norm Quadratic Average: 0.23762336373329163
Nearest Class Center Accuracy: 0.9998

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9958465099334717
Inter Cos: 0.2594691514968872
Norm Quadratic Average: 0.7464138865470886
Nearest Class Center Accuracy: 0.9998

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 1.938381552696228
Linear Weight Rank: 9
Intra Cos: 0.9978915452957153
Inter Cos: 0.34101128578186035
Norm Quadratic Average: 22.46259117126465
Nearest Class Center Accuracy: 0.9998

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 1.9414390325546265
Linear Weight Rank: 1398
Intra Cos: 0.9983541369438171
Inter Cos: 0.30935606360435486
Norm Quadratic Average: 15.054521560668945
Nearest Class Center Accuracy: 0.9998

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.9416217803955078
Linear Weight Rank: 8
Intra Cos: 0.9984541535377502
Inter Cos: 0.25584742426872253
Norm Quadratic Average: 10.410249710083008
Nearest Class Center Accuracy: 0.9998

Output Layer:
Intra Cos: 0.9987207651138306
Inter Cos: 0.2309226244688034
Norm Quadratic Average: 7.79973840713501
Nearest Class Center Accuracy: 0.9998

Test Set:
Average Loss: 0.5426876478910446
Accuracy: 0.8608
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.11344408988952637, Weights: 0.011932173743844032
NC2 Equiangle: Features: 0.1952190399169922, Weights: 0.16818489498562283
NC3 Self-Duality: 0.04245609790086746
NC4 NCC Mismatch: 0.008199999999999985

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526073545217514
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.55013656616211
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010432949289679527
Inter Cos: 0.06873314827680588
Norm Quadratic Average: 2.976907968521118
Nearest Class Center Accuracy: 0.3306

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015187372453510761
Inter Cos: 0.07990841567516327
Norm Quadratic Average: 2.7606382369995117
Nearest Class Center Accuracy: 0.4458

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013156909495592117
Inter Cos: 0.06217488273978233
Norm Quadratic Average: 1.9228227138519287
Nearest Class Center Accuracy: 0.5456

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016085175797343254
Inter Cos: 0.058066800236701965
Norm Quadratic Average: 1.198400616645813
Nearest Class Center Accuracy: 0.6178

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020478563383221626
Inter Cos: 0.05209566280245781
Norm Quadratic Average: 1.0262103080749512
Nearest Class Center Accuracy: 0.6607

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021742697805166245
Inter Cos: 0.05691051855683327
Norm Quadratic Average: 1.0307106971740723
Nearest Class Center Accuracy: 0.6878

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01982615515589714
Inter Cos: 0.03985264524817467
Norm Quadratic Average: 0.8895952105522156
Nearest Class Center Accuracy: 0.7324

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.038170743733644485
Inter Cos: 0.0666288435459137
Norm Quadratic Average: 0.46255791187286377
Nearest Class Center Accuracy: 0.8024

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.14515477418899536
Inter Cos: 0.10538759082555771
Norm Quadratic Average: 0.20232051610946655
Nearest Class Center Accuracy: 0.8205

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.42938733100891113
Inter Cos: 0.2979293167591095
Norm Quadratic Average: 0.12029475718736649
Nearest Class Center Accuracy: 0.8312

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4766916334629059
Inter Cos: 0.1941869556903839
Norm Quadratic Average: 0.10941294580698013
Nearest Class Center Accuracy: 0.8554

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4606865644454956
Inter Cos: 0.14339980483055115
Norm Quadratic Average: 0.10988034307956696
Nearest Class Center Accuracy: 0.8555

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5218847393989563
Inter Cos: 0.1570027619600296
Norm Quadratic Average: 0.10724392533302307
Nearest Class Center Accuracy: 0.8589

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5389736294746399
Inter Cos: 0.16441133618354797
Norm Quadratic Average: 0.22329473495483398
Nearest Class Center Accuracy: 0.8609

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5410877466201782
Inter Cos: 0.1871548593044281
Norm Quadratic Average: 0.7004876136779785
Nearest Class Center Accuracy: 0.861

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 1.938381552696228
Linear Weight Rank: 9
Intra Cos: 0.5777623057365417
Inter Cos: 0.3151175379753113
Norm Quadratic Average: 21.016714096069336
Nearest Class Center Accuracy: 0.8615

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 1.9414390325546265
Linear Weight Rank: 1398
Intra Cos: 0.5779668092727661
Inter Cos: 0.3107278347015381
Norm Quadratic Average: 14.099894523620605
Nearest Class Center Accuracy: 0.8621

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.9416217803955078
Linear Weight Rank: 8
Intra Cos: 0.5786530375480652
Inter Cos: 0.30149346590042114
Norm Quadratic Average: 9.766600608825684
Nearest Class Center Accuracy: 0.8623

Output Layer:
Intra Cos: 0.586107611656189
Inter Cos: 0.29495787620544434
Norm Quadratic Average: 7.337282180786133
Nearest Class Center Accuracy: 0.8613

