Model save path: ./New_Models/bn_False_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477276891469955
Norm Quadratic Average: 27.597177505493164
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019577842205762863
Inter Cos: 0.08596452325582504
Norm Quadratic Average: 32.08730697631836
Nearest Class Center Accuracy: 0.33098

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025512322783470154
Inter Cos: 0.0995514765381813
Norm Quadratic Average: 28.119619369506836
Nearest Class Center Accuracy: 0.42776

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.031228624284267426
Inter Cos: 0.08677053451538086
Norm Quadratic Average: 28.653242111206055
Nearest Class Center Accuracy: 0.51628

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022391371428966522
Inter Cos: 0.061240773648023605
Norm Quadratic Average: 11.280302047729492
Nearest Class Center Accuracy: 0.60348

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02722696028649807
Inter Cos: 0.05292398855090141
Norm Quadratic Average: 3.7177839279174805
Nearest Class Center Accuracy: 0.6573

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08888211846351624
Inter Cos: 0.14301124215126038
Norm Quadratic Average: 0.7838684916496277
Nearest Class Center Accuracy: 0.79398

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.48576873540878296
Inter Cos: 0.4751928746700287
Norm Quadratic Average: 0.45131075382232666
Nearest Class Center Accuracy: 0.88424

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6312379837036133
Inter Cos: 0.6576324701309204
Norm Quadratic Average: 0.4317091405391693
Nearest Class Center Accuracy: 0.86838

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6941037774085999
Inter Cos: 0.6972162127494812
Norm Quadratic Average: 0.44155120849609375
Nearest Class Center Accuracy: 0.91238

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7765818238258362
Inter Cos: 0.6162773370742798
Norm Quadratic Average: 0.6066575646400452
Nearest Class Center Accuracy: 0.95564

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8263779282569885
Inter Cos: 0.6171776056289673
Norm Quadratic Average: 1.1570558547973633
Nearest Class Center Accuracy: 0.96826

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8823570609092712
Inter Cos: 0.7183406949043274
Norm Quadratic Average: 1.711600422859192
Nearest Class Center Accuracy: 0.98046

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9111744165420532
Inter Cos: 0.7346668243408203
Norm Quadratic Average: 2.700009822845459
Nearest Class Center Accuracy: 0.9827

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9122357964515686
Inter Cos: 0.7130919694900513
Norm Quadratic Average: 4.348577499389648
Nearest Class Center Accuracy: 0.98368

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9108598232269287
Inter Cos: 0.6611754298210144
Norm Quadratic Average: 6.862430095672607
Nearest Class Center Accuracy: 0.9874

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 1.9935835599899292
Linear Weight Rank: 93
Intra Cos: 0.8945035934448242
Inter Cos: 0.5190654397010803
Norm Quadratic Average: 40.51921081542969
Nearest Class Center Accuracy: 0.99026

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.0302207469940186
Linear Weight Rank: 2741
Intra Cos: 0.9159459471702576
Inter Cos: 0.46648356318473816
Norm Quadratic Average: 33.27676773071289
Nearest Class Center Accuracy: 0.99572

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.9993975162506104
Linear Weight Rank: 9
Intra Cos: 0.9195067882537842
Inter Cos: 0.42195892333984375
Norm Quadratic Average: 23.67917251586914
Nearest Class Center Accuracy: 0.99846

Output Layer:
Intra Cos: 0.9404295086860657
Inter Cos: 0.48707467317581177
Norm Quadratic Average: 18.513296127319336
Nearest Class Center Accuracy: 0.99976

Test Set:
Average Loss: 0.7470751546382904
Accuracy: 0.8301
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.23713569343090057, Weights: 0.07933186739683151
NC2 Equiangle: Features: 0.3672782897949219, Weights: 0.16474891238742403
NC3 Self-Duality: 0.289588063955307
NC4 NCC Mismatch: 0.043300000000000005

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526073545217514
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.55013656616211
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016809578984975815
Inter Cos: 0.08630477637052536
Norm Quadratic Average: 32.05488586425781
Nearest Class Center Accuracy: 0.3485

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02390696108341217
Inter Cos: 0.09994553029537201
Norm Quadratic Average: 28.116540908813477
Nearest Class Center Accuracy: 0.4415

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.029529407620429993
Inter Cos: 0.08678101003170013
Norm Quadratic Average: 28.67367172241211
Nearest Class Center Accuracy: 0.5245

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020685790106654167
Inter Cos: 0.06160551682114601
Norm Quadratic Average: 11.295740127563477
Nearest Class Center Accuracy: 0.6057

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025021133944392204
Inter Cos: 0.0524885430932045
Norm Quadratic Average: 3.723571538925171
Nearest Class Center Accuracy: 0.6532

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08328131586313248
Inter Cos: 0.14585687220096588
Norm Quadratic Average: 0.7831514477729797
Nearest Class Center Accuracy: 0.7502

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.44188588857650757
Inter Cos: 0.4683707356452942
Norm Quadratic Average: 0.4492437243461609
Nearest Class Center Accuracy: 0.8059

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5608996748924255
Inter Cos: 0.6268141269683838
Norm Quadratic Average: 0.42911699414253235
Nearest Class Center Accuracy: 0.7845

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5998839735984802
Inter Cos: 0.6684252619743347
Norm Quadratic Average: 0.43761828541755676
Nearest Class Center Accuracy: 0.7923

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.614766538143158
Inter Cos: 0.5844906568527222
Norm Quadratic Average: 0.5965938568115234
Nearest Class Center Accuracy: 0.8069

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6479920148849487
Inter Cos: 0.5771599411964417
Norm Quadratic Average: 1.134985089302063
Nearest Class Center Accuracy: 0.8088

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7004289627075195
Inter Cos: 0.6291115283966064
Norm Quadratic Average: 1.6767512559890747
Nearest Class Center Accuracy: 0.8081

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7183091640472412
Inter Cos: 0.6346499919891357
Norm Quadratic Average: 2.6390585899353027
Nearest Class Center Accuracy: 0.8104

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7119225859642029
Inter Cos: 0.6117396950721741
Norm Quadratic Average: 4.244257926940918
Nearest Class Center Accuracy: 0.8122

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.683824896812439
Inter Cos: 0.5759423971176147
Norm Quadratic Average: 6.687854766845703
Nearest Class Center Accuracy: 0.8131

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 1.9935835599899292
Linear Weight Rank: 93
Intra Cos: 0.6844705939292908
Inter Cos: 0.5049468278884888
Norm Quadratic Average: 39.51510238647461
Nearest Class Center Accuracy: 0.8148

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.0302207469940186
Linear Weight Rank: 2741
Intra Cos: 0.6529648303985596
Inter Cos: 0.4537636935710907
Norm Quadratic Average: 32.38318634033203
Nearest Class Center Accuracy: 0.8209

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.9993975162506104
Linear Weight Rank: 9
Intra Cos: 0.6167750954627991
Inter Cos: 0.4138752222061157
Norm Quadratic Average: 23.027395248413086
Nearest Class Center Accuracy: 0.8236

Output Layer:
Intra Cos: 0.5994871258735657
Inter Cos: 0.4324958920478821
Norm Quadratic Average: 17.914396286010742
Nearest Class Center Accuracy: 0.8267

