Model save path: ./New_Models/bn_False_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.01.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477276891469955
Norm Quadratic Average: 27.597177505493164
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018671026453375816
Inter Cos: 0.08169594407081604
Norm Quadratic Average: 28.838329315185547
Nearest Class Center Accuracy: 0.3358

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023338142782449722
Inter Cos: 0.09316453337669373
Norm Quadratic Average: 24.059711456298828
Nearest Class Center Accuracy: 0.43708

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03610275685787201
Inter Cos: 0.09555785357952118
Norm Quadratic Average: 21.910242080688477
Nearest Class Center Accuracy: 0.5216

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026183491572737694
Inter Cos: 0.07038303464651108
Norm Quadratic Average: 7.521804332733154
Nearest Class Center Accuracy: 0.60094

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04191049188375473
Inter Cos: 0.07312165945768356
Norm Quadratic Average: 2.361865520477295
Nearest Class Center Accuracy: 0.6732

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.18673650920391083
Inter Cos: 0.21175670623779297
Norm Quadratic Average: 0.5144494771957397
Nearest Class Center Accuracy: 0.8199

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.516728401184082
Inter Cos: 0.5800924897193909
Norm Quadratic Average: 0.29144254326820374
Nearest Class Center Accuracy: 0.85258

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6478493809700012
Inter Cos: 0.9177574515342712
Norm Quadratic Average: 0.26456418633461
Nearest Class Center Accuracy: 0.82574

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8366645574569702
Inter Cos: 0.9598190188407898
Norm Quadratic Average: 0.375962495803833
Nearest Class Center Accuracy: 0.91734

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8872753381729126
Inter Cos: 0.9721046090126038
Norm Quadratic Average: 0.7764347195625305
Nearest Class Center Accuracy: 0.9403

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8958107233047485
Inter Cos: 0.9711990356445312
Norm Quadratic Average: 1.4430516958236694
Nearest Class Center Accuracy: 0.96442

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.933428168296814
Inter Cos: 0.9846342206001282
Norm Quadratic Average: 2.4592936038970947
Nearest Class Center Accuracy: 0.9635

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9380667209625244
Inter Cos: 0.985337495803833
Norm Quadratic Average: 4.192582130432129
Nearest Class Center Accuracy: 0.96278

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9377034902572632
Inter Cos: 0.9853772521018982
Norm Quadratic Average: 7.205809116363525
Nearest Class Center Accuracy: 0.96268

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9323296546936035
Inter Cos: 0.9839426875114441
Norm Quadratic Average: 12.20256519317627
Nearest Class Center Accuracy: 0.96318

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 1.9283298254013062
Linear Weight Rank: 10
Intra Cos: 0.9113895297050476
Inter Cos: 0.9401744604110718
Norm Quadratic Average: 66.5566177368164
Nearest Class Center Accuracy: 0.96832

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 1.955475091934204
Linear Weight Rank: 2460
Intra Cos: 0.905406653881073
Inter Cos: 0.8449324369430542
Norm Quadratic Average: 47.18806838989258
Nearest Class Center Accuracy: 0.97752

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.9325370788574219
Linear Weight Rank: 9
Intra Cos: 0.9074772000312805
Inter Cos: 0.7040295600891113
Norm Quadratic Average: 26.939773559570312
Nearest Class Center Accuracy: 0.98516

Output Layer:
Intra Cos: 0.9367765188217163
Inter Cos: 0.6446413397789001
Norm Quadratic Average: 16.609424591064453
Nearest Class Center Accuracy: 0.99048

Test Set:
Average Loss: 0.9759350221633911
Accuracy: 0.7907
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.34452933073043823, Weights: 0.19775104522705078
NC2 Equiangle: Features: 0.4396731906467014, Weights: 0.1905503378974067
NC3 Self-Duality: 0.7179601788520813
NC4 NCC Mismatch: 0.062000000000000055

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526073545217514
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.55013656616211
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01632683351635933
Inter Cos: 0.08205077052116394
Norm Quadratic Average: 28.818315505981445
Nearest Class Center Accuracy: 0.3523

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022662051022052765
Inter Cos: 0.09396792948246002
Norm Quadratic Average: 24.05854034423828
Nearest Class Center Accuracy: 0.4493

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03413383662700653
Inter Cos: 0.09554662555456161
Norm Quadratic Average: 21.930112838745117
Nearest Class Center Accuracy: 0.5284

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024555426090955734
Inter Cos: 0.07065945863723755
Norm Quadratic Average: 7.528881549835205
Nearest Class Center Accuracy: 0.6052

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03956122696399689
Inter Cos: 0.07291965186595917
Norm Quadratic Average: 2.362274646759033
Nearest Class Center Accuracy: 0.6629

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1741674840450287
Inter Cos: 0.21371674537658691
Norm Quadratic Average: 0.5134268999099731
Nearest Class Center Accuracy: 0.7613

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4266359210014343
Inter Cos: 0.5489054322242737
Norm Quadratic Average: 0.2895152270793915
Nearest Class Center Accuracy: 0.7629

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5169439315795898
Inter Cos: 0.8946802616119385
Norm Quadratic Average: 0.2611033022403717
Nearest Class Center Accuracy: 0.696

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5973792672157288
Inter Cos: 0.8907436728477478
Norm Quadratic Average: 0.3693772554397583
Nearest Class Center Accuracy: 0.7456

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6369782090187073
Inter Cos: 0.8984089493751526
Norm Quadratic Average: 0.7613840103149414
Nearest Class Center Accuracy: 0.7574

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6741889715194702
Inter Cos: 0.8901929259300232
Norm Quadratic Average: 1.4116953611373901
Nearest Class Center Accuracy: 0.7744

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6826158761978149
Inter Cos: 0.9020504355430603
Norm Quadratic Average: 2.40407133102417
Nearest Class Center Accuracy: 0.7721

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6744669675827026
Inter Cos: 0.9070700407028198
Norm Quadratic Average: 4.101524829864502
Nearest Class Center Accuracy: 0.7691

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6729298830032349
Inter Cos: 0.9077415466308594
Norm Quadratic Average: 7.049510478973389
Nearest Class Center Accuracy: 0.7688

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6711305975914001
Inter Cos: 0.9027365446090698
Norm Quadratic Average: 11.93735122680664
Nearest Class Center Accuracy: 0.769

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 1.9283298254013062
Linear Weight Rank: 10
Intra Cos: 0.6324529647827148
Inter Cos: 0.8643443584442139
Norm Quadratic Average: 65.2872314453125
Nearest Class Center Accuracy: 0.7739

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 1.955475091934204
Linear Weight Rank: 2460
Intra Cos: 0.639432430267334
Inter Cos: 0.7413482666015625
Norm Quadratic Average: 46.09854507446289
Nearest Class Center Accuracy: 0.7794

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.9325370788574219
Linear Weight Rank: 9
Intra Cos: 0.6586233377456665
Inter Cos: 0.6329245567321777
Norm Quadratic Average: 26.244632720947266
Nearest Class Center Accuracy: 0.7836

Output Layer:
Intra Cos: 0.6892425417900085
Inter Cos: 0.5879243612289429
Norm Quadratic Average: 16.162841796875
Nearest Class Center Accuracy: 0.7857

