Model save path: ./New_Models/bn_False_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477276891469955
Norm Quadratic Average: 27.597177505493164
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01876853220164776
Inter Cos: 0.08841977268457413
Norm Quadratic Average: 34.36837387084961
Nearest Class Center Accuracy: 0.34554

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02190886065363884
Inter Cos: 0.08901901543140411
Norm Quadratic Average: 36.29093551635742
Nearest Class Center Accuracy: 0.45972

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0277295783162117
Inter Cos: 0.08061958104372025
Norm Quadratic Average: 50.63296127319336
Nearest Class Center Accuracy: 0.53526

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0313633531332016
Inter Cos: 0.07303702086210251
Norm Quadratic Average: 35.63508987426758
Nearest Class Center Accuracy: 0.59206

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03578415513038635
Inter Cos: 0.06800587475299835
Norm Quadratic Average: 32.90084457397461
Nearest Class Center Accuracy: 0.63686

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03709607943892479
Inter Cos: 0.05927238613367081
Norm Quadratic Average: 24.865732192993164
Nearest Class Center Accuracy: 0.67442

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.033496614545583725
Inter Cos: 0.046780772507190704
Norm Quadratic Average: 15.834205627441406
Nearest Class Center Accuracy: 0.70856

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05948217213153839
Inter Cos: 0.07750718295574188
Norm Quadratic Average: 5.842742919921875
Nearest Class Center Accuracy: 0.7923

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.17190706729888916
Inter Cos: 0.1787921041250229
Norm Quadratic Average: 3.524907350540161
Nearest Class Center Accuracy: 0.86626

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.39966171979904175
Inter Cos: 0.3096100687980652
Norm Quadratic Average: 2.4237279891967773
Nearest Class Center Accuracy: 0.93784

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4766131639480591
Inter Cos: 0.31344136595726013
Norm Quadratic Average: 2.2822632789611816
Nearest Class Center Accuracy: 0.96518

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5814223885536194
Inter Cos: 0.34798648953437805
Norm Quadratic Average: 1.615430474281311
Nearest Class Center Accuracy: 0.98618

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7774912714958191
Inter Cos: 0.37674176692962646
Norm Quadratic Average: 1.731128215789795
Nearest Class Center Accuracy: 0.99662

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8282946944236755
Inter Cos: 0.294766902923584
Norm Quadratic Average: 2.289564609527588
Nearest Class Center Accuracy: 0.9993

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8268420696258545
Inter Cos: 0.2791801691055298
Norm Quadratic Average: 2.9492013454437256
Nearest Class Center Accuracy: 0.99972

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 4.852170467376709
Linear Weight Rank: 4029
Intra Cos: 0.8542949557304382
Inter Cos: 0.19629672169685364
Norm Quadratic Average: 18.536991119384766
Nearest Class Center Accuracy: 0.9999

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.4269309043884277
Linear Weight Rank: 3648
Intra Cos: 0.8652031421661377
Inter Cos: 0.2114807367324829
Norm Quadratic Average: 18.532052993774414
Nearest Class Center Accuracy: 0.99998

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.8326690196990967
Linear Weight Rank: 9
Intra Cos: 0.8533219695091248
Inter Cos: 0.22869300842285156
Norm Quadratic Average: 18.282363891601562
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.8355033993721008
Inter Cos: 0.3056497275829315
Norm Quadratic Average: 20.366418838500977
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.8895922941207886
Accuracy: 0.8342
NC1 Within Class Collapse: 5.014622688293457
NC2 Equinorm: Features: 0.17054890096187592, Weights: 0.03186121955513954
NC2 Equiangle: Features: 0.28001976013183594, Weights: 0.16509053972032334
NC3 Self-Duality: 0.1416107565164566
NC4 NCC Mismatch: 0.031000000000000028

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526073545217514
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.55013656616211
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01721145771443844
Inter Cos: 0.08860152959823608
Norm Quadratic Average: 34.33207702636719
Nearest Class Center Accuracy: 0.3635

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02085406519472599
Inter Cos: 0.08980005979537964
Norm Quadratic Average: 36.280277252197266
Nearest Class Center Accuracy: 0.4725

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025936853140592575
Inter Cos: 0.08120294660329819
Norm Quadratic Average: 50.64360046386719
Nearest Class Center Accuracy: 0.5445

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.028891626745462418
Inter Cos: 0.07362227141857147
Norm Quadratic Average: 35.662986755371094
Nearest Class Center Accuracy: 0.5998

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03307853266596794
Inter Cos: 0.06816387921571732
Norm Quadratic Average: 32.93451690673828
Nearest Class Center Accuracy: 0.6344

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03443784639239311
Inter Cos: 0.0590229332447052
Norm Quadratic Average: 24.889291763305664
Nearest Class Center Accuracy: 0.6644

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.030540164560079575
Inter Cos: 0.0463494211435318
Norm Quadratic Average: 15.839597702026367
Nearest Class Center Accuracy: 0.6936

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05147125571966171
Inter Cos: 0.07916858792304993
Norm Quadratic Average: 5.836142063140869
Nearest Class Center Accuracy: 0.7441

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.14338992536067963
Inter Cos: 0.1796543300151825
Norm Quadratic Average: 3.5125463008880615
Nearest Class Center Accuracy: 0.7819

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.31223079562187195
Inter Cos: 0.30892202258110046
Norm Quadratic Average: 2.406917095184326
Nearest Class Center Accuracy: 0.8145

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.35225382447242737
Inter Cos: 0.30141177773475647
Norm Quadratic Average: 2.2584733963012695
Nearest Class Center Accuracy: 0.8221

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4566080570220947
Inter Cos: 0.3506883978843689
Norm Quadratic Average: 1.5905534029006958
Nearest Class Center Accuracy: 0.8234

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5667247176170349
Inter Cos: 0.4201417565345764
Norm Quadratic Average: 1.6889451742172241
Nearest Class Center Accuracy: 0.8244

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.540867269039154
Inter Cos: 0.3790546655654907
Norm Quadratic Average: 2.2225332260131836
Nearest Class Center Accuracy: 0.8273

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5119498372077942
Inter Cos: 0.3393467962741852
Norm Quadratic Average: 2.8548038005828857
Nearest Class Center Accuracy: 0.8289

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 4.852170467376709
Linear Weight Rank: 4029
Intra Cos: 0.5248381495475769
Inter Cos: 0.30044475197792053
Norm Quadratic Average: 17.90555763244629
Nearest Class Center Accuracy: 0.8294

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.4269309043884277
Linear Weight Rank: 3648
Intra Cos: 0.5128201246261597
Inter Cos: 0.2730553150177002
Norm Quadratic Average: 17.882617950439453
Nearest Class Center Accuracy: 0.8304

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.8326690196990967
Linear Weight Rank: 9
Intra Cos: 0.4848328232765198
Inter Cos: 0.25389015674591064
Norm Quadratic Average: 17.668811798095703
Nearest Class Center Accuracy: 0.8305

Output Layer:
Intra Cos: 0.46078765392303467
Inter Cos: 0.28619757294654846
Norm Quadratic Average: 19.67633628845215
Nearest Class Center Accuracy: 0.8309

