Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.03.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597183227539062
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013165918178856373
Inter Cos: 0.09094448387622833
Norm Quadratic Average: 2.9674174785614014
Nearest Class Center Accuracy: 0.31906

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0181954987347126
Inter Cos: 0.08207753300666809
Norm Quadratic Average: 2.6825222969055176
Nearest Class Center Accuracy: 0.43616

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01273975521326065
Inter Cos: 0.06141410022974014
Norm Quadratic Average: 1.8805791139602661
Nearest Class Center Accuracy: 0.53306

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016027040779590607
Inter Cos: 0.05784988775849342
Norm Quadratic Average: 1.172384262084961
Nearest Class Center Accuracy: 0.60946

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02304135076701641
Inter Cos: 0.056454069912433624
Norm Quadratic Average: 1.0188534259796143
Nearest Class Center Accuracy: 0.66606

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025020048022270203
Inter Cos: 0.05178036168217659
Norm Quadratic Average: 0.9971752166748047
Nearest Class Center Accuracy: 0.70996

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024374235421419144
Inter Cos: 0.040809761732816696
Norm Quadratic Average: 0.8867617845535278
Nearest Class Center Accuracy: 0.76938

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05006654933094978
Inter Cos: 0.06269650906324387
Norm Quadratic Average: 0.4550061523914337
Nearest Class Center Accuracy: 0.88886

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.19768455624580383
Inter Cos: 0.11969524621963501
Norm Quadratic Average: 0.18880422413349152
Nearest Class Center Accuracy: 0.952

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.641545832157135
Inter Cos: 0.2356293946504593
Norm Quadratic Average: 0.1229516938328743
Nearest Class Center Accuracy: 0.98732

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7285078763961792
Inter Cos: 0.13904216885566711
Norm Quadratic Average: 0.11249931156635284
Nearest Class Center Accuracy: 0.99936

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.884244978427887
Inter Cos: 0.2737855315208435
Norm Quadratic Average: 0.11309728771448135
Nearest Class Center Accuracy: 0.99968

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9340760111808777
Inter Cos: 0.2674104571342468
Norm Quadratic Average: 0.10847368091344833
Nearest Class Center Accuracy: 0.99986

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9846832156181335
Inter Cos: 0.2295452058315277
Norm Quadratic Average: 0.2056868076324463
Nearest Class Center Accuracy: 0.99988

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9942647814750671
Inter Cos: 0.2604798674583435
Norm Quadratic Average: 0.7335672378540039
Nearest Class Center Accuracy: 0.99988

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 1.9401487112045288
Linear Weight Rank: 9
Intra Cos: 0.9969561100006104
Inter Cos: 0.33863604068756104
Norm Quadratic Average: 22.412302017211914
Nearest Class Center Accuracy: 0.99988

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 1.9431861639022827
Linear Weight Rank: 1397
Intra Cos: 0.99741131067276
Inter Cos: 0.29739734530448914
Norm Quadratic Average: 15.04498291015625
Nearest Class Center Accuracy: 0.99988

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.9433666467666626
Linear Weight Rank: 8
Intra Cos: 0.9974491000175476
Inter Cos: 0.24163372814655304
Norm Quadratic Average: 10.413556098937988
Nearest Class Center Accuracy: 0.99988

Output Layer:
Intra Cos: 0.9976882934570312
Inter Cos: 0.20878063142299652
Norm Quadratic Average: 7.833005905151367
Nearest Class Center Accuracy: 0.99988

Test Set:
Average Loss: 0.5414067420005798
Accuracy: 0.8565
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.10175091028213501, Weights: 0.013711044564843178
NC2 Equiangle: Features: 0.1970807393391927, Weights: 0.17003339131673176
NC3 Self-Duality: 0.039090219885110855
NC4 NCC Mismatch: 0.005299999999999971

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526075407862663
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550134658813477
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01380219403654337
Inter Cos: 0.09223467856645584
Norm Quadratic Average: 2.964500665664673
Nearest Class Center Accuracy: 0.3364

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016657153144478798
Inter Cos: 0.08372259140014648
Norm Quadratic Average: 2.6809890270233154
Nearest Class Center Accuracy: 0.4506

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011831315234303474
Inter Cos: 0.062102578580379486
Norm Quadratic Average: 1.881569743156433
Nearest Class Center Accuracy: 0.5489

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014984252862632275
Inter Cos: 0.05868581682443619
Norm Quadratic Average: 1.1736764907836914
Nearest Class Center Accuracy: 0.618

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021152736619114876
Inter Cos: 0.05701757222414017
Norm Quadratic Average: 1.0204079151153564
Nearest Class Center Accuracy: 0.6584

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022323405370116234
Inter Cos: 0.051905710250139236
Norm Quadratic Average: 0.9971857070922852
Nearest Class Center Accuracy: 0.6996

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02096296288073063
Inter Cos: 0.041075415909290314
Norm Quadratic Average: 0.8851636052131653
Nearest Class Center Accuracy: 0.7373

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03889550641179085
Inter Cos: 0.06536728143692017
Norm Quadratic Average: 0.452469140291214
Nearest Class Center Accuracy: 0.8028

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1533839851617813
Inter Cos: 0.12589235603809357
Norm Quadratic Average: 0.18500883877277374
Nearest Class Center Accuracy: 0.8221

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4719714820384979
Inter Cos: 0.2976686358451843
Norm Quadratic Average: 0.11916443705558777
Nearest Class Center Accuracy: 0.8299

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5251799821853638
Inter Cos: 0.2284855842590332
Norm Quadratic Average: 0.10753485560417175
Nearest Class Center Accuracy: 0.8485

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5701596140861511
Inter Cos: 0.2080509215593338
Norm Quadratic Average: 0.10719740390777588
Nearest Class Center Accuracy: 0.8394

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5735819339752197
Inter Cos: 0.1319904774427414
Norm Quadratic Average: 0.10252588987350464
Nearest Class Center Accuracy: 0.8546

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5856243968009949
Inter Cos: 0.17798404395580292
Norm Quadratic Average: 0.19345726072788239
Nearest Class Center Accuracy: 0.8571

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5839146971702576
Inter Cos: 0.22983622550964355
Norm Quadratic Average: 0.6898590326309204
Nearest Class Center Accuracy: 0.856

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 1.9401487112045288
Linear Weight Rank: 9
Intra Cos: 0.6092709898948669
Inter Cos: 0.3369356393814087
Norm Quadratic Average: 21.038925170898438
Nearest Class Center Accuracy: 0.8566

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 1.9431861639022827
Linear Weight Rank: 1397
Intra Cos: 0.6087396740913391
Inter Cos: 0.33029991388320923
Norm Quadratic Average: 14.131453514099121
Nearest Class Center Accuracy: 0.8565

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 1.9433666467666626
Linear Weight Rank: 8
Intra Cos: 0.6078948974609375
Inter Cos: 0.3209170699119568
Norm Quadratic Average: 9.790718078613281
Nearest Class Center Accuracy: 0.857

Output Layer:
Intra Cos: 0.6140820980072021
Inter Cos: 0.31071633100509644
Norm Quadratic Average: 7.383967399597168
Nearest Class Center Accuracy: 0.8571

