Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597183227539062
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012051567435264587
Inter Cos: 0.056625016033649445
Norm Quadratic Average: 21.001264572143555
Nearest Class Center Accuracy: 0.34376

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017047790810465813
Inter Cos: 0.0676213800907135
Norm Quadratic Average: 14.490797996520996
Nearest Class Center Accuracy: 0.47482

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01443454623222351
Inter Cos: 0.0555511936545372
Norm Quadratic Average: 11.172430038452148
Nearest Class Center Accuracy: 0.53654

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016923703253269196
Inter Cos: 0.04936886206269264
Norm Quadratic Average: 7.7505388259887695
Nearest Class Center Accuracy: 0.62038

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017938371747732162
Inter Cos: 0.03978065028786659
Norm Quadratic Average: 6.022151947021484
Nearest Class Center Accuracy: 0.67066

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018401669338345528
Inter Cos: 0.03439986705780029
Norm Quadratic Average: 5.834280490875244
Nearest Class Center Accuracy: 0.71816

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019643744453787804
Inter Cos: 0.029696522280573845
Norm Quadratic Average: 5.830820083618164
Nearest Class Center Accuracy: 0.76948

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04210355132818222
Inter Cos: 0.04152805730700493
Norm Quadratic Average: 3.9754726886749268
Nearest Class Center Accuracy: 0.8765

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08910788595676422
Inter Cos: 0.044339824467897415
Norm Quadratic Average: 2.618973731994629
Nearest Class Center Accuracy: 0.93472

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.19920964539051056
Inter Cos: 0.07908496260643005
Norm Quadratic Average: 2.3984313011169434
Nearest Class Center Accuracy: 0.95662

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3319854438304901
Inter Cos: 0.09707263112068176
Norm Quadratic Average: 2.204447031021118
Nearest Class Center Accuracy: 0.98476

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.619787335395813
Inter Cos: 0.10724519938230515
Norm Quadratic Average: 1.9906398057937622
Nearest Class Center Accuracy: 0.99204

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8912185430526733
Inter Cos: 0.05658988654613495
Norm Quadratic Average: 1.2371312379837036
Nearest Class Center Accuracy: 0.99966

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9346357583999634
Inter Cos: -0.012672371231019497
Norm Quadratic Average: 1.2224385738372803
Nearest Class Center Accuracy: 1.0

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9542863965034485
Inter Cos: -0.04793815314769745
Norm Quadratic Average: 1.194522500038147
Nearest Class Center Accuracy: 1.0

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 4.648595809936523
Linear Weight Rank: 4029
Intra Cos: 0.9909186959266663
Inter Cos: -0.06922425329685211
Norm Quadratic Average: 24.398555755615234
Nearest Class Center Accuracy: 1.0

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.1992805004119873
Linear Weight Rank: 3637
Intra Cos: 0.993720293045044
Inter Cos: -0.04835984855890274
Norm Quadratic Average: 17.194150924682617
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.503274440765381
Linear Weight Rank: 9
Intra Cos: 0.993522047996521
Inter Cos: 0.005828892812132835
Norm Quadratic Average: 12.769253730773926
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9959285855293274
Inter Cos: 0.155786395072937
Norm Quadratic Average: 10.479089736938477
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.689004857635498
Accuracy: 0.8729
NC1 Within Class Collapse: 2.647984266281128
NC2 Equinorm: Features: 0.11774013191461563, Weights: 0.021728822961449623
NC2 Equiangle: Features: 0.0939162466261122, Weights: 0.04293859799702962
NC3 Self-Duality: 0.07935620844364166
NC4 NCC Mismatch: 0.005299999999999971

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526075407862663
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550134658813477
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010475240647792816
Inter Cos: 0.05717792734503746
Norm Quadratic Average: 20.987285614013672
Nearest Class Center Accuracy: 0.3623

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015994956716895103
Inter Cos: 0.06855618208646774
Norm Quadratic Average: 14.484745979309082
Nearest Class Center Accuracy: 0.488

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013539000414311886
Inter Cos: 0.0561036579310894
Norm Quadratic Average: 11.172350883483887
Nearest Class Center Accuracy: 0.5492

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015824927017092705
Inter Cos: 0.05019816756248474
Norm Quadratic Average: 7.750797271728516
Nearest Class Center Accuracy: 0.6272

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016679707914590836
Inter Cos: 0.040568284690380096
Norm Quadratic Average: 6.021913528442383
Nearest Class Center Accuracy: 0.6706

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01669180952012539
Inter Cos: 0.03543945774435997
Norm Quadratic Average: 5.828019142150879
Nearest Class Center Accuracy: 0.7032

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017057757824659348
Inter Cos: 0.030680198222398758
Norm Quadratic Average: 5.816111087799072
Nearest Class Center Accuracy: 0.7368

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0330219641327858
Inter Cos: 0.043863214552402496
Norm Quadratic Average: 3.9538776874542236
Nearest Class Center Accuracy: 0.7969

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06627478450536728
Inter Cos: 0.050315868109464645
Norm Quadratic Average: 2.581193447113037
Nearest Class Center Accuracy: 0.8225

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.15102069079875946
Inter Cos: 0.09443185478448868
Norm Quadratic Average: 2.330125093460083
Nearest Class Center Accuracy: 0.8236

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.25162947177886963
Inter Cos: 0.13873809576034546
Norm Quadratic Average: 2.1232988834381104
Nearest Class Center Accuracy: 0.8378

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.44849252700805664
Inter Cos: 0.2278069108724594
Norm Quadratic Average: 1.900281310081482
Nearest Class Center Accuracy: 0.8353

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5883057117462158
Inter Cos: 0.2176448106765747
Norm Quadratic Average: 1.1616257429122925
Nearest Class Center Accuracy: 0.8493

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5883591175079346
Inter Cos: 0.16705812513828278
Norm Quadratic Average: 1.1398183107376099
Nearest Class Center Accuracy: 0.8645

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5630918741226196
Inter Cos: 0.10232480615377426
Norm Quadratic Average: 1.123795986175537
Nearest Class Center Accuracy: 0.8726

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 4.648595809936523
Linear Weight Rank: 4029
Intra Cos: 0.5846832394599915
Inter Cos: 0.12679967284202576
Norm Quadratic Average: 22.873952865600586
Nearest Class Center Accuracy: 0.8726

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.1992805004119873
Linear Weight Rank: 3637
Intra Cos: 0.584968090057373
Inter Cos: 0.12484202533960342
Norm Quadratic Average: 16.151628494262695
Nearest Class Center Accuracy: 0.8725

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.503274440765381
Linear Weight Rank: 9
Intra Cos: 0.5915283560752869
Inter Cos: 0.15864500403404236
Norm Quadratic Average: 12.08327579498291
Nearest Class Center Accuracy: 0.8727

Output Layer:
Intra Cos: 0.6180368661880493
Inter Cos: 0.22743523120880127
Norm Quadratic Average: 9.925777435302734
Nearest Class Center Accuracy: 0.8729

