Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.0005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0198909193277359
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597179412841797
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011275880970060825
Inter Cos: 0.05613335222005844
Norm Quadratic Average: 34.82954406738281
Nearest Class Center Accuracy: 0.33966

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016030557453632355
Inter Cos: 0.059473514556884766
Norm Quadratic Average: 21.645967483520508
Nearest Class Center Accuracy: 0.4734

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013194953091442585
Inter Cos: 0.05221622809767723
Norm Quadratic Average: 18.56840705871582
Nearest Class Center Accuracy: 0.53256

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016726555302739143
Inter Cos: 0.05153585225343704
Norm Quadratic Average: 12.156473159790039
Nearest Class Center Accuracy: 0.60896

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016859417781233788
Inter Cos: 0.04381436109542847
Norm Quadratic Average: 11.018322944641113
Nearest Class Center Accuracy: 0.66314

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018609726801514626
Inter Cos: 0.036160215735435486
Norm Quadratic Average: 10.519476890563965
Nearest Class Center Accuracy: 0.71606

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020485352724790573
Inter Cos: 0.031253132969141006
Norm Quadratic Average: 10.37614917755127
Nearest Class Center Accuracy: 0.7654

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04203702136874199
Inter Cos: 0.054517313838005066
Norm Quadratic Average: 7.141180992126465
Nearest Class Center Accuracy: 0.86414

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09744769334793091
Inter Cos: 0.07496871799230576
Norm Quadratic Average: 8.189393043518066
Nearest Class Center Accuracy: 0.92732

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.18764780461788177
Inter Cos: 0.08703862130641937
Norm Quadratic Average: 9.155223846435547
Nearest Class Center Accuracy: 0.95732

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.29167574644088745
Inter Cos: 0.08960509300231934
Norm Quadratic Average: 9.686175346374512
Nearest Class Center Accuracy: 0.98

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.526907205581665
Inter Cos: 0.1126861721277237
Norm Quadratic Average: 8.376361846923828
Nearest Class Center Accuracy: 0.9862

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8191186189651489
Inter Cos: 0.07401981949806213
Norm Quadratic Average: 5.7381272315979
Nearest Class Center Accuracy: 0.999

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8831700086593628
Inter Cos: -0.014204648323357105
Norm Quadratic Average: 5.900692462921143
Nearest Class Center Accuracy: 1.0

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9092345237731934
Inter Cos: -0.03330386430025101
Norm Quadratic Average: 5.892772197723389
Nearest Class Center Accuracy: 1.0

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 20.257566452026367
Linear Weight Rank: 4031
Intra Cos: 0.9648538827896118
Inter Cos: 0.0012405430898070335
Norm Quadratic Average: 45.37134552001953
Nearest Class Center Accuracy: 1.0

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 8.77511215209961
Linear Weight Rank: 3666
Intra Cos: 0.9836811423301697
Inter Cos: 0.008765267208218575
Norm Quadratic Average: 27.043102264404297
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.5755958557128906
Linear Weight Rank: 10
Intra Cos: 0.9775341153144836
Inter Cos: 0.022554274648427963
Norm Quadratic Average: 17.352540969848633
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9940914511680603
Inter Cos: 0.1673448234796524
Norm Quadratic Average: 13.669724464416504
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.7549830252170563
Accuracy: 0.8725
NC1 Within Class Collapse: 2.794229745864868
NC2 Equinorm: Features: 0.12603659927845, Weights: 0.02267080545425415
NC2 Equiangle: Features: 0.09087431165907119, Weights: 0.06406926049126518
NC3 Self-Duality: 0.22150874137878418
NC4 NCC Mismatch: 0.018100000000000005

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526077270507812
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550132751464844
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010014842264354229
Inter Cos: 0.0570470467209816
Norm Quadratic Average: 34.80000686645508
Nearest Class Center Accuracy: 0.3612

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014903555624186993
Inter Cos: 0.06050640344619751
Norm Quadratic Average: 21.63896369934082
Nearest Class Center Accuracy: 0.489

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012503795325756073
Inter Cos: 0.052791450172662735
Norm Quadratic Average: 18.579517364501953
Nearest Class Center Accuracy: 0.5472

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015590938739478588
Inter Cos: 0.05237571895122528
Norm Quadratic Average: 12.164111137390137
Nearest Class Center Accuracy: 0.6121

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015514370985329151
Inter Cos: 0.04434344545006752
Norm Quadratic Average: 11.025362968444824
Nearest Class Center Accuracy: 0.6592

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016712022945284843
Inter Cos: 0.03679821640253067
Norm Quadratic Average: 10.51203441619873
Nearest Class Center Accuracy: 0.6975

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01766304485499859
Inter Cos: 0.03236572444438934
Norm Quadratic Average: 10.351463317871094
Nearest Class Center Accuracy: 0.7352

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03366423025727272
Inter Cos: 0.0564366914331913
Norm Quadratic Average: 7.1042256355285645
Nearest Class Center Accuracy: 0.7863

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07322380691766739
Inter Cos: 0.07909400761127472
Norm Quadratic Average: 8.094198226928711
Nearest Class Center Accuracy: 0.8133

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1450529843568802
Inter Cos: 0.09390786290168762
Norm Quadratic Average: 8.972131729125977
Nearest Class Center Accuracy: 0.825

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20532388985157013
Inter Cos: 0.11354672908782959
Norm Quadratic Average: 9.413996696472168
Nearest Class Center Accuracy: 0.8356

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3729020059108734
Inter Cos: 0.20322197675704956
Norm Quadratic Average: 8.044023513793945
Nearest Class Center Accuracy: 0.8284

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5377284288406372
Inter Cos: 0.24961023032665253
Norm Quadratic Average: 5.382902145385742
Nearest Class Center Accuracy: 0.8479

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5697349905967712
Inter Cos: 0.1903766691684723
Norm Quadratic Average: 5.458256721496582
Nearest Class Center Accuracy: 0.8629

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5463489890098572
Inter Cos: 0.11990625411272049
Norm Quadratic Average: 5.423342227935791
Nearest Class Center Accuracy: 0.8704

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 20.257566452026367
Linear Weight Rank: 4031
Intra Cos: 0.562757134437561
Inter Cos: 0.12304985523223877
Norm Quadratic Average: 41.46048355102539
Nearest Class Center Accuracy: 0.8705

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 8.77511215209961
Linear Weight Rank: 3666
Intra Cos: 0.5449281334877014
Inter Cos: 0.1080203503370285
Norm Quadratic Average: 24.845834732055664
Nearest Class Center Accuracy: 0.8713

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.5755958557128906
Linear Weight Rank: 10
Intra Cos: 0.5435716509819031
Inter Cos: 0.1496293991804123
Norm Quadratic Average: 16.1710147857666
Nearest Class Center Accuracy: 0.8709

Output Layer:
Intra Cos: 0.6039379239082336
Inter Cos: 0.26367783546447754
Norm Quadratic Average: 12.53376293182373
Nearest Class Center Accuracy: 0.8722

