Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597183227539062
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013337556272745132
Inter Cos: 0.06559574604034424
Norm Quadratic Average: 4.173366546630859
Nearest Class Center Accuracy: 0.34576

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018061572685837746
Inter Cos: 0.0666837990283966
Norm Quadratic Average: 2.7783472537994385
Nearest Class Center Accuracy: 0.47774

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013879608362913132
Inter Cos: 0.053598370403051376
Norm Quadratic Average: 2.006606101989746
Nearest Class Center Accuracy: 0.54776

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01572917215526104
Inter Cos: 0.04813211038708687
Norm Quadratic Average: 1.3418850898742676
Nearest Class Center Accuracy: 0.62792

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018787216395139694
Inter Cos: 0.04325902462005615
Norm Quadratic Average: 1.0578064918518066
Nearest Class Center Accuracy: 0.67988

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0224949661642313
Inter Cos: 0.04366772249341011
Norm Quadratic Average: 0.8920570015907288
Nearest Class Center Accuracy: 0.71948

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024033790454268456
Inter Cos: 0.04292232543230057
Norm Quadratic Average: 0.8234819173812866
Nearest Class Center Accuracy: 0.76714

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0504489429295063
Inter Cos: 0.06901722401380539
Norm Quadratic Average: 0.5319135189056396
Nearest Class Center Accuracy: 0.8961

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.15532134473323822
Inter Cos: 0.14849114418029785
Norm Quadratic Average: 0.3069639503955841
Nearest Class Center Accuracy: 0.96572

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.48253342509269714
Inter Cos: 0.2474740594625473
Norm Quadratic Average: 0.19778700172901154
Nearest Class Center Accuracy: 0.99554

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.694455087184906
Inter Cos: 0.19358856976032257
Norm Quadratic Average: 0.17135080695152283
Nearest Class Center Accuracy: 0.99998

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8461217880249023
Inter Cos: 0.17943014204502106
Norm Quadratic Average: 0.18849550187587738
Nearest Class Center Accuracy: 1.0

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9327695369720459
Inter Cos: 0.012550229206681252
Norm Quadratic Average: 0.2305455058813095
Nearest Class Center Accuracy: 1.0

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.983110785484314
Inter Cos: -0.0276318546384573
Norm Quadratic Average: 0.47719812393188477
Nearest Class Center Accuracy: 1.0

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9958173036575317
Inter Cos: -0.04281902313232422
Norm Quadratic Average: 1.0196304321289062
Nearest Class Center Accuracy: 1.0

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.1657474040985107
Linear Weight Rank: 94
Intra Cos: 0.9988806247711182
Inter Cos: -0.038292307406663895
Norm Quadratic Average: 24.945165634155273
Nearest Class Center Accuracy: 1.0

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.181473731994629
Linear Weight Rank: 1073
Intra Cos: 0.9990638494491577
Inter Cos: 0.017948996275663376
Norm Quadratic Average: 16.786394119262695
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.1715595722198486
Linear Weight Rank: 9
Intra Cos: 0.99916011095047
Inter Cos: 0.06839560717344284
Norm Quadratic Average: 11.613591194152832
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9993455410003662
Inter Cos: 0.09317708015441895
Norm Quadratic Average: 8.428970336914062
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.4128592042922974
Accuracy: 0.902
NC1 Within Class Collapse: 1.9233710765838623
NC2 Equinorm: Features: 0.08750349283218384, Weights: 0.0017971385968849063
NC2 Equiangle: Features: 0.09073740641276042, Weights: 0.02123462756474813
NC3 Self-Duality: 0.02887139283120632
NC4 NCC Mismatch: 0.00649999999999995

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526075407862663
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550134658813477
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012642616406083107
Inter Cos: 0.06628575176000595
Norm Quadratic Average: 4.170346260070801
Nearest Class Center Accuracy: 0.3646

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016693172976374626
Inter Cos: 0.067980095744133
Norm Quadratic Average: 2.7767395973205566
Nearest Class Center Accuracy: 0.4925

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013063179329037666
Inter Cos: 0.054354943335056305
Norm Quadratic Average: 2.006687641143799
Nearest Class Center Accuracy: 0.5657

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014705114997923374
Inter Cos: 0.04907267913222313
Norm Quadratic Average: 1.342137336730957
Nearest Class Center Accuracy: 0.6363

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017163187265396118
Inter Cos: 0.043982598930597305
Norm Quadratic Average: 1.0580508708953857
Nearest Class Center Accuracy: 0.6748

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020163634791970253
Inter Cos: 0.04443064704537392
Norm Quadratic Average: 0.89146488904953
Nearest Class Center Accuracy: 0.7031

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02084091119468212
Inter Cos: 0.043730493634939194
Norm Quadratic Average: 0.8221050500869751
Nearest Class Center Accuracy: 0.7351

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03972531855106354
Inter Cos: 0.0711636021733284
Norm Quadratic Average: 0.5295236110687256
Nearest Class Center Accuracy: 0.8209

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1305706650018692
Inter Cos: 0.15536870062351227
Norm Quadratic Average: 0.3023488521575928
Nearest Class Center Accuracy: 0.8591

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.40335938334465027
Inter Cos: 0.26531025767326355
Norm Quadratic Average: 0.19178210198879242
Nearest Class Center Accuracy: 0.8788

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5215322971343994
Inter Cos: 0.25515827536582947
Norm Quadratic Average: 0.1641150414943695
Nearest Class Center Accuracy: 0.8935

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5928986072540283
Inter Cos: 0.277536541223526
Norm Quadratic Average: 0.17892175912857056
Nearest Class Center Accuracy: 0.8984

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5892395973205566
Inter Cos: 0.17701859772205353
Norm Quadratic Average: 0.21895341575145721
Nearest Class Center Accuracy: 0.9008

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6259777545928955
Inter Cos: 0.1405101716518402
Norm Quadratic Average: 0.4495694637298584
Nearest Class Center Accuracy: 0.9015

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6309207081794739
Inter Cos: 0.12586787343025208
Norm Quadratic Average: 0.95512455701828
Nearest Class Center Accuracy: 0.9014

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.1657474040985107
Linear Weight Rank: 94
Intra Cos: 0.6489121913909912
Inter Cos: 0.146766796708107
Norm Quadratic Average: 23.223758697509766
Nearest Class Center Accuracy: 0.9018

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.181473731994629
Linear Weight Rank: 1073
Intra Cos: 0.652922511100769
Inter Cos: 0.16480673849582672
Norm Quadratic Average: 15.641380310058594
Nearest Class Center Accuracy: 0.9015

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.1715595722198486
Linear Weight Rank: 9
Intra Cos: 0.6568720936775208
Inter Cos: 0.1825075000524521
Norm Quadratic Average: 10.836692810058594
Nearest Class Center Accuracy: 0.9015

Output Layer:
Intra Cos: 0.6600073575973511
Inter Cos: 0.1920562982559204
Norm Quadratic Average: 7.871677398681641
Nearest Class Center Accuracy: 0.9015

