Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893192246556282
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326313018798828
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014151013456285
Inter Cos: 0.029479283839464188
Norm Quadratic Average: 30.086071014404297
Nearest Class Center Accuracy: 0.04004

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01844794675707817
Inter Cos: 0.03431140258908272
Norm Quadratic Average: 20.755512237548828
Nearest Class Center Accuracy: 0.05794

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014609904028475285
Inter Cos: 0.02649771422147751
Norm Quadratic Average: 16.096555709838867
Nearest Class Center Accuracy: 0.0646

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021183330565690994
Inter Cos: 0.02074088715016842
Norm Quadratic Average: 11.564963340759277
Nearest Class Center Accuracy: 0.07118

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022009313106536865
Inter Cos: 0.018951745703816414
Norm Quadratic Average: 9.054550170898438
Nearest Class Center Accuracy: 0.07558

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02400999329984188
Inter Cos: 0.020074887201189995
Norm Quadratic Average: 8.854158401489258
Nearest Class Center Accuracy: 0.07808

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022008582949638367
Inter Cos: 0.020290900021791458
Norm Quadratic Average: 8.909112930297852
Nearest Class Center Accuracy: 0.07962

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03207534924149513
Inter Cos: 0.027825796976685524
Norm Quadratic Average: 6.112301826477051
Nearest Class Center Accuracy: 0.08578

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04217739403247833
Inter Cos: 0.03505944833159447
Norm Quadratic Average: 4.345518112182617
Nearest Class Center Accuracy: 0.0904

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05870896205306053
Inter Cos: 0.041816677898168564
Norm Quadratic Average: 3.8621387481689453
Nearest Class Center Accuracy: 0.09394

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09018751978874207
Inter Cos: 0.05757395923137665
Norm Quadratic Average: 3.6129839420318604
Nearest Class Center Accuracy: 0.09722

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.22889745235443115
Inter Cos: 0.12244828790426254
Norm Quadratic Average: 2.754409074783325
Nearest Class Center Accuracy: 0.09916

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5910521149635315
Inter Cos: 0.21319830417633057
Norm Quadratic Average: 1.736650824546814
Nearest Class Center Accuracy: 0.1

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8062565326690674
Inter Cos: 0.25536680221557617
Norm Quadratic Average: 1.6593550443649292
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8862491846084595
Inter Cos: 0.27961933612823486
Norm Quadratic Average: 1.5098199844360352
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 6.307075023651123
Linear Weight Rank: 4024
Intra Cos: 0.9485709071159363
Inter Cos: 0.34754303097724915
Norm Quadratic Average: 37.172218322753906
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 6.25571870803833
Linear Weight Rank: 3534
Intra Cos: 0.9594637751579285
Inter Cos: 0.3694589138031006
Norm Quadratic Average: 30.822025299072266
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 6.145885944366455
Linear Weight Rank: 98
Intra Cos: 0.9605079293251038
Inter Cos: 0.3479286730289459
Norm Quadratic Average: 29.86958122253418
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9696546792984009
Inter Cos: 0.3936590254306793
Norm Quadratic Average: 35.61363983154297
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 2.3304275505065917
Accuracy: 0.5956
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.16940757632255554, Weights: 0.02610784024000168
NC2 Equiangle: Features: 0.199121673275726, Weights: 0.1161706666272096
NC3 Self-Duality: 0.349563866853714
NC4 NCC Mismatch: 0.0686

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422183990478516
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.00699241366237402
Inter Cos: 0.1845630407333374
Norm Quadratic Average: 30.28530502319336
Nearest Class Center Accuracy: 0.2267

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010853267274796963
Inter Cos: 0.2415442019701004
Norm Quadratic Average: 20.897750854492188
Nearest Class Center Accuracy: 0.3667

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010831334628164768
Inter Cos: 0.1522762030363083
Norm Quadratic Average: 16.174131393432617
Nearest Class Center Accuracy: 0.4741

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015169081278145313
Inter Cos: 0.18356770277023315
Norm Quadratic Average: 11.610434532165527
Nearest Class Center Accuracy: 0.5259

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015684396028518677
Inter Cos: 0.15179982781410217
Norm Quadratic Average: 9.079681396484375
Nearest Class Center Accuracy: 0.5713

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014759746380150318
Inter Cos: 0.1375712752342224
Norm Quadratic Average: 8.863912582397461
Nearest Class Center Accuracy: 0.5936

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013055938296020031
Inter Cos: 0.12112079560756683
Norm Quadratic Average: 8.906806945800781
Nearest Class Center Accuracy: 0.6176

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016111154109239578
Inter Cos: 0.14290308952331543
Norm Quadratic Average: 6.102508544921875
Nearest Class Center Accuracy: 0.6469

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01817726343870163
Inter Cos: 0.1470119059085846
Norm Quadratic Average: 4.31057596206665
Nearest Class Center Accuracy: 0.6646

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0229082852602005
Inter Cos: 0.18764331936836243
Norm Quadratic Average: 3.772368907928467
Nearest Class Center Accuracy: 0.6641

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.031148917973041534
Inter Cos: 0.23223528265953064
Norm Quadratic Average: 3.459475517272949
Nearest Class Center Accuracy: 0.643

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08086072653532028
Inter Cos: 0.32840457558631897
Norm Quadratic Average: 2.5295026302337646
Nearest Class Center Accuracy: 0.603

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1683918535709381
Inter Cos: 0.4365905821323395
Norm Quadratic Average: 1.49471914768219
Nearest Class Center Accuracy: 0.5908

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.22413843870162964
Inter Cos: 0.42437541484832764
Norm Quadratic Average: 1.3607808351516724
Nearest Class Center Accuracy: 0.5842

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2205491065979004
Inter Cos: 0.39757072925567627
Norm Quadratic Average: 1.30807626247406
Nearest Class Center Accuracy: 0.6031

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 6.307075023651123
Linear Weight Rank: 4024
Intra Cos: 0.23832187056541443
Inter Cos: 0.48308929800987244
Norm Quadratic Average: 32.59650802612305
Nearest Class Center Accuracy: 0.6042

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 6.25571870803833
Linear Weight Rank: 3534
Intra Cos: 0.2636328339576721
Inter Cos: 0.5046528577804565
Norm Quadratic Average: 27.818504333496094
Nearest Class Center Accuracy: 0.6019

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 6.145885944366455
Linear Weight Rank: 98
Intra Cos: 0.2727415859699249
Inter Cos: 0.531638503074646
Norm Quadratic Average: 27.618947982788086
Nearest Class Center Accuracy: 0.5987

Output Layer:
Intra Cos: 0.2915939390659332
Inter Cos: 0.6101155877113342
Norm Quadratic Average: 33.176658630371094
Nearest Class Center Accuracy: 0.5952

