Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.0001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02289319410920143
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326311111450195
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03144538775086403
Inter Cos: 0.03230057284235954
Norm Quadratic Average: 64.21150970458984
Nearest Class Center Accuracy: 0.0431

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022693796083331108
Inter Cos: 0.02306104637682438
Norm Quadratic Average: 90.88858032226562
Nearest Class Center Accuracy: 0.05636

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019488045945763588
Inter Cos: 0.021259207278490067
Norm Quadratic Average: 171.79347229003906
Nearest Class Center Accuracy: 0.06306

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023066049441695213
Inter Cos: 0.02376275509595871
Norm Quadratic Average: 178.5885467529297
Nearest Class Center Accuracy: 0.06766

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026316603645682335
Inter Cos: 0.03173903748393059
Norm Quadratic Average: 262.5622253417969
Nearest Class Center Accuracy: 0.06932

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02861257642507553
Inter Cos: 0.03486718237400055
Norm Quadratic Average: 334.0227355957031
Nearest Class Center Accuracy: 0.07058

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.031587183475494385
Inter Cos: 0.03443608060479164
Norm Quadratic Average: 435.1091613769531
Nearest Class Center Accuracy: 0.07192

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04830412194132805
Inter Cos: 0.04030806943774223
Norm Quadratic Average: 322.7826232910156
Nearest Class Center Accuracy: 0.07692

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05207134783267975
Inter Cos: 0.04253208264708519
Norm Quadratic Average: 305.54339599609375
Nearest Class Center Accuracy: 0.07818

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0644247755408287
Inter Cos: 0.05444652587175369
Norm Quadratic Average: 221.9190216064453
Nearest Class Center Accuracy: 0.0825

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09175632148981094
Inter Cos: 0.07997208833694458
Norm Quadratic Average: 156.69642639160156
Nearest Class Center Accuracy: 0.0857

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.219215527176857
Inter Cos: 0.16361495852470398
Norm Quadratic Average: 74.86995697021484
Nearest Class Center Accuracy: 0.0899

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.48597076535224915
Inter Cos: 0.28848525881767273
Norm Quadratic Average: 46.57675552368164
Nearest Class Center Accuracy: 0.09268

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6906098127365112
Inter Cos: 0.3135007917881012
Norm Quadratic Average: 28.224184036254883
Nearest Class Center Accuracy: 0.09338

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.799072265625
Inter Cos: 0.2993893325328827
Norm Quadratic Average: 16.991127014160156
Nearest Class Center Accuracy: 0.09482

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 73.92404174804688
Linear Weight Rank: 4031
Intra Cos: 0.8604790568351746
Inter Cos: 0.32838794589042664
Norm Quadratic Average: 71.11090087890625
Nearest Class Center Accuracy: 0.097

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 32.16133117675781
Linear Weight Rank: 3666
Intra Cos: 0.9090633392333984
Inter Cos: 0.31667351722717285
Norm Quadratic Average: 48.38292694091797
Nearest Class Center Accuracy: 0.09908

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 12.912884712219238
Linear Weight Rank: 99
Intra Cos: 0.9251747131347656
Inter Cos: 0.36731475591659546
Norm Quadratic Average: 39.7069206237793
Nearest Class Center Accuracy: 0.09942

Output Layer:
Intra Cos: 0.9689581990242004
Inter Cos: 0.6531280279159546
Norm Quadratic Average: 77.58576202392578
Nearest Class Center Accuracy: 0.09974

Test Set:
Average Loss: 4.202901084899902
Accuracy: 0.4942
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.4635489284992218, Weights: 0.034564707428216934
NC2 Equiangle: Features: 0.17484668461963385, Weights: 0.12040561868686869
NC3 Self-Duality: 0.7080932259559631
NC4 NCC Mismatch: 0.15959999999999996

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621266715228558
Inter Cos: 0.406754732131958
Norm Quadratic Average: 29.42218780517578
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013566895388066769
Inter Cos: 0.24187608063220978
Norm Quadratic Average: 64.59814453125
Nearest Class Center Accuracy: 0.2159

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015797290951013565
Inter Cos: 0.2263965904712677
Norm Quadratic Average: 91.57467651367188
Nearest Class Center Accuracy: 0.3413

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012531605549156666
Inter Cos: 0.16311821341514587
Norm Quadratic Average: 173.17686462402344
Nearest Class Center Accuracy: 0.4267

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017694417387247086
Inter Cos: 0.20931464433670044
Norm Quadratic Average: 180.12037658691406
Nearest Class Center Accuracy: 0.4577

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01676221936941147
Inter Cos: 0.18502898514270782
Norm Quadratic Average: 264.7367858886719
Nearest Class Center Accuracy: 0.48

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017657242715358734
Inter Cos: 0.17730867862701416
Norm Quadratic Average: 336.3933410644531
Nearest Class Center Accuracy: 0.4947

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019663006067276
Inter Cos: 0.17561158537864685
Norm Quadratic Average: 437.47491455078125
Nearest Class Center Accuracy: 0.4972

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022289957851171494
Inter Cos: 0.19539238512516022
Norm Quadratic Average: 323.6401672363281
Nearest Class Center Accuracy: 0.5187

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022074252367019653
Inter Cos: 0.18417607247829437
Norm Quadratic Average: 303.2840270996094
Nearest Class Center Accuracy: 0.5286

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025977525860071182
Inter Cos: 0.199391707777977
Norm Quadratic Average: 217.3396453857422
Nearest Class Center Accuracy: 0.5303

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03640292212367058
Inter Cos: 0.22706174850463867
Norm Quadratic Average: 150.82872009277344
Nearest Class Center Accuracy: 0.5104

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06451037526130676
Inter Cos: 0.3306555449962616
Norm Quadratic Average: 69.38959503173828
Nearest Class Center Accuracy: 0.478

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.14059273898601532
Inter Cos: 0.40342915058135986
Norm Quadratic Average: 40.9846305847168
Nearest Class Center Accuracy: 0.4483

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20409321784973145
Inter Cos: 0.3829720616340637
Norm Quadratic Average: 24.004112243652344
Nearest Class Center Accuracy: 0.4405

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.21288636326789856
Inter Cos: 0.38853082060813904
Norm Quadratic Average: 14.215455055236816
Nearest Class Center Accuracy: 0.452

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 73.92404174804688
Linear Weight Rank: 4031
Intra Cos: 0.22347761690616608
Inter Cos: 0.3928682506084442
Norm Quadratic Average: 58.84123611450195
Nearest Class Center Accuracy: 0.4647

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 32.16133117675781
Linear Weight Rank: 3666
Intra Cos: 0.18890324234962463
Inter Cos: 0.3612784743309021
Norm Quadratic Average: 39.68303298950195
Nearest Class Center Accuracy: 0.4774

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 12.912884712219238
Linear Weight Rank: 99
Intra Cos: 0.18600787222385406
Inter Cos: 0.4514557123184204
Norm Quadratic Average: 32.55583190917969
Nearest Class Center Accuracy: 0.4808

Output Layer:
Intra Cos: 0.1840628683567047
Inter Cos: 0.6928983926773071
Norm Quadratic Average: 62.8446159362793
Nearest Class Center Accuracy: 0.4792

