Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.0001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893192246556282
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326313018798828
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015890348702669144
Inter Cos: 0.029572751373052597
Norm Quadratic Average: 115.46255493164062
Nearest Class Center Accuracy: 0.04134

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017618419602513313
Inter Cos: 0.035098880529403687
Norm Quadratic Average: 66.18985748291016
Nearest Class Center Accuracy: 0.05618

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015889106318354607
Inter Cos: 0.023372070863842964
Norm Quadratic Average: 64.36479949951172
Nearest Class Center Accuracy: 0.06342

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021144209429621696
Inter Cos: 0.022700659930706024
Norm Quadratic Average: 43.14156723022461
Nearest Class Center Accuracy: 0.07036

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02220957912504673
Inter Cos: 0.0227670855820179
Norm Quadratic Average: 43.14384460449219
Nearest Class Center Accuracy: 0.07384

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025225870311260223
Inter Cos: 0.024570638313889503
Norm Quadratic Average: 42.11286544799805
Nearest Class Center Accuracy: 0.07642

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02580357901751995
Inter Cos: 0.025912610813975334
Norm Quadratic Average: 41.917327880859375
Nearest Class Center Accuracy: 0.0787

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.039115406572818756
Inter Cos: 0.03538936376571655
Norm Quadratic Average: 27.263078689575195
Nearest Class Center Accuracy: 0.08446

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.055706750601530075
Inter Cos: 0.04772726073861122
Norm Quadratic Average: 31.175718307495117
Nearest Class Center Accuracy: 0.08862

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07710601389408112
Inter Cos: 0.06060520559549332
Norm Quadratic Average: 31.497961044311523
Nearest Class Center Accuracy: 0.09264

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10413683205842972
Inter Cos: 0.07821229100227356
Norm Quadratic Average: 32.761268615722656
Nearest Class Center Accuracy: 0.09574

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20168760418891907
Inter Cos: 0.14103850722312927
Norm Quadratic Average: 25.60042381286621
Nearest Class Center Accuracy: 0.0991

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4470442235469818
Inter Cos: 0.2710133194923401
Norm Quadratic Average: 19.889562606811523
Nearest Class Center Accuracy: 0.1

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6156496405601501
Inter Cos: 0.31137189269065857
Norm Quadratic Average: 21.463314056396484
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7043377757072449
Inter Cos: 0.30231964588165283
Norm Quadratic Average: 24.47873878479004
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 74.03521728515625
Linear Weight Rank: 4031
Intra Cos: 0.8323522806167603
Inter Cos: 0.3386453092098236
Norm Quadratic Average: 59.677757263183594
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 32.41604232788086
Linear Weight Rank: 3665
Intra Cos: 0.885269820690155
Inter Cos: 0.2959918677806854
Norm Quadratic Average: 44.61152648925781
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 12.6641845703125
Linear Weight Rank: 99
Intra Cos: 0.9177165031433105
Inter Cos: 0.36269083619117737
Norm Quadratic Average: 41.38481903076172
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9574449062347412
Inter Cos: 0.6210843920707703
Norm Quadratic Average: 79.84790802001953
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 4.3805767375946045
Accuracy: 0.5622
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.26676565408706665, Weights: 0.027145596221089363
NC2 Equiangle: Features: 0.1639798127761995, Weights: 0.1113278290719697
NC3 Self-Duality: 0.5464624762535095
NC4 NCC Mismatch: 0.11029999999999995

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422183990478516
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.007687917910516262
Inter Cos: 0.18413794040679932
Norm Quadratic Average: 116.21055603027344
Nearest Class Center Accuracy: 0.2323

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010328381322324276
Inter Cos: 0.23621155321598053
Norm Quadratic Average: 66.64452362060547
Nearest Class Center Accuracy: 0.3639

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010289647616446018
Inter Cos: 0.15631723403930664
Norm Quadratic Average: 64.67719268798828
Nearest Class Center Accuracy: 0.4651

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015773288905620575
Inter Cos: 0.1789732128381729
Norm Quadratic Average: 43.315208435058594
Nearest Class Center Accuracy: 0.5033

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016546115279197693
Inter Cos: 0.1603689342737198
Norm Quadratic Average: 43.257408142089844
Nearest Class Center Accuracy: 0.5379

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016277126967906952
Inter Cos: 0.14649586379528046
Norm Quadratic Average: 42.15260314941406
Nearest Class Center Accuracy: 0.5603

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014588301070034504
Inter Cos: 0.13261328637599945
Norm Quadratic Average: 41.91004180908203
Nearest Class Center Accuracy: 0.5837

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018090367317199707
Inter Cos: 0.16021832823753357
Norm Quadratic Average: 27.21885108947754
Nearest Class Center Accuracy: 0.6037

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02366510033607483
Inter Cos: 0.19284698367118835
Norm Quadratic Average: 31.008594512939453
Nearest Class Center Accuracy: 0.6035

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.029483266174793243
Inter Cos: 0.22655810415744781
Norm Quadratic Average: 31.144027709960938
Nearest Class Center Accuracy: 0.6026

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03643243387341499
Inter Cos: 0.26697561144828796
Norm Quadratic Average: 32.134788513183594
Nearest Class Center Accuracy: 0.6013

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07442202419042587
Inter Cos: 0.34872862696647644
Norm Quadratic Average: 24.671144485473633
Nearest Class Center Accuracy: 0.5885

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.13547256588935852
Inter Cos: 0.48280468583106995
Norm Quadratic Average: 18.48668098449707
Nearest Class Center Accuracy: 0.5664

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.17991960048675537
Inter Cos: 0.5244634747505188
Norm Quadratic Average: 19.41524314880371
Nearest Class Center Accuracy: 0.5596

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.21524861454963684
Inter Cos: 0.5083367824554443
Norm Quadratic Average: 21.99691390991211
Nearest Class Center Accuracy: 0.5516

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 74.03521728515625
Linear Weight Rank: 4031
Intra Cos: 0.2390691488981247
Inter Cos: 0.46275660395622253
Norm Quadratic Average: 50.104827880859375
Nearest Class Center Accuracy: 0.5589

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 32.41604232788086
Linear Weight Rank: 3665
Intra Cos: 0.21839682757854462
Inter Cos: 0.4329688847064972
Norm Quadratic Average: 36.00594711303711
Nearest Class Center Accuracy: 0.5581

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 12.6641845703125
Linear Weight Rank: 99
Intra Cos: 0.21441885828971863
Inter Cos: 0.5025591850280762
Norm Quadratic Average: 33.1313362121582
Nearest Class Center Accuracy: 0.5598

Output Layer:
Intra Cos: 0.24197904765605927
Inter Cos: 0.6725730299949646
Norm Quadratic Average: 63.992218017578125
Nearest Class Center Accuracy: 0.5567

