Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.01.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893190383911133
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326326370239258
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013187162578105927
Inter Cos: 0.02809106558561325
Norm Quadratic Average: 8.743522644042969
Nearest Class Center Accuracy: 0.0394

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01690032333135605
Inter Cos: 0.03533131629228592
Norm Quadratic Average: 6.545704364776611
Nearest Class Center Accuracy: 0.05714

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012541004456579685
Inter Cos: 0.03239069879055023
Norm Quadratic Average: 4.728765487670898
Nearest Class Center Accuracy: 0.06452

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019985610619187355
Inter Cos: 0.017602477222681046
Norm Quadratic Average: 3.631321430206299
Nearest Class Center Accuracy: 0.07286

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023385703563690186
Inter Cos: 0.019028598442673683
Norm Quadratic Average: 2.6982085704803467
Nearest Class Center Accuracy: 0.07658

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02595297433435917
Inter Cos: 0.02077685110270977
Norm Quadratic Average: 2.5421862602233887
Nearest Class Center Accuracy: 0.07954

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022752925753593445
Inter Cos: 0.018878242000937462
Norm Quadratic Average: 2.478388547897339
Nearest Class Center Accuracy: 0.08174

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03376266732811928
Inter Cos: 0.0275731198489666
Norm Quadratic Average: 1.891447901725769
Nearest Class Center Accuracy: 0.0874

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04243798181414604
Inter Cos: 0.034471213817596436
Norm Quadratic Average: 1.2478282451629639
Nearest Class Center Accuracy: 0.09144

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08033055067062378
Inter Cos: 0.05091024935245514
Norm Quadratic Average: 0.9788467288017273
Nearest Class Center Accuracy: 0.09554

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20622433722019196
Inter Cos: 0.08413921296596527
Norm Quadratic Average: 0.7719237208366394
Nearest Class Center Accuracy: 0.09704

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5937528014183044
Inter Cos: 0.17468325793743134
Norm Quadratic Average: 0.5564516186714172
Nearest Class Center Accuracy: 0.09812

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8824882507324219
Inter Cos: 0.25535282492637634
Norm Quadratic Average: 0.43480098247528076
Nearest Class Center Accuracy: 0.1

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9201119542121887
Inter Cos: 0.32101479172706604
Norm Quadratic Average: 0.5177125930786133
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9794078469276428
Inter Cos: 0.38687124848365784
Norm Quadratic Average: 1.1594645977020264
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.6753296852111816
Linear Weight Rank: 145
Intra Cos: 0.9890649318695068
Inter Cos: 0.4218427836894989
Norm Quadratic Average: 36.03156661987305
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.6997621059417725
Linear Weight Rank: 1691
Intra Cos: 0.9894729852676392
Inter Cos: 0.42147737741470337
Norm Quadratic Average: 33.13323211669922
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 3.8091020584106445
Linear Weight Rank: 97
Intra Cos: 0.9889077544212341
Inter Cos: 0.434320867061615
Norm Quadratic Average: 32.43017578125
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.989641010761261
Inter Cos: 0.4677891731262207
Norm Quadratic Average: 34.338233947753906
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 1.7736375509262086
Accuracy: 0.6279
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.14722765982151031, Weights: 0.017334766685962677
NC2 Equiangle: Features: 0.24119929766414142, Weights: 0.21175056226325759
NC3 Self-Duality: 0.13178178668022156
NC4 NCC Mismatch: 0.06420000000000003

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422189712524414
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.007181531749665737
Inter Cos: 0.1963055431842804
Norm Quadratic Average: 8.802557945251465
Nearest Class Center Accuracy: 0.23

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01103843655437231
Inter Cos: 0.2630346715450287
Norm Quadratic Average: 6.58928108215332
Nearest Class Center Accuracy: 0.3688

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010136422701179981
Inter Cos: 0.13884200155735016
Norm Quadratic Average: 4.750974178314209
Nearest Class Center Accuracy: 0.5015

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013743511401116848
Inter Cos: 0.19561728835105896
Norm Quadratic Average: 3.6459898948669434
Nearest Class Center Accuracy: 0.5499

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015907064080238342
Inter Cos: 0.17665883898735046
Norm Quadratic Average: 2.705747365951538
Nearest Class Center Accuracy: 0.5846

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017182137817144394
Inter Cos: 0.1439676731824875
Norm Quadratic Average: 2.5454037189483643
Nearest Class Center Accuracy: 0.6013

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014524155296385288
Inter Cos: 0.10931003838777542
Norm Quadratic Average: 2.476484537124634
Nearest Class Center Accuracy: 0.6298

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017401929944753647
Inter Cos: 0.15111687779426575
Norm Quadratic Average: 1.8862643241882324
Nearest Class Center Accuracy: 0.6635

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01885271817445755
Inter Cos: 0.1593860685825348
Norm Quadratic Average: 1.2308286428451538
Nearest Class Center Accuracy: 0.6816

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02716735005378723
Inter Cos: 0.21490541100502014
Norm Quadratic Average: 0.9371457695960999
Nearest Class Center Accuracy: 0.6543

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05843124911189079
Inter Cos: 0.30833423137664795
Norm Quadratic Average: 0.6984936594963074
Nearest Class Center Accuracy: 0.6082

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.23440106213092804
Inter Cos: 0.410739928483963
Norm Quadratic Average: 0.46522635221481323
Nearest Class Center Accuracy: 0.5484

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.288661390542984
Inter Cos: 0.4745374619960785
Norm Quadratic Average: 0.34636709094047546
Nearest Class Center Accuracy: 0.5906

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.30325308442115784
Inter Cos: 0.515249490737915
Norm Quadratic Average: 0.4343309700489044
Nearest Class Center Accuracy: 0.6231

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3291275203227997
Inter Cos: 0.5789335370063782
Norm Quadratic Average: 1.0293322801589966
Nearest Class Center Accuracy: 0.6287

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.6753296852111816
Linear Weight Rank: 145
Intra Cos: 0.33767199516296387
Inter Cos: 0.6450992226600647
Norm Quadratic Average: 32.52699279785156
Nearest Class Center Accuracy: 0.6291

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.6997621059417725
Linear Weight Rank: 1691
Intra Cos: 0.34375253319740295
Inter Cos: 0.671170711517334
Norm Quadratic Average: 30.220117568969727
Nearest Class Center Accuracy: 0.6293

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 3.8091020584106445
Linear Weight Rank: 97
Intra Cos: 0.3426084518432617
Inter Cos: 0.6725046038627625
Norm Quadratic Average: 29.858097076416016
Nearest Class Center Accuracy: 0.6279

Output Layer:
Intra Cos: 0.3486248850822449
Inter Cos: 0.6813164353370667
Norm Quadratic Average: 31.7278995513916
Nearest Class Center Accuracy: 0.6293

