Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.01.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02289319410920143
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326311111450195
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012562200427055359
Inter Cos: 0.027194935828447342
Norm Quadratic Average: 8.541932106018066
Nearest Class Center Accuracy: 0.03856

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017424097284674644
Inter Cos: 0.037742167711257935
Norm Quadratic Average: 6.4031982421875
Nearest Class Center Accuracy: 0.05668

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012440955266356468
Inter Cos: 0.0293072871863842
Norm Quadratic Average: 4.6923017501831055
Nearest Class Center Accuracy: 0.06396

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020294955000281334
Inter Cos: 0.018163958564400673
Norm Quadratic Average: 3.5501575469970703
Nearest Class Center Accuracy: 0.0723

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02325909212231636
Inter Cos: 0.018873900175094604
Norm Quadratic Average: 2.663832426071167
Nearest Class Center Accuracy: 0.07614

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.027300463989377022
Inter Cos: 0.020851794630289078
Norm Quadratic Average: 2.5080766677856445
Nearest Class Center Accuracy: 0.0785

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024251606315374374
Inter Cos: 0.01907486468553543
Norm Quadratic Average: 2.47169828414917
Nearest Class Center Accuracy: 0.08106

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03506963700056076
Inter Cos: 0.028675101697444916
Norm Quadratic Average: 1.8648532629013062
Nearest Class Center Accuracy: 0.0878

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.045240871608257294
Inter Cos: 0.036985740065574646
Norm Quadratic Average: 1.2402287721633911
Nearest Class Center Accuracy: 0.0922

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07980738580226898
Inter Cos: 0.05633213371038437
Norm Quadratic Average: 0.9675818085670471
Nearest Class Center Accuracy: 0.0958

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.210947647690773
Inter Cos: 0.0889776274561882
Norm Quadratic Average: 0.7670782804489136
Nearest Class Center Accuracy: 0.09718

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5935003161430359
Inter Cos: 0.1623707413673401
Norm Quadratic Average: 0.5601574778556824
Nearest Class Center Accuracy: 0.09792

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8842251896858215
Inter Cos: 0.2801856994628906
Norm Quadratic Average: 0.4387013018131256
Nearest Class Center Accuracy: 0.1

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9208402633666992
Inter Cos: 0.36756473779678345
Norm Quadratic Average: 0.5097792148590088
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9773438572883606
Inter Cos: 0.44126084446907043
Norm Quadratic Average: 1.1593778133392334
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.6713225841522217
Linear Weight Rank: 141
Intra Cos: 0.9884523153305054
Inter Cos: 0.518724799156189
Norm Quadratic Average: 36.21399688720703
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.695758104324341
Linear Weight Rank: 1605
Intra Cos: 0.989616870880127
Inter Cos: 0.4927753210067749
Norm Quadratic Average: 33.36641311645508
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 3.806810140609741
Linear Weight Rank: 97
Intra Cos: 0.9893383383750916
Inter Cos: 0.49173077940940857
Norm Quadratic Average: 32.74165344238281
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9889671206474304
Inter Cos: 0.5041883587837219
Norm Quadratic Average: 34.796634674072266
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 1.8492744482040406
Accuracy: 0.6252
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.15393538773059845, Weights: 0.019943658262491226
NC2 Equiangle: Features: 0.24382245304608585, Weights: 0.21137293343592173
NC3 Self-Duality: 0.13359905779361725
NC4 NCC Mismatch: 0.0676

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621266715228558
Inter Cos: 0.406754732131958
Norm Quadratic Average: 29.42218780517578
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006645604036748409
Inter Cos: 0.1841730922460556
Norm Quadratic Average: 8.598607063293457
Nearest Class Center Accuracy: 0.2251

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010636086575686932
Inter Cos: 0.27163276076316833
Norm Quadratic Average: 6.445643901824951
Nearest Class Center Accuracy: 0.3596

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.009508251212537289
Inter Cos: 0.1432187855243683
Norm Quadratic Average: 4.713504791259766
Nearest Class Center Accuracy: 0.5

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014042492024600506
Inter Cos: 0.1990823596715927
Norm Quadratic Average: 3.564866542816162
Nearest Class Center Accuracy: 0.5452

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01630406454205513
Inter Cos: 0.18579816818237305
Norm Quadratic Average: 2.672422409057617
Nearest Class Center Accuracy: 0.5824

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016997378319501877
Inter Cos: 0.1542947143316269
Norm Quadratic Average: 2.512235403060913
Nearest Class Center Accuracy: 0.6029

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01490339357405901
Inter Cos: 0.11984721571207047
Norm Quadratic Average: 2.4711859226226807
Nearest Class Center Accuracy: 0.6246

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017474576830863953
Inter Cos: 0.15146438777446747
Norm Quadratic Average: 1.8609563112258911
Nearest Class Center Accuracy: 0.6622

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01749943569302559
Inter Cos: 0.16048412024974823
Norm Quadratic Average: 1.2248438596725464
Nearest Class Center Accuracy: 0.682

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025141429156064987
Inter Cos: 0.21481697261333466
Norm Quadratic Average: 0.9267357587814331
Nearest Class Center Accuracy: 0.6549

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05322982743382454
Inter Cos: 0.2998773455619812
Norm Quadratic Average: 0.6953732967376709
Nearest Class Center Accuracy: 0.6052

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.22757206857204437
Inter Cos: 0.3994095027446747
Norm Quadratic Average: 0.4693635404109955
Nearest Class Center Accuracy: 0.5465

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2853010892868042
Inter Cos: 0.43660274147987366
Norm Quadratic Average: 0.3502216339111328
Nearest Class Center Accuracy: 0.5925

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.29627975821495056
Inter Cos: 0.4813593626022339
Norm Quadratic Average: 0.4307142198085785
Nearest Class Center Accuracy: 0.6205

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3146791160106659
Inter Cos: 0.5470008254051208
Norm Quadratic Average: 1.033255696296692
Nearest Class Center Accuracy: 0.6266

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.6713225841522217
Linear Weight Rank: 141
Intra Cos: 0.3287385404109955
Inter Cos: 0.6192495226860046
Norm Quadratic Average: 32.76041793823242
Nearest Class Center Accuracy: 0.6278

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 3.695758104324341
Linear Weight Rank: 1605
Intra Cos: 0.3378714621067047
Inter Cos: 0.6440664529800415
Norm Quadratic Average: 30.488178253173828
Nearest Class Center Accuracy: 0.6283

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 3.806810140609741
Linear Weight Rank: 97
Intra Cos: 0.33195048570632935
Inter Cos: 0.6377217769622803
Norm Quadratic Average: 30.206867218017578
Nearest Class Center Accuracy: 0.6292

Output Layer:
Intra Cos: 0.32950618863105774
Inter Cos: 0.643478274345398
Norm Quadratic Average: 32.214202880859375
Nearest Class Center Accuracy: 0.629

