Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.0003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02289319410920143
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326311111450195
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01401225384324789
Inter Cos: 0.029039453715085983
Norm Quadratic Average: 64.06858825683594
Nearest Class Center Accuracy: 0.04018

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019505884498357773
Inter Cos: 0.038755401968955994
Norm Quadratic Average: 39.249229431152344
Nearest Class Center Accuracy: 0.05682

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015476287342607975
Inter Cos: 0.025631174445152283
Norm Quadratic Average: 34.69439697265625
Nearest Class Center Accuracy: 0.06316

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02181977778673172
Inter Cos: 0.02237313613295555
Norm Quadratic Average: 23.221141815185547
Nearest Class Center Accuracy: 0.0698

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022581499069929123
Inter Cos: 0.020764809101819992
Norm Quadratic Average: 21.284595489501953
Nearest Class Center Accuracy: 0.07396

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024642396718263626
Inter Cos: 0.0213455967605114
Norm Quadratic Average: 20.665536880493164
Nearest Class Center Accuracy: 0.07692

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025652913376688957
Inter Cos: 0.02166704088449478
Norm Quadratic Average: 20.698537826538086
Nearest Class Center Accuracy: 0.07884

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.035384878516197205
Inter Cos: 0.030609166249632835
Norm Quadratic Average: 12.770137786865234
Nearest Class Center Accuracy: 0.08502

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04763128235936165
Inter Cos: 0.04144890978932381
Norm Quadratic Average: 13.191742897033691
Nearest Class Center Accuracy: 0.08942

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06536511331796646
Inter Cos: 0.05437078699469566
Norm Quadratic Average: 13.041280746459961
Nearest Class Center Accuracy: 0.09334

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09620378911495209
Inter Cos: 0.07279647886753082
Norm Quadratic Average: 14.110734939575195
Nearest Class Center Accuracy: 0.09636

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20399966835975647
Inter Cos: 0.13037268817424774
Norm Quadratic Average: 12.398643493652344
Nearest Class Center Accuracy: 0.099

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.49574610590934753
Inter Cos: 0.23645515739917755
Norm Quadratic Average: 9.694454193115234
Nearest Class Center Accuracy: 0.1

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6571313738822937
Inter Cos: 0.2644551992416382
Norm Quadratic Average: 10.422381401062012
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7504337430000305
Inter Cos: 0.26940762996673584
Norm Quadratic Average: 10.708954811096191
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 39.123809814453125
Linear Weight Rank: 4031
Intra Cos: 0.8645482659339905
Inter Cos: 0.22491753101348877
Norm Quadratic Average: 56.07775115966797
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 18.28003692626953
Linear Weight Rank: 3660
Intra Cos: 0.9107514023780823
Inter Cos: 0.23624438047409058
Norm Quadratic Average: 39.49345397949219
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 9.05010986328125
Linear Weight Rank: 98
Intra Cos: 0.9341871738433838
Inter Cos: 0.28845903277397156
Norm Quadratic Average: 33.5660514831543
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9599851369857788
Inter Cos: 0.48390987515449524
Norm Quadratic Average: 49.69960403442383
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 2.9558522468566895
Accuracy: 0.5701
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.23326140642166138, Weights: 0.028528377413749695
NC2 Equiangle: Features: 0.17583230991556187, Weights: 0.10906469479955808
NC3 Self-Duality: 0.452526330947876
NC4 NCC Mismatch: 0.09219999999999995

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621266715228558
Inter Cos: 0.406754732131958
Norm Quadratic Average: 29.42218780517578
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.007679647766053677
Inter Cos: 0.18661434948444366
Norm Quadratic Average: 64.48750305175781
Nearest Class Center Accuracy: 0.2299

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012191626243293285
Inter Cos: 0.23890164494514465
Norm Quadratic Average: 39.52396011352539
Nearest Class Center Accuracy: 0.3573

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011599208228290081
Inter Cos: 0.14224648475646973
Norm Quadratic Average: 34.872684478759766
Nearest Class Center Accuracy: 0.4593

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016619279980659485
Inter Cos: 0.18479622900485992
Norm Quadratic Average: 23.32061195373535
Nearest Class Center Accuracy: 0.5036

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0161844901740551
Inter Cos: 0.1608092337846756
Norm Quadratic Average: 21.353084564208984
Nearest Class Center Accuracy: 0.55

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015810005366802216
Inter Cos: 0.1435539722442627
Norm Quadratic Average: 20.703571319580078
Nearest Class Center Accuracy: 0.5721

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014889783225953579
Inter Cos: 0.12322131544351578
Norm Quadratic Average: 20.70625114440918
Nearest Class Center Accuracy: 0.5928

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018032554537057877
Inter Cos: 0.14688335359096527
Norm Quadratic Average: 12.757040023803711
Nearest Class Center Accuracy: 0.6237

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020641203969717026
Inter Cos: 0.1652812510728836
Norm Quadratic Average: 13.106818199157715
Nearest Class Center Accuracy: 0.6338

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025800175964832306
Inter Cos: 0.20444580912590027
Norm Quadratic Average: 12.833287239074707
Nearest Class Center Accuracy: 0.628

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.035252440720796585
Inter Cos: 0.26326948404312134
Norm Quadratic Average: 13.733591079711914
Nearest Class Center Accuracy: 0.6178

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07327345758676529
Inter Cos: 0.358695387840271
Norm Quadratic Average: 11.81134033203125
Nearest Class Center Accuracy: 0.5841

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.14394496381282806
Inter Cos: 0.48924463987350464
Norm Quadratic Average: 8.83038330078125
Nearest Class Center Accuracy: 0.5814

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.18494674563407898
Inter Cos: 0.5031962394714355
Norm Quadratic Average: 9.180471420288086
Nearest Class Center Accuracy: 0.5771

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20237720012664795
Inter Cos: 0.4760811924934387
Norm Quadratic Average: 9.194425582885742
Nearest Class Center Accuracy: 0.5764

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 39.123809814453125
Linear Weight Rank: 4031
Intra Cos: 0.24971537292003632
Inter Cos: 0.4390481412410736
Norm Quadratic Average: 46.05782699584961
Nearest Class Center Accuracy: 0.569

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 18.28003692626953
Linear Weight Rank: 3660
Intra Cos: 0.23768854141235352
Inter Cos: 0.43423154950141907
Norm Quadratic Average: 32.11864471435547
Nearest Class Center Accuracy: 0.573

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 9.05010986328125
Linear Weight Rank: 98
Intra Cos: 0.24338053166866302
Inter Cos: 0.5094857811927795
Norm Quadratic Average: 27.46556282043457
Nearest Class Center Accuracy: 0.5721

Output Layer:
Intra Cos: 0.2751617729663849
Inter Cos: 0.649969220161438
Norm Quadratic Average: 40.938785552978516
Nearest Class Center Accuracy: 0.5713

