Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02289319410920143
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326311111450195
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01300730835646391
Inter Cos: 0.028905745595693588
Norm Quadratic Average: 30.498207092285156
Nearest Class Center Accuracy: 0.04026

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018916182219982147
Inter Cos: 0.03786639869213104
Norm Quadratic Average: 20.590438842773438
Nearest Class Center Accuracy: 0.05796

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014204313047230244
Inter Cos: 0.028817975893616676
Norm Quadratic Average: 15.794844627380371
Nearest Class Center Accuracy: 0.06424

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022107161581516266
Inter Cos: 0.021195320412516594
Norm Quadratic Average: 11.473827362060547
Nearest Class Center Accuracy: 0.07082

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022691411897540092
Inter Cos: 0.020544735714793205
Norm Quadratic Average: 8.95879077911377
Nearest Class Center Accuracy: 0.07542

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02286667376756668
Inter Cos: 0.019650699570775032
Norm Quadratic Average: 8.862109184265137
Nearest Class Center Accuracy: 0.07762

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021764833480119705
Inter Cos: 0.01911468617618084
Norm Quadratic Average: 9.074289321899414
Nearest Class Center Accuracy: 0.07942

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03175464645028114
Inter Cos: 0.02539265714585781
Norm Quadratic Average: 6.225980758666992
Nearest Class Center Accuracy: 0.08608

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04055362939834595
Inter Cos: 0.030603989958763123
Norm Quadratic Average: 4.399428844451904
Nearest Class Center Accuracy: 0.08996

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05622872710227966
Inter Cos: 0.03851483762264252
Norm Quadratic Average: 3.8456006050109863
Nearest Class Center Accuracy: 0.09436

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0877203568816185
Inter Cos: 0.05611439794301987
Norm Quadratic Average: 3.634688377380371
Nearest Class Center Accuracy: 0.09756

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.22979740798473358
Inter Cos: 0.11254770308732986
Norm Quadratic Average: 2.839308500289917
Nearest Class Center Accuracy: 0.09896

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5904353260993958
Inter Cos: 0.20543818175792694
Norm Quadratic Average: 1.7330880165100098
Nearest Class Center Accuracy: 0.1

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7977602481842041
Inter Cos: 0.22116881608963013
Norm Quadratic Average: 1.6568301916122437
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8825445771217346
Inter Cos: 0.20545190572738647
Norm Quadratic Average: 1.5174920558929443
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 6.297792911529541
Linear Weight Rank: 4024
Intra Cos: 0.9488383531570435
Inter Cos: 0.31716489791870117
Norm Quadratic Average: 36.94406509399414
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 6.262871742248535
Linear Weight Rank: 3533
Intra Cos: 0.9582488536834717
Inter Cos: 0.40072888135910034
Norm Quadratic Average: 30.83450698852539
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 6.161012172698975
Linear Weight Rank: 98
Intra Cos: 0.9572399854660034
Inter Cos: 0.41117990016937256
Norm Quadratic Average: 30.05130958557129
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9637989401817322
Inter Cos: 0.44917523860931396
Norm Quadratic Average: 36.19662857055664
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 2.313346915435791
Accuracy: 0.5969
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.168752983212471, Weights: 0.024499790742993355
NC2 Equiangle: Features: 0.2025799498895202, Weights: 0.11752286044034091
NC3 Self-Duality: 0.35370203852653503
NC4 NCC Mismatch: 0.06789999999999996

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621266715228558
Inter Cos: 0.406754732131958
Norm Quadratic Average: 29.42218780517578
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.007429418154060841
Inter Cos: 0.18016721308231354
Norm Quadratic Average: 30.70008659362793
Nearest Class Center Accuracy: 0.2339

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011068477295339108
Inter Cos: 0.23134952783584595
Norm Quadratic Average: 20.730195999145508
Nearest Class Center Accuracy: 0.3624

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01086763758212328
Inter Cos: 0.14404074847698212
Norm Quadratic Average: 15.870354652404785
Nearest Class Center Accuracy: 0.4728

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015037291683256626
Inter Cos: 0.18086938560009003
Norm Quadratic Average: 11.523333549499512
Nearest Class Center Accuracy: 0.5207

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015011300332844257
Inter Cos: 0.15086613595485687
Norm Quadratic Average: 8.986383438110352
Nearest Class Center Accuracy: 0.5659

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014836649410426617
Inter Cos: 0.13314548134803772
Norm Quadratic Average: 8.872233390808105
Nearest Class Center Accuracy: 0.5889

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013495366089046001
Inter Cos: 0.1160225123167038
Norm Quadratic Average: 9.072860717773438
Nearest Class Center Accuracy: 0.6092

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01625503972172737
Inter Cos: 0.14823196828365326
Norm Quadratic Average: 6.215011119842529
Nearest Class Center Accuracy: 0.6449

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016558606177568436
Inter Cos: 0.15755833685398102
Norm Quadratic Average: 4.359990119934082
Nearest Class Center Accuracy: 0.6639

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020852286368608475
Inter Cos: 0.1876765489578247
Norm Quadratic Average: 3.7500154972076416
Nearest Class Center Accuracy: 0.6566

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02855008840560913
Inter Cos: 0.24297048151493073
Norm Quadratic Average: 3.476616621017456
Nearest Class Center Accuracy: 0.6448

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08163917809724808
Inter Cos: 0.3496379852294922
Norm Quadratic Average: 2.60146427154541
Nearest Class Center Accuracy: 0.5984

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.15707087516784668
Inter Cos: 0.42898520827293396
Norm Quadratic Average: 1.491758108139038
Nearest Class Center Accuracy: 0.5893

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20834402740001678
Inter Cos: 0.4078376293182373
Norm Quadratic Average: 1.3585156202316284
Nearest Class Center Accuracy: 0.5884

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.21092312037944794
Inter Cos: 0.42094939947128296
Norm Quadratic Average: 1.306288242340088
Nearest Class Center Accuracy: 0.6055

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 6.297792911529541
Linear Weight Rank: 4024
Intra Cos: 0.22818638384342194
Inter Cos: 0.48858729004859924
Norm Quadratic Average: 32.20772171020508
Nearest Class Center Accuracy: 0.605

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 6.262871742248535
Linear Weight Rank: 3533
Intra Cos: 0.2466873973608017
Inter Cos: 0.50931715965271
Norm Quadratic Average: 27.673044204711914
Nearest Class Center Accuracy: 0.6031

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 6.161012172698975
Linear Weight Rank: 98
Intra Cos: 0.255124568939209
Inter Cos: 0.5327352285385132
Norm Quadratic Average: 27.630529403686523
Nearest Class Center Accuracy: 0.6031

Output Layer:
Intra Cos: 0.273681640625
Inter Cos: 0.5957784652709961
Norm Quadratic Average: 33.57722854614258
Nearest Class Center Accuracy: 0.602

