Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.0003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893190383911133
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326326370239258
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013999507762491703
Inter Cos: 0.02678772248327732
Norm Quadratic Average: 65.87705993652344
Nearest Class Center Accuracy: 0.04032

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01822240836918354
Inter Cos: 0.03762972727417946
Norm Quadratic Average: 39.65879440307617
Nearest Class Center Accuracy: 0.05776

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014138978905975819
Inter Cos: 0.02436124160885811
Norm Quadratic Average: 34.7899055480957
Nearest Class Center Accuracy: 0.06398

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020964279770851135
Inter Cos: 0.019972460344433784
Norm Quadratic Average: 23.35857391357422
Nearest Class Center Accuracy: 0.07034

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0218479186296463
Inter Cos: 0.01954488456249237
Norm Quadratic Average: 21.686086654663086
Nearest Class Center Accuracy: 0.07422

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024533621966838837
Inter Cos: 0.019946018233895302
Norm Quadratic Average: 20.911649703979492
Nearest Class Center Accuracy: 0.07696

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024714069440960884
Inter Cos: 0.019847843796014786
Norm Quadratic Average: 20.782642364501953
Nearest Class Center Accuracy: 0.07942

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03657517954707146
Inter Cos: 0.030081314966082573
Norm Quadratic Average: 12.837965965270996
Nearest Class Center Accuracy: 0.08604

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.049935247749090195
Inter Cos: 0.04209005832672119
Norm Quadratic Average: 13.309242248535156
Nearest Class Center Accuracy: 0.08992

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06932773441076279
Inter Cos: 0.05969633162021637
Norm Quadratic Average: 13.16491985321045
Nearest Class Center Accuracy: 0.09304

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10051103681325912
Inter Cos: 0.08062804490327835
Norm Quadratic Average: 14.24674129486084
Nearest Class Center Accuracy: 0.09576

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20903697609901428
Inter Cos: 0.13985469937324524
Norm Quadratic Average: 12.406149864196777
Nearest Class Center Accuracy: 0.0984

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5002475380897522
Inter Cos: 0.2980364263057709
Norm Quadratic Average: 9.605328559875488
Nearest Class Center Accuracy: 0.1

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6622172594070435
Inter Cos: 0.3341742157936096
Norm Quadratic Average: 10.377991676330566
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7403265237808228
Inter Cos: 0.3074485957622528
Norm Quadratic Average: 10.714756965637207
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 39.12562942504883
Linear Weight Rank: 4031
Intra Cos: 0.8465599417686462
Inter Cos: 0.358734130859375
Norm Quadratic Average: 57.141998291015625
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 18.2613468170166
Linear Weight Rank: 3659
Intra Cos: 0.9074766635894775
Inter Cos: 0.3730100393295288
Norm Quadratic Average: 39.82233810424805
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 9.023906707763672
Linear Weight Rank: 98
Intra Cos: 0.935482382774353
Inter Cos: 0.35330507159233093
Norm Quadratic Average: 33.34667205810547
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9606724977493286
Inter Cos: 0.5359688997268677
Norm Quadratic Average: 48.434837341308594
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 2.970068713378906
Accuracy: 0.5751
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.2348264753818512, Weights: 0.02809739299118519
NC2 Equiangle: Features: 0.17166064946338383, Weights: 0.10589308613478535
NC3 Self-Duality: 0.45376548171043396
NC4 NCC Mismatch: 0.08220000000000005

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422189712524414
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.005856444127857685
Inter Cos: 0.1793542057275772
Norm Quadratic Average: 66.3167724609375
Nearest Class Center Accuracy: 0.2327

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010102379135787487
Inter Cos: 0.2281721532344818
Norm Quadratic Average: 39.9317512512207
Nearest Class Center Accuracy: 0.3685

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010446674190461636
Inter Cos: 0.14851754903793335
Norm Quadratic Average: 34.95530319213867
Nearest Class Center Accuracy: 0.4758

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015446183271706104
Inter Cos: 0.17433111369609833
Norm Quadratic Average: 23.451444625854492
Nearest Class Center Accuracy: 0.524

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01543691661208868
Inter Cos: 0.15422095358371735
Norm Quadratic Average: 21.746482849121094
Nearest Class Center Accuracy: 0.5662

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015537877567112446
Inter Cos: 0.1354236751794815
Norm Quadratic Average: 20.937257766723633
Nearest Class Center Accuracy: 0.5841

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014760402031242847
Inter Cos: 0.12295981496572495
Norm Quadratic Average: 20.781572341918945
Nearest Class Center Accuracy: 0.6075

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01801009476184845
Inter Cos: 0.1423630714416504
Norm Quadratic Average: 12.813066482543945
Nearest Class Center Accuracy: 0.6327

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.021249812096357346
Inter Cos: 0.16176113486289978
Norm Quadratic Average: 13.209428787231445
Nearest Class Center Accuracy: 0.6362

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026893995702266693
Inter Cos: 0.20544438064098358
Norm Quadratic Average: 12.952095031738281
Nearest Class Center Accuracy: 0.6256

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03932628408074379
Inter Cos: 0.2500026226043701
Norm Quadratic Average: 13.882635116577148
Nearest Class Center Accuracy: 0.6175

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08079497516155243
Inter Cos: 0.3364267945289612
Norm Quadratic Average: 11.875006675720215
Nearest Class Center Accuracy: 0.5927

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.13456673920154572
Inter Cos: 0.4757353365421295
Norm Quadratic Average: 8.798772811889648
Nearest Class Center Accuracy: 0.5869

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.178610160946846
Inter Cos: 0.4970957636833191
Norm Quadratic Average: 9.195174217224121
Nearest Class Center Accuracy: 0.5789

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20617841184139252
Inter Cos: 0.4680764973163605
Norm Quadratic Average: 9.244062423706055
Nearest Class Center Accuracy: 0.5789

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 39.12562942504883
Linear Weight Rank: 4031
Intra Cos: 0.26049450039863586
Inter Cos: 0.41324514150619507
Norm Quadratic Average: 47.199951171875
Nearest Class Center Accuracy: 0.5723

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 18.2613468170166
Linear Weight Rank: 3659
Intra Cos: 0.24806742370128632
Inter Cos: 0.4379395544528961
Norm Quadratic Average: 32.5363655090332
Nearest Class Center Accuracy: 0.5762

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 9.023906707763672
Linear Weight Rank: 98
Intra Cos: 0.24493582546710968
Inter Cos: 0.5205321907997131
Norm Quadratic Average: 27.41948127746582
Nearest Class Center Accuracy: 0.5779

Output Layer:
Intra Cos: 0.3086340129375458
Inter Cos: 0.6746362447738647
Norm Quadratic Average: 40.091190338134766
Nearest Class Center Accuracy: 0.576

