Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.0003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477276891469955
Norm Quadratic Average: 27.597177505493164
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011448313482105732
Inter Cos: 0.05293534696102142
Norm Quadratic Average: 59.786216735839844
Nearest Class Center Accuracy: 0.3499

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015331098809838295
Inter Cos: 0.061448484659194946
Norm Quadratic Average: 34.5544319152832
Nearest Class Center Accuracy: 0.46716

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013031519949436188
Inter Cos: 0.05068456754088402
Norm Quadratic Average: 32.92343521118164
Nearest Class Center Accuracy: 0.53746

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016663651913404465
Inter Cos: 0.04865391552448273
Norm Quadratic Average: 21.832773208618164
Nearest Class Center Accuracy: 0.61358

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017678191885352135
Inter Cos: 0.04194518178701401
Norm Quadratic Average: 22.39061737060547
Nearest Class Center Accuracy: 0.65522

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018847554922103882
Inter Cos: 0.035899825394153595
Norm Quadratic Average: 21.96990203857422
Nearest Class Center Accuracy: 0.698

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020625758916139603
Inter Cos: 0.03280963376164436
Norm Quadratic Average: 21.693923950195312
Nearest Class Center Accuracy: 0.74756

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03824445232748985
Inter Cos: 0.057008419185876846
Norm Quadratic Average: 15.562614440917969
Nearest Class Center Accuracy: 0.83832

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07923518866300583
Inter Cos: 0.06936976313591003
Norm Quadratic Average: 18.102493286132812
Nearest Class Center Accuracy: 0.91392

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.14539361000061035
Inter Cos: 0.07238192111253738
Norm Quadratic Average: 18.808082580566406
Nearest Class Center Accuracy: 0.95412

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.23814456164836884
Inter Cos: 0.09261856228113174
Norm Quadratic Average: 19.44637107849121
Nearest Class Center Accuracy: 0.97504

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.47126898169517517
Inter Cos: 0.14840221405029297
Norm Quadratic Average: 15.372273445129395
Nearest Class Center Accuracy: 0.98418

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7610182762145996
Inter Cos: 0.09272788465023041
Norm Quadratic Average: 10.727505683898926
Nearest Class Center Accuracy: 0.99668

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8323303461074829
Inter Cos: 0.035490982234478
Norm Quadratic Average: 11.304123878479004
Nearest Class Center Accuracy: 0.99874

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8569731712341309
Inter Cos: -0.013178443536162376
Norm Quadratic Average: 11.630345344543457
Nearest Class Center Accuracy: 0.99776

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 38.515010833740234
Linear Weight Rank: 4031
Intra Cos: 0.8492133021354675
Inter Cos: 0.022090110927820206
Norm Quadratic Average: 68.53448486328125
Nearest Class Center Accuracy: 0.99878

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 16.041181564331055
Linear Weight Rank: 3669
Intra Cos: 0.9573793411254883
Inter Cos: 0.06359153240919113
Norm Quadratic Average: 37.059242248535156
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.874438762664795
Linear Weight Rank: 10
Intra Cos: 0.9621131420135498
Inter Cos: 0.06691378355026245
Norm Quadratic Average: 21.929946899414062
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.991426944732666
Inter Cos: 0.23675106465816498
Norm Quadratic Average: 17.643869400024414
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.8499241955399514
Accuracy: 0.8648
NC1 Within Class Collapse: 3.2328553199768066
NC2 Equinorm: Features: 0.1746446192264557, Weights: 0.020804302766919136
NC2 Equiangle: Features: 0.11345834732055664, Weights: 0.09699308607313369
NC3 Self-Duality: 0.40987569093704224
NC4 NCC Mismatch: 0.03739999999999999

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526073545217514
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.55013656616211
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010228975676000118
Inter Cos: 0.05393657088279724
Norm Quadratic Average: 59.735530853271484
Nearest Class Center Accuracy: 0.3726

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014190549962222576
Inter Cos: 0.06285373866558075
Norm Quadratic Average: 34.54216384887695
Nearest Class Center Accuracy: 0.4828

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012199992313981056
Inter Cos: 0.05143959820270538
Norm Quadratic Average: 32.92921447753906
Nearest Class Center Accuracy: 0.5505

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015482506714761257
Inter Cos: 0.049602873623371124
Norm Quadratic Average: 21.830577850341797
Nearest Class Center Accuracy: 0.617

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01611972600221634
Inter Cos: 0.04290112853050232
Norm Quadratic Average: 22.383546829223633
Nearest Class Center Accuracy: 0.6511

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01697617396712303
Inter Cos: 0.036946460604667664
Norm Quadratic Average: 21.957075119018555
Nearest Class Center Accuracy: 0.6866

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01822572387754917
Inter Cos: 0.03412899002432823
Norm Quadratic Average: 21.668621063232422
Nearest Class Center Accuracy: 0.7185

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.030930664390325546
Inter Cos: 0.05942300334572792
Norm Quadratic Average: 15.52518367767334
Nearest Class Center Accuracy: 0.7685

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0600266195833683
Inter Cos: 0.07500118017196655
Norm Quadratic Average: 17.977916717529297
Nearest Class Center Accuracy: 0.8031

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1026696190237999
Inter Cos: 0.07997757941484451
Norm Quadratic Average: 18.566234588623047
Nearest Class Center Accuracy: 0.819

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1609726846218109
Inter Cos: 0.1044449582695961
Norm Quadratic Average: 19.057676315307617
Nearest Class Center Accuracy: 0.8316

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.34052586555480957
Inter Cos: 0.1985241025686264
Norm Quadratic Average: 14.904134750366211
Nearest Class Center Accuracy: 0.8298

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5188218951225281
Inter Cos: 0.24372296035289764
Norm Quadratic Average: 10.183332443237305
Nearest Class Center Accuracy: 0.8362

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5699456930160522
Inter Cos: 0.23315146565437317
Norm Quadratic Average: 10.59012508392334
Nearest Class Center Accuracy: 0.8426

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5710019469261169
Inter Cos: 0.20962300896644592
Norm Quadratic Average: 10.809676170349121
Nearest Class Center Accuracy: 0.8474

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 38.515010833740234
Linear Weight Rank: 4031
Intra Cos: 0.6034302115440369
Inter Cos: 0.1983620524406433
Norm Quadratic Average: 63.42058563232422
Nearest Class Center Accuracy: 0.8464

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 16.041181564331055
Linear Weight Rank: 3669
Intra Cos: 0.5468562841415405
Inter Cos: 0.1366291046142578
Norm Quadratic Average: 33.8809814453125
Nearest Class Center Accuracy: 0.8576

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.874438762664795
Linear Weight Rank: 10
Intra Cos: 0.5313094258308411
Inter Cos: 0.13685593008995056
Norm Quadratic Average: 20.356441497802734
Nearest Class Center Accuracy: 0.8593

Output Layer:
Intra Cos: 0.598373532295227
Inter Cos: 0.2798725366592407
Norm Quadratic Average: 16.01826286315918
Nearest Class Center Accuracy: 0.8644

