Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477276891469955
Norm Quadratic Average: 27.597177505493164
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012105842120945454
Inter Cos: 0.058300890028476715
Norm Quadratic Average: 8.57067584991455
Nearest Class Center Accuracy: 0.33906

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017663605511188507
Inter Cos: 0.06826305389404297
Norm Quadratic Average: 6.33811616897583
Nearest Class Center Accuracy: 0.4765

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01383423712104559
Inter Cos: 0.05223631486296654
Norm Quadratic Average: 4.670205593109131
Nearest Class Center Accuracy: 0.54532

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016129225492477417
Inter Cos: 0.05452652648091316
Norm Quadratic Average: 3.3517701625823975
Nearest Class Center Accuracy: 0.62356

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017515966668725014
Inter Cos: 0.04236525297164917
Norm Quadratic Average: 2.423393487930298
Nearest Class Center Accuracy: 0.68336

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01992606930434704
Inter Cos: 0.04121354594826698
Norm Quadratic Average: 2.149595260620117
Nearest Class Center Accuracy: 0.7235

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019971366971731186
Inter Cos: 0.03653383627533913
Norm Quadratic Average: 2.0383763313293457
Nearest Class Center Accuracy: 0.78328

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.043724846094846725
Inter Cos: 0.0456588938832283
Norm Quadratic Average: 1.5266344547271729
Nearest Class Center Accuracy: 0.90546

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.10194139182567596
Inter Cos: 0.07013954967260361
Norm Quadratic Average: 0.9854112863540649
Nearest Class Center Accuracy: 0.9535

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2784820795059204
Inter Cos: 0.11253152787685394
Norm Quadratic Average: 0.7685422301292419
Nearest Class Center Accuracy: 0.9711

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4665224850177765
Inter Cos: 0.09344664216041565
Norm Quadratic Average: 0.5145909190177917
Nearest Class Center Accuracy: 0.99874

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7532727122306824
Inter Cos: 0.06204470992088318
Norm Quadratic Average: 0.36425909399986267
Nearest Class Center Accuracy: 1.0

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9434776306152344
Inter Cos: 0.023586591705679893
Norm Quadratic Average: 0.31486889719963074
Nearest Class Center Accuracy: 1.0

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9803519248962402
Inter Cos: -0.006982053630053997
Norm Quadratic Average: 0.4536445140838623
Nearest Class Center Accuracy: 1.0

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9940266609191895
Inter Cos: -0.031376469880342484
Norm Quadratic Average: 0.9178164005279541
Nearest Class Center Accuracy: 1.0

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.2348837852478027
Linear Weight Rank: 2961
Intra Cos: 0.9984747171401978
Inter Cos: -0.05293431878089905
Norm Quadratic Average: 24.65997314453125
Nearest Class Center Accuracy: 1.0

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.30135178565979
Linear Weight Rank: 975
Intra Cos: 0.9988248944282532
Inter Cos: -0.011520642787218094
Norm Quadratic Average: 16.878149032592773
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.2540433406829834
Linear Weight Rank: 9
Intra Cos: 0.9988393783569336
Inter Cos: 0.05546436458826065
Norm Quadratic Average: 11.99233627319336
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9990787506103516
Inter Cos: 0.10633258521556854
Norm Quadratic Average: 8.994531631469727
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.47638080835342406
Accuracy: 0.8907
NC1 Within Class Collapse: 2.1882729530334473
NC2 Equinorm: Features: 0.11778520792722702, Weights: 0.008486238308250904
NC2 Equiangle: Features: 0.10149926079644098, Weights: 0.02791121006011963
NC3 Self-Duality: 0.049782514572143555
NC4 NCC Mismatch: 0.006800000000000028

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526073545217514
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.55013656616211
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010738814249634743
Inter Cos: 0.05903908982872963
Norm Quadratic Average: 8.564241409301758
Nearest Class Center Accuracy: 0.3599

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01635701023042202
Inter Cos: 0.06985484063625336
Norm Quadratic Average: 6.336798191070557
Nearest Class Center Accuracy: 0.491

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012944911606609821
Inter Cos: 0.053057488054037094
Norm Quadratic Average: 4.670406341552734
Nearest Class Center Accuracy: 0.5614

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015095117501914501
Inter Cos: 0.05569438636302948
Norm Quadratic Average: 3.3528623580932617
Nearest Class Center Accuracy: 0.6312

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016026558354496956
Inter Cos: 0.043269019573926926
Norm Quadratic Average: 2.424225330352783
Nearest Class Center Accuracy: 0.6782

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017986787483096123
Inter Cos: 0.04223417118191719
Norm Quadratic Average: 2.1486711502075195
Nearest Class Center Accuracy: 0.7102

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01719694770872593
Inter Cos: 0.037657901644706726
Norm Quadratic Average: 2.034130334854126
Nearest Class Center Accuracy: 0.7503

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.033486850559711456
Inter Cos: 0.04820423573255539
Norm Quadratic Average: 1.516940951347351
Nearest Class Center Accuracy: 0.8239

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08140967786312103
Inter Cos: 0.07649131119251251
Norm Quadratic Average: 0.9658743739128113
Nearest Class Center Accuracy: 0.8454

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.23609957098960876
Inter Cos: 0.1474493145942688
Norm Quadratic Average: 0.7387585043907166
Nearest Class Center Accuracy: 0.8319

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.36276349425315857
Inter Cos: 0.16861064732074738
Norm Quadratic Average: 0.49020421504974365
Nearest Class Center Accuracy: 0.8688

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5173863768577576
Inter Cos: 0.20478351414203644
Norm Quadratic Average: 0.3432411551475525
Nearest Class Center Accuracy: 0.8852

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.595888614654541
Inter Cos: 0.11819805949926376
Norm Quadratic Average: 0.2918664216995239
Nearest Class Center Accuracy: 0.8899

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5994653701782227
Inter Cos: 0.06932076811790466
Norm Quadratic Average: 0.4199818968772888
Nearest Class Center Accuracy: 0.8898

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6196843385696411
Inter Cos: 0.1116989254951477
Norm Quadratic Average: 0.8522152900695801
Nearest Class Center Accuracy: 0.8903

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.2348837852478027
Linear Weight Rank: 2961
Intra Cos: 0.6398738026618958
Inter Cos: 0.16514666378498077
Norm Quadratic Average: 22.856731414794922
Nearest Class Center Accuracy: 0.8906

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.30135178565979
Linear Weight Rank: 975
Intra Cos: 0.6416776776313782
Inter Cos: 0.1728222370147705
Norm Quadratic Average: 15.658588409423828
Nearest Class Center Accuracy: 0.8904

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.2540433406829834
Linear Weight Rank: 9
Intra Cos: 0.647226095199585
Inter Cos: 0.19779250025749207
Norm Quadratic Average: 11.157059669494629
Nearest Class Center Accuracy: 0.8906

Output Layer:
Intra Cos: 0.6502496004104614
Inter Cos: 0.21138523519039154
Norm Quadratic Average: 8.381171226501465
Nearest Class Center Accuracy: 0.8906

