Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.01.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477276891469955
Norm Quadratic Average: 27.597177505493164
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011169730685651302
Inter Cos: 0.05974097177386284
Norm Quadratic Average: 6.287117004394531
Nearest Class Center Accuracy: 0.33872

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016898492351174355
Inter Cos: 0.05808500200510025
Norm Quadratic Average: 4.913845062255859
Nearest Class Center Accuracy: 0.47442

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01220304798334837
Inter Cos: 0.04648065194487572
Norm Quadratic Average: 3.5617523193359375
Nearest Class Center Accuracy: 0.56286

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01406087912619114
Inter Cos: 0.04693089425563812
Norm Quadratic Average: 2.3927040100097656
Nearest Class Center Accuracy: 0.63416

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016384048387408257
Inter Cos: 0.03780807927250862
Norm Quadratic Average: 1.7717382907867432
Nearest Class Center Accuracy: 0.69566

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019559066742658615
Inter Cos: 0.03421026095747948
Norm Quadratic Average: 1.4768925905227661
Nearest Class Center Accuracy: 0.75954

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025499671697616577
Inter Cos: 0.030805133283138275
Norm Quadratic Average: 1.2473171949386597
Nearest Class Center Accuracy: 0.83924

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07576483488082886
Inter Cos: 0.0450836680829525
Norm Quadratic Average: 0.8906498551368713
Nearest Class Center Accuracy: 0.94116

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1969437152147293
Inter Cos: 0.07163210213184357
Norm Quadratic Average: 0.6063624620437622
Nearest Class Center Accuracy: 0.96282

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4338564872741699
Inter Cos: 0.10756686329841614
Norm Quadratic Average: 0.42505064606666565
Nearest Class Center Accuracy: 0.9871

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5670287013053894
Inter Cos: 0.0466422513127327
Norm Quadratic Average: 0.2570182979106903
Nearest Class Center Accuracy: 0.99946

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7841583490371704
Inter Cos: 0.04103533923625946
Norm Quadratic Average: 0.18639056384563446
Nearest Class Center Accuracy: 1.0

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9324989914894104
Inter Cos: 0.06063374504446983
Norm Quadratic Average: 0.181890070438385
Nearest Class Center Accuracy: 1.0

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9920827150344849
Inter Cos: -0.0014100158587098122
Norm Quadratic Average: 0.4074767827987671
Nearest Class Center Accuracy: 1.0

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9977517127990723
Inter Cos: -0.05041606351733208
Norm Quadratic Average: 1.012378215789795
Nearest Class Center Accuracy: 1.0

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.0906851291656494
Linear Weight Rank: 10
Intra Cos: 0.9991933703422546
Inter Cos: -0.03418711572885513
Norm Quadratic Average: 25.16068458557129
Nearest Class Center Accuracy: 1.0

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.0955379009246826
Linear Weight Rank: 1428
Intra Cos: 0.9993005394935608
Inter Cos: 0.006776103749871254
Norm Quadratic Average: 16.463041305541992
Nearest Class Center Accuracy: 1.0

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.0936901569366455
Linear Weight Rank: 9
Intra Cos: 0.9993746280670166
Inter Cos: 0.06780387461185455
Norm Quadratic Average: 10.95026683807373
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9995782375335693
Inter Cos: 0.1592627912759781
Norm Quadratic Average: 7.7239789962768555
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.4218067709684372
Accuracy: 0.8966
NC1 Within Class Collapse: 2.0168323516845703
NC2 Equinorm: Features: 0.09802360832691193, Weights: 0.006216782610863447
NC2 Equiangle: Features: 0.09249691433376736, Weights: 0.034404129452175566
NC3 Self-Duality: 0.021589552983641624
NC4 NCC Mismatch: 0.0047000000000000375

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526073545217514
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.55013656616211
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01102684810757637
Inter Cos: 0.060494594275951385
Norm Quadratic Average: 6.281904697418213
Nearest Class Center Accuracy: 0.3636

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015684515237808228
Inter Cos: 0.05906843766570091
Norm Quadratic Average: 4.91195011138916
Nearest Class Center Accuracy: 0.4935

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011359068565070629
Inter Cos: 0.04703420773148537
Norm Quadratic Average: 3.5625758171081543
Nearest Class Center Accuracy: 0.5844

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01314008142799139
Inter Cos: 0.047864001244306564
Norm Quadratic Average: 2.393867015838623
Nearest Class Center Accuracy: 0.6419

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014841577969491482
Inter Cos: 0.03836073726415634
Norm Quadratic Average: 1.7726449966430664
Nearest Class Center Accuracy: 0.6923

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016840720549225807
Inter Cos: 0.034719936549663544
Norm Quadratic Average: 1.474586009979248
Nearest Class Center Accuracy: 0.7333

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020087795332074165
Inter Cos: 0.03177450969815254
Norm Quadratic Average: 1.2410157918930054
Nearest Class Center Accuracy: 0.781

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05393774434924126
Inter Cos: 0.04717439040541649
Norm Quadratic Average: 0.8785183429718018
Nearest Class Center Accuracy: 0.8362

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.16981066763401031
Inter Cos: 0.08315707743167877
Norm Quadratic Average: 0.5855452418327332
Nearest Class Center Accuracy: 0.8423

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.3571561276912689
Inter Cos: 0.18346484005451202
Norm Quadratic Average: 0.40512821078300476
Nearest Class Center Accuracy: 0.8472

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.39457592368125916
Inter Cos: 0.1328555941581726
Norm Quadratic Average: 0.2429383099079132
Nearest Class Center Accuracy: 0.8809

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5586165189743042
Inter Cos: 0.16407035291194916
Norm Quadratic Average: 0.1757376790046692
Nearest Class Center Accuracy: 0.8878

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6339397430419922
Inter Cos: 0.13470081984996796
Norm Quadratic Average: 0.17239174246788025
Nearest Class Center Accuracy: 0.8951

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6622681617736816
Inter Cos: 0.1012805923819542
Norm Quadratic Average: 0.38333773612976074
Nearest Class Center Accuracy: 0.8956

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6655277609825134
Inter Cos: 0.13735170662403107
Norm Quadratic Average: 0.9498210549354553
Nearest Class Center Accuracy: 0.896

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.0906851291656494
Linear Weight Rank: 10
Intra Cos: 0.6702427268028259
Inter Cos: 0.12635056674480438
Norm Quadratic Average: 23.5593204498291
Nearest Class Center Accuracy: 0.8958

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.0955379009246826
Linear Weight Rank: 1428
Intra Cos: 0.6781228184700012
Inter Cos: 0.1707386076450348
Norm Quadratic Average: 15.431944847106934
Nearest Class Center Accuracy: 0.8963

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.0936901569366455
Linear Weight Rank: 9
Intra Cos: 0.6853680610656738
Inter Cos: 0.21511569619178772
Norm Quadratic Average: 10.278501510620117
Nearest Class Center Accuracy: 0.8966

Output Layer:
Intra Cos: 0.6974822878837585
Inter Cos: 0.26599234342575073
Norm Quadratic Average: 7.264551162719727
Nearest Class Center Accuracy: 0.8971

