Model save path: ./New_Models/bn_False_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.0003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477277636528015
Norm Quadratic Average: 27.597183227539062
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01897493191063404
Inter Cos: 0.07868923246860504
Norm Quadratic Average: 40.772491455078125
Nearest Class Center Accuracy: 0.34608

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018715009093284607
Inter Cos: 0.06463392823934555
Norm Quadratic Average: 43.72718048095703
Nearest Class Center Accuracy: 0.48556

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020303083583712578
Inter Cos: 0.05436530336737633
Norm Quadratic Average: 58.001522064208984
Nearest Class Center Accuracy: 0.56388

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024878837168216705
Inter Cos: 0.05975669249892235
Norm Quadratic Average: 39.3193473815918
Nearest Class Center Accuracy: 0.61948

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.030108056962490082
Inter Cos: 0.052862748503685
Norm Quadratic Average: 35.96280288696289
Nearest Class Center Accuracy: 0.66472

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03603074699640274
Inter Cos: 0.0486656054854393
Norm Quadratic Average: 27.363758087158203
Nearest Class Center Accuracy: 0.70332

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.041150107979774475
Inter Cos: 0.04478970542550087
Norm Quadratic Average: 20.831878662109375
Nearest Class Center Accuracy: 0.73576

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06340562552213669
Inter Cos: 0.064226895570755
Norm Quadratic Average: 9.27061653137207
Nearest Class Center Accuracy: 0.80766

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.13200324773788452
Inter Cos: 0.09516517072916031
Norm Quadratic Average: 5.725605010986328
Nearest Class Center Accuracy: 0.8538

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.24751169979572296
Inter Cos: 0.16645391285419464
Norm Quadratic Average: 3.687713861465454
Nearest Class Center Accuracy: 0.91382

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.39788544178009033
Inter Cos: 0.20660088956356049
Norm Quadratic Average: 3.005977153778076
Nearest Class Center Accuracy: 0.96

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6202006936073303
Inter Cos: 0.25632670521736145
Norm Quadratic Average: 2.0336318016052246
Nearest Class Center Accuracy: 0.9805

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8368681073188782
Inter Cos: 0.21078403294086456
Norm Quadratic Average: 1.9650243520736694
Nearest Class Center Accuracy: 0.9934

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8959407806396484
Inter Cos: 0.2072693258523941
Norm Quadratic Average: 2.1201388835906982
Nearest Class Center Accuracy: 0.99816

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9196038246154785
Inter Cos: 0.21911032497882843
Norm Quadratic Average: 2.259392738342285
Nearest Class Center Accuracy: 0.99972

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 38.515480041503906
Linear Weight Rank: 4031
Intra Cos: 0.9434094429016113
Inter Cos: 0.29332515597343445
Norm Quadratic Average: 15.136995315551758
Nearest Class Center Accuracy: 0.99994

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 15.943594932556152
Linear Weight Rank: 3669
Intra Cos: 0.9460081458091736
Inter Cos: 0.2993888258934021
Norm Quadratic Average: 14.835457801818848
Nearest Class Center Accuracy: 0.99998

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 3.4080922603607178
Linear Weight Rank: 10
Intra Cos: 0.9393235445022583
Inter Cos: 0.22575318813323975
Norm Quadratic Average: 15.28895378112793
Nearest Class Center Accuracy: 1.0

Output Layer:
Intra Cos: 0.9494631886482239
Inter Cos: 0.2998673915863037
Norm Quadratic Average: 18.526769638061523
Nearest Class Center Accuracy: 1.0

Test Set:
Average Loss: 0.9172778920173645
Accuracy: 0.8382
NC1 Within Class Collapse: 4.173345565795898
NC2 Equinorm: Features: 0.21068698167800903, Weights: 0.019044427201151848
NC2 Equiangle: Features: 0.22610706753200954, Weights: 0.1447565714518229
NC3 Self-Duality: 0.21315568685531616
NC4 NCC Mismatch: 0.032200000000000006

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526075407862663
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.550134658813477
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017218757420778275
Inter Cos: 0.07823293656110764
Norm Quadratic Average: 40.73817825317383
Nearest Class Center Accuracy: 0.3636

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018123598769307137
Inter Cos: 0.06545934081077576
Norm Quadratic Average: 43.69626235961914
Nearest Class Center Accuracy: 0.5

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019515233114361763
Inter Cos: 0.05486626923084259
Norm Quadratic Average: 57.978721618652344
Nearest Class Center Accuracy: 0.5767

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022974813356995583
Inter Cos: 0.06103275716304779
Norm Quadratic Average: 39.326786041259766
Nearest Class Center Accuracy: 0.6242

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.027562949806451797
Inter Cos: 0.05413307994604111
Norm Quadratic Average: 35.98946762084961
Nearest Class Center Accuracy: 0.6618

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03264644369482994
Inter Cos: 0.050034888088703156
Norm Quadratic Average: 27.374074935913086
Nearest Class Center Accuracy: 0.6866

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.036791786551475525
Inter Cos: 0.04631679132580757
Norm Quadratic Average: 20.818836212158203
Nearest Class Center Accuracy: 0.7062

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05335530266165733
Inter Cos: 0.0655742883682251
Norm Quadratic Average: 9.238781929016113
Nearest Class Center Accuracy: 0.7456

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.11098599433898926
Inter Cos: 0.09227980673313141
Norm Quadratic Average: 5.678997039794922
Nearest Class Center Accuracy: 0.7579

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.20588000118732452
Inter Cos: 0.16824384033679962
Norm Quadratic Average: 3.643455743789673
Nearest Class Center Accuracy: 0.7797

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.28335854411125183
Inter Cos: 0.219169020652771
Norm Quadratic Average: 2.9563353061676025
Nearest Class Center Accuracy: 0.8032

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4268794357776642
Inter Cos: 0.3033704459667206
Norm Quadratic Average: 1.9820446968078613
Nearest Class Center Accuracy: 0.8135

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5263938903808594
Inter Cos: 0.32775601744651794
Norm Quadratic Average: 1.8870012760162354
Nearest Class Center Accuracy: 0.8199

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5249735116958618
Inter Cos: 0.2867834270000458
Norm Quadratic Average: 2.019364833831787
Nearest Class Center Accuracy: 0.825

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5086249709129333
Inter Cos: 0.2544457018375397
Norm Quadratic Average: 2.1412711143493652
Nearest Class Center Accuracy: 0.8313

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 38.515480041503906
Linear Weight Rank: 4031
Intra Cos: 0.513066828250885
Inter Cos: 0.21486537158489227
Norm Quadratic Average: 14.274296760559082
Nearest Class Center Accuracy: 0.8329

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 15.943594932556152
Linear Weight Rank: 3669
Intra Cos: 0.5009536147117615
Inter Cos: 0.19701531529426575
Norm Quadratic Average: 14.02921199798584
Nearest Class Center Accuracy: 0.8336

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 3.4080922603607178
Linear Weight Rank: 10
Intra Cos: 0.49414747953414917
Inter Cos: 0.21760648488998413
Norm Quadratic Average: 14.566436767578125
Nearest Class Center Accuracy: 0.8351

Output Layer:
Intra Cos: 0.514130175113678
Inter Cos: 0.34454742074012756
Norm Quadratic Average: 17.639848709106445
Nearest Class Center Accuracy: 0.8366

