Model save path: ./New_Models/bn_True_dataset_CIFAR10_epochs_200_lr_0.01_model_type_vgg19_rand_seed_265358_test_samples_None_train_samples_None_weight_decay_0.02.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01989092119038105
Inter Cos: 0.10477276891469955
Norm Quadratic Average: 27.597177505493164
Nearest Class Center Accuracy: 0.26968

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011900809593498707
Inter Cos: 0.06186101213097572
Norm Quadratic Average: 4.275109767913818
Nearest Class Center Accuracy: 0.32754

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020178306847810745
Inter Cos: 0.07576625049114227
Norm Quadratic Average: 3.7171261310577393
Nearest Class Center Accuracy: 0.45424

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014633546583354473
Inter Cos: 0.0535157136619091
Norm Quadratic Average: 2.55621075630188
Nearest Class Center Accuracy: 0.54282

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01616177149116993
Inter Cos: 0.050697699189186096
Norm Quadratic Average: 1.7845110893249512
Nearest Class Center Accuracy: 0.62094

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018235493451356888
Inter Cos: 0.038457877933979034
Norm Quadratic Average: 1.4079937934875488
Nearest Class Center Accuracy: 0.67862

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020685123279690742
Inter Cos: 0.03850910812616348
Norm Quadratic Average: 1.2175103425979614
Nearest Class Center Accuracy: 0.73098

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025258876383304596
Inter Cos: 0.03491874784231186
Norm Quadratic Average: 0.9718994498252869
Nearest Class Center Accuracy: 0.82478

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.08186649531126022
Inter Cos: 0.07255929708480835
Norm Quadratic Average: 0.5408069491386414
Nearest Class Center Accuracy: 0.94774

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.31455573439598083
Inter Cos: 0.12761390209197998
Norm Quadratic Average: 0.30090418457984924
Nearest Class Center Accuracy: 0.97584

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6545137763023376
Inter Cos: 0.1580498069524765
Norm Quadratic Average: 0.1859070211648941
Nearest Class Center Accuracy: 0.99442

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.7380195260047913
Inter Cos: 0.24526505172252655
Norm Quadratic Average: 0.1459379494190216
Nearest Class Center Accuracy: 0.99872

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8833793997764587
Inter Cos: 0.2605704367160797
Norm Quadratic Average: 0.12767301499843597
Nearest Class Center Accuracy: 0.99994

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9259033799171448
Inter Cos: 0.2909332811832428
Norm Quadratic Average: 0.13161709904670715
Nearest Class Center Accuracy: 0.99998

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9907029271125793
Inter Cos: 0.18765296041965485
Norm Quadratic Average: 0.24464893341064453
Nearest Class Center Accuracy: 0.99998

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.997430682182312
Inter Cos: 0.11547309160232544
Norm Quadratic Average: 0.8591015338897705
Nearest Class Center Accuracy: 0.99998

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.000847101211548
Linear Weight Rank: 10
Intra Cos: 0.9984959363937378
Inter Cos: 0.21321024000644684
Norm Quadratic Average: 23.793027877807617
Nearest Class Center Accuracy: 0.99998

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.004544973373413
Linear Weight Rank: 1597
Intra Cos: 0.9988484978675842
Inter Cos: 0.23282644152641296
Norm Quadratic Average: 15.685042381286621
Nearest Class Center Accuracy: 0.99998

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.0039563179016113
Linear Weight Rank: 9
Intra Cos: 0.9990265369415283
Inter Cos: 0.2115161120891571
Norm Quadratic Average: 10.562979698181152
Nearest Class Center Accuracy: 0.99998

Output Layer:
Intra Cos: 0.9992524981498718
Inter Cos: 0.16043737530708313
Norm Quadratic Average: 7.561749458312988
Nearest Class Center Accuracy: 0.99998

Test Set:
Average Loss: 0.45320243275165556
Accuracy: 0.8836
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.09945277869701385, Weights: 0.009866781532764435
NC2 Equiangle: Features: 0.14178036583794487, Weights: 0.10353906419542101
NC3 Self-Duality: 0.042623311281204224
NC4 NCC Mismatch: 0.006299999999999972

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018526073545217514
Inter Cos: 0.1042705774307251
Norm Quadratic Average: 27.55013656616211
Nearest Class Center Accuracy: 0.284

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.010119611397385597
Inter Cos: 0.06252764910459518
Norm Quadratic Average: 4.269237041473389
Nearest Class Center Accuracy: 0.343

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01896537095308304
Inter Cos: 0.07736856490373611
Norm Quadratic Average: 3.715238332748413
Nearest Class Center Accuracy: 0.4708

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013655504211783409
Inter Cos: 0.054091762751340866
Norm Quadratic Average: 2.5572850704193115
Nearest Class Center Accuracy: 0.5627

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015194236300885677
Inter Cos: 0.0514545701444149
Norm Quadratic Average: 1.7856929302215576
Nearest Class Center Accuracy: 0.6316

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01677880994975567
Inter Cos: 0.03905551880598068
Norm Quadratic Average: 1.4088127613067627
Nearest Class Center Accuracy: 0.6756

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018444813787937164
Inter Cos: 0.039165955036878586
Norm Quadratic Average: 1.2165623903274536
Nearest Class Center Accuracy: 0.7129

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020880792289972305
Inter Cos: 0.03656848892569542
Norm Quadratic Average: 0.968500554561615
Nearest Class Center Accuracy: 0.7708

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05858440324664116
Inter Cos: 0.07788904011249542
Norm Quadratic Average: 0.5351928472518921
Nearest Class Center Accuracy: 0.8397

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2658001482486725
Inter Cos: 0.1482042521238327
Norm Quadratic Average: 0.2923547029495239
Nearest Class Center Accuracy: 0.8416

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4978438913822174
Inter Cos: 0.24900247156620026
Norm Quadratic Average: 0.178549125790596
Nearest Class Center Accuracy: 0.8562

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5222751498222351
Inter Cos: 0.23438319563865662
Norm Quadratic Average: 0.13835301995277405
Nearest Class Center Accuracy: 0.8695

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6106300950050354
Inter Cos: 0.24087251722812653
Norm Quadratic Average: 0.12047488242387772
Nearest Class Center Accuracy: 0.8706

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5679908990859985
Inter Cos: 0.19283458590507507
Norm Quadratic Average: 0.12479201704263687
Nearest Class Center Accuracy: 0.8791

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6212230324745178
Inter Cos: 0.1904824823141098
Norm Quadratic Average: 0.2303939163684845
Nearest Class Center Accuracy: 0.8834

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6395135521888733
Inter Cos: 0.23618614673614502
Norm Quadratic Average: 0.8073351979255676
Nearest Class Center Accuracy: 0.8831

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 2.000847101211548
Linear Weight Rank: 10
Intra Cos: 0.645919680595398
Inter Cos: 0.27463215589523315
Norm Quadratic Average: 22.346729278564453
Nearest Class Center Accuracy: 0.8837

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 2.004544973373413
Linear Weight Rank: 1597
Intra Cos: 0.650627613067627
Inter Cos: 0.287023663520813
Norm Quadratic Average: 14.739239692687988
Nearest Class Center Accuracy: 0.8842

Layer 18: Linear(in_features=4096, out_features=10, bias=True)
Linear Weight Norm: 2.0039563179016113
Linear Weight Rank: 9
Intra Cos: 0.6550613045692444
Inter Cos: 0.2853020131587982
Norm Quadratic Average: 9.933069229125977
Nearest Class Center Accuracy: 0.8847

Output Layer:
Intra Cos: 0.6730799078941345
Inter Cos: 0.26176878809928894
Norm Quadratic Average: 7.124239921569824
Nearest Class Center Accuracy: 0.8837

