Model save path: ./New_Models/bn_True_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_979323_test_samples_None_train_samples_None_weight_decay_0.005.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02289319410920143
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326311111450195
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.011709029786288738
Inter Cos: 0.028433820232748985
Norm Quadratic Average: 9.833748817443848
Nearest Class Center Accuracy: 0.03888

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.017972072586417198
Inter Cos: 0.04163503646850586
Norm Quadratic Average: 7.221686363220215
Nearest Class Center Accuracy: 0.05776

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013386286795139313
Inter Cos: 0.03194788843393326
Norm Quadratic Average: 5.382772445678711
Nearest Class Center Accuracy: 0.06352

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020954202860593796
Inter Cos: 0.018757324665784836
Norm Quadratic Average: 3.957223892211914
Nearest Class Center Accuracy: 0.07252

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022260300815105438
Inter Cos: 0.0197809599339962
Norm Quadratic Average: 3.0446689128875732
Nearest Class Center Accuracy: 0.07518

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0244063138961792
Inter Cos: 0.02006777748465538
Norm Quadratic Average: 2.8722176551818848
Nearest Class Center Accuracy: 0.07786

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02173752337694168
Inter Cos: 0.01848285272717476
Norm Quadratic Average: 2.8379929065704346
Nearest Class Center Accuracy: 0.08028

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.032715827226638794
Inter Cos: 0.02539435774087906
Norm Quadratic Average: 2.1281092166900635
Nearest Class Center Accuracy: 0.08702

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04246393218636513
Inter Cos: 0.030837202444672585
Norm Quadratic Average: 1.4019347429275513
Nearest Class Center Accuracy: 0.09152

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06714525818824768
Inter Cos: 0.04789108783006668
Norm Quadratic Average: 1.109856367111206
Nearest Class Center Accuracy: 0.09524

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.1642940789461136
Inter Cos: 0.08781708031892776
Norm Quadratic Average: 0.9283863306045532
Nearest Class Center Accuracy: 0.09712

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.4626433849334717
Inter Cos: 0.12808723747730255
Norm Quadratic Average: 0.7364481091499329
Nearest Class Center Accuracy: 0.09798

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8251749277114868
Inter Cos: 0.20542652904987335
Norm Quadratic Average: 0.5434916615486145
Nearest Class Center Accuracy: 0.09998

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9094321131706238
Inter Cos: 0.3588932454586029
Norm Quadratic Average: 0.5846520662307739
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.9618123173713684
Inter Cos: 0.40780410170555115
Norm Quadratic Average: 1.1843066215515137
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.9160549640655518
Linear Weight Rank: 353
Intra Cos: 0.981421947479248
Inter Cos: 0.42588600516319275
Norm Quadratic Average: 38.55754852294922
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 4.0331573486328125
Linear Weight Rank: 1796
Intra Cos: 0.9835572242736816
Inter Cos: 0.3817332088947296
Norm Quadratic Average: 33.61034393310547
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.151207447052002
Linear Weight Rank: 97
Intra Cos: 0.9837039113044739
Inter Cos: 0.3889061510562897
Norm Quadratic Average: 31.64607048034668
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9853355288505554
Inter Cos: 0.4635460376739502
Norm Quadratic Average: 32.651737213134766
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 1.9068238193511964
Accuracy: 0.6282
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.15422844886779785, Weights: 0.017031915485858917
NC2 Equiangle: Features: 0.21970436789772727, Weights: 0.17966286399147727
NC3 Self-Duality: 0.15456746518611908
NC4 NCC Mismatch: 0.06110000000000004

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621266715228558
Inter Cos: 0.406754732131958
Norm Quadratic Average: 29.42218780517578
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.007502668537199497
Inter Cos: 0.1967897266149521
Norm Quadratic Average: 9.899601936340332
Nearest Class Center Accuracy: 0.2261

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01061048824340105
Inter Cos: 0.26706773042678833
Norm Quadratic Average: 7.270616054534912
Nearest Class Center Accuracy: 0.3636

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.00990686658769846
Inter Cos: 0.15207748115062714
Norm Quadratic Average: 5.407840728759766
Nearest Class Center Accuracy: 0.4884

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013811524026095867
Inter Cos: 0.20053689181804657
Norm Quadratic Average: 3.973836660385132
Nearest Class Center Accuracy: 0.5433

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015632156282663345
Inter Cos: 0.17730185389518738
Norm Quadratic Average: 3.0543212890625
Nearest Class Center Accuracy: 0.5741

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015157750807702541
Inter Cos: 0.14310620725154877
Norm Quadratic Average: 2.8772213459014893
Nearest Class Center Accuracy: 0.6003

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012351869605481625
Inter Cos: 0.11669237911701202
Norm Quadratic Average: 2.8385045528411865
Nearest Class Center Accuracy: 0.6255

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014951835386455059
Inter Cos: 0.14951510727405548
Norm Quadratic Average: 2.124403715133667
Nearest Class Center Accuracy: 0.6682

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.014977932907640934
Inter Cos: 0.1356699913740158
Norm Quadratic Average: 1.3846408128738403
Nearest Class Center Accuracy: 0.6943

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019821885973215103
Inter Cos: 0.181515172123909
Norm Quadratic Average: 1.064713954925537
Nearest Class Center Accuracy: 0.6731

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03511522710323334
Inter Cos: 0.2629949450492859
Norm Quadratic Average: 0.8424080014228821
Nearest Class Center Accuracy: 0.62

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.16498078405857086
Inter Cos: 0.3877522051334381
Norm Quadratic Average: 0.6148151755332947
Nearest Class Center Accuracy: 0.5553

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2595676779747009
Inter Cos: 0.4326825439929962
Norm Quadratic Average: 0.4304218590259552
Nearest Class Center Accuracy: 0.586

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.25086644291877747
Inter Cos: 0.4610476493835449
Norm Quadratic Average: 0.48427316546440125
Nearest Class Center Accuracy: 0.6225

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2623639404773712
Inter Cos: 0.5313107371330261
Norm Quadratic Average: 1.0572152137756348
Nearest Class Center Accuracy: 0.632

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 3.9160549640655518
Linear Weight Rank: 353
Intra Cos: 0.2663547396659851
Inter Cos: 0.59400874376297
Norm Quadratic Average: 35.114803314208984
Nearest Class Center Accuracy: 0.6307

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 4.0331573486328125
Linear Weight Rank: 1796
Intra Cos: 0.27221164107322693
Inter Cos: 0.6123661398887634
Norm Quadratic Average: 30.997285842895508
Nearest Class Center Accuracy: 0.6311

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 4.151207447052002
Linear Weight Rank: 97
Intra Cos: 0.26826950907707214
Inter Cos: 0.6224431991577148
Norm Quadratic Average: 29.55015754699707
Nearest Class Center Accuracy: 0.6305

Output Layer:
Intra Cos: 0.2667109966278076
Inter Cos: 0.6437828540802002
Norm Quadratic Average: 30.628732681274414
Nearest Class Center Accuracy: 0.6278

