Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.001.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893190383911133
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326326370239258
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.028707819059491158
Inter Cos: 0.04173005372285843
Norm Quadratic Average: 44.26633834838867
Nearest Class Center Accuracy: 0.04158

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02330738492310047
Inter Cos: 0.031808968633413315
Norm Quadratic Average: 51.89742660522461
Nearest Class Center Accuracy: 0.0524

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.0243542343378067
Inter Cos: 0.026977023109793663
Norm Quadratic Average: 79.98780059814453
Nearest Class Center Accuracy: 0.06192

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026417598128318787
Inter Cos: 0.02618616260588169
Norm Quadratic Average: 65.10746765136719
Nearest Class Center Accuracy: 0.06808

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.030095990747213364
Inter Cos: 0.03597770631313324
Norm Quadratic Average: 73.93380737304688
Nearest Class Center Accuracy: 0.07062

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.035964928567409515
Inter Cos: 0.038911040872335434
Norm Quadratic Average: 74.75179290771484
Nearest Class Center Accuracy: 0.07238

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03454791381955147
Inter Cos: 0.03337288275361061
Norm Quadratic Average: 66.01822662353516
Nearest Class Center Accuracy: 0.07516

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.046661972999572754
Inter Cos: 0.03736625239253044
Norm Quadratic Average: 28.874807357788086
Nearest Class Center Accuracy: 0.081

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.06141575053334236
Inter Cos: 0.046244967728853226
Norm Quadratic Average: 14.227434158325195
Nearest Class Center Accuracy: 0.0845

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.11506077647209167
Inter Cos: 0.08649195730686188
Norm Quadratic Average: 5.370151996612549
Nearest Class Center Accuracy: 0.08776

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2749998867511749
Inter Cos: 0.20895318686962128
Norm Quadratic Average: 3.0406384468078613
Nearest Class Center Accuracy: 0.09468

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.5477847456932068
Inter Cos: 0.4202893078327179
Norm Quadratic Average: 1.8211874961853027
Nearest Class Center Accuracy: 0.09934

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8401628136634827
Inter Cos: 0.6204131841659546
Norm Quadratic Average: 2.0687508583068848
Nearest Class Center Accuracy: 0.0999

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8853545784950256
Inter Cos: 0.6402724981307983
Norm Quadratic Average: 3.372359275817871
Nearest Class Center Accuracy: 0.1

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8945764303207397
Inter Cos: 0.6417760848999023
Norm Quadratic Average: 5.598719596862793
Nearest Class Center Accuracy: 0.1

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 6.2015700340271
Linear Weight Rank: 4026
Intra Cos: 0.8975921869277954
Inter Cos: 0.6349635124206543
Norm Quadratic Average: 52.797119140625
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 6.635872840881348
Linear Weight Rank: 3576
Intra Cos: 0.8829877376556396
Inter Cos: 0.5967697501182556
Norm Quadratic Average: 61.882816314697266
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 6.344020843505859
Linear Weight Rank: 98
Intra Cos: 0.8659619092941284
Inter Cos: 0.5220153331756592
Norm Quadratic Average: 54.273746490478516
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.9022800326347351
Inter Cos: 0.6135866641998291
Norm Quadratic Average: 65.05792236328125
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 3.9519277137756346
Accuracy: 0.4948
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.23973801732063293, Weights: 0.0506044365465641
NC2 Equiangle: Features: 0.2550528478140783, Weights: 0.10190686774976326
NC3 Self-Duality: 0.5197520852088928
NC4 NCC Mismatch: 0.20889999999999997

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422189712524414
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.012494468130171299
Inter Cos: 0.2703777253627777
Norm Quadratic Average: 44.508949279785156
Nearest Class Center Accuracy: 0.2036

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.016914010047912598
Inter Cos: 0.25888174772262573
Norm Quadratic Average: 52.21879577636719
Nearest Class Center Accuracy: 0.308

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01700602099299431
Inter Cos: 0.21477310359477997
Norm Quadratic Average: 80.5363998413086
Nearest Class Center Accuracy: 0.3886

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020569179207086563
Inter Cos: 0.25280362367630005
Norm Quadratic Average: 65.6154556274414
Nearest Class Center Accuracy: 0.4439

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023506660014390945
Inter Cos: 0.2644897401332855
Norm Quadratic Average: 74.49980163574219
Nearest Class Center Accuracy: 0.4634

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.025515809655189514
Inter Cos: 0.2717120945453644
Norm Quadratic Average: 75.27354431152344
Nearest Class Center Accuracy: 0.4791

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02332455664873123
Inter Cos: 0.22839011251926422
Norm Quadratic Average: 66.40062713623047
Nearest Class Center Accuracy: 0.512

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023433495312929153
Inter Cos: 0.24280214309692383
Norm Quadratic Average: 28.97601318359375
Nearest Class Center Accuracy: 0.5622

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026207979768514633
Inter Cos: 0.2350185513496399
Norm Quadratic Average: 14.157459259033203
Nearest Class Center Accuracy: 0.5693

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04863836243748665
Inter Cos: 0.3530833423137665
Norm Quadratic Average: 5.247718811035156
Nearest Class Center Accuracy: 0.5434

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.09530014544725418
Inter Cos: 0.5046163201332092
Norm Quadratic Average: 2.9338419437408447
Nearest Class Center Accuracy: 0.5304

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.163396418094635
Inter Cos: 0.6372140049934387
Norm Quadratic Average: 1.7151153087615967
Nearest Class Center Accuracy: 0.5214

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2573447823524475
Inter Cos: 0.7199432849884033
Norm Quadratic Average: 1.8656994104385376
Nearest Class Center Accuracy: 0.4914

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.28062647581100464
Inter Cos: 0.7360795140266418
Norm Quadratic Average: 3.0086991786956787
Nearest Class Center Accuracy: 0.4838

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.2804388999938965
Inter Cos: 0.739111065864563
Norm Quadratic Average: 4.983048915863037
Nearest Class Center Accuracy: 0.482

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 6.2015700340271
Linear Weight Rank: 4026
Intra Cos: 0.2797336280345917
Inter Cos: 0.7250009179115295
Norm Quadratic Average: 47.217872619628906
Nearest Class Center Accuracy: 0.4824

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 6.635872840881348
Linear Weight Rank: 3576
Intra Cos: 0.260455459356308
Inter Cos: 0.6957002878189087
Norm Quadratic Average: 56.135738372802734
Nearest Class Center Accuracy: 0.4853

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 6.344020843505859
Linear Weight Rank: 98
Intra Cos: 0.23208795487880707
Inter Cos: 0.6593028903007507
Norm Quadratic Average: 49.16350555419922
Nearest Class Center Accuracy: 0.4881

Output Layer:
Intra Cos: 0.25040969252586365
Inter Cos: 0.7283778786659241
Norm Quadratic Average: 58.77036666870117
Nearest Class Center Accuracy: 0.4852

