Model save path: ./New_Models/bn_False_dataset_CIFAR100_epochs_200_lr_0.01_model_type_vgg19_rand_seed_314159_test_samples_None_train_samples_None_weight_decay_0.0003.pth.tar
Training Set:
Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022893190383911133
Inter Cos: 0.07011394202709198
Norm Quadratic Average: 29.326326370239258
Nearest Class Center Accuracy: 0.03258

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.02821177989244461
Inter Cos: 0.03308698534965515
Norm Quadratic Average: 55.48764419555664
Nearest Class Center Accuracy: 0.04238

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023779751732945442
Inter Cos: 0.025984112173318863
Norm Quadratic Average: 73.83805084228516
Nearest Class Center Accuracy: 0.05478

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01948321983218193
Inter Cos: 0.025529036298394203
Norm Quadratic Average: 122.6098403930664
Nearest Class Center Accuracy: 0.0626

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.024103209376335144
Inter Cos: 0.025768427178263664
Norm Quadratic Average: 109.8185806274414
Nearest Class Center Accuracy: 0.0686

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.026409264653921127
Inter Cos: 0.03254314884543419
Norm Quadratic Average: 135.85777282714844
Nearest Class Center Accuracy: 0.07002

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.029490739107131958
Inter Cos: 0.036284007132053375
Norm Quadratic Average: 144.01792907714844
Nearest Class Center Accuracy: 0.0722

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.03192957490682602
Inter Cos: 0.035039130598306656
Norm Quadratic Average: 152.685302734375
Nearest Class Center Accuracy: 0.07428

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04846375063061714
Inter Cos: 0.04050764814019203
Norm Quadratic Average: 90.39376831054688
Nearest Class Center Accuracy: 0.0793

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.05441621318459511
Inter Cos: 0.04588400572538376
Norm Quadratic Average: 65.44523620605469
Nearest Class Center Accuracy: 0.0814

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.07687006890773773
Inter Cos: 0.06035753712058067
Norm Quadratic Average: 36.094764709472656
Nearest Class Center Accuracy: 0.08542

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.12938639521598816
Inter Cos: 0.1017637625336647
Norm Quadratic Average: 20.52424430847168
Nearest Class Center Accuracy: 0.0883

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.31834012269973755
Inter Cos: 0.23105476796627045
Norm Quadratic Average: 9.738920211791992
Nearest Class Center Accuracy: 0.0913

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.6715202331542969
Inter Cos: 0.4160305857658386
Norm Quadratic Average: 7.0443010330200195
Nearest Class Center Accuracy: 0.09528

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8091862797737122
Inter Cos: 0.44501927495002747
Norm Quadratic Average: 5.987777233123779
Nearest Class Center Accuracy: 0.0986

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.8581743836402893
Inter Cos: 0.44413071870803833
Norm Quadratic Average: 5.5594964027404785
Nearest Class Center Accuracy: 0.09974

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 39.00679016113281
Linear Weight Rank: 4031
Intra Cos: 0.874891996383667
Inter Cos: 0.45029711723327637
Norm Quadratic Average: 35.69163131713867
Nearest Class Center Accuracy: 0.1

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 18.11542510986328
Linear Weight Rank: 3663
Intra Cos: 0.8802069425582886
Inter Cos: 0.43034952878952026
Norm Quadratic Average: 35.18573760986328
Nearest Class Center Accuracy: 0.1

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 9.559785842895508
Linear Weight Rank: 98
Intra Cos: 0.8921541571617126
Inter Cos: 0.4181616008281708
Norm Quadratic Average: 35.666419982910156
Nearest Class Center Accuracy: 0.1

Output Layer:
Intra Cos: 0.93430095911026
Inter Cos: 0.6239583492279053
Norm Quadratic Average: 61.78160095214844
Nearest Class Center Accuracy: 0.1

Test Set:
Average Loss: 3.842694696044922
Accuracy: 0.506
NC1 Within Class Collapse: nan
NC2 Equinorm: Features: 0.298949658870697, Weights: 0.03765299171209335
NC2 Equiangle: Features: 0.22151021938131313, Weights: 0.11566487630208333
NC3 Self-Duality: 0.508261501789093
NC4 NCC Mismatch: 0.14600000000000002

Layer 0: Conv2d(3, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.006621268577873707
Inter Cos: 0.4067547917366028
Norm Quadratic Average: 29.422189712524414
Nearest Class Center Accuracy: 0.1136

Layer 1: Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.01145568210631609
Inter Cos: 0.2478812336921692
Norm Quadratic Average: 55.807186126708984
Nearest Class Center Accuracy: 0.2157

Layer 2: Conv2d(64, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.015114723704755306
Inter Cos: 0.2323305755853653
Norm Quadratic Average: 74.37631225585938
Nearest Class Center Accuracy: 0.3352

Layer 3: Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.013691029511392117
Inter Cos: 0.16640090942382812
Norm Quadratic Average: 123.50364685058594
Nearest Class Center Accuracy: 0.417

Layer 4: Conv2d(128, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018748246133327484
Inter Cos: 0.23285670578479767
Norm Quadratic Average: 110.6967544555664
Nearest Class Center Accuracy: 0.4652

Layer 5: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.018940255045890808
Inter Cos: 0.21784564852714539
Norm Quadratic Average: 136.91864013671875
Nearest Class Center Accuracy: 0.4909

Layer 6: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.019612178206443787
Inter Cos: 0.21838095784187317
Norm Quadratic Average: 144.99313354492188
Nearest Class Center Accuracy: 0.5028

Layer 7: Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.020243152976036072
Inter Cos: 0.20553971827030182
Norm Quadratic Average: 153.49436950683594
Nearest Class Center Accuracy: 0.514

Layer 8: Conv2d(256, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.022888340055942535
Inter Cos: 0.22511766850948334
Norm Quadratic Average: 90.63753509521484
Nearest Class Center Accuracy: 0.54

Layer 9: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.023603271692991257
Inter Cos: 0.20422187447547913
Norm Quadratic Average: 65.03678894042969
Nearest Class Center Accuracy: 0.5545

Layer 10: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.030705537647008896
Inter Cos: 0.22776184976100922
Norm Quadratic Average: 35.29402160644531
Nearest Class Center Accuracy: 0.5477

Layer 11: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.04884396120905876
Inter Cos: 0.28825411200523376
Norm Quadratic Average: 19.665407180786133
Nearest Class Center Accuracy: 0.5312

Layer 12: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.11841356009244919
Inter Cos: 0.44351065158843994
Norm Quadratic Average: 9.009800910949707
Nearest Class Center Accuracy: 0.4908

Layer 13: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.22731095552444458
Inter Cos: 0.5650041699409485
Norm Quadratic Average: 6.294098377227783
Nearest Class Center Accuracy: 0.4873

Layer 14: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.245329812169075
Inter Cos: 0.5846331119537354
Norm Quadratic Average: 5.268923282623291
Nearest Class Center Accuracy: 0.4958

Layer 15: Conv2d(512, 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
Intra Cos: 0.22823664546012878
Inter Cos: 0.579511284828186
Norm Quadratic Average: 4.890163421630859
Nearest Class Center Accuracy: 0.5033

Layer 16: Linear(in_features=25088, out_features=4096, bias=True)
Linear Weight Norm: 39.00679016113281
Linear Weight Rank: 4031
Intra Cos: 0.2155279666185379
Inter Cos: 0.5667868852615356
Norm Quadratic Average: 31.485782623291016
Nearest Class Center Accuracy: 0.5068

Layer 17: Linear(in_features=4096, out_features=4096, bias=True)
Linear Weight Norm: 18.11542510986328
Linear Weight Rank: 3663
Intra Cos: 0.20793960988521576
Inter Cos: 0.5529166460037231
Norm Quadratic Average: 31.120342254638672
Nearest Class Center Accuracy: 0.5081

Layer 18: Linear(in_features=4096, out_features=100, bias=True)
Linear Weight Norm: 9.559785842895508
Linear Weight Rank: 98
Intra Cos: 0.20727968215942383
Inter Cos: 0.5834205150604248
Norm Quadratic Average: 31.600683212280273
Nearest Class Center Accuracy: 0.5081

Output Layer:
Intra Cos: 0.2210225909948349
Inter Cos: 0.6877845525741577
Norm Quadratic Average: 54.95173263549805
Nearest Class Center Accuracy: 0.5045

