INFO:__main__:Command line arguments: src/run_patchcore.py --gpu 1 --seed 0 --log_group IM224_WR50_L2-3_P01_D1024-1024_PS-3_AN-1_S0 --log_project MVTecAD_Results results patch_core -b wideresnet50 -le layer2 -le layer3 --faiss_on_gpu --pretrain_embed_dimension 1024 --target_embed_dimension 1024 --anomaly_scorer_num_nn 1 --patchsize 3 sampler identity dataset --resize 224 --imagesize 224 -d carpet -d grid -d leather -d tile -d wood -d bottle -d cable -d capsule -d hazelnut -d metal_nut -d pill -d screw -d toothbrush -d transistor -d zipper mvtec ../MVTec
INFO:__main__:Evaluating dataset [mvtec_carpet] (1/15)...


INFO:__main__:Training models (1/1)


Computing support features...:   0%|          | 0/126 [00:00<?, ?it/s][A

Computing support features...:   1%|          | 1/126 [00:00<01:13,  1.70it/s][A

Computing support features...:   2%|▏         | 3/126 [00:00<00:26,  4.69it/s][A

Computing support features...:   4%|▍         | 5/126 [00:00<00:17,  6.87it/s][A

Computing support features...:   6%|▌         | 7/126 [00:01<00:14,  8.28it/s][A

Computing support features...:   7%|▋         | 9/126 [00:01<00:12,  9.41it/s][A

Computing support features...:   9%|▊         | 11/126 [00:01<00:11, 10.12it/s][A

Computing support features...:  10%|█         | 13/126 [00:01<00:10, 10.78it/s][A

Computing support features...:  12%|█▏        | 15/126 [00:01<00:09, 11.68it/s][A

Computing support features...:  13%|█▎        | 17/126 [00:01<00:08, 12.41it/s][A

Computing support features...:  15%|█▌        | 19/126 [00:02<00:08, 12.99it/s][A

Computing support features...:  17%|█▋        | 21/126 [00:02<00:10, 10.27it/s][A

Computing support features...:  18%|█▊        | 23/126 [00:02<00:09, 10.79it/s][A

Computing support features...:  20%|█▉        | 25/126 [00:02<00:08, 11.39it/s][A

Computing support features...:  21%|██▏       | 27/126 [00:02<00:08, 11.85it/s][A

Computing support features...:  23%|██▎       | 29/126 [00:02<00:08, 11.89it/s][A

Computing support features...:  25%|██▍       | 31/126 [00:03<00:07, 12.27it/s][A

Computing support features...:  26%|██▌       | 33/126 [00:03<00:07, 12.22it/s][A

Computing support features...:  28%|██▊       | 35/126 [00:03<00:07, 12.49it/s][A

Computing support features...:  29%|██▉       | 37/126 [00:03<00:07, 12.50it/s][A

Computing support features...:  31%|███       | 39/126 [00:03<00:07, 12.38it/s][A

Computing support features...:  33%|███▎      | 41/126 [00:03<00:06, 12.64it/s][A

Computing support features...:  34%|███▍      | 43/126 [00:04<00:06, 12.42it/s][A

Computing support features...:  36%|███▌      | 45/126 [00:04<00:06, 12.50it/s][A

Computing support features...:  37%|███▋      | 47/126 [00:04<00:06, 12.53it/s][A

Computing support features...:  39%|███▉      | 49/126 [00:04<00:06, 12.39it/s][A

Computing support features...:  40%|████      | 51/126 [00:04<00:05, 12.57it/s][A

Computing support features...:  42%|████▏     | 53/126 [00:04<00:05, 12.38it/s][A

Computing support features...:  44%|████▎     | 55/126 [00:05<00:06, 10.49it/s][A

Computing support features...:  45%|████▌     | 57/126 [00:05<00:06, 10.96it/s][A

Computing support features...:  47%|████▋     | 59/126 [00:05<00:05, 11.29it/s][A

Computing support features...:  48%|████▊     | 61/126 [00:05<00:05, 11.47it/s][A

Computing support features...:  50%|█████     | 63/126 [00:05<00:05, 11.59it/s][A

Computing support features...:  52%|█████▏    | 65/126 [00:05<00:05, 11.94it/s][A

Computing support features...:  53%|█████▎    | 67/126 [00:06<00:04, 11.98it/s][A

Computing support features...:  55%|█████▍    | 69/126 [00:06<00:04, 12.26it/s][A

Computing support features...:  56%|█████▋    | 71/126 [00:06<00:04, 12.28it/s][A

Computing support features...:  58%|█████▊    | 73/126 [00:06<00:04, 12.19it/s][A

Computing support features...:  60%|█████▉    | 75/126 [00:06<00:04, 12.45it/s][A

Computing support features...:  61%|██████    | 77/126 [00:06<00:03, 12.25it/s][A

Computing support features...:  63%|██████▎   | 79/126 [00:07<00:03, 12.47it/s][A

Computing support features...:  64%|██████▍   | 81/126 [00:07<00:03, 12.52it/s][A

Computing support features...:  66%|██████▌   | 83/126 [00:07<00:03, 12.36it/s][A

Computing support features...:  67%|██████▋   | 85/126 [00:07<00:03, 12.64it/s][A

Computing support features...:  69%|██████▉   | 87/126 [00:07<00:03, 12.22it/s][A

Computing support features...:  71%|███████   | 89/126 [00:07<00:03, 12.05it/s][A

Computing support features...:  72%|███████▏  | 91/126 [00:08<00:02, 12.16it/s][A

Computing support features...:  74%|███████▍  | 93/126 [00:08<00:02, 12.04it/s][A

Computing support features...:  75%|███████▌  | 95/126 [00:08<00:03,  9.75it/s][A

Computing support features...:  77%|███████▋  | 97/126 [00:08<00:02, 10.49it/s][A

Computing support features...:  79%|███████▊  | 99/126 [00:08<00:02, 11.04it/s][A

Computing support features...:  80%|████████  | 101/126 [00:08<00:02, 11.27it/s][A

Computing support features...:  82%|████████▏ | 103/126 [00:09<00:01, 11.71it/s][A

Computing support features...:  83%|████████▎ | 105/126 [00:09<00:01, 11.77it/s][A

Computing support features...:  85%|████████▍ | 107/126 [00:09<00:01, 12.04it/s][A

Computing support features...:  87%|████████▋ | 109/126 [00:09<00:01, 12.16it/s][A

Computing support features...:  88%|████████▊ | 111/126 [00:09<00:01, 12.17it/s][A

Computing support features...:  90%|████████▉ | 113/126 [00:09<00:01, 12.51it/s][A

Computing support features...:  91%|█████████▏| 115/126 [00:10<00:00, 12.38it/s][A

Computing support features...:  93%|█████████▎| 117/126 [00:10<00:00, 12.68it/s][A

Computing support features...:  94%|█████████▍| 119/126 [00:10<00:00, 12.65it/s][A

Computing support features...:  96%|█████████▌| 121/126 [00:10<00:00, 12.72it/s][A

Computing support features...:  98%|█████████▊| 123/126 [00:10<00:00, 12.88it/s][A

Computing support features...:  99%|█████████▉| 125/126 [00:10<00:00, 12.47it/s][A

                                                                                [AINFO:__main__:Embedding test data with models (1/1)

Inferring...:   0%|          | 0/49 [00:00<?, ?it/s]
Inferring...:   2%|▏         | 1/49 [00:00<00:39,  1.22it/s]
Inferring...:   4%|▍         | 2/49 [00:01<00:21,  2.17it/s]
Inferring...:   6%|▌         | 3/49 [00:01<00:14,  3.11it/s]
Inferring...:   8%|▊         | 4/49 [00:01<00:11,  3.91it/s]
Inferring...:  10%|█         | 5/49 [00:01<00:10,  4.19it/s]
Inferring...:  12%|█▏        | 6/49 [00:01<00:09,  4.69it/s]
Inferring...:  14%|█▍        | 7/49 [00:01<00:08,  4.74it/s]
Inferring...:  16%|█▋        | 8/49 [00:02<00:08,  5.12it/s]
Inferring...:  18%|█▊        | 9/49 [00:02<00:07,  5.40it/s]
Inferring...:  20%|██        | 10/49 [00:02<00:07,  5.18it/s]
Inferring...:  22%|██▏       | 11/49 [00:02<00:06,  5.57it/s]
Inferring...:  24%|██▍       | 12/49 [00:02<00:06,  5.64it/s]
Inferring...:  27%|██▋       | 13/49 [00:02<00:06,  5.32it/s]
Inferring...:  29%|██▊       | 14/49 [00:03<00:06,  5.53it/s]
Inferring...:  31%|███       | 15/49 [00:03<00:06,  5.26it/s]
Inferring...:  33%|███▎      | 16/49 [00:03<00:05,  5.56it/s]
Inferring...:  35%|███▍      | 17/49 [00:03<00:05,  5.70it/s]
Inferring...:  37%|███▋      | 18/49 [00:03<00:05,  5.33it/s]
Inferring...:  39%|███▉      | 19/49 [00:04<00:05,  5.42it/s]
Inferring...:  41%|████      | 20/49 [00:04<00:05,  5.27it/s]
Inferring...:  43%|████▎     | 21/49 [00:04<00:05,  5.47it/s]
Inferring...:  45%|████▍     | 22/49 [00:04<00:04,  5.49it/s]
Inferring...:  47%|████▋     | 23/49 [00:04<00:04,  5.35it/s]
Inferring...:  49%|████▉     | 24/49 [00:04<00:04,  5.53it/s]
Inferring...:  51%|█████     | 25/49 [00:05<00:04,  5.26it/s]
Inferring...:  53%|█████▎    | 26/49 [00:05<00:04,  5.54it/s]
Inferring...:  55%|█████▌    | 27/49 [00:05<00:04,  5.31it/s]
Inferring...:  57%|█████▋    | 28/49 [00:05<00:03,  5.49it/s]
Inferring...:  59%|█████▉    | 29/49 [00:05<00:03,  5.25it/s]
Inferring...:  61%|██████    | 30/49 [00:06<00:03,  5.23it/s]
Inferring...:  63%|██████▎   | 31/49 [00:06<00:03,  5.13it/s]
Inferring...:  65%|██████▌   | 32/49 [00:06<00:03,  5.03it/s]
Inferring...:  67%|██████▋   | 33/49 [00:06<00:03,  5.30it/s]
Inferring...:  69%|██████▉   | 34/49 [00:06<00:02,  5.17it/s]
Inferring...:  71%|███████▏  | 35/49 [00:07<00:02,  5.46it/s]
Inferring...:  73%|███████▎  | 36/49 [00:07<00:02,  5.29it/s]
Inferring...:  76%|███████▌  | 37/49 [00:07<00:02,  4.28it/s]
Inferring...:  78%|███████▊  | 38/49 [00:07<00:02,  4.43it/s]
Inferring...:  80%|███████▉  | 39/49 [00:07<00:02,  4.82it/s]
Inferring...:  82%|████████▏ | 40/49 [00:08<00:01,  4.84it/s]
Inferring...:  84%|████████▎ | 41/49 [00:08<00:01,  5.18it/s]
Inferring...:  86%|████████▌ | 42/49 [00:08<00:01,  5.53it/s]
Inferring...:  88%|████████▊ | 43/49 [00:08<00:01,  5.36it/s]
Inferring...:  90%|████████▉ | 44/49 [00:08<00:00,  5.58it/s]
Inferring...:  92%|█████████▏| 45/49 [00:09<00:00,  5.59it/s]
Inferring...:  94%|█████████▍| 46/49 [00:09<00:00,  5.27it/s]
Inferring...:  96%|█████████▌| 47/49 [00:09<00:00,  5.41it/s]
Inferring...:  98%|█████████▊| 48/49 [00:09<00:00,  5.12it/s]
                                                             
INFO:__main__:Computing evaluation metrics.
INFO:__main__:instance_auroc: 0.997
INFO:__main__:full_pixel_auroc: 0.991
INFO:__main__:anomaly_pixel_auroc: 0.988
INFO:__main__:

-----

INFO:__main__:Evaluating dataset [mvtec_grid] (2/15)...


INFO:__main__:Training models (1/1)
AUROC: 0.9902592897415161
Partial AUROC: 0.9814375042915344
AP: 0.6639779210090637
<class 'float'>
tensor(4867072.) 4867072
wAP:  0.5966348052024841


Computing support features...:   0%|          | 0/122 [00:00<?, ?it/s][A

Computing support features...:   1%|          | 1/122 [00:00<01:15,  1.61it/s][A

Computing support features...:   2%|▏         | 3/122 [00:00<00:26,  4.45it/s][A

Computing support features...:   4%|▍         | 5/122 [00:00<00:17,  6.61it/s][A

Computing support features...:   6%|▌         | 7/122 [00:01<00:13,  8.39it/s][A

Computing support features...:   7%|▋         | 9/122 [00:01<00:11,  9.45it/s][A

Computing support features...:   9%|▉         | 11/122 [00:01<00:10, 10.26it/s][A

Computing support features...:  11%|█         | 13/122 [00:01<00:10, 10.82it/s][A

Computing support features...:  12%|█▏        | 15/122 [00:01<00:09, 11.04it/s][A

Computing support features...:  14%|█▍        | 17/122 [00:01<00:09, 11.66it/s][A

Computing support features...:  16%|█▌        | 19/122 [00:02<00:08, 12.09it/s][A

Computing support features...:  17%|█▋        | 21/122 [00:02<00:19,  5.32it/s][A

Computing support features...:  19%|█▉        | 23/122 [00:03<00:15,  6.43it/s][A

Computing support features...:  20%|██        | 25/122 [00:03<00:12,  7.59it/s][A

Computing support features...:  22%|██▏       | 27/122 [00:03<00:11,  8.48it/s][A

Computing support features...:  24%|██▍       | 29/122 [00:03<00:10,  9.21it/s][A

Computing support features...:  25%|██▌       | 31/122 [00:03<00:09, 10.05it/s][A

Computing support features...:  27%|██▋       | 33/122 [00:03<00:08, 10.65it/s][A

Computing support features...:  29%|██▊       | 35/122 [00:04<00:08, 10.84it/s][A

Computing support features...:  30%|███       | 37/122 [00:04<00:07, 11.24it/s][A

Computing support features...:  32%|███▏      | 39/122 [00:04<00:07, 11.24it/s][A

Computing support features...:  34%|███▎      | 41/122 [00:04<00:07, 11.42it/s][A

Computing support features...:  35%|███▌      | 43/122 [00:04<00:06, 11.58it/s][A

Computing support features...:  37%|███▋      | 45/122 [00:04<00:06, 11.82it/s][A

Computing support features...:  39%|███▊      | 47/122 [00:05<00:06, 11.82it/s][A

Computing support features...:  40%|████      | 49/122 [00:05<00:06, 11.59it/s][A

Computing support features...:  42%|████▏     | 51/122 [00:05<00:06, 11.83it/s][A

Computing support features...:  43%|████▎     | 53/122 [00:05<00:05, 12.27it/s][A

Computing support features...:  45%|████▌     | 55/122 [00:05<00:05, 12.49it/s][A

Computing support features...:  47%|████▋     | 57/122 [00:06<00:07,  8.71it/s][A

Computing support features...:  48%|████▊     | 59/122 [00:06<00:06,  9.37it/s][A

Computing support features...:  50%|█████     | 61/122 [00:06<00:06, 10.10it/s][A

Computing support features...:  52%|█████▏    | 63/122 [00:06<00:05, 10.58it/s][A

Computing support features...:  53%|█████▎    | 65/122 [00:06<00:05, 10.94it/s][A

Computing support features...:  55%|█████▍    | 67/122 [00:06<00:04, 11.33it/s][A

Computing support features...:  57%|█████▋    | 69/122 [00:07<00:04, 11.35it/s][A

Computing support features...:  58%|█████▊    | 71/122 [00:07<00:04, 11.82it/s][A

Computing support features...:  60%|█████▉    | 73/122 [00:07<00:03, 12.38it/s][A

Computing support features...:  61%|██████▏   | 75/122 [00:07<00:03, 11.98it/s][A

Computing support features...:  63%|██████▎   | 77/122 [00:07<00:03, 11.64it/s][A

Computing support features...:  65%|██████▍   | 79/122 [00:07<00:03, 12.04it/s][A

Computing support features...:  66%|██████▋   | 81/122 [00:08<00:03, 11.91it/s][A

Computing support features...:  68%|██████▊   | 83/122 [00:08<00:03, 11.88it/s][A

Computing support features...:  70%|██████▉   | 85/122 [00:08<00:03, 11.93it/s][A

Computing support features...:  71%|███████▏  | 87/122 [00:08<00:02, 12.02it/s][A

Computing support features...:  73%|███████▎  | 89/122 [00:08<00:02, 12.16it/s][A

Computing support features...:  75%|███████▍  | 91/122 [00:08<00:02, 11.94it/s][A

Computing support features...:  76%|███████▌  | 93/122 [00:09<00:02, 12.15it/s][A

Computing support features...:  78%|███████▊  | 95/122 [00:09<00:02, 11.91it/s][A

Computing support features...:  80%|███████▉  | 97/122 [00:09<00:02, 11.73it/s][A

Computing support features...:  81%|████████  | 99/122 [00:09<00:02,  8.10it/s][A

Computing support features...:  83%|████████▎ | 101/122 [00:10<00:02,  8.86it/s][A

Computing support features...:  84%|████████▍ | 103/122 [00:10<00:01,  9.73it/s][A

Computing support features...:  86%|████████▌ | 105/122 [00:10<00:01, 10.48it/s][A

Computing support features...:  88%|████████▊ | 107/122 [00:10<00:01, 10.85it/s][A

Computing support features...:  89%|████████▉ | 109/122 [00:10<00:01, 11.30it/s][A

Computing support features...:  91%|█████████ | 111/122 [00:10<00:00, 11.52it/s][A

Computing support features...:  93%|█████████▎| 113/122 [00:11<00:00, 11.61it/s][A

Computing support features...:  94%|█████████▍| 115/122 [00:11<00:00, 11.91it/s][A

Computing support features...:  96%|█████████▌| 117/122 [00:11<00:00, 11.86it/s][A

Computing support features...:  98%|█████████▊| 119/122 [00:11<00:00, 12.04it/s][A

Computing support features...:  99%|█████████▉| 121/122 [00:11<00:00, 12.04it/s][A

                                                                                [AINFO:__main__:Embedding test data with models (1/1)

Inferring...:   0%|          | 0/29 [00:00<?, ?it/s]
Inferring...:   3%|▎         | 1/29 [00:00<00:22,  1.25it/s]
Inferring...:   7%|▋         | 2/29 [00:00<00:11,  2.25it/s]
Inferring...:  10%|█         | 3/29 [00:01<00:08,  3.07it/s]
Inferring...:  14%|█▍        | 4/29 [00:01<00:06,  3.74it/s]
Inferring...:  17%|█▋        | 5/29 [00:01<00:05,  4.14it/s]
Inferring...:  21%|██        | 6/29 [00:01<00:04,  4.68it/s]
Inferring...:  24%|██▍       | 7/29 [00:01<00:04,  4.81it/s]
Inferring...:  28%|██▊       | 8/29 [00:02<00:04,  5.10it/s]
Inferring...:  31%|███       | 9/29 [00:02<00:03,  5.08it/s]
Inferring...:  34%|███▍      | 10/29 [00:02<00:03,  5.11it/s]
Inferring...:  38%|███▊      | 11/29 [00:02<00:03,  5.35it/s]
Inferring...:  41%|████▏     | 12/29 [00:02<00:03,  5.08it/s]
Inferring...:  45%|████▍     | 13/29 [00:03<00:02,  5.45it/s]
Inferring...:  48%|████▊     | 14/29 [00:03<00:02,  5.59it/s]
Inferring...:  52%|█████▏    | 15/29 [00:03<00:02,  5.44it/s]
Inferring...:  55%|█████▌    | 16/29 [00:03<00:02,  5.79it/s]
Inferring...:  59%|█████▊    | 17/29 [00:03<00:02,  5.63it/s]
Inferring...:  62%|██████▏   | 18/29 [00:03<00:01,  5.50it/s]
Inferring...:  66%|██████▌   | 19/29 [00:04<00:01,  5.68it/s]
Inferring...:  69%|██████▉   | 20/29 [00:04<00:01,  5.49it/s]
Inferring...:  72%|███████▏  | 21/29 [00:04<00:01,  5.85it/s]
Inferring...:  76%|███████▌  | 22/29 [00:04<00:01,  6.26it/s]
Inferring...:  79%|███████▉  | 23/29 [00:04<00:00,  6.59it/s]
Inferring...:  83%|████████▎ | 24/29 [00:04<00:00,  6.55it/s]
Inferring...:  86%|████████▌ | 25/29 [00:05<00:00,  6.08it/s]
Inferring...:  90%|████████▉ | 26/29 [00:05<00:00,  6.09it/s]
Inferring...:  93%|█████████▎| 27/29 [00:05<00:00,  5.71it/s]
Inferring...:  97%|█████████▋| 28/29 [00:05<00:00,  5.61it/s]
Inferring...: 100%|██████████| 29/29 [00:05<00:00,  5.67it/s]
                                                             
INFO:__main__:Computing evaluation metrics.
INFO:__main__:instance_auroc: 0.973
INFO:__main__:full_pixel_auroc: 0.988
INFO:__main__:anomaly_pixel_auroc: 0.982
INFO:__main__:

-----

INFO:__main__:Evaluating dataset [mvtec_leather] (3/15)...


INFO:__main__:Training models (1/1)
AUROC: 0.9878689646720886
Partial AUROC: 0.9762136340141296
AP: 0.393547922372818
<class 'float'>
tensor(2910208.) 2910208
wAP:  0.3844696879386902


Computing support features...:   0%|          | 0/107 [00:00<?, ?it/s][A

Computing support features...:   1%|          | 1/107 [00:00<01:22,  1.29it/s][A

Computing support features...:   3%|▎         | 3/107 [00:00<00:28,  3.69it/s][A

Computing support features...:   5%|▍         | 5/107 [00:01<00:17,  5.80it/s][A

Computing support features...:   7%|▋         | 7/107 [00:01<00:13,  7.49it/s][A

Computing support features...:   8%|▊         | 9/107 [00:01<00:11,  8.73it/s][A

Computing support features...:  10%|█         | 11/107 [00:01<00:14,  6.77it/s][A

Computing support features...:  12%|█▏        | 13/107 [00:02<00:12,  7.77it/s][A

Computing support features...:  14%|█▍        | 15/107 [00:02<00:10,  8.72it/s][A

Computing support features...:  16%|█▌        | 17/107 [00:02<00:09,  9.42it/s][A

Computing support features...:  18%|█▊        | 19/107 [00:02<00:08, 10.03it/s][A

Computing support features...:  20%|█▉        | 21/107 [00:02<00:08, 10.58it/s][A

Computing support features...:  21%|██▏       | 23/107 [00:02<00:07, 10.83it/s][A

Computing support features...:  23%|██▎       | 25/107 [00:03<00:07, 11.33it/s][A

Computing support features...:  25%|██▌       | 27/107 [00:03<00:07, 11.39it/s][A

Computing support features...:  27%|██▋       | 29/107 [00:03<00:06, 11.36it/s][A

Computing support features...:  29%|██▉       | 31/107 [00:03<00:06, 11.42it/s][A

Computing support features...:  31%|███       | 33/107 [00:03<00:06, 11.39it/s][A

Computing support features...:  33%|███▎      | 35/107 [00:03<00:06, 11.56it/s][A

Computing support features...:  35%|███▍      | 37/107 [00:04<00:06, 11.52it/s][A

Computing support features...:  36%|███▋      | 39/107 [00:04<00:05, 11.67it/s][A

Computing support features...:  38%|███▊      | 41/107 [00:04<00:05, 11.61it/s][A

Computing support features...:  40%|████      | 43/107 [00:04<00:05, 11.49it/s][A

Computing support features...:  42%|████▏     | 45/107 [00:04<00:06,  9.21it/s][A

Computing support features...:  44%|████▍     | 47/107 [00:05<00:06,  9.95it/s][A

Computing support features...:  46%|████▌     | 49/107 [00:05<00:05, 10.09it/s][A

Computing support features...:  48%|████▊     | 51/107 [00:05<00:05, 10.60it/s][A

Computing support features...:  50%|████▉     | 53/107 [00:05<00:05, 10.73it/s][A

Computing support features...:  51%|█████▏    | 55/107 [00:05<00:04, 10.85it/s][A

Computing support features...:  53%|█████▎    | 57/107 [00:06<00:04, 11.00it/s][A

Computing support features...:  55%|█████▌    | 59/107 [00:06<00:04, 11.27it/s][A

Computing support features...:  57%|█████▋    | 61/107 [00:06<00:03, 11.65it/s][A

Computing support features...:  59%|█████▉    | 63/107 [00:06<00:03, 11.66it/s][A

Computing support features...:  61%|██████    | 65/107 [00:06<00:03, 11.74it/s][A

Computing support features...:  63%|██████▎   | 67/107 [00:06<00:03, 11.70it/s][A

Computing support features...:  64%|██████▍   | 69/107 [00:07<00:03, 11.57it/s][A

Computing support features...:  66%|██████▋   | 71/107 [00:07<00:03, 11.81it/s][A

Computing support features...:  68%|██████▊   | 73/107 [00:07<00:02, 11.61it/s][A

Computing support features...:  70%|███████   | 75/107 [00:07<00:02, 11.65it/s][A

Computing support features...:  72%|███████▏  | 77/107 [00:07<00:02, 11.62it/s][A

Computing support features...:  74%|███████▍  | 79/107 [00:07<00:02, 11.76it/s][A

Computing support features...:  76%|███████▌  | 81/107 [00:08<00:02, 11.78it/s][A

Computing support features...:  78%|███████▊  | 83/107 [00:08<00:02, 11.57it/s][A

Computing support features...:  79%|███████▉  | 85/107 [00:08<00:01, 11.76it/s][A

Computing support features...:  81%|████████▏ | 87/107 [00:08<00:01, 11.62it/s][A

Computing support features...:  83%|████████▎ | 89/107 [00:08<00:01,  9.09it/s][A

Computing support features...:  85%|████████▌ | 91/107 [00:09<00:01,  9.82it/s][A

Computing support features...:  87%|████████▋ | 93/107 [00:09<00:01, 10.28it/s][A

Computing support features...:  89%|████████▉ | 95/107 [00:09<00:01, 10.47it/s][A

Computing support features...:  91%|█████████ | 97/107 [00:09<00:00, 10.89it/s][A

Computing support features...:  93%|█████████▎| 99/107 [00:09<00:00, 11.00it/s][A

Computing support features...:  94%|█████████▍| 101/107 [00:09<00:00, 11.20it/s][A

Computing support features...:  96%|█████████▋| 103/107 [00:10<00:00, 10.99it/s][A

Computing support features...:  98%|█████████▊| 105/107 [00:10<00:00, 11.08it/s][A

Computing support features...: 100%|██████████| 107/107 [00:10<00:00, 11.84it/s][A

                                                                                [AINFO:__main__:Embedding test data with models (1/1)

Inferring...:   0%|          | 0/52 [00:00<?, ?it/s]
Inferring...:   2%|▏         | 1/52 [00:00<00:41,  1.22it/s]
Inferring...:   4%|▍         | 2/52 [00:01<00:22,  2.19it/s]
Inferring...:   6%|▌         | 3/52 [00:01<00:15,  3.10it/s]
Inferring...:   8%|▊         | 4/52 [00:01<00:13,  3.66it/s]
Inferring...:  10%|▉         | 5/52 [00:01<00:10,  4.29it/s]
Inferring...:  12%|█▏        | 6/52 [00:01<00:09,  4.97it/s]
Inferring...:  13%|█▎        | 7/52 [00:01<00:08,  5.40it/s]
Inferring...:  15%|█▌        | 8/52 [00:01<00:07,  5.83it/s]
Inferring...:  17%|█▋        | 9/52 [00:02<00:07,  5.67it/s]
Inferring...:  19%|█▉        | 10/52 [00:02<00:07,  5.76it/s]
Inferring...:  21%|██        | 11/52 [00:02<00:06,  5.95it/s]
Inferring...:  23%|██▎       | 12/52 [00:02<00:07,  5.58it/s]
Inferring...:  25%|██▌       | 13/52 [00:02<00:06,  5.83it/s]
Inferring...:  27%|██▋       | 14/52 [00:03<00:06,  5.61it/s]
Inferring...:  29%|██▉       | 15/52 [00:03<00:06,  5.72it/s]
Inferring...:  31%|███       | 16/52 [00:03<00:06,  5.60it/s]
Inferring...:  33%|███▎      | 17/52 [00:03<00:06,  5.54it/s]
Inferring...:  35%|███▍      | 18/52 [00:03<00:05,  5.89it/s]
Inferring...:  37%|███▋      | 19/52 [00:03<00:05,  5.76it/s]
Inferring...:  38%|███▊      | 20/52 [00:04<00:05,  5.82it/s]
Inferring...:  40%|████      | 21/52 [00:04<00:05,  5.90it/s]
Inferring...:  42%|████▏     | 22/52 [00:04<00:05,  5.74it/s]
Inferring...:  44%|████▍     | 23/52 [00:04<00:04,  5.86it/s]
Inferring...:  46%|████▌     | 24/52 [00:04<00:04,  5.67it/s]
Inferring...:  48%|████▊     | 25/52 [00:04<00:04,  5.84it/s]
Inferring...:  50%|█████     | 26/52 [00:05<00:04,  6.12it/s]
Inferring...:  52%|█████▏    | 27/52 [00:05<00:04,  5.76it/s]
Inferring...:  54%|█████▍    | 28/52 [00:05<00:03,  6.08it/s]
Inferring...:  56%|█████▌    | 29/52 [00:05<00:03,  6.15it/s]
Inferring...:  58%|█████▊    | 30/52 [00:05<00:03,  5.84it/s]
Inferring...:  60%|█████▉    | 31/52 [00:05<00:03,  5.99it/s]
Inferring...:  62%|██████▏   | 32/52 [00:06<00:03,  5.95it/s]
Inferring...:  63%|██████▎   | 33/52 [00:06<00:03,  5.76it/s]
Inferring...:  65%|██████▌   | 34/52 [00:06<00:03,  5.98it/s]
Inferring...:  67%|██████▋   | 35/52 [00:06<00:02,  5.74it/s]
Inferring...:  69%|██████▉   | 36/52 [00:06<00:02,  5.81it/s]
Inferring...:  71%|███████   | 37/52 [00:06<00:02,  6.03it/s]
Inferring...:  73%|███████▎  | 38/52 [00:07<00:02,  5.75it/s]
Inferring...:  75%|███████▌  | 39/52 [00:07<00:02,  6.13it/s]
Inferring...:  77%|███████▋  | 40/52 [00:07<00:01,  6.14it/s]
Inferring...:  79%|███████▉  | 41/52 [00:07<00:01,  5.80it/s]
Inferring...:  81%|████████  | 42/52 [00:07<00:01,  6.05it/s]
Inferring...:  83%|████████▎ | 43/52 [00:07<00:01,  5.75it/s]
Inferring...:  85%|████████▍ | 44/52 [00:08<00:01,  5.86it/s]
Inferring...:  87%|████████▋ | 45/52 [00:08<00:01,  5.70it/s]
Inferring...:  88%|████████▊ | 46/52 [00:08<00:01,  5.65it/s]
Inferring...:  90%|█████████ | 47/52 [00:08<00:00,  5.85it/s]
Inferring...:  92%|█████████▏| 48/52 [00:08<00:00,  5.71it/s]
Inferring...:  94%|█████████▍| 49/52 [00:09<00:00,  5.87it/s]
Inferring...:  96%|█████████▌| 50/52 [00:09<00:00,  5.79it/s]
Inferring...:  98%|█████████▊| 51/52 [00:09<00:00,  5.60it/s]
Inferring...: 100%|██████████| 52/52 [00:09<00:00,  5.88it/s]
                                                             
INFO:__main__:Computing evaluation metrics.
INFO:__main__:instance_auroc: 1.000
INFO:__main__:full_pixel_auroc: 0.993
INFO:__main__:anomaly_pixel_auroc: 0.990
INFO:__main__:

-----

INFO:__main__:Evaluating dataset [mvtec_tile] (4/15)...


INFO:__main__:Training models (1/1)
AUROC: 0.9933988451957703
Partial AUROC: 0.9870566129684448
AP: 0.5072723031044006
<class 'float'>
tensor(5218304.5000) 5218304
wAP:  0.5127370357513428


Computing support features...:   0%|          | 0/99 [00:00<?, ?it/s][A

Computing support features...:   1%|          | 1/99 [00:00<01:12,  1.36it/s][A

Computing support features...:   2%|▏         | 2/99 [00:01<00:55,  1.74it/s][A

Computing support features...:   4%|▍         | 4/99 [00:01<00:25,  3.69it/s][A

Computing support features...:   6%|▌         | 6/99 [00:01<00:16,  5.50it/s][A

Computing support features...:   8%|▊         | 8/99 [00:01<00:13,  6.86it/s][A

Computing support features...:  10%|█         | 10/99 [00:01<00:10,  8.23it/s][A

Computing support features...:  12%|█▏        | 12/99 [00:02<00:09,  9.01it/s][A

Computing support features...:  14%|█▍        | 14/99 [00:02<00:08,  9.49it/s][A

Computing support features...:  16%|█▌        | 16/99 [00:02<00:08,  9.90it/s][A

Computing support features...:  18%|█▊        | 18/99 [00:02<00:07, 10.28it/s][A

Computing support features...:  20%|██        | 20/99 [00:02<00:07, 10.80it/s][A

Computing support features...:  22%|██▏       | 22/99 [00:02<00:07, 10.99it/s][A

Computing support features...:  24%|██▍       | 24/99 [00:03<00:06, 11.34it/s][A

Computing support features...:  26%|██▋       | 26/99 [00:03<00:06, 11.34it/s][A

Computing support features...:  28%|██▊       | 28/99 [00:03<00:06, 11.40it/s][A

Computing support features...:  30%|███       | 30/99 [00:03<00:06, 11.34it/s][A

Computing support features...:  32%|███▏      | 32/99 [00:03<00:05, 11.36it/s][A

Computing support features...:  34%|███▍      | 34/99 [00:03<00:05, 11.42it/s][A

Computing support features...:  36%|███▋      | 36/99 [00:04<00:07,  8.15it/s][A

Computing support features...:  38%|███▊      | 38/99 [00:04<00:06,  8.88it/s][A

Computing support features...:  40%|████      | 40/99 [00:04<00:06,  9.63it/s][A

Computing support features...:  42%|████▏     | 42/99 [00:04<00:05, 10.03it/s][A

Computing support features...:  44%|████▍     | 44/99 [00:05<00:05, 10.32it/s][A

Computing support features...:  46%|████▋     | 46/99 [00:05<00:05, 10.60it/s][A

Computing support features...:  48%|████▊     | 48/99 [00:05<00:04, 10.90it/s][A

Computing support features...:  51%|█████     | 50/99 [00:05<00:04, 11.04it/s][A

Computing support features...:  53%|█████▎    | 52/99 [00:05<00:04, 11.28it/s][A

Computing support features...:  55%|█████▍    | 54/99 [00:05<00:04, 11.19it/s][A

Computing support features...:  57%|█████▋    | 56/99 [00:06<00:03, 11.22it/s][A

Computing support features...:  59%|█████▊    | 58/99 [00:06<00:03, 11.17it/s][A

Computing support features...:  61%|██████    | 60/99 [00:06<00:03, 11.04it/s][A

Computing support features...:  63%|██████▎   | 62/99 [00:06<00:03, 11.28it/s][A

Computing support features...:  65%|██████▍   | 64/99 [00:06<00:03, 11.24it/s][A

Computing support features...:  67%|██████▋   | 66/99 [00:07<00:02, 11.29it/s][A

Computing support features...:  69%|██████▊   | 68/99 [00:07<00:02, 11.60it/s][A

Computing support features...:  71%|███████   | 70/99 [00:07<00:02, 11.40it/s][A

Computing support features...:  73%|███████▎  | 72/99 [00:07<00:02, 11.61it/s][A

Computing support features...:  75%|███████▍  | 74/99 [00:07<00:02, 11.45it/s][A

Computing support features...:  77%|███████▋  | 76/99 [00:08<00:02,  7.96it/s][A

Computing support features...:  79%|███████▉  | 78/99 [00:08<00:02,  9.03it/s][A

Computing support features...:  81%|████████  | 80/99 [00:08<00:01,  9.96it/s][A

Computing support features...:  83%|████████▎ | 82/99 [00:08<00:01, 10.64it/s][A

Computing support features...:  85%|████████▍ | 84/99 [00:08<00:01, 10.92it/s][A

Computing support features...:  87%|████████▋ | 86/99 [00:08<00:01, 11.23it/s][A

Computing support features...:  89%|████████▉ | 88/99 [00:09<00:00, 11.52it/s][A

Computing support features...:  91%|█████████ | 90/99 [00:09<00:00, 11.44it/s][A

Computing support features...:  93%|█████████▎| 92/99 [00:09<00:00, 11.88it/s][A

Computing support features...:  95%|█████████▍| 94/99 [00:09<00:00, 11.80it/s][A

Computing support features...:  97%|█████████▋| 96/99 [00:09<00:00, 11.88it/s][A

Computing support features...:  99%|█████████▉| 98/99 [00:09<00:00, 12.11it/s][A

                                                                              [AINFO:__main__:Embedding test data with models (1/1)

Inferring...:   0%|          | 0/49 [00:00<?, ?it/s]
Inferring...:   2%|▏         | 1/49 [00:00<00:41,  1.16it/s]
Inferring...:   4%|▍         | 2/49 [00:01<00:21,  2.23it/s]
Inferring...:   6%|▌         | 3/49 [00:01<00:15,  3.04it/s]
Inferring...:   8%|▊         | 4/49 [00:01<00:11,  3.81it/s]
Inferring...:  10%|█         | 5/49 [00:01<00:10,  4.22it/s]
Inferring...:  12%|█▏        | 6/49 [00:01<00:08,  4.86it/s]
Inferring...:  14%|█▍        | 7/49 [00:01<00:08,  5.08it/s]
Inferring...:  16%|█▋        | 8/49 [00:02<00:07,  5.23it/s]
Inferring...:  18%|█▊        | 9/49 [00:02<00:07,  5.55it/s]
Inferring...:  20%|██        | 10/49 [00:02<00:07,  5.54it/s]
Inferring...:  22%|██▏       | 11/49 [00:02<00:06,  5.97it/s]
Inferring...:  24%|██▍       | 12/49 [00:02<00:06,  5.79it/s]
Inferring...:  27%|██▋       | 13/49 [00:02<00:06,  5.85it/s]
Inferring...:  29%|██▊       | 14/49 [00:03<00:05,  6.00it/s]
Inferring...:  31%|███       | 15/49 [00:03<00:05,  5.83it/s]
Inferring...:  33%|███▎      | 16/49 [00:03<00:05,  6.19it/s]
Inferring...:  35%|███▍      | 17/49 [00:03<00:05,  6.32it/s]
Inferring...:  37%|███▋      | 18/49 [00:03<00:05,  5.88it/s]
Inferring...:  39%|███▉      | 19/49 [00:03<00:04,  6.16it/s]
Inferring...:  41%|████      | 20/49 [00:04<00:04,  5.96it/s]
Inferring...:  43%|████▎     | 21/49 [00:04<00:04,  5.86it/s]
Inferring...:  45%|████▍     | 22/49 [00:04<00:04,  6.02it/s]
Inferring...:  47%|████▋     | 23/49 [00:04<00:04,  6.01it/s]
Inferring...:  49%|████▉     | 24/49 [00:04<00:04,  5.82it/s]
Inferring...:  51%|█████     | 25/49 [00:04<00:03,  6.14it/s]
Inferring...:  53%|█████▎    | 26/49 [00:05<00:03,  5.88it/s]
Inferring...:  55%|█████▌    | 27/49 [00:05<00:03,  5.92it/s]
Inferring...:  57%|█████▋    | 28/49 [00:05<00:03,  6.06it/s]
Inferring...:  59%|█████▉    | 29/49 [00:05<00:03,  5.81it/s]
Inferring...:  61%|██████    | 30/49 [00:05<00:03,  6.05it/s]
Inferring...:  63%|██████▎   | 31/49 [00:05<00:03,  5.86it/s]
Inferring...:  65%|██████▌   | 32/49 [00:06<00:02,  5.96it/s]
Inferring...:  67%|██████▋   | 33/49 [00:06<00:02,  5.75it/s]
Inferring...:  69%|██████▉   | 34/49 [00:06<00:02,  5.62it/s]
Inferring...:  71%|███████▏  | 35/49 [00:06<00:02,  5.77it/s]
Inferring...:  73%|███████▎  | 36/49 [00:06<00:02,  5.71it/s]
Inferring...:  76%|███████▌  | 37/49 [00:06<00:02,  5.96it/s]
Inferring...:  78%|███████▊  | 38/49 [00:07<00:01,  5.99it/s]
Inferring...:  80%|███████▉  | 39/49 [00:07<00:01,  5.78it/s]
Inferring...:  82%|████████▏ | 40/49 [00:07<00:01,  5.97it/s]
Inferring...:  84%|████████▎ | 41/49 [00:07<00:01,  5.78it/s]
Inferring...:  86%|████████▌ | 42/49 [00:07<00:01,  6.11it/s]
Inferring...:  88%|████████▊ | 43/49 [00:08<00:01,  4.10it/s]
Inferring...:  90%|████████▉ | 44/49 [00:08<00:01,  4.60it/s]
Inferring...:  92%|█████████▏| 45/49 [00:08<00:00,  4.84it/s]
Inferring...:  94%|█████████▍| 46/49 [00:08<00:00,  5.31it/s]
Inferring...:  96%|█████████▌| 47/49 [00:08<00:00,  5.31it/s]
Inferring...:  98%|█████████▊| 48/49 [00:09<00:00,  5.46it/s]
                                                             
INFO:__main__:Computing evaluation metrics.
INFO:__main__:instance_auroc: 1.000
INFO:__main__:full_pixel_auroc: 0.968
INFO:__main__:anomaly_pixel_auroc: 0.952
INFO:__main__:

-----

INFO:__main__:Evaluating dataset [mvtec_wood] (5/15)...


INFO:__main__:Training models (1/1)
AUROC: 0.9714481234550476
Partial AUROC: 0.9477880001068115
AP: 0.6649946570396423
<class 'float'>
tensor(4867071.5000) 4867072
wAP:  0.6831071972846985


Computing support features...:   0%|          | 0/114 [00:00<?, ?it/s][A

Computing support features...:   1%|          | 1/114 [00:00<01:29,  1.27it/s][A

Computing support features...:   3%|▎         | 3/114 [00:00<00:30,  3.63it/s][A

Computing support features...:   4%|▍         | 5/114 [00:01<00:19,  5.60it/s][A

Computing support features...:   6%|▌         | 7/114 [00:01<00:14,  7.14it/s][A

Computing support features...:   8%|▊         | 9/114 [00:01<00:12,  8.37it/s][A

Computing support features...:  10%|▉         | 11/114 [00:01<00:10,  9.51it/s][A

Computing support features...:  11%|█▏        | 13/114 [00:01<00:09, 10.42it/s][A

Computing support features...:  13%|█▎        | 15/114 [00:01<00:09, 10.94it/s][A

Computing support features...:  15%|█▍        | 17/114 [00:02<00:08, 11.09it/s][A

Computing support features...:  17%|█▋        | 19/114 [00:02<00:08, 10.94it/s][A

Computing support features...:  18%|█▊        | 21/114 [00:02<00:08, 11.20it/s][A

Computing support features...:  20%|██        | 23/114 [00:02<00:08, 11.26it/s][A

Computing support features...:  22%|██▏       | 25/114 [00:02<00:07, 11.23it/s][A

Computing support features...:  24%|██▎       | 27/114 [00:03<00:07, 11.24it/s][A

Computing support features...:  25%|██▌       | 29/114 [00:03<00:07, 11.21it/s][A

Computing support features...:  27%|██▋       | 31/114 [00:03<00:11,  7.23it/s][A

Computing support features...:  29%|██▉       | 33/114 [00:03<00:09,  8.14it/s][A

Computing support features...:  31%|███       | 35/114 [00:04<00:08,  8.98it/s][A

Computing support features...:  32%|███▏      | 37/114 [00:04<00:08,  9.61it/s][A

Computing support features...:  34%|███▍      | 39/114 [00:04<00:07, 10.01it/s][A

Computing support features...:  36%|███▌      | 41/114 [00:04<00:06, 10.53it/s][A

Computing support features...:  38%|███▊      | 43/114 [00:04<00:06, 10.63it/s][A

Computing support features...:  39%|███▉      | 45/114 [00:04<00:06, 10.76it/s][A

Computing support features...:  41%|████      | 47/114 [00:05<00:06, 10.72it/s][A

Computing support features...:  43%|████▎     | 49/114 [00:05<00:05, 10.91it/s][A

Computing support features...:  45%|████▍     | 51/114 [00:05<00:05, 10.99it/s][A

Computing support features...:  46%|████▋     | 53/114 [00:05<00:05, 11.29it/s][A

Computing support features...:  48%|████▊     | 55/114 [00:05<00:05, 11.32it/s][A

Computing support features...:  50%|█████     | 57/114 [00:06<00:05, 11.27it/s][A

Computing support features...:  52%|█████▏    | 59/114 [00:06<00:04, 11.42it/s][A

Computing support features...:  54%|█████▎    | 61/114 [00:06<00:04, 11.25it/s][A

Computing support features...:  55%|█████▌    | 63/114 [00:06<00:04, 11.54it/s][A

Computing support features...:  57%|█████▋    | 65/114 [00:06<00:04, 11.45it/s][A

Computing support features...:  59%|█████▉    | 67/114 [00:06<00:04, 11.59it/s][A

Computing support features...:  61%|██████    | 69/114 [00:07<00:03, 11.59it/s][A

Computing support features...:  62%|██████▏   | 71/114 [00:07<00:03, 11.44it/s][A

Computing support features...:  64%|██████▍   | 73/114 [00:07<00:03, 11.22it/s][A

Computing support features...:  66%|██████▌   | 75/114 [00:07<00:03, 11.24it/s][A

Computing support features...:  68%|██████▊   | 77/114 [00:08<00:04,  8.12it/s][A

Computing support features...:  69%|██████▉   | 79/114 [00:08<00:03,  9.03it/s][A

Computing support features...:  71%|███████   | 81/114 [00:08<00:03,  9.35it/s][A

Computing support features...:  73%|███████▎  | 83/114 [00:08<00:03,  9.98it/s][A

Computing support features...:  75%|███████▍  | 85/114 [00:08<00:02, 10.25it/s][A

Computing support features...:  76%|███████▋  | 87/114 [00:08<00:02, 10.63it/s][A

Computing support features...:  78%|███████▊  | 89/114 [00:09<00:02, 10.76it/s][A

Computing support features...:  80%|███████▉  | 91/114 [00:09<00:02, 10.80it/s][A

Computing support features...:  82%|████████▏ | 93/114 [00:09<00:01, 11.02it/s][A

Computing support features...:  83%|████████▎ | 95/114 [00:09<00:01, 11.06it/s][A

Computing support features...:  85%|████████▌ | 97/114 [00:09<00:01, 11.27it/s][A

Computing support features...:  87%|████████▋ | 99/114 [00:09<00:01, 11.24it/s][A

Computing support features...:  89%|████████▊ | 101/114 [00:10<00:01, 11.59it/s][A

Computing support features...:  90%|█████████ | 103/114 [00:10<00:00, 11.51it/s][A

Computing support features...:  92%|█████████▏| 105/114 [00:10<00:00, 11.59it/s][A

Computing support features...:  94%|█████████▍| 107/114 [00:10<00:00, 11.40it/s][A

Computing support features...:  96%|█████████▌| 109/114 [00:10<00:00, 11.50it/s][A

Computing support features...:  97%|█████████▋| 111/114 [00:10<00:00, 11.44it/s][A

Computing support features...:  99%|█████████▉| 113/114 [00:11<00:00, 11.41it/s][A

                                                                                [AINFO:__main__:Embedding test data with models (1/1)

Inferring...:   0%|          | 0/30 [00:00<?, ?it/s]
Inferring...:   3%|▎         | 1/30 [00:00<00:28,  1.01it/s]
Inferring...:   7%|▋         | 2/30 [00:01<00:13,  2.04it/s]
Inferring...:  10%|█         | 3/30 [00:01<00:09,  3.00it/s]
Inferring...:  13%|█▎        | 4/30 [00:01<00:06,  3.87it/s]
Inferring...:  17%|█▋        | 5/30 [00:01<00:05,  4.55it/s]
Inferring...:  20%|██        | 6/30 [00:01<00:04,  4.95it/s]
Inferring...:  23%|██▎       | 7/30 [00:01<00:04,  4.98it/s]
Inferring...:  27%|██▋       | 8/30 [00:02<00:04,  5.38it/s]
Inferring...:  30%|███       | 9/30 [00:02<00:03,  5.52it/s]
Inferring...:  33%|███▎      | 10/30 [00:02<00:03,  5.36it/s]
Inferring...:  37%|███▋      | 11/30 [00:02<00:03,  5.57it/s]
Inferring...:  40%|████      | 12/30 [00:02<00:03,  5.40it/s]
Inferring...:  43%|████▎     | 13/30 [00:02<00:02,  5.69it/s]
Inferring...:  47%|████▋     | 14/30 [00:03<00:02,  5.55it/s]
Inferring...:  50%|█████     | 15/30 [00:03<00:02,  5.40it/s]
Inferring...:  53%|█████▎    | 16/30 [00:03<00:02,  5.65it/s]
Inferring...:  57%|█████▋    | 17/30 [00:03<00:02,  5.45it/s]
Inferring...:  60%|██████    | 18/30 [00:04<00:03,  4.00it/s]
Inferring...:  63%|██████▎   | 19/30 [00:04<00:02,  4.31it/s]
Inferring...:  67%|██████▋   | 20/30 [00:04<00:02,  4.75it/s]
Inferring...:  70%|███████   | 21/30 [00:04<00:01,  4.95it/s]
Inferring...:  73%|███████▎  | 22/30 [00:04<00:01,  5.16it/s]
Inferring...:  77%|███████▋  | 23/30 [00:04<00:01,  5.42it/s]
Inferring...:  80%|████████  | 24/30 [00:05<00:01,  5.33it/s]
Inferring...:  83%|████████▎ | 25/30 [00:05<00:00,  5.74it/s]
Inferring...:  87%|████████▋ | 26/30 [00:05<00:00,  5.74it/s]
Inferring...:  90%|█████████ | 27/30 [00:05<00:00,  5.47it/s]
Inferring...:  93%|█████████▎| 28/30 [00:05<00:00,  5.71it/s]
Inferring...:  97%|█████████▋| 29/30 [00:06<00:00,  5.37it/s]
Inferring...: 100%|██████████| 30/30 [00:06<00:00,  6.06it/s]
                                                             
INFO:__main__:Computing evaluation metrics.
INFO:__main__:instance_auroc: 0.995
INFO:__main__:full_pixel_auroc: 0.945
INFO:__main__:anomaly_pixel_auroc: 0.924
INFO:__main__:

-----

INFO:__main__:Evaluating dataset [mvtec_bottle] (6/15)...


INFO:__main__:Training models (1/1)
AUROC: 0.9482823014259338
Partial AUROC: 0.9099522829055786
AP: 0.5457332134246826
<class 'float'>
tensor(2960384.) 2960384
wAP:  0.6313714385032654


Computing support features...:   0%|          | 0/95 [00:00<?, ?it/s][A

Computing support features...:   1%|          | 1/95 [00:00<01:13,  1.28it/s][A

Computing support features...:   3%|▎         | 3/95 [00:00<00:24,  3.70it/s][A

Computing support features...:   5%|▌         | 5/95 [00:01<00:16,  5.60it/s][A

Computing support features...:   7%|▋         | 7/95 [00:01<00:12,  7.32it/s][A

Computing support features...:   9%|▉         | 9/95 [00:01<00:10,  8.38it/s][A

Computing support features...:  12%|█▏        | 11/95 [00:01<00:08,  9.61it/s][A

Computing support features...:  14%|█▎        | 13/95 [00:01<00:08, 10.17it/s][A

Computing support features...:  16%|█▌        | 15/95 [00:01<00:07, 10.55it/s][A

Computing support features...:  18%|█▊        | 17/95 [00:02<00:07, 11.13it/s][A

Computing support features...:  20%|██        | 19/95 [00:02<00:06, 11.18it/s][A

Computing support features...:  22%|██▏       | 21/95 [00:02<00:06, 11.52it/s][A

Computing support features...:  24%|██▍       | 23/95 [00:02<00:06, 11.46it/s][A

Computing support features...:  26%|██▋       | 25/95 [00:03<00:09,  7.78it/s][A

Computing support features...:  28%|██▊       | 27/95 [00:03<00:07,  8.66it/s][A

Computing support features...:  31%|███       | 29/95 [00:03<00:06,  9.53it/s][A

Computing support features...:  33%|███▎      | 31/95 [00:03<00:06,  9.89it/s][A

Computing support features...:  35%|███▍      | 33/95 [00:03<00:06, 10.33it/s][A

Computing support features...:  37%|███▋      | 35/95 [00:03<00:05, 10.59it/s][A

Computing support features...:  39%|███▉      | 37/95 [00:04<00:05, 10.84it/s][A

Computing support features...:  41%|████      | 39/95 [00:04<00:05, 11.14it/s][A

Computing support features...:  43%|████▎     | 41/95 [00:04<00:04, 11.01it/s][A

Computing support features...:  45%|████▌     | 43/95 [00:04<00:04, 11.56it/s][A

Computing support features...:  47%|████▋     | 45/95 [00:04<00:04, 11.45it/s][A

Computing support features...:  49%|████▉     | 47/95 [00:05<00:04, 11.61it/s][A

Computing support features...:  52%|█████▏    | 49/95 [00:05<00:04, 11.46it/s][A

Computing support features...:  54%|█████▎    | 51/95 [00:05<00:03, 11.13it/s][A

Computing support features...:  56%|█████▌    | 53/95 [00:05<00:03, 11.58it/s][A

Computing support features...:  58%|█████▊    | 55/95 [00:05<00:03, 11.53it/s][A

Computing support features...:  60%|██████    | 57/95 [00:05<00:03, 11.65it/s][A

Computing support features...:  62%|██████▏   | 59/95 [00:06<00:03, 11.58it/s][A

Computing support features...:  64%|██████▍   | 61/95 [00:06<00:03,  8.51it/s][A

Computing support features...:  66%|██████▋   | 63/95 [00:06<00:03,  9.33it/s][A

Computing support features...:  68%|██████▊   | 65/95 [00:06<00:03,  9.71it/s][A

Computing support features...:  71%|███████   | 67/95 [00:06<00:02,  9.94it/s][A

Computing support features...:  73%|███████▎  | 69/95 [00:07<00:02, 10.41it/s][A

Computing support features...:  75%|███████▍  | 71/95 [00:07<00:02, 10.49it/s][A

Computing support features...:  77%|███████▋  | 73/95 [00:07<00:02, 11.00it/s][A

Computing support features...:  79%|███████▉  | 75/95 [00:07<00:01, 10.97it/s][A

Computing support features...:  81%|████████  | 77/95 [00:07<00:01, 11.13it/s][A

Computing support features...:  83%|████████▎ | 79/95 [00:08<00:01, 11.07it/s][A

Computing support features...:  85%|████████▌ | 81/95 [00:08<00:01, 11.34it/s][A

Computing support features...:  87%|████████▋ | 83/95 [00:08<00:01, 11.46it/s][A

Computing support features...:  89%|████████▉ | 85/95 [00:08<00:00, 11.63it/s][A

Computing support features...:  92%|█████████▏| 87/95 [00:08<00:00, 11.79it/s][A

Computing support features...:  94%|█████████▎| 89/95 [00:08<00:00, 11.54it/s][A

Computing support features...:  96%|█████████▌| 91/95 [00:09<00:00, 11.64it/s][A

Computing support features...:  98%|█████████▊| 93/95 [00:09<00:00, 11.45it/s][A

Computing support features...: 100%|██████████| 95/95 [00:09<00:00, 12.34it/s][A

                                                                              [AINFO:__main__:Embedding test data with models (1/1)

Inferring...:   0%|          | 0/36 [00:00<?, ?it/s]
Inferring...:   3%|▎         | 1/36 [00:00<00:30,  1.14it/s]
Inferring...:   6%|▌         | 2/36 [00:01<00:14,  2.27it/s]
Inferring...:   8%|▊         | 3/36 [00:01<00:10,  3.17it/s]
Inferring...:  11%|█         | 4/36 [00:01<00:08,  3.84it/s]
Inferring...:  14%|█▍        | 5/36 [00:01<00:06,  4.48it/s]
Inferring...:  17%|█▋        | 6/36 [00:01<00:06,  4.83it/s]
Inferring...:  19%|█▉        | 7/36 [00:01<00:05,  5.37it/s]
Inferring...:  22%|██▏       | 8/36 [00:02<00:05,  5.46it/s]
Inferring...:  25%|██▌       | 9/36 [00:02<00:04,  5.53it/s]
Inferring...:  28%|██▊       | 10/36 [00:02<00:04,  5.88it/s]
Inferring...:  31%|███       | 11/36 [00:02<00:04,  5.68it/s]
Inferring...:  33%|███▎      | 12/36 [00:02<00:03,  6.24it/s]
Inferring...:  36%|███▌      | 13/36 [00:02<00:03,  6.02it/s]
Inferring...:  39%|███▉      | 14/36 [00:03<00:04,  4.57it/s]
Inferring...:  42%|████▏     | 15/36 [00:03<00:04,  4.85it/s]
Inferring...:  44%|████▍     | 16/36 [00:03<00:03,  5.36it/s]
Inferring...:  47%|████▋     | 17/36 [00:03<00:03,  5.73it/s]
Inferring...:  50%|█████     | 18/36 [00:03<00:03,  5.76it/s]
Inferring...:  53%|█████▎    | 19/36 [00:03<00:02,  6.05it/s]
Inferring...:  56%|█████▌    | 20/36 [00:04<00:02,  6.12it/s]
Inferring...:  58%|█████▊    | 21/36 [00:04<00:02,  5.93it/s]
Inferring...:  61%|██████    | 22/36 [00:04<00:02,  6.14it/s]
Inferring...:  64%|██████▍   | 23/36 [00:04<00:02,  6.09it/s]
Inferring...:  67%|██████▋   | 24/36 [00:04<00:02,  5.93it/s]
Inferring...:  69%|██████▉   | 25/36 [00:04<00:01,  6.27it/s]
Inferring...:  72%|███████▏  | 26/36 [00:05<00:01,  6.06it/s]
Inferring...:  75%|███████▌  | 27/36 [00:05<00:01,  6.37it/s]
Inferring...:  78%|███████▊  | 28/36 [00:05<00:01,  6.57it/s]
Inferring...:  81%|████████  | 29/36 [00:05<00:01,  6.23it/s]
Inferring...:  83%|████████▎ | 30/36 [00:05<00:00,  6.26it/s]
Inferring...:  86%|████████▌ | 31/36 [00:05<00:00,  6.38it/s]
Inferring...:  89%|████████▉ | 32/36 [00:06<00:00,  6.09it/s]
Inferring...:  92%|█████████▏| 33/36 [00:06<00:00,  6.32it/s]
Inferring...:  94%|█████████▍| 34/36 [00:06<00:00,  5.98it/s]
Inferring...:  97%|█████████▋| 35/36 [00:06<00:00,  5.91it/s]
                                                             
INFO:__main__:Computing evaluation metrics.
INFO:__main__:instance_auroc: 1.000
INFO:__main__:full_pixel_auroc: 0.988
INFO:__main__:anomaly_pixel_auroc: 0.983
INFO:__main__:

-----

INFO:__main__:Evaluating dataset [mvtec_cable] (7/15)...


INFO:__main__:Training models (1/1)
AUROC: 0.9894407391548157
Partial AUROC: 0.9792956113815308
AP: 0.8067715167999268
<class 'float'>
tensor(3562496.) 3562496
wAP:  0.810759425163269


Computing support features...:   0%|          | 0/83 [00:00<?, ?it/s][A

Computing support features...:   1%|          | 1/83 [00:00<01:03,  1.29it/s][A

Computing support features...:   4%|▎         | 3/83 [00:00<00:21,  3.71it/s][A

Computing support features...:   6%|▌         | 5/83 [00:01<00:13,  5.73it/s][A

Computing support features...:   8%|▊         | 7/83 [00:01<00:10,  7.30it/s][A

Computing support features...:  11%|█         | 9/83 [00:01<00:08,  8.59it/s][A

Computing support features...:  13%|█▎        | 11/83 [00:01<00:07,  9.68it/s][A

Computing support features...:  16%|█▌        | 13/83 [00:01<00:06, 10.38it/s][A

Computing support features...:  18%|█▊        | 15/83 [00:01<00:06, 10.96it/s][A

Computing support features...:  20%|██        | 17/83 [00:02<00:05, 11.29it/s][A

Computing support features...:  23%|██▎       | 19/83 [00:02<00:05, 11.39it/s][A

Computing support features...:  25%|██▌       | 21/83 [00:02<00:08,  7.70it/s][A

Computing support features...:  28%|██▊       | 23/83 [00:02<00:06,  8.64it/s][A

Computing support features...:  30%|███       | 25/83 [00:03<00:06,  9.24it/s][A

Computing support features...:  33%|███▎      | 27/83 [00:03<00:05, 10.10it/s][A

Computing support features...:  35%|███▍      | 29/83 [00:03<00:05, 10.47it/s][A

Computing support features...:  37%|███▋      | 31/83 [00:03<00:04, 10.83it/s][A

Computing support features...:  40%|███▉      | 33/83 [00:03<00:04, 11.00it/s][A

Computing support features...:  42%|████▏     | 35/83 [00:03<00:04, 11.18it/s][A

Computing support features...:  45%|████▍     | 37/83 [00:04<00:04, 11.38it/s][A

Computing support features...:  47%|████▋     | 39/83 [00:04<00:03, 11.29it/s][A

Computing support features...:  49%|████▉     | 41/83 [00:04<00:03, 11.71it/s][A

Computing support features...:  52%|█████▏    | 43/83 [00:04<00:03, 11.70it/s][A

Computing support features...:  54%|█████▍    | 45/83 [00:04<00:03, 11.69it/s][A

Computing support features...:  57%|█████▋    | 47/83 [00:04<00:03, 11.67it/s][A

Computing support features...:  59%|█████▉    | 49/83 [00:05<00:02, 11.54it/s][A

Computing support features...:  61%|██████▏   | 51/83 [00:05<00:02, 11.67it/s][A

Computing support features...:  64%|██████▍   | 53/83 [00:05<00:02, 11.50it/s][A

Computing support features...:  66%|██████▋   | 55/83 [00:05<00:02, 11.54it/s][A

Computing support features...:  69%|██████▊   | 57/83 [00:05<00:02, 11.41it/s][A

Computing support features...:  71%|███████   | 59/83 [00:06<00:02, 11.36it/s][A

Computing support features...:  73%|███████▎  | 61/83 [00:06<00:01, 11.58it/s][A

Computing support features...:  76%|███████▌  | 63/83 [00:06<00:02,  8.84it/s][A

Computing support features...:  78%|███████▊  | 65/83 [00:06<00:01,  9.45it/s][A

Computing support features...:  81%|████████  | 67/83 [00:06<00:01, 10.05it/s][A

Computing support features...:  83%|████████▎ | 69/83 [00:07<00:01, 10.48it/s][A

Computing support features...:  86%|████████▌ | 71/83 [00:07<00:01, 10.93it/s][A

Computing support features...:  88%|████████▊ | 73/83 [00:07<00:00, 11.34it/s][A

Computing support features...:  90%|█████████ | 75/83 [00:07<00:00, 11.33it/s][A

Computing support features...:  93%|█████████▎| 77/83 [00:07<00:00, 11.67it/s][A

Computing support features...:  95%|█████████▌| 79/83 [00:07<00:00, 11.55it/s][A

Computing support features...:  98%|█████████▊| 81/83 [00:08<00:00, 11.79it/s][A

Computing support features...: 100%|██████████| 83/83 [00:08<00:00, 11.81it/s][A

                                                                              [AINFO:__main__:Embedding test data with models (1/1)

Inferring...:   0%|          | 0/59 [00:00<?, ?it/s]
Inferring...:   2%|▏         | 1/59 [00:00<00:51,  1.12it/s]
Inferring...:   3%|▎         | 2/59 [00:01<00:26,  2.14it/s]
Inferring...:   5%|▌         | 3/59 [00:01<00:18,  3.10it/s]
Inferring...:   7%|▋         | 4/59 [00:01<00:14,  3.78it/s]
Inferring...:   8%|▊         | 5/59 [00:01<00:11,  4.66it/s]
Inferring...:  10%|█         | 6/59 [00:01<00:10,  5.14it/s]
Inferring...:  12%|█▏        | 7/59 [00:01<00:09,  5.39it/s]
Inferring...:  14%|█▎        | 8/59 [00:01<00:08,  5.88it/s]
Inferring...:  15%|█▌        | 9/59 [00:02<00:08,  5.89it/s]
Inferring...:  17%|█▋        | 10/59 [00:02<00:08,  6.04it/s]
Inferring...:  19%|█▊        | 11/59 [00:02<00:07,  6.30it/s]
Inferring...:  20%|██        | 12/59 [00:02<00:07,  6.14it/s]
Inferring...:  22%|██▏       | 13/59 [00:02<00:07,  6.46it/s]
Inferring...:  24%|██▎       | 14/59 [00:02<00:07,  6.16it/s]
Inferring...:  25%|██▌       | 15/59 [00:03<00:07,  6.18it/s]
Inferring...:  27%|██▋       | 16/59 [00:03<00:06,  6.55it/s]
Inferring...:  29%|██▉       | 17/59 [00:03<00:06,  6.32it/s]
Inferring...:  31%|███       | 18/59 [00:03<00:06,  6.35it/s]
Inferring...:  32%|███▏      | 19/59 [00:03<00:06,  6.31it/s]
Inferring...:  34%|███▍      | 20/59 [00:03<00:06,  6.27it/s]
Inferring...:  36%|███▌      | 21/59 [00:03<00:05,  6.68it/s]
Inferring...:  37%|███▋      | 22/59 [00:04<00:05,  6.79it/s]
Inferring...:  39%|███▉      | 23/59 [00:04<00:05,  6.68it/s]
Inferring...:  41%|████      | 24/59 [00:04<00:05,  6.49it/s]
Inferring...:  42%|████▏     | 25/59 [00:04<00:05,  6.66it/s]
Inferring...:  44%|████▍     | 26/59 [00:04<00:05,  6.51it/s]
Inferring...:  46%|████▌     | 27/59 [00:04<00:05,  6.37it/s]
Inferring...:  47%|████▋     | 28/59 [00:05<00:04,  6.57it/s]
Inferring...:  49%|████▉     | 29/59 [00:05<00:04,  6.42it/s]
Inferring...:  51%|█████     | 30/59 [00:05<00:04,  6.76it/s]
Inferring...:  53%|█████▎    | 31/59 [00:05<00:03,  7.14it/s]
Inferring...:  54%|█████▍    | 32/59 [00:05<00:03,  7.18it/s]
Inferring...:  56%|█████▌    | 33/59 [00:05<00:03,  6.75it/s]
Inferring...:  58%|█████▊    | 34/59 [00:05<00:03,  6.53it/s]
Inferring...:  59%|█████▉    | 35/59 [00:06<00:03,  6.59it/s]
Inferring...:  61%|██████    | 36/59 [00:06<00:03,  6.34it/s]
Inferring...:  63%|██████▎   | 37/59 [00:06<00:03,  6.43it/s]
Inferring...:  64%|██████▍   | 38/59 [00:06<00:04,  4.42it/s]
Inferring...:  66%|██████▌   | 39/59 [00:06<00:03,  5.00it/s]
Inferring...:  68%|██████▊   | 40/59 [00:07<00:03,  5.22it/s]
Inferring...:  69%|██████▉   | 41/59 [00:07<00:03,  5.56it/s]
Inferring...:  71%|███████   | 42/59 [00:07<00:02,  5.71it/s]
Inferring...:  73%|███████▎  | 43/59 [00:07<00:02,  5.80it/s]
Inferring...:  75%|███████▍  | 44/59 [00:07<00:02,  6.02it/s]
Inferring...:  76%|███████▋  | 45/59 [00:07<00:02,  6.00it/s]
Inferring...:  78%|███████▊  | 46/59 [00:08<00:02,  6.05it/s]
Inferring...:  80%|███████▉  | 47/59 [00:08<00:01,  6.24it/s]
Inferring...:  81%|████████▏ | 48/59 [00:08<00:01,  6.16it/s]
Inferring...:  83%|████████▎ | 49/59 [00:08<00:01,  6.33it/s]
Inferring...:  85%|████████▍ | 50/59 [00:08<00:01,  6.67it/s]
Inferring...:  86%|████████▋ | 51/59 [00:08<00:01,  6.40it/s]
Inferring...:  88%|████████▊ | 52/59 [00:09<00:01,  6.39it/s]
Inferring...:  90%|████████▉ | 53/59 [00:09<00:00,  6.62it/s]
Inferring...:  92%|█████████▏| 54/59 [00:09<00:00,  6.36it/s]
Inferring...:  93%|█████████▎| 55/59 [00:09<00:00,  6.35it/s]
Inferring...:  95%|█████████▍| 56/59 [00:09<00:00,  6.47it/s]
Inferring...:  97%|█████████▋| 57/59 [00:09<00:00,  6.24it/s]
Inferring...:  98%|█████████▊| 58/59 [00:09<00:00,  6.62it/s]
Inferring...: 100%|██████████| 59/59 [00:10<00:00,  6.36it/s]
                                                             
INFO:__main__:Computing evaluation metrics.
INFO:__main__:instance_auroc: 0.996
INFO:__main__:full_pixel_auroc: 0.988
INFO:__main__:anomaly_pixel_auroc: 0.978
INFO:__main__:

-----

INFO:__main__:Evaluating dataset [mvtec_capsule] (8/15)...


INFO:__main__:Training models (1/1)
AUROC: 0.9883954524993896
Partial AUROC: 0.9777888059616089
AP: 0.7346676588058472
<class 'float'>
tensor(5920768.) 5920768
wAP:  0.6644478440284729


Computing support features...:   0%|          | 0/98 [00:00<?, ?it/s][A

Computing support features...:   1%|          | 1/98 [00:00<01:12,  1.34it/s][A

Computing support features...:   3%|▎         | 3/98 [00:00<00:25,  3.76it/s][A

Computing support features...:   5%|▌         | 5/98 [00:01<00:16,  5.80it/s][A

Computing support features...:   7%|▋         | 7/98 [00:01<00:12,  7.41it/s][A

Computing support features...:   9%|▉         | 9/98 [00:01<00:10,  8.54it/s][A

Computing support features...:  11%|█         | 11/98 [00:01<00:09,  9.55it/s][A

Computing support features...:  13%|█▎        | 13/98 [00:01<00:08, 10.06it/s][A

Computing support features...:  15%|█▌        | 15/98 [00:01<00:07, 10.72it/s][A

Computing support features...:  17%|█▋        | 17/98 [00:02<00:07, 10.85it/s][A

Computing support features...:  19%|█▉        | 19/98 [00:02<00:07, 11.24it/s][A

Computing support features...:  21%|██▏       | 21/98 [00:02<00:06, 11.69it/s][A

Computing support features...:  23%|██▎       | 23/98 [00:02<00:09,  8.25it/s][A

Computing support features...:  26%|██▌       | 25/98 [00:03<00:07,  9.23it/s][A

Computing support features...:  28%|██▊       | 27/98 [00:03<00:07,  9.90it/s][A

Computing support features...:  30%|██▉       | 29/98 [00:03<00:06, 10.25it/s][A

Computing support features...:  32%|███▏      | 31/98 [00:03<00:06, 10.76it/s][A

Computing support features...:  34%|███▎      | 33/98 [00:03<00:05, 10.87it/s][A

Computing support features...:  36%|███▌      | 35/98 [00:03<00:05, 11.34it/s][A

Computing support features...:  38%|███▊      | 37/98 [00:04<00:05, 11.30it/s][A

Computing support features...:  40%|███▉      | 39/98 [00:04<00:05, 11.39it/s][A

Computing support features...:  42%|████▏     | 41/98 [00:04<00:04, 11.80it/s][A

Computing support features...:  44%|████▍     | 43/98 [00:04<00:04, 11.65it/s][A

Computing support features...:  46%|████▌     | 45/98 [00:04<00:04, 11.78it/s][A

Computing support features...:  48%|████▊     | 47/98 [00:04<00:04, 11.69it/s][A

Computing support features...:  50%|█████     | 49/98 [00:05<00:04, 11.01it/s][A

Computing support features...:  52%|█████▏    | 51/98 [00:05<00:04, 11.14it/s][A

Computing support features...:  54%|█████▍    | 53/98 [00:05<00:04, 11.07it/s][A

Computing support features...:  56%|█████▌    | 55/98 [00:05<00:03, 11.35it/s][A

Computing support features...:  58%|█████▊    | 57/98 [00:05<00:03, 11.33it/s][A

Computing support features...:  60%|██████    | 59/98 [00:06<00:04,  8.66it/s][A

Computing support features...:  62%|██████▏   | 61/98 [00:06<00:03,  9.57it/s][A

Computing support features...:  64%|██████▍   | 63/98 [00:06<00:03, 10.02it/s][A

Computing support features...:  66%|██████▋   | 65/98 [00:06<00:03, 10.56it/s][A

Computing support features...:  68%|██████▊   | 67/98 [00:06<00:02, 10.95it/s][A

Computing support features...:  70%|███████   | 69/98 [00:06<00:02, 11.05it/s][A

Computing support features...:  72%|███████▏  | 71/98 [00:07<00:02, 11.40it/s][A

Computing support features...:  74%|███████▍  | 73/98 [00:07<00:02, 11.38it/s][A

Computing support features...:  77%|███████▋  | 75/98 [00:07<00:02, 11.41it/s][A

Computing support features...:  79%|███████▊  | 77/98 [00:07<00:01, 11.36it/s][A

Computing support features...:  81%|████████  | 79/98 [00:07<00:01, 11.54it/s][A

Computing support features...:  83%|████████▎ | 81/98 [00:08<00:01, 11.53it/s][A

Computing support features...:  85%|████████▍ | 83/98 [00:08<00:01, 11.52it/s][A

Computing support features...:  87%|████████▋ | 85/98 [00:08<00:01, 11.85it/s][A

Computing support features...:  89%|████████▉ | 87/98 [00:08<00:00, 11.71it/s][A

Computing support features...:  91%|█████████ | 89/98 [00:08<00:00, 11.67it/s][A

Computing support features...:  93%|█████████▎| 91/98 [00:08<00:00, 11.65it/s][A

Computing support features...:  95%|█████████▍| 93/98 [00:09<00:00, 11.46it/s][A

Computing support features...:  97%|█████████▋| 95/98 [00:09<00:00, 11.08it/s][A

Computing support features...:  99%|█████████▉| 97/98 [00:09<00:00, 11.28it/s][A

                                                                              [AINFO:__main__:Embedding test data with models (1/1)

Inferring...:   0%|          | 0/56 [00:00<?, ?it/s]
Inferring...:   2%|▏         | 1/56 [00:00<00:51,  1.08it/s]
Inferring...:   4%|▎         | 2/56 [00:01<00:26,  2.07it/s]
Inferring...:   5%|▌         | 3/56 [00:01<00:17,  3.08it/s]
Inferring...:   7%|▋         | 4/56 [00:01<00:13,  3.82it/s]
Inferring...:   9%|▉         | 5/56 [00:01<00:11,  4.29it/s]
Inferring...:  11%|█         | 6/56 [00:01<00:09,  5.04it/s]
Inferring...:  12%|█▎        | 7/56 [00:01<00:08,  5.62it/s]
Inferring...:  14%|█▍        | 8/56 [00:02<00:11,  4.09it/s]
Inferring...:  16%|█▌        | 9/56 [00:02<00:10,  4.53it/s]
Inferring...:  18%|█▊        | 10/56 [00:02<00:09,  4.78it/s]
Inferring...:  20%|█▉        | 11/56 [00:02<00:08,  5.31it/s]
Inferring...:  21%|██▏       | 12/56 [00:02<00:08,  5.38it/s]
Inferring...:  23%|██▎       | 13/56 [00:03<00:07,  5.78it/s]
Inferring...:  25%|██▌       | 14/56 [00:03<00:06,  6.20it/s]
Inferring...:  27%|██▋       | 15/56 [00:03<00:06,  6.13it/s]
Inferring...:  29%|██▊       | 16/56 [00:03<00:06,  6.42it/s]
Inferring...:  30%|███       | 17/56 [00:03<00:05,  6.66it/s]
Inferring...:  32%|███▏      | 18/56 [00:03<00:05,  6.64it/s]
Inferring...:  34%|███▍      | 19/56 [00:03<00:06,  6.11it/s]
Inferring...:  36%|███▌      | 20/56 [00:04<00:05,  6.22it/s]
Inferring...:  38%|███▊      | 21/56 [00:04<00:05,  6.23it/s]
Inferring...:  39%|███▉      | 22/56 [00:04<00:05,  6.04it/s]
Inferring...:  41%|████      | 23/56 [00:04<00:05,  6.10it/s]
Inferring...:  43%|████▎     | 24/56 [00:04<00:05,  5.81it/s]
Inferring...:  45%|████▍     | 25/56 [00:04<00:05,  5.96it/s]
Inferring...:  46%|████▋     | 26/56 [00:05<00:04,  6.24it/s]
Inferring...:  48%|████▊     | 27/56 [00:05<00:04,  5.88it/s]
Inferring...:  50%|█████     | 28/56 [00:05<00:04,  6.36it/s]
Inferring...:  52%|█████▏    | 29/56 [00:05<00:04,  6.37it/s]
Inferring...:  54%|█████▎    | 30/56 [00:05<00:04,  6.07it/s]
Inferring...:  55%|█████▌    | 31/56 [00:05<00:04,  6.19it/s]
Inferring...:  57%|█████▋    | 32/56 [00:06<00:04,  5.99it/s]
Inferring...:  59%|█████▉    | 33/56 [00:06<00:03,  5.91it/s]
Inferring...:  61%|██████    | 34/56 [00:06<00:03,  6.02it/s]
Inferring...:  62%|██████▎   | 35/56 [00:06<00:03,  5.89it/s]
Inferring...:  64%|██████▍   | 36/56 [00:06<00:03,  6.16it/s]
Inferring...:  66%|██████▌   | 37/56 [00:06<00:03,  6.33it/s]
Inferring...:  68%|██████▊   | 38/56 [00:07<00:03,  5.92it/s]
Inferring...:  70%|██████▉   | 39/56 [00:07<00:02,  6.05it/s]
Inferring...:  71%|███████▏  | 40/56 [00:07<00:02,  5.88it/s]
Inferring...:  73%|███████▎  | 41/56 [00:07<00:02,  5.97it/s]
Inferring...:  75%|███████▌  | 42/56 [00:07<00:02,  5.89it/s]
Inferring...:  77%|███████▋  | 43/56 [00:07<00:02,  5.75it/s]
Inferring...:  79%|███████▊  | 44/56 [00:08<00:01,  6.15it/s]
Inferring...:  80%|████████  | 45/56 [00:08<00:01,  6.01it/s]
Inferring...:  82%|████████▏ | 46/56 [00:08<00:01,  6.02it/s]
Inferring...:  84%|████████▍ | 47/56 [00:08<00:01,  6.21it/s]
Inferring...:  86%|████████▌ | 48/56 [00:08<00:01,  5.88it/s]
Inferring...:  88%|████████▊ | 49/56 [00:08<00:01,  6.18it/s]
Inferring...:  89%|████████▉ | 50/56 [00:09<00:01,  5.88it/s]
Inferring...:  91%|█████████ | 51/56 [00:09<00:00,  5.99it/s]
Inferring...:  93%|█████████▎| 52/56 [00:09<00:00,  6.10it/s]
Inferring...:  95%|█████████▍| 53/56 [00:09<00:00,  5.76it/s]
Inferring...:  96%|█████████▋| 54/56 [00:09<00:00,  6.14it/s]
Inferring...:  98%|█████████▊| 55/56 [00:09<00:00,  5.95it/s]
Inferring...: 100%|██████████| 56/56 [00:10<00:00,  5.87it/s]
                                                             
INFO:__main__:Computing evaluation metrics.
INFO:__main__:instance_auroc: 0.979
INFO:__main__:full_pixel_auroc: 0.992
INFO:__main__:anomaly_pixel_auroc: 0.990
INFO:__main__:

-----

INFO:__main__:Evaluating dataset [mvtec_hazelnut] (9/15)...


INFO:__main__:Training models (1/1)
AUROC: 0.9891661405563354
Partial AUROC: 0.978763222694397
AP: 0.5108447074890137
<class 'float'>
tensor(5619712.) 5619712
wAP:  0.3955104649066925


Computing support features...:   0%|          | 0/176 [00:00<?, ?it/s][A

Computing support features...:   1%|          | 1/176 [00:00<02:16,  1.28it/s][A

Computing support features...:   2%|▏         | 3/176 [00:00<00:45,  3.83it/s][A

Computing support features...:   3%|▎         | 5/176 [00:01<00:29,  5.83it/s][A

Computing support features...:   3%|▎         | 6/176 [00:01<00:37,  4.57it/s][A

Computing support features...:   5%|▍         | 8/176 [00:01<00:27,  6.16it/s][A

Computing support features...:   6%|▌         | 10/176 [00:01<00:21,  7.61it/s][A

Computing support features...:   7%|▋         | 12/176 [00:01<00:18,  8.72it/s][A

Computing support features...:   8%|▊         | 14/176 [00:02<00:16,  9.63it/s][A

Computing support features...:   9%|▉         | 16/176 [00:02<00:15, 10.37it/s][A

Computing support features...:  10%|█         | 18/176 [00:02<00:14, 10.67it/s][A

Computing support features...:  11%|█▏        | 20/176 [00:02<00:13, 11.26it/s][A

Computing support features...:  12%|█▎        | 22/176 [00:02<00:13, 11.49it/s][A

Computing support features...:  14%|█▎        | 24/176 [00:02<00:13, 11.30it/s][A

Computing support features...:  15%|█▍        | 26/176 [00:03<00:13, 11.34it/s][A

Computing support features...:  16%|█▌        | 28/176 [00:03<00:12, 11.60it/s][A

Computing support features...:  17%|█▋        | 30/176 [00:03<00:12, 11.91it/s][A

Computing support features...:  18%|█▊        | 32/176 [00:03<00:12, 11.85it/s][A

Computing support features...:  19%|█▉        | 34/176 [00:03<00:11, 11.95it/s][A

Computing support features...:  20%|██        | 36/176 [00:03<00:11, 11.91it/s][A

Computing support features...:  22%|██▏       | 38/176 [00:04<00:11, 12.01it/s][A

Computing support features...:  23%|██▎       | 40/176 [00:04<00:14,  9.41it/s][A

Computing support features...:  24%|██▍       | 42/176 [00:04<00:13, 10.22it/s][A

Computing support features...:  25%|██▌       | 44/176 [00:04<00:12, 10.61it/s][A

Computing support features...:  26%|██▌       | 46/176 [00:04<00:11, 11.13it/s][A

Computing support features...:  27%|██▋       | 48/176 [00:05<00:11, 11.47it/s][A

Computing support features...:  28%|██▊       | 50/176 [00:05<00:11, 11.42it/s][A

Computing support features...:  30%|██▉       | 52/176 [00:05<00:10, 11.78it/s][A

Computing support features...:  31%|███       | 54/176 [00:05<00:10, 11.74it/s][A

Computing support features...:  32%|███▏      | 56/176 [00:05<00:10, 11.84it/s][A

Computing support features...:  33%|███▎      | 58/176 [00:05<00:09, 11.83it/s][A

Computing support features...:  34%|███▍      | 60/176 [00:06<00:09, 11.82it/s][A

Computing support features...:  35%|███▌      | 62/176 [00:06<00:09, 11.86it/s][A

Computing support features...:  36%|███▋      | 64/176 [00:06<00:09, 11.73it/s][A

Computing support features...:  38%|███▊      | 66/176 [00:06<00:09, 11.93it/s][A

Computing support features...:  39%|███▊      | 68/176 [00:06<00:09, 11.75it/s][A

Computing support features...:  40%|███▉      | 70/176 [00:06<00:08, 11.91it/s][A

Computing support features...:  41%|████      | 72/176 [00:07<00:08, 11.76it/s][A

Computing support features...:  42%|████▏     | 74/176 [00:07<00:08, 11.88it/s][A

Computing support features...:  43%|████▎     | 76/176 [00:07<00:08, 11.91it/s][A

Computing support features...:  44%|████▍     | 78/176 [00:07<00:08, 11.76it/s][A

Computing support features...:  45%|████▌     | 80/176 [00:07<00:07, 12.15it/s][A

Computing support features...:  47%|████▋     | 82/176 [00:07<00:07, 11.98it/s][A

Computing support features...:  48%|████▊     | 84/176 [00:08<00:07, 11.90it/s][A

Computing support features...:  49%|████▉     | 86/176 [00:08<00:09,  9.03it/s][A

Computing support features...:  50%|█████     | 88/176 [00:08<00:08,  9.89it/s][A

Computing support features...:  51%|█████     | 90/176 [00:08<00:08, 10.41it/s][A

Computing support features...:  52%|█████▏    | 92/176 [00:08<00:07, 10.88it/s][A

Computing support features...:  53%|█████▎    | 94/176 [00:09<00:07, 11.11it/s][A

Computing support features...:  55%|█████▍    | 96/176 [00:09<00:07, 11.26it/s][A

Computing support features...:  56%|█████▌    | 98/176 [00:09<00:06, 11.60it/s][A

Computing support features...:  57%|█████▋    | 100/176 [00:09<00:06, 11.56it/s][A

Computing support features...:  58%|█████▊    | 102/176 [00:09<00:06, 11.64it/s][A

Computing support features...:  59%|█████▉    | 104/176 [00:10<00:06, 11.45it/s][A

Computing support features...:  60%|██████    | 106/176 [00:10<00:06, 11.57it/s][A

Computing support features...:  61%|██████▏   | 108/176 [00:10<00:05, 11.61it/s][A

Computing support features...:  62%|██████▎   | 110/176 [00:10<00:05, 11.48it/s][A

Computing support features...:  64%|██████▎   | 112/176 [00:10<00:05, 11.67it/s][A

Computing support features...:  65%|██████▍   | 114/176 [00:10<00:05, 11.49it/s][A

Computing support features...:  66%|██████▌   | 116/176 [00:11<00:05, 11.81it/s][A

Computing support features...:  67%|██████▋   | 118/176 [00:11<00:05, 11.55it/s][A

Computing support features...:  68%|██████▊   | 120/176 [00:11<00:04, 11.83it/s][A

Computing support features...:  69%|██████▉   | 122/176 [00:11<00:04, 11.98it/s][A

Computing support features...:  70%|███████   | 124/176 [00:11<00:04, 11.91it/s][A

Computing support features...:  72%|███████▏  | 126/176 [00:11<00:04, 12.28it/s][A

Computing support features...:  73%|███████▎  | 128/176 [00:12<00:03, 12.13it/s][A

Computing support features...:  74%|███████▍  | 130/176 [00:12<00:03, 11.99it/s][A

Computing support features...:  75%|███████▌  | 132/176 [00:12<00:03, 11.91it/s][A

Computing support features...:  76%|███████▌  | 134/176 [00:12<00:03, 11.90it/s][A

Computing support features...:  77%|███████▋  | 136/176 [00:12<00:04,  8.54it/s][A

Computing support features...:  78%|███████▊  | 138/176 [00:13<00:04,  9.48it/s][A

Computing support features...:  80%|███████▉  | 140/176 [00:13<00:03, 10.05it/s][A

Computing support features...:  81%|████████  | 142/176 [00:13<00:03, 10.89it/s][A

Computing support features...:  82%|████████▏ | 144/176 [00:13<00:02, 11.28it/s][A

Computing support features...:  83%|████████▎ | 146/176 [00:13<00:02, 11.63it/s][A

Computing support features...:  84%|████████▍ | 148/176 [00:13<00:02, 12.09it/s][A

Computing support features...:  85%|████████▌ | 150/176 [00:14<00:02, 12.11it/s][A

Computing support features...:  86%|████████▋ | 152/176 [00:14<00:01, 12.20it/s][A

Computing support features...:  88%|████████▊ | 154/176 [00:14<00:01, 12.21it/s][A

Computing support features...:  89%|████████▊ | 156/176 [00:14<00:01, 11.99it/s][A

Computing support features...:  90%|████████▉ | 158/176 [00:14<00:01, 12.18it/s][A

Computing support features...:  91%|█████████ | 160/176 [00:14<00:01, 11.84it/s][A

Computing support features...:  92%|█████████▏| 162/176 [00:15<00:01, 12.10it/s][A

Computing support features...:  93%|█████████▎| 164/176 [00:15<00:00, 12.29it/s][A

Computing support features...:  94%|█████████▍| 166/176 [00:15<00:00, 12.15it/s][A

Computing support features...:  95%|█████████▌| 168/176 [00:15<00:00, 12.69it/s][A

Computing support features...:  97%|█████████▋| 170/176 [00:15<00:00, 12.17it/s][A

Computing support features...:  98%|█████████▊| 172/176 [00:15<00:00, 11.91it/s][A

Computing support features...:  99%|█████████▉| 174/176 [00:15<00:00, 12.23it/s][A

Computing support features...: 100%|██████████| 176/176 [00:16<00:00, 12.82it/s][A

                                                                                [AINFO:__main__:Embedding test data with models (1/1)

Inferring...:   0%|          | 0/47 [00:00<?, ?it/s]
Inferring...:   2%|▏         | 1/47 [00:00<00:45,  1.01it/s]
Inferring...:   4%|▍         | 2/47 [00:01<00:22,  1.97it/s]
Inferring...:   6%|▋         | 3/47 [00:01<00:16,  2.71it/s]
Inferring...:   9%|▊         | 4/47 [00:01<00:14,  3.04it/s]
Inferring...:  11%|█         | 5/47 [00:01<00:11,  3.57it/s]
Inferring...:  13%|█▎        | 6/47 [00:02<00:11,  3.68it/s]
Inferring...:  15%|█▍        | 7/47 [00:02<00:09,  4.07it/s]
Inferring...:  17%|█▋        | 8/47 [00:02<00:09,  4.01it/s]
Inferring...:  19%|█▉        | 9/47 [00:02<00:08,  4.26it/s]
Inferring...:  21%|██▏       | 10/47 [00:02<00:09,  4.11it/s]
Inferring...:  23%|██▎       | 11/47 [00:03<00:07,  4.56it/s]
Inferring...:  26%|██▌       | 12/47 [00:03<00:07,  4.72it/s]
Inferring...:  28%|██▊       | 13/47 [00:03<00:07,  4.49it/s]
Inferring...:  30%|██▉       | 14/47 [00:03<00:07,  4.70it/s]
Inferring...:  32%|███▏      | 15/47 [00:04<00:07,  4.42it/s]
Inferring...:  34%|███▍      | 16/47 [00:04<00:06,  4.69it/s]
Inferring...:  36%|███▌      | 17/47 [00:04<00:06,  4.50it/s]
Inferring...:  38%|███▊      | 18/47 [00:04<00:06,  4.65it/s]
Inferring...:  40%|████      | 19/47 [00:04<00:05,  4.72it/s]
Inferring...:  43%|████▎     | 20/47 [00:05<00:06,  4.44it/s]
Inferring...:  45%|████▍     | 21/47 [00:05<00:05,  4.55it/s]
Inferring...:  47%|████▋     | 22/47 [00:05<00:05,  4.31it/s]
Inferring...:  49%|████▉     | 23/47 [00:05<00:05,  4.43it/s]
Inferring...:  51%|█████     | 24/47 [00:06<00:05,  4.27it/s]
Inferring...:  53%|█████▎    | 25/47 [00:06<00:04,  4.50it/s]
Inferring...:  55%|█████▌    | 26/47 [00:06<00:04,  4.43it/s]
Inferring...:  57%|█████▋    | 27/47 [00:06<00:04,  4.58it/s]
Inferring...:  60%|█████▉    | 28/47 [00:06<00:04,  4.36it/s]
Inferring...:  62%|██████▏   | 29/47 [00:07<00:03,  4.65it/s]
Inferring...:  64%|██████▍   | 30/47 [00:07<00:03,  4.43it/s]
Inferring...:  66%|██████▌   | 31/47 [00:07<00:04,  3.28it/s]
Inferring...:  68%|██████▊   | 32/47 [00:08<00:04,  3.66it/s]
Inferring...:  70%|███████   | 33/47 [00:08<00:03,  3.77it/s]
Inferring...:  72%|███████▏  | 34/47 [00:08<00:03,  4.09it/s]
Inferring...:  74%|███████▍  | 35/47 [00:08<00:02,  4.04it/s]
Inferring...:  77%|███████▋  | 36/47 [00:08<00:02,  4.44it/s]
Inferring...:  79%|███████▊  | 37/47 [00:09<00:02,  4.31it/s]
Inferring...:  81%|████████  | 38/47 [00:09<00:01,  4.53it/s]
Inferring...:  83%|████████▎ | 39/47 [00:09<00:01,  4.38it/s]
Inferring...:  85%|████████▌ | 40/47 [00:09<00:01,  4.59it/s]
Inferring...:  87%|████████▋ | 41/47 [00:10<00:01,  4.43it/s]
Inferring...:  89%|████████▉ | 42/47 [00:10<00:01,  4.66it/s]
Inferring...:  91%|█████████▏| 43/47 [00:10<00:00,  4.40it/s]
Inferring...:  94%|█████████▎| 44/47 [00:10<00:00,  4.60it/s]
Inferring...:  96%|█████████▌| 45/47 [00:10<00:00,  4.36it/s]
Inferring...:  98%|█████████▊| 46/47 [00:11<00:00,  4.64it/s]
Inferring...: 100%|██████████| 47/47 [00:11<00:00,  4.42it/s]
                                                             
INFO:__main__:Computing evaluation metrics.
INFO:__main__:instance_auroc: 1.000
INFO:__main__:full_pixel_auroc: 0.990
INFO:__main__:anomaly_pixel_auroc: 0.983
INFO:__main__:

-----

INFO:__main__:Evaluating dataset [mvtec_metal_nut] (10/15)...


INFO:__main__:Training models (1/1)
AUROC: 0.9896597266197205
Partial AUROC: 0.9797566533088684
AP: 0.6863647699356079
<class 'float'>
tensor(4716544.) 4716544
wAP:  0.6875631213188171


Computing support features...:   0%|          | 0/99 [00:00<?, ?it/s][A

Computing support features...:   1%|          | 1/99 [00:00<01:13,  1.32it/s][A

Computing support features...:   3%|▎         | 3/99 [00:00<00:24,  3.85it/s][A

Computing support features...:   5%|▌         | 5/99 [00:01<00:15,  5.96it/s][A

Computing support features...:   7%|▋         | 7/99 [00:01<00:11,  7.70it/s][A

Computing support features...:   9%|▉         | 9/99 [00:01<00:10,  8.80it/s][A

Computing support features...:  11%|█         | 11/99 [00:01<00:08, 10.00it/s][A

Computing support features...:  13%|█▎        | 13/99 [00:01<00:08, 10.65it/s][A

Computing support features...:  15%|█▌        | 15/99 [00:01<00:07, 10.89it/s][A

Computing support features...:  17%|█▋        | 17/99 [00:02<00:07, 11.37it/s][A

Computing support features...:  19%|█▉        | 19/99 [00:02<00:06, 11.43it/s][A

Computing support features...:  21%|██        | 21/99 [00:02<00:06, 11.61it/s][A

Computing support features...:  23%|██▎       | 23/99 [00:02<00:06, 11.52it/s][A

Computing support features...:  25%|██▌       | 25/99 [00:02<00:06, 11.68it/s][A

Computing support features...:  27%|██▋       | 27/99 [00:02<00:06, 11.77it/s][A

Computing support features...:  29%|██▉       | 29/99 [00:03<00:09,  7.69it/s][A

Computing support features...:  31%|███▏      | 31/99 [00:03<00:07,  8.57it/s][A

Computing support features...:  33%|███▎      | 33/99 [00:03<00:07,  9.37it/s][A

Computing support features...:  35%|███▌      | 35/99 [00:03<00:06, 10.10it/s][A

Computing support features...:  37%|███▋      | 37/99 [00:04<00:05, 10.73it/s][A

Computing support features...:  39%|███▉      | 39/99 [00:04<00:05, 11.05it/s][A

Computing support features...:  41%|████▏     | 41/99 [00:04<00:05, 11.35it/s][A

Computing support features...:  43%|████▎     | 43/99 [00:04<00:04, 11.52it/s][A

Computing support features...:  45%|████▌     | 45/99 [00:04<00:04, 11.51it/s][A

Computing support features...:  47%|████▋     | 47/99 [00:04<00:04, 11.81it/s][A

Computing support features...:  49%|████▉     | 49/99 [00:05<00:04, 11.68it/s][A

Computing support features...:  52%|█████▏    | 51/99 [00:05<00:03, 12.14it/s][A

Computing support features...:  54%|█████▎    | 53/99 [00:05<00:03, 12.04it/s][A

Computing support features...:  56%|█████▌    | 55/99 [00:05<00:03, 11.80it/s][A

Computing support features...:  58%|█████▊    | 57/99 [00:05<00:03, 11.95it/s][A

Computing support features...:  60%|█████▉    | 59/99 [00:05<00:03, 11.75it/s][A

Computing support features...:  62%|██████▏   | 61/99 [00:06<00:03, 11.96it/s][A

Computing support features...:  64%|██████▎   | 63/99 [00:06<00:03, 11.89it/s][A

Computing support features...:  66%|██████▌   | 65/99 [00:06<00:02, 11.89it/s][A

Computing support features...:  68%|██████▊   | 67/99 [00:06<00:02, 11.74it/s][A

Computing support features...:  70%|██████▉   | 69/99 [00:06<00:03,  8.95it/s][A

Computing support features...:  72%|███████▏  | 71/99 [00:07<00:02,  9.50it/s][A

Computing support features...:  74%|███████▎  | 73/99 [00:07<00:02, 10.20it/s][A

Computing support features...:  76%|███████▌  | 75/99 [00:07<00:02, 10.47it/s][A

Computing support features...:  78%|███████▊  | 77/99 [00:07<00:02, 10.57it/s][A

Computing support features...:  80%|███████▉  | 79/99 [00:07<00:01, 10.58it/s][A

Computing support features...:  82%|████████▏ | 81/99 [00:07<00:01, 10.87it/s][A

Computing support features...:  84%|████████▍ | 83/99 [00:08<00:01, 10.98it/s][A

Computing support features...:  86%|████████▌ | 85/99 [00:08<00:01, 11.11it/s][A

Computing support features...:  88%|████████▊ | 87/99 [00:08<00:01, 11.06it/s][A

Computing support features...:  90%|████████▉ | 89/99 [00:08<00:00, 10.95it/s][A

Computing support features...:  92%|█████████▏| 91/99 [00:08<00:00, 11.01it/s][A

Computing support features...:  94%|█████████▍| 93/99 [00:09<00:00, 10.82it/s][A

Computing support features...:  96%|█████████▌| 95/99 [00:09<00:00, 11.26it/s][A

Computing support features...:  98%|█████████▊| 97/99 [00:09<00:00, 11.30it/s][A

Computing support features...: 100%|██████████| 99/99 [00:09<00:00, 11.48it/s][A

                                                                              [AINFO:__main__:Embedding test data with models (1/1)

Inferring...:   0%|          | 0/50 [00:00<?, ?it/s]
Inferring...:   2%|▏         | 1/50 [00:00<00:45,  1.08it/s]
Inferring...:   4%|▍         | 2/50 [00:01<00:22,  2.15it/s]
Inferring...:   6%|▌         | 3/50 [00:01<00:15,  3.13it/s]
Inferring...:   8%|▊         | 4/50 [00:01<00:12,  3.72it/s]
Inferring...:  10%|█         | 5/50 [00:01<00:09,  4.57it/s]
Inferring...:  12%|█▏        | 6/50 [00:01<00:08,  4.99it/s]
Inferring...:  14%|█▍        | 7/50 [00:01<00:08,  5.10it/s]
Inferring...:  16%|█▌        | 8/50 [00:02<00:07,  5.46it/s]
Inferring...:  18%|█▊        | 9/50 [00:02<00:07,  5.40it/s]
Inferring...:  20%|██        | 10/50 [00:02<00:07,  5.67it/s]
Inferring...:  22%|██▏       | 11/50 [00:02<00:07,  5.57it/s]
Inferring...:  24%|██▍       | 12/50 [00:02<00:06,  5.55it/s]
Inferring...:  26%|██▌       | 13/50 [00:02<00:06,  5.75it/s]
Inferring...:  28%|██▊       | 14/50 [00:03<00:06,  5.63it/s]
Inferring...:  30%|███       | 15/50 [00:03<00:05,  5.85it/s]
Inferring...:  32%|███▏      | 16/50 [00:03<00:05,  5.83it/s]
Inferring...:  34%|███▍      | 17/50 [00:03<00:05,  5.81it/s]
Inferring...:  36%|███▌      | 18/50 [00:03<00:05,  5.99it/s]
Inferring...:  38%|███▊      | 19/50 [00:03<00:05,  5.78it/s]
Inferring...:  40%|████      | 20/50 [00:04<00:04,  6.14it/s]
Inferring...:  42%|████▏     | 21/50 [00:04<00:04,  5.90it/s]
Inferring...:  44%|████▍     | 22/50 [00:04<00:04,  5.81it/s]
Inferring...:  46%|████▌     | 23/50 [00:04<00:04,  5.87it/s]
Inferring...:  48%|████▊     | 24/50 [00:04<00:04,  5.80it/s]
Inferring...:  50%|█████     | 25/50 [00:04<00:04,  6.04it/s]
Inferring...:  52%|█████▏    | 26/50 [00:05<00:05,  4.46it/s]
Inferring...:  54%|█████▍    | 27/50 [00:05<00:04,  4.98it/s]
Inferring...:  56%|█████▌    | 28/50 [00:05<00:04,  5.19it/s]
Inferring...:  58%|█████▊    | 29/50 [00:05<00:03,  5.45it/s]
Inferring...:  60%|██████    | 30/50 [00:05<00:03,  5.81it/s]
Inferring...:  62%|██████▏   | 31/50 [00:06<00:03,  5.70it/s]
Inferring...:  64%|██████▍   | 32/50 [00:06<00:03,  5.71it/s]
Inferring...:  66%|██████▌   | 33/50 [00:06<00:02,  5.85it/s]
Inferring...:  68%|██████▊   | 34/50 [00:06<00:02,  5.80it/s]
Inferring...:  70%|███████   | 35/50 [00:06<00:02,  6.09it/s]
Inferring...:  72%|███████▏  | 36/50 [00:06<00:02,  6.36it/s]
Inferring...:  74%|███████▍  | 37/50 [00:07<00:02,  6.15it/s]
Inferring...:  76%|███████▌  | 38/50 [00:07<00:01,  6.13it/s]
Inferring...:  78%|███████▊  | 39/50 [00:07<00:01,  6.29it/s]
Inferring...:  80%|████████  | 40/50 [00:07<00:01,  6.00it/s]
Inferring...:  82%|████████▏ | 41/50 [00:07<00:01,  6.38it/s]
Inferring...:  84%|████████▍ | 42/50 [00:07<00:01,  6.10it/s]
Inferring...:  86%|████████▌ | 43/50 [00:08<00:01,  5.88it/s]
Inferring...:  88%|████████▊ | 44/50 [00:08<00:00,  6.04it/s]
Inferring...:  90%|█████████ | 45/50 [00:08<00:00,  5.91it/s]
Inferring...:  92%|█████████▏| 46/50 [00:08<00:00,  6.05it/s]
Inferring...:  94%|█████████▍| 47/50 [00:08<00:00,  6.01it/s]
Inferring...:  96%|█████████▌| 48/50 [00:08<00:00,  5.99it/s]
Inferring...:  98%|█████████▊| 49/50 [00:09<00:00,  6.36it/s]
                                                             
INFO:__main__:Computing evaluation metrics.
INFO:__main__:instance_auroc: 0.999
INFO:__main__:full_pixel_auroc: 0.987
INFO:__main__:anomaly_pixel_auroc: 0.983
INFO:__main__:

-----

INFO:__main__:Evaluating dataset [mvtec_pill] (11/15)...


INFO:__main__:Training models (1/1)
AUROC: 0.9866987466812134
Partial AUROC: 0.9739824533462524
AP: 0.8965752124786377
<class 'float'>
tensor(4967424.) 4967424
wAP:  0.8911733031272888


Computing support features...:   0%|          | 0/121 [00:00<?, ?it/s][A

Computing support features...:   1%|          | 1/121 [00:00<01:32,  1.30it/s][A

Computing support features...:   2%|▏         | 3/121 [00:00<00:31,  3.76it/s][A

Computing support features...:   4%|▍         | 5/121 [00:01<00:20,  5.79it/s][A

Computing support features...:   6%|▌         | 7/121 [00:01<00:15,  7.41it/s][A

Computing support features...:   7%|▋         | 9/121 [00:01<00:12,  8.66it/s][A

Computing support features...:   9%|▉         | 11/121 [00:01<00:11,  9.73it/s][A

Computing support features...:  11%|█         | 13/121 [00:01<00:10, 10.12it/s][A

Computing support features...:  12%|█▏        | 15/121 [00:01<00:09, 10.79it/s][A

Computing support features...:  14%|█▍        | 17/121 [00:02<00:09, 10.79it/s][A

Computing support features...:  16%|█▌        | 19/121 [00:02<00:13,  7.75it/s][A

Computing support features...:  17%|█▋        | 21/121 [00:02<00:11,  8.76it/s][A

Computing support features...:  19%|█▉        | 23/121 [00:02<00:10,  9.37it/s][A

Computing support features...:  21%|██        | 25/121 [00:03<00:09, 10.15it/s][A

Computing support features...:  22%|██▏       | 27/121 [00:03<00:08, 10.52it/s][A

Computing support features...:  24%|██▍       | 29/121 [00:03<00:08, 10.88it/s][A

Computing support features...:  26%|██▌       | 31/121 [00:03<00:08, 10.79it/s][A

Computing support features...:  27%|██▋       | 33/121 [00:03<00:08, 10.99it/s][A

Computing support features...:  29%|██▉       | 35/121 [00:03<00:07, 10.99it/s][A

Computing support features...:  31%|███       | 37/121 [00:04<00:07, 11.36it/s][A

Computing support features...:  32%|███▏      | 39/121 [00:04<00:07, 11.27it/s][A

Computing support features...:  34%|███▍      | 41/121 [00:04<00:07, 11.27it/s][A

Computing support features...:  36%|███▌      | 43/121 [00:04<00:06, 11.47it/s][A

Computing support features...:  37%|███▋      | 45/121 [00:04<00:06, 11.45it/s][A

Computing support features...:  39%|███▉      | 47/121 [00:04<00:06, 11.41it/s][A

Computing support features...:  40%|████      | 49/121 [00:05<00:06, 11.31it/s][A

Computing support features...:  42%|████▏     | 51/121 [00:05<00:06, 11.14it/s][A

Computing support features...:  44%|████▍     | 53/121 [00:05<00:05, 11.36it/s][A

Computing support features...:  45%|████▌     | 55/121 [00:05<00:05, 11.18it/s][A

Computing support features...:  47%|████▋     | 57/121 [00:06<00:07,  8.64it/s][A

Computing support features...:  49%|████▉     | 59/121 [00:06<00:06,  9.26it/s][A

Computing support features...:  50%|█████     | 61/121 [00:06<00:06,  9.89it/s][A

Computing support features...:  52%|█████▏    | 63/121 [00:06<00:05, 10.25it/s][A

Computing support features...:  54%|█████▎    | 65/121 [00:06<00:05, 11.07it/s][A

Computing support features...:  55%|█████▌    | 67/121 [00:06<00:04, 11.58it/s][A

Computing support features...:  57%|█████▋    | 69/121 [00:07<00:04, 11.56it/s][A

Computing support features...:  59%|█████▊    | 71/121 [00:07<00:04, 11.76it/s][A

Computing support features...:  60%|██████    | 73/121 [00:07<00:04, 11.75it/s][A

Computing support features...:  62%|██████▏   | 75/121 [00:07<00:03, 11.84it/s][A

Computing support features...:  64%|██████▎   | 77/121 [00:07<00:03, 11.99it/s][A

Computing support features...:  65%|██████▌   | 79/121 [00:07<00:03, 11.49it/s][A

Computing support features...:  67%|██████▋   | 81/121 [00:08<00:03, 11.90it/s][A

Computing support features...:  69%|██████▊   | 83/121 [00:08<00:03, 11.50it/s][A

Computing support features...:  70%|███████   | 85/121 [00:08<00:03, 11.54it/s][A

Computing support features...:  72%|███████▏  | 87/121 [00:08<00:02, 11.83it/s][A

Computing support features...:  74%|███████▎  | 89/121 [00:08<00:02, 11.62it/s][A

Computing support features...:  75%|███████▌  | 91/121 [00:08<00:02, 11.32it/s][A

Computing support features...:  77%|███████▋  | 93/121 [00:09<00:02, 11.17it/s][A

Computing support features...:  79%|███████▊  | 95/121 [00:09<00:02, 11.06it/s][A

Computing support features...:  80%|████████  | 97/121 [00:09<00:02, 11.27it/s][A

Computing support features...:  82%|████████▏ | 99/121 [00:09<00:01, 11.45it/s][A

Computing support features...:  83%|████████▎ | 101/121 [00:09<00:01, 11.50it/s][A

Computing support features...:  85%|████████▌ | 103/121 [00:10<00:01, 11.46it/s][A

Computing support features...:  87%|████████▋ | 105/121 [00:10<00:01,  8.73it/s][A

Computing support features...:  88%|████████▊ | 107/121 [00:10<00:01,  9.59it/s][A

Computing support features...:  90%|█████████ | 109/121 [00:10<00:01, 10.32it/s][A

Computing support features...:  92%|█████████▏| 111/121 [00:10<00:00, 10.63it/s][A

Computing support features...:  93%|█████████▎| 113/121 [00:11<00:00, 11.01it/s][A

Computing support features...:  95%|█████████▌| 115/121 [00:11<00:00, 11.26it/s][A

Computing support features...:  97%|█████████▋| 117/121 [00:11<00:00, 11.53it/s][A

Computing support features...:  98%|█████████▊| 119/121 [00:11<00:00, 11.82it/s][A

Computing support features...: 100%|██████████| 121/121 [00:11<00:00, 12.12it/s][A

                                                                                [AINFO:__main__:Embedding test data with models (1/1)

Inferring...:   0%|          | 0/70 [00:00<?, ?it/s]
Inferring...:   1%|▏         | 1/70 [00:00<01:02,  1.10it/s]
Inferring...:   3%|▎         | 2/70 [00:01<00:33,  2.00it/s]
Inferring...:   4%|▍         | 3/70 [00:01<00:23,  2.84it/s]
Inferring...:   6%|▌         | 4/70 [00:01<00:17,  3.69it/s]
Inferring...:   7%|▋         | 5/70 [00:01<00:14,  4.53it/s]
Inferring...:   9%|▊         | 6/70 [00:01<00:12,  5.22it/s]
Inferring...:  10%|█         | 7/70 [00:01<00:11,  5.31it/s]
Inferring...:  11%|█▏        | 8/70 [00:02<00:11,  5.42it/s]
Inferring...:  13%|█▎        | 9/70 [00:02<00:11,  5.35it/s]
Inferring...:  14%|█▍        | 10/70 [00:02<00:10,  5.46it/s]
Inferring...:  16%|█▌        | 11/70 [00:02<00:10,  5.46it/s]
Inferring...:  17%|█▋        | 12/70 [00:02<00:10,  5.61it/s]
Inferring...:  19%|█▊        | 13/70 [00:02<00:10,  5.45it/s]
Inferring...:  20%|██        | 14/70 [00:03<00:10,  5.36it/s]
Inferring...:  21%|██▏       | 15/70 [00:03<00:10,  5.38it/s]
Inferring...:  23%|██▎       | 16/70 [00:03<00:09,  5.43it/s]
Inferring...:  24%|██▍       | 17/70 [00:03<00:09,  5.50it/s]
Inferring...:  26%|██▌       | 18/70 [00:03<00:09,  5.49it/s]
Inferring...:  27%|██▋       | 19/70 [00:04<00:09,  5.41it/s]
Inferring...:  29%|██▊       | 20/70 [00:04<00:09,  5.46it/s]
Inferring...:  30%|███       | 21/70 [00:04<00:08,  5.56it/s]
Inferring...:  31%|███▏      | 22/70 [00:04<00:08,  5.54it/s]
Inferring...:  33%|███▎      | 23/70 [00:04<00:08,  5.59it/s]
Inferring...:  34%|███▍      | 24/70 [00:04<00:08,  5.59it/s]
Inferring...:  36%|███▌      | 25/70 [00:05<00:08,  5.57it/s]
Inferring...:  37%|███▋      | 26/70 [00:05<00:07,  5.61it/s]
Inferring...:  39%|███▊      | 27/70 [00:05<00:07,  5.55it/s]
Inferring...:  40%|████      | 28/70 [00:05<00:07,  5.56it/s]
Inferring...:  41%|████▏     | 29/70 [00:05<00:07,  5.50it/s]
Inferring...:  43%|████▎     | 30/70 [00:06<00:07,  5.47it/s]
Inferring...:  44%|████▍     | 31/70 [00:06<00:07,  5.43it/s]
Inferring...:  46%|████▌     | 32/70 [00:06<00:07,  5.39it/s]
Inferring...:  47%|████▋     | 33/70 [00:06<00:06,  5.36it/s]
Inferring...:  49%|████▊     | 34/70 [00:06<00:06,  5.67it/s]
Inferring...:  50%|█████     | 35/70 [00:06<00:05,  5.84it/s]
Inferring...:  51%|█████▏    | 36/70 [00:07<00:05,  6.09it/s]
Inferring...:  53%|█████▎    | 37/70 [00:07<00:05,  6.14it/s]
Inferring...:  54%|█████▍    | 38/70 [00:07<00:05,  6.27it/s]
Inferring...:  56%|█████▌    | 39/70 [00:07<00:04,  6.35it/s]
Inferring...:  57%|█████▋    | 40/70 [00:07<00:04,  6.27it/s]
Inferring...:  59%|█████▊    | 41/70 [00:07<00:04,  6.66it/s]
Inferring...:  60%|██████    | 42/70 [00:07<00:04,  6.94it/s]
Inferring...:  61%|██████▏   | 43/70 [00:08<00:03,  7.11it/s]
Inferring...:  63%|██████▎   | 44/70 [00:08<00:03,  7.06it/s]
Inferring...:  64%|██████▍   | 45/70 [00:08<00:03,  7.01it/s]
Inferring...:  66%|██████▌   | 46/70 [00:08<00:03,  7.06it/s]
Inferring...:  67%|██████▋   | 47/70 [00:08<00:03,  7.14it/s]
Inferring...:  69%|██████▊   | 48/70 [00:08<00:03,  7.12it/s]
Inferring...:  70%|███████   | 49/70 [00:08<00:02,  7.14it/s]
Inferring...:  71%|███████▏  | 50/70 [00:09<00:02,  7.09it/s]
Inferring...:  73%|███████▎  | 51/70 [00:09<00:02,  7.08it/s]
Inferring...:  74%|███████▍  | 52/70 [00:09<00:02,  7.16it/s]
Inferring...:  76%|███████▌  | 53/70 [00:09<00:02,  7.14it/s]
Inferring...:  77%|███████▋  | 54/70 [00:09<00:02,  7.19it/s]
Inferring...:  79%|███████▊  | 55/70 [00:09<00:02,  7.13it/s]
Inferring...:  80%|████████  | 56/70 [00:09<00:01,  7.10it/s]
Inferring...:  81%|████████▏ | 57/70 [00:10<00:01,  7.02it/s]
Inferring...:  83%|████████▎ | 58/70 [00:10<00:01,  7.05it/s]
Inferring...:  84%|████████▍ | 59/70 [00:10<00:01,  7.17it/s]
Inferring...:  86%|████████▌ | 60/70 [00:10<00:01,  7.07it/s]
Inferring...:  87%|████████▋ | 61/70 [00:10<00:01,  7.00it/s]
Inferring...:  89%|████████▊ | 62/70 [00:10<00:01,  7.06it/s]
Inferring...:  90%|█████████ | 63/70 [00:10<00:01,  6.92it/s]
Inferring...:  91%|█████████▏| 64/70 [00:11<00:01,  4.36it/s]
Inferring...:  93%|█████████▎| 65/70 [00:11<00:01,  4.96it/s]
Inferring...:  94%|█████████▍| 66/70 [00:11<00:00,  5.45it/s]
Inferring...:  96%|█████████▌| 67/70 [00:11<00:00,  5.79it/s]
Inferring...:  97%|█████████▋| 68/70 [00:11<00:00,  6.26it/s]
Inferring...:  99%|█████████▊| 69/70 [00:12<00:00,  6.55it/s]
                                                             
INFO:__main__:Computing evaluation metrics.
INFO:__main__:instance_auroc: 0.963
INFO:__main__:full_pixel_auroc: 0.978
INFO:__main__:anomaly_pixel_auroc: 0.976
INFO:__main__:

-----

INFO:__main__:Evaluating dataset [mvtec_screw] (12/15)...


INFO:__main__:Training models (1/1)
AUROC: 0.9732879400253296
Partial AUROC: 0.9507014751434326
AP: 0.7341581583023071
<class 'float'>
tensor(6974464.) 6974464
wAP:  0.7105074524879456


Computing support features...:   0%|          | 0/140 [00:00<?, ?it/s][A

Computing support features...:   1%|          | 1/140 [00:00<01:41,  1.38it/s][A

Computing support features...:   2%|▏         | 3/140 [00:00<00:34,  3.95it/s][A

Computing support features...:   4%|▎         | 5/140 [00:01<00:22,  5.93it/s][A

Computing support features...:   5%|▌         | 7/140 [00:01<00:17,  7.40it/s][A

Computing support features...:   6%|▋         | 9/140 [00:01<00:15,  8.46it/s][A

Computing support features...:   8%|▊         | 11/140 [00:01<00:13,  9.53it/s][A

Computing support features...:   9%|▉         | 13/140 [00:01<00:12,  9.89it/s][A

Computing support features...:  11%|█         | 15/140 [00:01<00:11, 10.51it/s][A

Computing support features...:  12%|█▏        | 17/140 [00:02<00:11, 10.74it/s][A

Computing support features...:  14%|█▎        | 19/140 [00:02<00:10, 11.17it/s][A

Computing support features...:  15%|█▌        | 21/140 [00:02<00:10, 11.56it/s][A

Computing support features...:  16%|█▋        | 23/140 [00:02<00:10, 11.48it/s][A

Computing support features...:  18%|█▊        | 25/140 [00:02<00:09, 11.81it/s][A

Computing support features...:  19%|█▉        | 27/140 [00:02<00:09, 11.65it/s][A

Computing support features...:  21%|██        | 29/140 [00:03<00:09, 11.82it/s][A

Computing support features...:  22%|██▏       | 31/140 [00:03<00:09, 11.78it/s][A

Computing support features...:  24%|██▎       | 33/140 [00:03<00:13,  7.75it/s][A

Computing support features...:  25%|██▌       | 35/140 [00:03<00:12,  8.71it/s][A

Computing support features...:  26%|██▋       | 37/140 [00:04<00:10,  9.41it/s][A

Computing support features...:  28%|██▊       | 39/140 [00:04<00:10,  9.98it/s][A

Computing support features...:  29%|██▉       | 41/140 [00:04<00:09, 10.41it/s][A

Computing support features...:  31%|███       | 43/140 [00:04<00:09, 10.48it/s][A

Computing support features...:  32%|███▏      | 45/140 [00:04<00:08, 10.99it/s][A

Computing support features...:  34%|███▎      | 47/140 [00:04<00:08, 11.05it/s][A

Computing support features...:  35%|███▌      | 49/140 [00:05<00:08, 11.29it/s][A

Computing support features...:  36%|███▋      | 51/140 [00:05<00:08, 11.09it/s][A

Computing support features...:  38%|███▊      | 53/140 [00:05<00:07, 11.33it/s][A

Computing support features...:  39%|███▉      | 55/140 [00:05<00:07, 11.34it/s][A

Computing support features...:  41%|████      | 57/140 [00:05<00:07, 11.26it/s][A

Computing support features...:  42%|████▏     | 59/140 [00:06<00:07, 11.50it/s][A

Computing support features...:  44%|████▎     | 61/140 [00:06<00:06, 11.38it/s][A

Computing support features...:  45%|████▌     | 63/140 [00:06<00:06, 11.61it/s][A

Computing support features...:  46%|████▋     | 65/140 [00:06<00:06, 11.49it/s][A

Computing support features...:  48%|████▊     | 67/140 [00:06<00:06, 11.59it/s][A

Computing support features...:  49%|████▉     | 69/140 [00:06<00:06, 11.28it/s][A

Computing support features...:  51%|█████     | 71/140 [00:07<00:06, 11.49it/s][A

Computing support features...:  52%|█████▏    | 73/140 [00:07<00:07,  8.64it/s][A

Computing support features...:  54%|█████▎    | 75/140 [00:07<00:06,  9.51it/s][A

Computing support features...:  55%|█████▌    | 77/140 [00:07<00:06,  9.99it/s][A

Computing support features...:  56%|█████▋    | 79/140 [00:07<00:05, 10.54it/s][A

Computing support features...:  58%|█████▊    | 81/140 [00:08<00:05, 10.76it/s][A

Computing support features...:  59%|█████▉    | 83/140 [00:08<00:05, 11.13it/s][A

Computing support features...:  61%|██████    | 85/140 [00:08<00:04, 11.25it/s][A

Computing support features...:  62%|██████▏   | 87/140 [00:08<00:04, 11.50it/s][A

Computing support features...:  64%|██████▎   | 89/140 [00:08<00:04, 11.53it/s][A

Computing support features...:  65%|██████▌   | 91/140 [00:08<00:04, 11.50it/s][A

Computing support features...:  66%|██████▋   | 93/140 [00:09<00:04, 11.72it/s][A

Computing support features...:  68%|██████▊   | 95/140 [00:09<00:03, 11.82it/s][A

Computing support features...:  69%|██████▉   | 97/140 [00:09<00:03, 11.87it/s][A

Computing support features...:  71%|███████   | 99/140 [00:09<00:03, 11.52it/s][A

Computing support features...:  72%|███████▏  | 101/140 [00:09<00:03, 11.36it/s][A

Computing support features...:  74%|███████▎  | 103/140 [00:09<00:03, 11.75it/s][A

Computing support features...:  75%|███████▌  | 105/140 [00:10<00:02, 11.72it/s][A

Computing support features...:  76%|███████▋  | 107/140 [00:10<00:02, 11.58it/s][A

Computing support features...:  78%|███████▊  | 109/140 [00:10<00:02, 11.76it/s][A

Computing support features...:  79%|███████▉  | 111/140 [00:10<00:02, 11.59it/s][A

Computing support features...:  81%|████████  | 113/140 [00:10<00:02, 12.00it/s][A

Computing support features...:  82%|████████▏ | 115/140 [00:10<00:02, 11.88it/s][A

Computing support features...:  84%|████████▎ | 117/140 [00:11<00:01, 11.92it/s][A

Computing support features...:  85%|████████▌ | 119/140 [00:11<00:01, 11.90it/s][A

Computing support features...:  86%|████████▋ | 121/140 [00:11<00:01, 11.69it/s][A

Computing support features...:  88%|████████▊ | 123/140 [00:11<00:01, 11.72it/s][A

Computing support features...:  89%|████████▉ | 125/140 [00:11<00:01, 11.71it/s][A

Computing support features...:  91%|█████████ | 127/140 [00:12<00:01,  8.27it/s][A

Computing support features...:  92%|█████████▏| 129/140 [00:12<00:01,  9.30it/s][A

Computing support features...:  94%|█████████▎| 131/140 [00:12<00:00,  9.83it/s][A

Computing support features...:  95%|█████████▌| 133/140 [00:12<00:00, 10.41it/s][A

Computing support features...:  96%|█████████▋| 135/140 [00:12<00:00, 10.94it/s][A

Computing support features...:  98%|█████████▊| 137/140 [00:13<00:00, 11.21it/s][A

Computing support features...:  99%|█████████▉| 139/140 [00:13<00:00, 11.63it/s][A

                                                                                [AINFO:__main__:Embedding test data with models (1/1)

Inferring...:   0%|          | 0/70 [00:00<?, ?it/s]
Inferring...:   1%|▏         | 1/70 [00:00<01:03,  1.08it/s]
Inferring...:   3%|▎         | 2/70 [00:01<00:34,  1.96it/s]
Inferring...:   4%|▍         | 3/70 [00:01<00:24,  2.72it/s]
Inferring...:   6%|▌         | 4/70 [00:01<00:18,  3.59it/s]
Inferring...:   7%|▋         | 5/70 [00:01<00:15,  4.15it/s]
Inferring...:   9%|▊         | 6/70 [00:01<00:15,  4.25it/s]
Inferring...:  10%|█         | 7/70 [00:02<00:13,  4.66it/s]
Inferring...:  11%|█▏        | 8/70 [00:02<00:13,  4.53it/s]
Inferring...:  13%|█▎        | 9/70 [00:02<00:12,  4.84it/s]
Inferring...:  14%|█▍        | 10/70 [00:02<00:12,  4.78it/s]
Inferring...:  16%|█▌        | 11/70 [00:02<00:11,  5.03it/s]
Inferring...:  17%|█▋        | 12/70 [00:03<00:11,  4.87it/s]
Inferring...:  19%|█▊        | 13/70 [00:03<00:11,  5.03it/s]
Inferring...:  20%|██        | 14/70 [00:03<00:10,  5.41it/s]
Inferring...:  21%|██▏       | 15/70 [00:03<00:09,  5.71it/s]
Inferring...:  23%|██▎       | 16/70 [00:03<00:09,  5.73it/s]
Inferring...:  24%|██▍       | 17/70 [00:03<00:10,  5.21it/s]
Inferring...:  26%|██▌       | 18/70 [00:04<00:09,  5.36it/s]
Inferring...:  27%|██▋       | 19/70 [00:04<00:10,  5.05it/s]
Inferring...:  29%|██▊       | 20/70 [00:04<00:09,  5.31it/s]
Inferring...:  30%|███       | 21/70 [00:04<00:09,  4.94it/s]
Inferring...:  31%|███▏      | 22/70 [00:04<00:09,  5.11it/s]
Inferring...:  33%|███▎      | 23/70 [00:05<00:09,  4.95it/s]
Inferring...:  34%|███▍      | 24/70 [00:05<00:08,  5.15it/s]
Inferring...:  36%|███▌      | 25/70 [00:05<00:08,  5.51it/s]
Inferring...:  37%|███▋      | 26/70 [00:05<00:07,  5.72it/s]
Inferring...:  39%|███▊      | 27/70 [00:05<00:07,  5.59it/s]
Inferring...:  40%|████      | 28/70 [00:06<00:07,  5.31it/s]
Inferring...:  41%|████▏     | 29/70 [00:06<00:07,  5.40it/s]
Inferring...:  43%|████▎     | 30/70 [00:06<00:07,  5.16it/s]
Inferring...:  44%|████▍     | 31/70 [00:06<00:07,  5.26it/s]
Inferring...:  46%|████▌     | 32/70 [00:06<00:07,  5.00it/s]
Inferring...:  47%|████▋     | 33/70 [00:07<00:07,  5.18it/s]
Inferring...:  49%|████▊     | 34/70 [00:07<00:07,  5.04it/s]
Inferring...:  50%|█████     | 35/70 [00:07<00:06,  5.16it/s]
Inferring...:  51%|█████▏    | 36/70 [00:07<00:06,  5.09it/s]
Inferring...:  53%|█████▎    | 37/70 [00:07<00:06,  4.99it/s]
Inferring...:  54%|█████▍    | 38/70 [00:08<00:06,  5.20it/s]
Inferring...:  56%|█████▌    | 39/70 [00:08<00:06,  4.98it/s]
Inferring...:  57%|█████▋    | 40/70 [00:08<00:05,  5.18it/s]
Inferring...:  59%|█████▊    | 41/70 [00:08<00:05,  4.98it/s]
Inferring...:  60%|██████    | 42/70 [00:08<00:05,  5.25it/s]
Inferring...:  61%|██████▏   | 43/70 [00:09<00:05,  5.02it/s]
Inferring...:  63%|██████▎   | 44/70 [00:09<00:05,  5.00it/s]
Inferring...:  64%|██████▍   | 45/70 [00:09<00:05,  4.99it/s]
Inferring...:  66%|██████▌   | 46/70 [00:09<00:04,  4.87it/s]
Inferring...:  67%|██████▋   | 47/70 [00:09<00:04,  5.07it/s]
Inferring...:  69%|██████▊   | 48/70 [00:10<00:04,  4.89it/s]
Inferring...:  70%|███████   | 49/70 [00:10<00:04,  5.18it/s]
Inferring...:  71%|███████▏  | 50/70 [00:10<00:04,  4.94it/s]
Inferring...:  73%|███████▎  | 51/70 [00:10<00:03,  5.25it/s]
Inferring...:  74%|███████▍  | 52/70 [00:10<00:03,  5.02it/s]
Inferring...:  76%|███████▌  | 53/70 [00:10<00:03,  5.03it/s]
Inferring...:  77%|███████▋  | 54/70 [00:11<00:03,  4.83it/s]
Inferring...:  79%|███████▊  | 55/70 [00:11<00:02,  5.05it/s]
Inferring...:  80%|████████  | 56/70 [00:11<00:02,  5.30it/s]
Inferring...:  81%|████████▏ | 57/70 [00:11<00:02,  5.13it/s]
Inferring...:  83%|████████▎ | 58/70 [00:11<00:02,  5.31it/s]
Inferring...:  84%|████████▍ | 59/70 [00:12<00:02,  5.11it/s]
Inferring...:  86%|████████▌ | 60/70 [00:12<00:01,  5.26it/s]
Inferring...:  87%|████████▋ | 61/70 [00:12<00:01,  5.43it/s]
Inferring...:  89%|████████▊ | 62/70 [00:12<00:01,  5.21it/s]
Inferring...:  90%|█████████ | 63/70 [00:12<00:01,  5.43it/s]
Inferring...:  91%|█████████▏| 64/70 [00:13<00:01,  5.09it/s]
Inferring...:  93%|█████████▎| 65/70 [00:13<00:00,  5.31it/s]
Inferring...:  94%|█████████▍| 66/70 [00:13<00:00,  5.16it/s]
Inferring...:  96%|█████████▌| 67/70 [00:13<00:00,  5.22it/s]
Inferring...:  97%|█████████▋| 68/70 [00:13<00:00,  4.99it/s]
Inferring...:  99%|█████████▊| 69/70 [00:14<00:00,  5.02it/s]
Inferring...: 100%|██████████| 70/70 [00:14<00:00,  5.17it/s]
                                                             
INFO:__main__:Computing evaluation metrics.
INFO:__main__:instance_auroc: 0.975
INFO:__main__:full_pixel_auroc: 0.995
INFO:__main__:anomaly_pixel_auroc: 0.993
INFO:__main__:

-----

INFO:__main__:Evaluating dataset [mvtec_toothbrush] (13/15)...


INFO:__main__:Training models (1/1)
AUROC: 0.9930139780044556
Partial AUROC: 0.986346960067749
AP: 0.4151475131511688
<class 'float'>
tensor(7024640.) 7024640
wAP:  0.35898569226264954


Computing support features...:   0%|          | 0/24 [00:00<?, ?it/s][A

Computing support features...:   4%|▍         | 1/24 [00:00<00:19,  1.20it/s][A

Computing support features...:  12%|█▎        | 3/24 [00:01<00:05,  3.53it/s][A

Computing support features...:  21%|██        | 5/24 [00:01<00:04,  3.97it/s][A

Computing support features...:  29%|██▉       | 7/24 [00:01<00:03,  5.57it/s][A

Computing support features...:  38%|███▊      | 9/24 [00:01<00:02,  6.92it/s][A

Computing support features...:  46%|████▌     | 11/24 [00:01<00:01,  8.19it/s][A

Computing support features...:  54%|█████▍    | 13/24 [00:02<00:01,  9.20it/s][A

Computing support features...:  62%|██████▎   | 15/24 [00:02<00:00,  9.82it/s][A

Computing support features...:  71%|███████   | 17/24 [00:02<00:00, 10.53it/s][A

Computing support features...:  79%|███████▉  | 19/24 [00:02<00:00, 10.76it/s][A

Computing support features...:  88%|████████▊ | 21/24 [00:02<00:00, 11.23it/s][A

Computing support features...:  96%|█████████▌| 23/24 [00:02<00:00, 11.37it/s][A

                                                                              [AINFO:__main__:Embedding test data with models (1/1)

Inferring...:   0%|          | 0/19 [00:00<?, ?it/s]
Inferring...:   5%|▌         | 1/19 [00:00<00:16,  1.12it/s]
Inferring...:  11%|█         | 2/19 [00:01<00:07,  2.27it/s]
Inferring...:  21%|██        | 4/19 [00:01<00:03,  4.37it/s]
Inferring...:  26%|██▋       | 5/19 [00:01<00:02,  5.11it/s]
Inferring...:  32%|███▏      | 6/19 [00:01<00:02,  5.92it/s]
Inferring...:  37%|███▋      | 7/19 [00:01<00:01,  6.68it/s]
Inferring...:  42%|████▏     | 8/19 [00:01<00:01,  7.12it/s]
Inferring...:  47%|████▋     | 9/19 [00:01<00:01,  7.48it/s]
Inferring...:  53%|█████▎    | 10/19 [00:01<00:01,  8.09it/s]
Inferring...:  58%|█████▊    | 11/19 [00:02<00:00,  8.47it/s]
Inferring...:  63%|██████▎   | 12/19 [00:02<00:00,  8.43it/s]
Inferring...:  74%|███████▎  | 14/19 [00:02<00:00,  9.03it/s]
Inferring...:  79%|███████▉  | 15/19 [00:02<00:00,  8.83it/s]
Inferring...:  84%|████████▍ | 16/19 [00:02<00:00,  8.86it/s]
Inferring...:  89%|████████▉ | 17/19 [00:02<00:00,  8.95it/s]
Inferring...:  95%|█████████▍| 18/19 [00:02<00:00,  8.79it/s]
Inferring...: 100%|██████████| 19/19 [00:02<00:00,  8.55it/s]
                                                             
INFO:__main__:Computing evaluation metrics.
INFO:__main__:instance_auroc: 0.907
INFO:__main__:full_pixel_auroc: 0.988
INFO:__main__:anomaly_pixel_auroc: 0.983
INFO:__main__:

-----

INFO:__main__:Evaluating dataset [mvtec_transistor] (14/15)...


INFO:__main__:Training models (1/1)
AUROC: 0.9895519018173218
Partial AUROC: 0.9795135259628296
AP: 0.6555657386779785
<class 'float'>
tensor(1906688.) 1906688
wAP:  0.3484451472759247


Computing support features...:   0%|          | 0/77 [00:00<?, ?it/s][A

Computing support features...:   1%|▏         | 1/77 [00:00<00:57,  1.31it/s][A

Computing support features...:   4%|▍         | 3/77 [00:00<00:19,  3.84it/s][A

Computing support features...:   6%|▋         | 5/77 [00:01<00:12,  5.95it/s][A

Computing support features...:   8%|▊         | 6/77 [00:01<00:13,  5.12it/s][A

Computing support features...:  10%|█         | 8/77 [00:01<00:09,  7.06it/s][A

Computing support features...:  13%|█▎        | 10/77 [00:01<00:07,  8.65it/s][A

Computing support features...:  16%|█▌        | 12/77 [00:01<00:06,  9.93it/s][A

Computing support features...:  18%|█▊        | 14/77 [00:01<00:05, 10.89it/s][A

Computing support features...:  21%|██        | 16/77 [00:02<00:05, 11.65it/s][A

Computing support features...:  23%|██▎       | 18/77 [00:02<00:04, 12.19it/s][A

Computing support features...:  26%|██▌       | 20/77 [00:02<00:04, 12.36it/s][A

Computing support features...:  29%|██▊       | 22/77 [00:02<00:04, 12.72it/s][A

Computing support features...:  31%|███       | 24/77 [00:02<00:04, 12.83it/s][A

Computing support features...:  34%|███▍      | 26/77 [00:02<00:03, 12.86it/s][A

Computing support features...:  36%|███▋      | 28/77 [00:03<00:03, 12.70it/s][A

Computing support features...:  39%|███▉      | 30/77 [00:03<00:03, 12.63it/s][A

Computing support features...:  42%|████▏     | 32/77 [00:03<00:03, 12.82it/s][A

Computing support features...:  44%|████▍     | 34/77 [00:03<00:03, 12.62it/s][A

Computing support features...:  47%|████▋     | 36/77 [00:03<00:03, 12.42it/s][A

Computing support features...:  49%|████▉     | 38/77 [00:03<00:03, 12.46it/s][A

Computing support features...:  52%|█████▏    | 40/77 [00:03<00:02, 12.36it/s][A

Computing support features...:  55%|█████▍    | 42/77 [00:04<00:03,  9.76it/s][A

Computing support features...:  57%|█████▋    | 44/77 [00:04<00:03, 10.58it/s][A

Computing support features...:  60%|█████▉    | 46/77 [00:04<00:02, 11.11it/s][A

Computing support features...:  62%|██████▏   | 48/77 [00:04<00:02, 11.62it/s][A

Computing support features...:  65%|██████▍   | 50/77 [00:04<00:02, 11.99it/s][A

Computing support features...:  68%|██████▊   | 52/77 [00:05<00:02, 12.28it/s][A

Computing support features...:  70%|███████   | 54/77 [00:05<00:01, 12.46it/s][A

Computing support features...:  73%|███████▎  | 56/77 [00:05<00:01, 12.59it/s][A

Computing support features...:  75%|███████▌  | 58/77 [00:05<00:01, 12.70it/s][A

Computing support features...:  78%|███████▊  | 60/77 [00:05<00:01, 12.83it/s][A

Computing support features...:  81%|████████  | 62/77 [00:05<00:01, 12.87it/s][A

Computing support features...:  83%|████████▎ | 64/77 [00:05<00:00, 13.01it/s][A

Computing support features...:  86%|████████▌ | 66/77 [00:06<00:00, 13.00it/s][A

Computing support features...:  88%|████████▊ | 68/77 [00:06<00:00, 12.96it/s][A

Computing support features...:  91%|█████████ | 70/77 [00:06<00:00, 13.02it/s][A

Computing support features...:  94%|█████████▎| 72/77 [00:06<00:00, 13.11it/s][A

Computing support features...:  96%|█████████▌| 74/77 [00:06<00:00, 13.20it/s][A

Computing support features...:  99%|█████████▊| 76/77 [00:06<00:00, 13.25it/s][A

                                                                              [AINFO:__main__:Embedding test data with models (1/1)

Inferring...:   0%|          | 0/42 [00:00<?, ?it/s]
Inferring...:   2%|▏         | 1/42 [00:00<00:37,  1.10it/s]
Inferring...:   5%|▍         | 2/42 [00:01<00:18,  2.21it/s]
Inferring...:   7%|▋         | 3/42 [00:01<00:12,  3.04it/s]
Inferring...:  10%|▉         | 4/42 [00:01<00:09,  3.99it/s]
Inferring...:  12%|█▏        | 5/42 [00:01<00:07,  4.67it/s]
Inferring...:  14%|█▍        | 6/42 [00:01<00:06,  5.19it/s]
Inferring...:  17%|█▋        | 7/42 [00:01<00:05,  5.99it/s]
Inferring...:  19%|█▉        | 8/42 [00:02<00:07,  4.67it/s]
Inferring...:  21%|██▏       | 9/42 [00:02<00:06,  5.40it/s]
Inferring...:  24%|██▍       | 10/42 [00:02<00:05,  5.82it/s]
Inferring...:  26%|██▌       | 11/42 [00:02<00:05,  6.01it/s]
Inferring...:  29%|██▊       | 12/42 [00:02<00:04,  6.09it/s]
Inferring...:  31%|███       | 13/42 [00:02<00:04,  6.39it/s]
Inferring...:  33%|███▎      | 14/42 [00:02<00:04,  6.43it/s]
Inferring...:  36%|███▌      | 15/42 [00:03<00:04,  6.30it/s]
Inferring...:  38%|███▊      | 16/42 [00:03<00:03,  6.69it/s]
Inferring...:  40%|████      | 17/42 [00:03<00:03,  6.51it/s]
Inferring...:  43%|████▎     | 18/42 [00:03<00:03,  6.54it/s]
Inferring...:  45%|████▌     | 19/42 [00:03<00:03,  6.90it/s]
Inferring...:  48%|████▊     | 20/42 [00:03<00:03,  6.58it/s]
Inferring...:  50%|█████     | 21/42 [00:03<00:03,  6.82it/s]
Inferring...:  52%|█████▏    | 22/42 [00:04<00:03,  6.60it/s]
Inferring...:  55%|█████▍    | 23/42 [00:04<00:03,  6.31it/s]
Inferring...:  57%|█████▋    | 24/42 [00:04<00:02,  6.44it/s]
Inferring...:  60%|█████▉    | 25/42 [00:04<00:02,  6.23it/s]
Inferring...:  62%|██████▏   | 26/42 [00:04<00:02,  6.68it/s]
Inferring...:  64%|██████▍   | 27/42 [00:04<00:02,  6.57it/s]
Inferring...:  67%|██████▋   | 28/42 [00:05<00:02,  6.45it/s]
Inferring...:  69%|██████▉   | 29/42 [00:05<00:01,  7.01it/s]
Inferring...:  71%|███████▏  | 30/42 [00:05<00:01,  7.30it/s]
Inferring...:  74%|███████▍  | 31/42 [00:05<00:01,  7.09it/s]
Inferring...:  76%|███████▌  | 32/42 [00:05<00:01,  6.93it/s]
Inferring...:  79%|███████▊  | 33/42 [00:05<00:01,  7.15it/s]
Inferring...:  81%|████████  | 34/42 [00:05<00:01,  7.06it/s]
Inferring...:  83%|████████▎ | 35/42 [00:06<00:01,  6.65it/s]
Inferring...:  86%|████████▌ | 36/42 [00:06<00:00,  6.78it/s]
Inferring...:  88%|████████▊ | 37/42 [00:06<00:00,  6.58it/s]
Inferring...:  90%|█████████ | 38/42 [00:06<00:00,  6.43it/s]
Inferring...:  93%|█████████▎| 39/42 [00:06<00:00,  6.65it/s]
Inferring...:  95%|█████████▌| 40/42 [00:06<00:00,  6.45it/s]
Inferring...:  98%|█████████▊| 41/42 [00:06<00:00,  6.67it/s]
Inferring...: 100%|██████████| 42/42 [00:07<00:00,  6.84it/s]
                                                             
INFO:__main__:Computing evaluation metrics.
INFO:__main__:instance_auroc: 0.999
INFO:__main__:full_pixel_auroc: 0.978
INFO:__main__:anomaly_pixel_auroc: 0.949
INFO:__main__:

-----

INFO:__main__:Evaluating dataset [mvtec_zipper] (15/15)...


INFO:__main__:Training models (1/1)
AUROC: 0.9773417711257935
Partial AUROC: 0.9558137655258179
AP: 0.7292457222938538
<class 'float'>
tensor(4214784.) 4214784
wAP:  0.6971675157546997


Computing support features...:   0%|          | 0/104 [00:00<?, ?it/s][A

Computing support features...:   1%|          | 1/104 [00:00<01:11,  1.44it/s][A

Computing support features...:   3%|▎         | 3/104 [00:00<00:23,  4.22it/s][A

Computing support features...:   5%|▍         | 5/104 [00:00<00:15,  6.50it/s][A

Computing support features...:   7%|▋         | 7/104 [00:01<00:11,  8.10it/s][A

Computing support features...:   9%|▊         | 9/104 [00:01<00:10,  8.94it/s][A

Computing support features...:  11%|█         | 11/104 [00:01<00:09,  9.77it/s][A

Computing support features...:  12%|█▎        | 13/104 [00:01<00:12,  7.40it/s][A

Computing support features...:  14%|█▍        | 15/104 [00:02<00:10,  8.44it/s][A

Computing support features...:  16%|█▋        | 17/104 [00:02<00:09,  9.35it/s][A

Computing support features...:  18%|█▊        | 19/104 [00:02<00:08, 10.02it/s][A

Computing support features...:  20%|██        | 21/104 [00:02<00:08, 10.34it/s][A

Computing support features...:  22%|██▏       | 23/104 [00:02<00:07, 10.97it/s][A

Computing support features...:  24%|██▍       | 25/104 [00:02<00:07, 10.99it/s][A

Computing support features...:  26%|██▌       | 27/104 [00:03<00:06, 11.19it/s][A

Computing support features...:  28%|██▊       | 29/104 [00:03<00:06, 11.38it/s][A

Computing support features...:  30%|██▉       | 31/104 [00:03<00:06, 11.41it/s][A

Computing support features...:  32%|███▏      | 33/104 [00:03<00:06, 11.69it/s][A

Computing support features...:  34%|███▎      | 35/104 [00:03<00:05, 11.56it/s][A

Computing support features...:  36%|███▌      | 37/104 [00:03<00:05, 11.76it/s][A

Computing support features...:  38%|███▊      | 39/104 [00:04<00:05, 11.79it/s][A

Computing support features...:  39%|███▉      | 41/104 [00:04<00:05, 11.58it/s][A

Computing support features...:  41%|████▏     | 43/104 [00:04<00:05, 11.72it/s][A

Computing support features...:  43%|████▎     | 45/104 [00:04<00:05, 11.59it/s][A

Computing support features...:  45%|████▌     | 47/104 [00:04<00:04, 12.03it/s][A

Computing support features...:  47%|████▋     | 49/104 [00:05<00:06,  9.16it/s][A

Computing support features...:  49%|████▉     | 51/104 [00:05<00:05,  9.79it/s][A

Computing support features...:  51%|█████     | 53/104 [00:05<00:04, 10.36it/s][A

Computing support features...:  53%|█████▎    | 55/104 [00:05<00:04, 10.89it/s][A

Computing support features...:  55%|█████▍    | 57/104 [00:05<00:04, 11.02it/s][A

Computing support features...:  57%|█████▋    | 59/104 [00:05<00:03, 11.58it/s][A

Computing support features...:  59%|█████▊    | 61/104 [00:06<00:03, 12.04it/s][A

Computing support features...:  61%|██████    | 63/104 [00:06<00:03, 12.26it/s][A

Computing support features...:  62%|██████▎   | 65/104 [00:06<00:03, 12.09it/s][A

Computing support features...:  64%|██████▍   | 67/104 [00:06<00:03, 11.60it/s][A

Computing support features...:  66%|██████▋   | 69/104 [00:06<00:03, 11.28it/s][A

Computing support features...:  68%|██████▊   | 71/104 [00:07<00:02, 11.10it/s][A

Computing support features...:  70%|███████   | 73/104 [00:07<00:02, 11.09it/s][A

Computing support features...:  72%|███████▏  | 75/104 [00:07<00:02, 11.17it/s][A

Computing support features...:  74%|███████▍  | 77/104 [00:07<00:02, 11.55it/s][A

Computing support features...:  76%|███████▌  | 79/104 [00:07<00:02, 11.32it/s][A

Computing support features...:  78%|███████▊  | 81/104 [00:07<00:01, 11.64it/s][A

Computing support features...:  80%|███████▉  | 83/104 [00:08<00:01, 11.86it/s][A

Computing support features...:  82%|████████▏ | 85/104 [00:08<00:01, 11.85it/s][A

Computing support features...:  84%|████████▎ | 87/104 [00:08<00:01, 11.51it/s][A

Computing support features...:  86%|████████▌ | 89/104 [00:08<00:01, 11.48it/s][A

Computing support features...:  88%|████████▊ | 91/104 [00:08<00:01, 11.77it/s][A

Computing support features...:  89%|████████▉ | 93/104 [00:09<00:01,  9.29it/s][A

Computing support features...:  91%|█████████▏| 95/104 [00:09<00:00,  9.75it/s][A

Computing support features...:  93%|█████████▎| 97/104 [00:09<00:00, 10.38it/s][A

Computing support features...:  95%|█████████▌| 99/104 [00:09<00:00, 10.80it/s][A

Computing support features...:  97%|█████████▋| 101/104 [00:09<00:00, 10.83it/s][A

Computing support features...:  99%|█████████▉| 103/104 [00:09<00:00, 11.37it/s][A

                                                                                [AINFO:__main__:Embedding test data with models (1/1)

Inferring...:   0%|          | 0/62 [00:00<?, ?it/s]
Inferring...:   2%|▏         | 1/62 [00:00<00:52,  1.16it/s]
Inferring...:   3%|▎         | 2/62 [00:01<00:26,  2.23it/s]
Inferring...:   5%|▍         | 3/62 [00:01<00:18,  3.16it/s]
Inferring...:   6%|▋         | 4/62 [00:01<00:15,  3.73it/s]
Inferring...:   8%|▊         | 5/62 [00:01<00:12,  4.49it/s]
Inferring...:  10%|▉         | 6/62 [00:01<00:11,  4.78it/s]
Inferring...:  11%|█▏        | 7/62 [00:01<00:11,  4.95it/s]
Inferring...:  13%|█▎        | 8/62 [00:02<00:09,  5.53it/s]
Inferring...:  15%|█▍        | 9/62 [00:02<00:09,  5.44it/s]
Inferring...:  16%|█▌        | 10/62 [00:02<00:09,  5.44it/s]
Inferring...:  18%|█▊        | 11/62 [00:02<00:08,  5.67it/s]
Inferring...:  19%|█▉        | 12/62 [00:02<00:09,  5.53it/s]
Inferring...:  21%|██        | 13/62 [00:02<00:08,  5.68it/s]
Inferring...:  23%|██▎       | 14/62 [00:03<00:08,  5.57it/s]
Inferring...:  24%|██▍       | 15/62 [00:03<00:08,  5.53it/s]
Inferring...:  26%|██▌       | 16/62 [00:03<00:07,  5.86it/s]
Inferring...:  27%|██▋       | 17/62 [00:03<00:07,  5.74it/s]
Inferring...:  29%|██▉       | 18/62 [00:03<00:07,  6.04it/s]
Inferring...:  31%|███       | 19/62 [00:03<00:07,  6.14it/s]
Inferring...:  32%|███▏      | 20/62 [00:04<00:07,  5.90it/s]
Inferring...:  34%|███▍      | 21/62 [00:04<00:06,  5.99it/s]
Inferring...:  35%|███▌      | 22/62 [00:04<00:06,  5.80it/s]
Inferring...:  37%|███▋      | 23/62 [00:04<00:06,  6.12it/s]
Inferring...:  39%|███▊      | 24/62 [00:04<00:06,  6.29it/s]
Inferring...:  40%|████      | 25/62 [00:04<00:06,  5.97it/s]
Inferring...:  42%|████▏     | 26/62 [00:05<00:06,  5.89it/s]
Inferring...:  44%|████▎     | 27/62 [00:05<00:05,  6.03it/s]
Inferring...:  45%|████▌     | 28/62 [00:05<00:05,  5.80it/s]
Inferring...:  47%|████▋     | 29/62 [00:05<00:05,  6.21it/s]
Inferring...:  48%|████▊     | 30/62 [00:05<00:05,  6.00it/s]
Inferring...:  50%|█████     | 31/62 [00:05<00:05,  5.80it/s]
Inferring...:  52%|█████▏    | 32/62 [00:06<00:05,  5.80it/s]
Inferring...:  53%|█████▎    | 33/62 [00:06<00:05,  5.62it/s]
Inferring...:  55%|█████▍    | 34/62 [00:06<00:04,  5.81it/s]
Inferring...:  56%|█████▋    | 35/62 [00:06<00:04,  5.62it/s]
Inferring...:  58%|█████▊    | 36/62 [00:06<00:04,  5.96it/s]
Inferring...:  60%|█████▉    | 37/62 [00:06<00:04,  5.86it/s]
Inferring...:  61%|██████▏   | 38/62 [00:07<00:04,  5.67it/s]
Inferring...:  63%|██████▎   | 39/62 [00:07<00:03,  5.75it/s]
Inferring...:  65%|██████▍   | 40/62 [00:07<00:03,  5.59it/s]
Inferring...:  66%|██████▌   | 41/62 [00:07<00:03,  5.94it/s]
Inferring...:  68%|██████▊   | 42/62 [00:07<00:03,  5.73it/s]
Inferring...:  69%|██████▉   | 43/62 [00:08<00:03,  5.72it/s]
Inferring...:  71%|███████   | 44/62 [00:08<00:03,  5.58it/s]
Inferring...:  73%|███████▎  | 45/62 [00:08<00:03,  5.48it/s]
Inferring...:  74%|███████▍  | 46/62 [00:08<00:02,  5.70it/s]
Inferring...:  76%|███████▌  | 47/62 [00:08<00:02,  5.65it/s]
Inferring...:  77%|███████▋  | 48/62 [00:08<00:02,  5.94it/s]
Inferring...:  79%|███████▉  | 49/62 [00:09<00:02,  5.88it/s]
Inferring...:  81%|████████  | 50/62 [00:09<00:02,  5.77it/s]
Inferring...:  82%|████████▏ | 51/62 [00:09<00:01,  6.08it/s]
Inferring...:  84%|████████▍ | 52/62 [00:09<00:01,  5.88it/s]
Inferring...:  85%|████████▌ | 53/62 [00:09<00:01,  6.13it/s]
Inferring...:  87%|████████▋ | 54/62 [00:09<00:01,  5.92it/s]
Inferring...:  89%|████████▊ | 55/62 [00:10<00:01,  5.83it/s]
Inferring...:  90%|█████████ | 56/62 [00:10<00:00,  6.04it/s]
Inferring...:  92%|█████████▏| 57/62 [00:10<00:00,  5.79it/s]
Inferring...:  94%|█████████▎| 58/62 [00:10<00:00,  6.08it/s]
Inferring...:  95%|█████████▌| 59/62 [00:10<00:00,  5.83it/s]
Inferring...:  97%|█████████▋| 60/62 [00:10<00:00,  5.91it/s]
Inferring...:  98%|█████████▊| 61/62 [00:11<00:00,  6.05it/s]
Inferring...: 100%|██████████| 62/62 [00:11<00:00,  6.69it/s]
                                                             
INFO:__main__:Computing evaluation metrics.
INFO:__main__:instance_auroc: 0.986
INFO:__main__:full_pixel_auroc: 0.989
INFO:__main__:anomaly_pixel_auroc: 0.985
INFO:__main__:

-----

INFO:patchcore.utils:instance_auroc: 0.985
INFO:patchcore.utils:full_pixel_auroc: 0.984
INFO:patchcore.utils:anomaly_pixel_auroc: 0.976
AUROC: 0.9889292120933533
Partial AUROC: 0.9784924387931824
AP: 0.6522158980369568
<class 'float'>
tensor(6171648.) 6171648
wAP:  0.646364688873291
AUROC:  0.9837828755378724
partial AUROC:  0.9695268630981445
AP:  0.639805527528127
wAP:  0.6012829879919688
