[2025-05-11 09:47:08,117][INFO] Following apps/actions have missing dependencies
[2025-05-11 09:47:08,117][INFO] • CODE_ANALYSIS_TOOL_GET_RELEVANT_CODE: {'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi'}
[2025-05-11 09:47:08,117][INFO] • SQLTOOL_SQL_QUERY: {'sqlalchemy>=2.0'}
[2025-05-11 09:47:08,117][INFO] • CODE_ANALYSIS_TOOL_CREATE_CODE_MAP: {'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi'}
[2025-05-11 09:47:08,117][INFO] • CODE_ANALYSIS_TOOL_GET_METHOD_SIGNATURE: {'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi'}
[2025-05-11 09:47:08,117][INFO] • CODE_ANALYSIS_TOOL_GET_CLASS_INFO: {'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi'}
[2025-05-11 09:47:08,117][INFO] • CODE_ANALYSIS_TOOL_GET_METHOD_BODY: {'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi'}
[2025-05-11 09:47:08,117][INFO] Installing dependencies...
[2025-05-11 09:47:08,117][INFO] Installing tokenizers>=0.19,<0.20
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:47:10,421][INFO] Installed tokenizers>=0.19,<0.20
[2025-05-11 09:47:10,421][INFO] Installing tree_sitter>=0.22.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:47:12,718][INFO] Installed tree_sitter>=0.22.0
[2025-05-11 09:47:12,718][INFO] Installing deeplake>3.9,<3.9.39
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:47:15,149][INFO] Installed deeplake>3.9,<3.9.39
[2025-05-11 09:47:15,149][INFO] Installing tree_sitter_python>=0.22.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:47:17,456][INFO] Installed tree_sitter_python>=0.22.0
[2025-05-11 09:47:17,456][INFO] Installing git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:47:20,415][INFO] Installed git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi
[2025-05-11 09:47:20,416][INFO] Installing sqlalchemy>=2.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:47:22,767][INFO] Installed sqlalchemy>=2.0

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  2.09it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.31it/s]
Testing prompts:  30%|███       | 3/10 [00:50<02:39, 22.85s/it]
Testing prompts:  40%|████      | 4/10 [01:39<03:18, 33.16s/it]
Testing prompts:  50%|█████     | 5/10 [02:28<03:14, 38.93s/it]
Testing prompts:  60%|██████    | 6/10 [04:03<03:51, 57.99s/it]
Testing prompts:  70%|███████   | 7/10 [04:04<01:58, 39.37s/it]
Testing prompts:  80%|████████  | 8/10 [05:39<01:54, 57.17s/it]
Testing prompts:  90%|█████████ | 9/10 [06:29<00:54, 54.65s/it]
Testing prompts: 100%|██████████| 10/10 [06:29<00:00, 37.97s/it]
Testing prompts: 100%|██████████| 10/10 [06:29<00:00, 38.97s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  2.03it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:04,  1.99it/s]
Testing prompts:  30%|███       | 3/10 [01:37<05:09, 44.16s/it]
Testing prompts:  40%|████      | 4/10 [03:12<06:27, 64.57s/it]
Testing prompts:  50%|█████     | 5/10 [04:48<06:19, 75.80s/it]
Testing prompts:  60%|██████    | 6/10 [05:40<04:30, 67.64s/it]
Testing prompts:  70%|███████   | 7/10 [05:41<02:17, 45.70s/it]
Testing prompts:  80%|████████  | 8/10 [05:41<01:02, 31.30s/it]
Testing prompts:  90%|█████████ | 9/10 [05:42<00:21, 21.91s/it]
Testing prompts: 100%|██████████| 10/10 [05:43<00:00, 15.52s/it]
Testing prompts: 100%|██████████| 10/10 [05:43<00:00, 34.40s/it]

Testing prompts:   0%|          | 0/20 [00:00<?, ?it/s]
Testing prompts:   5%|▌         | 1/20 [00:01<00:23,  1.25s/it]
Testing prompts:  10%|█         | 2/20 [00:02<00:24,  1.37s/it]
Testing prompts:  15%|█▌        | 3/20 [00:03<00:16,  1.03it/s]
Testing prompts:  20%|██        | 4/20 [01:38<10:13, 38.33s/it]
Testing prompts:  25%|██▌       | 5/20 [01:40<06:15, 25.06s/it]
Testing prompts:  30%|███       | 6/20 [02:32<07:59, 34.28s/it]
Testing prompts:  35%|███▌      | 7/20 [02:33<05:02, 23.26s/it]
Testing prompts:  40%|████      | 8/20 [02:34<03:15, 16.28s/it]
Testing prompts:  45%|████▌     | 9/20 [02:34<02:04, 11.36s/it]
Testing prompts:  50%|█████     | 10/20 [02:35<01:20,  8.08s/it]
Testing prompts:  55%|█████▌    | 11/20 [02:36<00:52,  5.79s/it]
Testing prompts:  60%|██████    | 12/20 [02:37<00:35,  4.41s/it]
Testing prompts:  65%|██████▌   | 13/20 [02:40<00:27,  3.96s/it]
Testing prompts:  70%|███████   | 14/20 [04:16<03:10, 31.76s/it]
Testing prompts:  75%|███████▌  | 15/20 [04:16<01:51, 22.34s/it]
Testing prompts:  80%|████████  | 16/20 [04:17<01:03, 15.79s/it]
Testing prompts:  85%|████████▌ | 17/20 [04:18<00:33, 11.20s/it]
Testing prompts:  90%|█████████ | 18/20 [04:18<00:16,  8.06s/it]
Testing prompts:  95%|█████████▌| 19/20 [04:19<00:05,  5.78s/it]
Testing prompts: 100%|██████████| 20/20 [04:19<00:00,  4.19s/it]
Testing prompts: 100%|██████████| 20/20 [04:19<00:00, 12.99s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.80it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.14s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.16it/s]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.10s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:06,  1.21s/it]
Testing prompts:  60%|██████    | 6/10 [02:31<03:22, 50.60s/it]
Testing prompts:  70%|███████   | 7/10 [02:33<01:43, 34.49s/it]
Testing prompts:  80%|████████  | 8/10 [02:33<00:47, 23.66s/it]
Testing prompts:  90%|█████████ | 9/10 [02:34<00:16, 16.44s/it]
Testing prompts: 100%|██████████| 10/10 [02:34<00:00, 11.52s/it]
Testing prompts: 100%|██████████| 10/10 [02:34<00:00, 15.48s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.76it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:04,  1.86it/s]
Testing prompts:  30%|███       | 3/10 [00:01<00:03,  1.97it/s]
Testing prompts:  40%|████      | 4/10 [01:38<03:52, 38.72s/it]
Testing prompts:  50%|█████     | 5/10 [02:28<03:33, 42.68s/it]
Testing prompts:  60%|██████    | 6/10 [04:04<04:02, 60.63s/it]
Testing prompts:  70%|███████   | 7/10 [04:04<02:02, 40.98s/it]
Testing prompts:  80%|████████  | 8/10 [04:05<00:56, 28.09s/it]
Testing prompts:  90%|█████████ | 9/10 [04:05<00:19, 19.58s/it]
Testing prompts: 100%|██████████| 10/10 [04:06<00:00, 13.77s/it]
Testing prompts: 100%|██████████| 10/10 [04:06<00:00, 24.67s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.28it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:08,  1.00s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.15it/s]
Testing prompts:  40%|████      | 4/10 [01:38<03:49, 38.18s/it]
Testing prompts:  50%|█████     | 5/10 [01:39<02:04, 24.94s/it]
Testing prompts:  60%|██████    | 6/10 [03:17<03:19, 49.76s/it]
Testing prompts:  70%|███████   | 7/10 [03:18<01:41, 33.68s/it]
Testing prompts:  80%|████████  | 8/10 [04:54<01:47, 53.57s/it]
Testing prompts:  90%|█████████ | 9/10 [04:55<00:37, 37.22s/it]
Testing prompts: 100%|██████████| 10/10 [04:56<00:00, 25.92s/it]
Testing prompts: 100%|██████████| 10/10 [04:56<00:00, 29.60s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.73it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.03it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.34it/s]
Testing prompts:  40%|████      | 4/10 [00:51<02:00, 20.01s/it]
Testing prompts:  50%|█████     | 5/10 [00:53<01:07, 13.56s/it]
Testing prompts:  60%|██████    | 6/10 [04:04<04:54, 73.66s/it]
Testing prompts:  70%|███████   | 7/10 [04:05<02:29, 49.92s/it]
Testing prompts:  80%|████████  | 8/10 [04:06<01:08, 34.36s/it]
Testing prompts:  90%|█████████ | 9/10 [04:07<00:24, 24.01s/it]
Testing prompts: 100%|██████████| 10/10 [04:08<00:00, 16.74s/it]
Testing prompts: 100%|██████████| 10/10 [04:08<00:00, 24.81s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.98it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:08,  1.00s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.30it/s]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.18s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:06,  1.23s/it]
Testing prompts:  60%|██████    | 6/10 [03:16<04:23, 65.88s/it]
Testing prompts:  70%|███████   | 7/10 [03:18<02:14, 44.85s/it]
Testing prompts:  80%|████████  | 8/10 [03:18<01:01, 30.73s/it]
Testing prompts:  90%|█████████ | 9/10 [03:19<00:21, 21.29s/it]
Testing prompts: 100%|██████████| 10/10 [03:19<00:00, 14.88s/it]
Testing prompts: 100%|██████████| 10/10 [03:19<00:00, 20.00s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.82it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.09s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.19it/s]
Testing prompts:  40%|████      | 4/10 [01:38<03:50, 38.48s/it]
Testing prompts:  50%|█████     | 5/10 [01:40<02:06, 25.30s/it]
Testing prompts:  60%|██████    | 6/10 [02:29<02:13, 33.45s/it]
Testing prompts:  70%|███████   | 7/10 [02:30<01:08, 22.71s/it]
Testing prompts:  80%|████████  | 8/10 [02:32<00:31, 15.96s/it]
Testing prompts:  90%|█████████ | 9/10 [02:32<00:11, 11.14s/it]
Testing prompts: 100%|██████████| 10/10 [02:33<00:00,  7.88s/it]
Testing prompts: 100%|██████████| 10/10 [02:33<00:00, 15.32s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.75it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.26s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.09it/s]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.09s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:06,  1.27s/it]
Testing prompts:  60%|██████    | 6/10 [01:41<02:13, 33.38s/it]
Testing prompts:  70%|███████   | 7/10 [01:41<01:07, 22.63s/it]
Testing prompts:  80%|████████  | 8/10 [01:42<00:31, 15.58s/it]
Testing prompts:  90%|█████████ | 9/10 [01:42<00:10, 10.85s/it]
Testing prompts: 100%|██████████| 10/10 [01:43<00:00,  7.68s/it]
Testing prompts: 100%|██████████| 10/10 [01:43<00:00, 10.35s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  2.18it/s]
Testing prompts:  20%|██        | 2/10 [00:00<00:03,  2.11it/s]
Testing prompts:  30%|███       | 3/10 [00:01<00:03,  2.11it/s]
Testing prompts:  40%|████      | 4/10 [00:50<01:57, 19.66s/it]
Testing prompts:  50%|█████     | 5/10 [01:39<02:31, 30.39s/it]
Testing prompts:  60%|██████    | 6/10 [01:41<01:22, 20.55s/it]
Testing prompts:  70%|███████   | 7/10 [03:16<02:14, 44.89s/it]
Testing prompts:  80%|████████  | 8/10 [04:05<01:32, 46.23s/it]
Testing prompts:  90%|█████████ | 9/10 [04:06<00:32, 32.26s/it]
Testing prompts: 100%|██████████| 10/10 [04:55<00:00, 37.40s/it]
Testing prompts: 100%|██████████| 10/10 [04:55<00:00, 29.59s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.86it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.22s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.10it/s]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.08s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:06,  1.30s/it]
Testing prompts:  60%|██████    | 6/10 [00:55<01:10, 17.74s/it]
Testing prompts:  70%|███████   | 7/10 [02:32<02:11, 43.70s/it]
Testing prompts:  80%|████████  | 8/10 [02:33<01:00, 30.14s/it]
Testing prompts:  90%|█████████ | 9/10 [02:34<00:20, 20.94s/it]
Testing prompts: 100%|██████████| 10/10 [02:35<00:00, 14.68s/it]
Testing prompts: 100%|██████████| 10/10 [02:35<00:00, 15.51s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.85it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:04,  1.70it/s]
Testing prompts:  30%|███       | 3/10 [00:01<00:03,  1.76it/s]
Testing prompts:  40%|████      | 4/10 [03:13<07:37, 76.26s/it]
Testing prompts:  50%|█████     | 5/10 [03:15<04:06, 49.21s/it]
Testing prompts:  60%|██████    | 6/10 [04:50<04:19, 64.98s/it]
Testing prompts:  70%|███████   | 7/10 [04:51<02:11, 43.96s/it]
Testing prompts:  80%|████████  | 8/10 [06:27<02:01, 60.55s/it]
Testing prompts:  90%|█████████ | 9/10 [07:18<00:57, 57.69s/it]
Testing prompts: 100%|██████████| 10/10 [07:20<00:00, 40.28s/it]
Testing prompts: 100%|██████████| 10/10 [07:20<00:00, 44.03s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.94it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:04,  1.86it/s]
Testing prompts:  30%|███       | 3/10 [00:50<02:40, 22.96s/it]
Testing prompts:  40%|████      | 4/10 [02:28<05:14, 52.35s/it]
Testing prompts:  50%|█████     | 5/10 [02:29<02:49, 33.89s/it]
Testing prompts:  60%|██████    | 6/10 [04:54<04:47, 71.84s/it]
Testing prompts:  70%|███████   | 7/10 [04:55<02:25, 48.52s/it]
Testing prompts:  80%|████████  | 8/10 [06:30<02:07, 63.53s/it]
Testing prompts:  90%|█████████ | 9/10 [06:31<00:43, 43.83s/it]
Testing prompts: 100%|██████████| 10/10 [08:07<00:00, 59.80s/it]
Testing prompts: 100%|██████████| 10/10 [08:07<00:00, 48.70s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  2.10it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:08,  1.08s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.17it/s]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.16s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:06,  1.26s/it]
Testing prompts:  60%|██████    | 6/10 [01:41<02:13, 33.43s/it]
Testing prompts:  70%|███████   | 7/10 [01:42<01:08, 22.67s/it]
Testing prompts:  80%|████████  | 8/10 [01:42<00:31, 15.62s/it]
Testing prompts:  90%|█████████ | 9/10 [01:43<00:10, 10.91s/it]
Testing prompts: 100%|██████████| 10/10 [01:43<00:00,  7.71s/it]
Testing prompts: 100%|██████████| 10/10 [01:43<00:00, 10.37s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.47it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:05,  1.59it/s]
Testing prompts:  30%|███       | 3/10 [00:01<00:04,  1.61it/s]
Testing prompts:  40%|████      | 4/10 [02:27<05:46, 57.68s/it]
Testing prompts:  50%|█████     | 5/10 [02:28<03:06, 37.32s/it]
Testing prompts:  60%|██████    | 6/10 [03:17<02:45, 41.34s/it]
Testing prompts:  70%|███████   | 7/10 [03:17<01:23, 27.99s/it]
Testing prompts:  80%|████████  | 8/10 [04:53<01:38, 49.40s/it]
Testing prompts:  90%|█████████ | 9/10 [04:54<00:34, 34.42s/it]
Testing prompts: 100%|██████████| 10/10 [04:56<00:00, 24.22s/it]
Testing prompts: 100%|██████████| 10/10 [04:56<00:00, 29.60s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.67it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.13s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.19it/s]
Testing prompts:  40%|████      | 4/10 [01:39<03:53, 38.84s/it]
Testing prompts:  50%|█████     | 5/10 [01:40<02:06, 25.25s/it]
Testing prompts:  60%|██████    | 6/10 [03:16<03:16, 49.22s/it]
Testing prompts:  70%|███████   | 7/10 [03:17<01:39, 33.31s/it]
Testing prompts:  80%|████████  | 8/10 [03:17<00:45, 22.86s/it]
Testing prompts:  90%|█████████ | 9/10 [03:19<00:16, 16.33s/it]
Testing prompts: 100%|██████████| 10/10 [03:20<00:00, 11.63s/it]
Testing prompts: 100%|██████████| 10/10 [03:20<00:00, 20.07s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.67it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.15s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.18it/s]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.30s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:06,  1.24s/it]
Testing prompts:  60%|██████    | 6/10 [00:55<01:10, 17.64s/it]
Testing prompts:  70%|███████   | 7/10 [00:56<00:37, 12.41s/it]
Testing prompts:  80%|████████  | 8/10 [00:58<00:17,  8.91s/it]
Testing prompts:  90%|█████████ | 9/10 [00:59<00:06,  6.44s/it]
Testing prompts: 100%|██████████| 10/10 [00:59<00:00,  4.62s/it]
Testing prompts: 100%|██████████| 10/10 [00:59<00:00,  5.98s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  2.14it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:04,  1.84it/s]
Testing prompts:  30%|███       | 3/10 [01:36<05:07, 43.86s/it]
Testing prompts:  40%|████      | 4/10 [03:12<06:25, 64.27s/it]
Testing prompts:  50%|█████     | 5/10 [04:01<04:54, 58.90s/it]
Testing prompts:  60%|██████    | 6/10 [05:36<04:45, 71.26s/it]
Testing prompts:  70%|███████   | 7/10 [06:25<03:12, 64.02s/it]
Testing prompts:  80%|████████  | 8/10 [08:00<02:27, 73.93s/it]
Testing prompts:  90%|█████████ | 9/10 [08:02<00:51, 51.20s/it]
Testing prompts: 100%|██████████| 10/10 [08:02<00:00, 35.56s/it]
Testing prompts: 100%|██████████| 10/10 [08:02<00:00, 48.27s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.99it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.28s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.08it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:05,  1.01it/s]
Testing prompts:  50%|█████     | 5/10 [00:05<00:06,  1.26s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:03,  1.01it/s]
Testing prompts:  70%|███████   | 7/10 [00:06<00:02,  1.21it/s]
Testing prompts:  80%|████████  | 8/10 [00:07<00:01,  1.02it/s]
Testing prompts:  90%|█████████ | 9/10 [00:08<00:00,  1.20it/s]
Testing prompts: 100%|██████████| 10/10 [00:09<00:00,  1.17it/s]
Testing prompts: 100%|██████████| 10/10 [00:09<00:00,  1.07it/s]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.89it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:04,  1.79it/s]
Testing prompts:  30%|███       | 3/10 [01:36<05:07, 43.96s/it]
Testing prompts:  40%|████      | 4/10 [03:12<06:26, 64.37s/it]
Testing prompts:  50%|█████     | 5/10 [03:13<03:28, 41.70s/it]
Testing prompts:  60%|██████    | 6/10 [04:49<03:59, 59.97s/it]
Testing prompts:  70%|███████   | 7/10 [04:49<02:01, 40.54s/it]
Testing prompts:  80%|████████  | 8/10 [04:51<00:56, 28.02s/it]
Testing prompts:  90%|█████████ | 9/10 [05:40<00:34, 34.79s/it]
Testing prompts: 100%|██████████| 10/10 [07:17<00:00, 54.07s/it]
Testing prompts: 100%|██████████| 10/10 [07:17<00:00, 43.80s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.39it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.09s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.08it/s]
Testing prompts:  40%|████      | 4/10 [01:38<03:50, 38.42s/it]
Testing prompts:  50%|█████     | 5/10 [01:39<02:04, 24.97s/it]
Testing prompts:  60%|██████    | 6/10 [02:31<02:15, 33.91s/it]
Testing prompts:  70%|███████   | 7/10 [02:32<01:09, 23.22s/it]
Testing prompts:  80%|████████  | 8/10 [02:33<00:32, 16.23s/it]
Testing prompts:  90%|█████████ | 9/10 [02:34<00:11, 11.55s/it]
Testing prompts: 100%|██████████| 10/10 [02:35<00:00,  8.12s/it]
Testing prompts: 100%|██████████| 10/10 [02:35<00:00, 15.53s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.95it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:08,  1.08s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.21it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:05,  1.09it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:04,  1.01it/s]
Testing prompts:  60%|██████    | 6/10 [01:41<02:14, 33.70s/it]
Testing prompts:  70%|███████   | 7/10 [01:43<01:09, 23.10s/it]
Testing prompts:  80%|████████  | 8/10 [01:44<00:32, 16.14s/it]
Testing prompts:  90%|█████████ | 9/10 [01:45<00:11, 11.56s/it]
Testing prompts: 100%|██████████| 10/10 [01:46<00:00,  8.15s/it]
Testing prompts: 100%|██████████| 10/10 [01:46<00:00, 10.64s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.98it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.08it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.22it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:06,  1.10s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.19s/it]
Testing prompts:  60%|██████    | 6/10 [01:40<02:13, 33.32s/it]
Testing prompts:  70%|███████   | 7/10 [01:42<01:08, 22.93s/it]
Testing prompts:  80%|████████  | 8/10 [01:43<00:31, 15.78s/it]
Testing prompts:  90%|█████████ | 9/10 [01:43<00:11, 11.01s/it]
Testing prompts: 100%|██████████| 10/10 [01:43<00:00,  7.76s/it]
Testing prompts: 100%|██████████| 10/10 [01:43<00:00, 10.40s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  2.16it/s]
Testing prompts:  20%|██        | 2/10 [00:00<00:03,  2.20it/s]
Testing prompts:  30%|███       | 3/10 [01:36<05:07, 43.93s/it]
Testing prompts:  40%|████      | 4/10 [03:12<06:26, 64.46s/it]
Testing prompts:  50%|█████     | 5/10 [04:01<04:55, 59.05s/it]
Testing prompts:  60%|██████    | 6/10 [04:03<02:37, 39.45s/it]
Testing prompts:  70%|███████   | 7/10 [04:03<01:20, 26.70s/it]
Testing prompts:  80%|████████  | 8/10 [04:04<00:36, 18.37s/it]
Testing prompts:  90%|█████████ | 9/10 [04:05<00:12, 12.93s/it]
Testing prompts: 100%|██████████| 10/10 [04:06<00:00,  9.18s/it]
Testing prompts: 100%|██████████| 10/10 [04:06<00:00, 24.61s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:10,  1.17s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.12s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.20it/s]
Testing prompts:  40%|████      | 4/10 [00:52<02:00, 20.11s/it]
Testing prompts:  50%|█████     | 5/10 [00:53<01:06, 13.28s/it]
Testing prompts:  60%|██████    | 6/10 [01:43<01:42, 25.57s/it]
Testing prompts:  70%|███████   | 7/10 [01:44<00:52, 17.57s/it]
Testing prompts:  80%|████████  | 8/10 [03:19<01:24, 42.49s/it]
Testing prompts:  90%|█████████ | 9/10 [03:20<00:29, 29.45s/it]
Testing prompts: 100%|██████████| 10/10 [03:21<00:00, 20.64s/it]
Testing prompts: 100%|██████████| 10/10 [03:21<00:00, 20.17s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  2.06it/s]
Testing prompts:  20%|██        | 2/10 [00:00<00:03,  2.06it/s]
Testing prompts:  30%|███       | 3/10 [00:52<02:45, 23.63s/it]
Testing prompts:  40%|████      | 4/10 [02:28<05:13, 52.31s/it]
Testing prompts:  50%|█████     | 5/10 [02:29<02:49, 33.97s/it]
Testing prompts:  60%|██████    | 6/10 [04:05<03:39, 54.99s/it]
Testing prompts:  70%|███████   | 7/10 [04:06<01:51, 37.16s/it]
Testing prompts:  80%|████████  | 8/10 [05:41<01:51, 55.84s/it]
Testing prompts:  90%|█████████ | 9/10 [05:43<00:38, 38.82s/it]
Testing prompts: 100%|██████████| 10/10 [06:33<00:00, 42.32s/it]
Testing prompts: 100%|██████████| 10/10 [06:33<00:00, 39.35s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.95it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:04,  1.90it/s]
Testing prompts:  30%|███       | 3/10 [01:36<05:07, 43.90s/it]
Testing prompts:  40%|████      | 4/10 [03:11<06:25, 64.22s/it]
Testing prompts:  50%|█████     | 5/10 [03:13<03:28, 41.65s/it]
Testing prompts:  60%|██████    | 6/10 [04:02<02:57, 44.27s/it]
Testing prompts:  70%|███████   | 7/10 [04:03<01:30, 30.01s/it]
Testing prompts:  80%|████████  | 8/10 [04:04<00:41, 20.88s/it]
Testing prompts:  90%|█████████ | 9/10 [05:40<00:44, 44.37s/it]
Testing prompts: 100%|██████████| 10/10 [05:42<00:00, 31.15s/it]
Testing prompts: 100%|██████████| 10/10 [05:42<00:00, 34.25s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.96it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:08,  1.07s/it]
Testing prompts:  30%|███       | 3/10 [01:37<05:08, 44.11s/it]
Testing prompts:  40%|████      | 4/10 [02:28<04:40, 46.82s/it]
Testing prompts:  50%|█████     | 5/10 [02:29<02:31, 30.38s/it]
Testing prompts:  60%|██████    | 6/10 [03:19<02:28, 37.05s/it]
Testing prompts:  70%|███████   | 7/10 [03:20<01:15, 25.11s/it]
Testing prompts:  80%|████████  | 8/10 [03:21<00:35, 17.53s/it]
Testing prompts:  90%|█████████ | 9/10 [03:21<00:12, 12.23s/it]
Testing prompts: 100%|██████████| 10/10 [03:22<00:00,  8.61s/it]
Testing prompts: 100%|██████████| 10/10 [03:22<00:00, 20.24s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  2.08it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.20it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:04,  1.48it/s]
Testing prompts:  40%|████      | 4/10 [01:37<03:47, 38.00s/it]
Testing prompts:  50%|█████     | 5/10 [03:14<04:56, 59.29s/it]
Testing prompts:  60%|██████    | 6/10 [04:51<04:49, 72.25s/it]
Testing prompts:  70%|███████   | 7/10 [05:40<03:14, 64.71s/it]
Testing prompts:  80%|████████  | 8/10 [06:29<01:59, 59.73s/it]
Testing prompts:  90%|█████████ | 9/10 [06:30<00:41, 41.35s/it]
Testing prompts: 100%|██████████| 10/10 [06:32<00:00, 28.96s/it]
Testing prompts: 100%|██████████| 10/10 [06:32<00:00, 39.21s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  2.11it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:08,  1.08s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.22it/s]
Testing prompts:  40%|████      | 4/10 [00:52<02:01, 20.30s/it]
Testing prompts:  50%|█████     | 5/10 [00:53<01:06, 13.39s/it]
Testing prompts:  60%|██████    | 6/10 [01:43<01:43, 25.80s/it]
Testing prompts:  70%|███████   | 7/10 [01:44<00:52, 17.53s/it]
Testing prompts:  80%|████████  | 8/10 [01:45<00:24, 12.47s/it]
Testing prompts:  90%|█████████ | 9/10 [01:47<00:08,  8.96s/it]
Testing prompts: 100%|██████████| 10/10 [01:48<00:00,  6.56s/it]
Testing prompts: 100%|██████████| 10/10 [01:48<00:00, 10.83s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  2.25it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.02it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.34it/s]
Testing prompts:  40%|████      | 4/10 [01:39<03:52, 38.77s/it]
Testing prompts:  50%|█████     | 5/10 [01:40<02:06, 25.23s/it]
Testing prompts:  60%|██████    | 6/10 [03:16<03:16, 49.15s/it]
Testing prompts:  70%|███████   | 7/10 [03:17<01:40, 33.39s/it]
Testing prompts:  80%|████████  | 8/10 [03:17<00:45, 22.93s/it]
Testing prompts:  90%|█████████ | 9/10 [04:07<00:31, 31.28s/it]
Testing prompts: 100%|██████████| 10/10 [04:08<00:00, 22.09s/it]
Testing prompts: 100%|██████████| 10/10 [04:08<00:00, 24.87s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.82it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.12it/s]
Testing prompts:  30%|███       | 3/10 [00:52<02:46, 23.79s/it]
Testing prompts:  40%|████      | 4/10 [02:29<05:15, 52.61s/it]
Testing prompts:  50%|█████     | 5/10 [04:04<05:39, 67.89s/it]
Testing prompts:  60%|██████    | 6/10 [05:39<05:08, 77.19s/it]
Testing prompts:  70%|███████   | 7/10 [06:29<03:24, 68.18s/it]
Testing prompts:  80%|████████  | 8/10 [06:30<01:33, 46.91s/it]
Testing prompts:  90%|█████████ | 9/10 [07:21<00:48, 48.22s/it]
Testing prompts: 100%|██████████| 10/10 [08:11<00:00, 48.58s/it]
Testing prompts: 100%|██████████| 10/10 [08:11<00:00, 49.12s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.71it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.04it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.30it/s]
Testing prompts:  40%|████      | 4/10 [01:40<03:54, 39.06s/it]
Testing prompts:  50%|█████     | 5/10 [01:41<02:07, 25.53s/it]
Testing prompts:  60%|██████    | 6/10 [03:17<03:17, 49.45s/it]
Testing prompts:  70%|███████   | 7/10 [03:18<01:40, 33.45s/it]
Testing prompts:  80%|████████  | 8/10 [03:18<00:45, 22.95s/it]
Testing prompts:  90%|█████████ | 9/10 [03:19<00:15, 15.95s/it]
Testing prompts: 100%|██████████| 10/10 [03:19<00:00, 11.16s/it]
Testing prompts: 100%|██████████| 10/10 [03:19<00:00, 19.95s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:09,  1.09s/it]
Testing prompts:  20%|██        | 2/10 [00:01<00:05,  1.35it/s]
Testing prompts:  30%|███       | 3/10 [00:51<02:41, 23.07s/it]
Testing prompts:  40%|████      | 4/10 [01:40<03:20, 33.37s/it]
Testing prompts:  50%|█████     | 5/10 [03:15<04:38, 55.61s/it]
Testing prompts:  60%|██████    | 6/10 [04:06<03:36, 54.15s/it]
Testing prompts:  70%|███████   | 7/10 [04:07<01:50, 36.84s/it]
Testing prompts:  80%|████████  | 8/10 [05:43<01:50, 55.47s/it]
Testing prompts:  90%|█████████ | 9/10 [05:44<00:38, 38.60s/it]
Testing prompts: 100%|██████████| 10/10 [05:46<00:00, 27.12s/it]
Testing prompts: 100%|██████████| 10/10 [05:46<00:00, 34.62s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  2.00it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:08,  1.05s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.21it/s]
Testing prompts:  40%|████      | 4/10 [01:38<03:49, 38.25s/it]
Testing prompts:  50%|█████     | 5/10 [01:39<02:04, 24.84s/it]
Testing prompts:  60%|██████    | 6/10 [03:14<03:15, 48.97s/it]
Testing prompts:  70%|███████   | 7/10 [03:16<01:40, 33.47s/it]
Testing prompts:  80%|████████  | 8/10 [03:18<00:47, 23.50s/it]
Testing prompts:  90%|█████████ | 9/10 [03:20<00:16, 16.63s/it]
Testing prompts: 100%|██████████| 10/10 [03:20<00:00, 11.67s/it]
Testing prompts: 100%|██████████| 10/10 [03:20<00:00, 20.08s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.83it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.20s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.33s/it]
Testing prompts:  40%|████      | 4/10 [00:55<02:07, 21.30s/it]
Testing prompts:  50%|█████     | 5/10 [00:56<01:10, 14.03s/it]
Testing prompts:  60%|██████    | 6/10 [01:47<01:45, 26.36s/it]
Testing prompts:  70%|███████   | 7/10 [01:48<00:54, 18.14s/it]
Testing prompts:  80%|████████  | 8/10 [01:48<00:25, 12.57s/it]
Testing prompts:  90%|█████████ | 9/10 [01:49<00:08,  8.79s/it]
Testing prompts: 100%|██████████| 10/10 [01:49<00:00,  6.23s/it]
Testing prompts: 100%|██████████| 10/10 [01:49<00:00, 10.99s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  2.02it/s]
Testing prompts:  20%|██        | 2/10 [00:00<00:04,  2.00it/s]
Testing prompts:  30%|███       | 3/10 [00:50<02:39, 22.85s/it]
Testing prompts:  40%|████      | 4/10 [01:41<03:24, 34.11s/it]
Testing prompts:  50%|█████     | 5/10 [01:43<01:51, 22.37s/it]
Testing prompts:  60%|██████    | 6/10 [02:33<02:07, 31.81s/it]
Testing prompts:  70%|███████   | 7/10 [02:34<01:04, 21.57s/it]
Testing prompts:  80%|████████  | 8/10 [04:10<01:30, 45.49s/it]
Testing prompts:  90%|█████████ | 9/10 [04:11<00:31, 31.64s/it]
Testing prompts: 100%|██████████| 10/10 [04:13<00:00, 22.33s/it]
Testing prompts: 100%|██████████| 10/10 [04:13<00:00, 25.34s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.76it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:04,  1.86it/s]
Testing prompts:  30%|███       | 3/10 [01:38<05:13, 44.79s/it]
Testing prompts:  40%|████      | 4/10 [03:15<06:31, 65.20s/it]
Testing prompts:  50%|█████     | 5/10 [04:50<06:20, 76.14s/it]
Testing prompts:  60%|██████    | 6/10 [04:52<03:23, 50.78s/it]
Testing prompts:  70%|███████   | 7/10 [04:52<01:43, 34.36s/it]
Testing prompts:  80%|████████  | 8/10 [05:42<01:18, 39.17s/it]
Testing prompts:  90%|█████████ | 9/10 [07:17<00:56, 56.86s/it]
Testing prompts: 100%|██████████| 10/10 [07:19<00:00, 39.91s/it]
Testing prompts: 100%|██████████| 10/10 [07:19<00:00, 43.98s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.37s/it]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.10it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.34it/s]
Testing prompts:  40%|████      | 4/10 [00:51<01:59, 19.94s/it]
Testing prompts:  50%|█████     | 5/10 [00:53<01:06, 13.26s/it]
Testing prompts:  60%|██████    | 6/10 [04:04<04:55, 73.87s/it]
Testing prompts:  70%|███████   | 7/10 [04:06<02:30, 50.17s/it]
Testing prompts:  80%|████████  | 8/10 [04:06<01:08, 34.33s/it]
Testing prompts:  90%|█████████ | 9/10 [04:07<00:23, 23.85s/it]
Testing prompts: 100%|██████████| 10/10 [04:08<00:00, 16.89s/it]
Testing prompts: 100%|██████████| 10/10 [04:08<00:00, 24.87s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.32it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.10s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.15it/s]