[2025-05-11 10:06:33,272][INFO] Following apps/actions have missing dependencies
[2025-05-11 10:06:33,272][INFO] • CODE_ANALYSIS_TOOL_GET_RELEVANT_CODE: {'tree_sitter_python>=0.22.0', 'deeplake>3.9,<3.9.39', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0'}
[2025-05-11 10:06:33,272][INFO] • SQLTOOL_SQL_QUERY: {'sqlalchemy>=2.0'}
[2025-05-11 10:06:33,272][INFO] • CODE_ANALYSIS_TOOL_CREATE_CODE_MAP: {'tree_sitter_python>=0.22.0', 'deeplake>3.9,<3.9.39', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0'}
[2025-05-11 10:06:33,272][INFO] • CODE_ANALYSIS_TOOL_GET_METHOD_SIGNATURE: {'tree_sitter_python>=0.22.0', 'deeplake>3.9,<3.9.39', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0'}
[2025-05-11 10:06:33,272][INFO] • CODE_ANALYSIS_TOOL_GET_CLASS_INFO: {'tree_sitter_python>=0.22.0', 'deeplake>3.9,<3.9.39', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0'}
[2025-05-11 10:06:33,272][INFO] • CODE_ANALYSIS_TOOL_GET_METHOD_BODY: {'tree_sitter_python>=0.22.0', 'deeplake>3.9,<3.9.39', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0'}
[2025-05-11 10:06:33,272][INFO] Installing dependencies...
[2025-05-11 10:06:33,272][INFO] Installing tree_sitter_python>=0.22.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 10:06:35,499][INFO] Installed tree_sitter_python>=0.22.0
[2025-05-11 10:06:35,499][INFO] Installing deeplake>3.9,<3.9.39
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 10:06:37,826][INFO] Installed deeplake>3.9,<3.9.39
[2025-05-11 10:06:37,826][INFO] Installing git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 10:06:40,698][INFO] Installed git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi
[2025-05-11 10:06:40,699][INFO] Installing tokenizers>=0.19,<0.20
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 10:06:42,922][INFO] Installed tokenizers>=0.19,<0.20
[2025-05-11 10:06:42,922][INFO] Installing tree_sitter>=0.22.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 10:06:45,128][INFO] Installed tree_sitter>=0.22.0
[2025-05-11 10:06:45,128][INFO] Installing sqlalchemy>=2.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 10:06:47,376][INFO] Installed sqlalchemy>=2.0

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.51s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.30s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.24s/it]
Testing prompts:  40%|████      | 4/10 [00:37<01:24, 14.01s/it]
Testing prompts:  50%|█████     | 5/10 [00:38<00:47,  9.43s/it]
Testing prompts:  60%|██████    | 6/10 [00:40<00:26,  6.70s/it]
Testing prompts:  70%|███████   | 7/10 [00:41<00:14,  4.91s/it]
Testing prompts:  80%|████████  | 8/10 [00:44<00:08,  4.45s/it]
Testing prompts:  90%|█████████ | 9/10 [00:46<00:03,  3.73s/it]
Testing prompts: 100%|██████████| 10/10 [00:48<00:00,  3.16s/it]
Testing prompts: 100%|██████████| 10/10 [00:48<00:00,  4.88s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:19,  2.21s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.63s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.47s/it]
Testing prompts:  40%|████      | 4/10 [00:38<01:24, 14.11s/it]
Testing prompts:  50%|█████     | 5/10 [00:39<00:47,  9.54s/it]
Testing prompts:  60%|██████    | 6/10 [00:41<00:27,  6.80s/it]
Testing prompts:  70%|███████   | 7/10 [00:42<00:15,  5.08s/it]
Testing prompts:  80%|████████  | 8/10 [00:45<00:08,  4.44s/it]
Testing prompts:  90%|█████████ | 9/10 [00:47<00:03,  3.67s/it]
Testing prompts: 100%|██████████| 10/10 [00:49<00:00,  2.98s/it]
Testing prompts: 100%|██████████| 10/10 [00:49<00:00,  4.91s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.37s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.15s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.26s/it]
Testing prompts:  40%|████      | 4/10 [00:40<01:31, 15.18s/it]
Testing prompts:  50%|█████     | 5/10 [00:41<00:50, 10.12s/it]
Testing prompts:  60%|██████    | 6/10 [00:42<00:28,  7.16s/it]
Testing prompts:  70%|███████   | 7/10 [00:44<00:16,  5.52s/it]
Testing prompts:  80%|████████  | 8/10 [00:47<00:09,  4.72s/it]
Testing prompts:  90%|█████████ | 9/10 [00:50<00:03,  3.91s/it]
Testing prompts: 100%|██████████| 10/10 [00:51<00:00,  3.20s/it]
Testing prompts: 100%|██████████| 10/10 [00:51<00:00,  5.17s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:16,  1.83s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:11,  1.47s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:11,  1.69s/it]
Testing prompts:  40%|████      | 4/10 [00:32<01:11, 11.97s/it]
Testing prompts:  50%|█████     | 5/10 [00:34<00:41,  8.25s/it]
Testing prompts:  60%|██████    | 6/10 [00:35<00:23,  5.93s/it]
Testing prompts:  70%|███████   | 7/10 [00:37<00:13,  4.51s/it]
Testing prompts:  80%|████████  | 8/10 [00:40<00:08,  4.14s/it]
Testing prompts:  90%|█████████ | 9/10 [00:43<00:03,  3.67s/it]
Testing prompts: 100%|██████████| 10/10 [00:45<00:00,  3.08s/it]
Testing prompts: 100%|██████████| 10/10 [00:45<00:00,  4.51s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:17,  1.95s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:11,  1.43s/it]
Testing prompts:  30%|███       | 3/10 [00:08<00:22,  3.15s/it]
Testing prompts:  40%|████      | 4/10 [00:39<01:24, 14.11s/it]
Testing prompts:  50%|█████     | 5/10 [00:40<00:47,  9.58s/it]
Testing prompts:  60%|██████    | 6/10 [00:42<00:27,  6.93s/it]
Testing prompts:  70%|███████   | 7/10 [00:44<00:15,  5.18s/it]
Testing prompts:  80%|████████  | 8/10 [00:47<00:09,  4.52s/it]
Testing prompts:  90%|█████████ | 9/10 [00:49<00:03,  3.82s/it]
Testing prompts: 100%|██████████| 10/10 [00:52<00:00,  3.55s/it]
Testing prompts: 100%|██████████| 10/10 [00:52<00:00,  5.23s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:11,  1.25s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.21s/it]
Testing prompts:  30%|███       | 3/10 [00:32<01:39, 14.23s/it]
Testing prompts:  40%|████      | 4/10 [00:33<00:55,  9.23s/it]
Testing prompts:  50%|█████     | 5/10 [00:35<00:32,  6.41s/it]
Testing prompts:  60%|██████    | 6/10 [00:37<00:20,  5.14s/it]
Testing prompts:  70%|███████   | 7/10 [00:39<00:11,  3.86s/it]
Testing prompts:  80%|████████  | 8/10 [00:42<00:07,  3.59s/it]
Testing prompts:  90%|█████████ | 9/10 [00:44<00:03,  3.21s/it]
Testing prompts: 100%|██████████| 10/10 [00:45<00:00,  2.69s/it]
Testing prompts: 100%|██████████| 10/10 [00:45<00:00,  4.59s/it]

Testing prompts:   0%|          | 0/9 [00:00<?, ?it/s]
Testing prompts:  11%|█         | 1/9 [00:01<00:12,  1.57s/it]
Testing prompts:  22%|██▏       | 2/9 [00:02<00:09,  1.34s/it]
Testing prompts:  33%|███▎      | 3/9 [00:06<00:14,  2.40s/it]
Testing prompts:  44%|████▍     | 4/9 [00:10<00:14,  2.90s/it]
Testing prompts:  56%|█████▌    | 5/9 [00:45<00:58, 14.74s/it]
Testing prompts:  67%|██████▋   | 6/9 [01:19<01:03, 21.10s/it]
Testing prompts:  78%|███████▊  | 7/9 [01:23<00:30, 15.43s/it]
Testing prompts:  89%|████████▉ | 8/9 [01:26<00:11, 11.58s/it]
Testing prompts: 100%|██████████| 9/9 [01:33<00:00, 10.12s/it]
Testing prompts: 100%|██████████| 9/9 [01:33<00:00, 10.36s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:17,  1.98s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.40s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:08,  1.26s/it]
Testing prompts:  40%|████      | 4/10 [00:35<01:17, 12.97s/it]
Testing prompts:  50%|█████     | 5/10 [00:36<00:43,  8.77s/it]
Testing prompts:  60%|██████    | 6/10 [00:38<00:25,  6.37s/it]
Testing prompts:  70%|███████   | 7/10 [00:40<00:15,  5.00s/it]
Testing prompts:  80%|████████  | 8/10 [00:43<00:08,  4.47s/it]
Testing prompts:  90%|█████████ | 9/10 [00:45<00:03,  3.71s/it]
Testing prompts: 100%|██████████| 10/10 [00:47<00:00,  3.31s/it]
Testing prompts: 100%|██████████| 10/10 [00:47<00:00,  4.80s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:24,  2.72s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:15,  1.89s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:10,  1.52s/it]
Testing prompts:  40%|████      | 4/10 [00:34<01:14, 12.41s/it]
Testing prompts:  50%|█████     | 5/10 [00:35<00:42,  8.56s/it]
Testing prompts:  60%|██████    | 6/10 [00:37<00:24,  6.19s/it]
Testing prompts:  70%|███████   | 7/10 [00:39<00:14,  4.72s/it]
Testing prompts:  80%|████████  | 8/10 [00:42<00:08,  4.36s/it]
Testing prompts:  90%|█████████ | 9/10 [00:45<00:03,  3.77s/it]
Testing prompts: 100%|██████████| 10/10 [00:47<00:00,  3.19s/it]
Testing prompts: 100%|██████████| 10/10 [00:47<00:00,  4.72s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:16,  1.83s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.35s/it]
Testing prompts:  30%|███       | 3/10 [00:07<00:19,  2.83s/it]
Testing prompts:  40%|████      | 4/10 [00:38<01:23, 13.95s/it]
Testing prompts:  50%|█████     | 5/10 [00:40<00:47,  9.49s/it]
Testing prompts:  60%|██████    | 6/10 [00:41<00:27,  6.82s/it]
Testing prompts:  70%|███████   | 7/10 [00:42<00:15,  5.02s/it]
Testing prompts:  80%|████████  | 8/10 [00:46<00:09,  4.58s/it]
Testing prompts:  90%|█████████ | 9/10 [00:48<00:03,  3.73s/it]
Testing prompts: 100%|██████████| 10/10 [00:50<00:00,  3.29s/it]
Testing prompts: 100%|██████████| 10/10 [00:50<00:00,  5.08s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.55s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.46s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:09,  1.29s/it]
Testing prompts:  40%|████      | 4/10 [00:33<01:14, 12.36s/it]
Testing prompts:  50%|█████     | 5/10 [00:34<00:41,  8.39s/it]
Testing prompts:  60%|██████    | 6/10 [00:35<00:23,  5.97s/it]
Testing prompts:  70%|███████   | 7/10 [00:37<00:13,  4.59s/it]
Testing prompts:  80%|████████  | 8/10 [00:40<00:08,  4.16s/it]
Testing prompts:  90%|█████████ | 9/10 [00:43<00:03,  3.54s/it]
Testing prompts: 100%|██████████| 10/10 [00:45<00:00,  3.20s/it]
Testing prompts: 100%|██████████| 10/10 [00:45<00:00,  4.56s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:15,  1.76s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.29s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.44s/it]
Testing prompts:  40%|████      | 4/10 [01:12<02:46, 27.82s/it]
Testing prompts:  50%|█████     | 5/10 [01:13<01:31, 18.24s/it]
Testing prompts:  60%|██████    | 6/10 [01:15<00:50, 12.50s/it]
Testing prompts:  70%|███████   | 7/10 [01:16<00:26,  8.91s/it]
Testing prompts:  80%|████████  | 8/10 [01:20<00:14,  7.33s/it]
Testing prompts:  90%|█████████ | 9/10 [01:22<00:05,  5.55s/it]
Testing prompts: 100%|██████████| 10/10 [01:23<00:00,  4.35s/it]
Testing prompts: 100%|██████████| 10/10 [01:23<00:00,  8.40s/it]

Testing prompts:   0%|          | 0/14 [00:00<?, ?it/s]
Testing prompts:   7%|▋         | 1/14 [00:02<00:31,  2.43s/it]
Testing prompts:  14%|█▍        | 2/14 [00:03<00:20,  1.75s/it]
Testing prompts:  21%|██▏       | 3/14 [00:05<00:17,  1.58s/it]
Testing prompts:  29%|██▊       | 4/14 [00:06<00:14,  1.44s/it]
Testing prompts:  36%|███▌      | 5/14 [00:08<00:14,  1.57s/it]
Testing prompts:  43%|████▎     | 6/14 [00:09<00:11,  1.44s/it]
Testing prompts:  50%|█████     | 7/14 [00:10<00:10,  1.48s/it]
Testing prompts:  57%|█████▋    | 8/14 [00:12<00:08,  1.41s/it]
Testing prompts:  64%|██████▍   | 9/14 [00:15<00:10,  2.06s/it]
Testing prompts:  71%|███████▏  | 10/14 [00:17<00:07,  2.00s/it]
Testing prompts:  79%|███████▊  | 11/14 [00:19<00:06,  2.02s/it]
Testing prompts:  86%|████████▌ | 12/14 [00:20<00:03,  1.83s/it]
Testing prompts:  93%|█████████▎| 13/14 [00:24<00:02,  2.21s/it]
Testing prompts: 100%|██████████| 14/14 [00:25<00:00,  2.10s/it]
Testing prompts: 100%|██████████| 14/14 [00:25<00:00,  1.85s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:18,  2.07s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.71s/it]
Testing prompts:  30%|███       | 3/10 [00:07<00:18,  2.60s/it]
Testing prompts:  40%|████      | 4/10 [00:40<01:28, 14.74s/it]
Testing prompts:  50%|█████     | 5/10 [00:41<00:49,  9.87s/it]
Testing prompts:  60%|██████    | 6/10 [00:43<00:28,  7.01s/it]
Testing prompts:  70%|███████   | 7/10 [00:45<00:16,  5.37s/it]
Testing prompts:  80%|████████  | 8/10 [00:46<00:07,  4.00s/it]
Testing prompts:  90%|█████████ | 9/10 [00:47<00:03,  3.13s/it]
Testing prompts: 100%|██████████| 10/10 [00:48<00:00,  2.60s/it]
Testing prompts: 100%|██████████| 10/10 [00:48<00:00,  4.89s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:16,  1.81s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.19s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.19s/it]
Testing prompts:  40%|████      | 4/10 [00:42<01:36, 16.05s/it]
Testing prompts:  50%|█████     | 5/10 [00:43<00:53, 10.72s/it]
Testing prompts:  60%|██████    | 6/10 [00:45<00:30,  7.66s/it]
Testing prompts:  70%|███████   | 7/10 [00:47<00:16,  5.63s/it]
Testing prompts:  80%|████████  | 8/10 [00:50<00:09,  4.96s/it]
Testing prompts:  90%|█████████ | 9/10 [00:52<00:04,  4.05s/it]
Testing prompts: 100%|██████████| 10/10 [00:54<00:00,  3.38s/it]
Testing prompts: 100%|██████████| 10/10 [00:54<00:00,  5.45s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:23,  2.66s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:16,  2.03s/it]
Testing prompts:  30%|███       | 3/10 [00:08<00:22,  3.16s/it]
Testing prompts:  40%|████      | 4/10 [00:39<01:23, 13.86s/it]
Testing prompts:  50%|█████     | 5/10 [00:40<00:47,  9.42s/it]
Testing prompts:  60%|██████    | 6/10 [00:42<00:27,  6.78s/it]
Testing prompts:  70%|███████   | 7/10 [00:43<00:15,  5.04s/it]
Testing prompts:  80%|████████  | 8/10 [00:46<00:08,  4.41s/it]
Testing prompts:  90%|█████████ | 9/10 [00:48<00:03,  3.70s/it]
Testing prompts: 100%|██████████| 10/10 [00:50<00:00,  3.04s/it]
Testing prompts: 100%|██████████| 10/10 [00:50<00:00,  5.04s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:20,  2.25s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.70s/it]
Testing prompts:  30%|███       | 3/10 [00:07<00:19,  2.75s/it]
Testing prompts:  40%|████      | 4/10 [00:35<01:16, 12.71s/it]
Testing prompts:  50%|█████     | 5/10 [00:37<00:43,  8.68s/it]
Testing prompts:  60%|██████    | 6/10 [00:39<00:26,  6.53s/it]
Testing prompts:  70%|███████   | 7/10 [00:40<00:14,  4.89s/it]
Testing prompts:  80%|████████  | 8/10 [00:44<00:08,  4.40s/it]
Testing prompts:  90%|█████████ | 9/10 [00:46<00:03,  3.58s/it]
Testing prompts: 100%|██████████| 10/10 [00:51<00:00,  4.00s/it]
Testing prompts: 100%|██████████| 10/10 [00:51<00:00,  5.10s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.41s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.44s/it]
Testing prompts:  30%|███       | 3/10 [00:39<02:01, 17.34s/it]
Testing prompts:  40%|████      | 4/10 [00:40<01:05, 10.96s/it]
Testing prompts:  50%|█████     | 5/10 [00:42<00:38,  7.78s/it]
Testing prompts:  60%|██████    | 6/10 [00:43<00:22,  5.62s/it]
Testing prompts:  70%|███████   | 7/10 [00:45<00:13,  4.44s/it]
Testing prompts:  80%|████████  | 8/10 [00:48<00:07,  3.98s/it]
Testing prompts:  90%|█████████ | 9/10 [00:50<00:03,  3.33s/it]
Testing prompts: 100%|██████████| 10/10 [00:53<00:00,  3.09s/it]
Testing prompts: 100%|██████████| 10/10 [00:53<00:00,  5.33s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:03<00:27,  3.04s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:14,  1.82s/it]
Testing prompts:  30%|███       | 3/10 [00:35<01:48, 15.45s/it]
Testing prompts:  40%|████      | 4/10 [00:36<00:59,  9.85s/it]
Testing prompts:  50%|█████     | 5/10 [00:39<00:35,  7.15s/it]
Testing prompts:  60%|██████    | 6/10 [00:40<00:20,  5.21s/it]
Testing prompts:  70%|███████   | 7/10 [00:42<00:11,  3.99s/it]
Testing prompts:  80%|████████  | 8/10 [00:46<00:08,  4.03s/it]
Testing prompts:  90%|█████████ | 9/10 [00:48<00:03,  3.34s/it]
Testing prompts: 100%|██████████| 10/10 [00:49<00:00,  2.68s/it]
Testing prompts: 100%|██████████| 10/10 [00:49<00:00,  4.94s/it]

Testing prompts:   0%|          | 0/6 [00:00<?, ?it/s]
Testing prompts:  17%|█▋        | 1/6 [00:01<00:05,  1.18s/it]
Testing prompts:  33%|███▎      | 2/6 [00:02<00:04,  1.10s/it]
Testing prompts:  50%|█████     | 3/6 [00:04<00:04,  1.48s/it]
Testing prompts:  67%|██████▋   | 4/6 [00:09<00:06,  3.06s/it]
Testing prompts:  83%|████████▎ | 5/6 [00:25<00:07,  7.52s/it]
Testing prompts: 100%|██████████| 6/6 [00:52<00:00, 14.40s/it]
Testing prompts: 100%|██████████| 6/6 [00:52<00:00,  8.80s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:18,  2.02s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:12,  1.54s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:09,  1.41s/it]
Testing prompts:  40%|████      | 4/10 [00:35<01:18, 13.08s/it]
Testing prompts:  50%|█████     | 5/10 [00:36<00:44,  8.87s/it]
Testing prompts:  60%|██████    | 6/10 [00:38<00:25,  6.38s/it]
Testing prompts:  70%|███████   | 7/10 [00:40<00:14,  4.83s/it]
Testing prompts:  80%|████████  | 8/10 [00:43<00:08,  4.33s/it]
Testing prompts:  90%|█████████ | 9/10 [00:45<00:03,  3.77s/it]
Testing prompts: 100%|██████████| 10/10 [00:47<00:00,  3.09s/it]
Testing prompts: 100%|██████████| 10/10 [00:47<00:00,  4.74s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:19,  2.17s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.68s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:11,  1.68s/it]
Testing prompts:  40%|████      | 4/10 [00:39<01:26, 14.43s/it]
Testing prompts:  50%|█████     | 5/10 [00:40<00:48,  9.70s/it]
Testing prompts:  60%|██████    | 6/10 [00:42<00:27,  6.95s/it]
Testing prompts:  70%|███████   | 7/10 [00:43<00:15,  5.19s/it]
Testing prompts:  80%|████████  | 8/10 [00:46<00:09,  4.52s/it]
Testing prompts:  90%|█████████ | 9/10 [00:48<00:03,  3.66s/it]
Testing prompts: 100%|██████████| 10/10 [00:50<00:00,  3.09s/it]
Testing prompts: 100%|██████████| 10/10 [00:50<00:00,  5.03s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:18,  2.01s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:12,  1.61s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.51s/it]
Testing prompts:  40%|████      | 4/10 [00:22<00:48,  8.00s/it]
Testing prompts:  50%|█████     | 5/10 [00:24<00:28,  5.66s/it]
Testing prompts:  60%|██████    | 6/10 [00:25<00:16,  4.24s/it]
Testing prompts:  70%|███████   | 7/10 [00:27<00:10,  3.42s/it]
Testing prompts:  80%|████████  | 8/10 [00:30<00:06,  3.28s/it]
Testing prompts:  90%|█████████ | 9/10 [00:32<00:02,  2.97s/it]
Testing prompts: 100%|██████████| 10/10 [00:34<00:00,  2.61s/it]
Testing prompts: 100%|██████████| 10/10 [00:34<00:00,  3.45s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.52s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:12,  1.61s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:09,  1.37s/it]
Testing prompts:  40%|████      | 4/10 [00:38<01:25, 14.22s/it]
Testing prompts:  50%|█████     | 5/10 [00:39<00:48,  9.62s/it]
Testing prompts:  60%|██████    | 6/10 [00:41<00:27,  6.85s/it]
Testing prompts:  70%|███████   | 7/10 [00:42<00:15,  5.13s/it]
Testing prompts:  80%|████████  | 8/10 [00:46<00:09,  4.57s/it]
Testing prompts:  90%|█████████ | 9/10 [00:48<00:03,  3.78s/it]
Testing prompts: 100%|██████████| 10/10 [00:49<00:00,  3.06s/it]
Testing prompts: 100%|██████████| 10/10 [00:49<00:00,  4.96s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:19,  2.11s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:12,  1.55s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:17,  2.52s/it]
Testing prompts:  40%|████      | 4/10 [00:38<01:25, 14.17s/it]
Testing prompts:  50%|█████     | 5/10 [00:40<00:48,  9.74s/it]
Testing prompts:  60%|██████    | 6/10 [00:42<00:27,  6.88s/it]
Testing prompts:  70%|███████   | 7/10 [00:43<00:15,  5.12s/it]
Testing prompts:  80%|████████  | 8/10 [00:47<00:09,  4.57s/it]
Testing prompts:  90%|█████████ | 9/10 [00:49<00:03,  3.84s/it]
Testing prompts: 100%|██████████| 10/10 [00:50<00:00,  3.15s/it]
Testing prompts: 100%|██████████| 10/10 [00:50<00:00,  5.09s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:05,  1.48s/it]
Testing prompts:  40%|████      | 2/5 [00:02<00:03,  1.15s/it]
Testing prompts:  60%|██████    | 3/5 [00:05<00:04,  2.10s/it]
Testing prompts:  80%|████████  | 4/5 [00:09<00:02,  2.69s/it]
Testing prompts: 100%|██████████| 5/5 [00:14<00:00,  3.58s/it]
Testing prompts: 100%|██████████| 5/5 [00:14<00:00,  2.88s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:17,  1.94s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.29s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.12s/it]
Testing prompts:  40%|████      | 4/10 [00:32<01:12, 12.14s/it]
Testing prompts:  50%|█████     | 5/10 [00:34<00:42,  8.49s/it]
Testing prompts:  60%|██████    | 6/10 [00:36<00:25,  6.37s/it]
Testing prompts:  70%|███████   | 7/10 [00:38<00:14,  4.82s/it]
Testing prompts:  80%|████████  | 8/10 [00:44<00:10,  5.18s/it]
Testing prompts:  90%|█████████ | 9/10 [00:46<00:04,  4.07s/it]
Testing prompts: 100%|██████████| 10/10 [00:48<00:00,  3.43s/it]
Testing prompts: 100%|██████████| 10/10 [00:48<00:00,  4.82s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:11,  1.23s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.07s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.08s/it]
Testing prompts:  40%|████      | 4/10 [00:34<01:17, 12.94s/it]
Testing prompts:  50%|█████     | 5/10 [00:36<00:44,  8.94s/it]
Testing prompts:  60%|██████    | 6/10 [00:37<00:25,  6.40s/it]
Testing prompts:  70%|███████   | 7/10 [00:39<00:14,  4.87s/it]
Testing prompts:  80%|████████  | 8/10 [00:42<00:08,  4.30s/it]
Testing prompts:  90%|█████████ | 9/10 [00:43<00:03,  3.37s/it]
Testing prompts: 100%|██████████| 10/10 [00:46<00:00,  3.02s/it]
Testing prompts: 100%|██████████| 10/10 [00:46<00:00,  4.61s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:10,  1.18s/it]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.09it/s]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.01s/it]
Testing prompts:  40%|████      | 4/10 [00:37<01:26, 14.39s/it]
Testing prompts:  50%|█████     | 5/10 [00:39<00:48,  9.69s/it]
Testing prompts:  60%|██████    | 6/10 [00:40<00:27,  6.83s/it]
Testing prompts:  70%|███████   | 7/10 [00:42<00:15,  5.11s/it]
Testing prompts:  80%|████████  | 8/10 [00:45<00:09,  4.58s/it]
Testing prompts:  90%|█████████ | 9/10 [00:48<00:04,  4.09s/it]
Testing prompts: 100%|██████████| 10/10 [00:50<00:00,  3.33s/it]
Testing prompts: 100%|██████████| 10/10 [00:50<00:00,  5.02s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.40s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.10s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.16s/it]
Testing prompts:  40%|████      | 4/10 [01:10<02:42, 27.05s/it]
Testing prompts:  50%|█████     | 5/10 [01:12<01:29, 17.93s/it]
Testing prompts:  60%|██████    | 6/10 [01:13<00:49, 12.32s/it]
Testing prompts:  70%|███████   | 7/10 [01:15<00:26,  8.93s/it]
Testing prompts:  80%|████████  | 8/10 [01:18<00:13,  6.98s/it]
Testing prompts:  90%|█████████ | 9/10 [01:20<00:05,  5.52s/it]
Testing prompts: 100%|██████████| 10/10 [01:21<00:00,  4.27s/it]
Testing prompts: 100%|██████████| 10/10 [01:21<00:00,  8.20s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.40s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.16s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.16s/it]
Testing prompts:  40%|████      | 4/10 [00:30<01:08, 11.41s/it]
Testing prompts:  50%|█████     | 5/10 [00:31<00:38,  7.65s/it]
Testing prompts:  60%|██████    | 6/10 [00:32<00:22,  5.50s/it]
Testing prompts:  70%|███████   | 7/10 [00:34<00:13,  4.36s/it]
Testing prompts:  80%|████████  | 8/10 [00:37<00:07,  3.92s/it]
Testing prompts:  90%|█████████ | 9/10 [00:40<00:03,  3.52s/it]
Testing prompts: 100%|██████████| 10/10 [00:42<00:00,  3.13s/it]
Testing prompts: 100%|██████████| 10/10 [00:42<00:00,  4.29s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:11,  1.24s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.27s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:15,  2.28s/it]
Testing prompts:  40%|████      | 4/10 [00:30<01:07, 11.20s/it]
Testing prompts:  50%|█████     | 5/10 [00:31<00:37,  7.51s/it]
Testing prompts:  60%|██████    | 6/10 [00:33<00:21,  5.42s/it]
Testing prompts:  70%|███████   | 7/10 [00:34<00:12,  4.13s/it]
Testing prompts:  80%|████████  | 8/10 [00:37<00:07,  3.75s/it]
Testing prompts:  90%|█████████ | 9/10 [00:39<00:03,  3.04s/it]
Testing prompts: 100%|██████████| 10/10 [00:40<00:00,  2.43s/it]
Testing prompts: 100%|██████████| 10/10 [00:40<00:00,  4.02s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:11,  1.31s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.14s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.12s/it]
Testing prompts:  40%|████      | 4/10 [00:26<00:59,  9.85s/it]
Testing prompts:  50%|█████     | 5/10 [00:28<00:33,  6.80s/it]
Testing prompts:  60%|██████    | 6/10 [00:29<00:20,  5.04s/it]
Testing prompts:  70%|███████   | 7/10 [00:30<00:11,  3.77s/it]
Testing prompts:  80%|████████  | 8/10 [01:06<00:27, 13.77s/it]
Testing prompts:  90%|█████████ | 9/10 [01:08<00:10, 10.17s/it]
Testing prompts: 100%|██████████| 10/10 [01:09<00:00,  7.43s/it]
Testing prompts: 100%|██████████| 10/10 [01:09<00:00,  6.96s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:14,  1.59s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.27s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.13s/it]
Testing prompts:  40%|████      | 4/10 [00:33<01:15, 12.58s/it]
Testing prompts:  50%|█████     | 5/10 [00:35<00:42,  8.50s/it]
Testing prompts:  60%|██████    | 6/10 [00:36<00:24,  6.10s/it]
Testing prompts:  70%|███████   | 7/10 [00:37<00:13,  4.57s/it]
Testing prompts:  80%|████████  | 8/10 [00:40<00:08,  4.06s/it]
Testing prompts:  90%|█████████ | 9/10 [00:42<00:03,  3.24s/it]
Testing prompts: 100%|██████████| 10/10 [00:44<00:00,  2.82s/it]
Testing prompts: 100%|██████████| 10/10 [00:44<00:00,  4.42s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.54s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.26s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.15s/it]
Testing prompts:  40%|████      | 4/10 [00:29<01:06, 11.10s/it]
Testing prompts:  50%|█████     | 5/10 [00:31<00:38,  7.62s/it]
Testing prompts:  60%|██████    | 6/10 [00:32<00:22,  5.51s/it]
Testing prompts:  70%|███████   | 7/10 [00:34<00:12,  4.24s/it]
Testing prompts:  80%|████████  | 8/10 [00:37<00:07,  3.94s/it]
Testing prompts:  90%|█████████ | 9/10 [00:39<00:03,  3.37s/it]
Testing prompts: 100%|██████████| 10/10 [00:41<00:00,  2.84s/it]
Testing prompts: 100%|██████████| 10/10 [00:41<00:00,  4.15s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:10,  1.12s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.11s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.28s/it]
Testing prompts:  40%|████      | 4/10 [00:34<01:16, 12.83s/it]
Testing prompts:  50%|█████     | 5/10 [00:35<00:43,  8.70s/it]
Testing prompts:  60%|██████    | 6/10 [00:36<00:24,  6.18s/it]
Testing prompts:  70%|███████   | 7/10 [00:38<00:13,  4.62s/it]
Testing prompts:  80%|████████  | 8/10 [00:41<00:08,  4.18s/it]
Testing prompts:  90%|█████████ | 9/10 [00:43<00:03,  3.48s/it]
Testing prompts: 100%|██████████| 10/10 [00:45<00:00,  3.04s/it]
Testing prompts: 100%|██████████| 10/10 [00:45<00:00,  4.56s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:15,  1.75s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.26s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.15s/it]
Testing prompts:  40%|████      | 4/10 [00:34<01:16, 12.79s/it]
Testing prompts:  50%|█████     | 5/10 [00:35<00:43,  8.65s/it]
Testing prompts:  60%|██████    | 6/10 [00:37<00:24,  6.21s/it]
Testing prompts:  70%|███████   | 7/10 [00:38<00:13,  4.62s/it]
Testing prompts:  80%|████████  | 8/10 [00:41<00:08,  4.19s/it]
Testing prompts:  90%|█████████ | 9/10 [00:43<00:03,  3.41s/it]
Testing prompts: 100%|██████████| 10/10 [00:44<00:00,  2.80s/it]
Testing prompts: 100%|██████████| 10/10 [00:44<00:00,  4.49s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.52s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.18s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:16,  2.31s/it]
Testing prompts:  40%|████      | 4/10 [00:29<01:04, 10.69s/it]
Testing prompts:  50%|█████     | 5/10 [00:30<00:36,  7.26s/it]
Testing prompts:  60%|██████    | 6/10 [00:31<00:20,  5.17s/it]
Testing prompts:  70%|███████   | 7/10 [00:33<00:11,  3.93s/it]
Testing prompts:  80%|████████  | 8/10 [00:36<00:07,  3.70s/it]
Testing prompts:  90%|█████████ | 9/10 [00:37<00:02,  2.85s/it]
Testing prompts: 100%|██████████| 10/10 [00:41<00:00,  3.32s/it]
Testing prompts: 100%|██████████| 10/10 [00:41<00:00,  4.19s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:18,  2.09s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:16,  2.06s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:11,  1.66s/it]
Testing prompts:  40%|████      | 4/10 [00:33<01:13, 12.21s/it]
Testing prompts:  50%|█████     | 5/10 [00:34<00:41,  8.23s/it]
Testing prompts:  60%|██████    | 6/10 [00:36<00:24,  6.00s/it]
Testing prompts:  70%|███████   | 7/10 [00:38<00:13,  4.61s/it]
Testing prompts:  80%|████████  | 8/10 [00:41<00:08,  4.23s/it]
Testing prompts:  90%|█████████ | 9/10 [00:42<00:03,  3.25s/it]
Testing prompts: 100%|██████████| 10/10 [00:47<00:00,  3.85s/it]
Testing prompts: 100%|██████████| 10/10 [00:47<00:00,  4.80s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:04<00:44,  4.90s/it]
Testing prompts:  20%|██        | 2/10 [00:06<00:25,  3.19s/it]
Testing prompts:  30%|███       | 3/10 [00:11<00:25,  3.65s/it]
Testing prompts:  40%|████      | 4/10 [00:46<01:36, 16.02s/it]
Testing prompts:  50%|█████     | 5/10 [00:47<00:53, 10.68s/it]
Testing prompts:  60%|██████    | 6/10 [00:48<00:29,  7.42s/it]
Testing prompts:  70%|███████   | 7/10 [00:50<00:16,  5.54s/it]
Testing prompts:  80%|████████  | 8/10 [00:53<00:09,  4.77s/it]
Testing prompts:  90%|█████████ | 9/10 [00:55<00:04,  4.10s/it]
Testing prompts: 100%|██████████| 10/10 [00:57<00:00,  3.31s/it]
Testing prompts: 100%|██████████| 10/10 [00:57<00:00,  5.73s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:20,  2.24s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:12,  1.57s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:09,  1.38s/it]
Testing prompts:  40%|████      | 4/10 [00:37<01:23, 13.96s/it]
Testing prompts:  50%|█████     | 5/10 [00:38<00:46,  9.38s/it]
Testing prompts:  60%|██████    | 6/10 [00:40<00:27,  6.80s/it]
Testing prompts:  70%|███████   | 7/10 [00:42<00:15,  5.13s/it]
Testing prompts:  80%|████████  | 8/10 [00:46<00:09,  4.63s/it]
Testing prompts:  90%|█████████ | 9/10 [00:48<00:03,  3.84s/it]
Testing prompts: 100%|██████████| 10/10 [00:49<00:00,  3.21s/it]
Testing prompts: 100%|██████████| 10/10 [00:49<00:00,  4.99s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:18,  2.01s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:11,  1.48s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.49s/it]
Testing prompts:  40%|████      | 4/10 [00:31<01:08, 11.43s/it]
Testing prompts:  50%|█████     | 5/10 [00:32<00:38,  7.79s/it]
Testing prompts:  60%|██████    | 6/10 [00:33<00:22,  5.55s/it]
Testing prompts:  70%|███████   | 7/10 [00:35<00:12,  4.26s/it]
Testing prompts:  80%|████████  | 8/10 [00:40<00:09,  4.58s/it]
Testing prompts:  90%|█████████ | 9/10 [00:42<00:03,  3.68s/it]
Testing prompts: 100%|██████████| 10/10 [00:44<00:00,  3.16s/it]
Testing prompts: 100%|██████████| 10/10 [00:44<00:00,  4.44s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:16,  1.85s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:16,  2.06s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:11,  1.67s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:08,  1.45s/it]
Testing prompts:  50%|█████     | 5/10 [00:10<00:11,  2.30s/it]
Testing prompts:  60%|██████    | 6/10 [00:11<00:07,  1.99s/it]
Testing prompts:  70%|███████   | 7/10 [00:12<00:05,  1.75s/it]
Testing prompts:  80%|████████  | 8/10 [00:14<00:03,  1.62s/it]
Testing prompts:  90%|█████████ | 9/10 [00:15<00:01,  1.60s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  1.56s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  1.72s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.42s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.43s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.30s/it]
Testing prompts:  40%|████      | 4/10 [00:30<01:08, 11.33s/it]
Testing prompts:  50%|█████     | 5/10 [00:32<00:39,  7.80s/it]
Testing prompts:  60%|██████    | 6/10 [00:33<00:22,  5.59s/it]
Testing prompts:  70%|███████   | 7/10 [00:34<00:12,  4.20s/it]
Testing prompts:  80%|████████  | 8/10 [00:37<00:07,  3.77s/it]
Testing prompts:  90%|█████████ | 9/10 [00:39<00:03,  3.14s/it]
Testing prompts: 100%|██████████| 10/10 [00:41<00:00,  2.74s/it]
Testing prompts: 100%|██████████| 10/10 [00:41<00:00,  4.13s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:14,  1.60s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.27s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.14s/it]
Testing prompts:  40%|████      | 4/10 [00:25<00:56,  9.45s/it]
Testing prompts:  50%|█████     | 5/10 [00:27<00:33,  6.68s/it]
Testing prompts:  60%|██████    | 6/10 [00:29<00:20,  5.08s/it]
Testing prompts:  70%|███████   | 7/10 [00:30<00:11,  3.78s/it]
Testing prompts:  80%|████████  | 8/10 [00:33<00:06,  3.47s/it]
Testing prompts:  90%|█████████ | 9/10 [00:34<00:02,  2.84s/it]
Testing prompts: 100%|██████████| 10/10 [00:36<00:00,  2.34s/it]
Testing prompts: 100%|██████████| 10/10 [00:36<00:00,  3.61s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:09,  1.04s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:07,  1.00it/s]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.05s/it]
Testing prompts:  40%|████      | 4/10 [00:29<01:05, 10.99s/it]
Testing prompts:  50%|█████     | 5/10 [00:30<00:37,  7.42s/it]
Testing prompts:  60%|██████    | 6/10 [00:32<00:21,  5.49s/it]
Testing prompts:  70%|███████   | 7/10 [00:34<00:13,  4.55s/it]
Testing prompts:  80%|████████  | 8/10 [00:37<00:08,  4.12s/it]
Testing prompts:  90%|█████████ | 9/10 [00:39<00:03,  3.42s/it]
Testing prompts: 100%|██████████| 10/10 [00:41<00:00,  2.80s/it]
Testing prompts: 100%|██████████| 10/10 [00:41<00:00,  4.13s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:14,  1.64s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.24s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.04s/it]
Testing prompts:  40%|████      | 4/10 [00:35<01:19, 13.28s/it]
Testing prompts:  50%|█████     | 5/10 [00:36<00:44,  8.96s/it]
Testing prompts:  60%|██████    | 6/10 [00:38<00:25,  6.37s/it]
Testing prompts:  70%|███████   | 7/10 [00:39<00:14,  4.70s/it]
Testing prompts:  80%|████████  | 8/10 [00:42<00:08,  4.24s/it]
Testing prompts:  90%|█████████ | 9/10 [00:44<00:03,  3.39s/it]
Testing prompts: 100%|██████████| 10/10 [00:45<00:00,  2.73s/it]
Testing prompts: 100%|██████████| 10/10 [00:45<00:00,  4.54s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.55s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.10s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.19s/it]
Testing prompts:  40%|████      | 4/10 [00:34<01:18, 13.05s/it]
Testing prompts:  50%|█████     | 5/10 [00:36<00:44,  8.96s/it]
Testing prompts:  60%|██████    | 6/10 [00:37<00:25,  6.28s/it]
Testing prompts:  70%|███████   | 7/10 [00:39<00:14,  4.67s/it]
Testing prompts:  80%|████████  | 8/10 [00:42<00:08,  4.35s/it]
Testing prompts:  90%|█████████ | 9/10 [00:44<00:03,  3.64s/it]
Testing prompts: 100%|██████████| 10/10 [00:47<00:00,  3.35s/it]
Testing prompts: 100%|██████████| 10/10 [00:47<00:00,  4.74s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:20,  2.30s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:11,  1.45s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.15s/it]
Testing prompts:  40%|████      | 4/10 [00:18<00:38,  6.34s/it]
Testing prompts:  50%|█████     | 5/10 [00:19<00:22,  4.54s/it]
Testing prompts:  60%|██████    | 6/10 [00:20<00:13,  3.36s/it]
Testing prompts:  70%|███████   | 7/10 [00:23<00:09,  3.11s/it]
Testing prompts:  80%|████████  | 8/10 [00:26<00:06,  3.04s/it]
Testing prompts:  90%|█████████ | 9/10 [00:29<00:03,  3.00s/it]
Testing prompts: 100%|██████████| 10/10 [00:30<00:00,  2.39s/it]
Testing prompts: 100%|██████████| 10/10 [00:30<00:00,  3.01s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:09,  1.06s/it]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.16it/s]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.14s/it]
Testing prompts:  40%|████      | 4/10 [00:35<01:20, 13.45s/it]
Testing prompts:  50%|█████     | 5/10 [00:36<00:45,  9.07s/it]
Testing prompts:  60%|██████    | 6/10 [00:38<00:25,  6.38s/it]
Testing prompts:  70%|███████   | 7/10 [00:39<00:14,  4.70s/it]
Testing prompts:  80%|████████  | 8/10 [00:41<00:08,  4.07s/it]
Testing prompts:  90%|█████████ | 9/10 [00:43<00:03,  3.38s/it]
Testing prompts: 100%|██████████| 10/10 [00:44<00:00,  2.68s/it]
Testing prompts: 100%|██████████| 10/10 [00:44<00:00,  4.50s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:21,  2.43s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.70s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:10,  1.56s/it]
Testing prompts:  40%|████      | 4/10 [00:31<01:09, 11.56s/it]
Testing prompts:  50%|█████     | 5/10 [00:33<00:39,  7.90s/it]
Testing prompts:  60%|██████    | 6/10 [00:34<00:22,  5.63s/it]
Testing prompts:  70%|███████   | 7/10 [00:35<00:12,  4.22s/it]
Testing prompts:  80%|████████  | 8/10 [00:38<00:07,  3.76s/it]
Testing prompts:  90%|█████████ | 9/10 [00:40<00:03,  3.12s/it]
Testing prompts: 100%|██████████| 10/10 [00:41<00:00,  2.50s/it]
Testing prompts: 100%|██████████| 10/10 [00:41<00:00,  4.15s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:14,  1.59s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.26s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.18s/it]
Testing prompts:  40%|████      | 4/10 [00:29<01:04, 10.73s/it]
Testing prompts:  50%|█████     | 5/10 [00:30<00:36,  7.28s/it]
Testing prompts:  60%|██████    | 6/10 [00:31<00:20,  5.20s/it]
Testing prompts:  70%|███████   | 7/10 [00:32<00:11,  3.92s/it]
Testing prompts:  80%|████████  | 8/10 [00:36<00:07,  3.90s/it]
Testing prompts:  90%|█████████ | 9/10 [00:38<00:03,  3.29s/it]
Testing prompts: 100%|██████████| 10/10 [00:40<00:00,  2.83s/it]
Testing prompts: 100%|██████████| 10/10 [00:40<00:00,  4.03s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.03it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.12it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.19it/s]
Testing prompts:  40%|████      | 4/10 [00:34<01:18, 13.13s/it]
Testing prompts:  50%|█████     | 5/10 [00:36<00:44,  8.98s/it]
Testing prompts:  60%|██████    | 6/10 [00:37<00:25,  6.33s/it]
Testing prompts:  70%|███████   | 7/10 [00:38<00:14,  4.69s/it]
Testing prompts:  80%|████████  | 8/10 [00:41<00:08,  4.13s/it]
Testing prompts:  90%|█████████ | 9/10 [00:44<00:03,  3.63s/it]
Testing prompts: 100%|██████████| 10/10 [00:45<00:00,  2.95s/it]
Testing prompts: 100%|██████████| 10/10 [00:45<00:00,  4.56s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:10,  1.17s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.11s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.13s/it]
Testing prompts:  40%|████      | 4/10 [00:31<01:11, 11.95s/it]
Testing prompts:  50%|█████     | 5/10 [00:33<00:40,  8.09s/it]
Testing prompts:  60%|██████    | 6/10 [00:34<00:23,  5.87s/it]
Testing prompts:  70%|███████   | 7/10 [00:36<00:13,  4.39s/it]
Testing prompts:  80%|████████  | 8/10 [00:38<00:07,  3.88s/it]
Testing prompts:  90%|█████████ | 9/10 [00:40<00:03,  3.22s/it]
Testing prompts: 100%|██████████| 10/10 [00:41<00:00,  2.62s/it]
Testing prompts: 100%|██████████| 10/10 [00:41<00:00,  4.19s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:15,  1.74s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.45s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:18,  2.59s/it]
Testing prompts:  40%|████      | 4/10 [00:39<01:25, 14.31s/it]
Testing prompts:  50%|█████     | 5/10 [00:41<00:49,  9.84s/it]
Testing prompts:  60%|██████    | 6/10 [00:42<00:27,  6.94s/it]
Testing prompts:  70%|███████   | 7/10 [00:43<00:15,  5.07s/it]
Testing prompts:  80%|████████  | 8/10 [00:46<00:09,  4.50s/it]
Testing prompts:  90%|█████████ | 9/10 [00:48<00:03,  3.52s/it]
Testing prompts: 100%|██████████| 10/10 [00:49<00:00,  2.91s/it]
Testing prompts: 100%|██████████| 10/10 [00:49<00:00,  4.98s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:17,  2.00s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:15,  1.89s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:11,  1.57s/it]
Testing prompts:  40%|████      | 4/10 [00:16<00:31,  5.30s/it]
Testing prompts:  50%|█████     | 5/10 [00:19<00:23,  4.75s/it]
Testing prompts:  60%|██████    | 6/10 [00:21<00:14,  3.61s/it]
Testing prompts:  70%|███████   | 7/10 [00:22<00:09,  3.01s/it]
Testing prompts:  80%|████████  | 8/10 [00:26<00:06,  3.09s/it]
Testing prompts:  90%|█████████ | 9/10 [00:28<00:02,  2.72s/it]
Testing prompts: 100%|██████████| 10/10 [00:29<00:00,  2.28s/it]
Testing prompts: 100%|██████████| 10/10 [00:29<00:00,  2.94s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.45s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.31s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.31s/it]
Testing prompts:  40%|████      | 4/10 [00:31<01:09, 11.52s/it]
Testing prompts:  50%|█████     | 5/10 [00:32<00:38,  7.77s/it]
Testing prompts:  60%|██████    | 6/10 [00:33<00:22,  5.63s/it]
Testing prompts:  70%|███████   | 7/10 [00:35<00:12,  4.24s/it]
Testing prompts:  80%|████████  | 8/10 [00:38<00:07,  3.91s/it]
Testing prompts:  90%|█████████ | 9/10 [00:40<00:03,  3.30s/it]
Testing prompts: 100%|██████████| 10/10 [00:42<00:00,  2.92s/it]
Testing prompts: 100%|██████████| 10/10 [00:42<00:00,  4.23s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.47s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.22s/it]
Testing prompts:  30%|███       | 3/10 [00:13<00:39,  5.65s/it]
Testing prompts:  40%|████      | 4/10 [00:14<00:23,  3.87s/it]
Testing prompts:  50%|█████     | 5/10 [00:15<00:14,  2.98s/it]
Testing prompts:  60%|██████    | 6/10 [00:18<00:11,  2.82s/it]
Testing prompts:  70%|███████   | 7/10 [00:19<00:06,  2.33s/it]
Testing prompts:  80%|████████  | 8/10 [00:26<00:07,  3.64s/it]
Testing prompts:  90%|█████████ | 9/10 [00:28<00:03,  3.15s/it]
Testing prompts: 100%|██████████| 10/10 [00:30<00:00,  2.82s/it]
Testing prompts: 100%|██████████| 10/10 [00:30<00:00,  3.04s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:16,  1.86s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.33s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.15s/it]
Testing prompts:  40%|████      | 4/10 [00:29<01:04, 10.78s/it]
Testing prompts:  50%|█████     | 5/10 [00:30<00:36,  7.34s/it]
Testing prompts:  60%|██████    | 6/10 [00:31<00:21,  5.29s/it]
Testing prompts:  70%|███████   | 7/10 [00:33<00:12,  4.13s/it]
Testing prompts:  80%|████████  | 8/10 [00:36<00:07,  3.80s/it]
Testing prompts:  90%|█████████ | 9/10 [00:39<00:03,  3.53s/it]
Testing prompts: 100%|██████████| 10/10 [00:41<00:00,  3.08s/it]
Testing prompts: 100%|██████████| 10/10 [00:41<00:00,  4.17s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:20,  2.27s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.71s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:09,  1.42s/it]
Testing prompts:  40%|████      | 4/10 [00:37<01:22, 13.83s/it]
Testing prompts:  50%|█████     | 5/10 [00:38<00:46,  9.27s/it]
Testing prompts:  60%|██████    | 6/10 [00:40<00:26,  6.59s/it]
Testing prompts:  70%|███████   | 7/10 [00:41<00:14,  4.87s/it]
Testing prompts:  80%|████████  | 8/10 [00:45<00:09,  4.51s/it]
Testing prompts:  90%|█████████ | 9/10 [00:46<00:03,  3.59s/it]
Testing prompts: 100%|██████████| 10/10 [00:48<00:00,  2.89s/it]
Testing prompts: 100%|██████████| 10/10 [00:48<00:00,  4.80s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:09,  1.01s/it]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.04it/s]
Testing prompts:  30%|███       | 3/10 [00:30<01:34, 13.56s/it]
Testing prompts:  40%|████      | 4/10 [00:34<00:57,  9.63s/it]
Testing prompts:  50%|█████     | 5/10 [00:35<00:33,  6.70s/it]
Testing prompts:  60%|██████    | 6/10 [00:37<00:19,  4.91s/it]
Testing prompts:  70%|███████   | 7/10 [00:38<00:11,  3.70s/it]
Testing prompts:  80%|████████  | 8/10 [00:41<00:06,  3.45s/it]
Testing prompts:  90%|█████████ | 9/10 [00:42<00:02,  2.86s/it]
Testing prompts: 100%|██████████| 10/10 [00:43<00:00,  2.31s/it]
Testing prompts: 100%|██████████| 10/10 [00:43<00:00,  4.38s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:14,  1.58s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.20s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:17,  2.51s/it]
Testing prompts:  40%|████      | 4/10 [00:41<01:32, 15.40s/it]
Testing prompts:  50%|█████     | 5/10 [00:42<00:51, 10.29s/it]
Testing prompts:  60%|██████    | 6/10 [00:44<00:29,  7.32s/it]
Testing prompts:  70%|███████   | 7/10 [00:47<00:17,  5.77s/it]
Testing prompts:  80%|████████  | 8/10 [00:49<00:09,  4.85s/it]
Testing prompts:  90%|█████████ | 9/10 [01:16<00:11, 11.51s/it]
Testing prompts: 100%|██████████| 10/10 [01:17<00:00,  8.46s/it]
Testing prompts: 100%|██████████| 10/10 [01:17<00:00,  7.78s/it]
