[2025-05-11 09:39:05,950][INFO] Following apps/actions have missing dependencies
[2025-05-11 09:39:05,951][INFO] • CODE_ANALYSIS_TOOL_GET_RELEVANT_CODE: {'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi'}
[2025-05-11 09:39:05,951][INFO] • SQLTOOL_SQL_QUERY: {'sqlalchemy>=2.0'}
[2025-05-11 09:39:05,951][INFO] • CODE_ANALYSIS_TOOL_CREATE_CODE_MAP: {'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi'}
[2025-05-11 09:39:05,951][INFO] • CODE_ANALYSIS_TOOL_GET_METHOD_SIGNATURE: {'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi'}
[2025-05-11 09:39:05,951][INFO] • CODE_ANALYSIS_TOOL_GET_CLASS_INFO: {'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi'}
[2025-05-11 09:39:05,951][INFO] • CODE_ANALYSIS_TOOL_GET_METHOD_BODY: {'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi'}
[2025-05-11 09:39:05,951][INFO] Installing dependencies...
[2025-05-11 09:39:05,951][INFO] Installing deeplake>3.9,<3.9.39
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:39:08,276][INFO] Installed deeplake>3.9,<3.9.39
[2025-05-11 09:39:08,276][INFO] Installing tree_sitter_python>=0.22.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:39:10,486][INFO] Installed tree_sitter_python>=0.22.0
[2025-05-11 09:39:10,486][INFO] Installing tokenizers>=0.19,<0.20
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:39:12,740][INFO] Installed tokenizers>=0.19,<0.20
[2025-05-11 09:39:12,741][INFO] Installing tree_sitter>=0.22.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:39:14,967][INFO] Installed tree_sitter>=0.22.0
[2025-05-11 09:39:14,967][INFO] Installing git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:39:17,828][INFO] Installed git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi
[2025-05-11 09:39:17,828][INFO] Installing sqlalchemy>=2.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:39:20,078][INFO] Installed sqlalchemy>=2.0

Testing prompts:   0%|          | 0/17 [00:00<?, ?it/s]
Testing prompts:   6%|▌         | 1/17 [00:00<00:10,  1.50it/s]
Testing prompts:  12%|█▏        | 2/17 [00:01<00:11,  1.32it/s]
Testing prompts:  18%|█▊        | 3/17 [00:01<00:08,  1.56it/s]
Testing prompts:  24%|██▎       | 4/17 [00:02<00:08,  1.46it/s]
Testing prompts:  29%|██▉       | 5/17 [00:03<00:08,  1.40it/s]
Testing prompts:  35%|███▌      | 6/17 [00:04<00:08,  1.25it/s]
Testing prompts:  41%|████      | 7/17 [00:05<00:08,  1.20it/s]
Testing prompts:  47%|████▋     | 8/17 [00:06<00:07,  1.19it/s]
Testing prompts:  53%|█████▎    | 9/17 [00:07<00:07,  1.10it/s]
Testing prompts:  59%|█████▉    | 10/17 [00:08<00:06,  1.15it/s]
Testing prompts:  65%|██████▍   | 11/17 [00:09<00:05,  1.00it/s]
Testing prompts:  71%|███████   | 12/17 [00:10<00:04,  1.01it/s]
Testing prompts:  76%|███████▋  | 13/17 [00:11<00:03,  1.05it/s]
Testing prompts:  82%|████████▏ | 14/17 [00:12<00:03,  1.04s/it]
Testing prompts:  88%|████████▊ | 15/17 [00:15<00:03,  1.62s/it]
Testing prompts:  94%|█████████▍| 16/17 [00:18<00:01,  1.95s/it]
Testing prompts: 100%|██████████| 17/17 [00:19<00:00,  1.90s/it]
Testing prompts: 100%|██████████| 17/17 [00:19<00:00,  1.17s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.21it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.20it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.07it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:05,  1.05it/s]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.14s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.21s/it]
Testing prompts:  70%|███████   | 7/10 [00:07<00:03,  1.18s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:03,  1.88s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.81s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  2.14s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.56s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:10,  1.16s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.19s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.03s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:12,  2.01s/it]
Testing prompts:  50%|█████     | 5/10 [00:09<00:11,  2.26s/it]
Testing prompts:  60%|██████    | 6/10 [00:10<00:07,  1.92s/it]
Testing prompts:  70%|███████   | 7/10 [00:11<00:04,  1.66s/it]
Testing prompts:  80%|████████  | 8/10 [00:13<00:03,  1.53s/it]
Testing prompts:  90%|█████████ | 9/10 [00:14<00:01,  1.39s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.31s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.53s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.37s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.14s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.15s/it]
Testing prompts:  40%|████      | 4/10 [00:15<00:33,  5.56s/it]
Testing prompts:  50%|█████     | 5/10 [00:16<00:19,  3.95s/it]
Testing prompts:  60%|██████    | 6/10 [00:18<00:12,  3.14s/it]
Testing prompts:  70%|███████   | 7/10 [00:19<00:07,  2.41s/it]
Testing prompts:  80%|████████  | 8/10 [00:24<00:06,  3.13s/it]
Testing prompts:  90%|█████████ | 9/10 [00:29<00:03,  3.88s/it]
Testing prompts: 100%|██████████| 10/10 [00:34<00:00,  4.19s/it]
Testing prompts: 100%|██████████| 10/10 [00:34<00:00,  3.45s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:10,  1.15s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.16s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.05s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.05s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:06,  1.26s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.37s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.52s/it]
Testing prompts:  80%|████████  | 8/10 [00:13<00:04,  2.22s/it]
Testing prompts:  90%|█████████ | 9/10 [00:14<00:02,  2.03s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  2.28s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  1.75s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.41s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.38s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.23s/it]
Testing prompts:  40%|████      | 4/10 [00:08<00:15,  2.57s/it]
Testing prompts:  50%|█████     | 5/10 [00:10<00:11,  2.22s/it]
Testing prompts:  60%|██████    | 6/10 [00:11<00:07,  1.97s/it]
Testing prompts:  70%|███████   | 7/10 [00:12<00:05,  1.68s/it]
Testing prompts:  80%|████████  | 8/10 [00:13<00:02,  1.46s/it]
Testing prompts:  90%|█████████ | 9/10 [00:14<00:01,  1.31s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.21s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.56s/it]

Testing prompts:   0%|          | 0/17 [00:00<?, ?it/s]
Testing prompts:   6%|▌         | 1/17 [00:00<00:11,  1.37it/s]
Testing prompts:  12%|█▏        | 2/17 [00:01<00:11,  1.34it/s]
Testing prompts:  18%|█▊        | 3/17 [00:02<00:09,  1.46it/s]
Testing prompts:  24%|██▎       | 4/17 [00:02<00:09,  1.40it/s]
Testing prompts:  29%|██▉       | 5/17 [00:03<00:08,  1.38it/s]
Testing prompts:  35%|███▌      | 6/17 [00:04<00:08,  1.29it/s]
Testing prompts:  41%|████      | 7/17 [00:05<00:07,  1.32it/s]
Testing prompts:  47%|████▋     | 8/17 [00:05<00:06,  1.36it/s]
Testing prompts:  53%|█████▎    | 9/17 [00:07<00:07,  1.03it/s]
Testing prompts:  59%|█████▉    | 10/17 [00:08<00:06,  1.07it/s]
Testing prompts:  65%|██████▍   | 11/17 [00:09<00:05,  1.05it/s]
Testing prompts:  71%|███████   | 12/17 [00:10<00:04,  1.01it/s]
Testing prompts:  76%|███████▋  | 13/17 [00:11<00:03,  1.03it/s]
Testing prompts:  82%|████████▏ | 14/17 [00:12<00:03,  1.04s/it]
Testing prompts:  88%|████████▊ | 15/17 [00:15<00:03,  1.61s/it]
Testing prompts:  94%|█████████▍| 16/17 [00:18<00:02,  2.18s/it]
Testing prompts: 100%|██████████| 17/17 [00:21<00:00,  2.43s/it]
Testing prompts: 100%|██████████| 17/17 [00:21<00:00,  1.29s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.33it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.07it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:07,  1.03s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:11,  1.89s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:08,  1.65s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.44s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.34s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.34s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.23s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.82s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.50s/it]

Testing prompts:   0%|          | 0/17 [00:00<?, ?it/s]
Testing prompts:   6%|▌         | 1/17 [00:00<00:09,  1.70it/s]
Testing prompts:  12%|█▏        | 2/17 [00:01<00:10,  1.42it/s]
Testing prompts:  18%|█▊        | 3/17 [00:02<00:09,  1.47it/s]
Testing prompts:  24%|██▎       | 4/17 [00:02<00:09,  1.40it/s]
Testing prompts:  29%|██▉       | 5/17 [00:03<00:09,  1.28it/s]
Testing prompts:  35%|███▌      | 6/17 [00:04<00:09,  1.17it/s]
Testing prompts:  41%|████      | 7/17 [00:05<00:08,  1.19it/s]
Testing prompts:  47%|████▋     | 8/17 [00:06<00:06,  1.29it/s]
Testing prompts:  53%|█████▎    | 9/17 [00:07<00:07,  1.03it/s]
Testing prompts:  59%|█████▉    | 10/17 [00:08<00:07,  1.00s/it]
Testing prompts:  65%|██████▍   | 11/17 [00:09<00:06,  1.02s/it]
Testing prompts:  71%|███████   | 12/17 [00:11<00:05,  1.18s/it]
Testing prompts:  76%|███████▋  | 13/17 [00:12<00:04,  1.15s/it]
Testing prompts:  82%|████████▏ | 14/17 [00:13<00:03,  1.13s/it]
Testing prompts:  88%|████████▊ | 15/17 [00:16<00:03,  1.72s/it]
Testing prompts:  94%|█████████▍| 16/17 [00:19<00:02,  2.13s/it]
Testing prompts: 100%|██████████| 17/17 [00:22<00:00,  2.36s/it]
Testing prompts: 100%|██████████| 17/17 [00:22<00:00,  1.32s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.22it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.11s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.25s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:10,  1.83s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:08,  1.68s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.45s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.39s/it]
Testing prompts:  80%|████████  | 8/10 [00:13<00:04,  2.06s/it]
Testing prompts:  90%|█████████ | 9/10 [00:14<00:01,  1.77s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.55s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.56s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.19it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.14s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.19s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:11,  1.85s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:07,  1.52s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.39s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.34s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.28s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.29s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.81s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.51s/it]

Testing prompts:   0%|          | 0/9 [00:00<?, ?it/s]
Testing prompts:  11%|█         | 1/9 [00:00<00:06,  1.32it/s]
Testing prompts:  22%|██▏       | 2/9 [00:01<00:05,  1.23it/s]
Testing prompts:  33%|███▎      | 3/9 [00:02<00:05,  1.02it/s]
Testing prompts:  44%|████▍     | 4/9 [00:03<00:05,  1.03s/it]
Testing prompts:  56%|█████▌    | 5/9 [00:06<00:06,  1.60s/it]
Testing prompts:  67%|██████▋   | 6/9 [00:09<00:06,  2.19s/it]
Testing prompts:  78%|███████▊  | 7/9 [00:10<00:03,  1.76s/it]
Testing prompts:  89%|████████▉ | 8/9 [00:11<00:01,  1.54s/it]
Testing prompts: 100%|██████████| 9/9 [01:43<00:00, 29.62s/it]
Testing prompts: 100%|██████████| 9/9 [01:43<00:00, 11.46s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.49s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.34s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.45s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:07,  1.17s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.23s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.23s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.34s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.40s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.38s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.42s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.36s/it]

Testing prompts:   0%|          | 0/6 [00:00<?, ?it/s]
Testing prompts:  17%|█▋        | 1/6 [00:00<00:03,  1.28it/s]
Testing prompts:  33%|███▎      | 2/6 [00:01<00:03,  1.08it/s]
Testing prompts:  50%|█████     | 3/6 [00:02<00:02,  1.06it/s]
Testing prompts:  67%|██████▋   | 4/6 [00:05<00:03,  1.71s/it]
Testing prompts:  83%|████████▎ | 5/6 [00:06<00:01,  1.46s/it]
Testing prompts: 100%|██████████| 6/6 [01:40<00:00, 32.82s/it]
Testing prompts: 100%|██████████| 6/6 [01:40<00:00, 16.73s/it]

Testing prompts:   0%|          | 0/17 [00:00<?, ?it/s]
Testing prompts:   6%|▌         | 1/17 [00:00<00:09,  1.73it/s]
Testing prompts:  12%|█▏        | 2/17 [00:01<00:11,  1.33it/s]
Testing prompts:  18%|█▊        | 3/17 [00:02<00:09,  1.42it/s]
Testing prompts:  24%|██▎       | 4/17 [00:02<00:09,  1.36it/s]
Testing prompts:  29%|██▉       | 5/17 [00:03<00:09,  1.33it/s]
Testing prompts:  35%|███▌      | 6/17 [00:04<00:08,  1.32it/s]
Testing prompts:  41%|████      | 7/17 [00:05<00:07,  1.37it/s]
Testing prompts:  47%|████▋     | 8/17 [00:05<00:06,  1.38it/s]
Testing prompts:  53%|█████▎    | 9/17 [00:06<00:06,  1.22it/s]
Testing prompts:  59%|█████▉    | 10/17 [00:07<00:05,  1.21it/s]
Testing prompts:  65%|██████▍   | 11/17 [00:08<00:05,  1.12it/s]
Testing prompts:  71%|███████   | 12/17 [00:10<00:05,  1.01s/it]
Testing prompts:  76%|███████▋  | 13/17 [00:10<00:03,  1.02it/s]
Testing prompts:  82%|████████▏ | 14/17 [00:11<00:02,  1.04it/s]
Testing prompts:  88%|████████▊ | 15/17 [00:14<00:03,  1.55s/it]
Testing prompts:  94%|█████████▍| 16/17 [00:17<00:01,  1.92s/it]
Testing prompts: 100%|██████████| 17/17 [00:18<00:00,  1.67s/it]
Testing prompts: 100%|██████████| 17/17 [00:18<00:00,  1.10s/it]

Testing prompts:   0%|          | 0/15 [00:00<?, ?it/s]
Testing prompts:   7%|▋         | 1/15 [00:00<00:08,  1.70it/s]
Testing prompts:  13%|█▎        | 2/15 [00:01<00:08,  1.45it/s]
Testing prompts:  20%|██        | 3/15 [00:01<00:07,  1.53it/s]
Testing prompts:  27%|██▋       | 4/15 [00:02<00:07,  1.46it/s]
Testing prompts:  33%|███▎      | 5/15 [00:03<00:06,  1.43it/s]
Testing prompts:  40%|████      | 6/15 [00:04<00:06,  1.44it/s]
Testing prompts:  47%|████▋     | 7/15 [00:05<00:07,  1.03it/s]
Testing prompts:  53%|█████▎    | 8/15 [00:07<00:08,  1.15s/it]
Testing prompts:  60%|██████    | 9/15 [00:09<00:08,  1.43s/it]
Testing prompts:  67%|██████▋   | 10/15 [00:10<00:06,  1.27s/it]
Testing prompts:  73%|███████▎  | 11/15 [00:11<00:04,  1.17s/it]
Testing prompts:  80%|████████  | 12/15 [00:12<00:03,  1.13s/it]
Testing prompts:  87%|████████▋ | 13/15 [00:15<00:03,  1.69s/it]
Testing prompts:  93%|█████████▎| 14/15 [00:18<00:02,  2.10s/it]
Testing prompts: 100%|██████████| 15/15 [00:21<00:00,  2.41s/it]
Testing prompts: 100%|██████████| 15/15 [00:21<00:00,  1.42s/it]

Testing prompts:   0%|          | 0/17 [00:00<?, ?it/s]
Testing prompts:   6%|▌         | 1/17 [00:00<00:12,  1.31it/s]
Testing prompts:  12%|█▏        | 2/17 [00:01<00:12,  1.16it/s]
Testing prompts:  18%|█▊        | 3/17 [00:02<00:10,  1.29it/s]
Testing prompts:  24%|██▎       | 4/17 [00:03<00:09,  1.31it/s]
Testing prompts:  29%|██▉       | 5/17 [00:03<00:09,  1.29it/s]
Testing prompts:  35%|███▌      | 6/17 [00:04<00:09,  1.20it/s]
Testing prompts:  41%|████      | 7/17 [00:05<00:08,  1.19it/s]
Testing prompts:  47%|████▋     | 8/17 [00:06<00:07,  1.18it/s]
Testing prompts:  53%|█████▎    | 9/17 [00:07<00:07,  1.04it/s]
Testing prompts:  59%|█████▉    | 10/17 [00:08<00:07,  1.00s/it]
Testing prompts:  65%|██████▍   | 11/17 [00:09<00:06,  1.03s/it]
Testing prompts:  71%|███████   | 12/17 [00:11<00:05,  1.05s/it]
Testing prompts:  76%|███████▋  | 13/17 [00:11<00:03,  1.01it/s]
Testing prompts:  82%|████████▏ | 14/17 [00:13<00:03,  1.11s/it]
Testing prompts:  88%|████████▊ | 15/17 [00:16<00:03,  1.71s/it]
Testing prompts:  94%|█████████▍| 16/17 [00:20<00:02,  2.33s/it]
Testing prompts: 100%|██████████| 17/17 [00:23<00:00,  2.56s/it]
Testing prompts: 100%|██████████| 17/17 [00:23<00:00,  1.37s/it]

Testing prompts:   0%|          | 0/22 [00:00<?, ?it/s]
Testing prompts:   5%|▍         | 1/22 [00:00<00:11,  1.75it/s]
Testing prompts:   9%|▉         | 2/22 [00:01<00:12,  1.65it/s]
Testing prompts:  14%|█▎        | 3/22 [00:02<00:15,  1.23it/s]
Testing prompts:  18%|█▊        | 4/22 [00:03<00:14,  1.25it/s]
Testing prompts:  23%|██▎       | 5/22 [00:03<00:14,  1.17it/s]
Testing prompts:  27%|██▋       | 6/22 [00:05<00:18,  1.15s/it]
Testing prompts:  32%|███▏      | 7/22 [00:06<00:15,  1.02s/it]
Testing prompts:  36%|███▋      | 8/22 [00:07<00:13,  1.04it/s]
Testing prompts:  41%|████      | 9/22 [00:08<00:12,  1.05it/s]
Testing prompts:  45%|████▌     | 10/22 [00:08<00:10,  1.15it/s]
Testing prompts:  50%|█████     | 11/22 [00:10<00:10,  1.04it/s]
Testing prompts:  55%|█████▍    | 12/22 [00:11<00:09,  1.00it/s]
Testing prompts:  59%|█████▉    | 13/22 [00:12<00:09,  1.00s/it]
Testing prompts:  64%|██████▎   | 14/22 [00:13<00:07,  1.01it/s]
Testing prompts:  68%|██████▊   | 15/22 [00:16<00:11,  1.64s/it]
Testing prompts:  73%|███████▎  | 16/22 [00:20<00:14,  2.41s/it]
Testing prompts:  77%|███████▋  | 17/22 [00:23<00:12,  2.51s/it]
Testing prompts:  82%|████████▏ | 18/22 [00:24<00:08,  2.20s/it]
Testing prompts:  86%|████████▋ | 19/22 [00:26<00:05,  1.99s/it]
Testing prompts:  91%|█████████ | 20/22 [00:29<00:04,  2.25s/it]
Testing prompts:  95%|█████████▌| 21/22 [00:32<00:02,  2.57s/it]
Testing prompts: 100%|██████████| 22/22 [00:35<00:00,  2.64s/it]
Testing prompts: 100%|██████████| 22/22 [00:35<00:00,  1.60s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.07it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.25s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.18s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:10,  1.75s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:07,  1.46s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.35s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:04,  1.57s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:02,  1.50s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.47s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.29s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.39s/it]

Testing prompts:   0%|          | 0/9 [00:00<?, ?it/s]
Testing prompts:  11%|█         | 1/9 [00:00<00:06,  1.27it/s]
Testing prompts:  22%|██▏       | 2/9 [00:02<00:07,  1.09s/it]
Testing prompts:  33%|███▎      | 3/9 [00:03<00:06,  1.02s/it]
Testing prompts:  44%|████▍     | 4/9 [00:04<00:05,  1.04s/it]
Testing prompts:  56%|█████▌    | 5/9 [00:06<00:06,  1.59s/it]
Testing prompts:  67%|██████▋   | 6/9 [00:09<00:06,  2.07s/it]
Testing prompts:  78%|███████▊  | 7/9 [00:10<00:03,  1.76s/it]
Testing prompts:  89%|████████▉ | 8/9 [00:11<00:01,  1.53s/it]
Testing prompts: 100%|██████████| 9/9 [01:33<00:00, 26.72s/it]
Testing prompts: 100%|██████████| 9/9 [01:33<00:00, 10.44s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.10it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.03s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.04it/s]
Testing prompts:  40%|████      | 4/10 [00:05<00:09,  1.65s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.32s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.24s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.40s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.29s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.27s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.19s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.25s/it]

Testing prompts:   0%|          | 0/18 [00:00<?, ?it/s]
Testing prompts:   6%|▌         | 1/18 [00:00<00:11,  1.44it/s]
Testing prompts:  11%|█         | 2/18 [00:01<00:10,  1.47it/s]
Testing prompts:  17%|█▋        | 3/18 [00:01<00:09,  1.56it/s]
Testing prompts:  22%|██▏       | 4/18 [00:02<00:09,  1.47it/s]
Testing prompts:  28%|██▊       | 5/18 [00:03<00:09,  1.35it/s]
Testing prompts:  33%|███▎      | 6/18 [00:04<00:09,  1.31it/s]
Testing prompts:  39%|███▉      | 7/18 [00:05<00:08,  1.28it/s]
Testing prompts:  44%|████▍     | 8/18 [00:05<00:07,  1.33it/s]
Testing prompts:  50%|█████     | 9/18 [00:07<00:08,  1.11it/s]
Testing prompts:  56%|█████▌    | 10/18 [00:07<00:06,  1.18it/s]
Testing prompts:  61%|██████    | 11/18 [00:08<00:05,  1.21it/s]
Testing prompts:  67%|██████▋   | 12/18 [00:09<00:04,  1.20it/s]
Testing prompts:  72%|███████▏  | 13/18 [00:10<00:04,  1.22it/s]
Testing prompts:  78%|███████▊  | 14/18 [00:11<00:04,  1.01s/it]
Testing prompts:  83%|████████▎ | 15/18 [00:14<00:04,  1.55s/it]
Testing prompts:  89%|████████▉ | 16/18 [00:17<00:03,  1.88s/it]
Testing prompts:  94%|█████████▍| 17/18 [00:19<00:02,  2.15s/it]
Testing prompts: 100%|██████████| 18/18 [00:21<00:00,  1.97s/it]
Testing prompts: 100%|██████████| 18/18 [00:21<00:00,  1.19s/it]

Testing prompts:   0%|          | 0/20 [00:00<?, ?it/s]
Testing prompts:   5%|▌         | 1/20 [00:00<00:11,  1.65it/s]
Testing prompts:  10%|█         | 2/20 [00:01<00:12,  1.45it/s]
Testing prompts:  15%|█▌        | 3/20 [00:02<00:12,  1.34it/s]
Testing prompts:  20%|██        | 4/20 [00:03<00:15,  1.03it/s]
Testing prompts:  25%|██▌       | 5/20 [00:04<00:14,  1.06it/s]
Testing prompts:  30%|███       | 6/20 [00:05<00:12,  1.10it/s]
Testing prompts:  35%|███▌      | 7/20 [00:05<00:10,  1.19it/s]
Testing prompts:  40%|████      | 8/20 [00:06<00:10,  1.14it/s]
Testing prompts:  45%|████▌     | 9/20 [00:08<00:12,  1.11s/it]
Testing prompts:  50%|█████     | 10/20 [00:09<00:09,  1.04it/s]
Testing prompts:  55%|█████▌    | 11/20 [00:10<00:09,  1.01s/it]
Testing prompts:  60%|██████    | 12/20 [00:11<00:08,  1.04s/it]
Testing prompts:  65%|██████▌   | 13/20 [00:12<00:07,  1.02s/it]
Testing prompts:  70%|███████   | 14/20 [00:14<00:07,  1.31s/it]
Testing prompts:  75%|███████▌  | 15/20 [00:15<00:07,  1.42s/it]
Testing prompts:  80%|████████  | 16/20 [00:17<00:05,  1.39s/it]
Testing prompts:  85%|████████▌ | 17/20 [00:18<00:04,  1.39s/it]
Testing prompts:  90%|█████████ | 18/20 [00:19<00:02,  1.34s/it]
Testing prompts:  95%|█████████▌| 19/20 [00:20<00:01,  1.24s/it]
Testing prompts: 100%|██████████| 20/20 [00:21<00:00,  1.16s/it]
Testing prompts: 100%|██████████| 20/20 [00:21<00:00,  1.09s/it]

Testing prompts:   0%|          | 0/12 [00:00<?, ?it/s]
Testing prompts:   8%|▊         | 1/12 [00:00<00:06,  1.76it/s]
Testing prompts:  17%|█▋        | 2/12 [00:01<00:07,  1.36it/s]
Testing prompts:  25%|██▌       | 3/12 [00:02<00:06,  1.40it/s]
Testing prompts:  33%|███▎      | 4/12 [00:02<00:06,  1.28it/s]
Testing prompts:  42%|████▏     | 5/12 [00:04<00:07,  1.01s/it]
Testing prompts:  50%|█████     | 6/12 [00:05<00:05,  1.09it/s]
Testing prompts:  58%|█████▊    | 7/12 [00:06<00:04,  1.01it/s]
Testing prompts:  67%|██████▋   | 8/12 [00:07<00:03,  1.06it/s]
Testing prompts:  75%|███████▌  | 9/12 [00:08<00:02,  1.02it/s]
Testing prompts:  83%|████████▎ | 10/12 [00:09<00:02,  1.17s/it]
Testing prompts:  92%|█████████▏| 11/12 [00:10<00:01,  1.12s/it]
Testing prompts: 100%|██████████| 12/12 [00:11<00:00,  1.09s/it]
Testing prompts: 100%|██████████| 12/12 [00:11<00:00,  1.02it/s]

Testing prompts:   0%|          | 0/20 [00:00<?, ?it/s]
Testing prompts:   5%|▌         | 1/20 [00:00<00:12,  1.56it/s]
Testing prompts:  10%|█         | 2/20 [00:01<00:13,  1.32it/s]
Testing prompts:  15%|█▌        | 3/20 [00:01<00:10,  1.59it/s]
Testing prompts:  20%|██        | 4/20 [00:02<00:10,  1.52it/s]
Testing prompts:  25%|██▌       | 5/20 [00:03<00:10,  1.37it/s]
Testing prompts:  30%|███       | 6/20 [00:04<00:11,  1.26it/s]
Testing prompts:  35%|███▌      | 7/20 [00:05<00:09,  1.31it/s]
Testing prompts:  40%|████      | 8/20 [00:05<00:09,  1.32it/s]
Testing prompts:  45%|████▌     | 9/20 [00:07<00:10,  1.08it/s]
Testing prompts:  50%|█████     | 10/20 [00:07<00:08,  1.16it/s]
Testing prompts:  55%|█████▌    | 11/20 [00:08<00:08,  1.12it/s]
Testing prompts:  60%|██████    | 12/20 [00:10<00:08,  1.05s/it]
Testing prompts:  65%|██████▌   | 13/20 [00:11<00:08,  1.18s/it]
Testing prompts:  70%|███████   | 14/20 [00:13<00:08,  1.34s/it]
Testing prompts:  75%|███████▌  | 15/20 [00:16<00:09,  1.85s/it]
Testing prompts:  80%|████████  | 16/20 [00:20<00:09,  2.36s/it]
Testing prompts:  85%|████████▌ | 17/20 [00:24<00:08,  2.92s/it]
Testing prompts:  90%|█████████ | 18/20 [00:27<00:05,  2.87s/it]
Testing prompts:  95%|█████████▌| 19/20 [00:29<00:02,  2.84s/it]
Testing prompts: 100%|██████████| 20/20 [00:32<00:00,  2.96s/it]
Testing prompts: 100%|██████████| 20/20 [00:32<00:00,  1.65s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:15,  1.72s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:11,  1.47s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:09,  1.31s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.12s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:05,  1.16s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.19s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:04,  1.65s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:03,  1.67s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.81s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.61s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.50s/it]

Testing prompts:   0%|          | 0/17 [00:00<?, ?it/s]
Testing prompts:   6%|▌         | 1/17 [00:00<00:08,  1.97it/s]
Testing prompts:  12%|█▏        | 2/17 [00:01<00:10,  1.43it/s]
Testing prompts:  18%|█▊        | 3/17 [00:01<00:09,  1.51it/s]
Testing prompts:  24%|██▎       | 4/17 [00:02<00:09,  1.43it/s]
Testing prompts:  29%|██▉       | 5/17 [00:03<00:09,  1.23it/s]
Testing prompts:  35%|███▌      | 6/17 [00:04<00:10,  1.07it/s]
Testing prompts:  41%|████      | 7/17 [00:05<00:08,  1.15it/s]
Testing prompts:  47%|████▋     | 8/17 [00:06<00:07,  1.20it/s]
Testing prompts:  53%|█████▎    | 9/17 [00:07<00:08,  1.07s/it]
Testing prompts:  59%|█████▉    | 10/17 [00:08<00:06,  1.02it/s]
Testing prompts:  65%|██████▍   | 11/17 [00:09<00:06,  1.04s/it]
Testing prompts:  71%|███████   | 12/17 [00:11<00:05,  1.11s/it]
Testing prompts:  76%|███████▋  | 13/17 [00:13<00:06,  1.57s/it]
Testing prompts:  82%|████████▏ | 14/17 [00:14<00:04,  1.36s/it]
Testing prompts:  88%|████████▊ | 15/17 [00:17<00:03,  1.81s/it]
Testing prompts:  94%|█████████▍| 16/17 [00:21<00:02,  2.41s/it]
Testing prompts: 100%|██████████| 17/17 [00:24<00:00,  2.65s/it]
Testing prompts: 100%|██████████| 17/17 [00:24<00:00,  1.45s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:21,  2.44s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:15,  1.98s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.75s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:10,  1.68s/it]
Testing prompts:  50%|█████     | 5/10 [00:09<00:08,  1.76s/it]
Testing prompts:  60%|██████    | 6/10 [00:10<00:06,  1.54s/it]
Testing prompts:  70%|███████   | 7/10 [00:12<00:05,  1.76s/it]
Testing prompts:  80%|████████  | 8/10 [00:14<00:03,  1.86s/it]
Testing prompts:  90%|█████████ | 9/10 [00:16<00:01,  1.94s/it]
Testing prompts: 100%|██████████| 10/10 [00:18<00:00,  1.93s/it]
Testing prompts: 100%|██████████| 10/10 [00:18<00:00,  1.85s/it]

Testing prompts:   0%|          | 0/16 [00:00<?, ?it/s]
Testing prompts:   6%|▋         | 1/16 [00:00<00:09,  1.53it/s]
Testing prompts:  12%|█▎        | 2/16 [00:01<00:10,  1.31it/s]
Testing prompts:  19%|█▉        | 3/16 [00:02<00:09,  1.30it/s]
Testing prompts:  25%|██▌       | 4/16 [00:03<00:09,  1.27it/s]
Testing prompts:  31%|███▏      | 5/16 [00:03<00:09,  1.20it/s]
Testing prompts:  38%|███▊      | 6/16 [00:04<00:07,  1.26it/s]
Testing prompts:  44%|████▍     | 7/16 [00:05<00:07,  1.25it/s]
Testing prompts:  50%|█████     | 8/16 [00:06<00:06,  1.22it/s]
Testing prompts:  56%|█████▋    | 9/16 [00:07<00:06,  1.03it/s]
Testing prompts:  62%|██████▎   | 10/16 [00:08<00:06,  1.01s/it]
Testing prompts:  69%|██████▉   | 11/16 [00:10<00:05,  1.12s/it]
Testing prompts:  75%|███████▌  | 12/16 [00:11<00:05,  1.25s/it]
Testing prompts:  81%|████████▏ | 13/16 [00:12<00:03,  1.17s/it]
Testing prompts:  88%|████████▊ | 14/16 [00:13<00:02,  1.17s/it]
Testing prompts:  94%|█████████▍| 15/16 [00:20<00:02,  2.71s/it]
Testing prompts: 100%|██████████| 16/16 [00:23<00:00,  2.98s/it]
Testing prompts: 100%|██████████| 16/16 [00:23<00:00,  1.48s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.10it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.01it/s]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.08s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.12s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:08,  1.69s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:06,  1.57s/it]
Testing prompts:  70%|███████   | 7/10 [00:12<00:06,  2.31s/it]
Testing prompts:  80%|████████  | 8/10 [00:18<00:07,  3.53s/it]
Testing prompts:  90%|█████████ | 9/10 [00:21<00:03,  3.43s/it]
Testing prompts: 100%|██████████| 10/10 [00:22<00:00,  2.71s/it]
Testing prompts: 100%|██████████| 10/10 [00:22<00:00,  2.27s/it]

Testing prompts:   0%|          | 0/22 [00:00<?, ?it/s]
Testing prompts:   5%|▍         | 1/22 [00:00<00:13,  1.56it/s]
Testing prompts:   9%|▉         | 2/22 [00:01<00:16,  1.22it/s]
Testing prompts:  14%|█▎        | 3/22 [00:02<00:15,  1.23it/s]
Testing prompts:  18%|█▊        | 4/22 [00:03<00:14,  1.25it/s]
Testing prompts:  23%|██▎       | 5/22 [00:04<00:15,  1.13it/s]
Testing prompts:  27%|██▋       | 6/22 [00:05<00:15,  1.05it/s]
Testing prompts:  32%|███▏      | 7/22 [00:06<00:13,  1.12it/s]
Testing prompts:  36%|███▋      | 8/22 [00:06<00:12,  1.11it/s]
Testing prompts:  41%|████      | 9/22 [00:08<00:12,  1.01it/s]
Testing prompts:  45%|████▌     | 10/22 [00:09<00:12,  1.05s/it]
Testing prompts:  50%|█████     | 11/22 [00:10<00:13,  1.23s/it]
Testing prompts:  55%|█████▍    | 12/22 [00:12<00:12,  1.26s/it]
Testing prompts:  59%|█████▉    | 13/22 [00:13<00:10,  1.17s/it]
Testing prompts:  64%|██████▎   | 14/22 [00:14<00:09,  1.13s/it]
Testing prompts:  68%|██████▊   | 15/22 [00:17<00:11,  1.71s/it]
Testing prompts:  73%|███████▎  | 16/22 [00:21<00:14,  2.39s/it]
Testing prompts:  77%|███████▋  | 17/22 [00:24<00:13,  2.76s/it]
Testing prompts:  82%|████████▏ | 18/22 [00:27<00:11,  2.84s/it]
Testing prompts:  86%|████████▋ | 19/22 [00:32<00:10,  3.49s/it]
Testing prompts:  91%|█████████ | 20/22 [00:36<00:06,  3.47s/it]
Testing prompts:  95%|█████████▌| 21/22 [00:39<00:03,  3.45s/it]
Testing prompts: 100%|██████████| 22/22 [00:43<00:00,  3.52s/it]
Testing prompts: 100%|██████████| 22/22 [00:43<00:00,  1.98s/it]

Testing prompts:   0%|          | 0/19 [00:00<?, ?it/s]
Testing prompts:   5%|▌         | 1/19 [00:00<00:11,  1.56it/s]
Testing prompts:  11%|█         | 2/19 [00:01<00:13,  1.29it/s]
Testing prompts:  16%|█▌        | 3/19 [00:02<00:11,  1.40it/s]
Testing prompts:  21%|██        | 4/19 [00:02<00:11,  1.32it/s]
Testing prompts:  26%|██▋       | 5/19 [00:03<00:10,  1.32it/s]
Testing prompts:  32%|███▏      | 6/19 [00:04<00:11,  1.14it/s]
Testing prompts:  37%|███▋      | 7/19 [00:05<00:10,  1.19it/s]
Testing prompts:  42%|████▏     | 8/19 [00:06<00:09,  1.18it/s]
Testing prompts:  47%|████▋     | 9/19 [00:08<00:12,  1.25s/it]
Testing prompts:  53%|█████▎    | 10/19 [00:09<00:09,  1.10s/it]
Testing prompts:  58%|█████▊    | 11/19 [00:10<00:08,  1.09s/it]
Testing prompts:  63%|██████▎   | 12/19 [00:12<00:08,  1.28s/it]
Testing prompts:  68%|██████▊   | 13/19 [00:13<00:07,  1.32s/it]
Testing prompts:  74%|███████▎  | 14/19 [00:14<00:06,  1.26s/it]
Testing prompts:  79%|███████▉  | 15/19 [00:18<00:08,  2.14s/it]
Testing prompts:  84%|████████▍ | 16/19 [00:22<00:07,  2.51s/it]
Testing prompts:  89%|████████▉ | 17/19 [00:25<00:05,  2.88s/it]
Testing prompts:  95%|█████████▍| 18/19 [00:29<00:02,  2.97s/it]
Testing prompts: 100%|██████████| 19/19 [00:33<00:00,  3.26s/it]
Testing prompts: 100%|██████████| 19/19 [00:33<00:00,  1.74s/it]

Testing prompts:   0%|          | 0/18 [00:00<?, ?it/s]
Testing prompts:   6%|▌         | 1/18 [00:00<00:16,  1.00it/s]
Testing prompts:  11%|█         | 2/18 [00:02<00:19,  1.19s/it]
Testing prompts:  17%|█▋        | 3/18 [00:03<00:15,  1.01s/it]
Testing prompts:  22%|██▏       | 4/18 [00:04<00:14,  1.04s/it]
Testing prompts:  28%|██▊       | 5/18 [00:05<00:12,  1.00it/s]
Testing prompts:  33%|███▎      | 6/18 [00:05<00:10,  1.10it/s]
Testing prompts:  39%|███▉      | 7/18 [00:06<00:10,  1.07it/s]
Testing prompts:  44%|████▍     | 8/18 [00:07<00:08,  1.14it/s]
Testing prompts:  50%|█████     | 9/18 [00:08<00:08,  1.07it/s]
Testing prompts:  56%|█████▌    | 10/18 [00:09<00:08,  1.03s/it]
Testing prompts:  61%|██████    | 11/18 [00:11<00:07,  1.11s/it]
Testing prompts:  67%|██████▋   | 12/18 [00:13<00:09,  1.61s/it]
Testing prompts:  72%|███████▏  | 13/18 [00:14<00:07,  1.41s/it]
Testing prompts:  78%|███████▊  | 14/18 [00:16<00:05,  1.49s/it]
Testing prompts:  83%|████████▎ | 15/18 [00:20<00:06,  2.15s/it]
Testing prompts:  89%|████████▉ | 16/18 [00:24<00:05,  2.71s/it]
Testing prompts:  94%|█████████▍| 17/18 [00:26<00:02,  2.47s/it]
Testing prompts: 100%|██████████| 18/18 [00:28<00:00,  2.44s/it]
Testing prompts: 100%|██████████| 18/18 [00:28<00:00,  1.59s/it]

Testing prompts:   0%|          | 0/18 [00:00<?, ?it/s]
Testing prompts:   6%|▌         | 1/18 [00:00<00:09,  1.84it/s]
Testing prompts:  11%|█         | 2/18 [00:01<00:16,  1.06s/it]
Testing prompts:  17%|█▋        | 3/18 [00:02<00:15,  1.03s/it]
Testing prompts:  22%|██▏       | 4/18 [00:03<00:12,  1.08it/s]
Testing prompts:  28%|██▊       | 5/18 [00:04<00:11,  1.14it/s]
Testing prompts:  33%|███▎      | 6/18 [00:05<00:10,  1.17it/s]
Testing prompts:  39%|███▉      | 7/18 [00:06<00:09,  1.21it/s]
Testing prompts:  44%|████▍     | 8/18 [00:07<00:08,  1.17it/s]
Testing prompts:  50%|█████     | 9/18 [00:09<00:11,  1.28s/it]
Testing prompts:  56%|█████▌    | 10/18 [00:10<00:09,  1.13s/it]
Testing prompts:  61%|██████    | 11/18 [00:11<00:08,  1.21s/it]
Testing prompts:  67%|██████▋   | 12/18 [00:12<00:07,  1.26s/it]
Testing prompts:  72%|███████▏  | 13/18 [00:13<00:05,  1.19s/it]
Testing prompts:  78%|███████▊  | 14/18 [00:15<00:04,  1.21s/it]
Testing prompts:  83%|████████▎ | 15/18 [00:18<00:05,  1.83s/it]
Testing prompts:  89%|████████▉ | 16/18 [00:22<00:05,  2.53s/it]
Testing prompts:  94%|█████████▍| 17/18 [00:24<00:02,  2.31s/it]
Testing prompts: 100%|██████████| 18/18 [00:26<00:00,  2.22s/it]
Testing prompts: 100%|██████████| 18/18 [00:26<00:00,  1.46s/it]

Testing prompts:   0%|          | 0/17 [00:00<?, ?it/s]
Testing prompts:   6%|▌         | 1/17 [00:00<00:09,  1.73it/s]
Testing prompts:  12%|█▏        | 2/17 [00:01<00:09,  1.54it/s]
Testing prompts:  18%|█▊        | 3/17 [00:02<00:10,  1.33it/s]
Testing prompts:  24%|██▎       | 4/17 [00:02<00:10,  1.28it/s]
Testing prompts:  29%|██▉       | 5/17 [00:04<00:10,  1.15it/s]
Testing prompts:  35%|███▌      | 6/17 [00:04<00:09,  1.13it/s]
Testing prompts:  41%|████      | 7/17 [00:05<00:08,  1.19it/s]
Testing prompts:  47%|████▋     | 8/17 [00:06<00:07,  1.23it/s]
Testing prompts:  53%|█████▎    | 9/17 [00:07<00:07,  1.08it/s]
Testing prompts:  59%|█████▉    | 10/17 [00:08<00:06,  1.08it/s]
Testing prompts:  65%|██████▍   | 11/17 [00:09<00:06,  1.08s/it]
Testing prompts:  71%|███████   | 12/17 [00:11<00:06,  1.20s/it]
Testing prompts:  76%|███████▋  | 13/17 [00:12<00:04,  1.11s/it]
Testing prompts:  82%|████████▏ | 14/17 [00:14<00:04,  1.39s/it]
Testing prompts:  88%|████████▊ | 15/17 [00:17<00:03,  1.94s/it]
Testing prompts:  94%|█████████▍| 16/17 [00:22<00:02,  2.76s/it]
Testing prompts: 100%|██████████| 17/17 [00:26<00:00,  3.12s/it]
Testing prompts: 100%|██████████| 17/17 [00:26<00:00,  1.54s/it]

Testing prompts:   0%|          | 0/17 [00:00<?, ?it/s]
Testing prompts:   6%|▌         | 1/17 [00:00<00:11,  1.39it/s]
Testing prompts:  12%|█▏        | 2/17 [00:01<00:10,  1.41it/s]
Testing prompts:  18%|█▊        | 3/17 [00:02<00:09,  1.44it/s]
Testing prompts:  24%|██▎       | 4/17 [00:02<00:08,  1.48it/s]
Testing prompts:  29%|██▉       | 5/17 [00:03<00:08,  1.37it/s]
Testing prompts:  35%|███▌      | 6/17 [00:04<00:09,  1.22it/s]
Testing prompts:  41%|████      | 7/17 [00:05<00:07,  1.29it/s]
Testing prompts:  47%|████▋     | 8/17 [00:05<00:06,  1.35it/s]
Testing prompts:  53%|█████▎    | 9/17 [00:07<00:06,  1.18it/s]
Testing prompts:  59%|█████▉    | 10/17 [00:07<00:06,  1.15it/s]
Testing prompts:  65%|██████▍   | 11/17 [00:08<00:05,  1.13it/s]
Testing prompts:  71%|███████   | 12/17 [00:10<00:05,  1.15s/it]
Testing prompts:  76%|███████▋  | 13/17 [00:11<00:04,  1.08s/it]
Testing prompts:  82%|████████▏ | 14/17 [00:12<00:03,  1.10s/it]
Testing prompts:  88%|████████▊ | 15/17 [00:16<00:03,  1.96s/it]
Testing prompts:  94%|█████████▍| 16/17 [00:21<00:02,  2.86s/it]
Testing prompts: 100%|██████████| 17/17 [00:24<00:00,  3.02s/it]
Testing prompts: 100%|██████████| 17/17 [00:24<00:00,  1.47s/it]

Testing prompts:   0%|          | 0/21 [00:00<?, ?it/s]
Testing prompts:   5%|▍         | 1/21 [00:00<00:11,  1.70it/s]
Testing prompts:  10%|▉         | 2/21 [00:01<00:13,  1.37it/s]
Testing prompts:  14%|█▍        | 3/21 [00:02<00:12,  1.49it/s]
Testing prompts:  19%|█▉        | 4/21 [00:02<00:12,  1.41it/s]
Testing prompts:  24%|██▍       | 5/21 [00:03<00:12,  1.26it/s]
Testing prompts:  29%|██▊       | 6/21 [00:04<00:12,  1.23it/s]
Testing prompts:  33%|███▎      | 7/21 [00:05<00:11,  1.26it/s]
Testing prompts:  38%|███▊      | 8/21 [00:06<00:10,  1.29it/s]
Testing prompts:  43%|████▎     | 9/21 [00:07<00:11,  1.00it/s]
Testing prompts:  48%|████▊     | 10/21 [00:08<00:10,  1.03it/s]
Testing prompts:  52%|█████▏    | 11/21 [00:09<00:09,  1.02it/s]
Testing prompts:  57%|█████▋    | 12/21 [00:11<00:10,  1.17s/it]
Testing prompts:  62%|██████▏   | 13/21 [00:11<00:08,  1.05s/it]
Testing prompts:  67%|██████▋   | 14/21 [00:13<00:09,  1.29s/it]
Testing prompts:  71%|███████▏  | 15/21 [00:18<00:13,  2.33s/it]
Testing prompts:  76%|███████▌  | 16/21 [00:21<00:12,  2.54s/it]
Testing prompts:  81%|████████  | 17/21 [00:23<00:09,  2.45s/it]
Testing prompts:  86%|████████▌ | 18/21 [00:27<00:08,  2.74s/it]
Testing prompts:  90%|█████████ | 19/21 [00:30<00:05,  2.85s/it]
Testing prompts:  95%|█████████▌| 20/21 [00:33<00:03,  3.09s/it]
Testing prompts: 100%|██████████| 21/21 [00:36<00:00,  3.09s/it]
Testing prompts: 100%|██████████| 21/21 [00:36<00:00,  1.76s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:11,  1.22s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.23s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.11s/it]
Testing prompts:  40%|████      | 4/10 [00:15<00:32,  5.37s/it]
Testing prompts:  50%|█████     | 5/10 [00:20<00:25,  5.18s/it]
Testing prompts:  60%|██████    | 6/10 [00:21<00:15,  3.95s/it]
Testing prompts:  70%|███████   | 7/10 [00:22<00:09,  3.07s/it]
Testing prompts:  80%|████████  | 8/10 [00:24<00:04,  2.45s/it]
Testing prompts:  90%|█████████ | 9/10 [00:27<00:02,  2.75s/it]
Testing prompts: 100%|██████████| 10/10 [00:29<00:00,  2.40s/it]
Testing prompts: 100%|██████████| 10/10 [00:29<00:00,  2.91s/it]

Testing prompts:   0%|          | 0/9 [00:00<?, ?it/s]
Testing prompts:  11%|█         | 1/9 [00:01<00:11,  1.38s/it]
Testing prompts:  22%|██▏       | 2/9 [00:03<00:10,  1.53s/it]
Testing prompts:  33%|███▎      | 3/9 [00:04<00:08,  1.34s/it]
Testing prompts:  44%|████▍     | 4/9 [00:05<00:06,  1.26s/it]
Testing prompts:  56%|█████▌    | 5/9 [00:09<00:08,  2.20s/it]
Testing prompts:  67%|██████▋   | 6/9 [00:11<00:07,  2.41s/it]
Testing prompts:  78%|███████▊  | 7/9 [00:13<00:04,  2.08s/it]
Testing prompts:  89%|████████▉ | 8/9 [00:15<00:01,  2.00s/it]
Testing prompts: 100%|██████████| 9/9 [01:53<00:00, 32.04s/it]
Testing prompts: 100%|██████████| 9/9 [01:53<00:00, 12.59s/it]

Testing prompts:   0%|          | 0/18 [00:00<?, ?it/s]
Testing prompts:   6%|▌         | 1/18 [00:00<00:10,  1.59it/s]
Testing prompts:  11%|█         | 2/18 [00:01<00:11,  1.37it/s]
Testing prompts:  17%|█▋        | 3/18 [00:02<00:10,  1.38it/s]
Testing prompts:  22%|██▏       | 4/18 [00:02<00:10,  1.37it/s]
Testing prompts:  28%|██▊       | 5/18 [00:03<00:09,  1.34it/s]
Testing prompts:  33%|███▎      | 6/18 [00:04<00:09,  1.33it/s]
Testing prompts:  39%|███▉      | 7/18 [00:04<00:07,  1.47it/s]
Testing prompts:  44%|████▍     | 8/18 [00:05<00:07,  1.41it/s]
Testing prompts:  50%|█████     | 9/18 [00:07<00:08,  1.10it/s]
Testing prompts:  56%|█████▌    | 10/18 [00:07<00:06,  1.15it/s]
Testing prompts:  61%|██████    | 11/18 [00:08<00:06,  1.16it/s]
Testing prompts:  67%|██████▋   | 12/18 [00:09<00:05,  1.20it/s]
Testing prompts:  72%|███████▏  | 13/18 [00:10<00:04,  1.12it/s]
Testing prompts:  78%|███████▊  | 14/18 [00:11<00:03,  1.10it/s]
Testing prompts:  83%|████████▎ | 15/18 [00:14<00:04,  1.65s/it]
Testing prompts:  89%|████████▉ | 16/18 [00:18<00:04,  2.24s/it]
Testing prompts:  94%|█████████▍| 17/18 [00:21<00:02,  2.43s/it]
Testing prompts: 100%|██████████| 18/18 [00:23<00:00,  2.22s/it]
Testing prompts: 100%|██████████| 18/18 [00:23<00:00,  1.28s/it]

Testing prompts:   0%|          | 0/7 [00:00<?, ?it/s]
Testing prompts:  14%|█▍        | 1/7 [00:00<00:04,  1.28it/s]
Testing prompts:  29%|██▊       | 2/7 [00:02<00:05,  1.17s/it]
Testing prompts:  43%|████▎     | 3/7 [00:03<00:04,  1.17s/it]
Testing prompts:  57%|█████▋    | 4/7 [00:04<00:03,  1.14s/it]
Testing prompts:  71%|███████▏  | 5/7 [00:07<00:03,  1.69s/it]
Testing prompts:  86%|████████▌ | 6/7 [00:08<00:01,  1.48s/it]
Testing prompts: 100%|██████████| 7/7 [01:42<00:00, 31.87s/it]
Testing prompts: 100%|██████████| 7/7 [01:42<00:00, 14.67s/it]

Testing prompts:   0%|          | 0/19 [00:00<?, ?it/s]
Testing prompts:   5%|▌         | 1/19 [00:00<00:11,  1.57it/s]
Testing prompts:  11%|█         | 2/19 [00:01<00:12,  1.38it/s]
Testing prompts:  16%|█▌        | 3/19 [00:02<00:11,  1.41it/s]
Testing prompts:  21%|██        | 4/19 [00:02<00:10,  1.44it/s]
Testing prompts:  26%|██▋       | 5/19 [00:03<00:10,  1.35it/s]
Testing prompts:  32%|███▏      | 6/19 [00:04<00:10,  1.27it/s]
Testing prompts:  37%|███▋      | 7/19 [00:05<00:08,  1.33it/s]
Testing prompts:  42%|████▏     | 8/19 [00:05<00:07,  1.39it/s]
Testing prompts:  47%|████▋     | 9/19 [00:07<00:08,  1.13it/s]
Testing prompts:  53%|█████▎    | 10/19 [00:07<00:07,  1.16it/s]
Testing prompts:  58%|█████▊    | 11/19 [00:09<00:08,  1.09s/it]
Testing prompts:  63%|██████▎   | 12/19 [00:10<00:07,  1.07s/it]
Testing prompts:  68%|██████▊   | 13/19 [00:11<00:06,  1.07s/it]
Testing prompts:  74%|███████▎  | 14/19 [00:12<00:05,  1.13s/it]
Testing prompts:  79%|███████▉  | 15/19 [00:17<00:08,  2.07s/it]
Testing prompts:  84%|████████▍ | 16/19 [00:20<00:07,  2.37s/it]
Testing prompts:  89%|████████▉ | 17/19 [00:23<00:05,  2.65s/it]
Testing prompts:  95%|█████████▍| 18/19 [00:26<00:02,  2.75s/it]
Testing prompts: 100%|██████████| 19/19 [00:29<00:00,  2.83s/it]
Testing prompts: 100%|██████████| 19/19 [00:29<00:00,  1.55s/it]

Testing prompts:   0%|          | 0/18 [00:00<?, ?it/s]
Testing prompts:   6%|▌         | 1/18 [00:00<00:10,  1.66it/s]
Testing prompts:  11%|█         | 2/18 [00:01<00:11,  1.44it/s]
Testing prompts:  17%|█▋        | 3/18 [00:01<00:09,  1.54it/s]
Testing prompts:  22%|██▏       | 4/18 [00:02<00:09,  1.43it/s]
Testing prompts:  28%|██▊       | 5/18 [00:04<00:12,  1.08it/s]
Testing prompts:  33%|███▎      | 6/18 [00:05<00:12,  1.04s/it]
Testing prompts:  39%|███▉      | 7/18 [00:06<00:10,  1.07it/s]
Testing prompts:  44%|████▍     | 8/18 [00:06<00:08,  1.15it/s]
Testing prompts:  50%|█████     | 9/18 [00:08<00:10,  1.15s/it]
Testing prompts:  56%|█████▌    | 10/18 [00:09<00:08,  1.06s/it]
Testing prompts:  61%|██████    | 11/18 [00:10<00:07,  1.06s/it]
Testing prompts:  67%|██████▋   | 12/18 [00:11<00:06,  1.15s/it]
Testing prompts:  72%|███████▏  | 13/18 [00:12<00:05,  1.16s/it]
Testing prompts:  78%|███████▊  | 14/18 [00:14<00:04,  1.12s/it]
Testing prompts:  83%|████████▎ | 15/18 [00:17<00:05,  1.76s/it]
Testing prompts:  89%|████████▉ | 16/18 [00:21<00:04,  2.43s/it]
Testing prompts:  94%|█████████▍| 17/18 [00:24<00:02,  2.66s/it]
Testing prompts: 100%|██████████| 18/18 [00:28<00:00,  3.16s/it]
Testing prompts: 100%|██████████| 18/18 [00:28<00:00,  1.60s/it]

Testing prompts:   0%|          | 0/15 [00:00<?, ?it/s]
Testing prompts:   7%|▋         | 1/15 [00:00<00:10,  1.39it/s]
Testing prompts:  13%|█▎        | 2/15 [00:01<00:09,  1.30it/s]
Testing prompts:  20%|██        | 3/15 [00:02<00:08,  1.39it/s]
Testing prompts:  27%|██▋       | 4/15 [00:02<00:08,  1.34it/s]
Testing prompts:  33%|███▎      | 5/15 [00:03<00:07,  1.38it/s]
Testing prompts:  40%|████      | 6/15 [00:04<00:06,  1.34it/s]
Testing prompts:  47%|████▋     | 7/15 [00:05<00:05,  1.37it/s]
Testing prompts:  53%|█████▎    | 8/15 [00:05<00:05,  1.39it/s]
Testing prompts:  60%|██████    | 9/15 [00:09<00:09,  1.56s/it]
Testing prompts:  67%|██████▋   | 10/15 [00:13<00:11,  2.27s/it]
Testing prompts:  73%|███████▎  | 11/15 [00:15<00:09,  2.44s/it]
Testing prompts:  80%|████████  | 12/15 [00:19<00:07,  2.65s/it]
Testing prompts:  87%|████████▋ | 13/15 [00:19<00:04,  2.12s/it]
Testing prompts:  93%|█████████▎| 14/15 [00:20<00:01,  1.79s/it]
Testing prompts: 100%|██████████| 15/15 [00:34<00:00,  5.31s/it]
Testing prompts: 100%|██████████| 15/15 [00:34<00:00,  2.30s/it]

Testing prompts:   0%|          | 0/17 [00:00<?, ?it/s]
Testing prompts:   6%|▌         | 1/17 [00:00<00:10,  1.59it/s]
Testing prompts:  12%|█▏        | 2/17 [00:01<00:13,  1.14it/s]
Testing prompts:  18%|█▊        | 3/17 [00:02<00:10,  1.31it/s]
Testing prompts:  24%|██▎       | 4/17 [00:03<00:10,  1.23it/s]
Testing prompts:  29%|██▉       | 5/17 [00:03<00:09,  1.32it/s]
Testing prompts:  35%|███▌      | 6/17 [00:04<00:08,  1.28it/s]
Testing prompts:  41%|████      | 7/17 [00:05<00:07,  1.31it/s]
Testing prompts:  47%|████▋     | 8/17 [00:06<00:06,  1.36it/s]
Testing prompts:  53%|█████▎    | 9/17 [00:07<00:06,  1.22it/s]
Testing prompts:  59%|█████▉    | 10/17 [00:07<00:05,  1.20it/s]
Testing prompts:  65%|██████▍   | 11/17 [00:09<00:05,  1.08it/s]
Testing prompts:  71%|███████   | 12/17 [00:10<00:05,  1.04s/it]
Testing prompts:  76%|███████▋  | 13/17 [00:11<00:04,  1.02s/it]
Testing prompts:  82%|████████▏ | 14/17 [00:12<00:03,  1.02s/it]
Testing prompts:  88%|████████▊ | 15/17 [00:15<00:03,  1.61s/it]
Testing prompts:  94%|█████████▍| 16/17 [00:18<00:02,  2.03s/it]
Testing prompts: 100%|██████████| 17/17 [00:21<00:00,  2.33s/it]
Testing prompts: 100%|██████████| 17/17 [00:21<00:00,  1.26s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.19it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.24s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.21s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:10,  1.77s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:07,  1.46s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.30s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:05,  1.81s/it]
Testing prompts:  80%|████████  | 8/10 [00:12<00:03,  1.84s/it]
Testing prompts:  90%|█████████ | 9/10 [00:15<00:02,  2.18s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  2.12s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  1.77s/it]

Testing prompts:   0%|          | 0/16 [00:00<?, ?it/s]
Testing prompts:   6%|▋         | 1/16 [00:00<00:09,  1.61it/s]
Testing prompts:  12%|█▎        | 2/16 [00:01<00:11,  1.19it/s]
Testing prompts:  19%|█▉        | 3/16 [00:02<00:11,  1.14it/s]
Testing prompts:  25%|██▌       | 4/16 [00:03<00:09,  1.32it/s]
Testing prompts:  31%|███▏      | 5/16 [00:03<00:08,  1.33it/s]
Testing prompts:  38%|███▊      | 6/16 [00:04<00:08,  1.20it/s]
Testing prompts:  44%|████▍     | 7/16 [00:05<00:06,  1.29it/s]
Testing prompts:  50%|█████     | 8/16 [00:06<00:05,  1.34it/s]
Testing prompts:  56%|█████▋    | 9/16 [00:07<00:06,  1.10it/s]
Testing prompts:  62%|██████▎   | 10/16 [00:08<00:05,  1.16it/s]
Testing prompts:  69%|██████▉   | 11/16 [00:09<00:04,  1.08it/s]
Testing prompts:  75%|███████▌  | 12/16 [00:10<00:04,  1.15s/it]
Testing prompts:  81%|████████▏ | 13/16 [00:11<00:03,  1.10s/it]
Testing prompts:  88%|████████▊ | 14/16 [00:14<00:03,  1.61s/it]
Testing prompts:  94%|█████████▍| 15/16 [00:17<00:02,  2.02s/it]
Testing prompts: 100%|██████████| 16/16 [00:21<00:00,  2.45s/it]
Testing prompts: 100%|██████████| 16/16 [00:21<00:00,  1.32s/it]

Testing prompts:   0%|          | 0/9 [00:00<?, ?it/s]
Testing prompts:  11%|█         | 1/9 [00:00<00:06,  1.26it/s]
Testing prompts:  22%|██▏       | 2/9 [00:01<00:06,  1.15it/s]
Testing prompts:  33%|███▎      | 3/9 [00:02<00:06,  1.01s/it]
Testing prompts:  44%|████▍     | 4/9 [00:04<00:05,  1.06s/it]
Testing prompts:  56%|█████▌    | 5/9 [00:06<00:06,  1.74s/it]
Testing prompts:  67%|██████▋   | 6/9 [00:10<00:06,  2.27s/it]
Testing prompts:  78%|███████▊  | 7/9 [00:11<00:03,  1.83s/it]
Testing prompts:  89%|████████▉ | 8/9 [00:12<00:01,  1.56s/it]
Testing prompts: 100%|██████████| 9/9 [01:43<00:00, 29.69s/it]
Testing prompts: 100%|██████████| 9/9 [01:43<00:00, 11.53s/it]
