[2025-05-11 10:14:47,078][INFO] Following apps/actions have missing dependencies
[2025-05-11 10:14:47,078][INFO] • CODE_ANALYSIS_TOOL_GET_RELEVANT_CODE: {'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0'}
[2025-05-11 10:14:47,078][INFO] • SQLTOOL_SQL_QUERY: {'sqlalchemy>=2.0'}
[2025-05-11 10:14:47,078][INFO] • CODE_ANALYSIS_TOOL_CREATE_CODE_MAP: {'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0'}
[2025-05-11 10:14:47,078][INFO] • CODE_ANALYSIS_TOOL_GET_METHOD_SIGNATURE: {'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0'}
[2025-05-11 10:14:47,078][INFO] • CODE_ANALYSIS_TOOL_GET_CLASS_INFO: {'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0'}
[2025-05-11 10:14:47,078][INFO] • CODE_ANALYSIS_TOOL_GET_METHOD_BODY: {'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0'}
[2025-05-11 10:14:47,078][INFO] Installing dependencies...
[2025-05-11 10:14:47,078][INFO] Installing git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 10:14:49,940][INFO] Installed git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi
[2025-05-11 10:14:49,940][INFO] Installing tokenizers>=0.19,<0.20
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 10:14:52,164][INFO] Installed tokenizers>=0.19,<0.20
[2025-05-11 10:14:52,164][INFO] Installing tree_sitter>=0.22.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 10:14:54,408][INFO] Installed tree_sitter>=0.22.0
[2025-05-11 10:14:54,408][INFO] Installing deeplake>3.9,<3.9.39
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 10:14:56,773][INFO] Installed deeplake>3.9,<3.9.39
[2025-05-11 10:14:56,773][INFO] Installing tree_sitter_python>=0.22.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 10:14:59,009][INFO] Installed tree_sitter_python>=0.22.0
[2025-05-11 10:14:59,009][INFO] Installing sqlalchemy>=2.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 10:15:01,245][INFO] Installed sqlalchemy>=2.0

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.06it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.07s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.03s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.46s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.27s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.34s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.20s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.18s/it]
Testing prompts:  90%|█████████ | 9/10 [00:10<00:01,  1.10s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.10s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.17s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.25it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.27it/s]
Testing prompts:  30%|███       | 3/10 [01:36<05:07, 43.88s/it]
Testing prompts:  40%|████      | 4/10 [01:37<02:41, 26.93s/it]
Testing prompts:  50%|█████     | 5/10 [01:38<01:28, 17.65s/it]
Testing prompts:  60%|██████    | 6/10 [01:39<00:47, 11.91s/it]
Testing prompts:  70%|███████   | 7/10 [01:40<00:25,  8.38s/it]
Testing prompts:  80%|████████  | 8/10 [01:41<00:11,  5.99s/it]
Testing prompts:  90%|█████████ | 9/10 [01:42<00:04,  4.30s/it]
Testing prompts: 100%|██████████| 10/10 [01:42<00:00,  3.15s/it]
Testing prompts: 100%|██████████| 10/10 [01:42<00:00, 10.28s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.38it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.18it/s]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.25s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.26s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.40s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.37s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.22s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.34s/it]
Testing prompts:  90%|█████████ | 9/10 [00:10<00:01,  1.16s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.24s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.23s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.73it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.30it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.15it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:06,  1.10s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:06,  1.23s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.12s/it]
Testing prompts:  70%|███████   | 7/10 [00:07<00:03,  1.09s/it]
Testing prompts:  80%|████████  | 8/10 [00:07<00:01,  1.05it/s]
Testing prompts:  90%|█████████ | 9/10 [00:08<00:00,  1.12it/s]
Testing prompts: 100%|██████████| 10/10 [00:09<00:00,  1.19it/s]
Testing prompts: 100%|██████████| 10/10 [00:09<00:00,  1.06it/s]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.86it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:05,  1.39it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.25it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:06,  1.01s/it]
Testing prompts:  50%|█████     | 5/10 [00:04<00:05,  1.02s/it]
Testing prompts:  60%|██████    | 6/10 [00:05<00:04,  1.05s/it]
Testing prompts:  70%|███████   | 7/10 [00:07<00:03,  1.13s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:03,  1.73s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.69s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.48s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.27s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.44it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:08,  1.01s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.10it/s]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.17s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:07,  1.50s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.28s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:05,  1.81s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:03,  1.60s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.66s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.49s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.42s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.93it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:05,  1.35it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.11it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:06,  1.04s/it]
Testing prompts:  50%|█████     | 5/10 [00:04<00:05,  1.00s/it]
Testing prompts:  60%|██████    | 6/10 [00:05<00:03,  1.08it/s]
Testing prompts:  70%|███████   | 7/10 [00:06<00:02,  1.03it/s]
Testing prompts:  80%|████████  | 8/10 [00:07<00:01,  1.03it/s]
Testing prompts:  90%|█████████ | 9/10 [00:08<00:01,  1.05s/it]
Testing prompts: 100%|██████████| 10/10 [00:09<00:00,  1.08s/it]
Testing prompts: 100%|██████████| 10/10 [00:09<00:00,  1.01it/s]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.23it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.05s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.12s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:08,  1.37s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.30s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.42s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.63s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.37s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.57s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.42s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.38s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.45it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.03it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.01it/s]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.13s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.06s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.17s/it]
Testing prompts:  70%|███████   | 7/10 [00:07<00:03,  1.16s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:03,  1.51s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.38s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.27s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.21s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.03it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.02s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.38s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.26s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.19s/it]
Testing prompts:  60%|██████    | 6/10 [00:37<00:46, 11.66s/it]
Testing prompts:  70%|███████   | 7/10 [00:38<00:24,  8.19s/it]
Testing prompts:  80%|████████  | 8/10 [00:39<00:11,  5.85s/it]
Testing prompts:  90%|█████████ | 9/10 [00:41<00:04,  4.47s/it]
Testing prompts: 100%|██████████| 10/10 [00:42<00:00,  3.43s/it]
Testing prompts: 100%|██████████| 10/10 [00:42<00:00,  4.24s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.44it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.09it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.12it/s]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.09s/it]
Testing prompts:  50%|█████     | 5/10 [00:04<00:05,  1.03s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.11s/it]
Testing prompts:  70%|███████   | 7/10 [00:07<00:03,  1.13s/it]
Testing prompts:  80%|████████  | 8/10 [00:08<00:02,  1.11s/it]
Testing prompts:  90%|█████████ | 9/10 [00:09<00:01,  1.01s/it]
Testing prompts: 100%|██████████| 10/10 [00:10<00:00,  1.19s/it]
Testing prompts: 100%|██████████| 10/10 [00:10<00:00,  1.08s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.44it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.28it/s]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.39s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.20s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.14s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.14s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.63s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:03,  1.67s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.50s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.30s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.31s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.37it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.06it/s]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.29s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:08,  1.34s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.18s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.31s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.28s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.19s/it]
Testing prompts:  90%|█████████ | 9/10 [00:10<00:01,  1.21s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.22s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.21s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.42it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.07s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.35s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:09,  1.62s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:07,  1.50s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.31s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.16s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.07s/it]
Testing prompts:  90%|█████████ | 9/10 [00:10<00:01,  1.05s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.09s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.19s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.03it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.06s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.01s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.03s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.18s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.39s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.18s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:03,  1.65s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.37s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  2.05s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.51s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.16it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.05s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.14s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.09s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.16s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.16s/it]
Testing prompts:  70%|███████   | 7/10 [00:07<00:03,  1.14s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.19s/it]
Testing prompts:  90%|█████████ | 9/10 [00:10<00:01,  1.13s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.31s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.18s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.23it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:08,  1.01s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.07s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:08,  1.34s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:06,  1.20s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.12s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:05,  1.71s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:03,  1.65s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.58s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.48s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.39s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.41it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:08,  1.00s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:12,  1.74s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:09,  1.60s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:07,  1.45s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.43s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:03,  1.23s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.24s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.16s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.31s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.32s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.06it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.03s/it]
Testing prompts:  30%|███       | 3/10 [01:32<04:54, 42.05s/it]
Testing prompts:  40%|████      | 4/10 [01:33<02:35, 25.86s/it]
Testing prompts:  50%|█████     | 5/10 [01:34<01:24, 16.88s/it]
Testing prompts:  60%|██████    | 6/10 [01:35<00:45, 11.45s/it]
Testing prompts:  70%|███████   | 7/10 [01:36<00:23,  7.98s/it]
Testing prompts:  80%|████████  | 8/10 [01:37<00:11,  5.77s/it]
Testing prompts:  90%|█████████ | 9/10 [01:38<00:04,  4.23s/it]
Testing prompts: 100%|██████████| 10/10 [01:39<00:00,  3.32s/it]
Testing prompts: 100%|██████████| 10/10 [01:39<00:00,  9.98s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.36it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:08,  1.03s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.05it/s]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.16s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.14s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.04s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.33s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:03,  1.60s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.70s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.53s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.34s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.23it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.10it/s]
Testing prompts:  30%|███       | 3/10 [00:05<00:14,  2.04s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:10,  1.82s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:07,  1.58s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:06,  1.56s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:04,  1.36s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:02,  1.35s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.41s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.22s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.40s/it]

Testing prompts:   0%|          | 0/6 [00:00<?, ?it/s]
Testing prompts:  17%|█▋        | 1/6 [00:00<00:02,  1.78it/s]
Testing prompts:  33%|███▎      | 2/6 [00:01<00:04,  1.06s/it]
Testing prompts:  50%|█████     | 3/6 [00:02<00:03,  1.04s/it]
Testing prompts:  67%|██████▋   | 4/6 [00:04<00:02,  1.03s/it]
Testing prompts:  83%|████████▎ | 5/6 [00:05<00:01,  1.02s/it]
Testing prompts: 100%|██████████| 6/6 [00:10<00:00,  2.65s/it]
Testing prompts: 100%|██████████| 6/6 [00:10<00:00,  1.80s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.38it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.27it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.33it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:05,  1.07it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:04,  1.13it/s]
Testing prompts:  60%|██████    | 6/10 [00:05<00:03,  1.06it/s]
Testing prompts:  70%|███████   | 7/10 [00:06<00:03,  1.14s/it]
Testing prompts:  80%|████████  | 8/10 [00:07<00:02,  1.12s/it]
Testing prompts:  90%|█████████ | 9/10 [00:09<00:01,  1.16s/it]
Testing prompts: 100%|██████████| 10/10 [00:10<00:00,  1.08s/it]
Testing prompts: 100%|██████████| 10/10 [00:10<00:00,  1.01s/it]

Testing prompts:   0%|          | 0/7 [00:00<?, ?it/s]
Testing prompts:  14%|█▍        | 1/7 [00:00<00:04,  1.43it/s]
Testing prompts:  29%|██▊       | 2/7 [00:01<00:04,  1.18it/s]
Testing prompts:  43%|████▎     | 3/7 [00:02<00:03,  1.11it/s]
Testing prompts:  57%|█████▋    | 4/7 [00:03<00:02,  1.26it/s]
Testing prompts:  71%|███████▏  | 5/7 [00:04<00:01,  1.24it/s]
Testing prompts:  86%|████████▌ | 6/7 [00:05<00:00,  1.03it/s]
Testing prompts: 100%|██████████| 7/7 [00:10<00:00,  2.39s/it]
Testing prompts: 100%|██████████| 7/7 [00:10<00:00,  1.53s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.48it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:05,  1.43it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:07,  1.11s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.17s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:06,  1.27s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.25s/it]
Testing prompts:  70%|███████   | 7/10 [00:07<00:03,  1.13s/it]
Testing prompts:  80%|████████  | 8/10 [00:08<00:02,  1.15s/it]
Testing prompts:  90%|█████████ | 9/10 [00:10<00:01,  1.39s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.20s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.17s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.59it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:08,  1.06s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.09s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.24s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.14s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.09s/it]
Testing prompts:  70%|███████   | 7/10 [00:07<00:03,  1.03s/it]
Testing prompts:  80%|████████  | 8/10 [00:08<00:01,  1.04it/s]
Testing prompts:  90%|█████████ | 9/10 [00:09<00:01,  1.09s/it]
Testing prompts: 100%|██████████| 10/10 [00:10<00:00,  1.01s/it]
Testing prompts: 100%|██████████| 10/10 [00:10<00:00,  1.05s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:11,  1.27s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.04s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.22s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:07,  1.33s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.26s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.33s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.16s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.12s/it]
Testing prompts:  90%|█████████ | 9/10 [00:10<00:01,  1.20s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.22s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.22s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.42it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.05it/s]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.34s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:09,  1.51s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.28s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.30s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.17s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.14s/it]
Testing prompts:  90%|█████████ | 9/10 [00:10<00:01,  1.03s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.01it/s]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.13s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.03it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.04s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.05it/s]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.02s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.11s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.12s/it]
Testing prompts:  70%|███████   | 7/10 [00:07<00:03,  1.04s/it]
Testing prompts:  80%|████████  | 8/10 [00:08<00:02,  1.02s/it]
Testing prompts:  90%|█████████ | 9/10 [00:09<00:01,  1.12s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.27s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.12s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:10,  1.12s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.09s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.18s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.18s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.14s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.21s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.28s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.24s/it]
Testing prompts:  90%|█████████ | 9/10 [00:10<00:01,  1.18s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.19s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.19s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.08it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.05s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.47s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:10,  1.75s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:08,  1.73s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:06,  1.63s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:04,  1.55s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:02,  1.43s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.25s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.43s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.46s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:09,  1.02s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.09s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.02s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.45s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.22s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.26s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.24s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.14s/it]
Testing prompts:  90%|█████████ | 9/10 [00:10<00:01,  1.09s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.30s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.22s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.48it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.37s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.20s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.24s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.13s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.10s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.24s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.15s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.47s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.33s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.25s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.07it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.01it/s]
Testing prompts:  30%|███       | 3/10 [02:07<06:44, 57.79s/it]
Testing prompts:  40%|████      | 4/10 [02:08<03:33, 35.51s/it]
Testing prompts:  50%|█████     | 5/10 [02:09<01:55, 23.02s/it]
Testing prompts:  60%|██████    | 6/10 [02:10<01:02, 15.58s/it]
Testing prompts:  70%|███████   | 7/10 [02:11<00:32, 10.85s/it]
Testing prompts:  80%|████████  | 8/10 [02:13<00:15,  7.77s/it]
Testing prompts:  90%|█████████ | 9/10 [02:15<00:06,  6.02s/it]
Testing prompts: 100%|██████████| 10/10 [02:16<00:00,  4.45s/it]
Testing prompts: 100%|██████████| 10/10 [02:16<00:00, 13.61s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.42it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.17it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.17it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:05,  1.14it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:04,  1.14it/s]
Testing prompts:  60%|██████    | 6/10 [00:05<00:03,  1.06it/s]
Testing prompts:  70%|███████   | 7/10 [00:06<00:02,  1.05it/s]
Testing prompts:  80%|████████  | 8/10 [00:07<00:02,  1.00s/it]
Testing prompts:  90%|█████████ | 9/10 [00:08<00:01,  1.03s/it]
Testing prompts: 100%|██████████| 10/10 [00:10<00:00,  1.31s/it]
Testing prompts: 100%|██████████| 10/10 [00:10<00:00,  1.05s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.37it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.30it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.16it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:05,  1.19it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:04,  1.21it/s]
Testing prompts:  60%|██████    | 6/10 [00:05<00:03,  1.08it/s]
Testing prompts:  70%|███████   | 7/10 [00:07<00:03,  1.28s/it]
Testing prompts:  80%|████████  | 8/10 [00:08<00:02,  1.27s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.68s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.90s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.35s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.50it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.06it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:07,  1.05s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.12s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.10s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.10s/it]
Testing prompts:  70%|███████   | 7/10 [00:07<00:02,  1.03it/s]
Testing prompts:  80%|████████  | 8/10 [00:08<00:01,  1.02it/s]
Testing prompts:  90%|█████████ | 9/10 [00:09<00:01,  1.24s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.32s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.14s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.03it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.02it/s]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.06s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.22s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.08s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.09s/it]
Testing prompts:  70%|███████   | 7/10 [00:07<00:03,  1.10s/it]
Testing prompts:  80%|████████  | 8/10 [00:08<00:02,  1.11s/it]
Testing prompts:  90%|█████████ | 9/10 [00:09<00:01,  1.02s/it]
Testing prompts: 100%|██████████| 10/10 [00:10<00:00,  1.01s/it]
Testing prompts: 100%|██████████| 10/10 [00:10<00:00,  1.06s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:10,  1.15s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:07,  1.01it/s]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.05s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.25s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:06,  1.21s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.16s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.54s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:03,  1.64s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.66s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.52s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.40s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.02it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.05it/s]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.10s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.12s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.39s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.31s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.10s/it]
Testing prompts:  80%|████████  | 8/10 [00:08<00:01,  1.03it/s]
Testing prompts:  90%|█████████ | 9/10 [00:09<00:00,  1.13it/s]
Testing prompts: 100%|██████████| 10/10 [00:10<00:00,  1.08s/it]
Testing prompts: 100%|██████████| 10/10 [00:10<00:00,  1.09s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:15,  1.74s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.17s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.06s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.08s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.35s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.21s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.17s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.44s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.52s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.27s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.28s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.06it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.02it/s]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.35s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.32s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:07,  1.49s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.38s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:03,  1.32s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.18s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.20s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.08s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.21s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.82it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.20it/s]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.19s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.17s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.00s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.01s/it]
Testing prompts:  70%|███████   | 7/10 [00:07<00:03,  1.19s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.32s/it]
Testing prompts:  90%|█████████ | 9/10 [00:10<00:01,  1.21s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.10s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.10s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.06it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.02s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.54s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.43s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:07,  1.51s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.46s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:05,  1.69s/it]
Testing prompts:  80%|████████  | 8/10 [00:12<00:03,  1.85s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.48s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.35s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.45s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.23it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.04it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.22it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:05,  1.15it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:04,  1.07it/s]
Testing prompts:  60%|██████    | 6/10 [00:05<00:03,  1.13it/s]
Testing prompts:  70%|███████   | 7/10 [00:06<00:02,  1.04it/s]
Testing prompts:  80%|████████  | 8/10 [00:07<00:01,  1.14it/s]
Testing prompts:  90%|█████████ | 9/10 [00:08<00:00,  1.11it/s]
Testing prompts: 100%|██████████| 10/10 [00:09<00:00,  1.02s/it]
Testing prompts: 100%|██████████| 10/10 [00:09<00:00,  1.07it/s]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.33it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.06it/s]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.05s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.23s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.00s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.24s/it]
Testing prompts:  70%|███████   | 7/10 [00:07<00:03,  1.20s/it]
Testing prompts:  80%|████████  | 8/10 [00:08<00:02,  1.15s/it]
Testing prompts:  90%|█████████ | 9/10 [00:09<00:01,  1.09s/it]
Testing prompts: 100%|██████████| 10/10 [00:10<00:00,  1.01s/it]
Testing prompts: 100%|██████████| 10/10 [00:10<00:00,  1.08s/it]
