[2025-05-11 10:04:19,530][INFO] Following apps/actions have missing dependencies
[2025-05-11 10:04:19,530][INFO] • CODE_ANALYSIS_TOOL_GET_RELEVANT_CODE: {'tree_sitter>=0.22.0', 'tree_sitter_python>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tokenizers>=0.19,<0.20', 'deeplake>3.9,<3.9.39'}
[2025-05-11 10:04:19,530][INFO] • SQLTOOL_SQL_QUERY: {'sqlalchemy>=2.0'}
[2025-05-11 10:04:19,530][INFO] • CODE_ANALYSIS_TOOL_CREATE_CODE_MAP: {'tree_sitter>=0.22.0', 'tree_sitter_python>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tokenizers>=0.19,<0.20', 'deeplake>3.9,<3.9.39'}
[2025-05-11 10:04:19,530][INFO] • CODE_ANALYSIS_TOOL_GET_METHOD_SIGNATURE: {'tree_sitter>=0.22.0', 'tree_sitter_python>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tokenizers>=0.19,<0.20', 'deeplake>3.9,<3.9.39'}
[2025-05-11 10:04:19,530][INFO] • CODE_ANALYSIS_TOOL_GET_CLASS_INFO: {'tree_sitter>=0.22.0', 'tree_sitter_python>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tokenizers>=0.19,<0.20', 'deeplake>3.9,<3.9.39'}
[2025-05-11 10:04:19,530][INFO] • CODE_ANALYSIS_TOOL_GET_METHOD_BODY: {'tree_sitter>=0.22.0', 'tree_sitter_python>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tokenizers>=0.19,<0.20', 'deeplake>3.9,<3.9.39'}
[2025-05-11 10:04:19,530][INFO] Installing dependencies...
[2025-05-11 10:04:19,530][INFO] Installing tree_sitter>=0.22.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 10:04:21,840][INFO] Installed tree_sitter>=0.22.0
[2025-05-11 10:04:21,840][INFO] Installing tree_sitter_python>=0.22.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 10:04:24,167][INFO] Installed tree_sitter_python>=0.22.0
[2025-05-11 10:04:24,167][INFO] Installing git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 10:04:27,119][INFO] Installed git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi
[2025-05-11 10:04:27,119][INFO] Installing tokenizers>=0.19,<0.20
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 10:04:29,428][INFO] Installed tokenizers>=0.19,<0.20
[2025-05-11 10:04:29,428][INFO] Installing deeplake>3.9,<3.9.39
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 10:04:31,873][INFO] Installed deeplake>3.9,<3.9.39
[2025-05-11 10:04:31,873][INFO] Installing sqlalchemy>=2.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 10:04:34,168][INFO] Installed sqlalchemy>=2.0

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.42it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:05,  1.46it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.18it/s]
Testing prompts:  40%|████      | 4/10 [00:15<00:34,  5.82s/it]
Testing prompts:  50%|█████     | 5/10 [00:16<00:20,  4.06s/it]
Testing prompts:  60%|██████    | 6/10 [00:17<00:11,  2.85s/it]
Testing prompts:  70%|███████   | 7/10 [00:17<00:06,  2.09s/it]
Testing prompts:  80%|████████  | 8/10 [00:19<00:03,  1.81s/it]
Testing prompts:  90%|█████████ | 9/10 [00:26<00:03,  3.63s/it]
Testing prompts: 100%|██████████| 10/10 [00:27<00:00,  2.78s/it]
Testing prompts: 100%|██████████| 10/10 [00:27<00:00,  2.75s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:09,  1.03s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.02s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.06it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.21it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:04,  1.14it/s]
Testing prompts:  60%|██████    | 6/10 [00:05<00:03,  1.14it/s]
Testing prompts:  70%|███████   | 7/10 [01:50<01:45, 35.03s/it]
Testing prompts:  80%|████████  | 8/10 [01:51<00:48, 24.22s/it]
Testing prompts:  90%|█████████ | 9/10 [01:52<00:16, 16.95s/it]
Testing prompts: 100%|██████████| 10/10 [01:58<00:00, 13.42s/it]
Testing prompts: 100%|██████████| 10/10 [01:58<00:00, 11.83s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.25it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.31it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.30it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:04,  1.38it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.48it/s]
Testing prompts:  60%|██████    | 6/10 [00:05<00:03,  1.05it/s]
Testing prompts:  70%|███████   | 7/10 [01:38<01:33, 31.23s/it]
Testing prompts:  80%|████████  | 8/10 [01:39<00:43, 21.52s/it]
Testing prompts:  90%|█████████ | 9/10 [01:40<00:15, 15.09s/it]
Testing prompts: 100%|██████████| 10/10 [01:47<00:00, 12.52s/it]
Testing prompts: 100%|██████████| 10/10 [01:47<00:00, 10.71s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:09,  1.10s/it]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.19it/s]
Testing prompts:  30%|███       | 3/10 [00:09<00:28,  4.04s/it]
Testing prompts:  40%|████      | 4/10 [00:10<00:16,  2.67s/it]
Testing prompts:  50%|█████     | 5/10 [00:10<00:09,  1.96s/it]
Testing prompts:  60%|██████    | 6/10 [00:25<00:25,  6.43s/it]
Testing prompts:  70%|███████   | 7/10 [00:34<00:21,  7.24s/it]
Testing prompts:  80%|████████  | 8/10 [00:36<00:10,  5.29s/it]
Testing prompts:  90%|█████████ | 9/10 [00:36<00:03,  3.90s/it]
Testing prompts: 100%|██████████| 10/10 [00:37<00:00,  2.93s/it]
Testing prompts: 100%|██████████| 10/10 [00:37<00:00,  3.76s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.19it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.14it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.22it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.33it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:04,  1.21it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:03,  1.28it/s]
Testing prompts:  70%|███████   | 7/10 [00:17<00:14,  4.84s/it]
Testing prompts:  80%|████████  | 8/10 [01:53<01:07, 33.59s/it]
Testing prompts:  90%|█████████ | 9/10 [01:54<00:23, 23.38s/it]
Testing prompts: 100%|██████████| 10/10 [01:55<00:00, 16.54s/it]
Testing prompts: 100%|██████████| 10/10 [01:55<00:00, 11.53s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.07it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.21it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.31it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:04,  1.41it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.51it/s]
Testing prompts:  60%|██████    | 6/10 [00:14<00:16,  4.18s/it]
Testing prompts:  70%|███████   | 7/10 [00:18<00:12,  4.14s/it]
Testing prompts:  80%|████████  | 8/10 [00:19<00:06,  3.07s/it]
Testing prompts:  90%|█████████ | 9/10 [00:20<00:02,  2.50s/it]
Testing prompts: 100%|██████████| 10/10 [00:21<00:00,  1.95s/it]
Testing prompts: 100%|██████████| 10/10 [00:21<00:00,  2.14s/it]

Testing prompts:   0%|          | 0/6 [00:00<?, ?it/s]
Testing prompts:  17%|█▋        | 1/6 [00:00<00:04,  1.21it/s]
Testing prompts:  33%|███▎      | 2/6 [00:01<00:03,  1.21it/s]
Testing prompts:  50%|█████     | 3/6 [00:02<00:02,  1.34it/s]
Testing prompts:  67%|██████▋   | 4/6 [00:06<00:04,  2.23s/it]
Testing prompts:  83%|████████▎ | 5/6 [00:18<00:05,  5.58s/it]
Testing prompts: 100%|██████████| 6/6 [01:49<00:00, 34.60s/it]
Testing prompts: 100%|██████████| 6/6 [01:49<00:00, 18.21s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.20it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.28it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.14it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.23it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.33it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.36it/s]
Testing prompts:  70%|███████   | 7/10 [01:44<01:39, 33.10s/it]
Testing prompts:  80%|████████  | 8/10 [01:45<00:45, 22.82s/it]
Testing prompts:  90%|█████████ | 9/10 [01:46<00:15, 16.00s/it]
Testing prompts: 100%|██████████| 10/10 [01:53<00:00, 13.29s/it]
Testing prompts: 100%|██████████| 10/10 [01:53<00:00, 11.34s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.10it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.18it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.28it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.27it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.38it/s]
Testing prompts:  60%|██████    | 6/10 [00:20<00:23,  5.98s/it]
Testing prompts:  70%|███████   | 7/10 [00:20<00:12,  4.27s/it]
Testing prompts:  80%|████████  | 8/10 [00:21<00:06,  3.16s/it]
Testing prompts:  90%|█████████ | 9/10 [00:22<00:02,  2.42s/it]
Testing prompts: 100%|██████████| 10/10 [00:29<00:00,  3.93s/it]
Testing prompts: 100%|██████████| 10/10 [00:29<00:00,  2.96s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.31it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.33it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.30it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:04,  1.37it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.29it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.36it/s]
Testing prompts:  70%|███████   | 7/10 [00:18<00:15,  5.04s/it]
Testing prompts:  80%|████████  | 8/10 [00:31<00:15,  7.54s/it]
Testing prompts:  90%|█████████ | 9/10 [00:32<00:05,  5.54s/it]
Testing prompts: 100%|██████████| 10/10 [00:37<00:00,  5.29s/it]
Testing prompts: 100%|██████████| 10/10 [00:37<00:00,  3.72s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:14,  1.57s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.09s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:06,  1.03it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:05,  1.12it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:04,  1.17it/s]
Testing prompts:  60%|██████    | 6/10 [00:05<00:03,  1.20it/s]
Testing prompts:  70%|███████   | 7/10 [01:38<01:33, 31.12s/it]
Testing prompts:  80%|████████  | 8/10 [01:39<00:42, 21.49s/it]
Testing prompts:  90%|█████████ | 9/10 [01:40<00:14, 15.00s/it]
Testing prompts: 100%|██████████| 10/10 [01:43<00:00, 11.17s/it]
Testing prompts: 100%|██████████| 10/10 [01:43<00:00, 10.32s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.06it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:08,  1.01s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.21it/s]
Testing prompts:  40%|████      | 4/10 [00:15<00:34,  5.73s/it]
Testing prompts:  50%|█████     | 5/10 [00:16<00:19,  3.87s/it]
Testing prompts:  60%|██████    | 6/10 [00:17<00:11,  2.77s/it]
Testing prompts:  70%|███████   | 7/10 [00:17<00:06,  2.14s/it]
Testing prompts:  80%|████████  | 8/10 [00:18<00:03,  1.70s/it]
Testing prompts:  90%|█████████ | 9/10 [00:19<00:01,  1.40s/it]
Testing prompts: 100%|██████████| 10/10 [00:22<00:00,  2.05s/it]
Testing prompts: 100%|██████████| 10/10 [00:22<00:00,  2.29s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.41it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.31it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.35it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.24it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.35it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:03,  1.20it/s]
Testing prompts:  70%|███████   | 7/10 [01:35<01:30, 30.23s/it]
Testing prompts:  80%|████████  | 8/10 [01:36<00:41, 20.89s/it]
Testing prompts:  90%|█████████ | 9/10 [01:37<00:14, 14.66s/it]
Testing prompts: 100%|██████████| 10/10 [01:41<00:00, 11.51s/it]
Testing prompts: 100%|██████████| 10/10 [01:41<00:00, 10.18s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.25it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.19it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.18it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:05,  1.09it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:04,  1.12it/s]
Testing prompts:  60%|██████    | 6/10 [00:05<00:03,  1.25it/s]
Testing prompts:  70%|███████   | 7/10 [00:12<00:09,  3.06s/it]
Testing prompts:  80%|████████  | 8/10 [00:16<00:06,  3.38s/it]
Testing prompts:  90%|█████████ | 9/10 [00:17<00:02,  2.58s/it]
Testing prompts: 100%|██████████| 10/10 [00:18<00:00,  2.00s/it]
Testing prompts: 100%|██████████| 10/10 [00:18<00:00,  1.83s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:06,  1.53s/it]
Testing prompts:  40%|████      | 2/5 [00:02<00:03,  1.14s/it]
Testing prompts:  60%|██████    | 3/5 [00:03<00:01,  1.04it/s]
Testing prompts:  80%|████████  | 4/5 [00:09<00:03,  3.02s/it]
Testing prompts: 100%|██████████| 5/5 [00:19<00:00,  5.62s/it]
Testing prompts: 100%|██████████| 5/5 [00:19<00:00,  3.91s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.08it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.19it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.19it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.31it/s]
Testing prompts:  50%|█████     | 5/10 [00:15<00:24,  4.98s/it]
Testing prompts:  60%|██████    | 6/10 [00:16<00:13,  3.50s/it]
Testing prompts:  70%|███████   | 7/10 [00:16<00:07,  2.57s/it]
Testing prompts:  80%|████████  | 8/10 [00:22<00:07,  3.52s/it]
Testing prompts:  90%|█████████ | 9/10 [00:23<00:02,  2.70s/it]
Testing prompts: 100%|██████████| 10/10 [00:24<00:00,  2.11s/it]
Testing prompts: 100%|██████████| 10/10 [00:24<00:00,  2.42s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.22it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.18s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.06s/it]
Testing prompts:  40%|████      | 4/10 [00:03<00:05,  1.10it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:03,  1.26it/s]
Testing prompts:  60%|██████    | 6/10 [00:05<00:03,  1.31it/s]
Testing prompts:  70%|███████   | 7/10 [00:08<00:04,  1.66s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.47s/it]
Testing prompts:  90%|█████████ | 9/10 [00:42<00:11, 11.18s/it]
Testing prompts: 100%|██████████| 10/10 [00:42<00:00,  7.92s/it]
Testing prompts: 100%|██████████| 10/10 [00:42<00:00,  4.29s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.16it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.32s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.10s/it]
Testing prompts:  40%|████      | 4/10 [00:03<00:05,  1.08it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:04,  1.11it/s]
Testing prompts:  60%|██████    | 6/10 [00:05<00:03,  1.04it/s]
Testing prompts:  70%|███████   | 7/10 [00:18<00:14,  4.79s/it]
Testing prompts:  80%|████████  | 8/10 [00:24<00:10,  5.08s/it]
Testing prompts:  90%|█████████ | 9/10 [00:25<00:03,  3.73s/it]
Testing prompts: 100%|██████████| 10/10 [00:25<00:00,  2.81s/it]
Testing prompts: 100%|██████████| 10/10 [00:25<00:00,  2.58s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.22it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.17it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.17it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:05,  1.17it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:04,  1.21it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:03,  1.31it/s]
Testing prompts:  70%|███████   | 7/10 [01:36<01:31, 30.57s/it]
Testing prompts:  80%|████████  | 8/10 [01:37<00:42, 21.17s/it]
Testing prompts:  90%|█████████ | 9/10 [01:38<00:14, 14.85s/it]
Testing prompts: 100%|██████████| 10/10 [01:45<00:00, 12.29s/it]
Testing prompts: 100%|██████████| 10/10 [01:45<00:00, 10.53s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.12it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.22it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.19it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:05,  1.19it/s]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.14s/it]
Testing prompts:  60%|██████    | 6/10 [00:05<00:04,  1.03s/it]
Testing prompts:  70%|███████   | 7/10 [00:20<00:16,  5.44s/it]
Testing prompts:  80%|████████  | 8/10 [00:25<00:10,  5.23s/it]
Testing prompts:  90%|█████████ | 9/10 [00:26<00:03,  3.89s/it]
Testing prompts: 100%|██████████| 10/10 [00:30<00:00,  4.17s/it]
Testing prompts: 100%|██████████| 10/10 [00:30<00:00,  3.09s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.39it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:05,  1.34it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.38it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:04,  1.46it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.53it/s]
Testing prompts:  60%|██████    | 6/10 [00:03<00:02,  1.59it/s]
Testing prompts:  70%|███████   | 7/10 [00:18<00:15,  5.28s/it]
Testing prompts:  80%|████████  | 8/10 [00:23<00:10,  5.23s/it]
Testing prompts:  90%|█████████ | 9/10 [00:24<00:03,  3.88s/it]
Testing prompts: 100%|██████████| 10/10 [00:25<00:00,  2.94s/it]
Testing prompts: 100%|██████████| 10/10 [00:25<00:00,  2.57s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:09,  1.02s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.06s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.12it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:05,  1.07it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:04,  1.17it/s]
Testing prompts:  60%|██████    | 6/10 [00:05<00:03,  1.24it/s]
Testing prompts:  70%|███████   | 7/10 [01:36<01:30, 30.30s/it]
Testing prompts:  80%|████████  | 8/10 [01:37<00:41, 20.91s/it]
Testing prompts:  90%|█████████ | 9/10 [01:38<00:14, 14.83s/it]
Testing prompts: 100%|██████████| 10/10 [01:41<00:00, 11.30s/it]
Testing prompts: 100%|██████████| 10/10 [01:41<00:00, 10.19s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:10,  1.20s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.11s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.07it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.28it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:03,  1.43it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.48it/s]
Testing prompts:  70%|███████   | 7/10 [01:32<01:27, 29.16s/it]
Testing prompts:  80%|████████  | 8/10 [01:33<00:40, 20.11s/it]
Testing prompts:  90%|█████████ | 9/10 [01:34<00:14, 14.21s/it]
Testing prompts: 100%|██████████| 10/10 [01:39<00:00, 11.51s/it]
Testing prompts: 100%|██████████| 10/10 [01:39<00:00,  9.99s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.25it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.22it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.08it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.25it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.36it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:03,  1.27it/s]
Testing prompts:  70%|███████   | 7/10 [01:40<01:35, 31.73s/it]
Testing prompts:  80%|████████  | 8/10 [01:42<00:44, 22.30s/it]
Testing prompts:  90%|█████████ | 9/10 [01:43<00:15, 15.84s/it]
Testing prompts: 100%|██████████| 10/10 [01:45<00:00, 11.49s/it]
Testing prompts: 100%|██████████| 10/10 [01:45<00:00, 10.57s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.16it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:12,  1.53s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.26s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.11s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:04,  1.07it/s]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.10s/it]
Testing prompts:  70%|███████   | 7/10 [01:46<01:40, 33.49s/it]
Testing prompts:  80%|████████  | 8/10 [03:14<01:41, 50.74s/it]
Testing prompts:  90%|█████████ | 9/10 [03:26<00:38, 38.62s/it]
Testing prompts: 100%|██████████| 10/10 [03:37<00:00, 30.09s/it]
Testing prompts: 100%|██████████| 10/10 [03:37<00:00, 21.75s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.16it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.19it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.20it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.21it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:03,  1.28it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:03,  1.23it/s]
Testing prompts:  70%|███████   | 7/10 [01:45<01:40, 33.35s/it]
Testing prompts:  80%|████████  | 8/10 [01:46<00:45, 22.99s/it]
Testing prompts:  90%|█████████ | 9/10 [01:46<00:16, 16.07s/it]
Testing prompts: 100%|██████████| 10/10 [01:48<00:00, 11.45s/it]
Testing prompts: 100%|██████████| 10/10 [01:48<00:00, 10.80s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.34it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.33it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.38it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:04,  1.49it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.61it/s]
Testing prompts:  60%|██████    | 6/10 [00:03<00:02,  1.64it/s]
Testing prompts:  70%|███████   | 7/10 [01:27<01:23, 27.83s/it]
Testing prompts:  80%|████████  | 8/10 [01:28<00:38, 19.21s/it]
Testing prompts:  90%|█████████ | 9/10 [01:29<00:13, 13.53s/it]
Testing prompts: 100%|██████████| 10/10 [01:36<00:00, 11.63s/it]
Testing prompts: 100%|██████████| 10/10 [01:36<00:00,  9.70s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.54it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:05,  1.48it/s]
Testing prompts:  30%|███       | 3/10 [00:01<00:04,  1.56it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:03,  1.60it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.62it/s]
Testing prompts:  60%|██████    | 6/10 [00:03<00:02,  1.56it/s]
Testing prompts:  70%|███████   | 7/10 [01:33<01:29, 29.71s/it]
Testing prompts:  80%|████████  | 8/10 [01:34<00:41, 20.50s/it]
Testing prompts:  90%|█████████ | 9/10 [01:35<00:14, 14.38s/it]
Testing prompts: 100%|██████████| 10/10 [01:41<00:00, 11.96s/it]
Testing prompts: 100%|██████████| 10/10 [01:41<00:00, 10.16s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.10it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.24it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.20it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.32it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.42it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.53it/s]
Testing prompts:  70%|███████   | 7/10 [01:33<01:28, 29.64s/it]
Testing prompts:  80%|████████  | 8/10 [01:34<00:40, 20.45s/it]
Testing prompts:  90%|█████████ | 9/10 [01:35<00:14, 14.37s/it]
Testing prompts: 100%|██████████| 10/10 [01:39<00:00, 11.26s/it]
Testing prompts: 100%|██████████| 10/10 [01:39<00:00,  9.97s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.35s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:07,  1.05it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.20it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.40it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:04,  1.19it/s]
Testing prompts:  60%|██████    | 6/10 [00:15<00:17,  4.46s/it]
Testing prompts:  70%|███████   | 7/10 [00:20<00:13,  4.43s/it]
Testing prompts:  80%|████████  | 8/10 [00:20<00:06,  3.25s/it]
Testing prompts:  90%|█████████ | 9/10 [00:21<00:02,  2.47s/it]
Testing prompts: 100%|██████████| 10/10 [00:22<00:00,  1.95s/it]
Testing prompts: 100%|██████████| 10/10 [00:22<00:00,  2.24s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.07it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.21it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.33it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:06,  1.04s/it]
Testing prompts:  50%|█████     | 5/10 [00:04<00:04,  1.07it/s]
Testing prompts:  60%|██████    | 6/10 [00:05<00:03,  1.27it/s]
Testing prompts:  70%|███████   | 7/10 [00:19<00:15,  5.13s/it]
Testing prompts:  80%|████████  | 8/10 [00:20<00:07,  3.78s/it]
Testing prompts:  90%|█████████ | 9/10 [00:54<00:13, 13.45s/it]
Testing prompts: 100%|██████████| 10/10 [02:37<00:00, 40.96s/it]
Testing prompts: 100%|██████████| 10/10 [02:37<00:00, 15.73s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.00it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.04it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.07it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.26it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:03,  1.38it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.42it/s]
Testing prompts:  70%|███████   | 7/10 [01:25<01:20, 26.87s/it]
Testing prompts:  80%|████████  | 8/10 [01:26<00:37, 18.54s/it]
Testing prompts:  90%|█████████ | 9/10 [01:27<00:13, 13.02s/it]
Testing prompts: 100%|██████████| 10/10 [01:34<00:00, 11.44s/it]
Testing prompts: 100%|██████████| 10/10 [01:34<00:00,  9.49s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.39it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:05,  1.36it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.35it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:04,  1.47it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.36it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:03,  1.18it/s]
Testing prompts:  70%|███████   | 7/10 [01:36<01:31, 30.44s/it]
Testing prompts:  80%|████████  | 8/10 [01:36<00:41, 20.98s/it]
Testing prompts:  90%|█████████ | 9/10 [01:38<00:14, 14.81s/it]
Testing prompts: 100%|██████████| 10/10 [01:39<00:00, 10.70s/it]
Testing prompts: 100%|██████████| 10/10 [01:39<00:00,  9.95s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:15,  1.77s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.22s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:06,  1.00it/s]
Testing prompts:  40%|████      | 4/10 [00:04<00:05,  1.13it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:04,  1.24it/s]
Testing prompts:  60%|██████    | 6/10 [00:05<00:03,  1.28it/s]
Testing prompts:  70%|███████   | 7/10 [00:15<00:11,  3.96s/it]
Testing prompts:  80%|████████  | 8/10 [00:28<00:13,  6.80s/it]
Testing prompts:  90%|█████████ | 9/10 [00:34<00:06,  6.39s/it]
Testing prompts: 100%|██████████| 10/10 [00:35<00:00,  4.65s/it]
Testing prompts: 100%|██████████| 10/10 [00:35<00:00,  3.51s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.52it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:05,  1.44it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.40it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:04,  1.49it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.40it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.47it/s]
Testing prompts:  70%|███████   | 7/10 [01:28<01:24, 28.14s/it]
Testing prompts:  80%|████████  | 8/10 [01:29<00:38, 19.39s/it]
Testing prompts:  90%|█████████ | 9/10 [01:30<00:13, 13.59s/it]
Testing prompts: 100%|██████████| 10/10 [01:36<00:00, 11.37s/it]
Testing prompts: 100%|██████████| 10/10 [01:36<00:00,  9.67s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.41it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.33it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.30it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.30it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.42it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.42it/s]
Testing prompts:  70%|███████   | 7/10 [00:20<00:16,  5.64s/it]
Testing prompts:  80%|████████  | 8/10 [00:34<00:16,  8.29s/it]
Testing prompts:  90%|█████████ | 9/10 [00:34<00:05,  5.94s/it]
Testing prompts: 100%|██████████| 10/10 [00:35<00:00,  4.33s/it]
Testing prompts: 100%|██████████| 10/10 [00:35<00:00,  3.56s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.29it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.19it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.23it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:04,  1.41it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.53it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.58it/s]
Testing prompts:  70%|███████   | 7/10 [01:41<01:36, 32.27s/it]
Testing prompts:  80%|████████  | 8/10 [01:42<00:44, 22.29s/it]
Testing prompts:  90%|█████████ | 9/10 [01:43<00:15, 15.65s/it]
Testing prompts: 100%|██████████| 10/10 [01:44<00:00, 11.20s/it]
Testing prompts: 100%|██████████| 10/10 [01:44<00:00, 10.48s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.26it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.31it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.17it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.26it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.34it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.46it/s]
Testing prompts:  70%|███████   | 7/10 [00:05<00:02,  1.46it/s]
Testing prompts:  80%|████████  | 8/10 [00:05<00:01,  1.54it/s]
Testing prompts:  90%|█████████ | 9/10 [00:06<00:00,  1.24it/s]
Testing prompts: 100%|██████████| 10/10 [01:42<00:00, 30.23s/it]
Testing prompts: 100%|██████████| 10/10 [01:42<00:00, 10.29s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.28it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:05,  1.41it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:04,  1.46it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:04,  1.44it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.52it/s]
Testing prompts:  60%|██████    | 6/10 [00:03<00:02,  1.59it/s]
Testing prompts:  70%|███████   | 7/10 [00:18<00:15,  5.05s/it]
Testing prompts:  80%|████████  | 8/10 [00:28<00:13,  6.78s/it]
Testing prompts:  90%|█████████ | 9/10 [00:29<00:04,  4.90s/it]
Testing prompts: 100%|██████████| 10/10 [00:34<00:00,  5.07s/it]
Testing prompts: 100%|██████████| 10/10 [00:34<00:00,  3.48s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:11,  1.29s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:07,  1.03it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.14it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:05,  1.19it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:03,  1.34it/s]
Testing prompts:  60%|██████    | 6/10 [00:19<00:22,  5.54s/it]
Testing prompts:  70%|███████   | 7/10 [00:23<00:15,  5.29s/it]
Testing prompts:  80%|████████  | 8/10 [00:24<00:07,  3.93s/it]
Testing prompts:  90%|█████████ | 9/10 [00:25<00:02,  2.89s/it]
Testing prompts: 100%|██████████| 10/10 [00:26<00:00,  2.19s/it]
Testing prompts: 100%|██████████| 10/10 [00:26<00:00,  2.60s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.05it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.18it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.36it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:04,  1.46it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.46it/s]
Testing prompts:  60%|██████    | 6/10 [00:15<00:17,  4.50s/it]
Testing prompts:  70%|███████   | 7/10 [00:16<00:10,  3.36s/it]
Testing prompts:  80%|████████  | 8/10 [00:22<00:08,  4.28s/it]
Testing prompts:  90%|█████████ | 9/10 [00:23<00:03,  3.19s/it]
Testing prompts: 100%|██████████| 10/10 [00:24<00:00,  2.44s/it]
Testing prompts: 100%|██████████| 10/10 [00:24<00:00,  2.43s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.46it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:05,  1.36it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.37it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:03,  1.53it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.60it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.38it/s]
Testing prompts:  70%|███████   | 7/10 [00:13<00:10,  3.58s/it]
Testing prompts:  80%|████████  | 8/10 [00:21<00:10,  5.03s/it]
Testing prompts:  90%|█████████ | 9/10 [00:22<00:03,  3.66s/it]
Testing prompts: 100%|██████████| 10/10 [00:23<00:00,  2.78s/it]
Testing prompts: 100%|██████████| 10/10 [00:23<00:00,  2.33s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.08it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.21it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.30it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.32it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.43it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.45it/s]
Testing prompts:  70%|███████   | 7/10 [00:14<00:11,  3.89s/it]
Testing prompts:  80%|████████  | 8/10 [00:25<00:12,  6.17s/it]
Testing prompts:  90%|█████████ | 9/10 [00:28<00:04,  4.91s/it]
Testing prompts: 100%|██████████| 10/10 [00:28<00:00,  3.61s/it]
Testing prompts: 100%|██████████| 10/10 [00:28<00:00,  2.88s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.10it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.19it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.25it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:04,  1.43it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.46it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.43it/s]
Testing prompts:  70%|███████   | 7/10 [01:29<01:24, 28.27s/it]
Testing prompts:  80%|████████  | 8/10 [01:30<00:39, 19.57s/it]
Testing prompts:  90%|█████████ | 9/10 [01:31<00:13, 13.78s/it]
Testing prompts: 100%|██████████| 10/10 [01:34<00:00, 10.47s/it]
Testing prompts: 100%|██████████| 10/10 [01:34<00:00,  9.45s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.27it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:05,  1.38it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.36it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:04,  1.44it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.55it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.58it/s]
Testing prompts:  70%|███████   | 7/10 [01:46<01:41, 33.96s/it]
Testing prompts:  80%|████████  | 8/10 [01:47<00:46, 23.36s/it]
Testing prompts:  90%|█████████ | 9/10 [01:48<00:16, 16.44s/it]
Testing prompts: 100%|██████████| 10/10 [01:53<00:00, 12.97s/it]
Testing prompts: 100%|██████████| 10/10 [01:53<00:00, 11.37s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.20it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.30it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.36it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:03,  1.54it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.57it/s]
Testing prompts:  60%|██████    | 6/10 [00:03<00:02,  1.60it/s]
Testing prompts:  70%|███████   | 7/10 [01:31<01:26, 28.90s/it]
Testing prompts:  80%|████████  | 8/10 [01:33<00:40, 20.32s/it]
Testing prompts:  90%|█████████ | 9/10 [01:34<00:14, 14.34s/it]
Testing prompts: 100%|██████████| 10/10 [01:38<00:00, 11.36s/it]
Testing prompts: 100%|██████████| 10/10 [01:38<00:00,  9.89s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.38it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:05,  1.34it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.34it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:04,  1.48it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.36it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.40it/s]
Testing prompts:  70%|███████   | 7/10 [01:30<01:25, 28.63s/it]
Testing prompts:  80%|████████  | 8/10 [01:31<00:39, 19.97s/it]
Testing prompts:  90%|█████████ | 9/10 [01:32<00:13, 14.00s/it]
Testing prompts: 100%|██████████| 10/10 [01:33<00:00,  9.96s/it]
Testing prompts: 100%|██████████| 10/10 [01:33<00:00,  9.36s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.30it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:05,  1.42it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:04,  1.44it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:03,  1.50it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.60it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.50it/s]
Testing prompts:  70%|███████   | 7/10 [01:42<01:38, 32.72s/it]
Testing prompts:  80%|████████  | 8/10 [01:43<00:45, 22.60s/it]
Testing prompts:  90%|█████████ | 9/10 [01:44<00:15, 15.84s/it]
Testing prompts: 100%|██████████| 10/10 [01:48<00:00, 12.24s/it]
Testing prompts: 100%|██████████| 10/10 [01:48<00:00, 10.88s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.49it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:05,  1.34it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.37it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:03,  1.51it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.58it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.39it/s]
Testing prompts:  70%|███████   | 7/10 [01:44<01:39, 33.16s/it]
Testing prompts:  80%|████████  | 8/10 [01:44<00:45, 22.84s/it]
Testing prompts:  90%|█████████ | 9/10 [01:45<00:15, 15.96s/it]
Testing prompts: 100%|██████████| 10/10 [01:50<00:00, 12.49s/it]
Testing prompts: 100%|██████████| 10/10 [01:50<00:00, 11.04s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.49it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.22it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.07it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:05,  1.11it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:03,  1.29it/s]
Testing prompts:  60%|██████    | 6/10 [00:15<00:17,  4.42s/it]
Testing prompts:  70%|███████   | 7/10 [00:19<00:12,  4.27s/it]
Testing prompts:  80%|████████  | 8/10 [00:20<00:06,  3.29s/it]
Testing prompts:  90%|█████████ | 9/10 [00:24<00:03,  3.52s/it]
Testing prompts: 100%|██████████| 10/10 [00:25<00:00,  2.65s/it]
Testing prompts: 100%|██████████| 10/10 [00:25<00:00,  2.54s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.35it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:05,  1.36it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.35it/s]
Testing prompts:  40%|████      | 4/10 [00:02<00:04,  1.39it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.40it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.49it/s]
Testing prompts:  70%|███████   | 7/10 [00:07<00:04,  1.54s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:04,  2.43s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.96s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.58s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.35s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.34it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.30it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.26it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.24it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.36it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.39it/s]
Testing prompts:  70%|███████   | 7/10 [01:32<01:28, 29.39s/it]
Testing prompts:  80%|████████  | 8/10 [01:33<00:40, 20.26s/it]
Testing prompts:  90%|█████████ | 9/10 [01:35<00:14, 14.59s/it]
Testing prompts: 100%|██████████| 10/10 [01:39<00:00, 11.12s/it]
Testing prompts: 100%|██████████| 10/10 [01:39<00:00,  9.91s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.42it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.13it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.12it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.29it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.37it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.46it/s]
Testing prompts:  70%|███████   | 7/10 [01:36<01:31, 30.57s/it]
Testing prompts:  80%|████████  | 8/10 [01:37<00:42, 21.06s/it]
Testing prompts:  90%|█████████ | 9/10 [01:38<00:14, 14.72s/it]
Testing prompts: 100%|██████████| 10/10 [01:39<00:00, 10.55s/it]
Testing prompts: 100%|██████████| 10/10 [01:39<00:00,  9.92s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.60it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.11it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.20it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.34it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.49it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:02,  1.56it/s]
Testing prompts:  70%|███████   | 7/10 [01:45<01:40, 33.43s/it]
Testing prompts:  80%|████████  | 8/10 [01:45<00:46, 23.04s/it]
Testing prompts:  90%|█████████ | 9/10 [01:46<00:16, 16.17s/it]
Testing prompts: 100%|██████████| 10/10 [01:51<00:00, 12.67s/it]
Testing prompts: 100%|██████████| 10/10 [01:51<00:00, 11.18s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:11,  1.23s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.00s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.08it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:05,  1.17it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:03,  1.32it/s]
Testing prompts:  60%|██████    | 6/10 [00:04<00:03,  1.33it/s]
Testing prompts:  70%|███████   | 7/10 [00:08<00:05,  1.73s/it]
Testing prompts:  80%|████████  | 8/10 [00:15<00:06,  3.48s/it]
Testing prompts:  90%|█████████ | 9/10 [00:16<00:02,  2.66s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  2.07s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  1.76s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.13it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.24it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:07,  1.01s/it]
Testing prompts:  40%|████      | 4/10 [00:03<00:05,  1.19it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:04,  1.07it/s]
Testing prompts:  60%|██████    | 6/10 [00:05<00:03,  1.24it/s]
Testing prompts:  70%|███████   | 7/10 [00:16<00:12,  4.19s/it]
Testing prompts:  80%|████████  | 8/10 [00:17<00:06,  3.12s/it]
Testing prompts:  90%|█████████ | 9/10 [00:21<00:03,  3.61s/it]
Testing prompts: 100%|██████████| 10/10 [02:06<00:00, 34.82s/it]
Testing prompts: 100%|██████████| 10/10 [02:06<00:00, 12.65s/it]
