[2025-05-11 09:32:38,639][INFO] Following apps/actions have missing dependencies
[2025-05-11 09:32:38,639][INFO] • CODE_ANALYSIS_TOOL_GET_RELEVANT_CODE: {'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter>=0.22.0', 'tree_sitter_python>=0.22.0', 'tokenizers>=0.19,<0.20', 'deeplake>3.9,<3.9.39'}
[2025-05-11 09:32:38,639][INFO] • SQLTOOL_SQL_QUERY: {'sqlalchemy>=2.0'}
[2025-05-11 09:32:38,639][INFO] • CODE_ANALYSIS_TOOL_CREATE_CODE_MAP: {'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter>=0.22.0', 'tree_sitter_python>=0.22.0', 'tokenizers>=0.19,<0.20', 'deeplake>3.9,<3.9.39'}
[2025-05-11 09:32:38,639][INFO] • CODE_ANALYSIS_TOOL_GET_METHOD_SIGNATURE: {'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter>=0.22.0', 'tree_sitter_python>=0.22.0', 'tokenizers>=0.19,<0.20', 'deeplake>3.9,<3.9.39'}
[2025-05-11 09:32:38,639][INFO] • CODE_ANALYSIS_TOOL_GET_CLASS_INFO: {'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter>=0.22.0', 'tree_sitter_python>=0.22.0', 'tokenizers>=0.19,<0.20', 'deeplake>3.9,<3.9.39'}
[2025-05-11 09:32:38,639][INFO] • CODE_ANALYSIS_TOOL_GET_METHOD_BODY: {'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter>=0.22.0', 'tree_sitter_python>=0.22.0', 'tokenizers>=0.19,<0.20', 'deeplake>3.9,<3.9.39'}
[2025-05-11 09:32:38,639][INFO] Installing dependencies...
[2025-05-11 09:32:38,639][INFO] Installing git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:32:41,811][INFO] Installed git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi
[2025-05-11 09:32:41,811][INFO] Installing tree_sitter>=0.22.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:32:44,132][INFO] Installed tree_sitter>=0.22.0
[2025-05-11 09:32:44,132][INFO] Installing tree_sitter_python>=0.22.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:32:46,494][INFO] Installed tree_sitter_python>=0.22.0
[2025-05-11 09:32:46,495][INFO] Installing tokenizers>=0.19,<0.20
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:32:48,849][INFO] Installed tokenizers>=0.19,<0.20
[2025-05-11 09:32:48,849][INFO] Installing deeplake>3.9,<3.9.39
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:32:51,262][INFO] Installed deeplake>3.9,<3.9.39
[2025-05-11 09:32:51,262][INFO] Installing sqlalchemy>=2.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:32:53,571][INFO] Installed sqlalchemy>=2.0

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:18,  2.02s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.71s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.51s/it]
Testing prompts:  40%|████      | 4/10 [00:55<02:05, 20.93s/it]
Testing prompts:  50%|█████     | 5/10 [00:56<01:09, 13.92s/it]
Testing prompts:  60%|██████    | 6/10 [00:58<00:38,  9.74s/it]
Testing prompts:  70%|███████   | 7/10 [02:34<01:53, 37.94s/it]
Testing prompts:  80%|████████  | 8/10 [02:35<00:52, 26.18s/it]
Testing prompts:  90%|█████████ | 9/10 [02:36<00:18, 18.21s/it]
Testing prompts: 100%|██████████| 10/10 [02:37<00:00, 13.10s/it]
Testing prompts: 100%|██████████| 10/10 [02:37<00:00, 15.79s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:14,  1.56s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.48s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.26s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.40s/it]
Testing prompts:  50%|█████     | 5/10 [01:42<02:58, 35.80s/it]
Testing prompts:  60%|██████    | 6/10 [01:43<01:36, 24.12s/it]
Testing prompts:  70%|███████   | 7/10 [01:44<00:49, 16.56s/it]
Testing prompts:  80%|████████  | 8/10 [01:46<00:23, 11.67s/it]
Testing prompts:  90%|█████████ | 9/10 [01:47<00:08,  8.56s/it]
Testing prompts: 100%|██████████| 10/10 [01:49<00:00,  6.39s/it]
Testing prompts: 100%|██████████| 10/10 [01:49<00:00, 10.93s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:10,  1.18s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.36s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.45s/it]
Testing prompts:  40%|████      | 4/10 [00:54<02:03, 20.66s/it]
Testing prompts:  50%|█████     | 5/10 [00:55<01:08, 13.64s/it]
Testing prompts:  60%|██████    | 6/10 [00:56<00:37,  9.46s/it]
Testing prompts:  70%|███████   | 7/10 [02:32<01:53, 37.72s/it]
Testing prompts:  80%|████████  | 8/10 [02:33<00:51, 25.98s/it]
Testing prompts:  90%|█████████ | 9/10 [02:34<00:18, 18.10s/it]
Testing prompts: 100%|██████████| 10/10 [02:35<00:00, 12.97s/it]
Testing prompts: 100%|██████████| 10/10 [02:35<00:00, 15.59s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:15,  1.69s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.76s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:11,  1.59s/it]
Testing prompts:  40%|████      | 4/10 [01:42<03:56, 39.37s/it]
Testing prompts:  50%|█████     | 5/10 [01:43<02:08, 25.70s/it]
Testing prompts:  60%|██████    | 6/10 [01:44<01:09, 17.40s/it]
Testing prompts:  70%|███████   | 7/10 [01:46<00:36, 12.09s/it]
Testing prompts:  80%|████████  | 8/10 [01:46<00:16,  8.46s/it]
Testing prompts:  90%|█████████ | 9/10 [01:48<00:06,  6.29s/it]
Testing prompts: 100%|██████████| 10/10 [01:49<00:00,  4.87s/it]
Testing prompts: 100%|██████████| 10/10 [01:49<00:00, 11.00s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.53s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.49s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:09,  1.40s/it]
Testing prompts:  40%|████      | 4/10 [01:40<03:52, 38.76s/it]
Testing prompts:  50%|█████     | 5/10 [01:41<02:06, 25.28s/it]
Testing prompts:  60%|██████    | 6/10 [01:43<01:08, 17.19s/it]
Testing prompts:  70%|███████   | 7/10 [01:45<00:36, 12.20s/it]
Testing prompts:  80%|████████  | 8/10 [01:46<00:17,  8.64s/it]
Testing prompts:  90%|█████████ | 9/10 [01:48<00:06,  6.67s/it]
Testing prompts: 100%|██████████| 10/10 [01:49<00:00,  5.04s/it]
Testing prompts: 100%|██████████| 10/10 [01:49<00:00, 10.98s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.49s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:12,  1.59s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.43s/it]
Testing prompts:  40%|████      | 4/10 [01:41<03:54, 39.02s/it]
Testing prompts:  50%|█████     | 5/10 [01:42<02:07, 25.46s/it]
Testing prompts:  60%|██████    | 6/10 [01:43<01:08, 17.22s/it]
Testing prompts:  70%|███████   | 7/10 [03:19<02:09, 43.08s/it]
Testing prompts:  80%|████████  | 8/10 [03:21<00:59, 29.69s/it]
Testing prompts:  90%|█████████ | 9/10 [03:22<00:20, 20.90s/it]
Testing prompts: 100%|██████████| 10/10 [03:23<00:00, 14.85s/it]
Testing prompts: 100%|██████████| 10/10 [03:23<00:00, 20.39s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.42s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:12,  1.60s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.55s/it]
Testing prompts:  40%|████      | 4/10 [00:56<02:07, 21.27s/it]
Testing prompts:  50%|█████     | 5/10 [00:57<01:10, 14.17s/it]
Testing prompts:  60%|██████    | 6/10 [00:58<00:38,  9.60s/it]
Testing prompts:  70%|███████   | 7/10 [02:34<01:53, 37.81s/it]
Testing prompts:  80%|████████  | 8/10 [02:35<00:52, 26.10s/it]
Testing prompts:  90%|█████████ | 9/10 [02:36<00:18, 18.39s/it]
Testing prompts: 100%|██████████| 10/10 [02:39<00:00, 13.47s/it]
Testing prompts: 100%|██████████| 10/10 [02:39<00:00, 15.92s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.50s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:07,  1.05it/s]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.08s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.27s/it]
Testing prompts:  50%|█████     | 5/10 [02:32<04:29, 53.87s/it]
Testing prompts:  60%|██████    | 6/10 [02:33<02:23, 35.92s/it]
Testing prompts:  70%|███████   | 7/10 [02:35<01:15, 25.01s/it]
Testing prompts:  80%|████████  | 8/10 [02:36<00:34, 17.28s/it]
Testing prompts:  90%|█████████ | 9/10 [02:37<00:12, 12.39s/it]
Testing prompts: 100%|██████████| 10/10 [02:39<00:00,  9.15s/it]
Testing prompts: 100%|██████████| 10/10 [02:39<00:00, 15.99s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:15,  1.72s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:15,  1.98s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:11,  1.68s/it]
Testing prompts:  40%|████      | 4/10 [00:56<02:08, 21.46s/it]
Testing prompts:  50%|█████     | 5/10 [00:58<01:11, 14.32s/it]
Testing prompts:  60%|██████    | 6/10 [01:00<00:40, 10.00s/it]
Testing prompts:  70%|███████   | 7/10 [02:38<01:56, 38.76s/it]
Testing prompts:  80%|████████  | 8/10 [02:39<00:53, 26.77s/it]
Testing prompts:  90%|█████████ | 9/10 [02:40<00:18, 18.72s/it]
Testing prompts: 100%|██████████| 10/10 [02:41<00:00, 13.41s/it]
Testing prompts: 100%|██████████| 10/10 [02:41<00:00, 16.19s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.51s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.64s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.51s/it]
Testing prompts:  40%|████      | 4/10 [01:43<04:00, 40.03s/it]
Testing prompts:  50%|█████     | 5/10 [01:45<02:10, 26.19s/it]
Testing prompts:  60%|██████    | 6/10 [01:46<01:11, 17.85s/it]
Testing prompts:  70%|███████   | 7/10 [01:48<00:37, 12.44s/it]
Testing prompts:  80%|████████  | 8/10 [01:49<00:17,  8.72s/it]
Testing prompts:  90%|█████████ | 9/10 [01:51<00:06,  6.67s/it]
Testing prompts: 100%|██████████| 10/10 [01:53<00:00,  5.17s/it]
Testing prompts: 100%|██████████| 10/10 [01:53<00:00, 11.30s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:14,  1.64s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.86s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:11,  1.69s/it]
Testing prompts:  40%|████      | 4/10 [00:56<02:06, 21.16s/it]
Testing prompts:  50%|█████     | 5/10 [00:57<01:09, 13.90s/it]
Testing prompts:  60%|██████    | 6/10 [00:58<00:39,  9.78s/it]
Testing prompts:  70%|███████   | 7/10 [00:59<00:20,  6.83s/it]
Testing prompts:  80%|████████  | 8/10 [01:00<00:09,  4.98s/it]
Testing prompts:  90%|█████████ | 9/10 [01:01<00:03,  3.81s/it]
Testing prompts: 100%|██████████| 10/10 [01:03<00:00,  3.02s/it]
Testing prompts: 100%|██████████| 10/10 [01:03<00:00,  6.32s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.53s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.70s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:11,  1.66s/it]
Testing prompts:  40%|████      | 4/10 [01:41<03:55, 39.22s/it]
Testing prompts:  50%|█████     | 5/10 [01:43<02:08, 25.73s/it]
Testing prompts:  60%|██████    | 6/10 [01:45<01:10, 17.55s/it]
Testing prompts:  70%|███████   | 7/10 [01:46<00:36, 12.21s/it]
Testing prompts:  80%|████████  | 8/10 [01:47<00:17,  8.63s/it]
Testing prompts:  90%|█████████ | 9/10 [01:49<00:06,  6.44s/it]
Testing prompts: 100%|██████████| 10/10 [05:04<00:00, 64.71s/it]
Testing prompts: 100%|██████████| 10/10 [05:04<00:00, 30.42s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:16,  1.82s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.25s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.77s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:10,  1.76s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:07,  1.56s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:05,  1.47s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:03,  1.32s/it]
Testing prompts:  80%|████████  | 8/10 [01:46<01:03, 31.63s/it]
Testing prompts:  90%|█████████ | 9/10 [01:48<00:22, 22.36s/it]
Testing prompts: 100%|██████████| 10/10 [01:50<00:00, 15.86s/it]
Testing prompts: 100%|██████████| 10/10 [01:50<00:00, 11.01s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:15,  1.77s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:15,  1.91s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.73s/it]
Testing prompts:  40%|████      | 4/10 [01:42<03:55, 39.29s/it]
Testing prompts:  50%|█████     | 5/10 [01:43<02:07, 25.49s/it]
Testing prompts:  60%|██████    | 6/10 [01:44<01:09, 17.39s/it]
Testing prompts:  70%|███████   | 7/10 [03:21<02:09, 43.16s/it]
Testing prompts:  80%|████████  | 8/10 [03:21<00:59, 29.71s/it]
Testing prompts:  90%|█████████ | 9/10 [03:22<00:20, 20.64s/it]
Testing prompts: 100%|██████████| 10/10 [03:24<00:00, 14.78s/it]
Testing prompts: 100%|██████████| 10/10 [03:24<00:00, 20.43s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:19,  2.13s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.79s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:11,  1.67s/it]
Testing prompts:  40%|████      | 4/10 [00:55<02:06, 21.04s/it]
Testing prompts:  50%|█████     | 5/10 [00:56<01:08, 13.77s/it]
Testing prompts:  60%|██████    | 6/10 [00:58<00:39,  9.80s/it]
Testing prompts:  70%|███████   | 7/10 [02:35<01:54, 38.09s/it]
Testing prompts:  80%|████████  | 8/10 [02:36<00:52, 26.26s/it]
Testing prompts:  90%|█████████ | 9/10 [02:36<00:18, 18.28s/it]
Testing prompts: 100%|██████████| 10/10 [02:38<00:00, 13.25s/it]
Testing prompts: 100%|██████████| 10/10 [02:38<00:00, 15.89s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.52s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.47s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.46s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:09,  1.50s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:07,  1.44s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.46s/it]
Testing prompts:  70%|███████   | 7/10 [00:59<00:52, 17.46s/it]
Testing prompts:  80%|████████  | 8/10 [00:59<00:24, 12.14s/it]
Testing prompts:  90%|█████████ | 9/10 [01:01<00:08,  8.97s/it]
Testing prompts: 100%|██████████| 10/10 [01:03<00:00,  6.70s/it]
Testing prompts: 100%|██████████| 10/10 [01:03<00:00,  6.36s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:16,  1.83s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.64s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.57s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:09,  1.66s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:07,  1.58s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:06,  1.52s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:04,  1.42s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:02,  1.16s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.39s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.60s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.53s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:17,  1.93s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.39s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:08,  1.28s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.47s/it]
Testing prompts:  50%|█████     | 5/10 [02:32<04:28, 53.79s/it]
Testing prompts:  60%|██████    | 6/10 [02:34<02:24, 36.09s/it]
Testing prompts:  70%|███████   | 7/10 [02:35<01:14, 24.76s/it]
Testing prompts:  80%|████████  | 8/10 [02:37<00:34, 17.34s/it]
Testing prompts:  90%|█████████ | 9/10 [02:38<00:12, 12.37s/it]
Testing prompts: 100%|██████████| 10/10 [02:40<00:00,  9.04s/it]
Testing prompts: 100%|██████████| 10/10 [02:40<00:00, 16.01s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.42s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.75s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.57s/it]
Testing prompts:  40%|████      | 4/10 [00:55<02:06, 21.11s/it]
Testing prompts:  50%|█████     | 5/10 [00:57<01:11, 14.21s/it]
Testing prompts:  60%|██████    | 6/10 [00:59<00:39,  9.79s/it]
Testing prompts:  70%|███████   | 7/10 [02:36<01:55, 38.58s/it]
Testing prompts:  80%|████████  | 8/10 [02:37<00:53, 26.62s/it]
Testing prompts:  90%|█████████ | 9/10 [02:39<00:18, 18.81s/it]
Testing prompts: 100%|██████████| 10/10 [02:40<00:00, 13.41s/it]
Testing prompts: 100%|██████████| 10/10 [02:40<00:00, 16.08s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:15,  1.69s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.29s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:11,  1.63s/it]
Testing prompts:  40%|████      | 4/10 [00:55<02:06, 21.07s/it]
Testing prompts:  50%|█████     | 5/10 [03:23<05:33, 66.68s/it]
Testing prompts:  60%|██████    | 6/10 [03:24<02:58, 44.53s/it]
Testing prompts:  70%|███████   | 7/10 [03:26<01:31, 30.50s/it]
Testing prompts:  80%|████████  | 8/10 [03:28<00:42, 21.37s/it]
Testing prompts:  90%|█████████ | 9/10 [03:29<00:15, 15.12s/it]
Testing prompts: 100%|██████████| 10/10 [03:30<00:00, 10.87s/it]
Testing prompts: 100%|██████████| 10/10 [03:30<00:00, 21.08s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:14,  1.59s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:11,  1.50s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.50s/it]
Testing prompts:  40%|████      | 4/10 [01:40<03:53, 38.96s/it]
Testing prompts:  50%|█████     | 5/10 [01:42<02:08, 25.66s/it]
Testing prompts:  60%|██████    | 6/10 [01:45<01:10, 17.63s/it]
Testing prompts:  70%|███████   | 7/10 [01:45<00:36, 12.13s/it]
Testing prompts:  80%|████████  | 8/10 [04:12<01:50, 55.11s/it]
Testing prompts:  90%|█████████ | 9/10 [04:14<00:38, 38.27s/it]
Testing prompts: 100%|██████████| 10/10 [04:15<00:00, 26.99s/it]
Testing prompts: 100%|██████████| 10/10 [04:15<00:00, 25.60s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:15,  1.77s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:15,  1.94s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.74s/it]
Testing prompts:  40%|████      | 4/10 [00:55<02:04, 20.73s/it]
Testing prompts:  50%|█████     | 5/10 [00:56<01:09, 13.91s/it]
Testing prompts:  60%|██████    | 6/10 [00:59<00:40, 10.01s/it]
Testing prompts:  70%|███████   | 7/10 [01:00<00:21,  7.12s/it]
Testing prompts:  80%|████████  | 8/10 [01:01<00:10,  5.09s/it]
Testing prompts:  90%|█████████ | 9/10 [01:02<00:03,  3.99s/it]
Testing prompts: 100%|██████████| 10/10 [01:05<00:00,  3.47s/it]
Testing prompts: 100%|██████████| 10/10 [01:05<00:00,  6.52s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.35s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:12,  1.56s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.52s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:10,  1.67s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:07,  1.59s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:06,  1.61s/it]
Testing prompts:  70%|███████   | 7/10 [01:46<01:37, 32.63s/it]
Testing prompts:  80%|████████  | 8/10 [01:46<00:44, 22.42s/it]
Testing prompts:  90%|█████████ | 9/10 [01:48<00:15, 15.89s/it]
Testing prompts: 100%|██████████| 10/10 [01:49<00:00, 11.53s/it]
Testing prompts: 100%|██████████| 10/10 [01:49<00:00, 10.99s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:16,  1.78s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.18s/it]
Testing prompts:  30%|███       | 3/10 [01:40<05:18, 45.45s/it]
Testing prompts:  40%|████      | 4/10 [01:42<02:48, 28.06s/it]
Testing prompts:  50%|█████     | 5/10 [01:43<01:31, 18.28s/it]
Testing prompts:  60%|██████    | 6/10 [01:44<00:50, 12.60s/it]
Testing prompts:  70%|███████   | 7/10 [01:45<00:26,  8.73s/it]
Testing prompts:  80%|████████  | 8/10 [01:47<00:13,  6.54s/it]
Testing prompts:  90%|█████████ | 9/10 [01:48<00:04,  4.95s/it]
Testing prompts: 100%|██████████| 10/10 [01:49<00:00,  3.74s/it]
Testing prompts: 100%|██████████| 10/10 [01:49<00:00, 10.97s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:15,  1.68s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.77s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:11,  1.70s/it]
Testing prompts:  40%|████      | 4/10 [00:55<02:05, 20.92s/it]
Testing prompts:  50%|█████     | 5/10 [00:57<01:09, 13.94s/it]
Testing prompts:  60%|██████    | 6/10 [00:57<00:37,  9.39s/it]
Testing prompts:  70%|███████   | 7/10 [02:33<01:53, 37.70s/it]
Testing prompts:  80%|████████  | 8/10 [02:34<00:52, 26.03s/it]
Testing prompts:  90%|█████████ | 9/10 [02:36<00:18, 18.45s/it]
Testing prompts: 100%|██████████| 10/10 [02:38<00:00, 13.25s/it]
Testing prompts: 100%|██████████| 10/10 [02:38<00:00, 15.81s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.51s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.84s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:11,  1.65s/it]
Testing prompts:  40%|████      | 4/10 [00:55<02:05, 20.89s/it]
Testing prompts:  50%|█████     | 5/10 [00:56<01:09, 13.81s/it]
Testing prompts:  60%|██████    | 6/10 [00:58<00:38,  9.68s/it]
Testing prompts:  70%|███████   | 7/10 [00:59<00:20,  6.86s/it]
Testing prompts:  80%|████████  | 8/10 [01:01<00:10,  5.23s/it]
Testing prompts:  90%|█████████ | 9/10 [01:02<00:03,  3.96s/it]
Testing prompts: 100%|██████████| 10/10 [01:03<00:00,  3.05s/it]
Testing prompts: 100%|██████████| 10/10 [01:03<00:00,  6.33s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.53s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:11,  1.50s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.15s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:07,  1.33s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.37s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:06,  1.54s/it]
Testing prompts:  70%|███████   | 7/10 [01:45<01:37, 32.60s/it]
Testing prompts:  80%|████████  | 8/10 [01:46<00:45, 22.57s/it]
Testing prompts:  90%|█████████ | 9/10 [01:47<00:15, 15.99s/it]
Testing prompts: 100%|██████████| 10/10 [01:48<00:00, 11.40s/it]
Testing prompts: 100%|██████████| 10/10 [01:48<00:00, 10.89s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.55s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.46s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:09,  1.38s/it]
Testing prompts:  40%|████      | 4/10 [01:40<03:53, 38.99s/it]
Testing prompts:  50%|█████     | 5/10 [01:42<02:07, 25.51s/it]
Testing prompts:  60%|██████    | 6/10 [01:43<01:08, 17.17s/it]
Testing prompts:  70%|███████   | 7/10 [01:44<00:35, 11.79s/it]
Testing prompts:  80%|████████  | 8/10 [03:24<01:20, 40.09s/it]
Testing prompts:  90%|█████████ | 9/10 [03:26<00:28, 28.10s/it]
Testing prompts: 100%|██████████| 10/10 [03:28<00:00, 19.91s/it]
Testing prompts: 100%|██████████| 10/10 [03:28<00:00, 20.82s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.41s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.23s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.31s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.36s/it]
Testing prompts:  50%|█████     | 5/10 [01:41<02:58, 35.62s/it]
Testing prompts:  60%|██████    | 6/10 [01:44<01:37, 24.35s/it]
Testing prompts:  70%|███████   | 7/10 [01:46<00:51, 17.07s/it]
Testing prompts:  80%|████████  | 8/10 [01:47<00:23, 11.96s/it]
Testing prompts:  90%|█████████ | 9/10 [01:48<00:08,  8.52s/it]
Testing prompts: 100%|██████████| 10/10 [01:49<00:00,  6.30s/it]
Testing prompts: 100%|██████████| 10/10 [01:49<00:00, 10.96s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:17,  1.99s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.80s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:13,  1.96s/it]
Testing prompts:  40%|████      | 4/10 [00:56<02:07, 21.24s/it]
Testing prompts:  50%|█████     | 5/10 [00:58<01:11, 14.39s/it]
Testing prompts:  60%|██████    | 6/10 [00:59<00:39,  9.85s/it]
Testing prompts:  70%|███████   | 7/10 [01:51<01:10, 23.65s/it]
Testing prompts:  80%|████████  | 8/10 [01:52<00:32, 16.37s/it]
Testing prompts:  90%|█████████ | 9/10 [01:54<00:11, 11.86s/it]
Testing prompts: 100%|██████████| 10/10 [01:56<00:00,  8.67s/it]
Testing prompts: 100%|██████████| 10/10 [01:56<00:00, 11.62s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:10,  1.12s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.49s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.50s/it]
Testing prompts:  40%|████      | 4/10 [00:55<02:06, 21.15s/it]
Testing prompts:  50%|█████     | 5/10 [00:56<01:09, 13.99s/it]
Testing prompts:  60%|██████    | 6/10 [00:58<00:38,  9.70s/it]
Testing prompts:  70%|███████   | 7/10 [00:59<00:20,  6.81s/it]
Testing prompts:  80%|████████  | 8/10 [01:00<00:09,  4.97s/it]
Testing prompts:  90%|█████████ | 9/10 [03:29<00:50, 50.01s/it]
Testing prompts: 100%|██████████| 10/10 [03:31<00:00, 35.20s/it]
Testing prompts: 100%|██████████| 10/10 [03:31<00:00, 21.13s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:14,  1.63s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.72s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.75s/it]
Testing prompts:  40%|████      | 4/10 [01:43<03:58, 39.82s/it]
Testing prompts:  50%|█████     | 5/10 [01:44<02:09, 25.90s/it]
Testing prompts:  60%|██████    | 6/10 [01:45<01:09, 17.43s/it]
Testing prompts:  70%|███████   | 7/10 [03:22<02:09, 43.26s/it]
Testing prompts:  80%|████████  | 8/10 [03:23<00:59, 29.80s/it]
Testing prompts:  90%|█████████ | 9/10 [03:25<00:21, 21.11s/it]
Testing prompts: 100%|██████████| 10/10 [03:26<00:00, 15.09s/it]
Testing prompts: 100%|██████████| 10/10 [03:26<00:00, 20.66s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.46s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:12,  1.54s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.53s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:07,  1.30s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:07,  1.41s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.25s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.07s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.00s/it]
Testing prompts:  90%|█████████ | 9/10 [00:10<00:01,  1.09s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.12s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.21s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.34s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.16s/it]
Testing prompts:  30%|███       | 3/10 [01:39<05:13, 44.79s/it]
Testing prompts:  40%|████      | 4/10 [01:41<02:47, 27.95s/it]
Testing prompts:  50%|█████     | 5/10 [01:42<01:31, 18.35s/it]
Testing prompts:  60%|██████    | 6/10 [01:43<00:50, 12.60s/it]
Testing prompts:  70%|███████   | 7/10 [01:46<00:27,  9.15s/it]
Testing prompts:  80%|████████  | 8/10 [01:48<00:13,  6.95s/it]
Testing prompts:  90%|█████████ | 9/10 [01:48<00:04,  4.96s/it]
Testing prompts: 100%|██████████| 10/10 [01:50<00:00,  3.81s/it]
Testing prompts: 100%|██████████| 10/10 [01:50<00:00, 11.01s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:16,  1.83s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:12,  1.56s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.51s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.41s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:06,  1.35s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.44s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:03,  1.29s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:02,  1.39s/it]
Testing prompts:  90%|█████████ | 9/10 [01:47<00:31, 31.02s/it]
Testing prompts: 100%|██████████| 10/10 [01:49<00:00, 22.12s/it]
Testing prompts: 100%|██████████| 10/10 [01:49<00:00, 10.97s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.39s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.14s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.17s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:09,  1.54s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.35s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.07s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.06s/it]
Testing prompts:  80%|████████  | 8/10 [01:44<01:02, 31.40s/it]
Testing prompts:  90%|█████████ | 9/10 [01:45<00:21, 21.90s/it]
Testing prompts: 100%|██████████| 10/10 [01:47<00:00, 15.57s/it]
Testing prompts: 100%|██████████| 10/10 [01:47<00:00, 10.70s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:11,  1.26s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.34s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.34s/it]
Testing prompts:  40%|████      | 4/10 [01:40<03:52, 38.81s/it]
Testing prompts:  50%|█████     | 5/10 [01:41<02:06, 25.27s/it]
Testing prompts:  60%|██████    | 6/10 [01:43<01:09, 17.32s/it]
Testing prompts:  70%|███████   | 7/10 [01:44<00:35, 12.00s/it]
Testing prompts:  80%|████████  | 8/10 [01:45<00:17,  8.58s/it]
Testing prompts:  90%|█████████ | 9/10 [01:47<00:06,  6.50s/it]
Testing prompts: 100%|██████████| 10/10 [01:48<00:00,  4.85s/it]
Testing prompts: 100%|██████████| 10/10 [01:48<00:00, 10.88s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.38s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:20,  2.62s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:14,  2.08s/it]
Testing prompts:  40%|████      | 4/10 [00:56<02:05, 20.99s/it]
Testing prompts:  50%|█████     | 5/10 [00:57<01:09, 13.96s/it]
Testing prompts:  60%|██████    | 6/10 [00:59<00:39,  9.78s/it]
Testing prompts:  70%|███████   | 7/10 [01:00<00:20,  6.82s/it]
Testing prompts:  80%|████████  | 8/10 [01:01<00:10,  5.02s/it]
Testing prompts:  90%|█████████ | 9/10 [01:02<00:03,  3.70s/it]
Testing prompts: 100%|██████████| 10/10 [01:03<00:00,  3.04s/it]
Testing prompts: 100%|██████████| 10/10 [01:03<00:00,  6.37s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.45s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.67s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.51s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:09,  1.55s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:07,  1.54s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.42s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:04,  1.41s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.18s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.03s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.20s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.33s/it]
