[2025-05-11 09:29:40,352][INFO] Following apps/actions have missing dependencies
[2025-05-11 09:29:40,352][INFO] • CODE_ANALYSIS_TOOL_GET_RELEVANT_CODE: {'deeplake>3.9,<3.9.39', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter_python>=0.22.0'}
[2025-05-11 09:29:40,352][INFO] • SQLTOOL_SQL_QUERY: {'sqlalchemy>=2.0'}
[2025-05-11 09:29:40,352][INFO] • CODE_ANALYSIS_TOOL_CREATE_CODE_MAP: {'deeplake>3.9,<3.9.39', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter_python>=0.22.0'}
[2025-05-11 09:29:40,352][INFO] • CODE_ANALYSIS_TOOL_GET_METHOD_SIGNATURE: {'deeplake>3.9,<3.9.39', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter_python>=0.22.0'}
[2025-05-11 09:29:40,352][INFO] • CODE_ANALYSIS_TOOL_GET_CLASS_INFO: {'deeplake>3.9,<3.9.39', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter_python>=0.22.0'}
[2025-05-11 09:29:40,352][INFO] • CODE_ANALYSIS_TOOL_GET_METHOD_BODY: {'deeplake>3.9,<3.9.39', 'tokenizers>=0.19,<0.20', 'tree_sitter>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter_python>=0.22.0'}
[2025-05-11 09:29:40,352][INFO] Installing dependencies...
[2025-05-11 09:29:40,352][INFO] Installing deeplake>3.9,<3.9.39
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:29:42,725][INFO] Installed deeplake>3.9,<3.9.39
[2025-05-11 09:29:42,725][INFO] Installing tokenizers>=0.19,<0.20
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:29:44,997][INFO] Installed tokenizers>=0.19,<0.20
[2025-05-11 09:29:44,997][INFO] Installing tree_sitter>=0.22.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:29:47,413][INFO] Installed tree_sitter>=0.22.0
[2025-05-11 09:29:47,413][INFO] Installing git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:29:50,347][INFO] Installed git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi
[2025-05-11 09:29:50,347][INFO] Installing tree_sitter_python>=0.22.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:29:52,581][INFO] Installed tree_sitter_python>=0.22.0
[2025-05-11 09:29:52,581][INFO] Installing sqlalchemy>=2.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:29:54,800][INFO] Installed sqlalchemy>=2.0

Testing prompts:   0%|          | 0/9 [00:00<?, ?it/s]
Testing prompts:  11%|█         | 1/9 [00:15<02:02, 15.35s/it]
Testing prompts:  22%|██▏       | 2/9 [00:17<00:51,  7.33s/it]
Testing prompts:  33%|███▎      | 3/9 [00:30<01:01, 10.23s/it]
Testing prompts:  44%|████▍     | 4/9 [00:31<00:33,  6.61s/it]
Testing prompts:  56%|█████▌    | 5/9 [00:33<00:19,  4.81s/it]
Testing prompts:  67%|██████▋   | 6/9 [00:35<00:11,  3.74s/it]
Testing prompts:  78%|███████▊  | 7/9 [00:48<00:13,  6.93s/it]
Testing prompts:  89%|████████▉ | 8/9 [01:02<00:09,  9.17s/it]
Testing prompts: 100%|██████████| 9/9 [01:23<00:00, 12.73s/it]
Testing prompts: 100%|██████████| 9/9 [01:23<00:00,  9.24s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<02:03, 13.77s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:49,  6.22s/it]
Testing prompts:  30%|███       | 3/10 [00:28<01:06,  9.49s/it]
Testing prompts:  40%|████      | 4/10 [00:43<01:10, 11.72s/it]
Testing prompts:  50%|█████     | 5/10 [00:44<00:39,  7.89s/it]
Testing prompts:  60%|██████    | 6/10 [00:45<00:22,  5.74s/it]
Testing prompts:  70%|███████   | 7/10 [01:00<00:26,  8.68s/it]
Testing prompts:  80%|████████  | 8/10 [01:26<00:28, 14.01s/it]
Testing prompts:  90%|█████████ | 9/10 [02:00<00:20, 20.36s/it]
Testing prompts: 100%|██████████| 10/10 [02:13<00:00, 18.28s/it]
Testing prompts: 100%|██████████| 10/10 [02:13<00:00, 13.40s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:13<00:54, 13.65s/it]
Testing prompts:  40%|████      | 2/5 [00:14<00:19,  6.34s/it]
Testing prompts:  60%|██████    | 3/5 [00:28<00:19,  9.57s/it]
Testing prompts:  80%|████████  | 4/5 [00:29<00:06,  6.11s/it]
Testing prompts: 100%|██████████| 5/5 [00:30<00:00,  4.54s/it]
Testing prompts: 100%|██████████| 5/5 [00:30<00:00,  6.17s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<02:02, 13.57s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:50,  6.26s/it]
Testing prompts:  30%|███       | 3/10 [00:27<01:05,  9.39s/it]
Testing prompts:  40%|████      | 4/10 [00:28<00:36,  6.02s/it]
Testing prompts:  50%|█████     | 5/10 [00:43<00:45,  9.09s/it]
Testing prompts:  60%|██████    | 6/10 [00:44<00:26,  6.52s/it]
Testing prompts:  70%|███████   | 7/10 [00:59<00:27,  9.13s/it]
Testing prompts:  80%|████████  | 8/10 [01:12<00:20, 10.46s/it]
Testing prompts:  90%|█████████ | 9/10 [01:26<00:11, 11.64s/it]
Testing prompts: 100%|██████████| 10/10 [01:39<00:00, 12.02s/it]
Testing prompts: 100%|██████████| 10/10 [01:39<00:00,  9.97s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:16,  1.80s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:12,  1.62s/it]
Testing prompts:  30%|███       | 3/10 [00:11<00:32,  4.58s/it]
Testing prompts:  40%|████      | 4/10 [00:19<00:35,  5.87s/it]
Testing prompts:  50%|█████     | 5/10 [00:20<00:21,  4.26s/it]
Testing prompts:  60%|██████    | 6/10 [00:21<00:12,  3.22s/it]
Testing prompts:  70%|███████   | 7/10 [00:31<00:15,  5.32s/it]
Testing prompts:  80%|████████  | 8/10 [00:32<00:07,  3.92s/it]
Testing prompts:  90%|█████████ | 9/10 [00:33<00:03,  3.10s/it]
Testing prompts: 100%|██████████| 10/10 [00:34<00:00,  2.50s/it]
Testing prompts: 100%|██████████| 10/10 [00:34<00:00,  3.49s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:11,  1.31s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.20s/it]
Testing prompts:  30%|███       | 3/10 [00:15<00:46,  6.60s/it]
Testing prompts:  40%|████      | 4/10 [00:16<00:26,  4.36s/it]
Testing prompts:  50%|█████     | 5/10 [00:30<00:39,  7.88s/it]
Testing prompts:  60%|██████    | 6/10 [00:31<00:22,  5.51s/it]
Testing prompts:  70%|███████   | 7/10 [00:44<00:24,  8.14s/it]
Testing prompts:  80%|████████  | 8/10 [00:47<00:12,  6.25s/it]
Testing prompts:  90%|█████████ | 9/10 [01:00<00:08,  8.48s/it]
Testing prompts: 100%|██████████| 10/10 [01:01<00:00,  6.27s/it]
Testing prompts: 100%|██████████| 10/10 [01:01<00:00,  6.19s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:11,  1.29s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.05s/it]
Testing prompts:  30%|███       | 3/10 [00:15<00:48,  6.86s/it]
Testing prompts:  40%|████      | 4/10 [00:17<00:29,  4.94s/it]
Testing prompts:  50%|█████     | 5/10 [00:30<00:39,  7.85s/it]
Testing prompts:  60%|██████    | 6/10 [00:44<00:38,  9.67s/it]
Testing prompts:  70%|███████   | 7/10 [00:58<00:34, 11.35s/it]
Testing prompts:  80%|████████  | 8/10 [01:23<00:30, 15.41s/it]
Testing prompts:  90%|█████████ | 9/10 [01:57<00:21, 21.37s/it]
Testing prompts: 100%|██████████| 10/10 [02:16<00:00, 20.67s/it]
Testing prompts: 100%|██████████| 10/10 [02:16<00:00, 13.66s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:12<01:56, 12.97s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:47,  5.97s/it]
Testing prompts:  30%|███       | 3/10 [00:14<00:25,  3.68s/it]
Testing prompts:  40%|████      | 4/10 [00:16<00:16,  2.68s/it]
Testing prompts:  50%|█████     | 5/10 [00:31<00:35,  7.18s/it]
Testing prompts:  60%|██████    | 6/10 [00:45<00:38,  9.54s/it]
Testing prompts:  70%|███████   | 7/10 [00:46<00:20,  6.84s/it]
Testing prompts:  80%|████████  | 8/10 [01:21<00:31, 15.67s/it]
Testing prompts:  90%|█████████ | 9/10 [01:45<00:18, 18.24s/it]
Testing prompts: 100%|██████████| 10/10 [01:59<00:00, 16.92s/it]
Testing prompts: 100%|██████████| 10/10 [01:59<00:00, 11.91s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:17,  1.93s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:17,  2.21s/it]
Testing prompts:  30%|███       | 3/10 [00:17<00:51,  7.37s/it]
Testing prompts:  40%|████      | 4/10 [00:31<00:58,  9.72s/it]
Testing prompts:  50%|█████     | 5/10 [00:32<00:33,  6.75s/it]
Testing prompts:  60%|██████    | 6/10 [00:46<00:36,  9.07s/it]
Testing prompts:  70%|███████   | 7/10 [00:47<00:19,  6.53s/it]
Testing prompts:  80%|████████  | 8/10 [00:48<00:09,  4.85s/it]
Testing prompts:  90%|█████████ | 9/10 [00:50<00:03,  3.78s/it]
Testing prompts: 100%|██████████| 10/10 [01:04<00:00,  7.04s/it]
Testing prompts: 100%|██████████| 10/10 [01:04<00:00,  6.45s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<01:59, 13.26s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:49,  6.14s/it]
Testing prompts:  30%|███       | 3/10 [00:27<01:05,  9.30s/it]
Testing prompts:  40%|████      | 4/10 [00:40<01:05, 10.91s/it]
Testing prompts:  50%|█████     | 5/10 [00:42<00:37,  7.41s/it]
Testing prompts:  60%|██████    | 6/10 [00:43<00:21,  5.42s/it]
Testing prompts:  70%|███████   | 7/10 [00:57<00:24,  8.32s/it]
Testing prompts:  80%|████████  | 8/10 [01:11<00:19,  9.98s/it]
Testing prompts:  90%|█████████ | 9/10 [01:25<00:11, 11.16s/it]
Testing prompts: 100%|██████████| 10/10 [01:38<00:00, 11.75s/it]
Testing prompts: 100%|██████████| 10/10 [01:38<00:00,  9.83s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.48s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.79s/it]
Testing prompts:  30%|███       | 3/10 [00:16<00:48,  7.00s/it]
Testing prompts:  40%|████      | 4/10 [00:18<00:28,  4.80s/it]
Testing prompts:  50%|█████     | 5/10 [00:31<00:39,  7.99s/it]
Testing prompts:  60%|██████    | 6/10 [00:55<00:52, 13.21s/it]
Testing prompts:  70%|███████   | 7/10 [00:56<00:27,  9.29s/it]
Testing prompts:  80%|████████  | 8/10 [00:58<00:14,  7.06s/it]
Testing prompts:  90%|█████████ | 9/10 [01:00<00:05,  5.50s/it]
Testing prompts: 100%|██████████| 10/10 [01:01<00:00,  4.14s/it]
Testing prompts: 100%|██████████| 10/10 [01:01<00:00,  6.18s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<02:03, 13.77s/it]
Testing prompts:  20%|██        | 2/10 [00:15<00:51,  6.42s/it]
Testing prompts:  30%|███       | 3/10 [00:28<01:07,  9.65s/it]
Testing prompts:  40%|████      | 4/10 [00:42<01:08, 11.37s/it]
Testing prompts:  50%|█████     | 5/10 [00:43<00:38,  7.69s/it]
Testing prompts:  60%|██████    | 6/10 [00:45<00:22,  5.57s/it]
Testing prompts:  70%|███████   | 7/10 [00:58<00:24,  8.11s/it]
Testing prompts:  80%|████████  | 8/10 [01:14<00:20, 10.48s/it]
Testing prompts:  90%|█████████ | 9/10 [01:27<00:11, 11.56s/it]
Testing prompts: 100%|██████████| 10/10 [01:41<00:00, 12.22s/it]
Testing prompts: 100%|██████████| 10/10 [01:41<00:00, 10.17s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.55s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.23s/it]
Testing prompts:  30%|███       | 3/10 [00:16<00:47,  6.85s/it]
Testing prompts:  40%|████      | 4/10 [00:18<00:30,  5.03s/it]
Testing prompts:  50%|█████     | 5/10 [00:20<00:19,  3.94s/it]
Testing prompts:  60%|██████    | 6/10 [00:34<00:29,  7.35s/it]
Testing prompts:  70%|███████   | 7/10 [00:57<00:38, 12.68s/it]
Testing prompts:  80%|████████  | 8/10 [01:33<00:39, 19.80s/it]
Testing prompts:  90%|█████████ | 9/10 [01:47<00:18, 18.07s/it]
Testing prompts: 100%|██████████| 10/10 [01:48<00:00, 12.93s/it]
Testing prompts: 100%|██████████| 10/10 [01:48<00:00, 10.87s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<01:58, 13.20s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:49,  6.14s/it]
Testing prompts:  30%|███       | 3/10 [00:27<01:06,  9.48s/it]
Testing prompts:  40%|████      | 4/10 [00:28<00:37,  6.17s/it]
Testing prompts:  50%|█████     | 5/10 [00:42<00:43,  8.78s/it]
Testing prompts:  60%|██████    | 6/10 [00:43<00:25,  6.30s/it]
Testing prompts:  70%|███████   | 7/10 [00:57<00:26,  8.79s/it]
Testing prompts:  80%|████████  | 8/10 [01:21<00:27, 13.62s/it]
Testing prompts:  90%|█████████ | 9/10 [01:56<00:20, 20.27s/it]
Testing prompts: 100%|██████████| 10/10 [02:13<00:00, 19.15s/it]
Testing prompts: 100%|██████████| 10/10 [02:13<00:00, 13.33s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:19,  2.13s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.81s/it]
Testing prompts:  30%|███       | 3/10 [00:17<00:49,  7.11s/it]
Testing prompts:  40%|████      | 4/10 [00:18<00:29,  4.83s/it]
Testing prompts:  50%|█████     | 5/10 [00:19<00:18,  3.62s/it]
Testing prompts:  60%|██████    | 6/10 [00:21<00:11,  2.76s/it]
Testing prompts:  70%|███████   | 7/10 [00:22<00:06,  2.18s/it]
Testing prompts:  80%|████████  | 8/10 [00:36<00:12,  6.12s/it]
Testing prompts:  90%|█████████ | 9/10 [00:37<00:04,  4.62s/it]
Testing prompts: 100%|██████████| 10/10 [00:39<00:00,  3.54s/it]
Testing prompts: 100%|██████████| 10/10 [00:39<00:00,  3.90s/it]

Testing prompts:   0%|          | 0/7 [00:00<?, ?it/s]
Testing prompts:  14%|█▍        | 1/7 [00:01<00:09,  1.60s/it]
Testing prompts:  29%|██▊       | 2/7 [00:03<00:08,  1.63s/it]
Testing prompts:  43%|████▎     | 3/7 [00:17<00:29,  7.28s/it]
Testing prompts:  57%|█████▋    | 4/7 [00:19<00:15,  5.32s/it]
Testing prompts:  71%|███████▏  | 5/7 [00:22<00:08,  4.30s/it]
Testing prompts:  86%|████████▌ | 6/7 [00:35<00:07,  7.28s/it]
Testing prompts: 100%|██████████| 7/7 [00:57<00:00, 12.22s/it]
Testing prompts: 100%|██████████| 7/7 [00:57<00:00,  8.22s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.46s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.26s/it]
Testing prompts:  30%|███       | 3/10 [00:11<00:31,  4.55s/it]
Testing prompts:  40%|████      | 4/10 [00:14<00:23,  3.97s/it]
Testing prompts:  50%|█████     | 5/10 [00:17<00:19,  3.85s/it]
Testing prompts:  60%|██████    | 6/10 [00:19<00:12,  3.24s/it]
Testing prompts:  70%|███████   | 7/10 [00:31<00:17,  6.00s/it]
Testing prompts:  80%|████████  | 8/10 [00:42<00:15,  7.50s/it]
Testing prompts:  90%|█████████ | 9/10 [00:51<00:07,  7.92s/it]
Testing prompts: 100%|██████████| 10/10 [01:27<00:00, 16.63s/it]
Testing prompts: 100%|██████████| 10/10 [01:27<00:00,  8.72s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:21,  2.39s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.66s/it]
Testing prompts:  30%|███       | 3/10 [00:11<00:33,  4.73s/it]
Testing prompts:  40%|████      | 4/10 [00:13<00:21,  3.66s/it]
Testing prompts:  50%|█████     | 5/10 [00:16<00:15,  3.13s/it]
Testing prompts:  60%|██████    | 6/10 [00:25<00:21,  5.30s/it]
Testing prompts:  70%|███████   | 7/10 [00:26<00:11,  3.96s/it]
Testing prompts:  80%|████████  | 8/10 [00:28<00:06,  3.12s/it]
Testing prompts:  90%|█████████ | 9/10 [00:28<00:02,  2.40s/it]
Testing prompts: 100%|██████████| 10/10 [00:43<00:00,  6.08s/it]
Testing prompts: 100%|██████████| 10/10 [00:43<00:00,  4.33s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:14<02:08, 14.22s/it]
Testing prompts:  20%|██        | 2/10 [00:15<00:51,  6.42s/it]
Testing prompts:  30%|███       | 3/10 [00:30<01:12, 10.34s/it]
Testing prompts:  40%|████      | 4/10 [00:31<00:40,  6.71s/it]
Testing prompts:  50%|█████     | 5/10 [00:32<00:24,  4.84s/it]
Testing prompts:  60%|██████    | 6/10 [00:46<00:31,  7.88s/it]
Testing prompts:  70%|███████   | 7/10 [01:21<00:50, 16.78s/it]
Testing prompts:  80%|████████  | 8/10 [01:45<00:38, 19.12s/it]
Testing prompts:  90%|█████████ | 9/10 [02:00<00:17, 17.82s/it]
Testing prompts: 100%|██████████| 10/10 [02:02<00:00, 12.93s/it]
Testing prompts: 100%|██████████| 10/10 [02:02<00:00, 12.28s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:15<02:18, 15.34s/it]
Testing prompts:  20%|██        | 2/10 [00:17<01:01,  7.63s/it]
Testing prompts:  30%|███       | 3/10 [00:30<01:09, 10.00s/it]
Testing prompts:  40%|████      | 4/10 [00:31<00:39,  6.55s/it]
Testing prompts:  50%|█████     | 5/10 [00:46<00:47,  9.50s/it]
Testing prompts:  60%|██████    | 6/10 [00:47<00:26,  6.70s/it]
Testing prompts:  70%|███████   | 7/10 [01:01<00:26,  8.91s/it]
Testing prompts:  80%|████████  | 8/10 [01:25<00:27, 13.91s/it]
Testing prompts:  90%|█████████ | 9/10 [01:59<00:20, 20.23s/it]
Testing prompts: 100%|██████████| 10/10 [02:13<00:00, 18.28s/it]
Testing prompts: 100%|██████████| 10/10 [02:13<00:00, 13.38s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<02:01, 13.53s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:49,  6.15s/it]
Testing prompts:  30%|███       | 3/10 [00:15<00:26,  3.75s/it]
Testing prompts:  40%|████      | 4/10 [00:16<00:17,  2.84s/it]
Testing prompts:  50%|█████     | 5/10 [00:19<00:13,  2.74s/it]
Testing prompts:  60%|██████    | 6/10 [00:21<00:10,  2.53s/it]
Testing prompts:  70%|███████   | 7/10 [00:24<00:07,  2.58s/it]
Testing prompts:  80%|████████  | 8/10 [00:37<00:12,  6.11s/it]
Testing prompts:  90%|█████████ | 9/10 [01:12<00:14, 14.95s/it]
Testing prompts: 100%|██████████| 10/10 [01:35<00:00, 17.63s/it]
Testing prompts: 100%|██████████| 10/10 [01:35<00:00,  9.59s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<02:00, 13.44s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:50,  6.26s/it]
Testing prompts:  30%|███       | 3/10 [00:28<01:06,  9.50s/it]
Testing prompts:  40%|████      | 4/10 [00:29<00:36,  6.16s/it]
Testing prompts:  50%|█████     | 5/10 [00:30<00:23,  4.62s/it]
Testing prompts:  60%|██████    | 6/10 [00:32<00:14,  3.72s/it]
Testing prompts:  70%|███████   | 7/10 [00:34<00:09,  3.18s/it]
Testing prompts:  80%|████████  | 8/10 [00:49<00:13,  6.92s/it]
Testing prompts:  90%|█████████ | 9/10 [00:51<00:05,  5.10s/it]
Testing prompts: 100%|██████████| 10/10 [01:14<00:00, 10.69s/it]
Testing prompts: 100%|██████████| 10/10 [01:14<00:00,  7.42s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<02:05, 13.99s/it]
Testing prompts:  20%|██        | 2/10 [00:15<00:52,  6.51s/it]
Testing prompts:  30%|███       | 3/10 [00:28<01:08,  9.74s/it]
Testing prompts:  40%|████      | 4/10 [00:41<01:05, 10.99s/it]
Testing prompts:  50%|█████     | 5/10 [00:42<00:36,  7.38s/it]
Testing prompts:  60%|██████    | 6/10 [00:44<00:21,  5.38s/it]
Testing prompts:  70%|███████   | 7/10 [00:57<00:23,  7.90s/it]
Testing prompts:  80%|████████  | 8/10 [01:21<00:26, 13.07s/it]
Testing prompts:  90%|█████████ | 9/10 [01:55<00:19, 19.74s/it]
Testing prompts: 100%|██████████| 10/10 [02:10<00:00, 18.06s/it]
Testing prompts: 100%|██████████| 10/10 [02:10<00:00, 13.02s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<01:59, 13.33s/it]
Testing prompts:  20%|██        | 2/10 [00:15<00:52,  6.57s/it]
Testing prompts:  30%|███       | 3/10 [00:28<01:07,  9.66s/it]
Testing prompts:  40%|████      | 4/10 [00:41<01:06, 11.13s/it]
Testing prompts:  50%|█████     | 5/10 [00:43<00:38,  7.72s/it]
Testing prompts:  60%|██████    | 6/10 [00:45<00:22,  5.65s/it]
Testing prompts:  70%|███████   | 7/10 [00:59<00:25,  8.51s/it]
Testing prompts:  80%|████████  | 8/10 [01:13<00:20, 10.24s/it]
Testing prompts:  90%|█████████ | 9/10 [01:28<00:11, 11.71s/it]
Testing prompts: 100%|██████████| 10/10 [01:41<00:00, 12.26s/it]
Testing prompts: 100%|██████████| 10/10 [01:41<00:00, 10.20s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:14<02:13, 14.84s/it]
Testing prompts:  20%|██        | 2/10 [00:16<00:55,  6.92s/it]
Testing prompts:  30%|███       | 3/10 [00:29<01:08,  9.80s/it]
Testing prompts:  40%|████      | 4/10 [00:30<00:38,  6.36s/it]
Testing prompts:  50%|█████     | 5/10 [00:44<00:45,  9.00s/it]
Testing prompts:  60%|██████    | 6/10 [00:46<00:26,  6.57s/it]
Testing prompts:  70%|███████   | 7/10 [01:00<00:27,  9.20s/it]
Testing prompts:  80%|████████  | 8/10 [01:35<00:34, 17.47s/it]
Testing prompts:  90%|█████████ | 9/10 [01:59<00:19, 19.39s/it]
Testing prompts: 100%|██████████| 10/10 [02:14<00:00, 17.96s/it]
Testing prompts: 100%|██████████| 10/10 [02:14<00:00, 13.42s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:14,  1.60s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.67s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:11,  1.63s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:09,  1.50s/it]
Testing prompts:  50%|█████     | 5/10 [00:15<00:20,  4.17s/it]
Testing prompts:  60%|██████    | 6/10 [00:15<00:12,  3.02s/it]
Testing prompts:  70%|███████   | 7/10 [00:17<00:07,  2.64s/it]
Testing prompts:  80%|████████  | 8/10 [00:25<00:08,  4.42s/it]
Testing prompts:  90%|█████████ | 9/10 [00:35<00:06,  6.01s/it]
Testing prompts: 100%|██████████| 10/10 [00:49<00:00,  8.35s/it]
Testing prompts: 100%|██████████| 10/10 [00:49<00:00,  4.91s/it]

Testing prompts:   0%|          | 0/6 [00:00<?, ?it/s]
Testing prompts:  17%|█▋        | 1/6 [00:02<00:14,  2.85s/it]
Testing prompts:  33%|███▎      | 2/6 [00:03<00:07,  1.81s/it]
Testing prompts:  50%|█████     | 3/6 [00:17<00:21,  7.18s/it]
Testing prompts:  67%|██████▋   | 4/6 [00:19<00:10,  5.20s/it]
Testing prompts:  83%|████████▎ | 5/6 [00:21<00:04,  4.08s/it]
Testing prompts: 100%|██████████| 6/6 [02:30<00:00, 46.37s/it]
Testing prompts: 100%|██████████| 6/6 [02:30<00:00, 25.04s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<02:02, 13.58s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:50,  6.35s/it]
Testing prompts:  30%|███       | 3/10 [00:27<01:06,  9.45s/it]
Testing prompts:  40%|████      | 4/10 [00:41<01:06, 11.09s/it]
Testing prompts:  50%|█████     | 5/10 [00:42<00:37,  7.51s/it]
Testing prompts:  60%|██████    | 6/10 [00:44<00:22,  5.52s/it]
Testing prompts:  70%|███████   | 7/10 [00:57<00:24,  8.12s/it]
Testing prompts:  80%|████████  | 8/10 [01:12<00:20, 10.10s/it]
Testing prompts:  90%|█████████ | 9/10 [01:26<00:11, 11.55s/it]
Testing prompts: 100%|██████████| 10/10 [01:40<00:00, 12.15s/it]
Testing prompts: 100%|██████████| 10/10 [01:40<00:00, 10.05s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:15,  1.69s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.34s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.18s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.45s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:08,  1.70s/it]
Testing prompts:  60%|██████    | 6/10 [00:23<00:25,  6.32s/it]
Testing prompts:  70%|███████   | 7/10 [00:46<00:36, 12.06s/it]
Testing prompts:  80%|████████  | 8/10 [01:21<00:38, 19.15s/it]
Testing prompts:  90%|█████████ | 9/10 [01:35<00:17, 17.55s/it]
Testing prompts: 100%|██████████| 10/10 [01:36<00:00, 12.45s/it]
Testing prompts: 100%|██████████| 10/10 [01:36<00:00,  9.63s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<02:00, 13.36s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:49,  6.18s/it]
Testing prompts:  30%|███       | 3/10 [00:28<01:08,  9.79s/it]
Testing prompts:  40%|████      | 4/10 [00:42<01:07, 11.26s/it]
Testing prompts:  50%|█████     | 5/10 [00:43<00:37,  7.60s/it]
Testing prompts:  60%|██████    | 6/10 [00:44<00:22,  5.53s/it]
Testing prompts:  70%|███████   | 7/10 [00:59<00:25,  8.39s/it]
Testing prompts:  80%|████████  | 8/10 [01:22<00:26, 13.25s/it]
Testing prompts:  90%|█████████ | 9/10 [02:00<00:20, 20.92s/it]
Testing prompts: 100%|██████████| 10/10 [02:14<00:00, 18.77s/it]
Testing prompts: 100%|██████████| 10/10 [02:14<00:00, 13.44s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:19,  2.14s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:12,  1.50s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:09,  1.37s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:11,  1.89s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:08,  1.66s/it]
Testing prompts:  60%|██████    | 6/10 [00:17<00:17,  4.37s/it]
Testing prompts:  70%|███████   | 7/10 [00:20<00:11,  3.67s/it]
Testing prompts:  80%|████████  | 8/10 [00:30<00:11,  5.87s/it]
Testing prompts:  90%|█████████ | 9/10 [00:31<00:04,  4.41s/it]
Testing prompts: 100%|██████████| 10/10 [00:33<00:00,  3.39s/it]
Testing prompts: 100%|██████████| 10/10 [00:33<00:00,  3.31s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<02:01, 13.47s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:49,  6.19s/it]
Testing prompts:  30%|███       | 3/10 [00:27<01:05,  9.33s/it]
Testing prompts:  40%|████      | 4/10 [00:28<00:36,  6.13s/it]
Testing prompts:  50%|█████     | 5/10 [00:30<00:22,  4.43s/it]
Testing prompts:  60%|██████    | 6/10 [00:32<00:14,  3.59s/it]
Testing prompts:  70%|███████   | 7/10 [00:34<00:09,  3.30s/it]
Testing prompts:  80%|████████  | 8/10 [00:48<00:13,  6.64s/it]
Testing prompts:  90%|█████████ | 9/10 [01:02<00:09,  9.01s/it]
Testing prompts: 100%|██████████| 10/10 [01:23<00:00, 12.64s/it]
Testing prompts: 100%|██████████| 10/10 [01:23<00:00,  8.37s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<02:01, 13.53s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:49,  6.21s/it]
Testing prompts:  30%|███       | 3/10 [00:29<01:09,  9.98s/it]
Testing prompts:  40%|████      | 4/10 [00:30<00:38,  6.42s/it]
Testing prompts:  50%|█████     | 5/10 [00:43<00:44,  8.84s/it]
Testing prompts:  60%|██████    | 6/10 [00:44<00:25,  6.39s/it]
Testing prompts:  70%|███████   | 7/10 [01:00<00:28,  9.39s/it]
Testing prompts:  80%|████████  | 8/10 [01:24<00:28, 14.18s/it]
Testing prompts:  90%|█████████ | 9/10 [01:59<00:20, 20.56s/it]
Testing prompts: 100%|██████████| 10/10 [02:13<00:00, 18.54s/it]
Testing prompts: 100%|██████████| 10/10 [02:13<00:00, 13.34s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.44s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.31s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.17s/it]
Testing prompts:  40%|████      | 4/10 [00:17<00:36,  6.04s/it]
Testing prompts:  50%|█████     | 5/10 [00:18<00:21,  4.30s/it]
Testing prompts:  60%|██████    | 6/10 [00:33<00:31,  7.82s/it]
Testing prompts:  70%|███████   | 7/10 [00:35<00:18,  6.21s/it]
Testing prompts:  80%|████████  | 8/10 [01:12<00:31, 15.79s/it]
Testing prompts:  90%|█████████ | 9/10 [01:46<00:21, 21.48s/it]
Testing prompts: 100%|██████████| 10/10 [02:00<00:00, 19.23s/it]
Testing prompts: 100%|██████████| 10/10 [02:00<00:00, 12.04s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:15,  1.76s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:15,  1.88s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.50s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:10,  1.68s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:08,  1.79s/it]
Testing prompts:  60%|██████    | 6/10 [00:22<00:23,  5.76s/it]
Testing prompts:  70%|███████   | 7/10 [00:36<00:25,  8.42s/it]
Testing prompts:  80%|████████  | 8/10 [00:37<00:12,  6.14s/it]
Testing prompts:  90%|█████████ | 9/10 [01:01<00:11, 11.63s/it]
Testing prompts: 100%|██████████| 10/10 [01:35<00:00, 18.79s/it]
Testing prompts: 100%|██████████| 10/10 [01:35<00:00,  9.58s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<01:58, 13.12s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:47,  5.99s/it]
Testing prompts:  30%|███       | 3/10 [00:15<00:26,  3.72s/it]
Testing prompts:  40%|████      | 4/10 [00:16<00:17,  2.88s/it]
Testing prompts:  50%|█████     | 5/10 [00:29<00:33,  6.61s/it]
Testing prompts:  60%|██████    | 6/10 [00:31<00:19,  4.84s/it]
Testing prompts:  70%|███████   | 7/10 [00:44<00:23,  7.69s/it]
Testing prompts:  80%|████████  | 8/10 [00:57<00:18,  9.36s/it]
Testing prompts:  90%|█████████ | 9/10 [01:12<00:11, 11.06s/it]
Testing prompts: 100%|██████████| 10/10 [01:26<00:00, 11.84s/it]
Testing prompts: 100%|██████████| 10/10 [01:26<00:00,  8.62s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<02:00, 13.44s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:49,  6.17s/it]
Testing prompts:  30%|███       | 3/10 [00:15<00:26,  3.86s/it]
Testing prompts:  40%|████      | 4/10 [00:31<00:52,  8.71s/it]
Testing prompts:  50%|█████     | 5/10 [00:33<00:30,  6.08s/it]
Testing prompts:  60%|██████    | 6/10 [00:34<00:18,  4.50s/it]
Testing prompts:  70%|███████   | 7/10 [00:49<00:23,  7.89s/it]
Testing prompts:  80%|████████  | 8/10 [01:03<00:19,  9.91s/it]
Testing prompts:  90%|█████████ | 9/10 [01:38<00:17, 17.70s/it]
Testing prompts: 100%|██████████| 10/10 [02:03<00:00, 19.81s/it]
Testing prompts: 100%|██████████| 10/10 [02:03<00:00, 12.31s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<01:58, 13.15s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:49,  6.14s/it]
Testing prompts:  30%|███       | 3/10 [00:27<01:05,  9.39s/it]
Testing prompts:  40%|████      | 4/10 [00:28<00:36,  6.10s/it]
Testing prompts:  50%|█████     | 5/10 [00:42<00:44,  8.92s/it]
Testing prompts:  60%|██████    | 6/10 [00:43<00:25,  6.35s/it]
Testing prompts:  70%|███████   | 7/10 [00:57<00:25,  8.60s/it]
Testing prompts:  80%|████████  | 8/10 [01:22<00:27, 13.95s/it]
Testing prompts:  90%|█████████ | 9/10 [01:57<00:20, 20.50s/it]
Testing prompts: 100%|██████████| 10/10 [02:11<00:00, 18.45s/it]
Testing prompts: 100%|██████████| 10/10 [02:11<00:00, 13.14s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<02:01, 13.50s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:48,  6.05s/it]
Testing prompts:  30%|███       | 3/10 [00:27<01:05,  9.42s/it]
Testing prompts:  40%|████      | 4/10 [00:28<00:36,  6.11s/it]
Testing prompts:  50%|█████     | 5/10 [00:42<00:43,  8.74s/it]
Testing prompts:  60%|██████    | 6/10 [00:43<00:25,  6.25s/it]
Testing prompts:  70%|███████   | 7/10 [00:56<00:25,  8.53s/it]
Testing prompts:  80%|████████  | 8/10 [01:20<00:26, 13.29s/it]
Testing prompts:  90%|█████████ | 9/10 [01:54<00:19, 19.82s/it]
Testing prompts: 100%|██████████| 10/10 [02:08<00:00, 18.01s/it]
Testing prompts: 100%|██████████| 10/10 [02:08<00:00, 12.85s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:14,  1.58s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.22s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.44s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:10,  1.77s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:08,  1.74s/it]
Testing prompts:  60%|██████    | 6/10 [00:17<00:17,  4.29s/it]
Testing prompts:  70%|███████   | 7/10 [00:19<00:10,  3.42s/it]
Testing prompts:  80%|████████  | 8/10 [00:27<00:09,  4.91s/it]
Testing prompts:  90%|█████████ | 9/10 [00:36<00:06,  6.23s/it]
Testing prompts: 100%|██████████| 10/10 [00:37<00:00,  4.65s/it]
Testing prompts: 100%|██████████| 10/10 [00:37<00:00,  3.74s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:13<00:53, 13.30s/it]
Testing prompts:  40%|████      | 2/5 [00:14<00:18,  6.08s/it]
Testing prompts:  60%|██████    | 3/5 [00:15<00:07,  3.80s/it]
Testing prompts:  80%|████████  | 4/5 [00:16<00:02,  2.80s/it]
Testing prompts: 100%|██████████| 5/5 [00:17<00:00,  2.16s/it]
Testing prompts: 100%|██████████| 5/5 [00:17<00:00,  3.54s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<02:01, 13.51s/it]
Testing prompts:  20%|██        | 2/10 [00:15<00:54,  6.87s/it]
Testing prompts:  30%|███       | 3/10 [00:17<00:30,  4.40s/it]
Testing prompts:  40%|████      | 4/10 [00:18<00:19,  3.21s/it]
Testing prompts:  50%|█████     | 5/10 [00:19<00:12,  2.52s/it]
Testing prompts:  60%|██████    | 6/10 [00:21<00:09,  2.29s/it]
Testing prompts:  70%|███████   | 7/10 [00:24<00:07,  2.46s/it]
Testing prompts:  80%|████████  | 8/10 [00:38<00:12,  6.01s/it]
Testing prompts:  90%|█████████ | 9/10 [00:52<00:08,  8.53s/it]
Testing prompts: 100%|██████████| 10/10 [01:16<00:00, 13.45s/it]
Testing prompts: 100%|██████████| 10/10 [01:16<00:00,  7.67s/it]

Testing prompts:   0%|          | 0/8 [00:00<?, ?it/s]
Testing prompts:  12%|█▎        | 1/8 [00:13<01:33, 13.39s/it]
Testing prompts:  25%|██▌       | 2/8 [00:14<00:37,  6.23s/it]
Testing prompts:  38%|███▊      | 3/8 [00:28<00:49,  9.83s/it]
Testing prompts:  50%|█████     | 4/8 [00:30<00:25,  6.50s/it]
Testing prompts:  62%|██████▎   | 5/8 [00:31<00:13,  4.62s/it]
Testing prompts:  75%|███████▌  | 6/8 [00:33<00:07,  3.66s/it]
Testing prompts:  88%|████████▊ | 7/8 [00:46<00:06,  6.78s/it]
Testing prompts: 100%|██████████| 8/8 [01:00<00:00,  9.10s/it]
Testing prompts: 100%|██████████| 8/8 [01:00<00:00,  7.56s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<01:57, 13.05s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:48,  6.06s/it]
Testing prompts:  30%|███       | 3/10 [00:28<01:08,  9.71s/it]
Testing prompts:  40%|████      | 4/10 [00:29<00:38,  6.43s/it]
Testing prompts:  50%|█████     | 5/10 [00:30<00:22,  4.56s/it]
Testing prompts:  60%|██████    | 6/10 [00:33<00:15,  3.76s/it]
Testing prompts:  70%|███████   | 7/10 [00:46<00:20,  6.86s/it]
Testing prompts:  80%|████████  | 8/10 [01:01<00:18,  9.46s/it]
Testing prompts:  90%|█████████ | 9/10 [01:25<00:14, 14.07s/it]
Testing prompts: 100%|██████████| 10/10 [01:59<00:00, 20.28s/it]
Testing prompts: 100%|██████████| 10/10 [01:59<00:00, 11.98s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<02:02, 13.60s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:49,  6.14s/it]
Testing prompts:  30%|███       | 3/10 [00:27<01:04,  9.27s/it]
Testing prompts:  40%|████      | 4/10 [00:40<01:04, 10.73s/it]
Testing prompts:  50%|█████     | 5/10 [00:41<00:36,  7.21s/it]
Testing prompts:  60%|██████    | 6/10 [00:42<00:20,  5.17s/it]
Testing prompts:  70%|███████   | 7/10 [00:55<00:23,  7.71s/it]
Testing prompts:  80%|████████  | 8/10 [01:29<00:32, 16.08s/it]
Testing prompts:  90%|█████████ | 9/10 [01:53<00:18, 18.48s/it]
Testing prompts: 100%|██████████| 10/10 [02:07<00:00, 17.26s/it]
Testing prompts: 100%|██████████| 10/10 [02:07<00:00, 12.79s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<02:04, 13.80s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:50,  6.34s/it]
Testing prompts:  30%|███       | 3/10 [00:28<01:06,  9.53s/it]
Testing prompts:  40%|████      | 4/10 [00:30<00:39,  6.63s/it]
Testing prompts:  50%|█████     | 5/10 [00:31<00:23,  4.68s/it]
Testing prompts:  60%|██████    | 6/10 [00:44<00:30,  7.62s/it]
Testing prompts:  70%|███████   | 7/10 [01:20<00:50, 16.72s/it]
Testing prompts:  80%|████████  | 8/10 [01:44<00:38, 19.10s/it]
Testing prompts:  90%|█████████ | 9/10 [01:59<00:17, 17.92s/it]
Testing prompts: 100%|██████████| 10/10 [02:01<00:00, 12.94s/it]
Testing prompts: 100%|██████████| 10/10 [02:01<00:00, 12.17s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<02:00, 13.42s/it]
Testing prompts:  20%|██        | 2/10 [00:14<00:49,  6.14s/it]
Testing prompts:  30%|███       | 3/10 [00:28<01:09,  9.93s/it]
Testing prompts:  40%|████      | 4/10 [00:29<00:38,  6.38s/it]
Testing prompts:  50%|█████     | 5/10 [00:43<00:45,  9.06s/it]
Testing prompts:  60%|██████    | 6/10 [00:45<00:26,  6.53s/it]
Testing prompts:  70%|███████   | 7/10 [01:00<00:27,  9.29s/it]
Testing prompts:  80%|████████  | 8/10 [01:24<00:28, 14.11s/it]
Testing prompts:  90%|█████████ | 9/10 [02:00<00:20, 20.83s/it]
Testing prompts: 100%|██████████| 10/10 [02:15<00:00, 18.99s/it]
Testing prompts: 100%|██████████| 10/10 [02:15<00:00, 13.52s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:13<02:02, 13.65s/it]
Testing prompts:  20%|██        | 2/10 [00:15<00:52,  6.52s/it]
Testing prompts:  30%|███       | 3/10 [00:28<01:07,  9.67s/it]
Testing prompts:  40%|████      | 4/10 [00:29<00:37,  6.32s/it]
Testing prompts:  50%|█████     | 5/10 [00:43<00:44,  8.95s/it]
Testing prompts:  60%|██████    | 6/10 [00:44<00:25,  6.40s/it]
Testing prompts:  70%|███████   | 7/10 [01:00<00:27,  9.31s/it]
Testing prompts:  80%|████████  | 8/10 [01:24<00:28, 14.02s/it]
Testing prompts:  90%|█████████ | 9/10 [01:59<00:20, 20.54s/it]
Testing prompts: 100%|██████████| 10/10 [02:13<00:00, 18.53s/it]
Testing prompts: 100%|██████████| 10/10 [02:13<00:00, 13.32s/it]
