[2025-05-11 09:46:21,345][INFO] Following apps/actions have missing dependencies
[2025-05-11 09:46:21,345][INFO] • CODE_ANALYSIS_TOOL_GET_RELEVANT_CODE: {'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter>=0.22.0', 'tokenizers>=0.19,<0.20'}
[2025-05-11 09:46:21,345][INFO] • SQLTOOL_SQL_QUERY: {'sqlalchemy>=2.0'}
[2025-05-11 09:46:21,345][INFO] • CODE_ANALYSIS_TOOL_CREATE_CODE_MAP: {'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter>=0.22.0', 'tokenizers>=0.19,<0.20'}
[2025-05-11 09:46:21,345][INFO] • CODE_ANALYSIS_TOOL_GET_METHOD_SIGNATURE: {'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter>=0.22.0', 'tokenizers>=0.19,<0.20'}
[2025-05-11 09:46:21,345][INFO] • CODE_ANALYSIS_TOOL_GET_CLASS_INFO: {'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter>=0.22.0', 'tokenizers>=0.19,<0.20'}
[2025-05-11 09:46:21,345][INFO] • CODE_ANALYSIS_TOOL_GET_METHOD_BODY: {'deeplake>3.9,<3.9.39', 'tree_sitter_python>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter>=0.22.0', 'tokenizers>=0.19,<0.20'}
[2025-05-11 09:46:21,345][INFO] Installing dependencies...
[2025-05-11 09:46:21,345][INFO] Installing deeplake>3.9,<3.9.39
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:46:23,876][INFO] Installed deeplake>3.9,<3.9.39
[2025-05-11 09:46:23,876][INFO] Installing tree_sitter_python>=0.22.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:46:26,197][INFO] Installed tree_sitter_python>=0.22.0
[2025-05-11 09:46:26,197][INFO] Installing git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:46:29,176][INFO] Installed git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi
[2025-05-11 09:46:29,177][INFO] Installing tree_sitter>=0.22.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:46:31,504][INFO] Installed tree_sitter>=0.22.0
[2025-05-11 09:46:31,504][INFO] Installing tokenizers>=0.19,<0.20
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:46:33,857][INFO] Installed tokenizers>=0.19,<0.20
[2025-05-11 09:46:33,857][INFO] Installing sqlalchemy>=2.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:46:36,229][INFO] Installed sqlalchemy>=2.0

Testing prompts:   0%|          | 0/7 [00:00<?, ?it/s]
Testing prompts:  14%|█▍        | 1/7 [00:04<00:24,  4.04s/it]
Testing prompts:  29%|██▊       | 2/7 [00:12<00:33,  6.60s/it]
Testing prompts:  43%|████▎     | 3/7 [00:14<00:18,  4.52s/it]
Testing prompts:  57%|█████▋    | 4/7 [00:15<00:09,  3.24s/it]
Testing prompts:  71%|███████▏  | 5/7 [00:16<00:04,  2.45s/it]
Testing prompts:  86%|████████▌ | 6/7 [00:21<00:03,  3.13s/it]
Testing prompts: 100%|██████████| 7/7 [00:32<00:00,  5.67s/it]
Testing prompts: 100%|██████████| 7/7 [00:32<00:00,  4.59s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:06,  1.69s/it]
Testing prompts:  40%|████      | 2/5 [00:02<00:04,  1.37s/it]
Testing prompts:  60%|██████    | 3/5 [00:07<00:05,  2.91s/it]
Testing prompts:  80%|████████  | 4/5 [00:08<00:02,  2.19s/it]
Testing prompts: 100%|██████████| 5/5 [00:10<00:00,  2.23s/it]
Testing prompts: 100%|██████████| 5/5 [00:10<00:00,  2.20s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:06,  1.58s/it]
Testing prompts:  40%|████      | 2/5 [00:02<00:04,  1.38s/it]
Testing prompts:  60%|██████    | 3/5 [00:10<00:08,  4.11s/it]
Testing prompts:  80%|████████  | 4/5 [00:11<00:02,  2.90s/it]
Testing prompts: 100%|██████████| 5/5 [00:18<00:00,  4.34s/it]
Testing prompts: 100%|██████████| 5/5 [00:18<00:00,  3.62s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:04,  1.10s/it]
Testing prompts:  40%|████      | 2/5 [00:14<00:24,  8.07s/it]
Testing prompts:  60%|██████    | 3/5 [00:16<00:10,  5.31s/it]
Testing prompts:  80%|████████  | 4/5 [00:17<00:03,  3.67s/it]
Testing prompts: 100%|██████████| 5/5 [00:19<00:00,  3.09s/it]
Testing prompts: 100%|██████████| 5/5 [00:19<00:00,  3.86s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:04,  1.21s/it]
Testing prompts:  40%|████      | 2/5 [00:14<00:24,  8.23s/it]
Testing prompts:  60%|██████    | 3/5 [00:15<00:10,  5.09s/it]
Testing prompts:  80%|████████  | 4/5 [00:17<00:03,  3.87s/it]
Testing prompts: 100%|██████████| 5/5 [00:18<00:00,  2.92s/it]
Testing prompts: 100%|██████████| 5/5 [00:18<00:00,  3.79s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.44s/it]
Testing prompts:  20%|██        | 2/10 [00:09<00:42,  5.31s/it]
Testing prompts:  30%|███       | 3/10 [00:11<00:26,  3.78s/it]
Testing prompts:  40%|████      | 4/10 [00:12<00:17,  2.85s/it]
Testing prompts:  50%|█████     | 5/10 [00:14<00:12,  2.60s/it]
Testing prompts:  60%|██████    | 6/10 [00:23<00:18,  4.62s/it]
Testing prompts:  70%|███████   | 7/10 [00:24<00:10,  3.49s/it]
Testing prompts:  80%|████████  | 8/10 [00:26<00:05,  2.81s/it]
Testing prompts:  90%|█████████ | 9/10 [01:00<00:12, 12.68s/it]
Testing prompts: 100%|██████████| 10/10 [01:28<00:00, 17.36s/it]
Testing prompts: 100%|██████████| 10/10 [01:28<00:00,  8.83s/it]

Testing prompts:   0%|          | 0/7 [00:00<?, ?it/s]
Testing prompts:  14%|█▍        | 1/7 [00:01<00:07,  1.20s/it]
Testing prompts:  29%|██▊       | 2/7 [00:03<00:10,  2.12s/it]
Testing prompts:  43%|████▎     | 3/7 [00:05<00:06,  1.69s/it]
Testing prompts:  57%|█████▋    | 4/7 [00:06<00:04,  1.44s/it]
Testing prompts:  71%|███████▏  | 5/7 [00:14<00:08,  4.05s/it]
Testing prompts:  86%|████████▌ | 6/7 [00:15<00:02,  2.90s/it]
Testing prompts: 100%|██████████| 7/7 [00:19<00:00,  3.38s/it]
Testing prompts: 100%|██████████| 7/7 [00:19<00:00,  2.84s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:10,  1.12s/it]
Testing prompts:  20%|██        | 2/10 [00:33<02:34, 19.27s/it]
Testing prompts:  30%|███       | 3/10 [00:39<01:35, 13.59s/it]
Testing prompts:  40%|████      | 4/10 [00:41<00:52,  8.70s/it]
Testing prompts:  50%|█████     | 5/10 [00:42<00:30,  6.10s/it]
Testing prompts:  60%|██████    | 6/10 [00:54<00:31,  7.96s/it]
Testing prompts:  70%|███████   | 7/10 [01:04<00:26,  8.75s/it]
Testing prompts:  80%|████████  | 8/10 [01:13<00:17,  8.97s/it]
Testing prompts:  90%|█████████ | 9/10 [01:17<00:07,  7.32s/it]
Testing prompts: 100%|██████████| 10/10 [01:18<00:00,  5.41s/it]
Testing prompts: 100%|██████████| 10/10 [01:18<00:00,  7.88s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:02<00:10,  2.54s/it]
Testing prompts:  40%|████      | 2/5 [00:28<00:49, 16.48s/it]
Testing prompts:  60%|██████    | 3/5 [00:36<00:25, 12.66s/it]
Testing prompts:  80%|████████  | 4/5 [00:38<00:08,  8.15s/it]
Testing prompts: 100%|██████████| 5/5 [00:39<00:00,  5.63s/it]
Testing prompts: 100%|██████████| 5/5 [00:39<00:00,  7.86s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:04,  1.17s/it]
Testing prompts:  40%|████      | 2/5 [00:09<00:15,  5.11s/it]
Testing prompts:  60%|██████    | 3/5 [00:10<00:06,  3.25s/it]
Testing prompts:  80%|████████  | 4/5 [00:11<00:02,  2.66s/it]
Testing prompts: 100%|██████████| 5/5 [00:13<00:00,  2.43s/it]
Testing prompts: 100%|██████████| 5/5 [00:13<00:00,  2.77s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:05,  1.27s/it]
Testing prompts:  40%|████      | 2/5 [00:02<00:03,  1.22s/it]
Testing prompts:  60%|██████    | 3/5 [00:31<00:27, 13.83s/it]
Testing prompts:  80%|████████  | 4/5 [00:31<00:08,  8.63s/it]
Testing prompts: 100%|██████████| 5/5 [01:04<00:00, 17.29s/it]
Testing prompts: 100%|██████████| 5/5 [01:04<00:00, 12.92s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:05,  1.34s/it]
Testing prompts:  40%|████      | 2/5 [00:34<01:00, 20.27s/it]
Testing prompts:  60%|██████    | 3/5 [00:36<00:23, 11.57s/it]
Testing prompts:  80%|████████  | 4/5 [00:37<00:07,  7.41s/it]
Testing prompts: 100%|██████████| 5/5 [00:42<00:00,  6.63s/it]
Testing prompts: 100%|██████████| 5/5 [00:42<00:00,  8.47s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:04,  1.10s/it]
Testing prompts:  40%|████      | 2/5 [00:03<00:05,  1.90s/it]
Testing prompts:  60%|██████    | 3/5 [00:04<00:03,  1.58s/it]
Testing prompts:  80%|████████  | 4/5 [00:06<00:01,  1.45s/it]
Testing prompts: 100%|██████████| 5/5 [00:10<00:00,  2.37s/it]
Testing prompts: 100%|██████████| 5/5 [00:10<00:00,  2.00s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:02<00:09,  2.49s/it]
Testing prompts:  40%|████      | 2/5 [00:03<00:04,  1.65s/it]
Testing prompts:  60%|██████    | 3/5 [00:12<00:10,  5.01s/it]
Testing prompts:  80%|████████  | 4/5 [00:13<00:03,  3.53s/it]
Testing prompts: 100%|██████████| 5/5 [00:16<00:00,  3.18s/it]
Testing prompts: 100%|██████████| 5/5 [00:16<00:00,  3.28s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:07,  1.92s/it]
Testing prompts:  40%|████      | 2/5 [00:19<00:33, 11.10s/it]
Testing prompts:  60%|██████    | 3/5 [00:21<00:13,  6.92s/it]
Testing prompts:  80%|████████  | 4/5 [00:23<00:04,  4.90s/it]
Testing prompts: 100%|██████████| 5/5 [00:24<00:00,  3.66s/it]
Testing prompts: 100%|██████████| 5/5 [00:24<00:00,  4.93s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:07,  1.92s/it]
Testing prompts:  40%|████      | 2/5 [01:06<01:56, 38.91s/it]
Testing prompts:  60%|██████    | 3/5 [01:39<01:11, 35.90s/it]
Testing prompts:  80%|████████  | 4/5 [01:40<00:22, 22.19s/it]
Testing prompts: 100%|██████████| 5/5 [01:41<00:00, 14.65s/it]
Testing prompts: 100%|██████████| 5/5 [01:41<00:00, 20.30s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:04,  1.21s/it]
Testing prompts:  40%|████      | 2/5 [00:19<00:34, 11.38s/it]
Testing prompts:  60%|██████    | 3/5 [00:21<00:14,  7.20s/it]
Testing prompts:  80%|████████  | 4/5 [00:23<00:04,  4.95s/it]
Testing prompts: 100%|██████████| 5/5 [00:24<00:00,  3.59s/it]
Testing prompts: 100%|██████████| 5/5 [00:24<00:00,  4.92s/it]

Testing prompts:   0%|          | 0/9 [00:00<?, ?it/s]
Testing prompts:  11%|█         | 1/9 [00:01<00:10,  1.30s/it]
Testing prompts:  22%|██▏       | 2/9 [00:12<00:48,  7.00s/it]
Testing prompts:  33%|███▎      | 3/9 [00:51<02:10, 21.75s/it]
Testing prompts:  44%|████▍     | 4/9 [00:52<01:07, 13.56s/it]
Testing prompts:  56%|█████▌    | 5/9 [00:53<00:36,  9.09s/it]
Testing prompts:  67%|██████▋   | 6/9 [01:02<00:26,  8.93s/it]
Testing prompts:  78%|███████▊  | 7/9 [01:03<00:12,  6.42s/it]
Testing prompts:  89%|████████▉ | 8/9 [01:04<00:04,  4.77s/it]
Testing prompts: 100%|██████████| 9/9 [01:12<00:00,  5.72s/it]
Testing prompts: 100%|██████████| 9/9 [01:12<00:00,  8.07s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:04,  1.17s/it]
Testing prompts:  40%|████      | 2/5 [00:04<00:07,  2.48s/it]
Testing prompts:  60%|██████    | 3/5 [00:06<00:04,  2.16s/it]
Testing prompts:  80%|████████  | 4/5 [00:07<00:01,  1.84s/it]
Testing prompts: 100%|██████████| 5/5 [00:12<00:00,  2.98s/it]
Testing prompts: 100%|██████████| 5/5 [00:12<00:00,  2.54s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:05<00:21,  5.33s/it]
Testing prompts:  40%|████      | 2/5 [00:09<00:13,  4.62s/it]
Testing prompts:  60%|██████    | 3/5 [00:11<00:06,  3.26s/it]
Testing prompts:  80%|████████  | 4/5 [00:12<00:02,  2.45s/it]
Testing prompts: 100%|██████████| 5/5 [00:17<00:00,  3.33s/it]
Testing prompts: 100%|██████████| 5/5 [00:17<00:00,  3.44s/it]

Testing prompts:   0%|          | 0/7 [00:00<?, ?it/s]
Testing prompts:  14%|█▍        | 1/7 [00:01<00:07,  1.21s/it]
Testing prompts:  29%|██▊       | 2/7 [00:03<00:08,  1.64s/it]
Testing prompts:  43%|████▎     | 3/7 [00:04<00:06,  1.60s/it]
Testing prompts:  57%|█████▋    | 4/7 [00:05<00:04,  1.40s/it]
Testing prompts:  71%|███████▏  | 5/7 [00:08<00:03,  1.94s/it]
Testing prompts:  86%|████████▌ | 6/7 [00:09<00:01,  1.71s/it]
Testing prompts: 100%|██████████| 7/7 [00:50<00:00, 14.40s/it]
Testing prompts: 100%|██████████| 7/7 [00:50<00:00,  7.21s/it]

Testing prompts:   0%|          | 0/7 [00:00<?, ?it/s]
Testing prompts:  14%|█▍        | 1/7 [00:01<00:11,  1.90s/it]
Testing prompts:  29%|██▊       | 2/7 [00:05<00:13,  2.66s/it]
Testing prompts:  43%|████▎     | 3/7 [00:07<00:09,  2.40s/it]
Testing prompts:  57%|█████▋    | 4/7 [00:09<00:06,  2.27s/it]
Testing prompts:  71%|███████▏  | 5/7 [00:10<00:03,  1.86s/it]
Testing prompts:  86%|████████▌ | 6/7 [00:16<00:03,  3.32s/it]
Testing prompts: 100%|██████████| 7/7 [00:59<00:00, 16.34s/it]
Testing prompts: 100%|██████████| 7/7 [00:59<00:00,  8.53s/it]

Testing prompts:   0%|          | 0/7 [00:00<?, ?it/s]
Testing prompts:  14%|█▍        | 1/7 [00:01<00:09,  1.52s/it]
Testing prompts:  29%|██▊       | 2/7 [00:04<00:12,  2.43s/it]
Testing prompts:  43%|████▎     | 3/7 [00:05<00:07,  1.86s/it]
Testing prompts:  57%|█████▋    | 4/7 [00:06<00:04,  1.57s/it]
Testing prompts:  71%|███████▏  | 5/7 [00:08<00:02,  1.40s/it]
Testing prompts:  86%|████████▌ | 6/7 [00:18<00:04,  4.42s/it]
Testing prompts: 100%|██████████| 7/7 [01:03<00:00, 17.85s/it]
Testing prompts: 100%|██████████| 7/7 [01:03<00:00,  9.11s/it]

Testing prompts:   0%|          | 0/6 [00:00<?, ?it/s]
Testing prompts:  17%|█▋        | 1/6 [00:01<00:05,  1.12s/it]
Testing prompts:  33%|███▎      | 2/6 [00:08<00:19,  4.93s/it]
Testing prompts:  50%|█████     | 3/6 [00:17<00:19,  6.60s/it]
Testing prompts:  67%|██████▋   | 4/6 [00:18<00:08,  4.43s/it]
Testing prompts:  83%|████████▎ | 5/6 [00:19<00:03,  3.34s/it]
Testing prompts: 100%|██████████| 6/6 [00:29<00:00,  5.35s/it]
Testing prompts: 100%|██████████| 6/6 [00:29<00:00,  4.85s/it]

Testing prompts:   0%|          | 0/6 [00:00<?, ?it/s]
Testing prompts:  17%|█▋        | 1/6 [00:11<00:56, 11.37s/it]
Testing prompts:  33%|███▎      | 2/6 [00:14<00:25,  6.43s/it]
Testing prompts:  50%|█████     | 3/6 [00:15<00:12,  4.24s/it]
Testing prompts:  67%|██████▋   | 4/6 [00:17<00:06,  3.36s/it]
Testing prompts:  83%|████████▎ | 5/6 [00:19<00:02,  2.57s/it]
Testing prompts: 100%|██████████| 6/6 [00:21<00:00,  2.40s/it]
Testing prompts: 100%|██████████| 6/6 [00:21<00:00,  3.54s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:05,  1.32s/it]
Testing prompts:  40%|████      | 2/5 [00:11<00:19,  6.61s/it]
Testing prompts:  60%|██████    | 3/5 [00:12<00:08,  4.18s/it]
Testing prompts:  80%|████████  | 4/5 [00:14<00:03,  3.01s/it]
Testing prompts: 100%|██████████| 5/5 [00:15<00:00,  2.39s/it]
Testing prompts: 100%|██████████| 5/5 [00:15<00:00,  3.09s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:03<00:14,  3.65s/it]
Testing prompts:  40%|████      | 2/5 [00:05<00:08,  2.73s/it]
Testing prompts:  60%|██████    | 3/5 [00:06<00:03,  2.00s/it]
Testing prompts:  80%|████████  | 4/5 [00:08<00:01,  1.71s/it]
Testing prompts: 100%|██████████| 5/5 [00:09<00:00,  1.52s/it]
Testing prompts: 100%|██████████| 5/5 [00:09<00:00,  1.86s/it]

Testing prompts:   0%|          | 0/6 [00:00<?, ?it/s]
Testing prompts:  17%|█▋        | 1/6 [00:00<00:04,  1.05it/s]
Testing prompts:  33%|███▎      | 2/6 [00:02<00:05,  1.42s/it]
Testing prompts:  50%|█████     | 3/6 [00:04<00:05,  1.76s/it]
Testing prompts:  67%|██████▋   | 4/6 [00:05<00:02,  1.49s/it]
Testing prompts:  83%|████████▎ | 5/6 [00:07<00:01,  1.63s/it]
Testing prompts: 100%|██████████| 6/6 [00:17<00:00,  4.24s/it]
Testing prompts: 100%|██████████| 6/6 [00:17<00:00,  2.85s/it]

Testing prompts:   0%|          | 0/7 [00:00<?, ?it/s]
Testing prompts:  14%|█▍        | 1/7 [00:04<00:26,  4.38s/it]
Testing prompts:  29%|██▊       | 2/7 [00:12<00:33,  6.72s/it]
Testing prompts:  43%|████▎     | 3/7 [00:14<00:17,  4.27s/it]
Testing prompts:  57%|█████▋    | 4/7 [00:15<00:09,  3.07s/it]
Testing prompts:  71%|███████▏  | 5/7 [00:16<00:04,  2.39s/it]
Testing prompts:  86%|████████▌ | 6/7 [00:17<00:01,  1.90s/it]
Testing prompts: 100%|██████████| 7/7 [00:40<00:00,  8.93s/it]
Testing prompts: 100%|██████████| 7/7 [00:40<00:00,  5.84s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:04,  1.13s/it]
Testing prompts:  40%|████      | 2/5 [00:12<00:21,  7.30s/it]
Testing prompts:  60%|██████    | 3/5 [00:14<00:09,  4.87s/it]
Testing prompts:  80%|████████  | 4/5 [00:16<00:03,  3.47s/it]
Testing prompts: 100%|██████████| 5/5 [00:21<00:00,  4.14s/it]
Testing prompts: 100%|██████████| 5/5 [00:21<00:00,  4.28s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:04,  1.22s/it]
Testing prompts:  40%|████      | 2/5 [00:12<00:20,  6.95s/it]
Testing prompts:  60%|██████    | 3/5 [00:13<00:08,  4.26s/it]
Testing prompts:  80%|████████  | 4/5 [00:14<00:03,  3.09s/it]
Testing prompts: 100%|██████████| 5/5 [00:16<00:00,  2.58s/it]
Testing prompts: 100%|██████████| 5/5 [00:16<00:00,  3.24s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:04,  1.15s/it]
Testing prompts:  40%|████      | 2/5 [00:11<00:19,  6.61s/it]
Testing prompts:  60%|██████    | 3/5 [00:12<00:08,  4.02s/it]
Testing prompts:  80%|████████  | 4/5 [00:14<00:03,  3.03s/it]
Testing prompts: 100%|██████████| 5/5 [00:15<00:00,  2.51s/it]
Testing prompts: 100%|██████████| 5/5 [00:15<00:00,  3.12s/it]

Testing prompts:   0%|          | 0/6 [00:00<?, ?it/s]
Testing prompts:  17%|█▋        | 1/6 [00:01<00:05,  1.14s/it]
Testing prompts:  33%|███▎      | 2/6 [00:04<00:10,  2.51s/it]
Testing prompts:  50%|█████     | 3/6 [00:05<00:05,  1.92s/it]
Testing prompts:  67%|██████▋   | 4/6 [00:06<00:03,  1.60s/it]
Testing prompts:  83%|████████▎ | 5/6 [00:08<00:01,  1.48s/it]
Testing prompts: 100%|██████████| 6/6 [00:11<00:00,  2.14s/it]
Testing prompts: 100%|██████████| 6/6 [00:11<00:00,  1.94s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:07,  1.90s/it]
Testing prompts:  40%|████      | 2/5 [00:03<00:05,  1.99s/it]
Testing prompts:  60%|██████    | 3/5 [00:05<00:04,  2.01s/it]
Testing prompts:  80%|████████  | 4/5 [00:07<00:01,  1.73s/it]
Testing prompts: 100%|██████████| 5/5 [00:08<00:00,  1.58s/it]
Testing prompts: 100%|██████████| 5/5 [00:08<00:00,  1.72s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:03<00:12,  3.04s/it]
Testing prompts:  40%|████      | 2/5 [00:04<00:06,  2.02s/it]
Testing prompts:  60%|██████    | 3/5 [00:45<00:39, 19.70s/it]
Testing prompts:  80%|████████  | 4/5 [00:46<00:12, 12.63s/it]
Testing prompts: 100%|██████████| 5/5 [00:49<00:00,  9.07s/it]
Testing prompts: 100%|██████████| 5/5 [00:49<00:00,  9.93s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:05,  1.42s/it]
Testing prompts:  40%|████      | 2/5 [00:02<00:04,  1.34s/it]
Testing prompts:  60%|██████    | 3/5 [00:08<00:06,  3.28s/it]
Testing prompts:  80%|████████  | 4/5 [00:09<00:02,  2.64s/it]
Testing prompts: 100%|██████████| 5/5 [00:13<00:00,  2.83s/it]
Testing prompts: 100%|██████████| 5/5 [00:13<00:00,  2.63s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.49s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:15,  1.93s/it]
Testing prompts:  30%|███       | 3/10 [00:12<00:36,  5.16s/it]
Testing prompts:  40%|████      | 4/10 [00:13<00:21,  3.52s/it]
Testing prompts:  50%|█████     | 5/10 [00:15<00:13,  2.74s/it]
Testing prompts:  60%|██████    | 6/10 [00:25<00:21,  5.45s/it]
Testing prompts:  70%|███████   | 7/10 [00:31<00:16,  5.66s/it]
Testing prompts:  80%|████████  | 8/10 [00:40<00:12,  6.45s/it]
Testing prompts:  90%|█████████ | 9/10 [00:53<00:08,  8.58s/it]
Testing prompts: 100%|██████████| 10/10 [00:54<00:00,  6.31s/it]
Testing prompts: 100%|██████████| 10/10 [00:54<00:00,  5.45s/it]

Testing prompts:   0%|          | 0/7 [00:00<?, ?it/s]
Testing prompts:  14%|█▍        | 1/7 [00:01<00:06,  1.12s/it]
Testing prompts:  29%|██▊       | 2/7 [00:03<00:09,  1.85s/it]
Testing prompts:  43%|████▎     | 3/7 [00:04<00:06,  1.66s/it]
Testing prompts:  57%|█████▋    | 4/7 [00:06<00:04,  1.47s/it]
Testing prompts:  71%|███████▏  | 5/7 [00:07<00:03,  1.52s/it]
Testing prompts:  86%|████████▌ | 6/7 [00:09<00:01,  1.53s/it]
Testing prompts: 100%|██████████| 7/7 [00:19<00:00,  4.39s/it]
Testing prompts: 100%|██████████| 7/7 [00:19<00:00,  2.79s/it]

Testing prompts:   0%|          | 0/8 [00:00<?, ?it/s]
Testing prompts:  12%|█▎        | 1/8 [00:01<00:12,  1.73s/it]
Testing prompts:  25%|██▌       | 2/8 [00:06<00:21,  3.59s/it]
Testing prompts:  38%|███▊      | 3/8 [00:07<00:11,  2.33s/it]
Testing prompts:  50%|█████     | 4/8 [00:09<00:08,  2.22s/it]
Testing prompts:  62%|██████▎   | 5/8 [00:10<00:05,  1.86s/it]
Testing prompts:  75%|███████▌  | 6/8 [00:11<00:03,  1.59s/it]
Testing prompts:  88%|████████▊ | 7/8 [00:19<00:03,  3.61s/it]
Testing prompts: 100%|██████████| 8/8 [00:20<00:00,  2.83s/it]
Testing prompts: 100%|██████████| 8/8 [00:20<00:00,  2.59s/it]

Testing prompts:   0%|          | 0/8 [00:00<?, ?it/s]
Testing prompts:  12%|█▎        | 1/8 [00:13<01:35, 13.60s/it]
Testing prompts:  25%|██▌       | 2/8 [00:27<01:23, 13.86s/it]
Testing prompts:  38%|███▊      | 3/8 [00:29<00:41,  8.28s/it]
Testing prompts:  50%|█████     | 4/8 [00:31<00:22,  5.71s/it]
Testing prompts:  62%|██████▎   | 5/8 [00:32<00:12,  4.20s/it]
Testing prompts:  75%|███████▌  | 6/8 [00:34<00:06,  3.40s/it]
Testing prompts:  88%|████████▊ | 7/8 [01:32<00:21, 21.44s/it]
Testing prompts: 100%|██████████| 8/8 [01:34<00:00, 15.08s/it]
Testing prompts: 100%|██████████| 8/8 [01:34<00:00, 11.81s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:03<00:12,  3.07s/it]
Testing prompts:  40%|████      | 2/5 [00:04<00:06,  2.02s/it]
Testing prompts:  60%|██████    | 3/5 [00:11<00:08,  4.19s/it]
Testing prompts:  80%|████████  | 4/5 [00:12<00:02,  2.97s/it]
Testing prompts: 100%|██████████| 5/5 [00:15<00:00,  2.95s/it]
Testing prompts: 100%|██████████| 5/5 [00:15<00:00,  3.03s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:04,  1.21s/it]
Testing prompts:  40%|████      | 2/5 [00:12<00:21,  7.16s/it]
Testing prompts:  60%|██████    | 3/5 [00:22<00:16,  8.26s/it]
Testing prompts:  80%|████████  | 4/5 [00:23<00:05,  5.41s/it]
Testing prompts: 100%|██████████| 5/5 [00:24<00:00,  3.95s/it]
Testing prompts: 100%|██████████| 5/5 [00:24<00:00,  4.90s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:04,  1.21s/it]
Testing prompts:  40%|████      | 2/5 [00:06<00:11,  3.89s/it]
Testing prompts:  60%|██████    | 3/5 [00:39<00:33, 16.97s/it]
Testing prompts:  80%|████████  | 4/5 [00:40<00:10, 10.71s/it]
Testing prompts: 100%|██████████| 5/5 [00:41<00:00,  7.21s/it]
Testing prompts: 100%|██████████| 5/5 [00:41<00:00,  8.32s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:06,  1.72s/it]
Testing prompts:  40%|████      | 2/5 [00:02<00:04,  1.40s/it]
Testing prompts:  60%|██████    | 3/5 [00:11<00:09,  4.57s/it]
Testing prompts:  80%|████████  | 4/5 [00:12<00:03,  3.19s/it]
Testing prompts: 100%|██████████| 5/5 [00:14<00:00,  2.87s/it]
Testing prompts: 100%|██████████| 5/5 [00:14<00:00,  2.92s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:07,  1.98s/it]
Testing prompts:  40%|████      | 2/5 [00:34<00:59, 19.92s/it]
Testing prompts:  60%|██████    | 3/5 [00:39<00:26, 13.17s/it]
Testing prompts:  80%|████████  | 4/5 [00:40<00:08,  8.52s/it]
Testing prompts: 100%|██████████| 5/5 [00:48<00:00,  8.06s/it]
Testing prompts: 100%|██████████| 5/5 [00:48<00:00,  9.65s/it]
