[2025-05-11 09:11:07,001][INFO] Following apps/actions have missing dependencies
[2025-05-11 09:11:07,001][INFO] • CODE_ANALYSIS_TOOL_GET_RELEVANT_CODE: {'tree_sitter>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter_python>=0.22.0', 'tokenizers>=0.19,<0.20', 'deeplake>3.9,<3.9.39'}
[2025-05-11 09:11:07,001][INFO] • SQLTOOL_SQL_QUERY: {'sqlalchemy>=2.0'}
[2025-05-11 09:11:07,001][INFO] • CODE_ANALYSIS_TOOL_CREATE_CODE_MAP: {'tree_sitter>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter_python>=0.22.0', 'tokenizers>=0.19,<0.20', 'deeplake>3.9,<3.9.39'}
[2025-05-11 09:11:07,001][INFO] • CODE_ANALYSIS_TOOL_GET_METHOD_SIGNATURE: {'tree_sitter>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter_python>=0.22.0', 'tokenizers>=0.19,<0.20', 'deeplake>3.9,<3.9.39'}
[2025-05-11 09:11:07,001][INFO] • CODE_ANALYSIS_TOOL_GET_CLASS_INFO: {'tree_sitter>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter_python>=0.22.0', 'tokenizers>=0.19,<0.20', 'deeplake>3.9,<3.9.39'}
[2025-05-11 09:11:07,001][INFO] • CODE_ANALYSIS_TOOL_GET_METHOD_BODY: {'tree_sitter>=0.22.0', 'git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi', 'tree_sitter_python>=0.22.0', 'tokenizers>=0.19,<0.20', 'deeplake>3.9,<3.9.39'}
[2025-05-11 09:11:07,001][INFO] Installing dependencies...
[2025-05-11 09:11:07,001][INFO] Installing tree_sitter>=0.22.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:11:09,461][INFO] Installed tree_sitter>=0.22.0
[2025-05-11 09:11:09,461][INFO] Installing git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:11:12,583][INFO] Installed git+https://github.com/DataDog/jedi.git@92d0c807b0dcd115b1ffd0a4ed21e44db127c2fb#egg=jedi
[2025-05-11 09:11:12,583][INFO] Installing tree_sitter_python>=0.22.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:11:14,939][INFO] Installed tree_sitter_python>=0.22.0
[2025-05-11 09:11:14,939][INFO] Installing tokenizers>=0.19,<0.20
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:11:17,319][INFO] Installed tokenizers>=0.19,<0.20
[2025-05-11 09:11:17,319][INFO] Installing deeplake>3.9,<3.9.39
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Error parsing requirements for jedi: [Errno 2] No such file or directory: '/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages/jedi-0.19.1.dist-info/METADATA'
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:11:19,787][INFO] Installed deeplake>3.9,<3.9.39
[2025-05-11 09:11:19,787][INFO] Installing sqlalchemy>=2.0
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution - (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -0di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -1di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -2di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -3di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -4di (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
WARNING: Ignoring invalid distribution -edi (/home/ubuntu/miniconda3/envs/agenttools/lib/python3.10/site-packages)
[2025-05-11 09:11:22,141][INFO] Installed sqlalchemy>=2.0

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:20,  2.23s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:15,  1.95s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:11,  1.68s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:08,  1.46s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:06,  1.22s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:04,  1.19s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:03,  1.28s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:02,  1.47s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.62s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.85s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.60s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:03<00:27,  3.06s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:18,  2.31s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:14,  2.10s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:10,  1.69s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:06,  1.37s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:04,  1.21s/it]
Testing prompts:  70%|███████   | 7/10 [00:11<00:04,  1.42s/it]
Testing prompts:  80%|████████  | 8/10 [00:12<00:02,  1.24s/it]
Testing prompts:  90%|█████████ | 9/10 [00:14<00:01,  1.63s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.45s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.57s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:23,  2.61s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:16,  2.00s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:15,  2.23s/it]
Testing prompts:  40%|████      | 4/10 [00:08<00:11,  1.89s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:07,  1.40s/it]
Testing prompts:  60%|██████    | 6/10 [00:10<00:05,  1.49s/it]
Testing prompts:  70%|███████   | 7/10 [00:11<00:04,  1.51s/it]
Testing prompts:  80%|████████  | 8/10 [00:13<00:03,  1.53s/it]
Testing prompts:  90%|█████████ | 9/10 [00:15<00:01,  1.87s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  1.66s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  1.72s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:22,  2.50s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:15,  1.92s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.84s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:09,  1.55s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:06,  1.29s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:05,  1.36s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:04,  1.48s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:02,  1.31s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.37s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.38s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.47s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:23,  2.64s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:16,  2.01s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.85s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:08,  1.48s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:06,  1.33s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:05,  1.41s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:04,  1.39s/it]
Testing prompts:  80%|████████  | 8/10 [00:12<00:03,  1.52s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.26s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.50s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.53s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.09it/s]
Testing prompts:  20%|██        | 2/10 [00:03<00:15,  1.91s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.73s/it]
Testing prompts:  40%|████      | 4/10 [00:15<00:30,  5.09s/it]
Testing prompts:  50%|█████     | 5/10 [00:17<00:19,  3.92s/it]
Testing prompts:  60%|██████    | 6/10 [00:19<00:13,  3.27s/it]
Testing prompts:  70%|███████   | 7/10 [00:20<00:07,  2.63s/it]
Testing prompts:  80%|████████  | 8/10 [00:22<00:04,  2.43s/it]
Testing prompts:  90%|█████████ | 9/10 [00:24<00:02,  2.18s/it]
Testing prompts: 100%|██████████| 10/10 [00:31<00:00,  3.66s/it]
Testing prompts: 100%|██████████| 10/10 [00:31<00:00,  3.10s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:09,  1.00s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:12,  1.58s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:11,  1.71s/it]
Testing prompts:  40%|████      | 4/10 [00:15<00:31,  5.19s/it]
Testing prompts:  50%|█████     | 5/10 [00:17<00:20,  4.01s/it]
Testing prompts:  60%|██████    | 6/10 [00:22<00:17,  4.45s/it]
Testing prompts:  70%|███████   | 7/10 [00:24<00:10,  3.64s/it]
Testing prompts:  80%|████████  | 8/10 [00:26<00:06,  3.11s/it]
Testing prompts:  90%|█████████ | 9/10 [00:28<00:02,  2.77s/it]
Testing prompts: 100%|██████████| 10/10 [00:30<00:00,  2.49s/it]
Testing prompts: 100%|██████████| 10/10 [00:30<00:00,  3.04s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:20,  2.27s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.78s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:13,  1.87s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:10,  1.67s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:06,  1.34s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:05,  1.42s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:04,  1.36s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:02,  1.11s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.05s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.08s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.33s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:03<00:31,  3.48s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:18,  2.25s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:12,  1.76s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:08,  1.40s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:07,  1.42s/it]
Testing prompts:  60%|██████    | 6/10 [00:10<00:06,  1.53s/it]
Testing prompts:  70%|███████   | 7/10 [00:11<00:04,  1.64s/it]
Testing prompts:  80%|████████  | 8/10 [00:13<00:03,  1.67s/it]
Testing prompts:  90%|█████████ | 9/10 [00:14<00:01,  1.44s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.60s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.66s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:00<00:02,  1.11it/s]
Testing prompts:  50%|█████     | 2/4 [00:02<00:02,  1.46s/it]
Testing prompts:  75%|███████▌  | 3/4 [00:04<00:01,  1.61s/it]
Testing prompts: 100%|██████████| 4/4 [01:55<00:00, 44.96s/it]
Testing prompts: 100%|██████████| 4/4 [01:55<00:00, 28.99s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.46s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:17,  2.15s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:13,  1.96s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:11,  1.94s/it]
Testing prompts:  50%|█████     | 5/10 [00:09<00:10,  2.03s/it]
Testing prompts:  60%|██████    | 6/10 [00:11<00:07,  1.94s/it]
Testing prompts:  70%|███████   | 7/10 [00:13<00:05,  1.98s/it]
Testing prompts:  80%|████████  | 8/10 [00:15<00:04,  2.01s/it]
Testing prompts:  90%|█████████ | 9/10 [00:18<00:02,  2.07s/it]
Testing prompts: 100%|██████████| 10/10 [00:19<00:00,  1.86s/it]
Testing prompts: 100%|██████████| 10/10 [00:19<00:00,  1.94s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.21it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:12,  1.50s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:12,  1.74s/it]
Testing prompts:  40%|████      | 4/10 [00:14<00:30,  5.04s/it]
Testing prompts:  50%|█████     | 5/10 [00:17<00:20,  4.05s/it]
Testing prompts:  60%|██████    | 6/10 [00:19<00:13,  3.33s/it]
Testing prompts:  70%|███████   | 7/10 [00:20<00:08,  2.83s/it]
Testing prompts:  80%|████████  | 8/10 [00:22<00:04,  2.34s/it]
Testing prompts:  90%|█████████ | 9/10 [00:23<00:02,  2.16s/it]
Testing prompts: 100%|██████████| 10/10 [00:25<00:00,  2.07s/it]
Testing prompts: 100%|██████████| 10/10 [00:25<00:00,  2.59s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.18it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.49s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:12,  1.75s/it]
Testing prompts:  40%|████      | 4/10 [00:15<00:32,  5.41s/it]
Testing prompts:  50%|█████     | 5/10 [00:18<00:21,  4.34s/it]
Testing prompts:  60%|██████    | 6/10 [00:19<00:13,  3.33s/it]
Testing prompts:  70%|███████   | 7/10 [00:21<00:08,  2.89s/it]
Testing prompts:  80%|████████  | 8/10 [00:23<00:05,  2.58s/it]
Testing prompts:  90%|█████████ | 9/10 [00:25<00:02,  2.48s/it]
Testing prompts: 100%|██████████| 10/10 [00:27<00:00,  2.36s/it]
Testing prompts: 100%|██████████| 10/10 [00:27<00:00,  2.79s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:17,  1.98s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:16,  2.11s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.72s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:08,  1.44s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:06,  1.23s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:04,  1.09s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:03,  1.19s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:02,  1.46s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.64s/it]
Testing prompts: 100%|██████████| 10/10 [00:24<00:00,  4.42s/it]
Testing prompts: 100%|██████████| 10/10 [00:24<00:00,  2.42s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.14it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.46s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:11,  1.61s/it]
Testing prompts:  40%|████      | 4/10 [00:15<00:31,  5.26s/it]
Testing prompts:  50%|█████     | 5/10 [00:17<00:20,  4.17s/it]
Testing prompts:  60%|██████    | 6/10 [00:19<00:13,  3.38s/it]
Testing prompts:  70%|███████   | 7/10 [00:21<00:08,  2.87s/it]
Testing prompts:  80%|████████  | 8/10 [00:22<00:04,  2.45s/it]
Testing prompts:  90%|█████████ | 9/10 [00:23<00:01,  1.91s/it]
Testing prompts: 100%|██████████| 10/10 [00:25<00:00,  1.89s/it]
Testing prompts: 100%|██████████| 10/10 [00:25<00:00,  2.54s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:16,  1.79s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:12,  1.56s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:13,  1.90s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:09,  1.65s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:07,  1.44s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.30s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:04,  1.34s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:02,  1.45s/it]
Testing prompts:  90%|█████████ | 9/10 [00:14<00:01,  1.69s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.69s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.59s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.09it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:12,  1.58s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.29s/it]
Testing prompts:  40%|████      | 4/10 [00:17<00:36,  6.03s/it]
Testing prompts:  50%|█████     | 5/10 [00:18<00:22,  4.49s/it]
Testing prompts:  60%|██████    | 6/10 [00:20<00:14,  3.51s/it]
Testing prompts:  70%|███████   | 7/10 [00:22<00:08,  2.92s/it]
Testing prompts:  80%|████████  | 8/10 [00:24<00:05,  2.57s/it]
Testing prompts:  90%|█████████ | 9/10 [00:26<00:02,  2.50s/it]
Testing prompts: 100%|██████████| 10/10 [00:28<00:00,  2.26s/it]
Testing prompts: 100%|██████████| 10/10 [00:28<00:00,  2.82s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.15it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.34s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.36s/it]
Testing prompts:  40%|████      | 4/10 [00:14<00:30,  5.14s/it]
Testing prompts:  50%|█████     | 5/10 [00:17<00:21,  4.25s/it]
Testing prompts:  60%|██████    | 6/10 [00:19<00:14,  3.51s/it]
Testing prompts:  70%|███████   | 7/10 [00:21<00:08,  2.92s/it]
Testing prompts:  80%|████████  | 8/10 [00:23<00:05,  2.60s/it]
Testing prompts:  90%|█████████ | 9/10 [00:25<00:02,  2.41s/it]
Testing prompts: 100%|██████████| 10/10 [00:27<00:00,  2.36s/it]
Testing prompts: 100%|██████████| 10/10 [00:27<00:00,  2.75s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:24,  2.75s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:18,  2.29s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:13,  1.92s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:10,  1.68s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:07,  1.43s/it]
Testing prompts:  60%|██████    | 6/10 [00:10<00:05,  1.49s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:03,  1.27s/it]
Testing prompts:  80%|████████  | 8/10 [00:12<00:02,  1.37s/it]
Testing prompts:  90%|█████████ | 9/10 [00:14<00:01,  1.50s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.46s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.57s/it]

Testing prompts:   0%|          | 0/7 [00:00<?, ?it/s]
Testing prompts:  14%|█▍        | 1/7 [00:01<00:09,  1.61s/it]
Testing prompts:  29%|██▊       | 2/7 [00:04<00:10,  2.14s/it]
Testing prompts:  43%|████▎     | 3/7 [00:05<00:07,  1.94s/it]
Testing prompts:  57%|█████▋    | 4/7 [00:07<00:05,  1.96s/it]
Testing prompts:  71%|███████▏  | 5/7 [00:10<00:04,  2.11s/it]
Testing prompts:  86%|████████▌ | 6/7 [00:12<00:02,  2.06s/it]
Testing prompts: 100%|██████████| 7/7 [02:09<00:00, 39.89s/it]
Testing prompts: 100%|██████████| 7/7 [02:09<00:00, 18.56s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.12it/s]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.77s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:09,  1.39s/it]
Testing prompts:  40%|████      | 4/10 [00:14<00:29,  4.92s/it]
Testing prompts:  50%|█████     | 5/10 [00:16<00:19,  3.94s/it]
Testing prompts:  60%|██████    | 6/10 [00:18<00:12,  3.19s/it]
Testing prompts:  70%|███████   | 7/10 [00:21<00:09,  3.09s/it]
Testing prompts:  80%|████████  | 8/10 [00:23<00:05,  2.75s/it]
Testing prompts:  90%|█████████ | 9/10 [00:25<00:02,  2.54s/it]
Testing prompts: 100%|██████████| 10/10 [00:28<00:00,  2.58s/it]
Testing prompts: 100%|██████████| 10/10 [00:28<00:00,  2.81s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:26,  2.98s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:17,  2.13s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:14,  2.14s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:10,  1.71s/it]
Testing prompts:  50%|█████     | 5/10 [00:09<00:08,  1.62s/it]
Testing prompts:  60%|██████    | 6/10 [00:10<00:06,  1.62s/it]
Testing prompts:  70%|███████   | 7/10 [00:12<00:04,  1.59s/it]
Testing prompts:  80%|████████  | 8/10 [00:13<00:02,  1.35s/it]
Testing prompts:  90%|█████████ | 9/10 [00:17<00:02,  2.21s/it]
Testing prompts: 100%|██████████| 10/10 [00:18<00:00,  1.92s/it]
Testing prompts: 100%|██████████| 10/10 [00:18<00:00,  1.85s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:24,  2.75s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:14,  1.87s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:13,  1.94s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:09,  1.62s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:06,  1.36s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:05,  1.36s/it]
Testing prompts:  70%|███████   | 7/10 [00:11<00:04,  1.44s/it]
Testing prompts:  80%|████████  | 8/10 [00:12<00:02,  1.30s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.45s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.48s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.53s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.12it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.39s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.56s/it]
Testing prompts:  40%|████      | 4/10 [00:16<00:34,  5.75s/it]
Testing prompts:  50%|█████     | 5/10 [00:18<00:21,  4.28s/it]
Testing prompts:  60%|██████    | 6/10 [00:20<00:14,  3.57s/it]
Testing prompts:  70%|███████   | 7/10 [00:22<00:08,  2.92s/it]
Testing prompts:  80%|████████  | 8/10 [00:24<00:05,  2.67s/it]
Testing prompts:  90%|█████████ | 9/10 [00:25<00:02,  2.34s/it]
Testing prompts: 100%|██████████| 10/10 [00:27<00:00,  2.13s/it]
Testing prompts: 100%|██████████| 10/10 [00:27<00:00,  2.75s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.48s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.37s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.29s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.40s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:07,  1.46s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.27s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.35s/it]
Testing prompts:  80%|████████  | 8/10 [00:18<00:07,  3.91s/it]
Testing prompts:  90%|█████████ | 9/10 [00:20<00:03,  3.17s/it]
Testing prompts: 100%|██████████| 10/10 [00:23<00:00,  3.05s/it]
Testing prompts: 100%|██████████| 10/10 [00:23<00:00,  2.32s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.15it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:12,  1.54s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.56s/it]
Testing prompts:  40%|████      | 4/10 [00:14<00:28,  4.82s/it]
Testing prompts:  50%|█████     | 5/10 [00:16<00:18,  3.77s/it]
Testing prompts:  60%|██████    | 6/10 [00:18<00:12,  3.15s/it]
Testing prompts:  70%|███████   | 7/10 [00:20<00:08,  2.79s/it]
Testing prompts:  80%|████████  | 8/10 [00:21<00:04,  2.38s/it]
Testing prompts:  90%|█████████ | 9/10 [00:23<00:02,  2.23s/it]
Testing prompts: 100%|██████████| 10/10 [00:26<00:00,  2.45s/it]
Testing prompts: 100%|██████████| 10/10 [00:26<00:00,  2.65s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:23,  2.58s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:17,  2.23s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:13,  2.00s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:09,  1.62s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:06,  1.23s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:04,  1.23s/it]
Testing prompts:  70%|███████   | 7/10 [00:11<00:04,  1.47s/it]
Testing prompts:  80%|████████  | 8/10 [00:12<00:03,  1.59s/it]
Testing prompts:  90%|█████████ | 9/10 [00:14<00:01,  1.60s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.84s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.69s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:18,  2.10s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:15,  1.90s/it]
Testing prompts:  30%|███       | 3/10 [00:09<00:23,  3.38s/it]
Testing prompts:  40%|████      | 4/10 [00:09<00:14,  2.40s/it]
Testing prompts:  50%|█████     | 5/10 [00:10<00:09,  1.86s/it]
Testing prompts:  60%|██████    | 6/10 [00:12<00:07,  1.87s/it]
Testing prompts:  70%|███████   | 7/10 [00:14<00:05,  1.92s/it]
Testing prompts:  80%|████████  | 8/10 [00:16<00:03,  1.94s/it]
Testing prompts:  90%|█████████ | 9/10 [00:17<00:01,  1.61s/it]
Testing prompts: 100%|██████████| 10/10 [00:18<00:00,  1.45s/it]
Testing prompts: 100%|██████████| 10/10 [00:18<00:00,  1.87s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.12it/s]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.78s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:13,  1.98s/it]
Testing prompts:  40%|████      | 4/10 [00:15<00:31,  5.17s/it]
Testing prompts:  50%|█████     | 5/10 [00:17<00:20,  4.06s/it]
Testing prompts:  60%|██████    | 6/10 [00:19<00:13,  3.32s/it]
Testing prompts:  70%|███████   | 7/10 [00:21<00:08,  2.83s/it]
Testing prompts:  80%|████████  | 8/10 [00:22<00:04,  2.44s/it]
Testing prompts:  90%|█████████ | 9/10 [00:25<00:02,  2.38s/it]
Testing prompts: 100%|██████████| 10/10 [00:27<00:00,  2.27s/it]
Testing prompts: 100%|██████████| 10/10 [00:27<00:00,  2.72s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:23,  2.60s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:16,  2.02s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:14,  2.02s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:09,  1.63s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:06,  1.36s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:05,  1.37s/it]
Testing prompts:  70%|███████   | 7/10 [00:11<00:04,  1.47s/it]
Testing prompts:  80%|████████  | 8/10 [00:13<00:03,  1.65s/it]
Testing prompts:  90%|█████████ | 9/10 [00:15<00:01,  1.90s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.71s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.70s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.84it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.12s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:11,  1.59s/it]
Testing prompts:  40%|████      | 4/10 [00:13<00:28,  4.79s/it]
Testing prompts:  50%|█████     | 5/10 [00:15<00:17,  3.59s/it]
Testing prompts:  60%|██████    | 6/10 [00:18<00:13,  3.33s/it]
Testing prompts:  70%|███████   | 7/10 [00:20<00:08,  2.96s/it]
Testing prompts:  80%|████████  | 8/10 [00:22<00:05,  2.72s/it]
Testing prompts:  90%|█████████ | 9/10 [00:24<00:02,  2.44s/it]
Testing prompts: 100%|██████████| 10/10 [00:26<00:00,  2.31s/it]
Testing prompts: 100%|██████████| 10/10 [00:26<00:00,  2.65s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:19,  2.17s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:12,  1.61s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.75s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:09,  1.54s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:06,  1.25s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.30s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:04,  1.44s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.15s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.26s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.19s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.34s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.23it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:12,  1.53s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.53s/it]
Testing prompts:  40%|████      | 4/10 [00:15<00:32,  5.42s/it]
Testing prompts:  50%|█████     | 5/10 [00:18<00:21,  4.29s/it]
Testing prompts:  60%|██████    | 6/10 [00:19<00:13,  3.37s/it]
Testing prompts:  70%|███████   | 7/10 [00:21<00:08,  2.86s/it]
Testing prompts:  80%|████████  | 8/10 [00:23<00:05,  2.54s/it]
Testing prompts:  90%|█████████ | 9/10 [00:26<00:02,  2.64s/it]
Testing prompts: 100%|██████████| 10/10 [00:27<00:00,  2.22s/it]
Testing prompts: 100%|██████████| 10/10 [00:27<00:00,  2.74s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:15,  1.69s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.45s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:11,  1.66s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:07,  1.30s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:05,  1.12s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.25s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:03,  1.31s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.21s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.52s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.36s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.36s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:00<00:03,  1.13it/s]
Testing prompts:  40%|████      | 2/5 [00:02<00:03,  1.32s/it]
Testing prompts:  60%|██████    | 3/5 [00:03<00:02,  1.19s/it]
Testing prompts:  80%|████████  | 4/5 [00:13<00:04,  4.67s/it]
Testing prompts: 100%|██████████| 5/5 [00:14<00:00,  3.22s/it]
Testing prompts: 100%|██████████| 5/5 [00:14<00:00,  2.84s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:15,  1.69s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:12,  1.52s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:13,  1.98s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:08,  1.48s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:06,  1.30s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:05,  1.48s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:04,  1.39s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:02,  1.47s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.50s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.32s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.45s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:24,  2.69s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:16,  2.03s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.76s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:09,  1.54s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:06,  1.28s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.25s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:04,  1.42s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:02,  1.25s/it]
Testing prompts:  90%|█████████ | 9/10 [00:14<00:01,  1.75s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.55s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.55s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:03<00:29,  3.28s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:17,  2.16s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:13,  1.99s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:09,  1.55s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:06,  1.33s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:05,  1.30s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:03,  1.30s/it]
Testing prompts:  80%|████████  | 8/10 [00:12<00:02,  1.47s/it]
Testing prompts:  90%|█████████ | 9/10 [00:15<00:01,  1.86s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  1.88s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  1.73s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:23,  2.59s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:15,  1.95s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.76s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:08,  1.37s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:06,  1.22s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.32s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:04,  1.46s/it]
Testing prompts:  80%|████████  | 8/10 [00:12<00:03,  1.60s/it]
Testing prompts:  90%|█████████ | 9/10 [00:14<00:01,  1.60s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.59s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.57s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:21,  2.37s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:12,  1.59s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.73s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:08,  1.50s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:06,  1.26s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:04,  1.18s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:03,  1.21s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:02,  1.41s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.33s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.46s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.43s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  2.06it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.19s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.05s/it]
Testing prompts:  40%|████      | 4/10 [00:11<00:24,  4.10s/it]
Testing prompts:  50%|█████     | 5/10 [00:14<00:17,  3.47s/it]
Testing prompts:  60%|██████    | 6/10 [00:16<00:12,  3.09s/it]
Testing prompts:  70%|███████   | 7/10 [00:18<00:07,  2.62s/it]
Testing prompts:  80%|████████  | 8/10 [00:20<00:04,  2.39s/it]
Testing prompts:  90%|█████████ | 9/10 [00:29<00:04,  4.62s/it]
Testing prompts: 100%|██████████| 10/10 [00:31<00:00,  3.83s/it]
Testing prompts: 100%|██████████| 10/10 [00:31<00:00,  3.17s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.19it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:12,  1.53s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.32s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.48s/it]
Testing prompts:  50%|█████     | 5/10 [00:15<00:22,  4.52s/it]
Testing prompts:  60%|██████    | 6/10 [00:17<00:14,  3.66s/it]
Testing prompts:  70%|███████   | 7/10 [00:19<00:09,  3.16s/it]
Testing prompts:  80%|████████  | 8/10 [00:21<00:05,  2.64s/it]
Testing prompts:  90%|█████████ | 9/10 [00:23<00:02,  2.44s/it]
Testing prompts: 100%|██████████| 10/10 [00:24<00:00,  2.13s/it]
Testing prompts: 100%|██████████| 10/10 [00:24<00:00,  2.46s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.21it/s]
Testing prompts:  20%|██        | 2/10 [00:03<00:16,  2.10s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:14,  2.01s/it]
Testing prompts:  40%|████      | 4/10 [00:15<00:29,  4.96s/it]
Testing prompts:  50%|█████     | 5/10 [00:17<00:19,  3.92s/it]
Testing prompts:  60%|██████    | 6/10 [00:18<00:12,  3.17s/it]
Testing prompts:  70%|███████   | 7/10 [00:20<00:08,  2.72s/it]
Testing prompts:  80%|████████  | 8/10 [00:22<00:04,  2.50s/it]
Testing prompts:  90%|█████████ | 9/10 [00:25<00:02,  2.51s/it]
Testing prompts: 100%|██████████| 10/10 [00:27<00:00,  2.43s/it]
Testing prompts: 100%|██████████| 10/10 [00:27<00:00,  2.76s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.05it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:12,  1.56s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.12s/it]
Testing prompts:  40%|████      | 4/10 [00:14<00:29,  5.00s/it]
Testing prompts:  50%|█████     | 5/10 [00:16<00:19,  3.96s/it]
Testing prompts:  60%|██████    | 6/10 [00:18<00:12,  3.20s/it]
Testing prompts:  70%|███████   | 7/10 [00:19<00:07,  2.67s/it]
Testing prompts:  80%|████████  | 8/10 [00:21<00:04,  2.33s/it]
Testing prompts:  90%|█████████ | 9/10 [00:23<00:02,  2.12s/it]
Testing prompts: 100%|██████████| 10/10 [00:25<00:00,  2.10s/it]
Testing prompts: 100%|██████████| 10/10 [00:25<00:00,  2.52s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.27it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.33s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:11,  1.71s/it]
Testing prompts:  40%|████      | 4/10 [00:13<00:27,  4.64s/it]
Testing prompts:  50%|█████     | 5/10 [00:15<00:18,  3.62s/it]
Testing prompts:  60%|██████    | 6/10 [00:17<00:12,  3.03s/it]
Testing prompts:  70%|███████   | 7/10 [00:19<00:07,  2.57s/it]
Testing prompts:  80%|████████  | 8/10 [00:21<00:04,  2.37s/it]
Testing prompts:  90%|█████████ | 9/10 [00:22<00:02,  2.21s/it]
Testing prompts: 100%|██████████| 10/10 [00:24<00:00,  1.94s/it]
Testing prompts: 100%|██████████| 10/10 [00:24<00:00,  2.42s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:21,  2.36s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.72s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.74s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:08,  1.39s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:05,  1.12s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:04,  1.25s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:04,  1.55s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:03,  1.51s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.46s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.56s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.51s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:22,  2.52s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.83s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.82s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:08,  1.48s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:06,  1.27s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.29s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:04,  1.43s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:02,  1.37s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.53s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.73s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.59s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:19,  2.13s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:11,  1.47s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:09,  1.30s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.01s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:05,  1.14s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:06,  1.66s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.39s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:03,  1.57s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.39s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  2.53s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  1.77s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:22,  2.45s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.78s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:14,  2.10s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:10,  1.71s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:06,  1.40s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:05,  1.46s/it]
Testing prompts:  70%|███████   | 7/10 [00:11<00:04,  1.57s/it]
Testing prompts:  80%|████████  | 8/10 [00:13<00:03,  1.70s/it]
Testing prompts:  90%|█████████ | 9/10 [00:14<00:01,  1.54s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.36s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.57s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:18,  2.04s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.36s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:08,  1.28s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.11s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:05,  1.19s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.08s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.09s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:03,  1.50s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.36s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.81s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.45s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.96it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.09s/it]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.16it/s]
Testing prompts:  40%|████      | 4/10 [00:11<00:24,  4.15s/it]
Testing prompts:  50%|█████     | 5/10 [00:14<00:18,  3.62s/it]
Testing prompts:  60%|██████    | 6/10 [00:16<00:11,  2.93s/it]
Testing prompts:  70%|███████   | 7/10 [00:18<00:07,  2.63s/it]
Testing prompts:  80%|████████  | 8/10 [00:20<00:04,  2.47s/it]
Testing prompts:  90%|█████████ | 9/10 [00:21<00:02,  2.24s/it]
Testing prompts: 100%|██████████| 10/10 [00:23<00:00,  2.18s/it]
Testing prompts: 100%|██████████| 10/10 [00:23<00:00,  2.40s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:16,  1.85s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:11,  1.47s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:11,  1.60s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:10,  1.67s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:06,  1.26s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:04,  1.22s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:03,  1.29s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.16s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.24s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.19s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.31s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.01it/s]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.63s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:09,  1.36s/it]
Testing prompts:  40%|████      | 4/10 [00:25<00:56,  9.40s/it]
Testing prompts:  50%|█████     | 5/10 [00:28<00:34,  6.93s/it]
Testing prompts:  60%|██████    | 6/10 [00:30<00:21,  5.28s/it]
Testing prompts:  70%|███████   | 7/10 [00:33<00:13,  4.50s/it]
Testing prompts:  80%|████████  | 8/10 [00:35<00:07,  3.61s/it]
Testing prompts:  90%|█████████ | 9/10 [00:37<00:03,  3.20s/it]
Testing prompts: 100%|██████████| 10/10 [00:38<00:00,  2.52s/it]
Testing prompts: 100%|██████████| 10/10 [00:38<00:00,  3.84s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.87it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.34s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.13s/it]
Testing prompts:  40%|████      | 4/10 [00:14<00:31,  5.21s/it]
Testing prompts:  50%|█████     | 5/10 [00:17<00:21,  4.22s/it]
Testing prompts:  60%|██████    | 6/10 [00:19<00:13,  3.44s/it]
Testing prompts:  70%|███████   | 7/10 [00:20<00:08,  2.88s/it]
Testing prompts:  80%|████████  | 8/10 [00:22<00:04,  2.50s/it]
Testing prompts:  90%|█████████ | 9/10 [00:24<00:02,  2.32s/it]
Testing prompts: 100%|██████████| 10/10 [00:26<00:00,  2.13s/it]
Testing prompts: 100%|██████████| 10/10 [00:26<00:00,  2.62s/it]
