/home/ubuntu/agent-tool-testing/src/toolfuzz/agent_executors/langchain/react_old.py:14: LangChainDeprecationWarning: LangChain agents will continue to be supported, but it is recommended for new use cases to be built with LangGraph. LangGraph offers a more flexible and full-featured framework for building agents, including support for tool-calling, persistence of state, and human-in-the-loop workflows. For details, refer to the `LangGraph documentation <https://langchain-ai.github.io/langgraph/>`_ as well as guides for `Migrating from AgentExecutor <https://python.langchain.com/docs/how_to/migrate_agent/>`_ and LangGraph's `Pre-built ReAct agent <https://langchain-ai.github.io/langgraph/how-tos/create-react-agent/>`_.
  agent = initialize_agent(tools, model, agent=AgentType.ZERO_SHOT_REACT_DESCRIPTION, verbose=True,

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.18it/s]
Testing prompts:  20%|██        | 2/10 [00:03<00:16,  2.07s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:13,  1.90s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:11,  1.94s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:08,  1.75s/it]
Testing prompts:  60%|██████    | 6/10 [00:11<00:07,  1.88s/it]
Testing prompts:  70%|███████   | 7/10 [00:11<00:04,  1.57s/it]
Testing prompts:  80%|████████  | 8/10 [00:13<00:02,  1.49s/it]
Testing prompts:  90%|█████████ | 9/10 [00:14<00:01,  1.40s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.47s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.61s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.33it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.31s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.12s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.18s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:06,  1.22s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.38s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:04,  1.37s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.13s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.53s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.47s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.33s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.57it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.42s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.30s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:07,  1.30s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.39s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.21s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.20s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.26s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.55s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.61s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.40s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.36it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.49s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.52s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:10,  1.77s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:09,  1.80s/it]
Testing prompts:  60%|██████    | 6/10 [00:10<00:08,  2.06s/it]
Testing prompts:  70%|███████   | 7/10 [00:12<00:05,  1.80s/it]
Testing prompts:  80%|████████  | 8/10 [00:12<00:02,  1.43s/it]
Testing prompts:  90%|█████████ | 9/10 [00:14<00:01,  1.54s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.60s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.63s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:10,  1.15s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:12,  1.60s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.49s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.40s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:05,  1.19s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:06,  1.67s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:05,  1.68s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:02,  1.47s/it]
Testing prompts:  90%|█████████ | 9/10 [00:17<00:02,  2.79s/it]
Testing prompts: 100%|██████████| 10/10 [00:19<00:00,  2.51s/it]
Testing prompts: 100%|██████████| 10/10 [00:19<00:00,  1.94s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.60it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.36s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.30s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.16s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.19s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.20s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.46s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.39s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.53s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.47s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.35s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.17it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.39s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.37s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:09,  1.52s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.39s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.46s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.39s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.12s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.79s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.52s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.45s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:09,  1.07s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:12,  1.57s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.47s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.42s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.38s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.24s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:04,  1.67s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:03,  1.53s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.72s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.92s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.62s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.69it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.45s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.30s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:07,  1.28s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.33s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.31s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.46s/it][2025-05-10 01:55:27,463][WARNING] Python REPL can execute arbitrary code. Use with caution.

Testing prompts:  80%|████████  | 8/10 [00:20<00:09,  4.64s/it]
Testing prompts:  90%|█████████ | 9/10 [00:24<00:04,  4.36s/it]
Testing prompts: 100%|██████████| 10/10 [00:26<00:00,  3.48s/it]
Testing prompts: 100%|██████████| 10/10 [00:26<00:00,  2.62s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.21it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.40s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.15s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.28s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.36s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.42s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.57s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:03,  1.65s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.57s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.40s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.41s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.70it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:12,  1.60s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.22s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.11s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.06s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.20s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:04,  1.37s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.14s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.68s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.62s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.38s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.48it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.14s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.16s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.17s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.14s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.21s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.30s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.40s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.41s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.56s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.34s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:18,  2.08s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.86s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:11,  1.66s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:08,  1.35s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:06,  1.23s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.30s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:03,  1.07s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:03,  1.63s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.76s/it]
Testing prompts: 100%|██████████| 10/10 [00:18<00:00,  2.47s/it]
Testing prompts: 100%|██████████| 10/10 [00:18<00:00,  1.81s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.81it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.10s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.39s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.27s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.39s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:06,  1.65s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.41s/it]
Testing prompts:  80%|████████  | 8/10 [00:15<00:05,  2.77s/it]
Testing prompts:  90%|█████████ | 9/10 [00:17<00:02,  2.64s/it]
Testing prompts: 100%|██████████| 10/10 [00:18<00:00,  2.24s/it]
Testing prompts: 100%|██████████| 10/10 [00:18<00:00,  1.89s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.42it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.24s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.14s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:11,  1.87s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:09,  1.95s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:06,  1.54s/it]
Testing prompts:  70%|███████   | 7/10 [00:11<00:05,  1.86s/it]
Testing prompts:  80%|████████  | 8/10 [00:12<00:02,  1.47s/it]
Testing prompts:  90%|█████████ | 9/10 [00:14<00:01,  1.82s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.84s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.68s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.23it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.17s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.13s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.20s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:06,  1.22s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.09s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:04,  1.44s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.38s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.55s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.56s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.36s/it]

Testing prompts:   0%|          | 0/20 [00:00<?, ?it/s]
Testing prompts:   5%|▌         | 1/20 [00:01<00:20,  1.07s/it]
Testing prompts:  10%|█         | 2/20 [00:02<00:22,  1.26s/it]
Testing prompts:  15%|█▌        | 3/20 [00:03<00:19,  1.17s/it]
Testing prompts:  20%|██        | 4/20 [00:04<00:18,  1.15s/it]
Testing prompts:  25%|██▌       | 5/20 [00:05<00:17,  1.14s/it]
Testing prompts:  30%|███       | 6/20 [00:06<00:15,  1.12s/it]
Testing prompts:  35%|███▌      | 7/20 [00:07<00:13,  1.04s/it]
Testing prompts:  40%|████      | 8/20 [00:13<00:29,  2.45s/it]
Testing prompts:  45%|████▌     | 9/20 [00:15<00:25,  2.32s/it]
Testing prompts:  50%|█████     | 10/20 [00:16<00:21,  2.11s/it]
Testing prompts:  55%|█████▌    | 11/20 [00:18<00:17,  1.96s/it]
Testing prompts:  60%|██████    | 12/20 [00:21<00:17,  2.21s/it]
Testing prompts:  65%|██████▌   | 13/20 [00:23<00:14,  2.09s/it]
Testing prompts:  70%|███████   | 14/20 [00:24<00:11,  1.95s/it]
Testing prompts:  75%|███████▌  | 15/20 [00:26<00:09,  1.94s/it]
Testing prompts:  80%|████████  | 16/20 [00:28<00:08,  2.00s/it]
Testing prompts:  85%|████████▌ | 17/20 [00:31<00:06,  2.10s/it]
Testing prompts:  90%|█████████ | 18/20 [00:33<00:04,  2.17s/it]
Testing prompts:  95%|█████████▌| 19/20 [00:35<00:02,  2.04s/it]
Testing prompts: 100%|██████████| 20/20 [00:36<00:00,  1.97s/it]
Testing prompts: 100%|██████████| 20/20 [00:36<00:00,  1.85s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.63it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.15s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.29s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.37s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:07,  1.52s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.36s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.17s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.21s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.48s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.61s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.40s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.30it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.32s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.14s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.07s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.18s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.12s/it]
Testing prompts:  70%|███████   | 7/10 [00:07<00:03,  1.09s/it]
Testing prompts:  80%|████████  | 8/10 [00:08<00:02,  1.09s/it]
Testing prompts:  90%|█████████ | 9/10 [00:10<00:01,  1.26s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.31s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.19s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.68it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:12,  1.53s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.22s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.37s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.28s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.23s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.12s/it]
Testing prompts:  80%|████████  | 8/10 [00:08<00:01,  1.07it/s]
Testing prompts:  90%|█████████ | 9/10 [00:16<00:02,  2.89s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  2.40s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  1.74s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.28it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.39s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.22s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.12s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.10s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.07s/it]
Testing prompts:  70%|███████   | 7/10 [00:11<00:06,  2.18s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:03,  1.68s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.66s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.48s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.44s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.46it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.25s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.06s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.27s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.33s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.25s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.09s/it]
Testing prompts:  80%|████████  | 8/10 [00:08<00:02,  1.04s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.35s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.87s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.40s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.69it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.33s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.14s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.16s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.31s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.35s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.30s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.31s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.54s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.77s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.44s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.49it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:12,  1.61s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:09,  1.39s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.38s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.26s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.46s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.42s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.35s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.42s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.55s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.43s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.29it/s]
Testing prompts:  20%|██        | 2/10 [00:04<00:17,  2.22s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.74s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:09,  1.59s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:07,  1.57s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.31s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:03,  1.21s/it]
Testing prompts:  80%|████████  | 8/10 [00:13<00:03,  1.97s/it]
Testing prompts:  90%|█████████ | 9/10 [00:15<00:02,  2.02s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.55s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.61s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.45it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.35s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:12,  1.81s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:09,  1.52s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.23s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.27s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:03,  1.31s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.26s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.44s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.52s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.41s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.62it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.24s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.12s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.21s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:06,  1.24s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.27s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.29s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.39s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.59s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.64s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.39s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.50it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.34s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.21s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.35s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:07,  1.47s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.24s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.23s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.23s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.52s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.53s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.37s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.65it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.46s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.25s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.20s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.10s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.17s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.56s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.29s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.68s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.50s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.37s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:09,  1.06s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.86s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.55s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.44s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.24s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:04,  1.25s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.40s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.17s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.42s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.51s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.42s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.70it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.34s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.14s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.22s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.31s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.22s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.43s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.47s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.82s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.71s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.47s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.36it/s]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.83s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:09,  1.42s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.43s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.30s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.32s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:03,  1.29s/it]
Testing prompts:  80%|████████  | 8/10 [00:15<00:05,  2.72s/it]
Testing prompts:  90%|█████████ | 9/10 [00:16<00:02,  2.37s/it]
Testing prompts: 100%|██████████| 10/10 [00:18<00:00,  2.05s/it]
Testing prompts: 100%|██████████| 10/10 [00:18<00:00,  1.81s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.32it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.31s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.13s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.12s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.11s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.16s/it]
Testing prompts:  70%|███████   | 7/10 [00:07<00:03,  1.12s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.24s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.44s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.58s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.31s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:09,  1.06s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.81s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.51s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:09,  1.64s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:07,  1.44s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.28s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:03,  1.15s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.16s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.75s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.55s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.46s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.61it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.31s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.16s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.22s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.29s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.25s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.17s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.26s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.32s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.35s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.26s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.34it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.37s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.21s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.26s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:07,  1.41s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.36s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.23s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.18s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.37s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.84s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.46s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.57it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.33s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.14s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.09s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.10s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.35s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.27s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.35s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.35s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.66s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.37s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:16,  1.86s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:15,  1.88s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.50s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:09,  1.58s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:07,  1.44s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.32s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:03,  1.11s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:02,  1.37s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.45s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.72s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.53s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.31it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.27s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.50s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.43s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:08,  1.66s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.48s/it]
Testing prompts:  70%|███████   | 7/10 [00:11<00:05,  1.95s/it]
Testing prompts:  80%|████████  | 8/10 [00:12<00:03,  1.56s/it]
Testing prompts:  90%|█████████ | 9/10 [00:14<00:01,  1.67s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.64s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.58s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.26it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:12,  1.60s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.29s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.16s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.05s/it]
Testing prompts:  60%|██████    | 6/10 [00:06<00:04,  1.12s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.22s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.23s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.33s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  2.11s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.50s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.56it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.22s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.24s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.13s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:04,  1.02it/s]
Testing prompts:  60%|██████    | 6/10 [00:08<00:07,  1.86s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.62s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.37s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.71s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.70s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.49s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.27it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.20s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.10s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.25s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.38s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.22s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.17s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.01s/it]
Testing prompts:  90%|█████████ | 9/10 [00:10<00:01,  1.28s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.41s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.26s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.39s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.73s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:11,  1.58s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:07,  1.33s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:06,  1.32s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.28s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:03,  1.24s/it]
Testing prompts:  80%|████████  | 8/10 [00:17<00:06,  3.38s/it]
Testing prompts:  90%|█████████ | 9/10 [00:22<00:03,  3.92s/it]
Testing prompts: 100%|██████████| 10/10 [00:24<00:00,  3.21s/it]
Testing prompts: 100%|██████████| 10/10 [00:24<00:00,  2.41s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.78it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.27s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.33s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.42s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.21s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.37s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.25s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.05s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.36s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.46s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.32s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.59it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.29s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:07,  1.10s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.22s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.29s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.25s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.18s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.25s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.38s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.36s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.27s/it]

Testing prompts:   0%|          | 0/20 [00:00<?, ?it/s]
Testing prompts:   5%|▌         | 1/20 [00:00<00:11,  1.64it/s]
Testing prompts:  10%|█         | 2/20 [00:02<00:27,  1.51s/it]
Testing prompts:  15%|█▌        | 3/20 [00:03<00:22,  1.30s/it]
Testing prompts:  20%|██        | 4/20 [00:05<00:20,  1.29s/it]
Testing prompts:  25%|██▌       | 5/20 [00:05<00:17,  1.16s/it]
Testing prompts:  30%|███       | 6/20 [00:07<00:18,  1.30s/it]
Testing prompts:  35%|███▌      | 7/20 [00:08<00:15,  1.21s/it]
Testing prompts:  40%|████      | 8/20 [00:14<00:31,  2.66s/it]
Testing prompts:  45%|████▌     | 9/20 [00:16<00:29,  2.64s/it]
Testing prompts:  50%|█████     | 10/20 [00:18<00:22,  2.29s/it]
Testing prompts:  55%|█████▌    | 11/20 [00:21<00:21,  2.41s/it]
Testing prompts:  60%|██████    | 12/20 [00:24<00:21,  2.72s/it]
Testing prompts:  65%|██████▌   | 13/20 [00:26<00:16,  2.39s/it]
Testing prompts:  70%|███████   | 14/20 [00:28<00:14,  2.49s/it]
Testing prompts:  75%|███████▌  | 15/20 [00:30<00:11,  2.34s/it]
Testing prompts:  80%|████████  | 16/20 [00:32<00:08,  2.04s/it]
Testing prompts:  85%|████████▌ | 17/20 [00:33<00:05,  1.69s/it]
Testing prompts:  90%|█████████ | 18/20 [00:35<00:03,  1.83s/it]
Testing prompts:  95%|█████████▌| 19/20 [00:36<00:01,  1.69s/it]
Testing prompts: 100%|██████████| 20/20 [00:38<00:00,  1.80s/it]
Testing prompts: 100%|██████████| 20/20 [00:38<00:00,  1.94s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.40it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.34s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:11,  1.60s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.46s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:07,  1.45s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.35s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:03,  1.26s/it]
Testing prompts:  80%|████████  | 8/10 [00:13<00:04,  2.27s/it]
Testing prompts:  90%|█████████ | 9/10 [00:15<00:02,  2.07s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  2.22s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  1.79s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.19it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.49s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.30s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:07,  1.25s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:05,  1.19s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.14s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.17s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.15s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.52s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.93s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.47s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:16,  1.78s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.72s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.74s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:08,  1.45s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:07,  1.49s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:05,  1.43s/it]
Testing prompts:  70%|███████   | 7/10 [00:11<00:05,  1.85s/it]
Testing prompts:  80%|████████  | 8/10 [00:12<00:03,  1.51s/it]
Testing prompts:  90%|█████████ | 9/10 [00:15<00:01,  1.81s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.72s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.66s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:09,  1.04s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.83s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:09,  1.42s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:07,  1.27s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.24s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.18s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.20s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:03,  1.50s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.64s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  2.15s/it]
Testing prompts: 100%|██████████| 10/10 [00:16<00:00,  1.63s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.73it/s]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.67s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:09,  1.39s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:07,  1.31s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.25s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.08s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.04s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.01s/it]
Testing prompts:  90%|█████████ | 9/10 [00:10<00:01,  1.21s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.38s/it]
Testing prompts: 100%|██████████| 10/10 [00:12<00:00,  1.25s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.37s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:17,  2.14s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:11,  1.69s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:08,  1.37s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:06,  1.23s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:04,  1.24s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:03,  1.07s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:03,  1.50s/it]
Testing prompts:  90%|█████████ | 9/10 [00:14<00:01,  1.90s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.83s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.59s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.50it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:12,  1.53s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.29s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:07,  1.33s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.28s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.09s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.07s/it]
Testing prompts:  80%|████████  | 8/10 [00:08<00:01,  1.06it/s]
Testing prompts:  90%|█████████ | 9/10 [00:10<00:01,  1.11s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.26s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.19s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.70it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:12,  1.55s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:11,  1.58s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.35s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.35s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.38s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:03,  1.29s/it]
Testing prompts:  80%|████████  | 8/10 [00:12<00:03,  1.74s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.65s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.48s/it]
Testing prompts: 100%|██████████| 10/10 [00:14<00:00,  1.46s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.54it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.35s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:10,  1.54s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:09,  1.54s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.27s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:05,  1.43s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.41s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:02,  1.42s/it]
Testing prompts:  90%|█████████ | 9/10 [00:13<00:01,  1.76s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.72s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.53s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.53it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.33s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.17s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.16s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:07,  1.48s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.26s/it]
Testing prompts:  70%|███████   | 7/10 [00:09<00:04,  1.38s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.15s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.32s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.42s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.31s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.34it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.42s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.26s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:12,  2.03s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:09,  1.84s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:06,  1.58s/it]
Testing prompts:  70%|███████   | 7/10 [00:10<00:04,  1.48s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:02,  1.38s/it]
Testing prompts:  90%|█████████ | 9/10 [00:14<00:01,  1.64s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.64s/it]
Testing prompts: 100%|██████████| 10/10 [00:15<00:00,  1.58s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:07,  1.17it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.34s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:08,  1.18s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.17s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:06,  1.32s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:04,  1.21s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.14s/it]
Testing prompts:  80%|████████  | 8/10 [00:09<00:02,  1.02s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.74s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.70s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.40s/it]
