/home/ubuntu/agent-tool-testing/src/toolfuzz/agent_executors/langchain/react_old.py:14: LangChainDeprecationWarning: LangChain agents will continue to be supported, but it is recommended for new use cases to be built with LangGraph. LangGraph offers a more flexible and full-featured framework for building agents, including support for tool-calling, persistence of state, and human-in-the-loop workflows. For details, refer to the `LangGraph documentation <https://langchain-ai.github.io/langgraph/>`_ as well as guides for `Migrating from AgentExecutor <https://python.langchain.com/docs/how_to/migrate_agent/>`_ and LangGraph's `Pre-built ReAct agent <https://langchain-ai.github.io/langgraph/how-tos/create-react-agent/>`_.
  agent = initialize_agent(tools, model, agent=AgentType.ZERO_SHOT_REACT_DESCRIPTION, verbose=True,

Testing prompts:   0%|          | 0/6 [00:00<?, ?it/s]
Testing prompts:  17%|█▋        | 1/6 [00:01<00:05,  1.12s/it]
Testing prompts:  33%|███▎      | 2/6 [00:01<00:03,  1.25it/s]
Testing prompts:  50%|█████     | 3/6 [00:02<00:02,  1.17it/s]
Testing prompts:  67%|██████▋   | 4/6 [00:03<00:01,  1.37it/s]
Testing prompts:  83%|████████▎ | 5/6 [00:04<00:00,  1.09it/s]
Testing prompts: 100%|██████████| 6/6 [02:11<00:00, 43.72s/it]
Testing prompts: 100%|██████████| 6/6 [02:11<00:00, 21.87s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:11,  1.33s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:07,  1.06it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:05,  1.17it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.38it/s]
Testing prompts:  50%|█████     | 5/10 [00:04<00:03,  1.30it/s]
Testing prompts:  60%|██████    | 6/10 [00:06<00:05,  1.26s/it]
Testing prompts:  70%|███████   | 7/10 [00:07<00:03,  1.14s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:03,  1.68s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.46s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.27s/it]
Testing prompts: 100%|██████████| 10/10 [00:11<00:00,  1.19s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:00<00:01,  1.39it/s]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.57s/it]
Testing prompts: 100%|██████████| 3/3 [01:56<00:00, 52.70s/it]
Testing prompts: 100%|██████████| 3/3 [01:56<00:00, 38.81s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:01<00:03,  1.09s/it]
Testing prompts:  50%|█████     | 2/4 [00:01<00:01,  1.31it/s]
Testing prompts:  75%|███████▌  | 3/4 [00:02<00:00,  1.23it/s]
Testing prompts: 100%|██████████| 4/4 [02:01<00:00, 47.38s/it]
Testing prompts: 100%|██████████| 4/4 [02:01<00:00, 30.32s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:02<00:06,  2.13s/it]
Testing prompts:  50%|█████     | 2/4 [00:02<00:02,  1.37s/it]
Testing prompts:  75%|███████▌  | 3/4 [00:03<00:01,  1.16s/it]
Testing prompts: 100%|██████████| 4/4 [02:15<00:00, 52.52s/it]
Testing prompts: 100%|██████████| 4/4 [02:15<00:00, 33.78s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:03,  1.55s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:00,  1.07it/s]
Testing prompts: 100%|██████████| 3/3 [02:00<00:00, 54.61s/it]
Testing prompts: 100%|██████████| 3/3 [02:00<00:00, 40.18s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:00<00:01,  1.14it/s]
Testing prompts:  67%|██████▋   | 2/3 [00:03<00:01,  1.63s/it]
Testing prompts: 100%|██████████| 3/3 [01:46<00:00, 47.93s/it]
Testing prompts: 100%|██████████| 3/3 [01:46<00:00, 35.35s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:01<00:05,  1.83s/it]
Testing prompts:  50%|█████     | 2/4 [00:02<00:02,  1.14s/it]
Testing prompts:  75%|███████▌  | 3/4 [00:03<00:00,  1.08it/s]
Testing prompts: 100%|██████████| 4/4 [01:46<00:00, 41.45s/it]
Testing prompts: 100%|██████████| 4/4 [01:46<00:00, 26.68s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:09,  1.10s/it]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.29it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:07,  1.00s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.50s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:05,  1.17s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.48s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:03,  1.28s/it]
Testing prompts:  80%|████████  | 8/10 [00:11<00:03,  1.72s/it]
Testing prompts:  90%|█████████ | 9/10 [00:12<00:01,  1.46s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.25s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.31s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:00<00:01,  1.68it/s]
Testing prompts:  50%|█████     | 2/4 [00:01<00:01,  1.92it/s]
Testing prompts:  75%|███████▌  | 3/4 [00:01<00:00,  1.61it/s]
Testing prompts: 100%|██████████| 4/4 [01:58<00:00, 46.35s/it]
Testing prompts: 100%|██████████| 4/4 [01:58<00:00, 29.57s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:07,  1.90s/it]
Testing prompts:  40%|████      | 2/5 [00:02<00:04,  1.40s/it]
Testing prompts:  60%|██████    | 3/5 [00:03<00:02,  1.13s/it]
Testing prompts:  80%|████████  | 4/5 [00:05<00:01,  1.35s/it]
Testing prompts: 100%|██████████| 5/5 [00:06<00:00,  1.32s/it]
Testing prompts: 100%|██████████| 5/5 [00:06<00:00,  1.34s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:00<00:01,  1.57it/s]
Testing prompts:  50%|█████     | 2/4 [00:01<00:01,  1.94it/s]
Testing prompts:  75%|███████▌  | 3/4 [00:01<00:00,  1.44it/s]
Testing prompts: 100%|██████████| 4/4 [01:54<00:00, 45.02s/it]
Testing prompts: 100%|██████████| 4/4 [01:54<00:00, 28.73s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:01<00:01,  1.54s/it]
Testing prompts: 100%|██████████| 2/2 [02:00<00:00, 70.54s/it]
Testing prompts: 100%|██████████| 2/2 [02:00<00:00, 60.19s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.47it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:05,  1.54it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.02it/s]
Testing prompts:  40%|████      | 4/10 [00:04<00:06,  1.16s/it]
Testing prompts:  50%|█████     | 5/10 [00:05<00:06,  1.28s/it]
Testing prompts:  60%|██████    | 6/10 [00:07<00:05,  1.41s/it]
Testing prompts:  70%|███████   | 7/10 [00:08<00:04,  1.43s/it]
Testing prompts:  80%|████████  | 8/10 [00:10<00:02,  1.41s/it]
Testing prompts:  90%|█████████ | 9/10 [00:11<00:01,  1.55s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.48s/it]
Testing prompts: 100%|██████████| 10/10 [00:13<00:00,  1.33s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:01<00:01,  1.79s/it]
Testing prompts: 100%|██████████| 2/2 [01:57<00:00, 68.68s/it]
Testing prompts: 100%|██████████| 2/2 [01:57<00:00, 58.65s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:04,  1.23s/it]
Testing prompts:  40%|████      | 2/5 [00:02<00:03,  1.30s/it]
Testing prompts:  60%|██████    | 3/5 [00:03<00:02,  1.12s/it]
Testing prompts:  80%|████████  | 4/5 [00:04<00:00,  1.08it/s]
Testing prompts: 100%|██████████| 5/5 [02:05<00:00, 44.33s/it]
Testing prompts: 100%|██████████| 5/5 [02:05<00:00, 25.08s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:01<00:03,  1.08s/it]
Testing prompts:  50%|█████     | 2/4 [00:01<00:01,  1.27it/s]
Testing prompts:  75%|███████▌  | 3/4 [00:02<00:00,  1.29it/s]
Testing prompts: 100%|██████████| 4/4 [00:07<00:00,  2.61s/it]
Testing prompts: 100%|██████████| 4/4 [00:07<00:00,  1.96s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:01<00:01,  1.51s/it]
Testing prompts: 100%|██████████| 2/2 [01:58<00:00, 69.16s/it]
Testing prompts: 100%|██████████| 2/2 [01:58<00:00, 59.01s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  1.41it/s]
Testing prompts: 100%|██████████| 2/2 [01:50<00:00, 64.82s/it]
Testing prompts: 100%|██████████| 2/2 [01:50<00:00, 55.20s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  1.11it/s]
Testing prompts: 100%|██████████| 2/2 [01:46<00:00, 62.58s/it]
Testing prompts: 100%|██████████| 2/2 [01:46<00:00, 53.33s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.23s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:01<00:00,  1.13it/s]
Testing prompts: 100%|██████████| 3/3 [01:45<00:00, 47.62s/it]
Testing prompts: 100%|██████████| 3/3 [01:45<00:00, 35.03s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:01<00:03,  1.18s/it]
Testing prompts:  50%|█████     | 2/4 [00:02<00:02,  1.03s/it]
Testing prompts:  75%|███████▌  | 3/4 [00:02<00:00,  1.15it/s]
Testing prompts: 100%|██████████| 4/4 [01:38<00:00, 38.31s/it]
Testing prompts: 100%|██████████| 4/4 [01:38<00:00, 24.62s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:03,  1.75s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:04<00:02,  2.05s/it]
Testing prompts: 100%|██████████| 3/3 [01:59<00:00, 53.62s/it]
Testing prompts: 100%|██████████| 3/3 [01:59<00:00, 39.67s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:01<00:01,  1.89s/it]
Testing prompts: 100%|██████████| 2/2 [01:41<00:00, 59.40s/it]
Testing prompts: 100%|██████████| 2/2 [01:41<00:00, 50.78s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:04,  1.24s/it]
Testing prompts:  40%|████      | 2/5 [00:01<00:02,  1.17it/s]
Testing prompts:  60%|██████    | 3/5 [00:02<00:01,  1.21it/s]
Testing prompts:  80%|████████  | 4/5 [00:03<00:00,  1.51it/s]
Testing prompts: 100%|██████████| 5/5 [01:40<00:00, 35.59s/it]
Testing prompts: 100%|██████████| 5/5 [01:40<00:00, 20.11s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  1.27it/s]
Testing prompts: 100%|██████████| 2/2 [01:46<00:00, 62.44s/it]
Testing prompts: 100%|██████████| 2/2 [01:46<00:00, 53.19s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:01<00:01,  1.93s/it]
Testing prompts: 100%|██████████| 2/2 [02:03<00:00, 72.45s/it]
Testing prompts: 100%|██████████| 2/2 [02:03<00:00, 61.87s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:00<00:01,  1.55it/s]
Testing prompts:  50%|█████     | 2/4 [00:01<00:01,  1.02it/s]
Testing prompts:  75%|███████▌  | 3/4 [00:03<00:01,  1.11s/it]
Testing prompts: 100%|██████████| 4/4 [01:34<00:00, 36.62s/it]
Testing prompts: 100%|██████████| 4/4 [01:34<00:00, 23.55s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.23s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:00,  1.02it/s]
Testing prompts: 100%|██████████| 3/3 [01:45<00:00, 47.79s/it]
Testing prompts: 100%|██████████| 3/3 [01:45<00:00, 35.18s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:01<00:03,  1.11s/it]
Testing prompts:  50%|█████     | 2/4 [00:01<00:01,  1.23it/s]
Testing prompts:  75%|███████▌  | 3/4 [00:02<00:00,  1.31it/s]
Testing prompts: 100%|██████████| 4/4 [02:02<00:00, 47.73s/it]
Testing prompts: 100%|██████████| 4/4 [02:02<00:00, 30.54s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  1.22it/s]
Testing prompts: 100%|██████████| 2/2 [02:11<00:00, 77.17s/it]
Testing prompts: 100%|██████████| 2/2 [02:11<00:00, 65.72s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:00<00:01,  1.36it/s]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.58s/it]
Testing prompts: 100%|██████████| 3/3 [02:05<00:00, 57.05s/it]
Testing prompts: 100%|██████████| 3/3 [02:05<00:00, 41.99s/it]

Testing prompts:   0%|          | 0/6 [00:00<?, ?it/s]
Testing prompts:  17%|█▋        | 1/6 [00:01<00:05,  1.14s/it]
Testing prompts:  33%|███▎      | 2/6 [00:01<00:03,  1.05it/s]
Testing prompts:  50%|█████     | 3/6 [00:02<00:02,  1.19it/s]
Testing prompts:  67%|██████▋   | 4/6 [00:03<00:01,  1.43it/s]
Testing prompts:  83%|████████▎ | 5/6 [00:03<00:00,  1.45it/s]
Testing prompts: 100%|██████████| 6/6 [02:00<00:00, 40.29s/it]
Testing prompts: 100%|██████████| 6/6 [02:00<00:00, 20.16s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:00<00:02,  1.08it/s]
Testing prompts:  50%|█████     | 2/4 [00:01<00:01,  1.27it/s]
Testing prompts:  75%|███████▌  | 3/4 [00:02<00:00,  1.40it/s]
Testing prompts: 100%|██████████| 4/4 [01:48<00:00, 42.44s/it]
Testing prompts: 100%|██████████| 4/4 [01:48<00:00, 27.16s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:00<00:02,  1.05it/s]
Testing prompts:  50%|█████     | 2/4 [00:02<00:02,  1.07s/it]
Testing prompts:  75%|███████▌  | 3/4 [00:03<00:01,  1.12s/it]
Testing prompts: 100%|██████████| 4/4 [01:50<00:00, 42.95s/it]
Testing prompts: 100%|██████████| 4/4 [01:50<00:00, 27.59s/it]

Testing prompts:   0%|          | 0/6 [00:00<?, ?it/s]
Testing prompts:  17%|█▋        | 1/6 [00:01<00:08,  1.75s/it]
Testing prompts:  33%|███▎      | 2/6 [00:02<00:04,  1.09s/it]
Testing prompts:  50%|█████     | 3/6 [00:03<00:02,  1.05it/s]
Testing prompts:  67%|██████▋   | 4/6 [00:03<00:01,  1.30it/s]
Testing prompts:  83%|████████▎ | 5/6 [00:04<00:00,  1.37it/s]
Testing prompts: 100%|██████████| 6/6 [01:52<00:00, 37.22s/it]
Testing prompts: 100%|██████████| 6/6 [01:52<00:00, 18.73s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:00<00:01,  1.30it/s]
Testing prompts:  67%|██████▋   | 2/3 [00:03<00:01,  1.75s/it]
Testing prompts: 100%|██████████| 3/3 [01:50<00:00, 49.98s/it]
Testing prompts: 100%|██████████| 3/3 [01:50<00:00, 36.86s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  1.50it/s]
Testing prompts: 100%|██████████| 2/2 [01:40<00:00, 58.77s/it]
Testing prompts: 100%|██████████| 2/2 [01:40<00:00, 50.05s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:00<00:02,  1.47it/s]
Testing prompts:  50%|█████     | 2/4 [00:01<00:01,  1.72it/s]
Testing prompts:  75%|███████▌  | 3/4 [00:01<00:00,  1.62it/s]
Testing prompts: 100%|██████████| 4/4 [01:46<00:00, 41.83s/it]
Testing prompts: 100%|██████████| 4/4 [01:46<00:00, 26.71s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:01<00:01,  1.13s/it]
Testing prompts: 100%|██████████| 2/2 [01:38<00:00, 57.53s/it]
Testing prompts: 100%|██████████| 2/2 [01:38<00:00, 49.07s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.13s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:01<00:00,  1.16it/s]
Testing prompts: 100%|██████████| 3/3 [01:46<00:00, 48.30s/it]
Testing prompts: 100%|██████████| 3/3 [01:46<00:00, 35.52s/it]

Testing prompts:   0%|          | 0/5 [00:00<?, ?it/s]
Testing prompts:  20%|██        | 1/5 [00:01<00:04,  1.08s/it]
Testing prompts:  40%|████      | 2/5 [00:01<00:02,  1.23it/s]
Testing prompts:  60%|██████    | 3/5 [00:02<00:01,  1.26it/s]
Testing prompts:  80%|████████  | 4/5 [00:03<00:00,  1.27it/s]
Testing prompts: 100%|██████████| 5/5 [01:41<00:00, 35.92s/it]
Testing prompts: 100%|██████████| 5/5 [01:41<00:00, 20.30s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:00<00:01,  1.50it/s]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.64s/it]
Testing prompts: 100%|██████████| 3/3 [01:42<00:00, 46.53s/it]
Testing prompts: 100%|██████████| 3/3 [01:42<00:00, 34.31s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:01<00:03,  1.16s/it]
Testing prompts:  50%|█████     | 2/4 [00:02<00:01,  1.02it/s]
Testing prompts:  75%|███████▌  | 3/4 [00:02<00:00,  1.18it/s]
Testing prompts: 100%|██████████| 4/4 [01:47<00:00, 42.00s/it]
Testing prompts: 100%|██████████| 4/4 [01:47<00:00, 26.95s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:01<00:04,  1.44s/it]
Testing prompts:  50%|█████     | 2/4 [00:02<00:01,  1.00it/s]
Testing prompts:  75%|███████▌  | 3/4 [00:02<00:00,  1.17it/s]
Testing prompts: 100%|██████████| 4/4 [01:50<00:00, 43.16s/it]
Testing prompts: 100%|██████████| 4/4 [01:50<00:00, 27.71s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:01<00:01,  1.44s/it]
Testing prompts: 100%|██████████| 2/2 [01:45<00:00, 61.99s/it]
Testing prompts: 100%|██████████| 2/2 [01:45<00:00, 52.91s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:01<00:03,  1.11s/it]
Testing prompts:  50%|█████     | 2/4 [00:01<00:01,  1.24it/s]
Testing prompts:  75%|███████▌  | 3/4 [00:02<00:00,  1.27it/s]
Testing prompts: 100%|██████████| 4/4 [01:43<00:00, 40.23s/it]
Testing prompts: 100%|██████████| 4/4 [01:43<00:00, 25.79s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  1.75it/s]
Testing prompts: 100%|██████████| 2/2 [01:45<00:00, 61.98s/it]
Testing prompts: 100%|██████████| 2/2 [01:45<00:00, 52.76s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:00<00:02,  1.32it/s]
Testing prompts:  50%|█████     | 2/4 [00:01<00:01,  1.57it/s]
Testing prompts:  75%|███████▌  | 3/4 [00:02<00:00,  1.13it/s]
Testing prompts: 100%|██████████| 4/4 [01:37<00:00, 38.12s/it]
Testing prompts: 100%|██████████| 4/4 [01:37<00:00, 24.43s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:10,  1.20s/it]
Testing prompts:  20%|██        | 2/10 [00:01<00:06,  1.17it/s]
Testing prompts:  30%|███       | 3/10 [00:02<00:06,  1.16it/s]
Testing prompts:  40%|████      | 4/10 [00:03<00:04,  1.34it/s]
Testing prompts:  50%|█████     | 5/10 [00:03<00:03,  1.34it/s]
Testing prompts:  60%|██████    | 6/10 [00:05<00:03,  1.04it/s]
Testing prompts:  70%|███████   | 7/10 [00:06<00:02,  1.14it/s]
Testing prompts:  80%|████████  | 8/10 [00:07<00:01,  1.05it/s]
Testing prompts:  90%|█████████ | 9/10 [00:07<00:00,  1.23it/s]
Testing prompts: 100%|██████████| 10/10 [00:08<00:00,  1.37it/s]
Testing prompts: 100%|██████████| 10/10 [00:08<00:00,  1.21it/s]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:01<00:01,  1.36s/it]
Testing prompts: 100%|██████████| 2/2 [01:38<00:00, 57.75s/it]
Testing prompts: 100%|██████████| 2/2 [01:38<00:00, 49.29s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:00<00:01,  1.11it/s]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.51s/it]
Testing prompts: 100%|██████████| 3/3 [01:35<00:00, 43.20s/it]
Testing prompts: 100%|██████████| 3/3 [01:35<00:00, 31.88s/it]
