/home/ubuntu/agent-tool-testing/src/toolfuzz/agent_executors/langchain/react_old.py:14: LangChainDeprecationWarning: LangChain agents will continue to be supported, but it is recommended for new use cases to be built with LangGraph. LangGraph offers a more flexible and full-featured framework for building agents, including support for tool-calling, persistence of state, and human-in-the-loop workflows. For details, refer to the `LangGraph documentation <https://langchain-ai.github.io/langgraph/>`_ as well as guides for `Migrating from AgentExecutor <https://python.langchain.com/docs/how_to/migrate_agent/>`_ and LangGraph's `Pre-built ReAct agent <https://langchain-ai.github.io/langgraph/how-tos/create-react-agent/>`_.
  agent = initialize_agent(tools, model, agent=AgentType.ZERO_SHOT_REACT_DESCRIPTION, verbose=True,

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:02<00:05,  2.82s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:04<00:02,  2.14s/it]
Testing prompts: 100%|██████████| 3/3 [00:12<00:00,  4.98s/it]
Testing prompts: 100%|██████████| 3/3 [00:12<00:00,  4.28s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.10s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.19s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.38s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.05s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.35s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.36s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.55s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.23s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.40s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.27s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.70s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.33s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.21s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.42s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.46s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.16s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.13s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.17s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.73s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.31s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.15s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.14s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.68s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.27s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.21s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.39s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.94s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.50s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.09s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.03s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  3.13s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.57s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:00<00:01,  1.03it/s]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.03s/it]
Testing prompts: 100%|██████████| 3/3 [00:05<00:00,  2.20s/it]
Testing prompts: 100%|██████████| 3/3 [00:05<00:00,  1.88s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.30s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.15s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.87s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.42s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.42s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.30s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.86s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.45s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.09s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.07s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.64s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.21s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:03,  1.53s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.34s/it]
Testing prompts: 100%|██████████| 3/3 [00:10<00:00,  4.36s/it]
Testing prompts: 100%|██████████| 3/3 [00:10<00:00,  3.56s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.25s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.17s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.42s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.09s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.17s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.11s/it]
Testing prompts: 100%|██████████| 3/3 [00:05<00:00,  2.31s/it]
Testing prompts: 100%|██████████| 3/3 [00:05<00:00,  1.99s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.22s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.16s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.38s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.06s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.14s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.16s/it]
Testing prompts: 100%|██████████| 3/3 [00:05<00:00,  2.28s/it]
Testing prompts: 100%|██████████| 3/3 [00:05<00:00,  1.98s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.29s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.14s/it]
Testing prompts: 100%|██████████| 3/3 [00:05<00:00,  2.23s/it]
Testing prompts: 100%|██████████| 3/3 [00:05<00:00,  1.95s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.26s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.31s/it]
Testing prompts: 100%|██████████| 3/3 [00:08<00:00,  3.18s/it]
Testing prompts: 100%|██████████| 3/3 [00:08<00:00,  2.67s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:00<00:01,  1.02it/s]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.27s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.78s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.34s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.36s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:03<00:01,  1.63s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.66s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.35s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.10s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.08s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  3.01s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.49s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:03,  1.62s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.27s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.88s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.48s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.34s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.16s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.94s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.48s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:02<00:05,  2.63s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:04<00:02,  2.29s/it]
Testing prompts: 100%|██████████| 3/3 [00:08<00:00,  2.94s/it]
Testing prompts: 100%|██████████| 3/3 [00:08<00:00,  2.80s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:03,  1.69s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.26s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.36s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.11s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.14s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.18s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.44s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.09s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.08s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.20s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.37s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.04s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.45s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.20s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.48s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.16s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:03,  1.57s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.42s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.57s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.27s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:02<00:04,  2.05s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:03<00:01,  1.48s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.49s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.28s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:02<00:05,  2.58s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:03<00:01,  1.80s/it]
Testing prompts: 100%|██████████| 3/3 [00:08<00:00,  3.18s/it]
Testing prompts: 100%|██████████| 3/3 [00:08<00:00,  2.89s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.25s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.22s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.43s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.10s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.24s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.11s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.36s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.03s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.13s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.15s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.43s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.08s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.10s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.33s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.82s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.39s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.48s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:03<00:01,  1.91s/it]
Testing prompts: 100%|██████████| 3/3 [00:08<00:00,  3.02s/it]
Testing prompts: 100%|██████████| 3/3 [00:08<00:00,  2.68s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.41s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.42s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.60s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.28s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:02<00:05,  2.58s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:05<00:02,  2.54s/it]
Testing prompts: 100%|██████████| 3/3 [00:09<00:00,  3.17s/it]
Testing prompts: 100%|██████████| 3/3 [00:09<00:00,  3.00s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.20s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:03<00:01,  1.81s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.76s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.44s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:03,  1.50s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:03<00:01,  1.56s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.69s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.38s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.17s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.24s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.76s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.34s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.26s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.19s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.77s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.35s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:03,  1.52s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.42s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.96s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.56s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:03,  1.53s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.21s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.66s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.30s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.09s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:03<00:01,  1.70s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.66s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.34s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.20s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.13s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.34s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.02s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.30s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:03<00:01,  1.82s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.69s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.40s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.20s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.21s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.36s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.05s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:03,  1.97s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:03<00:01,  1.82s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.69s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.47s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.01s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.42s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.41s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.10s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.24s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.30s/it]
Testing prompts: 100%|██████████| 3/3 [00:08<00:00,  3.48s/it]
Testing prompts: 100%|██████████| 3/3 [00:08<00:00,  2.88s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.33s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.30s/it]
Testing prompts: 100%|██████████| 3/3 [00:09<00:00,  3.63s/it]
Testing prompts: 100%|██████████| 3/3 [00:09<00:00,  3.00s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:01<00:02,  1.07s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:02<00:01,  1.17s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.49s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.12s/it]
