/home/ubuntu/agent-tool-testing/src/toolfuzz/agent_executors/langchain/react_old.py:14: LangChainDeprecationWarning: LangChain agents will continue to be supported, but it is recommended for new use cases to be built with LangGraph. LangGraph offers a more flexible and full-featured framework for building agents, including support for tool-calling, persistence of state, and human-in-the-loop workflows. For details, refer to the `LangGraph documentation <https://langchain-ai.github.io/langgraph/>`_ as well as guides for `Migrating from AgentExecutor <https://python.langchain.com/docs/how_to/migrate_agent/>`_ and LangGraph's `Pre-built ReAct agent <https://langchain-ai.github.io/langgraph/how-tos/create-react-agent/>`_.
  agent = initialize_agent(tools, model, agent=AgentType.ZERO_SHOT_REACT_DESCRIPTION, verbose=True,

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:02<00:05,  2.91s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:04<00:02,  2.08s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.16s/it]
Testing prompts: 100%|██████████| 3/3 [00:06<00:00,  2.22s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:05<00:05,  5.62s/it]
Testing prompts: 100%|██████████| 2/2 [00:08<00:00,  3.92s/it]
Testing prompts: 100%|██████████| 2/2 [00:08<00:00,  4.18s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:02<00:05,  2.89s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:04<00:01,  1.94s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.66s/it]
Testing prompts: 100%|██████████| 3/3 [00:07<00:00,  2.56s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:05,  1.69it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:12,  1.60s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:15,  2.20s/it]
Testing prompts:  40%|████      | 4/10 [00:09<00:15,  2.64s/it]
Testing prompts:  50%|█████     | 5/10 [00:12<00:15,  3.02s/it]
Testing prompts:  60%|██████    | 6/10 [00:18<00:15,  3.90s/it]
Testing prompts:  70%|███████   | 7/10 [00:19<00:09,  3.05s/it]
Testing prompts:  80%|████████  | 8/10 [00:22<00:06,  3.05s/it]
Testing prompts:  90%|█████████ | 9/10 [00:27<00:03,  3.71s/it]
Testing prompts: 100%|██████████| 10/10 [00:31<00:00,  3.53s/it]
Testing prompts: 100%|██████████| 10/10 [00:31<00:00,  3.10s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:03<00:03,  3.97s/it]
Testing prompts: 100%|██████████| 2/2 [00:06<00:00,  3.41s/it]
Testing prompts: 100%|██████████| 2/2 [00:06<00:00,  3.50s/it]

Testing prompts:   0%|          | 0/9 [00:00<?, ?it/s]
Testing prompts:  11%|█         | 1/9 [00:03<00:24,  3.01s/it]
Testing prompts:  22%|██▏       | 2/9 [00:07<00:28,  4.05s/it]
Testing prompts:  33%|███▎      | 3/9 [00:09<00:17,  2.84s/it]
Testing prompts:  44%|████▍     | 4/9 [00:10<00:10,  2.19s/it]
Testing prompts:  56%|█████▌    | 5/9 [00:12<00:09,  2.26s/it]
Testing prompts:  67%|██████▋   | 6/9 [00:14<00:06,  2.08s/it]
Testing prompts:  78%|███████▊  | 7/9 [00:16<00:04,  2.22s/it]
Testing prompts:  89%|████████▉ | 8/9 [00:19<00:02,  2.21s/it]
Testing prompts: 100%|██████████| 9/9 [02:04<00:00, 34.37s/it]
Testing prompts: 100%|██████████| 9/9 [02:04<00:00, 13.81s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:08<00:16,  8.39s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:10<00:04,  4.68s/it]
Testing prompts: 100%|██████████| 3/3 [00:13<00:00,  3.75s/it]
Testing prompts: 100%|██████████| 3/3 [00:13<00:00,  4.37s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:09<00:18,  9.47s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:10<00:04,  4.79s/it]
Testing prompts: 100%|██████████| 3/3 [00:14<00:00,  4.02s/it]
Testing prompts: 100%|██████████| 3/3 [00:14<00:00,  4.69s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:04<00:04,  4.28s/it]
Testing prompts: 100%|██████████| 2/2 [00:07<00:00,  3.37s/it]
Testing prompts: 100%|██████████| 2/2 [00:07<00:00,  3.51s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:08,  1.09it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:12,  1.60s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:12,  1.73s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.36s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:09,  1.96s/it]
Testing prompts:  60%|██████    | 6/10 [00:12<00:10,  2.74s/it]
Testing prompts:  70%|███████   | 7/10 [00:18<00:10,  3.64s/it]
Testing prompts:  80%|████████  | 8/10 [00:20<00:06,  3.17s/it]
Testing prompts:  90%|█████████ | 9/10 [00:21<00:02,  2.61s/it]
Testing prompts: 100%|██████████| 10/10 [00:26<00:00,  3.16s/it]
Testing prompts: 100%|██████████| 10/10 [00:26<00:00,  2.64s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  1.83it/s]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.26s/it]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.15s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:06<00:56,  6.32s/it]
Testing prompts:  20%|██        | 2/10 [00:09<00:38,  4.76s/it]
Testing prompts:  30%|███       | 3/10 [00:13<00:28,  4.05s/it]
Testing prompts:  40%|████      | 4/10 [00:17<00:24,  4.15s/it]
Testing prompts:  50%|█████     | 5/10 [00:19<00:16,  3.22s/it]
Testing prompts:  60%|██████    | 6/10 [00:22<00:12,  3.15s/it]
Testing prompts:  70%|███████   | 7/10 [00:24<00:09,  3.03s/it]
Testing prompts:  80%|████████  | 8/10 [00:27<00:05,  2.75s/it]
Testing prompts:  90%|█████████ | 9/10 [00:36<00:04,  4.72s/it]
Testing prompts: 100%|██████████| 10/10 [00:40<00:00,  4.64s/it]
Testing prompts: 100%|██████████| 10/10 [00:40<00:00,  4.05s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:08<00:17,  8.62s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:10<00:04,  4.62s/it]
Testing prompts: 100%|██████████| 3/3 [00:13<00:00,  3.73s/it]
Testing prompts: 100%|██████████| 3/3 [00:13<00:00,  4.37s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:02<00:02,  2.48s/it]
Testing prompts: 100%|██████████| 2/2 [00:04<00:00,  2.33s/it]
Testing prompts: 100%|██████████| 2/2 [00:04<00:00,  2.36s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:10<00:20, 10.14s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:12<00:05,  5.49s/it]
Testing prompts: 100%|██████████| 3/3 [00:14<00:00,  3.93s/it]
Testing prompts: 100%|██████████| 3/3 [00:14<00:00,  4.82s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:09<01:26,  9.58s/it]
Testing prompts:  20%|██        | 2/10 [00:10<00:34,  4.37s/it]
Testing prompts:  30%|███       | 3/10 [00:14<00:29,  4.25s/it]
Testing prompts:  40%|████      | 4/10 [00:24<00:39,  6.59s/it]
Testing prompts:  50%|█████     | 5/10 [00:32<00:34,  6.95s/it]
Testing prompts:  60%|██████    | 6/10 [00:33<00:20,  5.03s/it]
Testing prompts:  70%|███████   | 7/10 [00:35<00:12,  4.20s/it]
Testing prompts:  80%|████████  | 8/10 [00:39<00:07,  3.85s/it]
Testing prompts:  90%|█████████ | 9/10 [00:41<00:03,  3.55s/it]
Testing prompts: 100%|██████████| 10/10 [00:49<00:00,  4.71s/it]
Testing prompts: 100%|██████████| 10/10 [00:49<00:00,  4.93s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  2.74it/s]
Testing prompts: 100%|██████████| 2/2 [00:05<00:00,  3.11s/it]
Testing prompts: 100%|██████████| 2/2 [00:05<00:00,  2.70s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  1.75it/s]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.50s/it]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.36s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  1.81it/s]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.56s/it]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.41s/it]

Testing prompts:   0%|          | 0/20 [00:00<?, ?it/s]
Testing prompts:   5%|▌         | 1/20 [00:00<00:10,  1.87it/s]
Testing prompts:  10%|█         | 2/20 [00:01<00:13,  1.32it/s]
Testing prompts:  15%|█▌        | 3/20 [00:13<01:40,  5.91s/it]
Testing prompts:  20%|██        | 4/20 [00:14<01:02,  3.92s/it]
Testing prompts:  25%|██▌       | 5/20 [00:15<00:42,  2.84s/it]
Testing prompts:  30%|███       | 6/20 [00:15<00:29,  2.11s/it]
Testing prompts:  35%|███▌      | 7/20 [00:17<00:24,  1.87s/it]
Testing prompts:  40%|████      | 8/20 [00:19<00:21,  1.82s/it]
Testing prompts:  45%|████▌     | 9/20 [00:20<00:18,  1.69s/it]
Testing prompts:  50%|█████     | 10/20 [00:22<00:17,  1.76s/it]
Testing prompts:  55%|█████▌    | 11/20 [00:23<00:13,  1.49s/it]
Testing prompts:  60%|██████    | 12/20 [00:26<00:16,  2.02s/it]
Testing prompts:  65%|██████▌   | 13/20 [00:27<00:12,  1.85s/it]
Testing prompts:  70%|███████   | 14/20 [00:29<00:10,  1.75s/it]
Testing prompts:  75%|███████▌  | 15/20 [00:31<00:08,  1.73s/it]
Testing prompts:  80%|████████  | 16/20 [00:34<00:08,  2.18s/it]
Testing prompts:  85%|████████▌ | 17/20 [00:35<00:05,  1.97s/it]
Testing prompts:  90%|█████████ | 18/20 [00:42<00:06,  3.32s/it]
Testing prompts:  95%|█████████▌| 19/20 [00:44<00:02,  2.88s/it]
Testing prompts: 100%|██████████| 20/20 [00:46<00:00,  2.59s/it]
Testing prompts: 100%|██████████| 20/20 [00:46<00:00,  2.30s/it]

Testing prompts:   0%|          | 0/6 [00:00<?, ?it/s]
Testing prompts:  17%|█▋        | 1/6 [00:07<00:36,  7.23s/it]
Testing prompts:  33%|███▎      | 2/6 [00:11<00:22,  5.74s/it]
Testing prompts:  50%|█████     | 3/6 [00:13<00:11,  3.75s/it]
Testing prompts:  67%|██████▋   | 4/6 [00:14<00:05,  2.91s/it]
Testing prompts:  83%|████████▎ | 5/6 [00:16<00:02,  2.32s/it]
Testing prompts: 100%|██████████| 6/6 [00:19<00:00,  2.56s/it]
Testing prompts: 100%|██████████| 6/6 [00:19<00:00,  3.21s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:07<00:07,  7.19s/it]
Testing prompts: 100%|██████████| 2/2 [00:29<00:00, 15.83s/it]
Testing prompts: 100%|██████████| 2/2 [00:29<00:00, 14.53s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:23<03:27, 23.06s/it]
Testing prompts:  20%|██        | 2/10 [00:26<01:30, 11.36s/it]
Testing prompts:  30%|███       | 3/10 [00:28<00:51,  7.38s/it]
Testing prompts:  40%|████      | 4/10 [00:29<00:28,  4.83s/it]
Testing prompts:  50%|█████     | 5/10 [00:40<00:34,  7.00s/it]
Testing prompts:  60%|██████    | 6/10 [00:48<00:29,  7.35s/it]
Testing prompts:  70%|███████   | 7/10 [00:50<00:16,  5.41s/it]
Testing prompts:  80%|████████  | 8/10 [00:52<00:08,  4.30s/it]
Testing prompts:  90%|█████████ | 9/10 [00:55<00:04,  4.17s/it]
Testing prompts: 100%|██████████| 10/10 [00:59<00:00,  3.96s/it]
Testing prompts: 100%|██████████| 10/10 [00:59<00:00,  5.94s/it]

Testing prompts:   0%|          | 0/15 [00:00<?, ?it/s]
Testing prompts:   7%|▋         | 1/15 [00:00<00:07,  1.95it/s]
Testing prompts:  13%|█▎        | 2/15 [00:02<00:14,  1.14s/it]
Testing prompts:  20%|██        | 3/15 [00:03<00:15,  1.25s/it]
Testing prompts:  27%|██▋       | 4/15 [00:04<00:11,  1.03s/it]
Testing prompts:  33%|███▎      | 5/15 [00:05<00:10,  1.07s/it]
Testing prompts:  40%|████      | 6/15 [00:06<00:08,  1.05it/s]
Testing prompts:  47%|████▋     | 7/15 [00:07<00:09,  1.20s/it]
Testing prompts:  53%|█████▎    | 8/15 [00:10<00:10,  1.56s/it]
Testing prompts:  60%|██████    | 9/15 [00:14<00:14,  2.48s/it]
Testing prompts:  67%|██████▋   | 10/15 [00:16<00:11,  2.31s/it]
Testing prompts:  73%|███████▎  | 11/15 [00:17<00:07,  1.88s/it]
Testing prompts:  80%|████████  | 12/15 [00:18<00:05,  1.72s/it]
Testing prompts:  87%|████████▋ | 13/15 [00:23<00:05,  2.54s/it]
Testing prompts:  93%|█████████▎| 14/15 [00:25<00:02,  2.39s/it]
Testing prompts: 100%|██████████| 15/15 [00:26<00:00,  2.11s/it]
Testing prompts: 100%|██████████| 15/15 [00:26<00:00,  1.78s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:04<00:08,  4.05s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:05<00:02,  2.36s/it]
Testing prompts: 100%|██████████| 3/3 [02:19<00:00, 62.42s/it]
Testing prompts: 100%|██████████| 3/3 [02:19<00:00, 46.37s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:04<00:04,  4.11s/it]
Testing prompts: 100%|██████████| 2/2 [00:07<00:00,  3.47s/it]
Testing prompts: 100%|██████████| 2/2 [00:07<00:00,  3.57s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.92it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:10,  1.28s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:11,  1.69s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:13,  2.20s/it]
Testing prompts:  50%|█████     | 5/10 [00:10<00:13,  2.66s/it]
Testing prompts:  60%|██████    | 6/10 [00:13<00:10,  2.52s/it]
Testing prompts:  70%|███████   | 7/10 [00:26<00:18,  6.03s/it][2025-05-10 02:49:35,757][WARNING] Error response when hitting Wikibase: Error(code='resource-not-found', message='The requested resource does not exist', additional_properties={'context': {'resource_type': 'label'}})

Testing prompts:  80%|████████  | 8/10 [00:35<00:13,  6.93s/it]
Testing prompts:  90%|█████████ | 9/10 [00:43<00:07,  7.27s/it]
Testing prompts: 100%|██████████| 10/10 [00:47<00:00,  6.26s/it]
Testing prompts: 100%|██████████| 10/10 [00:47<00:00,  4.73s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:08<01:15,  8.41s/it]
Testing prompts:  20%|██        | 2/10 [00:12<00:45,  5.71s/it]
Testing prompts:  30%|███       | 3/10 [00:13<00:26,  3.78s/it]
Testing prompts:  40%|████      | 4/10 [00:18<00:24,  4.08s/it]
Testing prompts:  50%|█████     | 5/10 [00:21<00:19,  3.94s/it]
Testing prompts:  60%|██████    | 6/10 [00:25<00:14,  3.69s/it]
Testing prompts:  70%|███████   | 7/10 [00:27<00:09,  3.11s/it]
Testing prompts:  80%|████████  | 8/10 [00:30<00:06,  3.21s/it]
Testing prompts:  90%|█████████ | 9/10 [00:31<00:02,  2.63s/it]
Testing prompts: 100%|██████████| 10/10 [00:33<00:00,  2.33s/it]
Testing prompts: 100%|██████████| 10/10 [00:33<00:00,  3.35s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:09<01:26,  9.64s/it]
Testing prompts:  20%|██        | 2/10 [00:16<01:02,  7.83s/it]
Testing prompts:  30%|███       | 3/10 [00:19<00:39,  5.62s/it]
Testing prompts:  40%|████      | 4/10 [00:22<00:28,  4.70s/it]
Testing prompts:  50%|█████     | 5/10 [00:24<00:18,  3.76s/it]
Testing prompts:  60%|██████    | 6/10 [00:29<00:15,  3.99s/it]
Testing prompts:  70%|███████   | 7/10 [00:33<00:12,  4.04s/it]
Testing prompts:  80%|████████  | 8/10 [00:36<00:07,  3.96s/it][2025-05-10 02:51:16,206][WARNING] Could not find item Q14005 in Wikidata

Testing prompts:  90%|█████████ | 9/10 [00:48<00:06,  6.48s/it][2025-05-10 02:51:24,942][WARNING] Could not find item Q14005 in Wikidata

Testing prompts: 100%|██████████| 10/10 [00:55<00:00,  6.47s/it]
Testing prompts: 100%|██████████| 10/10 [00:55<00:00,  5.54s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  1.93it/s]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.58s/it]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.42s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:09<00:18,  9.02s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:11<00:04,  4.94s/it]
Testing prompts: 100%|██████████| 3/3 [00:14<00:00,  4.03s/it]
Testing prompts: 100%|██████████| 3/3 [00:14<00:00,  4.68s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:03,  2.83it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.01it/s]
Testing prompts:  30%|███       | 3/10 [00:04<00:13,  1.92s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:12,  2.05s/it]
Testing prompts:  50%|█████     | 5/10 [00:09<00:10,  2.15s/it]
Testing prompts:  60%|██████    | 6/10 [00:13<00:10,  2.71s/it]
Testing prompts:  70%|███████   | 7/10 [00:16<00:08,  2.95s/it]
Testing prompts:  80%|████████  | 8/10 [00:25<00:09,  4.79s/it]
Testing prompts:  90%|█████████ | 9/10 [00:26<00:03,  3.73s/it]
Testing prompts: 100%|██████████| 10/10 [00:30<00:00,  3.86s/it]
Testing prompts: 100%|██████████| 10/10 [00:30<00:00,  3.09s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  1.43it/s]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.45s/it]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.33s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  1.90it/s]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.10s/it]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.01s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  2.05it/s]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.52s/it]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.36s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:09<01:27,  9.69s/it]
Testing prompts:  20%|██        | 2/10 [00:12<00:45,  5.70s/it]
Testing prompts:  30%|███       | 3/10 [00:15<00:32,  4.60s/it]
Testing prompts:  40%|████      | 4/10 [00:18<00:22,  3.79s/it]
Testing prompts:  50%|█████     | 5/10 [00:20<00:16,  3.25s/it]
Testing prompts:  60%|██████    | 6/10 [00:29<00:21,  5.25s/it]
Testing prompts:  70%|███████   | 7/10 [00:31<00:11,  3.94s/it]
Testing prompts:  80%|████████  | 8/10 [00:32<00:05,  2.98s/it]
Testing prompts:  90%|█████████ | 9/10 [00:33<00:02,  2.42s/it]
Testing prompts: 100%|██████████| 10/10 [00:38<00:00,  3.40s/it]
Testing prompts: 100%|██████████| 10/10 [00:38<00:00,  3.88s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:03<00:06,  3.25s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:04<00:02,  2.34s/it]
Testing prompts: 100%|██████████| 3/3 [02:03<00:00, 55.47s/it]
Testing prompts: 100%|██████████| 3/3 [02:03<00:00, 41.22s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:01<00:01,  1.14s/it]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.25s/it]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.23s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:02<00:02,  2.04s/it]
Testing prompts: 100%|██████████| 2/2 [00:03<00:00,  1.43s/it]
Testing prompts: 100%|██████████| 2/2 [00:03<00:00,  1.52s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  1.70it/s]
Testing prompts: 100%|██████████| 2/2 [00:01<00:00,  1.01s/it]
Testing prompts: 100%|██████████| 2/2 [00:01<00:00,  1.05it/s]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:06<01:02,  6.90s/it]
Testing prompts:  20%|██        | 2/10 [00:09<00:33,  4.17s/it]
Testing prompts:  30%|███       | 3/10 [00:10<00:18,  2.68s/it]
Testing prompts:  40%|████      | 4/10 [00:11<00:14,  2.36s/it]
Testing prompts:  50%|█████     | 5/10 [00:17<00:17,  3.55s/it]
Testing prompts:  60%|██████    | 6/10 [00:27<00:22,  5.67s/it]
Testing prompts:  70%|███████   | 7/10 [00:29<00:13,  4.55s/it]
Testing prompts:  80%|████████  | 8/10 [00:33<00:08,  4.39s/it]
Testing prompts:  90%|█████████ | 9/10 [00:35<00:03,  3.55s/it]
Testing prompts: 100%|██████████| 10/10 [00:36<00:00,  2.93s/it]
Testing prompts: 100%|██████████| 10/10 [00:36<00:00,  3.69s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  1.96it/s]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.43s/it]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.29s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  1.96it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:08,  1.04s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:11,  1.62s/it]
Testing prompts:  40%|████      | 4/10 [00:10<00:20,  3.35s/it]
Testing prompts:  50%|█████     | 5/10 [00:11<00:12,  2.47s/it]
Testing prompts:  60%|██████    | 6/10 [00:12<00:07,  1.96s/it]
Testing prompts:  70%|███████   | 7/10 [00:16<00:08,  2.87s/it]
Testing prompts:  80%|████████  | 8/10 [00:18<00:04,  2.33s/it]
Testing prompts:  90%|█████████ | 9/10 [00:24<00:03,  3.48s/it]
Testing prompts: 100%|██████████| 10/10 [00:27<00:00,  3.39s/it]
Testing prompts: 100%|██████████| 10/10 [00:27<00:00,  2.72s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:09<01:21,  9.03s/it]
Testing prompts:  20%|██        | 2/10 [00:12<00:44,  5.51s/it]
Testing prompts:  30%|███       | 3/10 [00:14<00:29,  4.23s/it]
Testing prompts:  40%|████      | 4/10 [00:18<00:24,  4.07s/it]
Testing prompts:  50%|█████     | 5/10 [00:20<00:17,  3.45s/it]
Testing prompts:  60%|██████    | 6/10 [00:27<00:17,  4.46s/it]
Testing prompts:  70%|███████   | 7/10 [00:29<00:11,  3.76s/it]
Testing prompts:  80%|████████  | 8/10 [00:33<00:07,  3.64s/it]
Testing prompts:  90%|█████████ | 9/10 [00:38<00:04,  4.17s/it]
Testing prompts: 100%|██████████| 10/10 [00:40<00:00,  3.67s/it]
Testing prompts: 100%|██████████| 10/10 [00:40<00:00,  4.09s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  2.63it/s]
Testing prompts: 100%|██████████| 2/2 [00:01<00:00,  1.06s/it]
Testing prompts: 100%|██████████| 2/2 [00:01<00:00,  1.05it/s]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:25,  2.81s/it]
Testing prompts:  20%|██        | 2/10 [00:06<00:28,  3.58s/it]
Testing prompts:  30%|███       | 3/10 [00:10<00:24,  3.53s/it]
Testing prompts:  40%|████      | 4/10 [00:11<00:16,  2.67s/it]
Testing prompts:  50%|█████     | 5/10 [00:21<00:25,  5.11s/it]
Testing prompts:  60%|██████    | 6/10 [00:23<00:17,  4.33s/it]
Testing prompts:  70%|███████   | 7/10 [00:30<00:15,  5.11s/it]
Testing prompts:  80%|████████  | 8/10 [00:33<00:08,  4.39s/it]
Testing prompts:  90%|█████████ | 9/10 [00:34<00:03,  3.41s/it]
Testing prompts: 100%|██████████| 10/10 [00:39<00:00,  3.70s/it]
Testing prompts: 100%|██████████| 10/10 [00:39<00:00,  3.92s/it]

Testing prompts:   0%|          | 0/6 [00:00<?, ?it/s]
Testing prompts:  17%|█▋        | 1/6 [00:07<00:36,  7.32s/it]
Testing prompts:  33%|███▎      | 2/6 [00:11<00:21,  5.32s/it]
Testing prompts:  50%|█████     | 3/6 [00:13<00:11,  3.80s/it]
Testing prompts:  67%|██████▋   | 4/6 [00:14<00:05,  2.87s/it]
Testing prompts:  83%|████████▎ | 5/6 [00:18<00:03,  3.13s/it]
Testing prompts: 100%|██████████| 6/6 [02:30<00:00, 47.13s/it]
Testing prompts: 100%|██████████| 6/6 [02:30<00:00, 25.13s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  2.01it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:09,  1.17s/it]
Testing prompts:  30%|███       | 3/10 [00:03<00:09,  1.36s/it]
Testing prompts:  40%|████      | 4/10 [00:04<00:07,  1.20s/it]
Testing prompts:  50%|█████     | 5/10 [00:06<00:07,  1.43s/it]
Testing prompts:  60%|██████    | 6/10 [00:08<00:06,  1.63s/it]
Testing prompts:  70%|███████   | 7/10 [00:13<00:07,  2.58s/it]
Testing prompts:  80%|████████  | 8/10 [00:14<00:04,  2.23s/it]
Testing prompts:  90%|█████████ | 9/10 [00:15<00:01,  1.80s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  2.00s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  1.79s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:09<00:18,  9.32s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:10<00:04,  4.80s/it]
Testing prompts: 100%|██████████| 3/3 [00:13<00:00,  3.56s/it]
Testing prompts: 100%|██████████| 3/3 [00:13<00:00,  4.35s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:05<00:45,  5.06s/it]
Testing prompts:  20%|██        | 2/10 [00:08<00:31,  3.97s/it]
Testing prompts:  30%|███       | 3/10 [00:12<00:27,  3.95s/it]
Testing prompts:  40%|████      | 4/10 [00:16<00:23,  3.99s/it]
Testing prompts:  50%|█████     | 5/10 [00:17<00:15,  3.09s/it]
Testing prompts:  60%|██████    | 6/10 [00:20<00:12,  3.06s/it]
Testing prompts:  70%|███████   | 7/10 [00:23<00:08,  2.86s/it]
Testing prompts:  80%|████████  | 8/10 [00:26<00:05,  2.94s/it]
Testing prompts:  90%|█████████ | 9/10 [00:34<00:04,  4.72s/it]
Testing prompts: 100%|██████████| 10/10 [00:37<00:00,  4.02s/it]
Testing prompts: 100%|██████████| 10/10 [00:37<00:00,  3.74s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:06,  1.48it/s]
Testing prompts:  20%|██        | 2/10 [00:02<00:08,  1.07s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:13,  2.00s/it]
Testing prompts:  40%|████      | 4/10 [00:08<00:14,  2.43s/it]
Testing prompts:  50%|█████     | 5/10 [00:09<00:10,  2.15s/it]
Testing prompts:  60%|██████    | 6/10 [00:11<00:07,  1.89s/it]
Testing prompts:  70%|███████   | 7/10 [00:12<00:04,  1.56s/it]
Testing prompts:  80%|████████  | 8/10 [00:18<00:06,  3.15s/it]
Testing prompts:  90%|█████████ | 9/10 [00:19<00:02,  2.55s/it]
Testing prompts: 100%|██████████| 10/10 [00:24<00:00,  3.12s/it]
Testing prompts: 100%|██████████| 10/10 [00:24<00:00,  2.43s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:00<00:04,  2.06it/s]
Testing prompts:  20%|██        | 2/10 [00:01<00:08,  1.05s/it]
Testing prompts:  30%|███       | 3/10 [00:04<00:11,  1.68s/it]
Testing prompts:  40%|████      | 4/10 [00:05<00:08,  1.42s/it]
Testing prompts:  50%|█████     | 5/10 [00:07<00:08,  1.73s/it]
Testing prompts:  60%|██████    | 6/10 [00:09<00:07,  1.85s/it]
Testing prompts:  70%|███████   | 7/10 [00:11<00:05,  1.93s/it]
Testing prompts:  80%|████████  | 8/10 [00:13<00:03,  2.00s/it]
Testing prompts:  90%|█████████ | 9/10 [00:16<00:02,  2.24s/it]
Testing prompts: 100%|██████████| 10/10 [00:18<00:00,  2.20s/it]
Testing prompts: 100%|██████████| 10/10 [00:18<00:00,  1.89s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  3.08it/s]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.64s/it]
Testing prompts: 100%|██████████| 2/2 [00:02<00:00,  1.44s/it]

Testing prompts:   0%|          | 0/3 [00:00<?, ?it/s]
Testing prompts:  33%|███▎      | 1/3 [00:06<00:13,  6.71s/it]
Testing prompts:  67%|██████▋   | 2/3 [00:08<00:03,  3.66s/it]
Testing prompts: 100%|██████████| 3/3 [00:09<00:00,  2.66s/it]
Testing prompts: 100%|██████████| 3/3 [00:09<00:00,  3.23s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:10,  1.12s/it]
Testing prompts:  20%|██        | 2/10 [00:01<00:07,  1.06it/s]
Testing prompts:  30%|███       | 3/10 [00:15<00:47,  6.79s/it]
Testing prompts:  40%|████      | 4/10 [00:16<00:27,  4.52s/it]
Testing prompts:  50%|█████     | 5/10 [00:18<00:17,  3.42s/it]
Testing prompts:  60%|██████    | 6/10 [00:19<00:10,  2.55s/it]
Testing prompts:  70%|███████   | 7/10 [00:20<00:06,  2.15s/it]
Testing prompts:  80%|████████  | 8/10 [00:28<00:08,  4.03s/it]
Testing prompts:  90%|█████████ | 9/10 [00:36<00:05,  5.35s/it]
Testing prompts: 100%|██████████| 10/10 [00:44<00:00,  5.97s/it]
Testing prompts: 100%|██████████| 10/10 [00:44<00:00,  4.40s/it]

Testing prompts:   0%|          | 0/2 [00:00<?, ?it/s]
Testing prompts:  50%|█████     | 1/2 [00:00<00:00,  2.79it/s]
Testing prompts: 100%|██████████| 2/2 [00:01<00:00,  1.05it/s]
Testing prompts: 100%|██████████| 2/2 [00:01<00:00,  1.15it/s]
