/home/ubuntu/agent-tool-testing/src/toolfuzz/agent_executors/langchain/react_old.py:14: LangChainDeprecationWarning: LangChain agents will continue to be supported, but it is recommended for new use cases to be built with LangGraph. LangGraph offers a more flexible and full-featured framework for building agents, including support for tool-calling, persistence of state, and human-in-the-loop workflows. For details, refer to the `LangGraph documentation <https://langchain-ai.github.io/langgraph/>`_ as well as guides for `Migrating from AgentExecutor <https://python.langchain.com/docs/how_to/migrate_agent/>`_ and LangGraph's `Pre-built ReAct agent <https://langchain-ai.github.io/langgraph/how-tos/create-react-agent/>`_.
  agent = initialize_agent(tools, model, agent=AgentType.ZERO_SHOT_REACT_DESCRIPTION, verbose=True,

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:17,  1.93s/it]
Testing prompts:  20%|██        | 2/10 [00:06<00:28,  3.62s/it]
Testing prompts:  30%|███       | 3/10 [00:08<00:18,  2.71s/it]
Testing prompts:  40%|████      | 4/10 [00:11<00:16,  2.79s/it]
Testing prompts:  50%|█████     | 5/10 [00:13<00:12,  2.45s/it]
Testing prompts:  60%|██████    | 6/10 [00:15<00:09,  2.31s/it]
Testing prompts:  70%|███████   | 7/10 [00:16<00:06,  2.01s/it]
Testing prompts:  80%|████████  | 8/10 [00:22<00:06,  3.24s/it]
Testing prompts:  90%|█████████ | 9/10 [00:25<00:03,  3.13s/it]
Testing prompts: 100%|██████████| 10/10 [00:28<00:00,  3.20s/it]
Testing prompts: 100%|██████████| 10/10 [00:28<00:00,  2.87s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:07<01:05,  7.24s/it]
Testing prompts:  20%|██        | 2/10 [00:09<00:33,  4.23s/it]
Testing prompts:  30%|███       | 3/10 [00:11<00:22,  3.27s/it]
Testing prompts:  40%|████      | 4/10 [00:13<00:16,  2.75s/it]
Testing prompts:  50%|█████     | 5/10 [00:16<00:14,  2.94s/it]
Testing prompts:  60%|██████    | 6/10 [00:19<00:10,  2.74s/it]
Testing prompts:  70%|███████   | 7/10 [00:21<00:07,  2.64s/it]
Testing prompts:  80%|████████  | 8/10 [03:27<02:01, 60.89s/it]
Testing prompts:  90%|█████████ | 9/10 [03:29<00:42, 42.45s/it]
Testing prompts: 100%|██████████| 10/10 [03:31<00:00, 29.98s/it]
Testing prompts: 100%|██████████| 10/10 [03:31<00:00, 21.11s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:05<00:46,  5.13s/it]
Testing prompts:  20%|██        | 2/10 [00:07<00:25,  3.22s/it]
Testing prompts:  30%|███       | 3/10 [00:10<00:22,  3.24s/it]
Testing prompts:  40%|████      | 4/10 [00:11<00:14,  2.35s/it]
Testing prompts:  50%|█████     | 5/10 [00:13<00:10,  2.17s/it]
Testing prompts:  60%|██████    | 6/10 [00:13<00:06,  1.73s/it]
Testing prompts:  70%|███████   | 7/10 [00:15<00:04,  1.56s/it]
Testing prompts:  80%|████████  | 8/10 [00:18<00:04,  2.05s/it]
Testing prompts:  90%|█████████ | 9/10 [00:20<00:02,  2.15s/it]
Testing prompts: 100%|██████████| 10/10 [00:22<00:00,  1.91s/it]
Testing prompts: 100%|██████████| 10/10 [00:22<00:00,  2.20s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:04<00:42,  4.69s/it]
Testing prompts:  20%|██        | 2/10 [00:05<00:21,  2.65s/it]
Testing prompts:  30%|███       | 3/10 [00:07<00:14,  2.04s/it]
Testing prompts:  40%|████      | 4/10 [00:08<00:10,  1.77s/it]
Testing prompts:  50%|█████     | 5/10 [00:09<00:07,  1.52s/it]
Testing prompts:  60%|██████    | 6/10 [00:10<00:05,  1.35s/it]
Testing prompts:  70%|███████   | 7/10 [00:12<00:04,  1.59s/it]
Testing prompts:  80%|████████  | 8/10 [00:13<00:02,  1.40s/it]
Testing prompts:  90%|█████████ | 9/10 [00:15<00:01,  1.58s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  1.75s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  1.79s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.41s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.43s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:13,  1.86s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:11,  1.90s/it]
Testing prompts:  50%|█████     | 5/10 [00:09<00:09,  1.94s/it]
Testing prompts:  60%|██████    | 6/10 [00:11<00:08,  2.10s/it]
Testing prompts:  70%|███████   | 7/10 [00:13<00:06,  2.08s/it]
Testing prompts:  80%|████████  | 8/10 [00:15<00:03,  1.85s/it]
Testing prompts:  90%|█████████ | 9/10 [00:16<00:01,  1.61s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  1.56s/it]
Testing prompts: 100%|██████████| 10/10 [00:17<00:00,  1.75s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:14,  1.62s/it]
Testing prompts:  20%|██        | 2/10 [00:02<00:11,  1.42s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.83s/it]
Testing prompts:  40%|████      | 4/10 [03:11<07:27, 74.55s/it]
Testing prompts:  50%|█████     | 5/10 [03:12<03:59, 48.00s/it]
Testing prompts:  60%|██████    | 6/10 [03:14<02:09, 32.34s/it]
Testing prompts:  70%|███████   | 7/10 [03:15<01:07, 22.37s/it]
Testing prompts:  80%|████████  | 8/10 [03:17<00:31, 15.87s/it]
Testing prompts:  90%|█████████ | 9/10 [03:19<00:11, 11.53s/it]
Testing prompts: 100%|██████████| 10/10 [03:20<00:00,  8.15s/it]
Testing prompts: 100%|██████████| 10/10 [03:20<00:00, 20.05s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:08<01:20,  8.99s/it]
Testing prompts:  20%|██        | 2/10 [00:10<00:38,  4.86s/it]
Testing prompts:  30%|███       | 3/10 [00:12<00:24,  3.53s/it]
Testing prompts:  40%|████      | 4/10 [00:15<00:17,  2.99s/it]
Testing prompts:  50%|█████     | 5/10 [00:19<00:17,  3.45s/it]
Testing prompts:  60%|██████    | 6/10 [00:21<00:11,  2.92s/it]
Testing prompts:  70%|███████   | 7/10 [00:23<00:08,  2.83s/it]
Testing prompts:  80%|████████  | 8/10 [00:25<00:04,  2.44s/it]
Testing prompts:  90%|█████████ | 9/10 [00:28<00:02,  2.72s/it]
Testing prompts: 100%|██████████| 10/10 [00:30<00:00,  2.31s/it]
Testing prompts: 100%|██████████| 10/10 [00:30<00:00,  3.02s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:05<00:47,  5.24s/it]
Testing prompts:  20%|██        | 2/10 [00:06<00:25,  3.19s/it]
Testing prompts:  30%|███       | 3/10 [00:08<00:17,  2.45s/it]
Testing prompts:  40%|████      | 4/10 [00:10<00:12,  2.10s/it]
Testing prompts:  50%|█████     | 5/10 [03:16<05:41, 68.37s/it]
Testing prompts:  60%|██████    | 6/10 [03:18<03:04, 46.02s/it]
Testing prompts:  70%|███████   | 7/10 [03:20<01:34, 31.63s/it]
Testing prompts:  80%|████████  | 8/10 [03:21<00:43, 21.83s/it]
Testing prompts:  90%|█████████ | 9/10 [03:23<00:15, 15.59s/it]
Testing prompts: 100%|██████████| 10/10 [03:26<00:00, 11.67s/it]
Testing prompts: 100%|██████████| 10/10 [03:26<00:00, 20.62s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:14,  1.60s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:15,  1.91s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:15,  2.17s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:10,  1.70s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:08,  1.63s/it]
Testing prompts:  60%|██████    | 6/10 [00:11<00:08,  2.16s/it]
Testing prompts:  70%|███████   | 7/10 [00:13<00:05,  1.82s/it]
Testing prompts:  80%|████████  | 8/10 [03:19<02:01, 60.50s/it]
Testing prompts:  90%|█████████ | 9/10 [03:20<00:41, 41.94s/it]
Testing prompts: 100%|██████████| 10/10 [03:22<00:00, 29.78s/it]
Testing prompts: 100%|██████████| 10/10 [03:22<00:00, 20.28s/it]

Testing prompts:   0%|          | 0/20 [00:00<?, ?it/s]
Testing prompts:   5%|▌         | 1/20 [00:06<02:05,  6.60s/it]
Testing prompts:  10%|█         | 2/20 [00:08<01:05,  3.62s/it]
Testing prompts:  15%|█▌        | 3/20 [00:10<00:53,  3.15s/it]
Testing prompts:  20%|██        | 4/20 [00:11<00:37,  2.34s/it]
Testing prompts:  25%|██▌       | 5/20 [00:13<00:33,  2.26s/it]
Testing prompts:  30%|███       | 6/20 [00:16<00:33,  2.36s/it]
Testing prompts:  35%|███▌      | 7/20 [00:18<00:30,  2.38s/it]
Testing prompts:  40%|████      | 8/20 [00:21<00:27,  2.29s/it]
Testing prompts:  45%|████▌     | 9/20 [00:24<00:28,  2.62s/it]
Testing prompts:  50%|█████     | 10/20 [00:25<00:22,  2.20s/it]
Testing prompts:  55%|█████▌    | 11/20 [00:27<00:18,  2.07s/it]
Testing prompts:  60%|██████    | 12/20 [00:29<00:17,  2.16s/it]
Testing prompts:  65%|██████▌   | 13/20 [00:31<00:14,  2.14s/it]
Testing prompts:  70%|███████   | 14/20 [00:33<00:12,  2.13s/it]
Testing prompts:  75%|███████▌  | 15/20 [00:35<00:10,  2.05s/it]
Testing prompts:  80%|████████  | 16/20 [00:37<00:08,  2.04s/it]
Testing prompts:  85%|████████▌ | 17/20 [00:40<00:06,  2.10s/it]
Testing prompts:  90%|█████████ | 18/20 [00:43<00:04,  2.41s/it]
Testing prompts:  95%|█████████▌| 19/20 [00:45<00:02,  2.31s/it]
Testing prompts: 100%|██████████| 20/20 [00:46<00:00,  2.12s/it]
Testing prompts: 100%|██████████| 20/20 [00:46<00:00,  2.35s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:04<00:36,  4.09s/it]
Testing prompts:  20%|██        | 2/10 [00:05<00:20,  2.54s/it]
Testing prompts:  30%|███       | 3/10 [00:11<00:28,  4.10s/it]
Testing prompts:  40%|████      | 4/10 [00:13<00:20,  3.47s/it]
Testing prompts:  50%|█████     | 5/10 [00:15<00:13,  2.61s/it]
Testing prompts:  60%|██████    | 6/10 [03:21<04:19, 64.94s/it]
Testing prompts:  70%|███████   | 7/10 [03:22<02:12, 44.13s/it]
Testing prompts:  80%|████████  | 8/10 [05:37<02:26, 73.25s/it]
Testing prompts:  90%|█████████ | 9/10 [05:40<00:51, 51.07s/it]
Testing prompts: 100%|██████████| 10/10 [05:40<00:00, 35.51s/it]
Testing prompts: 100%|██████████| 10/10 [05:40<00:00, 34.09s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:06<00:59,  6.64s/it]
Testing prompts:  20%|██        | 2/10 [00:08<00:28,  3.55s/it]
Testing prompts:  30%|███       | 3/10 [00:09<00:18,  2.69s/it]
Testing prompts:  40%|████      | 4/10 [00:11<00:13,  2.18s/it]
Testing prompts:  50%|█████     | 5/10 [03:17<05:43, 68.60s/it]
Testing prompts:  60%|██████    | 6/10 [03:18<03:02, 45.65s/it]
Testing prompts:  70%|███████   | 7/10 [03:19<01:33, 31.10s/it]
Testing prompts:  80%|████████  | 8/10 [03:21<00:43, 21.80s/it]
Testing prompts:  90%|█████████ | 9/10 [03:24<00:15, 15.81s/it]
Testing prompts: 100%|██████████| 10/10 [06:30<00:00, 68.29s/it]
Testing prompts: 100%|██████████| 10/10 [06:30<00:00, 39.00s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:06<00:58,  6.54s/it]
Testing prompts:  20%|██        | 2/10 [00:08<00:29,  3.66s/it]
Testing prompts:  30%|███       | 3/10 [00:09<00:18,  2.57s/it]
Testing prompts:  40%|████      | 4/10 [00:11<00:13,  2.19s/it]
Testing prompts:  50%|█████     | 5/10 [00:13<00:10,  2.19s/it]
Testing prompts:  60%|██████    | 6/10 [00:15<00:09,  2.34s/it]
Testing prompts:  70%|███████   | 7/10 [00:17<00:06,  2.20s/it]
Testing prompts:  80%|████████  | 8/10 [00:20<00:04,  2.49s/it]
Testing prompts:  90%|█████████ | 9/10 [00:24<00:02,  2.68s/it]
Testing prompts: 100%|██████████| 10/10 [00:25<00:00,  2.28s/it]
Testing prompts: 100%|██████████| 10/10 [00:25<00:00,  2.54s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.47s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:20,  2.61s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:16,  2.37s/it]
Testing prompts:  40%|████      | 4/10 [00:09<00:13,  2.25s/it]
Testing prompts:  50%|█████     | 5/10 [00:10<00:10,  2.12s/it]
Testing prompts:  60%|██████    | 6/10 [03:16<04:18, 64.59s/it]
Testing prompts:  70%|███████   | 7/10 [03:18<02:11, 43.95s/it]
Testing prompts:  80%|████████  | 8/10 [03:19<01:00, 30.46s/it]
Testing prompts:  90%|█████████ | 9/10 [03:21<00:21, 21.34s/it]
Testing prompts: 100%|██████████| 10/10 [03:23<00:00, 15.40s/it]
Testing prompts: 100%|██████████| 10/10 [03:23<00:00, 20.32s/it]

Testing prompts:   0%|          | 0/20 [00:00<?, ?it/s]
Testing prompts:   5%|▌         | 1/20 [00:01<00:29,  1.54s/it]
Testing prompts:  10%|█         | 2/20 [00:04<00:38,  2.16s/it]
Testing prompts:  15%|█▌        | 3/20 [00:06<00:34,  2.03s/it]
Testing prompts:  20%|██        | 4/20 [00:07<00:31,  1.94s/it]
Testing prompts:  25%|██▌       | 5/20 [00:10<00:32,  2.20s/it]
Testing prompts:  30%|███       | 6/20 [00:14<00:37,  2.67s/it]
Testing prompts:  35%|███▌      | 7/20 [00:16<00:34,  2.64s/it]
Testing prompts:  40%|████      | 8/20 [00:19<00:30,  2.57s/it]
Testing prompts:  45%|████▌     | 9/20 [00:21<00:27,  2.47s/it]
Testing prompts:  50%|█████     | 10/20 [00:23<00:22,  2.25s/it]
Testing prompts:  55%|█████▌    | 11/20 [00:25<00:20,  2.28s/it]
Testing prompts:  60%|██████    | 12/20 [00:27<00:17,  2.22s/it]
Testing prompts:  65%|██████▌   | 13/20 [00:29<00:15,  2.19s/it]
Testing prompts:  70%|███████   | 14/20 [00:31<00:12,  2.05s/it]
Testing prompts:  75%|███████▌  | 15/20 [00:33<00:10,  2.14s/it]
Testing prompts:  80%|████████  | 16/20 [00:38<00:12,  3.01s/it]
Testing prompts:  85%|████████▌ | 17/20 [00:42<00:09,  3.18s/it]
Testing prompts:  90%|█████████ | 18/20 [00:43<00:05,  2.62s/it]
Testing prompts:  95%|█████████▌| 19/20 [00:45<00:02,  2.41s/it]
Testing prompts: 100%|██████████| 20/20 [00:46<00:00,  2.12s/it]
Testing prompts: 100%|██████████| 20/20 [00:46<00:00,  2.35s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:11,  1.33s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:15,  1.98s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:17,  2.45s/it]
Testing prompts:  40%|████      | 4/10 [00:10<00:17,  2.86s/it]
Testing prompts:  50%|█████     | 5/10 [00:13<00:14,  2.94s/it]
Testing prompts:  60%|██████    | 6/10 [00:15<00:10,  2.54s/it]
Testing prompts:  70%|███████   | 7/10 [00:17<00:07,  2.46s/it]
Testing prompts:  80%|████████  | 8/10 [00:19<00:04,  2.41s/it]
Testing prompts:  90%|█████████ | 9/10 [00:21<00:02,  2.26s/it]
Testing prompts: 100%|██████████| 10/10 [00:22<00:00,  1.93s/it]
Testing prompts: 100%|██████████| 10/10 [00:22<00:00,  2.28s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:01<00:04,  1.46s/it]
Testing prompts:  50%|█████     | 2/4 [00:03<00:03,  1.88s/it]
Testing prompts:  75%|███████▌  | 3/4 [00:05<00:02,  2.03s/it]
Testing prompts: 100%|██████████| 4/4 [02:28<00:00, 57.38s/it]
Testing prompts: 100%|██████████| 4/4 [02:28<00:00, 37.02s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:18,  2.11s/it]
Testing prompts:  20%|██        | 2/10 [00:10<00:47,  5.96s/it]
Testing prompts:  30%|███       | 3/10 [00:12<00:28,  4.06s/it]
Testing prompts:  40%|████      | 4/10 [03:18<07:35, 75.90s/it]
Testing prompts:  50%|█████     | 5/10 [03:20<04:06, 49.37s/it]
Testing prompts:  60%|██████    | 6/10 [03:22<02:12, 33.08s/it]
Testing prompts:  70%|███████   | 7/10 [03:24<01:08, 22.85s/it]
Testing prompts:  80%|████████  | 8/10 [03:25<00:31, 15.95s/it]
Testing prompts:  90%|█████████ | 9/10 [03:27<00:11, 11.57s/it]
Testing prompts: 100%|██████████| 10/10 [03:29<00:00,  8.76s/it]
Testing prompts: 100%|██████████| 10/10 [03:29<00:00, 20.97s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:04<00:36,  4.10s/it]
Testing prompts:  20%|██        | 2/10 [00:05<00:18,  2.31s/it]
Testing prompts:  30%|███       | 3/10 [00:07<00:15,  2.22s/it]
Testing prompts:  40%|████      | 4/10 [00:08<00:10,  1.75s/it]
Testing prompts:  50%|█████     | 5/10 [03:14<05:41, 68.30s/it]
Testing prompts:  60%|██████    | 6/10 [03:16<03:03, 45.80s/it]
Testing prompts:  70%|███████   | 7/10 [03:18<01:34, 31.50s/it]
Testing prompts:  80%|████████  | 8/10 [03:20<00:43, 21.88s/it]
Testing prompts:  90%|█████████ | 9/10 [03:20<00:15, 15.26s/it]
Testing prompts: 100%|██████████| 10/10 [03:21<00:00, 10.84s/it]
Testing prompts: 100%|██████████| 10/10 [03:21<00:00, 20.17s/it]

Testing prompts:   0%|          | 0/20 [00:00<?, ?it/s]
Testing prompts:   5%|▌         | 1/20 [00:05<01:52,  5.95s/it]
Testing prompts:  10%|█         | 2/20 [00:08<01:14,  4.14s/it]
Testing prompts:  15%|█▌        | 3/20 [00:10<00:47,  2.81s/it]
Testing prompts:  20%|██        | 4/20 [00:13<00:49,  3.06s/it]
Testing prompts:  25%|██▌       | 5/20 [00:17<00:51,  3.44s/it]
Testing prompts:  30%|███       | 6/20 [00:19<00:39,  2.81s/it]
Testing prompts:  35%|███▌      | 7/20 [00:21<00:34,  2.66s/it]
Testing prompts:  40%|████      | 8/20 [00:23<00:28,  2.39s/it]
Testing prompts:  45%|████▌     | 9/20 [00:25<00:24,  2.25s/it]
Testing prompts:  50%|█████     | 10/20 [00:27<00:22,  2.29s/it]
Testing prompts:  55%|█████▌    | 11/20 [00:29<00:18,  2.03s/it]
Testing prompts:  60%|██████    | 12/20 [00:31<00:16,  2.09s/it]
Testing prompts:  65%|██████▌   | 13/20 [00:32<00:12,  1.77s/it]
Testing prompts:  70%|███████   | 14/20 [00:33<00:09,  1.52s/it]
Testing prompts:  75%|███████▌  | 15/20 [00:34<00:06,  1.39s/it]
Testing prompts:  80%|████████  | 16/20 [00:37<00:07,  1.77s/it]
Testing prompts:  85%|████████▌ | 17/20 [00:38<00:05,  1.79s/it]
Testing prompts:  90%|█████████ | 18/20 [00:43<00:05,  2.78s/it]
Testing prompts:  95%|█████████▌| 19/20 [00:50<00:03,  3.92s/it]
Testing prompts: 100%|██████████| 20/20 [00:54<00:00,  3.79s/it]
Testing prompts: 100%|██████████| 20/20 [00:54<00:00,  2.70s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:05<00:48,  5.35s/it]
Testing prompts:  20%|██        | 2/10 [00:07<00:27,  3.44s/it]
Testing prompts:  30%|███       | 3/10 [00:09<00:20,  2.90s/it]
Testing prompts:  40%|████      | 4/10 [00:10<00:13,  2.22s/it]
Testing prompts:  50%|█████     | 5/10 [00:12<00:10,  2.03s/it]
Testing prompts:  60%|██████    | 6/10 [00:14<00:07,  1.99s/it]
Testing prompts:  70%|███████   | 7/10 [00:16<00:06,  2.01s/it]
Testing prompts:  80%|████████  | 8/10 [00:18<00:04,  2.01s/it]
Testing prompts:  90%|█████████ | 9/10 [03:24<00:59, 59.49s/it]
Testing prompts: 100%|██████████| 10/10 [03:25<00:00, 41.57s/it]
Testing prompts: 100%|██████████| 10/10 [03:25<00:00, 20.59s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:22,  2.50s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:16,  2.08s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.75s/it]
Testing prompts:  40%|████      | 4/10 [00:08<00:13,  2.18s/it]
Testing prompts:  50%|█████     | 5/10 [03:14<05:42, 68.47s/it]
Testing prompts:  60%|██████    | 6/10 [03:16<03:02, 45.70s/it]
Testing prompts:  70%|███████   | 7/10 [03:17<01:34, 31.39s/it]
Testing prompts:  80%|████████  | 8/10 [03:19<00:43, 21.94s/it]
Testing prompts:  90%|█████████ | 9/10 [03:22<00:15, 15.94s/it]
Testing prompts: 100%|██████████| 10/10 [03:24<00:00, 11.64s/it]
Testing prompts: 100%|██████████| 10/10 [03:24<00:00, 20.44s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:08<01:19,  8.81s/it]
Testing prompts:  20%|██        | 2/10 [00:11<00:41,  5.20s/it]
Testing prompts:  30%|███       | 3/10 [00:13<00:24,  3.54s/it]
Testing prompts:  40%|████      | 4/10 [00:14<00:16,  2.71s/it]
Testing prompts:  50%|█████     | 5/10 [00:18<00:16,  3.23s/it]
Testing prompts:  60%|██████    | 6/10 [00:20<00:11,  2.92s/it]
Testing prompts:  70%|███████   | 7/10 [00:23<00:08,  2.87s/it]
Testing prompts:  80%|████████  | 8/10 [00:25<00:05,  2.56s/it]
Testing prompts:  90%|█████████ | 9/10 [00:26<00:02,  2.16s/it]
Testing prompts: 100%|██████████| 10/10 [00:28<00:00,  1.90s/it]
Testing prompts: 100%|██████████| 10/10 [00:28<00:00,  2.82s/it]

Testing prompts:   0%|          | 0/4 [00:00<?, ?it/s]
Testing prompts:  25%|██▌       | 1/4 [00:01<00:04,  1.33s/it]
Testing prompts:  50%|█████     | 2/4 [00:02<00:02,  1.29s/it]
Testing prompts:  75%|███████▌  | 3/4 [00:03<00:01,  1.24s/it]
Testing prompts: 100%|██████████| 4/4 [02:07<00:00, 49.56s/it]
Testing prompts: 100%|██████████| 4/4 [02:07<00:00, 31.85s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.55s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.65s/it]
Testing prompts:  30%|███       | 3/10 [00:08<00:23,  3.29s/it]
Testing prompts:  40%|████      | 4/10 [00:10<00:17,  2.92s/it]
Testing prompts:  50%|█████     | 5/10 [00:11<00:11,  2.23s/it]
Testing prompts:  60%|██████    | 6/10 [03:17<04:18, 64.67s/it]
Testing prompts:  70%|███████   | 7/10 [03:18<02:11, 43.85s/it]
Testing prompts:  80%|████████  | 8/10 [03:19<01:00, 30.22s/it]
Testing prompts:  90%|█████████ | 9/10 [03:21<00:21, 21.38s/it]
Testing prompts: 100%|██████████| 10/10 [03:23<00:00, 15.35s/it]
Testing prompts: 100%|██████████| 10/10 [03:23<00:00, 20.36s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.50s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:13,  1.65s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:13,  1.92s/it]
Testing prompts:  40%|████      | 4/10 [03:11<07:27, 74.61s/it]
Testing prompts:  50%|█████     | 5/10 [03:12<04:00, 48.07s/it]
Testing prompts:  60%|██████    | 6/10 [03:13<02:08, 32.09s/it]
Testing prompts:  70%|███████   | 7/10 [03:15<01:06, 22.25s/it]
Testing prompts:  80%|████████  | 8/10 [03:17<00:31, 15.81s/it]
Testing prompts:  90%|█████████ | 9/10 [06:23<01:09, 69.08s/it]
Testing prompts: 100%|██████████| 10/10 [06:26<00:00, 48.45s/it]
Testing prompts: 100%|██████████| 10/10 [06:26<00:00, 38.61s/it]

Testing prompts:   0%|          | 0/7 [00:00<?, ?it/s]
Testing prompts:  14%|█▍        | 1/7 [00:06<00:41,  6.84s/it]
Testing prompts:  29%|██▊       | 2/7 [00:08<00:19,  3.83s/it]
Testing prompts:  43%|████▎     | 3/7 [00:27<00:42, 10.72s/it]
Testing prompts:  57%|█████▋    | 4/7 [03:33<03:59, 79.89s/it]
Testing prompts:  71%|███████▏  | 5/7 [03:34<01:43, 51.52s/it]
Testing prompts:  86%|████████▌ | 6/7 [03:37<00:34, 34.93s/it]
Testing prompts: 100%|██████████| 7/7 [03:40<00:00, 24.62s/it]
Testing prompts: 100%|██████████| 7/7 [03:40<00:00, 31.54s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:14,  1.60s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:16,  2.10s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:14,  2.03s/it]
Testing prompts:  40%|████      | 4/10 [00:08<00:12,  2.14s/it]
Testing prompts:  50%|█████     | 5/10 [00:10<00:10,  2.17s/it]
Testing prompts:  60%|██████    | 6/10 [00:13<00:09,  2.30s/it]
Testing prompts:  70%|███████   | 7/10 [00:15<00:06,  2.31s/it]
Testing prompts:  80%|████████  | 8/10 [00:16<00:03,  1.97s/it]
Testing prompts:  90%|█████████ | 9/10 [00:19<00:02,  2.17s/it]
Testing prompts: 100%|██████████| 10/10 [00:21<00:00,  2.10s/it]
Testing prompts: 100%|██████████| 10/10 [00:21<00:00,  2.12s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:05<00:53,  5.98s/it]
Testing prompts:  20%|██        | 2/10 [00:07<00:28,  3.55s/it]
Testing prompts:  30%|███       | 3/10 [00:09<00:17,  2.57s/it]
Testing prompts:  40%|████      | 4/10 [00:10<00:12,  2.13s/it]
Testing prompts:  50%|█████     | 5/10 [00:14<00:13,  2.74s/it]
Testing prompts:  60%|██████    | 6/10 [00:16<00:10,  2.59s/it]
Testing prompts:  70%|███████   | 7/10 [00:18<00:06,  2.19s/it]
Testing prompts:  80%|████████  | 8/10 [00:20<00:04,  2.24s/it]
Testing prompts:  90%|█████████ | 9/10 [00:23<00:02,  2.57s/it]
Testing prompts: 100%|██████████| 10/10 [00:25<00:00,  2.23s/it]
Testing prompts: 100%|██████████| 10/10 [00:25<00:00,  2.53s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.49s/it]
Testing prompts:  20%|██        | 2/10 [00:05<00:21,  2.68s/it]
Testing prompts:  30%|███       | 3/10 [00:08<00:20,  2.97s/it]
Testing prompts:  40%|████      | 4/10 [00:10<00:15,  2.60s/it]
Testing prompts:  50%|█████     | 5/10 [00:11<00:10,  2.08s/it]
Testing prompts:  60%|██████    | 6/10 [03:17<04:18, 64.63s/it]
Testing prompts:  70%|███████   | 7/10 [03:19<02:12, 44.06s/it]
Testing prompts:  80%|████████  | 8/10 [03:20<01:01, 30.52s/it]
Testing prompts:  90%|█████████ | 9/10 [03:22<00:21, 21.59s/it]
Testing prompts: 100%|██████████| 10/10 [03:25<00:00, 15.80s/it]
Testing prompts: 100%|██████████| 10/10 [03:25<00:00, 20.56s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:07<01:06,  7.42s/it]
Testing prompts:  20%|██        | 2/10 [00:09<00:36,  4.54s/it]
Testing prompts:  30%|███       | 3/10 [00:11<00:22,  3.25s/it]
Testing prompts:  40%|████      | 4/10 [00:13<00:16,  2.70s/it]
Testing prompts:  50%|█████     | 5/10 [00:17<00:16,  3.20s/it]
Testing prompts:  60%|██████    | 6/10 [00:19<00:11,  2.80s/it]
Testing prompts:  70%|███████   | 7/10 [00:21<00:07,  2.46s/it]
Testing prompts:  80%|████████  | 8/10 [00:23<00:04,  2.27s/it]
Testing prompts:  90%|█████████ | 9/10 [00:25<00:02,  2.34s/it]
Testing prompts: 100%|██████████| 10/10 [00:27<00:00,  2.18s/it]
Testing prompts: 100%|██████████| 10/10 [00:27<00:00,  2.75s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:14<02:07, 14.18s/it]
Testing prompts:  20%|██        | 2/10 [00:15<00:54,  6.79s/it]
Testing prompts:  30%|███       | 3/10 [00:17<00:32,  4.63s/it]
Testing prompts:  40%|████      | 4/10 [00:19<00:20,  3.39s/it]
Testing prompts:  50%|█████     | 5/10 [03:25<05:47, 69.47s/it]
Testing prompts:  60%|██████    | 6/10 [03:27<03:05, 46.49s/it]
Testing prompts:  70%|███████   | 7/10 [03:29<01:35, 31.88s/it]
Testing prompts:  80%|████████  | 8/10 [03:39<00:49, 24.83s/it]
Testing prompts:  90%|█████████ | 9/10 [03:40<00:17, 17.41s/it]
Testing prompts: 100%|██████████| 10/10 [03:41<00:00, 12.45s/it]
Testing prompts: 100%|██████████| 10/10 [03:41<00:00, 22.18s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:12,  1.39s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:15,  1.89s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:13,  1.97s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:10,  1.75s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:08,  1.66s/it]
Testing prompts:  60%|██████    | 6/10 [03:14<04:17, 64.32s/it]
Testing prompts:  70%|███████   | 7/10 [03:15<02:11, 43.75s/it]
Testing prompts:  80%|████████  | 8/10 [05:24<02:21, 70.63s/it]
Testing prompts:  90%|█████████ | 9/10 [05:25<00:48, 48.96s/it]
Testing prompts: 100%|██████████| 10/10 [05:26<00:00, 34.05s/it]
Testing prompts: 100%|██████████| 10/10 [05:26<00:00, 32.61s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:03<00:33,  3.72s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:16,  2.07s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:14,  2.03s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:09,  1.63s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:07,  1.45s/it]
Testing prompts:  60%|██████    | 6/10 [03:14<04:16, 64.13s/it]
Testing prompts:  70%|███████   | 7/10 [03:16<02:11, 43.94s/it]
Testing prompts:  80%|████████  | 8/10 [06:23<02:58, 89.46s/it]
Testing prompts:  90%|█████████ | 9/10 [06:25<01:02, 62.06s/it]
Testing prompts: 100%|██████████| 10/10 [09:31<00:00, 100.22s/it]
Testing prompts: 100%|██████████| 10/10 [09:31<00:00, 57.13s/it] 

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:18,  2.11s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:18,  2.30s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:15,  2.15s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:11,  1.84s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:07,  1.45s/it]
Testing prompts:  60%|██████    | 6/10 [00:11<00:07,  1.88s/it]
Testing prompts:  70%|███████   | 7/10 [00:13<00:05,  1.91s/it]
Testing prompts:  80%|████████  | 8/10 [00:14<00:03,  1.53s/it]
Testing prompts:  90%|█████████ | 9/10 [03:20<00:59, 59.21s/it]
Testing prompts: 100%|██████████| 10/10 [03:22<00:00, 41.57s/it]
Testing prompts: 100%|██████████| 10/10 [03:22<00:00, 20.21s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:21,  2.42s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:16,  2.11s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:14,  2.06s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:10,  1.80s/it]
Testing prompts:  50%|█████     | 5/10 [00:11<00:13,  2.63s/it]
Testing prompts:  60%|██████    | 6/10 [00:13<00:09,  2.29s/it]
Testing prompts:  70%|███████   | 7/10 [00:15<00:06,  2.31s/it]
Testing prompts:  80%|████████  | 8/10 [00:18<00:04,  2.40s/it]
Testing prompts:  90%|█████████ | 9/10 [00:19<00:02,  2.08s/it]
Testing prompts: 100%|██████████| 10/10 [00:21<00:00,  1.99s/it]
Testing prompts: 100%|██████████| 10/10 [00:21<00:00,  2.16s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:05<00:50,  5.56s/it]
Testing prompts:  20%|██        | 2/10 [00:06<00:25,  3.13s/it]
Testing prompts:  30%|███       | 3/10 [00:09<00:19,  2.72s/it]
Testing prompts:  40%|████      | 4/10 [00:10<00:12,  2.16s/it]
Testing prompts:  50%|█████     | 5/10 [00:11<00:09,  1.87s/it]
Testing prompts:  60%|██████    | 6/10 [00:13<00:06,  1.65s/it]
Testing prompts:  70%|███████   | 7/10 [00:14<00:04,  1.56s/it]
Testing prompts:  80%|████████  | 8/10 [00:15<00:02,  1.39s/it]
Testing prompts:  90%|█████████ | 9/10 [00:18<00:01,  2.00s/it]
Testing prompts: 100%|██████████| 10/10 [00:20<00:00,  1.84s/it]
Testing prompts: 100%|██████████| 10/10 [00:20<00:00,  2.03s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:11,  1.29s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:16,  2.03s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:13,  1.98s/it]
Testing prompts:  40%|████      | 4/10 [00:07<00:12,  2.01s/it]
Testing prompts:  50%|█████     | 5/10 [00:09<00:09,  1.99s/it]
Testing prompts:  60%|██████    | 6/10 [00:12<00:09,  2.31s/it]
Testing prompts:  70%|███████   | 7/10 [00:14<00:06,  2.06s/it]
Testing prompts:  80%|████████  | 8/10 [00:15<00:03,  1.96s/it]
Testing prompts:  90%|█████████ | 9/10 [00:17<00:01,  1.85s/it]
Testing prompts: 100%|██████████| 10/10 [00:18<00:00,  1.66s/it]
Testing prompts: 100%|██████████| 10/10 [00:18<00:00,  1.88s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:05<00:51,  5.76s/it]
Testing prompts:  20%|██        | 2/10 [00:07<00:24,  3.10s/it]
Testing prompts:  30%|███       | 3/10 [00:08<00:18,  2.59s/it]
Testing prompts:  40%|████      | 4/10 [00:10<00:12,  2.02s/it]
Testing prompts:  50%|█████     | 5/10 [03:16<05:41, 68.35s/it]
Testing prompts:  60%|██████    | 6/10 [03:18<03:03, 45.77s/it]
Testing prompts:  70%|███████   | 7/10 [03:20<01:34, 31.60s/it]
Testing prompts:  80%|████████  | 8/10 [03:22<00:44, 22.11s/it]
Testing prompts:  90%|█████████ | 9/10 [03:22<00:15, 15.40s/it]
Testing prompts: 100%|██████████| 10/10 [03:24<00:00, 11.06s/it]
Testing prompts: 100%|██████████| 10/10 [03:24<00:00, 20.42s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:06<00:55,  6.11s/it]
Testing prompts:  20%|██        | 2/10 [00:07<00:27,  3.48s/it]
Testing prompts:  30%|███       | 3/10 [00:09<00:18,  2.61s/it]
Testing prompts:  40%|████      | 4/10 [00:12<00:18,  3.02s/it]
Testing prompts:  50%|█████     | 5/10 [03:19<05:45, 69.13s/it]
Testing prompts:  60%|██████    | 6/10 [03:21<03:05, 46.45s/it]
Testing prompts:  70%|███████   | 7/10 [03:23<01:35, 31.80s/it]
Testing prompts:  80%|████████  | 8/10 [03:25<00:44, 22.19s/it]
Testing prompts:  90%|█████████ | 9/10 [03:26<00:15, 15.86s/it]
Testing prompts: 100%|██████████| 10/10 [03:28<00:00, 11.43s/it]
Testing prompts: 100%|██████████| 10/10 [03:28<00:00, 20.84s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:09<01:23,  9.25s/it]
Testing prompts:  20%|██        | 2/10 [00:10<00:38,  4.80s/it]
Testing prompts:  30%|███       | 3/10 [00:13<00:26,  3.81s/it]
Testing prompts:  40%|████      | 4/10 [00:14<00:16,  2.80s/it]
Testing prompts:  50%|█████     | 5/10 [03:20<05:44, 68.84s/it]
Testing prompts:  60%|██████    | 6/10 [03:22<03:04, 46.06s/it]
Testing prompts:  70%|███████   | 7/10 [03:24<01:34, 31.65s/it]
Testing prompts:  80%|████████  | 8/10 [03:25<00:43, 21.93s/it]
Testing prompts:  90%|█████████ | 9/10 [03:27<00:15, 15.64s/it]
Testing prompts: 100%|██████████| 10/10 [06:33<00:00, 68.11s/it]
Testing prompts: 100%|██████████| 10/10 [06:33<00:00, 39.31s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:02<00:21,  2.36s/it]
Testing prompts:  20%|██        | 2/10 [00:05<00:20,  2.61s/it]
Testing prompts:  30%|███       | 3/10 [00:07<00:16,  2.30s/it]
Testing prompts:  40%|████      | 4/10 [00:08<00:11,  1.98s/it]
Testing prompts:  50%|█████     | 5/10 [00:10<00:10,  2.04s/it]
Testing prompts:  60%|██████    | 6/10 [00:11<00:07,  1.77s/it]
Testing prompts:  70%|███████   | 7/10 [00:12<00:04,  1.51s/it]
Testing prompts:  80%|████████  | 8/10 [03:18<02:00, 60.24s/it]
Testing prompts:  90%|█████████ | 9/10 [03:20<00:41, 41.84s/it]
Testing prompts: 100%|██████████| 10/10 [06:26<00:00, 86.26s/it]
Testing prompts: 100%|██████████| 10/10 [06:26<00:00, 38.60s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:13,  1.46s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:12,  1.54s/it]
Testing prompts:  30%|███       | 3/10 [00:05<00:12,  1.76s/it]
Testing prompts:  40%|████      | 4/10 [00:06<00:10,  1.71s/it]
Testing prompts:  50%|█████     | 5/10 [00:08<00:08,  1.77s/it]
Testing prompts:  60%|██████    | 6/10 [00:13<00:11,  2.86s/it]
Testing prompts:  70%|███████   | 7/10 [00:15<00:07,  2.55s/it]
Testing prompts:  80%|████████  | 8/10 [00:17<00:04,  2.48s/it]
Testing prompts:  90%|█████████ | 9/10 [00:20<00:02,  2.51s/it]
Testing prompts: 100%|██████████| 10/10 [00:22<00:00,  2.35s/it]
Testing prompts: 100%|██████████| 10/10 [00:22<00:00,  2.24s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:16,  1.87s/it]
Testing prompts:  20%|██        | 2/10 [00:03<00:14,  1.87s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:14,  2.11s/it]
Testing prompts:  40%|████      | 4/10 [00:09<00:14,  2.46s/it]
Testing prompts:  50%|█████     | 5/10 [00:11<00:11,  2.35s/it]
Testing prompts:  60%|██████    | 6/10 [00:15<00:11,  2.89s/it]
Testing prompts:  70%|███████   | 7/10 [00:17<00:07,  2.58s/it]
Testing prompts:  80%|████████  | 8/10 [00:18<00:04,  2.11s/it]
Testing prompts:  90%|█████████ | 9/10 [00:20<00:02,  2.24s/it]
Testing prompts: 100%|██████████| 10/10 [00:22<00:00,  2.21s/it]
Testing prompts: 100%|██████████| 10/10 [00:22<00:00,  2.29s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:04<00:44,  5.00s/it]
Testing prompts:  20%|██        | 2/10 [00:06<00:24,  3.02s/it]
Testing prompts:  30%|███       | 3/10 [00:08<00:18,  2.63s/it]
Testing prompts:  40%|████      | 4/10 [00:12<00:17,  2.89s/it]
Testing prompts:  50%|█████     | 5/10 [03:18<05:44, 68.93s/it]
Testing prompts:  60%|██████    | 6/10 [03:19<03:03, 45.93s/it]
Testing prompts:  70%|███████   | 7/10 [03:21<01:35, 31.69s/it]
Testing prompts:  80%|████████  | 8/10 [03:33<00:50, 25.19s/it]
Testing prompts:  90%|█████████ | 9/10 [03:34<00:17, 17.70s/it]
Testing prompts: 100%|██████████| 10/10 [06:41<00:00, 69.90s/it]
Testing prompts: 100%|██████████| 10/10 [06:41<00:00, 40.10s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:07<01:05,  7.27s/it]
Testing prompts:  20%|██        | 2/10 [00:09<00:32,  4.05s/it]
Testing prompts:  30%|███       | 3/10 [00:11<00:22,  3.20s/it]
Testing prompts:  40%|████      | 4/10 [00:12<00:15,  2.60s/it]
Testing prompts:  50%|█████     | 5/10 [03:18<05:43, 68.74s/it]
Testing prompts:  60%|██████    | 6/10 [03:21<03:05, 46.26s/it]
Testing prompts:  70%|███████   | 7/10 [03:22<01:34, 31.42s/it]
Testing prompts:  80%|████████  | 8/10 [03:23<00:43, 21.69s/it]
Testing prompts:  90%|█████████ | 9/10 [03:25<00:15, 15.50s/it]
Testing prompts: 100%|██████████| 10/10 [03:26<00:00, 11.09s/it]
Testing prompts: 100%|██████████| 10/10 [03:26<00:00, 20.64s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:05<00:49,  5.47s/it]
Testing prompts:  20%|██        | 2/10 [00:06<00:23,  2.94s/it]
Testing prompts:  30%|███       | 3/10 [00:08<00:16,  2.41s/it]
Testing prompts:  40%|████      | 4/10 [00:09<00:11,  2.00s/it]
Testing prompts:  50%|█████     | 5/10 [00:15<00:17,  3.50s/it]
Testing prompts:  60%|██████    | 6/10 [03:22<04:22, 65.60s/it]
Testing prompts:  70%|███████   | 7/10 [03:23<02:13, 44.62s/it]
Testing prompts:  80%|████████  | 8/10 [03:25<01:02, 31.18s/it]
Testing prompts:  90%|█████████ | 9/10 [03:26<00:21, 21.72s/it]
Testing prompts: 100%|██████████| 10/10 [03:28<00:00, 15.47s/it]
Testing prompts: 100%|██████████| 10/10 [03:28<00:00, 20.83s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:01<00:15,  1.67s/it]
Testing prompts:  20%|██        | 2/10 [00:04<00:17,  2.13s/it]
Testing prompts:  30%|███       | 3/10 [00:06<00:16,  2.37s/it]
Testing prompts:  40%|████      | 4/10 [00:08<00:12,  2.01s/it]
Testing prompts:  50%|█████     | 5/10 [03:14<05:41, 68.34s/it]
Testing prompts:  60%|██████    | 6/10 [03:15<03:02, 45.50s/it]
Testing prompts:  70%|███████   | 7/10 [03:16<01:33, 31.05s/it]
Testing prompts:  80%|████████  | 8/10 [03:18<00:43, 21.61s/it]
Testing prompts:  90%|█████████ | 9/10 [06:23<01:12, 72.91s/it]
Testing prompts: 100%|██████████| 10/10 [06:27<00:00, 51.58s/it]
Testing prompts: 100%|██████████| 10/10 [06:27<00:00, 38.76s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:05<00:52,  5.87s/it]
Testing prompts:  20%|██        | 2/10 [00:06<00:24,  3.06s/it]
Testing prompts:  30%|███       | 3/10 [00:08<00:18,  2.58s/it]
Testing prompts:  40%|████      | 4/10 [00:10<00:14,  2.34s/it]
Testing prompts:  50%|█████     | 5/10 [03:17<05:44, 68.84s/it]
Testing prompts:  60%|██████    | 6/10 [03:19<03:04, 46.08s/it]
Testing prompts:  70%|███████   | 7/10 [03:21<01:35, 31.68s/it]
Testing prompts:  80%|████████  | 8/10 [03:30<00:48, 24.27s/it]
Testing prompts:  90%|█████████ | 9/10 [03:31<00:17, 17.04s/it]
Testing prompts: 100%|██████████| 10/10 [03:33<00:00, 12.49s/it]
Testing prompts: 100%|██████████| 10/10 [03:33<00:00, 21.35s/it]

Testing prompts:   0%|          | 0/20 [00:00<?, ?it/s]
Testing prompts:   5%|▌         | 1/20 [00:06<01:55,  6.08s/it]
Testing prompts:  10%|█         | 2/20 [00:08<01:06,  3.72s/it]
Testing prompts:  15%|█▌        | 3/20 [00:09<00:44,  2.63s/it]
Testing prompts:  20%|██        | 4/20 [00:10<00:33,  2.12s/it]
Testing prompts:  25%|██▌       | 5/20 [00:14<00:41,  2.76s/it]
Testing prompts:  30%|███       | 6/20 [00:17<00:38,  2.77s/it]
Testing prompts:  35%|███▌      | 7/20 [00:19<00:34,  2.66s/it]
Testing prompts:  40%|████      | 8/20 [00:21<00:28,  2.36s/it]
Testing prompts:  45%|████▌     | 9/20 [00:22<00:22,  2.01s/it]
Testing prompts:  50%|█████     | 10/20 [00:25<00:20,  2.05s/it]
Testing prompts:  55%|█████▌    | 11/20 [00:28<00:22,  2.50s/it]
Testing prompts:  60%|██████    | 12/20 [00:30<00:17,  2.24s/it]
Testing prompts:  65%|██████▌   | 13/20 [00:31<00:14,  2.06s/it]
Testing prompts:  70%|███████   | 14/20 [00:32<00:10,  1.70s/it]
Testing prompts:  75%|███████▌  | 15/20 [00:34<00:09,  1.83s/it]
Testing prompts:  80%|████████  | 16/20 [00:36<00:06,  1.73s/it]
Testing prompts:  85%|████████▌ | 17/20 [00:38<00:05,  1.84s/it]
Testing prompts:  90%|█████████ | 18/20 [00:40<00:03,  1.99s/it]
Testing prompts:  95%|█████████▌| 19/20 [00:41<00:01,  1.76s/it]
Testing prompts: 100%|██████████| 20/20 [00:44<00:00,  2.13s/it]
Testing prompts: 100%|██████████| 20/20 [00:44<00:00,  2.25s/it]

Testing prompts:   0%|          | 0/10 [00:00<?, ?it/s]
Testing prompts:  10%|█         | 1/10 [00:05<00:49,  5.45s/it]
Testing prompts:  20%|██        | 2/10 [00:07<00:26,  3.30s/it]
Testing prompts:  30%|███       | 3/10 [00:12<00:30,  4.39s/it]
Testing prompts:  40%|████      | 4/10 [00:13<00:18,  3.06s/it]
Testing prompts:  50%|█████     | 5/10 [00:17<00:16,  3.34s/it]
Testing prompts:  60%|██████    | 6/10 [00:19<00:11,  2.77s/it]
Testing prompts:  70%|███████   | 7/10 [00:22<00:08,  2.99s/it]
Testing prompts:  80%|████████  | 8/10 [00:24<00:04,  2.42s/it]
Testing prompts:  90%|█████████ | 9/10 [00:26<00:02,  2.28s/it]
Testing prompts: 100%|██████████| 10/10 [03:31<00:00, 58.94s/it]
Testing prompts: 100%|██████████| 10/10 [03:31<00:00, 21.19s/it]
