INFO 05-14 09:36:43 config.py:1670] Downcasting torch.float32 to torch.bfloat16.
WARNING 05-14 09:36:47 arg_utils.py:953] Chunked prefill is enabled by default for models with max_model_len > 32K. Currently, chunked prefill might not work with some features or models. If you encounter any issues, please disable chunked prefill by setting --enable-chunked-prefill=False.
INFO 05-14 09:36:47 config.py:1005] Chunked prefill is enabled with max_num_batched_tokens=512.
INFO 05-14 09:36:47 llm_engine.py:237] Initializing an LLM engine (vdev) with config: model='/volume/ailab4sci/txie/ydl/short_ablation2/Efficient2/actor/global_step_1686', speculative_config=None, tokenizer='/volume/ailab4sci/txie/ydl/short_ablation2/Efficient2/actor/global_step_1686', skip_tokenizer_init=False, tokenizer_mode=auto, revision=None, override_neuron_config=None, rope_scaling=None, rope_theta=None, tokenizer_revision=None, trust_remote_code=True, dtype=torch.bfloat16, max_seq_len=131072, download_dir=None, load_format=LoadFormat.AUTO, tensor_parallel_size=1, pipeline_parallel_size=1, disable_custom_all_reduce=False, quantization=None, enforce_eager=False, kv_cache_dtype=auto, quantization_param_path=None, device_config=cuda, decoding_config=DecodingConfig(guided_decoding_backend='outlines'), observability_config=ObservabilityConfig(otlp_traces_endpoint=None, collect_model_forward_time=False, collect_model_execute_time=False), seed=0, served_model_name=/volume/ailab4sci/txie/ydl/short_ablation2/Efficient2/actor/global_step_1686, use_v2_block_manager=True, num_scheduler_steps=1, chunked_prefill_enabled=True multi_step_stream_outputs=True, enable_prefix_caching=False, use_async_output_proc=True, use_cached_outputs=False, mm_processor_kwargs=None)
INFO 05-14 09:36:49 model_runner.py:1060] Starting to load model /volume/ailab4sci/txie/ydl/short_ablation2/Efficient2/actor/global_step_1686...

Loading safetensors checkpoint shards:   0% Completed | 0/7 [00:00<?, ?it/s]

Loading safetensors checkpoint shards:  14% Completed | 1/7 [00:00<00:05,  1.07it/s]

Loading safetensors checkpoint shards:  29% Completed | 2/7 [00:01<00:04,  1.01it/s]

Loading safetensors checkpoint shards:  43% Completed | 3/7 [00:03<00:04,  1.02s/it]

Loading safetensors checkpoint shards:  57% Completed | 4/7 [00:04<00:03,  1.03s/it]

Loading safetensors checkpoint shards:  71% Completed | 5/7 [00:04<00:01,  1.07it/s]

Loading safetensors checkpoint shards:  86% Completed | 6/7 [00:05<00:00,  1.06it/s]

Loading safetensors checkpoint shards: 100% Completed | 7/7 [00:06<00:00,  1.24it/s]

Loading safetensors checkpoint shards: 100% Completed | 7/7 [00:06<00:00,  1.11it/s]

INFO 05-14 09:36:56 model_runner.py:1071] Loading model weights took 14.2716 GB
INFO 05-14 09:36:56 gpu_executor.py:122] # GPU blocks: 66252, # CPU blocks: 4681
INFO 05-14 09:36:56 gpu_executor.py:126] Maximum concurrency for 131072 tokens per request: 8.09x
INFO 05-14 09:36:58 model_runner.py:1402] Capturing the model for CUDA graphs. This may lead to unexpected consequences if the model is not static. To run the model in eager mode, set 'enforce_eager=True' or use '--enforce-eager' in the CLI.
INFO 05-14 09:36:58 model_runner.py:1406] CUDA graphs can take additional 1~3 GiB memory per GPU. If you are running out of memory, consider decreasing `gpu_memory_utilization` or enforcing eager mode. You can also reduce the `max_num_seqs` as needed to decrease memory usage.
INFO 05-14 09:36:59 model_runner.py:1530] Graph capturing finished in 1 secs.

  0%|          | 0/83 [00:00<?, ?it/s]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.37s/it, est. speed input: 75.16 toks/s, output: 127.51 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.37s/it, est. speed input: 75.16 toks/s, output: 127.51 toks/s]

  1%|          | 1/83 [00:02<03:15,  2.39s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.64s/it, est. speed input: 22.65 toks/s, output: 128.57 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.64s/it, est. speed input: 22.65 toks/s, output: 128.57 toks/s]

  2%|▏         | 2/83 [00:10<07:23,  5.48s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.39s/it, est. speed input: 28.93 toks/s, output: 128.70 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.39s/it, est. speed input: 28.93 toks/s, output: 128.70 toks/s]

  4%|▎         | 3/83 [00:16<07:51,  5.90s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.87s/it, est. speed input: 37.98 toks/s, output: 128.72 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.87s/it, est. speed input: 37.98 toks/s, output: 128.72 toks/s]

  5%|▍         | 4/83 [00:21<07:13,  5.49s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.69s/it, est. speed input: 47.53 toks/s, output: 128.52 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.69s/it, est. speed input: 47.53 toks/s, output: 128.52 toks/s]

  6%|▌         | 5/83 [00:25<06:45,  5.20s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.06s/it, est. speed input: 25.63 toks/s, output: 128.74 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.06s/it, est. speed input: 25.63 toks/s, output: 128.74 toks/s]

  7%|▋         | 6/83 [00:33<07:29,  5.84s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.95s/it, est. speed input: 69.50 toks/s, output: 128.48 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.95s/it, est. speed input: 69.50 toks/s, output: 128.48 toks/s]

  8%|▊         | 7/83 [00:36<06:11,  4.89s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.13s/it, est. speed input: 60.78 toks/s, output: 128.57 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.13s/it, est. speed input: 60.78 toks/s, output: 128.57 toks/s]

 10%|▉         | 8/83 [00:40<05:48,  4.65s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.71s/it, est. speed input: 27.80 toks/s, output: 128.77 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.71s/it, est. speed input: 27.80 toks/s, output: 128.77 toks/s]

 11%|█         | 9/83 [00:48<07:18,  5.92s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.77s/it, est. speed input: 22.63 toks/s, output: 128.72 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.77s/it, est. speed input: 22.63 toks/s, output: 128.72 toks/s]

 12%|█▏        | 10/83 [00:58<08:38,  7.11s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.57s/it, est. speed input: 44.58 toks/s, output: 128.58 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.57s/it, est. speed input: 44.58 toks/s, output: 128.58 toks/s]

 13%|█▎        | 11/83 [01:05<08:19,  6.94s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.55s/it, est. speed input: 51.57 toks/s, output: 128.51 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.55s/it, est. speed input: 51.57 toks/s, output: 128.51 toks/s]

 14%|█▍        | 12/83 [01:08<06:59,  5.91s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.63s/it, est. speed input: 35.00 toks/s, output: 128.68 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.63s/it, est. speed input: 35.00 toks/s, output: 128.68 toks/s]

 16%|█▌        | 13/83 [01:15<07:09,  6.13s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.44s/it, est. speed input: 30.70 toks/s, output: 128.49 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.44s/it, est. speed input: 30.70 toks/s, output: 128.49 toks/s]

 17%|█▋        | 14/83 [01:23<07:51,  6.83s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.01s/it, est. speed input: 61.11 toks/s, output: 128.45 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.01s/it, est. speed input: 61.11 toks/s, output: 128.45 toks/s]

 18%|█▊        | 15/83 [01:27<06:46,  5.98s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.09s/it, est. speed input: 57.12 toks/s, output: 128.57 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.09s/it, est. speed input: 57.12 toks/s, output: 128.57 toks/s]

 19%|█▉        | 16/83 [01:32<06:22,  5.71s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:25<00:00, 25.56s/it, est. speed input: 10.21 toks/s, output: 128.55 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:25<00:00, 25.56s/it, est. speed input: 10.21 toks/s, output: 128.55 toks/s]

 20%|██        | 17/83 [01:58<12:51, 11.68s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.63s/it, est. speed input: 39.74 toks/s, output: 128.50 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.63s/it, est. speed input: 39.74 toks/s, output: 128.50 toks/s]

 22%|██▏       | 18/83 [02:03<10:21,  9.56s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.50s/it, est. speed input: 34.62 toks/s, output: 128.63 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.50s/it, est. speed input: 34.62 toks/s, output: 128.63 toks/s]

 23%|██▎       | 19/83 [02:09<09:13,  8.64s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.44s/it, est. speed input: 44.86 toks/s, output: 128.49 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.44s/it, est. speed input: 44.86 toks/s, output: 128.49 toks/s]

 24%|██▍       | 20/83 [02:14<07:45,  7.38s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.25s/it, est. speed input: 62.55 toks/s, output: 128.48 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.25s/it, est. speed input: 62.55 toks/s, output: 128.48 toks/s]

 25%|██▌       | 21/83 [02:17<06:20,  6.14s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.70s/it, est. speed input: 85.71 toks/s, output: 128.42 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.70s/it, est. speed input: 85.71 toks/s, output: 128.42 toks/s]

 27%|██▋       | 22/83 [02:20<05:29,  5.41s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.44s/it, est. speed input: 74.63 toks/s, output: 128.35 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.44s/it, est. speed input: 74.63 toks/s, output: 128.35 toks/s]

 28%|██▊       | 23/83 [02:23<04:31,  4.52s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.74s/it, est. speed input: 42.15 toks/s, output: 128.57 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.74s/it, est. speed input: 42.15 toks/s, output: 128.57 toks/s]

 29%|██▉       | 24/83 [02:28<04:30,  4.59s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.10s/it, est. speed input: 36.07 toks/s, output: 128.61 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.10s/it, est. speed input: 36.07 toks/s, output: 128.61 toks/s]

 30%|███       | 25/83 [02:33<04:34,  4.74s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.31s/it, est. speed input: 84.68 toks/s, output: 128.32 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.31s/it, est. speed input: 84.68 toks/s, output: 128.32 toks/s]

 31%|███▏      | 26/83 [02:35<03:48,  4.01s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.15s/it, est. speed input: 37.07 toks/s, output: 128.67 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.15s/it, est. speed input: 37.07 toks/s, output: 128.67 toks/s]

 33%|███▎      | 27/83 [02:40<04:03,  4.36s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.88s/it, est. speed input: 54.26 toks/s, output: 128.59 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.88s/it, est. speed input: 54.26 toks/s, output: 128.59 toks/s]

 34%|███▎      | 28/83 [02:46<04:24,  4.81s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.48s/it, est. speed input: 116.13 toks/s, output: 128.23 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.48s/it, est. speed input: 116.13 toks/s, output: 128.23 toks/s]

 35%|███▍      | 29/83 [02:49<03:42,  4.11s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.16s/it, est. speed input: 53.62 toks/s, output: 128.64 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.16s/it, est. speed input: 53.62 toks/s, output: 128.64 toks/s]

 36%|███▌      | 30/83 [02:53<03:38,  4.13s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.60s/it, est. speed input: 78.86 toks/s, output: 128.48 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.60s/it, est. speed input: 78.86 toks/s, output: 128.48 toks/s]

 37%|███▋      | 31/83 [02:55<03:10,  3.67s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.26s/it, est. speed input: 36.45 toks/s, output: 128.69 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.26s/it, est. speed input: 36.45 toks/s, output: 128.69 toks/s]

 39%|███▊      | 32/83 [03:02<03:46,  4.45s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.28s/it, est. speed input: 35.83 toks/s, output: 128.66 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.28s/it, est. speed input: 35.83 toks/s, output: 128.66 toks/s]

 40%|███▉      | 33/83 [03:08<04:09,  5.00s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.25s/it, est. speed input: 56.01 toks/s, output: 128.60 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.25s/it, est. speed input: 56.01 toks/s, output: 128.60 toks/s]

 41%|████      | 34/83 [03:13<04:08,  5.07s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.25s/it, est. speed input: 37.95 toks/s, output: 128.63 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.25s/it, est. speed input: 37.95 toks/s, output: 128.63 toks/s]

 42%|████▏     | 35/83 [03:20<04:34,  5.73s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.29s/it, est. speed input: 50.90 toks/s, output: 128.52 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.29s/it, est. speed input: 50.90 toks/s, output: 128.52 toks/s]

 43%|████▎     | 36/83 [03:27<04:37,  5.89s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.95s/it, est. speed input: 165.81 toks/s, output: 128.18 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.95s/it, est. speed input: 165.81 toks/s, output: 128.18 toks/s]

 45%|████▍     | 37/83 [03:30<03:50,  5.01s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.48s/it, est. speed input: 48.87 toks/s, output: 128.51 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.48s/it, est. speed input: 48.87 toks/s, output: 128.51 toks/s]

 46%|████▌     | 38/83 [03:33<03:24,  4.55s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.29s/it, est. speed input: 37.75 toks/s, output: 128.62 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.29s/it, est. speed input: 37.75 toks/s, output: 128.62 toks/s]

 47%|████▋     | 39/83 [03:37<03:16,  4.47s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.34s/it, est. speed input: 76.61 toks/s, output: 128.39 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.34s/it, est. speed input: 76.61 toks/s, output: 128.39 toks/s]

 48%|████▊     | 40/83 [03:40<02:44,  3.83s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.33s/it, est. speed input: 77.99 toks/s, output: 128.37 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.33s/it, est. speed input: 77.99 toks/s, output: 128.37 toks/s]

 49%|████▉     | 41/83 [03:43<02:34,  3.68s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.33s/it, est. speed input: 24.16 toks/s, output: 128.70 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.33s/it, est. speed input: 24.16 toks/s, output: 128.70 toks/s]

 51%|█████     | 42/83 [03:50<03:15,  4.78s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.78s/it, est. speed input: 21.76 toks/s, output: 128.73 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.78s/it, est. speed input: 21.76 toks/s, output: 128.73 toks/s]

 52%|█████▏    | 43/83 [03:59<03:59,  5.98s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.45s/it, est. speed input: 85.36 toks/s, output: 128.24 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.45s/it, est. speed input: 85.36 toks/s, output: 128.24 toks/s]

 53%|█████▎    | 44/83 [04:02<03:11,  4.92s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.19s/it, est. speed input: 52.90 toks/s, output: 128.65 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.19s/it, est. speed input: 52.90 toks/s, output: 128.65 toks/s]

 54%|█████▍    | 45/83 [04:05<02:47,  4.40s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.94s/it, est. speed input: 53.39 toks/s, output: 128.55 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.94s/it, est. speed input: 53.39 toks/s, output: 128.55 toks/s]

 55%|█████▌    | 46/83 [04:08<02:26,  3.96s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.24s/it, est. speed input: 34.90 toks/s, output: 128.72 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.24s/it, est. speed input: 34.90 toks/s, output: 128.72 toks/s]

 57%|█████▋    | 47/83 [04:13<02:36,  4.35s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.33s/it, est. speed input: 39.21 toks/s, output: 128.70 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.33s/it, est. speed input: 39.21 toks/s, output: 128.70 toks/s]

 58%|█████▊    | 48/83 [04:18<02:42,  4.64s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.38s/it, est. speed input: 38.40 toks/s, output: 128.67 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.38s/it, est. speed input: 38.40 toks/s, output: 128.67 toks/s]

 59%|█████▉    | 49/83 [04:23<02:35,  4.56s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.04s/it, est. speed input: 66.41 toks/s, output: 128.54 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.04s/it, est. speed input: 66.41 toks/s, output: 128.54 toks/s]

 60%|██████    | 50/83 [04:26<02:15,  4.11s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.48s/it, est. speed input: 49.09 toks/s, output: 128.52 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.48s/it, est. speed input: 49.09 toks/s, output: 128.52 toks/s]

 61%|██████▏   | 51/83 [04:30<02:15,  4.22s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.35s/it, est. speed input: 21.79 toks/s, output: 128.71 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.35s/it, est. speed input: 21.79 toks/s, output: 128.71 toks/s]

 63%|██████▎   | 52/83 [04:39<02:49,  5.46s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.47s/it, est. speed input: 40.04 toks/s, output: 128.62 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.47s/it, est. speed input: 40.04 toks/s, output: 128.62 toks/s]

 64%|██████▍   | 53/83 [04:45<02:52,  5.76s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.50s/it, est. speed input: 57.28 toks/s, output: 128.56 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.50s/it, est. speed input: 57.28 toks/s, output: 128.56 toks/s]

 65%|██████▌   | 54/83 [04:50<02:36,  5.39s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.57s/it, est. speed input: 36.04 toks/s, output: 128.70 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.57s/it, est. speed input: 36.04 toks/s, output: 128.70 toks/s]

 66%|██████▋   | 55/83 [04:59<03:06,  6.64s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.02s/it, est. speed input: 23.69 toks/s, output: 128.67 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.02s/it, est. speed input: 23.69 toks/s, output: 128.67 toks/s]

 67%|██████▋   | 56/83 [05:07<03:10,  7.06s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.35s/it, est. speed input: 16.42 toks/s, output: 128.74 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.35s/it, est. speed input: 16.42 toks/s, output: 128.74 toks/s]

 69%|██████▊   | 57/83 [05:18<03:29,  8.05s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.12s/it, est. speed input: 44.82 toks/s, output: 128.57 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.12s/it, est. speed input: 44.82 toks/s, output: 128.57 toks/s]

 70%|██████▉   | 58/83 [05:25<03:14,  7.77s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.39s/it, est. speed input: 64.69 toks/s, output: 128.47 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.39s/it, est. speed input: 64.69 toks/s, output: 128.47 toks/s]

 71%|███████   | 59/83 [05:29<02:42,  6.76s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.54s/it, est. speed input: 59.50 toks/s, output: 128.45 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.54s/it, est. speed input: 59.50 toks/s, output: 128.45 toks/s]

 72%|███████▏  | 60/83 [05:32<02:06,  5.49s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.26s/it, est. speed input: 50.02 toks/s, output: 128.58 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.26s/it, est. speed input: 50.02 toks/s, output: 128.58 toks/s]

 73%|███████▎  | 61/83 [05:35<01:46,  4.82s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.71s/it, est. speed input: 78.95 toks/s, output: 128.38 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.71s/it, est. speed input: 78.95 toks/s, output: 128.38 toks/s]

 75%|███████▍  | 62/83 [05:38<01:27,  4.19s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.59s/it, est. speed input: 34.59 toks/s, output: 128.63 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.59s/it, est. speed input: 34.59 toks/s, output: 128.63 toks/s]

 76%|███████▌  | 63/83 [05:44<01:38,  4.91s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.46s/it, est. speed input: 42.13 toks/s, output: 128.58 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.46s/it, est. speed input: 42.13 toks/s, output: 128.58 toks/s]

 77%|███████▋  | 64/83 [05:50<01:36,  5.08s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.83s/it, est. speed input: 29.57 toks/s, output: 128.66 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.83s/it, est. speed input: 29.57 toks/s, output: 128.66 toks/s]

 78%|███████▊  | 65/83 [05:56<01:40,  5.60s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.27s/it, est. speed input: 75.24 toks/s, output: 128.46 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.27s/it, est. speed input: 75.24 toks/s, output: 128.46 toks/s]

 80%|███████▉  | 66/83 [06:00<01:23,  4.90s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.04s/it, est. speed input: 28.43 toks/s, output: 128.65 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.04s/it, est. speed input: 28.43 toks/s, output: 128.65 toks/s]

 81%|████████  | 67/83 [06:09<01:38,  6.15s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.27s/it, est. speed input: 18.20 toks/s, output: 128.70 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.27s/it, est. speed input: 18.20 toks/s, output: 128.70 toks/s]

 82%|████████▏ | 68/83 [06:20<01:55,  7.68s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  4.00s/it, est. speed input: 52.78 toks/s, output: 128.57 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  4.00s/it, est. speed input: 52.78 toks/s, output: 128.57 toks/s]

 83%|████████▎ | 69/83 [06:24<01:32,  6.58s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.17s/it, est. speed input: 50.84 toks/s, output: 128.54 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.17s/it, est. speed input: 50.84 toks/s, output: 128.54 toks/s]

 84%|████████▍ | 70/83 [06:29<01:20,  6.16s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.46s/it, est. speed input: 37.21 toks/s, output: 128.67 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.46s/it, est. speed input: 37.21 toks/s, output: 128.67 toks/s]

 86%|████████▌ | 71/83 [06:34<01:07,  5.65s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.01s/it, est. speed input: 48.09 toks/s, output: 128.56 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.01s/it, est. speed input: 48.09 toks/s, output: 128.56 toks/s]

 87%|████████▋ | 72/83 [06:38<00:56,  5.16s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.38s/it, est. speed input: 33.70 toks/s, output: 128.70 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.38s/it, est. speed input: 33.70 toks/s, output: 128.70 toks/s]

 88%|████████▊ | 73/83 [06:44<00:55,  5.53s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.32s/it, est. speed input: 93.06 toks/s, output: 128.39 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.32s/it, est. speed input: 93.06 toks/s, output: 128.39 toks/s]

 89%|████████▉ | 74/83 [06:46<00:41,  4.56s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.07s/it, est. speed input: 40.76 toks/s, output: 128.66 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.07s/it, est. speed input: 40.76 toks/s, output: 128.66 toks/s]

 90%|█████████ | 75/83 [06:51<00:35,  4.42s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.01s/it, est. speed input: 49.34 toks/s, output: 128.62 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.01s/it, est. speed input: 49.34 toks/s, output: 128.62 toks/s]

 92%|█████████▏| 76/83 [06:58<00:36,  5.20s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.07s/it, est. speed input: 55.77 toks/s, output: 128.50 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.07s/it, est. speed input: 55.77 toks/s, output: 128.50 toks/s]

 93%|█████████▎| 77/83 [07:02<00:29,  4.86s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.78s/it, est. speed input: 64.44 toks/s, output: 128.52 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.78s/it, est. speed input: 64.44 toks/s, output: 128.52 toks/s]

 94%|█████████▍| 78/83 [07:04<00:21,  4.24s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.78s/it, est. speed input: 42.88 toks/s, output: 128.46 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.78s/it, est. speed input: 42.88 toks/s, output: 128.46 toks/s]

 95%|█████████▌| 79/83 [07:10<00:18,  4.70s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.29s/it, est. speed input: 49.62 toks/s, output: 128.58 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.29s/it, est. speed input: 49.62 toks/s, output: 128.58 toks/s]

 96%|█████████▋| 80/83 [07:14<00:13,  4.58s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.99s/it, est. speed input: 46.65 toks/s, output: 128.65 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.99s/it, est. speed input: 46.65 toks/s, output: 128.65 toks/s]

 98%|█████████▊| 81/83 [07:18<00:08,  4.40s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.30s/it, est. speed input: 62.50 toks/s, output: 128.64 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.30s/it, est. speed input: 62.50 toks/s, output: 128.64 toks/s]

 99%|█████████▉| 82/83 [07:22<00:04,  4.07s/it]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.24s/it, est. speed input: 23.35 toks/s, output: 128.77 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.24s/it, est. speed input: 23.35 toks/s, output: 128.77 toks/s]

100%|██████████| 83/83 [07:29<00:00,  5.02s/it]
100%|██████████| 83/83 [07:29<00:00,  5.42s/it]
ACC: 0.37349397590361444
[rank0]: Traceback (most recent call last):
[rank0]:   File "/volume/ailab4sci/txie/ydl/Short-RL/Logic-RL/Math_eval/test_amc.py", line 111, in <module>
[rank0]:     main()
[rank0]:   File "/volume/ailab4sci/txie/ydl/Short-RL/Logic-RL/Math_eval/test_amc.py", line 106, in main
[rank0]:     output_json = f"amc_output_{args.stage}_{args.step}.json"
[rank0]: AttributeError: 'Namespace' object has no attribute 'stage'
