INFO 05-13 20:58:39 config.py:1670] Downcasting torch.float32 to torch.bfloat16.
WARNING 05-13 20:58:45 arg_utils.py:953] Chunked prefill is enabled by default for models with max_model_len > 32K. Currently, chunked prefill might not work with some features or models. If you encounter any issues, please disable chunked prefill by setting --enable-chunked-prefill=False.
INFO 05-13 20:58:45 config.py:1005] Chunked prefill is enabled with max_num_batched_tokens=512.
INFO 05-13 20:58:45 llm_engine.py:237] Initializing an LLM engine (vdev) with config: model='/volume/ailab4sci/txie/ydl/short_ablation2/CosFn/actor/global_step_1686', speculative_config=None, tokenizer='/volume/ailab4sci/txie/ydl/short_ablation2/CosFn/actor/global_step_1686', skip_tokenizer_init=False, tokenizer_mode=auto, revision=None, override_neuron_config=None, rope_scaling=None, rope_theta=None, tokenizer_revision=None, trust_remote_code=True, dtype=torch.bfloat16, max_seq_len=131072, download_dir=None, load_format=LoadFormat.AUTO, tensor_parallel_size=1, pipeline_parallel_size=1, disable_custom_all_reduce=False, quantization=None, enforce_eager=False, kv_cache_dtype=auto, quantization_param_path=None, device_config=cuda, decoding_config=DecodingConfig(guided_decoding_backend='outlines'), observability_config=ObservabilityConfig(otlp_traces_endpoint=None, collect_model_forward_time=False, collect_model_execute_time=False), seed=0, served_model_name=/volume/ailab4sci/txie/ydl/short_ablation2/CosFn/actor/global_step_1686, use_v2_block_manager=True, num_scheduler_steps=1, chunked_prefill_enabled=True multi_step_stream_outputs=True, enable_prefix_caching=False, use_async_output_proc=True, use_cached_outputs=False, mm_processor_kwargs=None)
INFO 05-13 20:58:47 model_runner.py:1060] Starting to load model /volume/ailab4sci/txie/ydl/short_ablation2/CosFn/actor/global_step_1686...

Loading safetensors checkpoint shards:   0% Completed | 0/7 [00:00<?, ?it/s]

Loading safetensors checkpoint shards:  14% Completed | 1/7 [00:01<00:06,  1.09s/it]

Loading safetensors checkpoint shards:  29% Completed | 2/7 [00:02<00:05,  1.18s/it]

Loading safetensors checkpoint shards:  43% Completed | 3/7 [00:03<00:04,  1.19s/it]

Loading safetensors checkpoint shards:  57% Completed | 4/7 [00:04<00:03,  1.22s/it]

Loading safetensors checkpoint shards:  71% Completed | 5/7 [00:05<00:02,  1.13s/it]

Loading safetensors checkpoint shards:  86% Completed | 6/7 [00:06<00:01,  1.13s/it]

Loading safetensors checkpoint shards: 100% Completed | 7/7 [00:07<00:00,  1.02it/s]

Loading safetensors checkpoint shards: 100% Completed | 7/7 [00:07<00:00,  1.08s/it]

INFO 05-13 20:58:55 model_runner.py:1071] Loading model weights took 14.2716 GB
INFO 05-13 20:58:56 gpu_executor.py:122] # GPU blocks: 66252, # CPU blocks: 4681
INFO 05-13 20:58:56 gpu_executor.py:126] Maximum concurrency for 131072 tokens per request: 8.09x
INFO 05-13 20:58:59 model_runner.py:1402] Capturing the model for CUDA graphs. This may lead to unexpected consequences if the model is not static. To run the model in eager mode, set 'enforce_eager=True' or use '--enforce-eager' in the CLI.
INFO 05-13 20:58:59 model_runner.py:1406] CUDA graphs can take additional 1~3 GiB memory per GPU. If you are running out of memory, consider decreasing `gpu_memory_utilization` or enforcing eager mode. You can also reduce the `max_num_seqs` as needed to decrease memory usage.
INFO 05-13 20:59:00 model_runner.py:1530] Graph capturing finished in 1 secs.

  0%|          | 0/83 [00:00<?, ?it/s]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 37.72it/s, est. speed input: 6730.85 toks/s, output: 37.79 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.02it/s, est. speed input: 8503.83 toks/s, output: 49.12 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.82it/s, est. speed input: 9242.41 toks/s, output: 49.92 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 50.10it/s, est. speed input: 9294.44 toks/s, output: 50.20 toks/s]

  5%|▍         | 4/83 [00:00<00:02, 36.86it/s]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 48.17it/s, est. speed input: 10771.97 toks/s, output: 48.27 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.91it/s, est. speed input: 9059.62 toks/s, output: 50.02 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.79it/s, est. speed input: 10235.49 toks/s, output: 49.89 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 48.83it/s, est. speed input: 12291.54 toks/s, output: 48.93 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.59it/s, est. speed input: 12033.88 toks/s, output: 49.69 toks/s]

 11%|█         | 9/83 [00:00<00:01, 42.58it/s]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.73it/s, est. speed input: 11023.07 toks/s, output: 49.84 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 46.98it/s, est. speed input: 13804.34 toks/s, output: 47.08 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.59it/s, est. speed input: 9099.78 toks/s, output: 49.69 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 45.63it/s, est. speed input: 10613.97 toks/s, output: 45.72 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 34.68it/s, est. speed input: 8999.61 toks/s, output: 69.46 toks/s]

 17%|█▋        | 14/83 [00:00<00:01, 42.51it/s]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.77it/s, est. speed input: 12228.00 toks/s, output: 49.88 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 48.32it/s, est. speed input: 14099.89 toks/s, output: 48.42 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 47.98it/s, est. speed input: 12556.93 toks/s, output: 48.08 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 50.29it/s, est. speed input: 9279.21 toks/s, output: 50.40 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.94it/s, est. speed input: 11267.47 toks/s, output: 50.04 toks/s]

 23%|██▎       | 19/83 [00:00<00:01, 44.17it/s]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 35.90it/s, est. speed input: 7157.52 toks/s, output: 71.90 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 44.85it/s, est. speed input: 9133.51 toks/s, output: 44.96 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 47.43it/s, est. speed input: 15075.45 toks/s, output: 47.52 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.75it/s, est. speed input: 9081.17 toks/s, output: 49.86 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.35it/s, est. speed input: 9897.95 toks/s, output: 49.46 toks/s]

 29%|██▉       | 24/83 [00:00<00:01, 43.65it/s]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.53it/s, est. speed input: 9138.57 toks/s, output: 49.63 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.83it/s, est. speed input: 9794.76 toks/s, output: 49.94 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 35.64it/s, est. speed input: 6820.47 toks/s, output: 71.38 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 48.23it/s, est. speed input: 15427.17 toks/s, output: 48.33 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 31.02it/s, est. speed input: 8961.99 toks/s, output: 62.19 toks/s]

 35%|███▍      | 29/83 [00:00<00:01, 42.11it/s]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.08it/s, est. speed input: 10974.06 toks/s, output: 49.18 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.89it/s, est. speed input: 10257.59 toks/s, output: 50.00 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.66it/s, est. speed input: 11353.72 toks/s, output: 49.76 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.75it/s, est. speed input: 11224.72 toks/s, output: 49.85 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 48.19it/s, est. speed input: 14207.50 toks/s, output: 48.29 toks/s]

 41%|████      | 34/83 [00:00<00:01, 43.53it/s]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 47.60it/s, est. speed input: 13126.89 toks/s, output: 47.70 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 48.11it/s, est. speed input: 15437.62 toks/s, output: 48.21 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 41.73it/s, est. speed input: 20455.12 toks/s, output: 41.81 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 48.95it/s, est. speed input: 8344.43 toks/s, output: 49.05 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.09it/s, est. speed input: 7974.52 toks/s, output: 49.19 toks/s]

 47%|████▋     | 39/83 [00:00<00:01, 43.66it/s]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 48.93it/s, est. speed input: 8783.01 toks/s, output: 49.03 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 47.88it/s, est. speed input: 12483.05 toks/s, output: 47.98 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.43it/s, est. speed input: 8773.24 toks/s, output: 49.53 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 35.70it/s, est. speed input: 6831.99 toks/s, output: 71.50 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 35.39it/s, est. speed input: 7411.12 toks/s, output: 70.88 toks/s]

 53%|█████▎    | 44/83 [00:01<00:00, 42.69it/s]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.68it/s, est. speed input: 8419.50 toks/s, output: 49.78 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.83it/s, est. speed input: 7846.45 toks/s, output: 49.94 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 50.01it/s, est. speed input: 9178.02 toks/s, output: 50.12 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 22.82it/s, est. speed input: 4774.61 toks/s, output: 91.35 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.21it/s, est. speed input: 8291.09 toks/s, output: 49.32 toks/s]

 59%|█████▉    | 49/83 [00:01<00:00, 41.40it/s]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.57it/s, est. speed input: 10041.83 toks/s, output: 49.68 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.25it/s, est. speed input: 10865.43 toks/s, output: 49.35 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 35.55it/s, est. speed input: 6482.64 toks/s, output: 71.20 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 48.00it/s, est. speed input: 12464.71 toks/s, output: 48.09 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 48.03it/s, est. speed input: 12425.71 toks/s, output: 48.13 toks/s]

 65%|██████▌   | 54/83 [00:01<00:00, 41.95it/s]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 45.85it/s, est. speed input: 15864.35 toks/s, output: 45.95 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 35.55it/s, est. speed input: 6767.30 toks/s, output: 71.20 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.68it/s, est. speed input: 8470.02 toks/s, output: 49.79 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 47.89it/s, est. speed input: 15316.79 toks/s, output: 47.98 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 47.56it/s, est. speed input: 13542.78 toks/s, output: 47.65 toks/s]

 71%|███████   | 59/83 [00:01<00:00, 42.16it/s]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.57it/s, est. speed input: 7505.81 toks/s, output: 49.67 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.48it/s, est. speed input: 8087.92 toks/s, output: 49.59 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.52it/s, est. speed input: 10627.42 toks/s, output: 49.63 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.82it/s, est. speed input: 11390.91 toks/s, output: 49.92 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.63it/s, est. speed input: 11446.66 toks/s, output: 49.73 toks/s]

 77%|███████▋  | 64/83 [00:01<00:00, 43.61it/s]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.84it/s, est. speed input: 10095.80 toks/s, output: 49.95 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.52it/s, est. speed input: 12217.87 toks/s, output: 49.63 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 47.73it/s, est. speed input: 12299.31 toks/s, output: 47.82 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.30it/s, est. speed input: 10135.95 toks/s, output: 49.41 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 48.52it/s, est. speed input: 10282.55 toks/s, output: 48.68 toks/s]

 83%|████████▎ | 69/83 [00:01<00:00, 44.48it/s]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 46.72it/s, est. speed input: 12318.83 toks/s, output: 46.81 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.37it/s, est. speed input: 8218.69 toks/s, output: 49.48 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.40it/s, est. speed input: 9561.67 toks/s, output: 49.51 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.74it/s, est. speed input: 10725.08 toks/s, output: 49.85 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.79it/s, est. speed input: 10785.74 toks/s, output: 49.90 toks/s]

 89%|████████▉ | 74/83 [00:01<00:00, 45.08it/s]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 50.27it/s, est. speed input: 8368.64 toks/s, output: 50.38 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 45.79it/s, est. speed input: 15883.86 toks/s, output: 45.88 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.78it/s, est. speed input: 11330.02 toks/s, output: 49.88 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.94it/s, est. speed input: 8964.76 toks/s, output: 50.05 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.86it/s, est. speed input: 12400.01 toks/s, output: 49.96 toks/s]

 95%|█████████▌| 79/83 [00:01<00:00, 45.57it/s]

Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 46.22it/s, est. speed input: 9892.45 toks/s, output: 46.39 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 48.30it/s, est. speed input: 9008.24 toks/s, output: 48.40 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.44it/s, est. speed input: 10212.24 toks/s, output: 49.54 toks/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s, est. speed input: 0.00 toks/s, output: 0.00 toks/s][A
Processed prompts: 100%|██████████| 1/1 [00:00<00:00, 49.79it/s, est. speed input: 8441.66 toks/s, output: 49.92 toks/s]

100%|██████████| 83/83 [00:01<00:00, 43.61it/s]
ACC: 0.0
[rank0]: Traceback (most recent call last):
[rank0]:   File "/volume/ailab4sci/txie/ydl/Short-RL/Logic-RL/Math_eval/test_amc.py", line 111, in <module>
[rank0]:     main()
[rank0]:   File "/volume/ailab4sci/txie/ydl/Short-RL/Logic-RL/Math_eval/test_amc.py", line 106, in main
[rank0]:     output_json = f"amc_output_{args.stage}_{args.step}.json"
[rank0]: AttributeError: 'Namespace' object has no attribute 'stage'
