=== START DATE: Thu Sep 28 12:33:37 EDT 2023 ===
# GIT COMMIT: d000331e8089c1a51fe65b29d28fed37e2e8b171 ===
2023-09-28 12:33:41 [INFO] MINT: Experiment config: {'agent': {'agent_class': 'VLLMAgent', 'config': {'model_name': 'lemur-70b-chat-v1/', 'chat_mode': False, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': '<YOUR_API_BASE>', 'add_system_message': False}}, 'task': {'task_class': 'HumanEvalTask', 'task_type': 'code_generation', 'tool_imports': [], 'filepath': 'data/processed/humaneval/test_prompts.json'}, 'output_dir': 'data/outputs/lemur-70b-chat-v1/F=gpt-4-0613/PHF=no_GT-textual/max5_p2+tool+cd/code_generation/humaneval', 'env_config': {'max_steps': 5, 'use_tools': True, 'max_propose_solution': 2, 'count_down': True}, 'feedback_config': {'feedback_agent_config': {'chat_mode': True, 'max_tokens': 1024, 'temperature': 0.0, 'stop': ['\nQ:'], 'agent_class': 'OpenAIFeedbackAgent', 'model_name': 'gpt-4-0613', 'openai.api_base': 'http://blender09.cs.illinois.edu:8000/v1'}, 'pseudo_human_feedback': 'no_GT', 'feedback_form': 'textual'}}
2023-09-28 12:33:41 [INFO] MINT: Loaded 45 tasks from data/processed/humaneval/test_prompts.json
2023-09-28 12:33:41 [INFO] MINT: Initialized VLLMAgent with config: {'model_name': 'lemur-70b-chat-v1/', 'chat_mode': False, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': '<YOUR_API_BASE>', 'add_system_message': False}
2023-09-28 12:33:41 [INFO] MINT: remember to openup the server using docs/SERVING.mdh
2023-09-28 12:33:41 [INFO] MINT: Existing output file found. 45 tasks done.
2023-09-28 12:33:41 [INFO] MINT: All tasks done. Exiting.
=== START DATE: Thu Sep 28 12:34:28 EDT 2023 ===
# GIT COMMIT: d000331e8089c1a51fe65b29d28fed37e2e8b171 ===
2023-09-28 12:34:32 [INFO] MINT: Experiment config: {'agent': {'agent_class': 'VLLMAgent', 'config': {'model_name': 'lemur-70b-chat-v1/', 'chat_mode': False, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}}, 'task': {'task_class': 'HumanEvalTask', 'task_type': 'code_generation', 'tool_imports': [], 'filepath': 'data/processed/humaneval/test_prompts.json'}, 'output_dir': 'data/outputs/lemur-70b-chat-v1/F=gpt-4-0613/PHF=no_GT-textual/max5_p2+tool+cd/code_generation/humaneval', 'env_config': {'max_steps': 5, 'use_tools': True, 'max_propose_solution': 2, 'count_down': True}, 'feedback_config': {'feedback_agent_config': {'chat_mode': True, 'max_tokens': 1024, 'temperature': 0.0, 'stop': ['\nQ:'], 'agent_class': 'OpenAIFeedbackAgent', 'model_name': 'gpt-4-0613', 'openai.api_base': 'http://blender09.cs.illinois.edu:8000/v1'}, 'pseudo_human_feedback': 'no_GT', 'feedback_form': 'textual'}}
2023-09-28 12:34:32 [INFO] MINT: Loaded 45 tasks from data/processed/humaneval/test_prompts.json
2023-09-28 12:34:32 [INFO] MINT: Initialized VLLMAgent with config: {'model_name': 'lemur-70b-chat-v1/', 'chat_mode': False, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}
2023-09-28 12:34:32 [INFO] MINT: remember to openup the server using docs/SERVING.mdh
2023-09-28 12:34:32 [INFO] MINT: Existing output file found. 45 tasks done.
2023-09-28 12:34:32 [INFO] MINT: All tasks done. Exiting.
=== START DATE: Thu Sep 28 12:35:03 EDT 2023 ===
# GIT COMMIT: d000331e8089c1a51fe65b29d28fed37e2e8b171 ===
2023-09-28 12:35:07 [INFO] MINT: Experiment config: {'agent': {'agent_class': 'VLLMAgent', 'config': {'model_name': 'lemur-70b-chat-v1', 'chat_mode': False, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}}, 'task': {'task_class': 'HumanEvalTask', 'task_type': 'code_generation', 'tool_imports': [], 'filepath': 'data/processed/humaneval/test_prompts.json'}, 'output_dir': 'data/outputs/lemur-70b-chat-v1/F=gpt-4-0613/PHF=no_GT-textual/max5_p2+tool+cd/code_generation/humaneval', 'env_config': {'max_steps': 5, 'use_tools': True, 'max_propose_solution': 2, 'count_down': True}, 'feedback_config': {'feedback_agent_config': {'chat_mode': True, 'max_tokens': 1024, 'temperature': 0.0, 'stop': ['\nQ:'], 'agent_class': 'OpenAIFeedbackAgent', 'model_name': 'gpt-4-0613', 'openai.api_base': 'http://blender09.cs.illinois.edu:8000/v1'}, 'pseudo_human_feedback': 'no_GT', 'feedback_form': 'textual'}}
2023-09-28 12:35:07 [INFO] MINT: Loaded 45 tasks from data/processed/humaneval/test_prompts.json
2023-09-28 12:35:07 [INFO] MINT: Initialized VLLMAgent with config: {'model_name': 'lemur-70b-chat-v1', 'chat_mode': False, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}
2023-09-28 12:35:07 [INFO] MINT: remember to openup the server using docs/SERVING.mdh
2023-09-28 12:35:07 [INFO] MINT: Existing output file found. 45 tasks done.
2023-09-28 12:35:07 [INFO] MINT: All tasks done. Exiting.
=== START DATE: Thu Sep 28 12:37:57 EDT 2023 ===
# GIT COMMIT: d000331e8089c1a51fe65b29d28fed37e2e8b171 ===
2023-09-28 12:38:01 [INFO] MINT: Experiment config: {'agent': {'agent_class': 'VLLMAgent', 'config': {'model_name': 'lemur-70b-chat-v1', 'chat_mode': True, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}}, 'task': {'task_class': 'HumanEvalTask', 'task_type': 'code_generation', 'tool_imports': [], 'filepath': 'data/processed/humaneval/test_prompts.json'}, 'output_dir': 'data/outputs/lemur-70b-chat-v1/F=gpt-4-0613/PHF=no_GT-textual/max5_p2+tool+cd/code_generation/humaneval', 'env_config': {'max_steps': 5, 'use_tools': True, 'max_propose_solution': 2, 'count_down': True}, 'feedback_config': {'feedback_agent_config': {'chat_mode': True, 'max_tokens': 1024, 'temperature': 0.0, 'stop': ['\nQ:'], 'agent_class': 'OpenAIFeedbackAgent', 'model_name': 'gpt-4-0613', 'openai.api_base': 'http://blender09.cs.illinois.edu:8000/v1'}, 'pseudo_human_feedback': 'no_GT', 'feedback_form': 'textual'}}
2023-09-28 12:38:01 [INFO] MINT: Loaded 45 tasks from data/processed/humaneval/test_prompts.json
2023-09-28 12:38:01 [INFO] MINT: Initialized VLLMAgent with config: {'model_name': 'lemur-70b-chat-v1', 'chat_mode': True, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}
2023-09-28 12:38:01 [INFO] MINT: remember to openup the server using docs/SERVING.mdh
2023-09-28 12:38:01 [INFO] MINT: Existing output file found. 45 tasks done.
2023-09-28 12:38:01 [INFO] MINT: All tasks done. Exiting.
=== START DATE: Thu Sep 28 14:54:36 EDT 2023 ===
# GIT COMMIT: 4db04010b08914447be97e890b8000fb99baa076 ===
2023-09-28 14:54:40 [INFO] MINT: Experiment config: {'agent': {'agent_class': 'VLLMAgent', 'config': {'model_name': 'lemur-70b-chat-v1', 'chat_mode': True, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}}, 'task': {'task_class': 'HumanEvalTask', 'task_type': 'code_generation', 'tool_imports': [], 'filepath': 'data/processed/humaneval/test_prompts.json'}, 'output_dir': 'data/outputs/lemur-70b-chat-v1/F=gpt-4-0613/PHF=no_GT-textual/max5_p2+tool+cd/code_generation/humaneval', 'env_config': {'max_steps': 5, 'use_tools': True, 'max_propose_solution': 2, 'count_down': True}, 'feedback_config': {'feedback_agent_config': {'chat_mode': True, 'max_tokens': 1024, 'temperature': 0.0, 'stop': ['\nQ:'], 'agent_class': 'OpenAIFeedbackAgent', 'model_name': 'gpt-4-0613', 'openai.api_base': 'http://64.247.206.58:8010/v1', 'override': {'assistant': 'ASSISTANT', 'human': 'HUMAN'}}, 'pseudo_human_feedback': 'no_GT', 'feedback_form': 'textual'}}
2023-09-28 14:54:40 [INFO] MINT: Loaded 45 tasks from data/processed/humaneval/test_prompts.json
2023-09-28 14:54:40 [INFO] MINT: Initialized VLLMAgent with config: {'model_name': 'lemur-70b-chat-v1', 'chat_mode': True, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}
2023-09-28 14:54:40 [INFO] MINT: remember to openup the server using docs/SERVING.mdh
2023-09-28 14:54:40 [INFO] MINT: Existing output file found. 45 tasks done.
2023-09-28 14:54:40 [INFO] MINT: All tasks done. Exiting.
=== START DATE: Thu Sep 28 15:04:54 EDT 2023 ===
# GIT COMMIT: 4db04010b08914447be97e890b8000fb99baa076 ===
2023-09-28 15:04:58 [INFO] MINT: Experiment config: {'agent': {'agent_class': 'VLLMAgent', 'config': {'model_name': 'lemur-70b-chat-v1', 'chat_mode': True, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}}, 'task': {'task_class': 'HumanEvalTask', 'task_type': 'code_generation', 'tool_imports': [], 'filepath': 'data/processed/humaneval/test_prompts.json'}, 'output_dir': 'data/outputs/lemur-70b-chat-v1/F=gpt-4-0613/PHF=no_GT-textual/max5_p2+tool+cd/code_generation/humaneval', 'env_config': {'max_steps': 5, 'use_tools': True, 'max_propose_solution': 2, 'count_down': True}, 'feedback_config': {'feedback_agent_config': {'chat_mode': True, 'max_tokens': 1024, 'temperature': 0.0, 'stop': ['\nQ:'], 'agent_class': 'OpenAIFeedbackAgent', 'model_name': 'gpt-4-0613', 'openai.api_base': 'http://64.247.206.58:8010/v1', 'override': {'assistant': 'ASSISTANT', 'human': 'HUMAN'}}, 'pseudo_human_feedback': 'no_GT', 'feedback_form': 'textual'}}
2023-09-28 15:04:58 [INFO] MINT: Loaded 45 tasks from data/processed/humaneval/test_prompts.json
2023-09-28 15:04:58 [INFO] MINT: Initialized VLLMAgent with config: {'model_name': 'lemur-70b-chat-v1', 'chat_mode': True, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}
2023-09-28 15:04:58 [INFO] MINT: remember to openup the server using docs/SERVING.mdh
2023-09-28 15:04:58 [INFO] MINT: Existing output file found. 45 tasks done.
2023-09-28 15:04:58 [INFO] MINT: All tasks done. Exiting.
=== START DATE: Thu Sep 28 15:13:13 EDT 2023 ===
# GIT COMMIT: 4db04010b08914447be97e890b8000fb99baa076 ===
2023-09-28 15:13:18 [INFO] MINT: Experiment config: {'agent': {'agent_class': 'VLLMAgent', 'config': {'model_name': 'lemur-70b-chat-v1', 'chat_mode': True, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}}, 'task': {'task_class': 'HumanEvalTask', 'task_type': 'code_generation', 'tool_imports': [], 'filepath': 'data/processed/humaneval/test_prompts.json'}, 'output_dir': 'data/outputs/lemur-70b-chat-v1/F=gpt-4-0613/PHF=no_GT-textual/max5_p2+tool+cd/code_generation/humaneval', 'env_config': {'max_steps': 5, 'use_tools': True, 'max_propose_solution': 2, 'count_down': True}, 'feedback_config': {'feedback_agent_config': {'chat_mode': True, 'max_tokens': 1024, 'temperature': 0.0, 'stop': ['\nQ:'], 'agent_class': 'OpenAIFeedbackAgent', 'model_name': 'gpt-4-0613', 'openai.api_base': 'http://64.247.206.58:8010/v1', 'override': {'assistant': 'ASSISTANT', 'human': 'HUMAN'}}, 'pseudo_human_feedback': 'no_GT', 'feedback_form': 'textual'}}
2023-09-28 15:13:18 [INFO] MINT: Loaded 45 tasks from data/processed/humaneval/test_prompts.json
2023-09-28 15:13:18 [INFO] MINT: Initialized VLLMAgent with config: {'model_name': 'lemur-70b-chat-v1', 'chat_mode': True, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}
2023-09-28 15:13:18 [INFO] MINT: remember to openup the server using docs/SERVING.mdh
2023-09-28 15:13:18 [INFO] MINT: Existing output file found. 45 tasks done.
2023-09-28 15:13:18 [INFO] MINT: All tasks done. Exiting.
=== START DATE: Thu Sep 28 15:21:33 EDT 2023 ===
# GIT COMMIT: 4db04010b08914447be97e890b8000fb99baa076 ===
2023-09-28 15:21:37 [INFO] MINT: Experiment config: {'agent': {'agent_class': 'VLLMAgent', 'config': {'model_name': 'lemur-70b-chat-v1', 'chat_mode': True, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}}, 'task': {'task_class': 'HumanEvalTask', 'task_type': 'code_generation', 'tool_imports': [], 'filepath': 'data/processed/humaneval/test_prompts.json'}, 'output_dir': 'data/outputs/lemur-70b-chat-v1/F=gpt-4-0613/PHF=no_GT-textual/max5_p2+tool+cd/code_generation/humaneval', 'env_config': {'max_steps': 5, 'use_tools': True, 'max_propose_solution': 2, 'count_down': True}, 'feedback_config': {'feedback_agent_config': {'chat_mode': True, 'max_tokens': 1024, 'temperature': 0.0, 'stop': ['\nQ:'], 'agent_class': 'OpenAIFeedbackAgent', 'model_name': 'gpt-4-0613', 'openai.api_base': 'http://64.247.206.58:8010/v1', 'override': {'assistant': 'ASSISTANT', 'human': 'HUMAN'}}, 'pseudo_human_feedback': 'no_GT', 'feedback_form': 'textual'}}
2023-09-28 15:21:37 [INFO] MINT: Loaded 45 tasks from data/processed/humaneval/test_prompts.json
2023-09-28 15:21:37 [INFO] MINT: Initialized VLLMAgent with config: {'model_name': 'lemur-70b-chat-v1', 'chat_mode': True, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}
2023-09-28 15:21:37 [INFO] MINT: remember to openup the server using docs/SERVING.mdh
2023-09-28 15:21:37 [INFO] MINT: Existing output file found. 45 tasks done.
2023-09-28 15:21:37 [INFO] MINT: All tasks done. Exiting.
=== START DATE: Thu Sep 28 15:34:16 EDT 2023 ===
# GIT COMMIT: 4db04010b08914447be97e890b8000fb99baa076 ===
2023-09-28 15:34:20 [INFO] MINT: Experiment config: {'agent': {'agent_class': 'VLLMAgent', 'config': {'model_name': 'lemur-70b-chat-v1', 'chat_mode': True, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8010/v1', 'add_system_message': False}}, 'task': {'task_class': 'HumanEvalTask', 'task_type': 'code_generation', 'tool_imports': [], 'filepath': 'data/processed/humaneval/test_prompts.json'}, 'output_dir': 'data/outputs/lemur-70b-chat-v1/F=gpt-4-0613/PHF=no_GT-textual/max5_p2+tool+cd/code_generation/humaneval', 'env_config': {'max_steps': 5, 'use_tools': True, 'max_propose_solution': 2, 'count_down': True}, 'feedback_config': {'feedback_agent_config': {'chat_mode': True, 'max_tokens': 1024, 'temperature': 0.0, 'stop': ['\nQ:'], 'agent_class': 'OpenAIFeedbackAgent', 'model_name': 'gpt-4-0613', 'openai.api_base': 'http://64.247.206.58:8010/v1', 'override': {'assistant': 'ASSISTANT', 'human': 'HUMAN'}}, 'pseudo_human_feedback': 'no_GT', 'feedback_form': 'textual'}}
2023-09-28 15:34:20 [INFO] MINT: Loaded 45 tasks from data/processed/humaneval/test_prompts.json
2023-09-28 15:34:20 [INFO] MINT: Initialized VLLMAgent with config: {'model_name': 'lemur-70b-chat-v1', 'chat_mode': True, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8010/v1', 'add_system_message': False}
2023-09-28 15:34:20 [INFO] MINT: remember to openup the server using docs/SERVING.mdh
2023-09-28 15:34:20 [INFO] MINT: Existing output file found. 45 tasks done.
2023-09-28 15:34:20 [INFO] MINT: All tasks done. Exiting.
=== START DATE: Thu Sep 28 15:35:48 EDT 2023 ===
# GIT COMMIT: 4db04010b08914447be97e890b8000fb99baa076 ===
=== START DATE: Thu Sep 28 15:40:03 EDT 2023 ===
# GIT COMMIT: 4db04010b08914447be97e890b8000fb99baa076 ===
2023-09-28 15:40:07 [INFO] MINT: Experiment config: {'agent': {'agent_class': 'VLLMAgent', 'config': {'model_name': 'lemur-70b-chat-v1', 'chat_mode': True, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}}, 'task': {'task_class': 'HumanEvalTask', 'task_type': 'code_generation', 'tool_imports': [], 'filepath': 'data/processed/humaneval/test_prompts.json'}, 'output_dir': 'data/outputs/lemur-70b-chat-v1/F=gpt-4-0613/PHF=no_GT-textual/max5_p2+tool+cd/code_generation/humaneval', 'env_config': {'max_steps': 5, 'use_tools': True, 'max_propose_solution': 2, 'count_down': True}, 'feedback_config': {'feedback_agent_config': {'chat_mode': True, 'max_tokens': 1024, 'temperature': 0.0, 'stop': ['\nQ:'], 'agent_class': 'OpenAIFeedbackAgent', 'model_name': 'gpt-4-0613', 'openai.api_base': 'http://64.247.206.58:8010/v1', 'override': {'assistant': 'ASSISTANT', 'human': 'HUMAN'}}, 'pseudo_human_feedback': 'no_GT', 'feedback_form': 'textual'}}
2023-09-28 15:40:07 [INFO] MINT: Loaded 45 tasks from data/processed/humaneval/test_prompts.json
2023-09-28 15:40:07 [INFO] MINT: Initialized VLLMAgent with config: {'model_name': 'lemur-70b-chat-v1', 'chat_mode': True, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}
2023-09-28 15:40:07 [INFO] MINT: remember to openup the server using docs/SERVING.mdh
2023-09-28 15:40:07 [INFO] MINT: Existing output file found. 45 tasks done.
2023-09-28 15:40:07 [INFO] MINT: All tasks done. Exiting.
=== START DATE: Thu Sep 28 15:42:54 EDT 2023 ===
# GIT COMMIT: 4db04010b08914447be97e890b8000fb99baa076 ===
2023-09-28 15:42:58 [INFO] MINT: Experiment config: {'agent': {'agent_class': 'VLLMAgent', 'config': {'model_name': 'lemur-70b-chat-v1', 'chat_mode': True, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}}, 'task': {'task_class': 'HumanEvalTask', 'task_type': 'code_generation', 'tool_imports': [], 'filepath': 'data/processed/humaneval/test_prompts.json'}, 'output_dir': 'data/outputs/lemur-70b-chat-v1/F=gpt-4-0613/PHF=no_GT-textual/max5_p2+tool+cd/code_generation/humaneval', 'env_config': {'max_steps': 5, 'use_tools': True, 'max_propose_solution': 2, 'count_down': True}, 'feedback_config': {'feedback_agent_config': {'chat_mode': True, 'max_tokens': 1024, 'temperature': 0.0, 'stop': ['\nQ:'], 'agent_class': 'OpenAIFeedbackAgent', 'model_name': 'gpt-4-0613', 'openai.api_base': 'http://64.247.206.58:8010/v1', 'override': {'assistant': 'ASSISTANT', 'human': 'HUMAN'}}, 'pseudo_human_feedback': 'no_GT', 'feedback_form': 'textual'}}
2023-09-28 15:42:58 [INFO] MINT: Loaded 45 tasks from data/processed/humaneval/test_prompts.json
2023-09-28 15:42:58 [INFO] MINT: Initialized VLLMAgent with config: {'model_name': 'lemur-70b-chat-v1', 'chat_mode': True, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}
2023-09-28 15:42:58 [INFO] MINT: remember to openup the server using docs/SERVING.mdh
2023-09-28 15:42:58 [INFO] MINT: Existing output file found. 45 tasks done.
2023-09-28 15:42:58 [INFO] MINT: All tasks done. Exiting.
=== START DATE: Thu Sep 28 16:12:47 EDT 2023 ===
# GIT COMMIT: 4db04010b08914447be97e890b8000fb99baa076 ===
2023-09-28 16:12:51 [INFO] MINT: Experiment config: {'agent': {'agent_class': 'VLLMAgent', 'config': {'model_name': 'lemur-70b-chat-v1', 'chat_mode': True, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}}, 'task': {'task_class': 'HumanEvalTask', 'task_type': 'code_generation', 'tool_imports': [], 'filepath': 'data/processed/humaneval/test_prompts.json'}, 'output_dir': 'data/outputs/lemur-70b-chat-v1/F=gpt-4-0613/PHF=no_GT-textual/max5_p2+tool+cd/code_generation/humaneval', 'env_config': {'max_steps': 5, 'use_tools': True, 'max_propose_solution': 2, 'count_down': True}, 'feedback_config': {'feedback_agent_config': {'chat_mode': True, 'max_tokens': 1024, 'temperature': 0.0, 'stop': ['\nQ:'], 'agent_class': 'OpenAIFeedbackAgent', 'model_name': 'gpt-4-0613', 'openai.api_base': 'http://64.247.206.58:8010/v1', 'override': {'assistant': 'ASSISTANT', 'human': 'HUMAN'}}, 'pseudo_human_feedback': 'no_GT', 'feedback_form': 'textual'}}
2023-09-28 16:12:51 [INFO] MINT: Loaded 45 tasks from data/processed/humaneval/test_prompts.json
2023-09-28 16:12:51 [INFO] MINT: Initialized VLLMAgent with config: {'model_name': 'lemur-70b-chat-v1', 'chat_mode': True, 'max_tokens': 512, 'temperature': 0.0, 'openai.api_base': 'http://64.247.206.58:8000/v1', 'add_system_message': False}
2023-09-28 16:12:51 [INFO] MINT: remember to openup the server using docs/SERVING.mdh
2023-09-28 16:12:51 [INFO] MINT: Existing output file found. 45 tasks done.
2023-09-28 16:12:51 [INFO] MINT: All tasks done. Exiting.
