# Baseline fork from ORLM: Training Large Language Models for Optimization Modeling

try to run following command to evaluate:

```bash
#Single Case
bash scripts/eval.IndustryOR.pass1.sh ./models/CardinalOperations/ORLM-LLaMA-3-8B 1

bash scripts/eval.BWOR.pass1.sh ./models/CardinalOperations/ORLM-LLaMA-3-8B 1

bash scripts/eval.BWOR.pass1.sh ./models/meta-llama/Meta-Llama-3-8B-Instruct 1

bash scripts/eval.BWOR.pass1.sh ./models/meta-llama/Meta-Llama-3-8B 1

#Full running
bash scripts/eval.all.sh ./models/CardinalOperations/ORLM-LLaMA-3-8B 1

bash scripts/eval.all.sh ./models/Undi95/Meta-Llama-3-8B-Instruct-hf 1

bash scripts/eval.all.sh ./models/meta-llama/Meta-Llama-3-8B-Instruct 1

bash scripts/eval.all.sh ./models/meta-llama/Meta-Llama-3-8B 1

#Run with OpenAI
bash script_openai/eval_openai.all.sh ./results deepseek/deepseek-r1-0528:free

bash script_openai/eval_openai.IndustryOR.pass1.sh ./results deepseek/deepseek-r1-0528:free

bash script_openai/eval_openai.IndustryOR.pass1.sh ./results deepseek/deepseek-chat-v3-0324:free

bash script_openai/eval_openai.BWOR.pass1.sh ./results deepseek/deepseek-r1-distill-qwen-32b

bash script_openai/eval_openai.BWOR.pass1.sh ./results qwen/qwen3-235b-a22b

bash script_openai/eval_openai.IndustryOR.pass1.sh ./results qwen/qwen3-235b-a22b

```

Make sure to setup your OpenAI API key in `.env` file!

```bash
#setup a .env file
cp .env.example .env
```
