# BIRD-Ent Evaluation
This directory contains the evaluation script for BIRD-Ent, which is modified from the original BIRD evaluation script. An example of inference results can be found in `./examples/output_qwen3-235b.json`
## Evaluation Steps
- Convert the inference result file into the format required for evaluation, and simultaneously transform the table and column names in the inferred SQL queries to their original counterparts in the BIRD database, so that the SQL queries can be executed on the original database.
```python
python convert_output.py
```

- Run the shell script to obtain the evaluation results.
```sh
sh evaluation/run_evaluation.sh
```

---

# Spider-Ent Evaluation
This directory contains the evaluation script for Spider-Ent, which is modified from the original Spider evaluation script. An example of inference results can be found in `./examples/output_qwen3-235b.json`
## Evaluation Steps
- Convert the inference result file into the format required for evaluation, and simultaneously transform the table and column names in the inferred SQL queries to their original counterparts in the Spider database, so that the SQL queries can be executed on the original database.
```python
python convert_output.py
```

- Run the shell script to obtain the evaluation results.
```sh
sh eval-sql-ex.sh
```