# Data Geneartion

Use `python generator/generate.py -h` to see all available flags. Run `python generator/generate.py` with flags to generate data. Generated data will be put under the `data` folder.

# Evaluation

Use `python evaluator/evaluate.py -h` to see all available flags and arguments. Accuracy on postive samples, on negative samples and for the overall dataset will be outputed in the terminal. A copy of LLM's response will be put inside the `results` folder within `evaluator` folder of this repo.
