# SemGrad

- Bem model (Used for correctness evaluation). Please download the model from [Download link](https://tfhub.dev/google/answer_equivalence/bem/1) then save it to the directory **data/model/** (or change the default cache path **CACHED_BEM_PATH** in **uncertainty/generation_evaluation/metrics/bem.py** line 40). 

## Generation and Evaluation Correctness
run run_generations.sh

## RUN Baselines
run run_baselines.sh

## RUN SemGrad and HybridGrad
run run_semgrad.sh