# Run
We provide the scripts to run the llama7b on gsm8k (the scripts to run other models and datasets are similar to our example scripts):

1. change the model path in `bash/train/7b.sh`

## vft
```
bash bash/train/gsm8k/7b/train_vft.sh
```

## rft
```
bash bash/train/gsm8k/7b/train_rft.sh
```

## rrhf
```
bash bash/train/gsm8k/7b/train_rrhf.sh
```

## pro
```
bash bash/train/gsm8k/7b/train_pro.sh
```


## aft detached constraint
```
bash bash/train/gsm8k/7b/train_dc.sh
```


## aft boundary constraint
```
bash bash/train/gsm8k/7b/train_bc.sh [beta]
```

