# DPO LoRTA

This experiments are based on trl.

First install peft (which includes the implementation of LoRTA) from the `../nlu` directory.

Then follow trl's installation guide.

Finally, experiment scripts can be found at `examples/scripts/lora.sh` and `examples/scripts/lorta.sh`.