
# ROSE and Robust Fine-Tuning Instructions

## ROSE Fine-Tuning

1. Navigate to the **ROSE** folder.
2. Set up the environment following the instructions provided [here](https://github.com/jiangllan/ROSE/tree/main).
3. Move to the **runs** folder and execute the following script to start fine-tuning:
   ```bash
   bash run_all_data_first.sh
   ```
4. Once the model is trained, evaluate it using:
   ```bash
   bash run_test_adv.sh ../temp/... qnli
   ```

## Robust Fine-Tuning

1. Navigate to the **Robustness-of-Transformers-models** directory.
2. Train and measure **CKA** and **STIR** using the following notebook:
   ```text
   model/data/*-SAGMAN.ipynb
   ```
3. To measure **model-level robustness**, go to the **Robustness** folder.



