## Setup Environment

### Create and activate the conda env
```bash
conda create -n NLG python=3.7
conda activate NLG 
```

### Install Pytorch
```bash
pip install torch==1.9.1+cu111 torchvision==0.10.1+cu111 torchaudio==0.9.1 -f https://download.pytorch.org/whl/torch_stable.html
```

### Install the pre-requisites
Install dependencies: 
```bash
pip install -r requirements.txt
```

Install `transformers`: 
```bash
pip install -e . 
```

Install the updated `loralib`:
```bash
pip install -e ../loralib/
```


## Adapt BART on summarization tasks
example
```bash
sh scripts/run_debertav3_squad.sh
```
For details, please refer to folder scripts/ and scripts_ada/
