# RAUQ

## Install

```
wget https://anonymous.4open.science/api/repo/lm-polygraph-0616/zip
unzip zip -d lm-polygraph
pip install -r requirements.txt
```

## Experiments

To reproduce results from the paper on 3 GPUs - select methods in the `run_polygraph_unsup.py` script and run: 

```
cd scripts;
bash run_all_unsup.sh & bash run_all_unsup_1.sh &
```

Use `generate_series_of_exps.ipynb` to regenerate the scripts for run several experiments on different number of GPUs with various datasets and models.

Use `results.ipynb` to generate tables in pandas and latex with the results.
