
We ranked the AdvBench dataset by using SALMAN and then evaluate it based on the GCG and AutoDAN methods. GCG and AutoDAN are completely open source, and the code bases are as follows: [GPG](whttps://github.com/llm-attacks/llm-attacks/tree/main), [AutoDAN](https://github.com/SheltonLiu-N/AutoDAN)

### Step 1. Using SALMAN Ranking
```
python sample_code.py
```
The results will saved into sub-folder under gcg folder and AutoDAN folder.

### Step 2. Random Selection
Randomly select one percent of the data

### Step 3. Evaluating on GCG
Go to the gcg folder and run 
```
run.ipynb
```

### Step 4. Evaluating on AutoDAN
Go to the AutoDAN folder and run 
```
autodan_ga_eval.py
```


