# ID-LoRA: Low Rank Adaptation Inspired by Interpolation Decomposition for Efficient Fine-Tuning -> Implementation

![License](https://img.shields.io/badge/license-MIT-blue) ![Python](https://img.shields.io/badge/python-3.8%2B-green) ![PyTorch](https://img.shields.io/badge/pytorch-2.1.0%2B-orange)

This project is the official implementation of Paper《ID-LoRA: Low Rank Adaptation Inspired by Interpolation Decomposition for Efficient Fine-Tuning》


## 🚀 Start 

### Environment
- Python 3.8+
- PyTorch 2.4.0
- Other dependent libraries (See `requirements.txt`)

```bash
pip install -r requirements.txt
```

### Install 

```bash
cd ./peft-0.15.0-cluster
pip install .
cd ..
```
### Run
```bash
sh ./scripts/id-lora/multi_llama3_r_128.sh
```

