<h1 align="center">
    <p> EigenLoRAx: Efficient Low Rank Adaptation using Recycled Principle Subspaces</p>
</h1>
 
<h1 align="center"> 
    <image src="./imgs/elorax.png"/>
</h1>

### Setup
```console
conda env create -f environment.yml
conda activate eigenlorax
```


## Usage

In order to find the EigenLoRAxs Principal Components, start with a few pretrained LoRA adapters for the same base model. 

